The center for all Wikitravel images!

Tech:Optionally split long guides into one page per section

From Wikitravel Shared
Revision as of 22:45, 10 July 2007 by Evan (talk | contribs) (New version: Just realized that "Sorry" here means "Sorry you're such a dim bulb, Evan")
Jump to: navigation, search

Moved from en:Wikitravel talk:Article templates

I'd like to broach a subject that has come up before but I feel hasn't been answered satisfactorily.

Our most successful and valuable guides (for example, en:Geneva or en:Montreal) are extremely long. This makes them difficult to read on-line, and hard to edit and work with.

Our principle reason for making them like this is to make it easy for readers to print out a guide for a city, put it in their backpack, and head out to the train station.① This is a worthy goal, and it's the main way that I use Wikitravel for my actual travel guide (I just took en:Ottawa with us this weekend), so I think it's important to retain this functionality. I'm concerned, though, that in trying to balance the requirements of on-line use and off-line use, we've leaned too far towards print.

Here is my suggestion: I'd like to break up our guides into thematic sections, per the article templates, and separate those sections into different sub-pages. For example, en:Geneva#Eat would become en:Geneva/Eat. This should give us shorter pages that are more reasonable to work with and read.

I'd like to have a table of contents show up in the left-hand column (perhaps above "navigation" ?) with links to each sub-page. (This would be tricky but I think it can be done.) There are some interesting issues related to districts of huge cities that would have to be worked out, but I don't think they're insurmountable.

For comparison, see LonelyPlanet's Tokyo②, or Frommer's Tokyo. I'd point to the Rough Guides Tokyo page, but it's impossible to link to, as far as I can tell.

In addition, there would be links on the page to view the entire destination guide (main page and all sub-pages) in a printable version. It would also be possible to have an "edit the entire guide" link, too, but I'm not sure if it would be the Right Thing.

I think technically this would be relatively easy to do. I think it would make the Wikitravel online reading and editing experience considerably more pleasant, and may raise our rate of submissions. The downside is that a printable version of the guides would be an extra click away; however, I think that the paradigm of clicking a link to get a printable version is pretty well established on the Web and that most users wouldn't have a problem with it.

What's the feeling about this idea? Is it crazy? --Evan 11:57, 19 Oct 2005 (EDT)

① Feel free to substitute the luggage type and transportation depot of your choice here.
② Is that "See", "Eat", "Sleep", etc. that I see in the menu, there? Heh.

I would object to this. The Web, as a medium, has no need for distinct pages as such: you can happily keep scrolling on forever, and it's the abomination of the pay-per-view banner ad that makes most commercial sites stretch out what should be a single article into bite-sized chunks. I find it much less distracting to read, and much easier to search, content that is presented on one single page, instead of having to go on a wild click hunt trying to find the one page out of seventeen that has the bit I need. And this is especially so if you want to print out a guide.
I also don't think any of our pages are utterly unreasonable in size: en:Japan and en:New York (city) are the only ones that make it past 100k, and I don't see either one growing very much more. If anything, NYC should be cut down to size, with attractions/hotels/whatnot shunted out to districts... and the fact that so many users seem to have problems with the "city district" concept (newbies always add new sites to the main page, not the district pages) also leads me to believe that further fragmentation is not a good idea. Jpatokal 12:29, 19 Oct 2005 (EDT)
So, I think trying to find, say, hotel information on a long guide page is difficult. I also think that hitting "edit this page" and getting 100K of Wiki markup can be intimidating. I think from a usability point of view it'd be really helpful; splitting destination guides into multiple pages would put key info in each section "above the fold" (that is, on the first page before scrolling).
If we can find a way to make all-on-one-page vs. split-on-different-pages optional by user, would you be less opposed? --Evan 14:10, 19 Oct 2005 (EDT)
I'm generally in agreement with Jpatokal on this one. I like the article format and don't see any problem with them being long. It seems to me that the Table of Contents makes it really easy to find the part of the page that you want, and works better than initiating a whole new page load per section.
That said splitting up the sections as an option would make it possible to browse wikitravel with a cellphone, which is the one thing that doesn't work with long pages. Are you thinking of modifying Cache404 to do this? Or do you have something in mind with XMLHttpRequest? I'm not sure how many cellphone browsers would support the later. -- Mark 01:55, 20 Oct 2005 (EDT)
I also don't see a problem with the current long pages. Many newbies have no trouble clicking on the per-section 'edit' buttons where they are not overwhelmed with markup -- a nice side-benefit of the templates. But if you see a way to chunk things out into subpages but still retain the large pages, that might be interesting. -- Colin 12:42, 20 Oct 2005 (EDT)
To add to the chorus, I very much like having all of the information on one page. I think it's actually a strong advantage of Wikitravel that I can read everything about a destination in one place. Maybe there are people out there who like clicking on lots of links, but so long as there is a table of contents I wouldn't want to change the current "all in one place" format. -- Wrh2 13:18, 20 Oct 2005 (EDT)
Well, darn. I'm still not convinced that this is a bad idea, so I'm going to try and re-state my concerns and hope I can convey my point here. I think I started off with a facetious section header, and came off sounding like I think something is wrong, rather than conveying that I think something could be better.
First, it's not clear to me at all that new users are comfortable with editing Wikitravel pages. There is a silent majority of users from whom we never hear because they bail out on the editing process. For example: on perusals of our Apache logs, I see that of 1719 non-bots who have clicked "edit" in the last day or so, only 426 have completed their edit and submit their changes. Let's assume that 50% are not seriously trying to edit (say, they hit "edit" by mistake, or just wondering what would happen); I think 50% is high but let's just assume that for argument's sake. This still means we're losing about half of the people that are seriously trying to make edits.
Obviously, there's no way to tell what is keeping people from submitting. I'm only guessing that a 20K textarea full of Wiki markup is a factor in this. (And, yes, I overstated the size of most articles on Wikitravel -- a very fair point and conceded.)
I also think that the fact that every other travel guide on the Web breaks up articles in this way is worth thinking hard about. I don't think that advertisement is a suitable explanation for this; for example, Lonely Planet doesn't have ads on their pages, but they break up guides like this.
What I'm proposing is that you could optionally see a destination as a single page (for printing or if you just like really long pages) or separated into sub-pages by section. A user preference would allow you to see all destination pages one way or another -- readers and editors who prefer really long pages would have an identical UI to the one they have now.
I could probably use an "I get what you're saying, BUT..." response right now. I'm concerned I'm not making myself clear. --Evan 15:49, 31 Oct 2005 (EST)
Could wiki markup itself be a factor? Travel isn't exactly a technical topic, but Wiki markup is somewhat technical. Any idea what the edit to submit ratio is for 'pedia? -- Colin 15:53, 31 Oct 2005 (EST)
Evan, would your concerns be addressed if
# We had the TOC floating and always visible regardless of how much the reader scrolls down the page
A note: This is so easy to do. The only reason I didn't do it with the css I've been working on is that I thought it would annoy people. -- Mark 16:04, 1 Nov 2005 (EST)
# Section edit link were more prominent - maybe we could have the link right next to the section title, and edit links next to the TOC sections too.
It looks to me that with these changes it would be practically the same as having different pages without losing the advantage of having everything on the same page. Also, I am curious to know if you can figure out the breakup between those who tried to edit the entire article and gave up and those who tried to edit sections and gave up. Also, it would be interesting to see if people give up more on blank articles than on templated articles. If we learn that having a template helps, then may be we should try to fill as many articles with templates as possible, perhaps even look at scripts to do it. --Ravikiran 00:02, 1 Nov 2005 (EST)
More options is never a bad thing, but I still don't see the value in making someone click on an extra link to (for example) see the "Talk" section of the en:Falklands article and learn that "English is the official language." We already split articles up when they become unwieldy using districts and other tricks, and for me personally that seems to work nicely (although the en:United States could really use some breakup, and we don't have a good way of doing so). Anyhow, if this was implemented as a non-default user option I'd have no problem, but I'd rather not see it become default Wikitravel behavior. Perhaps there's another way to achieve the same result that wouldn't affect every article? -- Ryan 15:07, 1 Nov 2005 (EST)
I also am a big backer of "one guide, one article". I just think we can provide an alternate presentation that makes reading and editing parts of our guides easier.
I'm going to take a step back and see if I can do a prototype of this idea. --Evan 17:09, 1 Nov 2005 (EST)

Just to chime in way late with two bits:
  1. Back in the days at there was a whole butt-load of user behavior survey stuff done regarding the scroll-long-page vs click-to-short pages debate. What was discovered was that it was pretty much 50-50: about half the folks out there like to click and half prefer to scroll. We settled on a max of 2 1/2 - 3 scrolls on an 'average' screen per page and that's really what I like when I'm reading, say, the New York Times.
  2. I think there are a lot of possibilities that would open up if we broke things up-- at least as an option. It would allow users the option of clicking or scrolling (I think we need to consider 'readers' as well as 'editors' when we think about "users"). But it would also offer us the option of doing nifty content re-combining. By this I mean generating an article on-the-fly such as "Eating in Paris" (ie across districts) or "Hotels in The South" or "Things to do in Thailand."
I think breaking things up gives us a lot more flexibility and could be transparent, if desired, to the end user. Basically I see a lot of pros and no cons. Folks who like long articles don't need to give anything up, the default could still be "one guide, one article" but we could use the power internal syndication to give users access to content in new and exciting ways! Majnoona 20:57, 22 Nov 2005 (EST)
That brings up another point. The Law of the Wiki states that if each section starts looking like a separate article, each section will expand to fill up a complete article. I personally wouldn't mind that, but we should consider this possibility while taking the decision to split up. — Ravikiran 12:58, 23 Nov 2005 (EST)

Breakup Proposal

I've been thinking a lot about this issue as I think it's only going to become more important as we get more and more super-long articles. Here is my take on the outstanding issues and a proposal for a way forward.

Problem Some users like to click, some like to scroll.

  • Long pages are easier for editing and for reading / printing the whole


  • Shorter pages allow readers and editors to get directly to the desired

content and prevent users from getting lost 8 scrolls down.

  • We currently can't do content aggregation across destinations. Things

to do in Paris, regardless of district; places to stay in Thailand, etc...

headers way down the page.

Solution Breaking up pages by sections. This will allow:

  • Clickers to click, scrollers to scroll. We can have it all! If you like

how it is now, fine, you wont need to see a difference.

  • The possibility of more fine-grained TOC. Once you're on a section

page, the TOC can display subsections such as restaurants by budget.

  • On-the-fly internal syndication / content aggregation.
  • Improved deep-linking and searching. I'm thinking about bloggers, etc

Minor Problem It doesn't make sense to break up every page automagically.

  • Articles like en:Sausalito don't need page-per-section and it might

actually deter people from adding content.

Proposal Use the Article status to identify articles that are complete. Articles that make it to Guide status should have enough content to warrent a break-up.

  • These articles are the ones we would want to showcase through content

aggregation and internal syndication

  • These articles deserve the increased views / edits that would come from

better linking / searching

Comments? Other problems / proposals?


So, I put up some examples so folks could get an idea of what I was talking about. Here they are:

I don't think there's anything there that will surprise anyone (EXCEPT that they look almost exactly like "real" articles, so don't try and edit them! They're just copies of the current articles with some of the HTML moved around and/or deleted, so be cautious.) Suggestions or comments? I think we had the idea that you could set a preference to either see the split pages or not... that's not done for those pages, obviously. --Evan 17:22, 15 Feb 2006 (EST)

Hi Evan. The samples here are pretty much what I expected the splitting up of the articles would look like. Sad so say I expected it to look like World 66, and lo, it does. I guess I'm just really not into splitting. -- Mark 17:33, 15 Feb 2006 (EST)
Me too(tm), I don't like this at all. In particular, people tend to ignore the little links in the left navbar (witness the number of bug reports we get about WikiPedia: links 'not working').
I wouldn't object violently to allowing people to use a split view if they like, but I think the default should definitely be the 'whole story' version. Jpatokal 21:52, 15 Feb 2006 (EST)
There is one use case I can think of where this sort of splitting makes some sense: Cell phones. There's usually a limit on the size of a page which one can load on a cell phone connection, so our longer articles won't load on a cell phone. That said one still pays per link followed, and it's a real PITA to have to follow a bunch of links to get to the data you want, so maybe the thing that needs to be fixed is the phones themselves, not Wikitravel.
Still if you and MAJ want this really really badly and it's totally optional and not the default then I guess OK. I don't think it will solve the "problem" of "backed-out" edits, because I don't think that's what they are. -- Mark 05:14, 17 Feb 2006 (EST)
A Wikitravel article with the standard stylesheet will still be unreadable on a cellphone, even if it is split into chunks. The correct ways to handle this are to either recognize that it's a phone browser and reformat accordingly, or (better yet) create a for phone-formatted content. Jpatokal 11:10, 17 Feb 2006 (EST)
I just finished honing a one-column stylesheet for the new skin should it ever be adapted. It's designed to work with a 270px screen. -- Mark 11:39, 17 Feb 2006 (EST)

I don't know what the current situation on this is, but i'd tend to favour just splitting the listings for hotels, restaurants, shops and bars into their own subsections. It seems to me that as wikitravel takes off, the volumes of listings and the number of links added will increase and increase, especially for larger cities, and make it easier and easier to drown under a load of information - and people might not necessarily want to scroll down past some ridiculous number of bars to reach, say, places to get out. Obviously there should be an option to view and/or print all as one page. I'm not advocating splitting everything: the examples of that above seem a bit 'clunky', just the sections that are prone to fill up in that way. (No more bongos 09:19, 20 July 2006 (EDT))

There are two ways to prevent the list of bars from getting too long: splitting a city into districts, and simply limiting the number of bars listed. We're not trying to be the Yellow Pages, listing every bar you could go to, but a travel guide, listing the bars you should go to. If the Drink section's that long, it's time to trim it. Also, they don't have to scroll; clicking the table of contents will take them directly to whichever section they want, literally as easy as linking to another page. - Todd VerBeek 09:27, 20 July 2006 (EDT)
I suppose that could work as described, but there should at least be some kind of policy on the number of bars/hotels/shops/etc to be listed on the main city page, just as the number of cities on a country page is limited. There should probably be some kind of criteria as well (these may already exist without my knowledge). This is where we start getting drawn into the struggle between abridgement and completeness - for example, I myself would consider it essential when visiting a city to know where to find live music and bars of the kind that I like. And if it was entirely down to me, I'd write about it somewhere like this - but i know the majority would consider it irrelevant. (No more bongos 10:33, 20 July 2006 (EDT))
There aren't any policies for a maximum number of bars/restaurants/hotels. We don't have that problem very often (more often the opposite), so it hasn't been a pressing issue, and it's left up to individual discretion. If I see an article where it looks like someone copied the "Resturants" section of the yellow pages, I'll take out all the chains I recognize, figuring that if someone really wants an Olive Garden, they can find that easily enough on their own. If someone's taken the trouble to categorize bars by different kinds, that makes a long list more useful, so I'm less likely to trim those listings. - Todd VerBeek 11:45, 20 July 2006 (EDT)
As a data point, I have refrained from adding hotelmaker entries for major cities because the list is too long for places like Vegas, San Diego, or San Francisco. -- Colin 16:34, 20 July 2006 (EDT)

Lost discussion

For guide and star articles, it would be nice for some users to browse the articles one section per page, rather than as one long page. Any such feature would have to allow people to read and/or print the entire article as a single page, though. See en:Wikitravel talk:Article templates#The best Wikitravel articles are too damn long. --Evan 16:48, 17 June 2006 (EDT)

I've got a start of this feature working on review; see There's still a lot to do:
  • There's no link to the first section (no title) of the page in the Table of Contents.
  • There's no link to show the entire article in one page.
  • The edit links need to be fixed up so that if the user is on "Montreal - Do", clicking the edit tab edits only the do section.
  • We should probably group some of the sections together -- especially the first section, any geographical lists, and possibly "Understand".
  • It needs to be made optional by user.
That last one is going to be the hairiest -- it's going to require a lot of processing power that our caching system currently keeps us from having to use. --Evan 13:52, 19 June 2007 (EDT)
Looks like a good idea once you've done the above. So by "optional by user", would it be that we set in our preferences how to view all articles, or there would be a toggle link on the individual page to go from one page to multiple pages? It certainly would be cool to have the ability to print just the section you need, that will be great. I think everything through Understand makes sense to group, that sounds right – cacahuate talk 00:24, 20 June 2007 (EDT)

Splitting pages and SEO

Another motivation for this change is for search-engine optimization (SEO). It's not a secret to anyone that the more users who find and read Wikitravel guides, the more potential contributors we have.

Here is the SEO reasoning for split pages: people search on search engines a lot for the name of a destination ("Paris", "London", "Berlin"). But they also search with two-word search terms like "paris hotels", "london restaurants", "berlin museums". You can get a feel for this using the Overture search term suggester, which will give some rough numerical comparison for different search terms. For example, it gives about 114706 searches for "berlin", and 10633 for "berlin hotel", 2924 for "berlin tour", 1699 for "berlin travel", etc. 291322 for "paris", 83163 for "paris hotel" is even more striking.

Theoretically it would be great to get some more traffic on those other search terms. Not only would there be more users coming to Wikitravel, but they'd probably be more interested in travel information than those users who just search for "berlin" (although I doubt that many users who come from Google, etc. and click on the link that says "Berlin travel guide" don't expect travel information).

Search-engine optimization experts say that the best way to optimize for certain keywords is to have your content focused on those keywords. So, the idea goes, a page just about lodging in Paris will do better on a search for "paris hotels" than a page about lodging, restaurants, airports, safety, history, and museums.

Internet Brands folks are very eager to get this feature in place, and implementing the feature is my current top work priority. They think that it will be really helpful for increasing traffic to the site. I think that may be the case, although I have some reservations -- we get placed on the first or second page of results on Google for some of the biggest destinations like London, Berlin, Thailand, etc., and I'm worried that radically changing our pages will hurt that ranking, on searches that have 5-10 times more volume than the keywords we'd be optimizing for.

But I also think that there's some significant value in splitting pages for readability and for site performance. Especially as our bigger pages grow larger and larger, we need to deal with the situation in some smart way. --Evan 13:21, 10 July 2007 (EDT)

Wikipedia manages to pop up at the top of Google searches a lot despite single-page articles. I think it wise to guess that Google and Yahoo will improve their searches to point to useful sites rather than mere SEOed sites. So let's concentrate on being useful and let Google worry about Google. -- Cjensen 17:36, 10 July 2007 (EDT)

New version

I've got a new version of the new feature running on review; you can see an example on There are still a couple of bugs (incorrect links in the ToC for lower-level headings, and the "edit" tab should probably edit the section the page is about, not the entire article), but I think it's getting close to ready to roll out. Note that you can now turn on and off split pages using a special preference, for those people who want to navigate on unsplit pages, and that you can always get a link to the article "all on one page". The printable version always works with the whole article, too.

I'd love to get some testing feedback, comments, ideas, suggestions, and other advice about the feature. One thing I've been thinking about is that it would be relatively easy to implement manually -- we could just make more articles. But I'm not sure what people would think about that radical a change to our MoS. --Evan 13:21, 10 July 2007 (EDT)

Wow! Nice work! I think this is really workable-- best of both worlds with the preference option. There's always going to be the folks who want to click and those who want to scroll and this should satisfy both. I think it's going to make our biggest and best articles more usable and readable online and off... I'm looking forward to seeing this rolled out as soon as it's tested. Maj 13:40, 10 July 2007 (EDT)
I'm not going to mince my words -- it doesn't work. The TOC, which has until now been a nice little extra, is now the only way to move around and, being a little box of teensy-weeny text shunted off to the side, it's just not suited for that. I'm positive that, if you showed the Montreal page to 10 people now, 9 of them would think "Huh? That's it, just a picture and one sentence? Man, Wikitravel sucks!" and leave in a huff. The navigation has to be a lot more obvious, along the lines of the tabs-plus-index on the Wikimania pages:
I forgot to mention that the main page is going to have more sections on it -- everything up until, but not including, "See". I haven't finished the code to do that yet, though. I don't think the first page will make quite the same impression, but I know that's not entirely what you mean.
If I had my druthers, we'd have the TOC in the left-hand column, and the navigation would seem more natural. I'm not crazy about the second level of tabs -- we already have a lot of tabs on the top of the page to begin with. --Evan 14:02, 10 July 2007 (EDT)
OK, showing more sections would be an improvement, but I think you need to have a completely obvious way "forward/backward" added to the end of each section page. Also, it would be good to have sectioning activated only for articles that cross a certain size threshold. Jpatokal 14:06, 10 July 2007 (EDT)
The one reason I'd like the idea is if it became possible to browse districted information this way -- so, instead of "show me everything in this district" as done now, you could also do "show me hotels in all districts". Is this even remotely possible? Jpatokal 13:43, 10 July 2007 (EDT)
I think what you're saying is that we'd have a way to slice listings either by district, or by type? I think that's an achievable goal, although if I had my choice I'd disentangle it from this page-splitting system. --Evan 14:02, 10 July 2007 (EDT)
Yes, that's what I meant. How would you "disentangle" this then? Jpatokal 14:06, 10 July 2007 (EDT)
Well, the software I've just installed doesn't do anything like that. So I would disentangle them conceptually and defer that effort for a later time.
Thinking about it, though, one way we could make this work is by manually splitting up the district articles by sections then recombining them with transclusion. So if we had "Singapore/Chinatown/Eat" and "Singapore/Chinatown/Sleep", "Singapore/Orchard Road/Eat" and "Singapore/Orchard Road/Sleep" , we could use transclusion to make a "Singapore/Sleep" (by topic) and "Singapore/Orchard Road" (by district). It would be pretty neat if worked. --Evan 18:37, 10 July 2007 (EDT)
Sorry Evan, but I still don't see this split-up as an improvement. We've had discussions elsewhere about how to keep articles readable, and the preference has always been to sub-divide by districts or to use sub-headings in long lists. You've indicated that you'd like to chop things up by section for RDF reasons (update: wasn't there a discussion about "all hotels in Quebec" or some similar functionality as a result of this splitup?), but can't that also be accomplished with the listing tags? And if so, what is the perceived benefit of splitting articles up further? Is this something that's coming no matter what, will it be a configurable option, or is it just something you're toying around with that may or may not ever be used? -- Ryan 16:34, 10 July 2007 (EDT)
I think the perceived benefits are: that it will improve search engine rank for searches like "paris hotels", and that it will make it easier to read and navigate very long articles. Personally I agree with the second, and I'm dubious of the first.
This change won't have anything to do with RDF. Is that a TLA joke? It's supposedly good for SEO, is why I'm wondering if you're joking. Anyways, I believe once we're switched over to using Wikitravel:listings tags we'll be able to do some pretty complicated and interesting searches, such as "all hotels in Quebec" or "Mexican restaurants in Venice", but we're not there yet. This change (one page per section) doesn't have anything to do with that.
As for whether this is coming no matter what: I don't think so, but it's not my decision. The momentum here is coming from IB, and we haven't had a case where the Wikitravel:Technical infrastructure policy was tested that way. I'll ask some IB folks to comment here.
My takeaway from the above discussion was that if it were optional per user, the participants wouldn't particularly like it (except for one), but they wouldn't mind if it was available on the site. It is configurable, per user. It's not something I'm toying around with, though; it's been made my main current dev task for the last few weeks. --Evan 18:37, 10 July 2007 (EDT)
Still don't like. -- Cjensen 17:32, 10 July 2007 (EDT)
No, no, no, no! This is horrible! This 'solution' looks too much like all the other travel guides available. If I wanted a Lonely Planet guide, I'd buy one. -- Sapphire(Talk) • 17:45, 10 July 2007 (EDT)
Ok, I'll explain my repulsion a little further. I am someone who wants printed guides because it's easier than lugging a laptop around or worrying about my laptop getting jacked by the cleaning lady at the hotel. What this monstrosity has just done is made me print out 17 pages for the 17 sections on the Montreal article, plus the district articles and their sections. Why is this a problem? 1) It looks like Lonely Planet's set up (I'll expand on this later). 2) I just printed out, potentially, 40 different pages. 3) Your little (one page) link is almost unnoticeable. In fact, it took me around twenty minutes to notice it.
So tie my criticisms together: I just printed out 40 pages of sections (because I, a normal user, didn't see some annoying link titled "(One Page)", which doesn't give much explanation of what it'll do.) and just wasted a $20 US ink cartridge. Thanks for nothing Wikitravel! Then I realize, "Hey, if I go to Barnes and Noble or I could just buy the Lonely Planet guide to Paris (Wikitravel looks like Lonely Planet now anyways). If I give Lonely Planet my $20 I get all the information I want, although some (or most) of the information could be out-dated, but at least I don't have to click on 17 different links per article and lose an entire ink cartridge. So, please take that back to IB, who have been very helpful on other issues, but this is one thing I'm hoping they drop. -- Sapphire(Talk) • 18:03, 10 July 2007 (EDT)