[EDIT: this applies specifically to list/poll questions. I opened a separate question about discussion questions in general]

My question "Worst single user experience you’ve had?" just got closed. I don't disagree with that moderation in particular (the wording of the question was probably too negative/argumentative), but it does bring up the question of list, poll, and best/worst questions. Closing the question because a similar question was closed on SO doesn't seem like a very compelling reason (it's citing precedent -- but is that precedent relevant to this this jurisdiction?)

Consistency -- some list questions seem to be OK

Consider the top-voted question on ui.stackexchange "Must-read User Interface Book?". This question has no close votes, and seems to have been endorsed by the community. So the line is not an arbitrary "no list questions" or "no questions that cannot be answered". Obviously, there is some kind of subjective test. Why is a question on good UI books OK, but a question on bad/good UI implementations not? Both are not directly related to a specific issue, but intended to allow a budding designer to gain a broader perspective on the discipline.

The question is relevant and informative

Learning from design mistakes - or design successes - of past UIs certainly is useful. To address Carson Myers's response:

By asking about the worst UI screwups we've ever seen, you're really just looking for some light reading and entertainment (IMO, since the answers you probably expected aren't common and are probably obviously wrong to the community)

Most "worst UI" screw-ups are probably well-intentioned decisions that went wrong, and discussing why will help us become better designers. "Common UI pitfalls" is a different question. I'd argue both are relevant and worth discussing.

For example, Coding Horror's worst UI post addresses developer decisions that were well-intentioned -- wGetGUI's creator made that UI purposefully. Lotus Notes used to be ahead of its curve in user-focused design, one of the reasons it was so popular back in the 80s. What went wrong? IMO, that's exactly the sort of thing this site is for.

Common UI pitfalls is a separate, and equally relevant, question. These are usually made due to negligence or lack of knowledge. Few UI designers would purposefully use a check box as a radio button, but to many users or developers, the distinction is lost.

The opposite question (best user experience you've had) would bring up some good material. There could also be "Small things that make the UI feel better".

"fun" != "useless"

If the argument is "fun" questions shouldn't be allowed (but relevant open-ended could be acceptable), what if the question were rephrased to something like "Design mistakes to learn from?" or "Designs that affected you emotionally?"? I would argue that this would make the question less appealing for users to answer or read, while not significantly improving the scope or quality of the answers. But that argument could go either way.

Promotion/improved traffic

All but one link I've seen in the wild to StackOverflow was to an open-ended question (the "best source code comment" one was actually mentioned in a training seminar I went to). Especially as this site is about to go public, bringing traffic to/promoting this site is very important. Having a question like this could have users to sign up just to answer the question, which would encourage them to return, interact more, and possibly post on a more specific discussion.

Carson Myers brought up in his answer:

Even if it did draw traffic, it might not be the traffic we want, or rather, the traffic might not have the right impression of what this site is.

This is a really good point. I'd argue that traffic that would be interested in reading and discussing good/bad existing UI implementations is exactly sort of traffic we want, and as long as there aren't too many open-ended questions, anyone who explores the site will see that focused questions can be asked & discussed as well. However, if you feel a smaller, more elite community is healthier for the long-run success of the site, then by all means - open-ended and poll questions should almost certainly be disallowed. But be sure to weight the pros and cons before making a conscious choice to shut off a significant user base.

Questions like these a are great way to generate content

Especially as the site is new, and the volume of questions has been dropping lately, expanding the scope slightly will increase the amount of relevant content. This might make the site seem more attractive to potential visitors and increase search rank. When this site goes public (and in the first few weeks) having good content is IMO more important than having focused content (though again this is subjective).

Users like these questions

Look at the top-voted questions on StackOverflow, SuperUser and ServerFault. Many are open-ended/subjective. While "community-driven" != "democratic" (and "never trust the user" is an oft-cited principle in UX!), the users seem to have spoken strongly in favor of these questions.

The interface & site design lends itself to these questions

Features like voting & commenting plus the ready-made community makes these questions a very natural fit for this type of site. This may not be what Joel thought of when originally implementing StackOverflow, but that doesn't change this fact.

The precedent goes both ways

SO may be becoming harsher on poll questions, but it appears SuperUser and Electronic Gadgets are more lenient about them. UXExchange seems to have no problem with these questions, too. Precedent and consistency are certainly important to take into account, but it seems to go both ways on this one, so this argument isn't wholly convincing.

The scope of the question is important

No an argument for or against them, just food for thought. "Worst UI ever" or "Must-read UI books" might be too broad. But there are many list/poll questions that are more focused. "Are there any good resources about designing touch screen interfaces?", for example, has a narrower range of answers than "best books", "best blogs", or "worst interface", and could be considered more useful because of this.

TBPH, I feel the "crackdown" on poll-type questions on StackOverflow was a mistake, but obviously a lot of people a lot smarter then me felt otherwise. From what I understand about StackExchange, however, each site is given some latitude to decide what types of questions are OK, and AFAICT there's no StackExchange commandment prohibiting poll, list or open-ended questions. So this site could go a different way on them. Since we're user-moderated, a FAQ entry about them would go a long way towards making clear what's acceptable.

Sorry for the rant -- Spending 11 days cooped up in your room with the flu does that to ya. You've been... WALL OF TEXT'D!

when I got at the end of the question I thought I was reading an answer already –  Naoise Golden Jan 2 '12 at 18:16
add comment

6 Answers

When I read the title of your question, I thought: "this doesn't belong here."

After I read this meta question regarding it, I thought: "maybe this belongs here."

I have to conclude that it was mainly the phrasing in the question. I think questions that are of the type "(best|worst) x you've ever y" are obviously too subjective. If it were rephrased (as you suggested) to something like "Design mistakes to learn from" or even better something like "UI pitfalls everyone should know about" it may have survived. However, it still would have been a best/worst question in my eyes. By asking about the worst UI screwups we've ever seen, you're really just looking for some light reading and entertainment (IMO, since the answers you probably expected aren't common and are probably obviously wrong to the community) and, if you wanted an open-ended, list question of this sort, "common UI pitfalls" might be better.

Searching for list questions in a useful manner doesn't really work. If I google searched "should my navigation be a drop-down box?" on google, and your question had something related in it, I might not find it or be compelled to read it. While list questions can be entertaining and draw traffic, something about this particular question (and most best/worst questions I would assume) just nags at me about not adding much value to the site. Even if it did draw traffic, it might not be the traffic we want, or rather, the traffic might not have the right impression of what this site is.

All else being said, since everything is community moderated, and not necessarily always by the same parts of the community, some off-topic questions may survive while others will surely be shot down. This will probably result in the argument that "question X is allowed, why not question Y!" just as it did on stackoverflow. It's not really something that can be avoided.

In any case, you have been WALL OF TEXT'D as well, my friend :)

"Even if it did draw traffic, it might not be the traffic we want, or rather, the traffic might not have the right impression of what this site is." -- This is actually probably where the crux of the argument lies. I personally disagree with you on this, since I feel the type of person interested in that type of question would probably make a great community member -- but I can see your point here. –  Fraser Aug 15 '10 at 8:34
Re: search, I just meant insofar as finding the site itself. Google trends doesn't have enough data, but I'd guess more people would search for "worst ui" or "bad ui examples" than for "common ui pitfalls". –  Fraser Aug 15 '10 at 8:37
@Robert I agree that an initial influx of traffic would help, but I wouldn't want to sacrifice the integrity of the system. By that I mean, in the example you've given in the question, I think specific questions/answers would be better for the really crazy things we've seen in UI, so that various answers can weigh pros and cons and provide more well-rounded information than a "all these things are HORRIBLE" thread. While I agree that a list/poll may be suitable in some situations, I don't think it fits this particular content best -- I think it'd be better if users could search for a concept –  Carson Myers Aug 15 '10 at 10:00
and find a big question and numerous answers about why that concept may not be the best direction, rather than just finding a discouraging blurb about it in a thread full of people's fail. I guess what my inner programmer is trying to say is "it isn't the right data structure for the problem." –  Carson Myers Aug 15 '10 at 10:06
@Carson Myers -- Specific questions would be better, but the posting impetus needs to come from somewhere. Nobody is going to post a screenshot of a bad GUI and ask "what decisions caused this?"; the question brings those things up –  Fraser Aug 15 '10 at 10:07
Anyways, good debate! I need sleep & advance wars, be back tomorrow ;-P. –  Fraser Aug 15 '10 at 10:08
@Robert well we've both made our points and they aren't all necessarily mutually exclusive, but for the moment I think we should all get a handle on what is and isn't on-topic for this site. Once it's out of beta, I think these sorts of questions will find their way in regardless, and I don't necessarily oppose it. But for now I think staying true to the sites purpose trumps seeding content to gain traffic –  Carson Myers Aug 15 '10 at 21:27
add comment

I just asked a list question before realising the current attitude towards them; mine is here: http://ui.stackexchange.com/questions/375/what-are-some-great-web-based-prototyping-tools

I think they're relevant in the sense that my understanding of the StackExchange network, coming from StackOverflow, has always been that it's about replacing inadequate, outdated, or incomplete sources of information with better, more open, more recent and more community-driven ones. Following that logic, I asked a question where I described that I'd like to use the community here to form a resource that is better than the other ones I found, because I think the democratic voting system we have is superior to either anonymous wiki format (one of the links I found) or editorial (the other one, in which case the author is no longer maintaining the list).

For that reason I strongly subscribe to the notion of lists in situations where they produce valuable resources that people around the internet can rely on for accuracy, timeliness and relevance. Best/worst questions are a grey area.

add comment

I don't know what the test for "acceptable" list questions is, but here are some thoughts:

It might be that for some questions, the single "right" answer is an aggregate of many items; no individual is likely to have all of the items; and those items must be collected and sorted by several members of the community. (Hence the unwritten laws that list questions should CW, there should be one item per answer, and it's okay to post multiple answers.)

Another theory is that a question may have several answers that are not mutually exclusive. While you may have to choose between jQuery, Dojo, and Ext JS, you'll never be forced to select just one of several Hidden Secrets of JavaScript.

Also I think the answers should be useful to others. Entertaining answers are good as long as they clearly have practical applications. But that one applies to normal (non-list) questions too.

The book question passes all of these tests.

+1. I think the first two points aren't opposing theories but rather complement each other. In the best of these questions, the asker goes back & compiles a list of all the interesting answers. –  Fraser Aug 16 '10 at 4:31
add comment

I just tried to use chat.meta.stackoverflow.com (third place). I hated it.

I love StackOverflows UI for discussions (not just specific answers) and can't stand this arbitrary rule.

Solution: They should just add a checkbox to mark the question as open-ended and let people filter it if they want. The UI shouldn't be different. It works perfectly for discussions AS IS.

< analogy >

This issue is like Same-Sex Marriage. If you say it can only be one way (Man/Woman), then you are happy with your one way. If someone else LIKES MARRIAGE but wants it another way (Man/Man or Woman/Woman) then they are S.O.L. They don’t want some messed up “third way”, they want to be married! Stop being control freaks and let people do what they want to do!

< /analogy >

The "community wiki" checkbox is often used for this -- it's badly named (WTF is a community wiki?) and I'm not sure if this was the original intention of it, but most discussion questions become CW. –  Fraser Aug 17 '10 at 2:37
I just couldn't agree more. –  ign Aug 17 '10 at 3:51
-1 Because the same-sex marriage analogy is poisonous. I hit downvote before I even read your post. It doesn't matter what side you're on. That kind of analogy adds more heat than light. –  Patrick McElhaney Aug 17 '10 at 13:14
@Patrick. I thought that was the most inspired part. ;) –  Glen Lipka Aug 17 '10 at 15:03
add comment

I still disagree with you. The new 'third place' was invented for these things. I think the main site should remain both serious and concrete; no questions without answers that are helpful.

Now this last point is debatable in the case of this question, but 'list of' questions in principle ask for multiple answers, whereas we should try to ask for one correct answer. That answer may not exist due to multiple viewpoints, but it should be what we strive for.

+1 agreed, a "Worst user experience you've ever had" discussion in the chat would be acceptable –  Carson Myers Aug 16 '10 at 2:46
"we should try to ask for one correct answer. That answer may not exist due to multiple viewpoints, but it should be what we strive for." -- Why? What's the practical reasoning behind striving for one correct answer? Is this reasoning strong enough that we should not allow exceptions to the rule? And does the book question fit this in any way the implementation question does not? –  Fraser Aug 16 '10 at 4:26
@Robert Because that's what the site is for. If you don't like that, you should go to some discussion forum. Trying to get the single best answer to a question is what this is all about. –  Jouke van der Maas Aug 16 '10 at 10:31
@Jouke van der Maas - Sounds like circular logic, since the point here is to decide what this site is about. I addressed this in meta.ui.stackexchange.com/questions/53/… –  Fraser Aug 17 '10 at 2:09
@Robert It's not circular logic at all. The site founders have stated this multiple times. The site is not for discussion. It's for getting an answer to you questions. You can want something else, but you can't get it here. –  Jouke van der Maas Aug 17 '10 at 14:24
@Jouke van der Maas -- That's either fatalist or just plain unfriendly. We have the power to change these things, and the power to do so now. Resenting (or actively resisting) the change is bad for users, and bad for the future of the site. –  Fraser Aug 18 '10 at 1:38
add comment

To ensure that your question is not closed preemptively, it may be beneficial to phrase it in a way that is concise.

While this won't increase the relevancy of your question, it will decrease the possibility of misinterpretation.

add comment

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .