I love Eli Roth's comment about focus groups
They TOTALLY kill good ideas unjustifiably. Gather three groups of 8 people, ask them questions about what they saw, and forget that you're going to have social loafers and overachievers in the groups. It's a recipe for a compromise-frankenstein of an end product.
I swear, some insightful people are just going to sit there, while other people feel like they've been asked to a consulting gig and think WAY too hard about their feedback.
Focus groups don't work, because they're so often used as diagnostic tools, when they should only be used as exploratory tools--means of figuring out what to investigate with your real diagnostic tools like surveys and experiments.
Did that part hit anybody else this hard?