I have written here before about the myth of better search. Short of psychically guessing my search intent, and/or connecting electrodes directly to brain so that search results can scrolls, heads-up style, across my retina, it’s not clear to me anymore what materially “better” means.
The preceding is why I was briefly puzzled by a survey today claiming that Yahoo had surpassed Google in search Customer Satisfaction. How could that be?, I wondered. Not that Google is perfect, of course, because it isn’t, but had Yahoo somehow found a way to be meaningfully better at search than Google? And more importantly, if Yahoo searchers were more satisfied than Google searchers, how come Google was so far ahead of Yahoo in search usage, at least judging by ComScore stats?
To begin to answer the question, here are the underlying numbers: On the survey’s 100-point scale, Google scored 78, Yahoo 79, and Ask and MSN came in at 75. There were, in other words, four points separating the main search contenders, and only one point separating Google and Yahoo in satisfaction scores.
Assuming the survey method is credible — which is a leap, considering that there is nothing about survey size, sample makeup, etc. in the press release — I still have trouble with the result. A one point difference is meaningless, mere noise. Last month Google was ahead, this month Yahoo is ahead, and who knows what will happen next month. It’s just noise among searchers who wouldn’t know better search if it spidered them, doubly do when it’s demonstrably uncorrelated with search engine usage.