Predicting What Your Consumer Wants
The uncertainty principle of quantum physics states that you cannot know the location of a particle and it’s momentum at the same time.
The phenomenon is not a failure of instrumentation; just the nature of the system.
Of a similar vein, I posit the uncertainty principle of digital marketing: you can’t know who a consumer is and their tastes at the same time. After all, even if consumers would submit to a lengthy questionnaire (which they won’t) what sort of questions would you ask? I can’t explain my taste for Apple Jacks – the things don’t even taste like apples!
Assessing the value
Knowing what a consumer wants is extremely valuable. Even more valuable, is having consumers that trust you to tell them what they want. For this reason, Netflix is famously offering up a million dollars to anyone who can improve the accuracy of their Cinematch recommendation engine by 10%. Sounds like a lot of money for little gain, but most experts agree that the prize money represents a bargain for the company. The chief executive, Reed Hastings, points out that “getting to 10 percent would certainly be worth well in excess of $1 million.” Why? The New York Times describes the problem:
Customers pay a flat monthly rate, generally $16.99 (although cheaper plans are available), to check out as many movies as they want. The problem with this business model is that new members often have a couple of dozen movies in mind that they want to see, but after that they’re not sure what to check out next, and their requests slow. And a customer paying $17 a month for only one movie every month or two is at risk of canceling his subscription; the plan makes financial sense, from a user’s point of view, only if you rent a lot of movies.
Predicting Consumer’s Tastes
The fiscal desirability of a solution is obvious, but how can we predict a consumer’s taste? Several methodologies have been employed so far, the most prevalent being “collaborative filtering.” By aggregating people’s choices, guesses can be based on correlation. People who like X also tend to like Y. So to all the X lovers out there, may I suggest a nice helping of Y?
This works fairly well, but tends to fall apart around love-it-or-hate-it polarizing decisions like whether or not Michael Moore’s movies are masterworks of political dissent or hopelessly biased drivel from the radical left wing of America. (Whatever your opinion, at least we can find common ground in Tom Hanks films. America loves Tom Hanks.)
So what would be a useful predictor for those situations? Research shows that people are more likely to prefer things their social circle [login required] is also interested in. In other words, to predict your tastes, I don’t need to know what you like if I know what your friends like. And for that, all I need to know is who your friends are.
Know thy consumer’s friends, know thy consumer
Enter the Facebook Connect and MySpace Data Availability platforms. If users access sites through either technology, businesses could track both their and their friend’s activities. It stands to reason that any given set of “friends” will likely inhabit the similar social circles and, odds are, that some of their tastes will be the same. As such, choices on a site could be given additional prominence if a user’s peers had bought or viewed particular items. As Netflix understands, merely improving the guesses slightly pays off dramatically.
As with any use of personal data, privacy is a concern. However, revealing the data is purely voluntary and isn’t anything more than what the user already revealed through the social networking sites themselves. Across the web, users have repeatedly demonstrated that they are willing to reveal information about themselves for a more personalized and social experience.
Maybe soon we’ll be able to blame our friends for all our online buys.
Follow the author: @brianchiger Follow AgencyNet: @agencynet

Dan Waldron…
Well said
Tim Todd…
Interesting posit and it is a good point.
We at Nanocrowd have just launched a new service that reduce the number of unknowns needed to find recommendations that work. We start with the consumer and let them choose according to their taste by providing a solution to the question: “How does the consumer handle the proliferation of content and the competing voices that surround and describe it?”
Our approach cuts through the fog. The user inputs a movie and we return 40 movies most like, 40 movies least like, and small themed groupings of movies (containing movies like the one they picked). These detailed and nuanced recommendations help avoid leaving the user with a polarized set of options.
We look to assist users with the Netflix dilemma that you describe. Before Nanocrowd, I had a problem keeping my Netflix queue full. Now it is backed up and overflowing with movies.
Nanocrowd – The Movie Search Engine.
http://www.nanocrowd.com
A description of our approach at my blog:
http://primetimeforchange.com/2009/03/nanocrowd-movie-search-new.html
Thanks for the interesting post!
Brian…
@Tim: Interesting stuff! I’ll have to search through and add to my Netflix as well.
Do you think your approach has generalized applications outside of movies? How would it compare to music recommendations? Or fashion? I’d love one for blogs!
There’s been a big push in education towards more systems based models of learning, precisely so ideas and techniques from one discipline can be used in another. Recommendations is the perfect area for such innovation.
Could you be the Stephen Levit or Nate Silver of recommendations?
Tim Todd…
@Brian: Glad you find our approach and technology interesting and useful and thanks for the compliments. You definitely have a handle on what we are about at Nanocrowd.
Here is a quote from our company blog.
“Our first demonstration of this technology is theatrical-release movies, but the methods we are developing will apply to books, online videos, games, music, or even to art and architecture.”
http://blog.nanocrowd.com/
We also do have a very good team.
http://www.nanocrowd.com/index/team
Definitely check out Nanocrowd and our methodology, I would be interested to hear your thoughts!