Social Media Market Research Methods are REALLY Unevolved
Posted by Vaughn Mordecai on Thu, Apr 22, 2010 @ 01:02 PM
As you are reading through this article...Please also consider this post titled "Social Media Research: What a Difference a Year Makes" Social Media Research is evolving VERY FAST and this is worth considering.
Sometimes you just run out of things to say. We've all experienced it. When you're engaged in conversation with a group of people, it's the lull in conversation between the end of one topic and the beginning of another. The quieting of the chatter. Then something happens, it's a little bit difficult to define what it is, but a stimulus occurs that shoots the conversation down a whole new track, a micro conversation that invigorates the macro conversation. I believe that this happens in social media, and I experienced it recently with this blog.
For the first time since starting this blog, for the past couple of weeks, I've frankly had very little to say. It was a very interesting experience for me. I'm not a rabid talker to begin with, but I typically have some thought...some idea...some topic for this blog...gestating in my head. I had nothing. A lapse in the conversation...
Until last night...
Last night I was given a very simple illustration of the impact social media can have on the conversation. I've mentioned this before, but I have teens in my household. Two of them began to argue last night about whether cheerleading is actually a sport. One of them is a cheerleader, the other a soccer player. The soccer player posted this simple question to his 300 friends on Facebook..."Who agrees that cheerleading isn't a sport? Sorry Sis." Incidentally, the cheerleader had just returned from a two-hour tumbling session, was tired, sore, and feisty. Chaos ensued. The simple question resulted in 42 Facebook comments (not
to mention the internal "conversation" going on in my household). Both sides of the controversy chimed in with blistering frequency (over an hour and a half) and then the conversation stopped very abruptly when the parents of these teens sent them all to bed around 10:30pm.
In the process of the conversation, I Googled whether cheerleading was a sport and didn't really come to a definitive answer. When I didn't get a resolution to the question from Google, I consulted the mother of all immediate answers...ChaCha.
If you've never heard or used this service, it's very unique (and for the most part free). The teens I know use this service A LOT. You text ChaCha a question (242242 - spells "ChaCha")...any question...and ChaCha will text you the answer. You can send some N number of questions per month (data & txt messages apply) without being charged (I don't text them often enough to know what the limit is). The slogan on their website is "Real people answering your questions! Crazy Huh?"
I texted this simple question to ChaCha. "Is cheerleading a sport". As always, ChaCha came back with a reply in less than 30 seconds. "ESPN Court rules cheerleading is contact sport, yet many states for high school sports are not ruling it a sport, it depends who you ask. I would say Cheerleading is a sport." An ESPN Court ruled that cheerleading is not only a sport but a contact sport. If you've seen many cheerleading competitions, you'll understand. In the past several years that I've attended these competitions with my daughter, I've seen more people fall out of "stunts", more girls kicked or inadvertently punched in the face, fallen or dropped from 15-20 feet in the air, and/or hurt than I've seen in most other "sport" activities. At one point I actually tried to start videoing when these athletes "took a whipper." I agree with ChaCha. Cheerleading, at least competitive cheerleading, is a sport.
In connecting the dots from this experience to the market research that many of us provide, something occurred to me. Social media market research methods are REALLY UNDERDEVELOPED and VERY UNSTANDARDIZED. As I've followed the #MarketResearch hash tag on Twitter, I realized something. The way that most of us operating in the market research industry define market research, and the way that a lot of "other" businesses often define market research are very different.
You'll often see this post pop up on Twitter "Conducting #MarketResearch on...". The interesting point here is that this person is typically not doing any kind of Qualitative or Quantitative research as the market research industry has defined it. No focus group, no ethnography, no MROC, no survey, no statistical analysis, but is simply "looking stuff up". They're "looking stuff up" using Google, and Facebook, and Twitter, and article sites, and possibly...when they just can't get the answer, they're shooting the question over to ChaCha...all in the name of market research. Not exactly our market research methods...or are they? Are these our evolved research methods for conducting social media market research?
A few years ago I ran across an article in Quirks by Tim Macer. He was doing an evaluation of a number of industry software packages. Since then, when I run across his published articles, I try to take a look at them. Recently, he and an associate published their "Globalpark Annual Market Research Software Survey 2009". This was their sixth annual survey and well worth a look. Pertaining to this post, a small part of this study was an evaluation of the online communities being managed by his sample. The results were a little surprising given the amount of "chatter" that goes on regarding social media and research methods. He found:
- "Communities are still very rare."
- "Early adopters are still operating very few communities."
- "Over half of companies have no plans to operate an online community."
- Of the companies that were running communities most were using the same software to run their communities that they were using to run their panels.
This recent "cheerleading" experience and the lack of established and solid social media based research tools, leads me to the conclusion that I stated earlier. Social media research methods, and their accompanying technologies, are REALLY UNDERDEVELOPED and VERY UNSTANDARDIZED. In fact, I'm not even sure that they are completely defined yet or even exist with any level of sophistication...they are EXTREMELY UNEVOLVED. I appreciate the efforts by a few early adopters in our industry who have started writing about how to do this work more effectively. If you've seen or written one of these articles, please post the link to your article here as a reference for the readers.
Before we face the challenges of the unrepresentative online panel, we as a market research industry, should define what social media research is to begin with (even though the definition will evolve...much like the conversation evolves), and establish best practices for doing good, quality, social media market research that can be analyzed and/or evaluated in reportable ways that represent the opinions of engaged participants willing to add to the conversation.
- Are you aware of a great article on how to conduct social media research? If so, please link to it on this post. For the good of the market research community.
- I've recently wrote a follow up to this article titled "Adventures in Grunge and Social Media Market Research." If you're interested in this subject it's worth a read.