Subscribe to "The Landmark" Articles by Email

Your email:

Discovery Research Group is an experienced market research solutions provider. Please follow us on these Social Media outlets!

The Landmark Blog

Current Articles | RSS Feed RSS Feed

Social Media Market Research Methods are REALLY Unevolved

  
  
  

As you are reading through this article...Please also consider this post titled "Social Media Research: What a Difference a Year Makes"  Social Media Research is evolving VERY FAST and this is worth considering. 

Sometimes you just run out of things to say.  We've all experienced it.  When you're engaged in conversation with a group of people, it's the lull in conversation between the end of one topic and the beginning of another.  The quieting of the chatter.  Then something happens, it's a little bit difficult to define what it is, but a stimulus occurs that shoots the conversation down a whole new track, a micro conversation that invigorates the macro conversation.  I believe that this happens in social media, and I experienced it recently with this blog. 

For the first time since starting this blog, for the past couple of weeks, I've frankly had very little to say.  It was a very interesting experience for me.  I'm not a rabid talker to begin with, but I typically have some thought...some idea...some topic for this blog...gestating in my head.  I had nothing.  A lapse in the conversation...

Until last night...

Last night I was given a very simple illustration of the impact social media can have on the conversation.  I've mentioned this before, but I have teens in my household.  Two of them began to argue last night about whether cheerleading is actually a sport.  One of them is a cheerleader, the other a soccer player.  The soccer player posted this simple question to his 300 friends on Facebook..."Who agrees that cheerleading isn't a sport? Sorry Sis."  Incidentally, the cheerleader had just returned from a two-hour tumbling session, was tired, sore, and feisty.  Chaos ensued.  The simple question resulted in 42 Facebook comments (not Cheerleadingto mention the internal "conversation" going on in my household).  Both sides of the controversy chimed in with blistering frequency (over an hour and a half) and then the conversation stopped very abruptly when the parents of these teens sent them all to bed around 10:30pm.  

In the process of the conversation, I Googled whether cheerleading was a sport and didn't really come to a definitive answer.  When I didn't get a resolution to the question from Google, I consulted the mother of all immediate answers...ChaCha.

If you've never heard or used this service, it's very unique (and for the most part free).  The teens I know use this service A LOT.  You text ChaCha a question (242242 - spells "ChaCha")...any question...and ChaCha will text you the answer.  You can send some N number of questions per month (data & txt messages apply) without being charged (I don't text them often enough to know what the limit is).  The slogan on their website is "Real people answering your questions!  Crazy Huh?"

I texted this simple question to ChaCha.  "Is cheerleading a sport".  As always, ChaCha came back with a reply in less than 30 seconds.  "ESPN Court rules cheerleading is contact sport, yet many states for high school sports are not ruling it a sport, it depends who you ask.  I would say Cheerleading is a sport."  An ESPN Court ruled that cheerleading is not only a sport but a contact sport.  If you've seen many cheerleading competitions, you'll understand.  In the past several years that I've attended these competitions with my daughter, I've seen more people fall out of "stunts", more girls kicked or inadvertently punched in the face, fallen or dropped from 15-20 feet in the air, and/or hurt than I've seen in most other "sport" activities.  At one point I actually tried to start videoing when these athletes "took a whipper."  I agree with ChaCha.  Cheerleading, at least competitive cheerleading, is a sport.

In connecting the dots from this experience to the market research that many of us provide, something occurred to me.  Social media market research methods are REALLY UNDERDEVELOPED and VERY UNSTANDARDIZED.  As I've followed the #MarketResearch hash tag on Twitter, I realized something.  The way that most of us operating in the market research industry define market research, and the way that a lot of "other" businesses often define market research are very different.

You'll often see this post pop up on Twitter "Conducting #MarketResearch on...".  The interesting point here is that this person is typically not doing any kind of Qualitative or Quantitative research as the market research industry has defined it.  No focus group, no ethnography, no MROC, no survey, no statistical analysis, but is simply "looking stuff up".  They're "looking stuff up" using Google, and Facebook, and Twitter, and article sites, and possibly...when they just can't get the answer, they're shooting the question over to ChaCha...all in the name of market research.  Not exactly our market research methods...or are they?  Are these our evolved research methods for conducting social media market research?

A few years ago I ran across an article in Quirks by Tim Macer.  He was doing an evaluation of a number of industry software packages.  Since then, when I run across his published articles, I try to take a look at them.  Recently, he and an associate published their "Globalpark Annual Market Research Software Survey 2009".  This was their sixth annual survey and well worth a look.  Pertaining to this post, a small part of this study was an evaluation of the online communities being managed by his sample.  The results were a little surprising given the amount of "chatter" that goes on regarding social media and research methods.  He found:

  • "Communities are still very rare."
  • "Early adopters are still operating very few communities."
  • "Over half of companies have no plans to operate an online community."
  • Of the companies that were running communities most were using the same software to run their communities that they were using to run their panels.

This recent "cheerleading" experience and the lack of established and solid social media based research tools, leads me to the conclusion that I stated earlier.  Social media research methods, and their accompanying technologies, are REALLY UNDERDEVELOPED and VERY UNSTANDARDIZED.  In fact, I'm not even sure that they are completely defined yet or even exist with any level of sophistication...they are EXTREMELY UNEVOLVED.  I appreciate the efforts by a few early adopters in our industry who have started writing about how to do this work more effectively.  If you've seen or written one of these articles, please post the link to your article here as a reference for the readers.  

Before we face the challenges of the unrepresentative online panel, we as a market research industry, should define what social media research is to begin with (even though the definition will evolve...much like the conversation evolves), and establish best practices for doing good, quality, social media market research that can be analyzed and/or evaluated in reportable ways that represent the opinions of engaged participants willing to add to the conversation. 

  • Are you aware of a great article on how to conduct social media research?  If so, please link to it on this post.  For the good of the market research community.
  • I've recently wrote a follow up to this article titled "Adventures in Grunge and Social Media Market Research."  If you're interested in this subject it's worth a read.

Comments

Most original and approach and very interesting observation Patrizio. Thanks for your creativity. This might reveal a real business opportunity. 
Posted @ Tuesday, April 27, 2010 3:47 AM by Michel Ickx
Your comment about "looking for stuff on the internet" hit home with me. I often think I'm talking to a researcher only to discover our use of the term research is completely different. 
 
You are absolutely correct about there being no standards for social media research. There are so many nuances in this field that are completely unlike any survey/focus group/mroc method that we are developing standards along the way. And in discussions with other people, are finding differences of opinion along the way. It will be interesting to see where we end up in a couple years when we have nailed down some standards that most people agree on. 
 
Annie Pettit, CRO 
www.conversition.com
Posted @ Tuesday, April 27, 2010 7:36 AM by Annie Pettit @LoveStats
Thanks for the contribution Annie & Michel. As I've tried to place "social media research" in it's own methodological "box" I've had a very difficult time. I would like readable best practices, outlined methods that can be duplicated, and that produce measurable outcomes. What I've found is that this term means many different things to many different people, all changing based on your vantage point and what you want the term to mean. I like your point that you are "finding differences of opinion along the way." Maybe that's what we should expect...given that it's social.
Posted @ Wednesday, April 28, 2010 11:45 AM by Vaughn Mordecai
You speak the truth, Vaughn. I read the comments anxiously, in the hopes of finding links to the articles you suggested people post.
Posted @ Friday, August 20, 2010 1:27 PM by Tracy Tuten
By the way, the August 2010 issue of Quirks and alert! each have articles on REAL social media research. Let's say the articles are just for you. :)
Posted @ Friday, August 20, 2010 2:32 PM by Annie Pettit
Thanks for the note Annie. For anyone following this thread, you really should take a look at the August 2010 issue of Quirks. Annie is an article contributor to this edition who has made some strong headway in the area of social media research...even since this article was originally written. This method is evolving VERY quickly and Annie's company Conversition (http://www.conversition.com/) is one of the companies that is leading the charge.
Posted @ Monday, August 23, 2010 1:00 PM by Vaughn Mordecai
Annie, Thank you for the tip! I had found the Quirk issue that very day and it is indeed helpful.
Posted @ Monday, August 23, 2010 1:59 PM by Tracy
The search for methodological standards in social media research reminds me of when I first started in the business in the 1970s and the transition from in-home to telephone research was gearing up. Both modes shared commonalities, but many issues required new thinking, revised assumptions and improved or entirely different techniques. It will be interesting to see where this new road takes the profession.
Posted @ Thursday, August 26, 2010 2:46 PM by Mark Schneider
That's a very good point. It has started to feel a lot like the significant steps into new directions of the past. I'm sure that down the road a year or two we'll have much more industry wide established best practices. For now, key stakeholders seem to be blazing the way, trying to standardize and talk about best practices as much as they can so that researchers new to the method have an easier time.
Posted @ Thursday, August 26, 2010 5:05 PM by Vaughn Mordecai
Hi Vaughn, 
 
Great article--this is certainly a hot topic of debate within the industry. I agree, we still have a long way to come as to define and conduct social media market research. I think with all the buzz around this topic and research currently being conducted,the industry is finally starting to come up with answers for researchers on these very important questions.  
 
I have included a link to a webinar I participated in with Jim Longo of Itracks and Dan Coates of Globapark. 
 
The topic of the webinar was "Social Market Research: Real World Accounts of What Works". In the webinar, Jim, Dan, and myself discuss the difference between overt & covert listening, how to recruit, alert, and engage panel and community members through the use of social media technologies and applications, how to incorporate and integrate social media into your own business/brand strategy, and some key takeaways. 
 
http://www.globalpark.com/files/SocialMedia.html 
 
Hopefully you will find this to be a valuable resource. 
 
Thanks again for your post. 
 
Aaron Burch 
 
Senior Director, Online Panels & Communities 
Touchstone Research 
Posted @ Friday, October 08, 2010 1:32 PM by Aaron Burch
Thanks for the link Aaron. I'll be sure to take a look. It sounds like this will add some excellent insight that hasn't really been brought up in this post...leveraging social media for your research. Something that many of us could use.
Posted @ Friday, October 08, 2010 4:27 PM by Vaughn Mordecai
Post Comment
Name
 *
Email
 *
Website (optional)
Comment
 *

Allowed tags: <a> link, <b> bold, <i> italics