The Landmark Blog

Robots and the Uses for IVR in Market Research Surveys

 Email Article |  Twitter |  Facebook |  digg it |   delicious |   LinkedIn |   Technorati 

Did you ever used to watch the TV show "Mystery Science Theater 3000"?  The show was extremely funny and very creative.  The basic premise was to take a bunch of old, corny, black and white science fiction and horror movies, play them in the background on a large screen while a couple of "robots" and a human make fun of them.  Sounds like a strange premise, but it works.  If you've never seen it, make the jump (after you read this blog) to their website and check it out.  Very funny stuff.  

The thing that every person knows about robots is that, like Mystery Science Theater 3000, all good robots should have the ability to speak.  Market Research has speaking robots of their own.  If you're involved in doing telephone market research, you've heard of "robo-dialing" or "auto-dialing" and "interactive voice response - IVR".  Take a look at this picture...now you know who's making these automated research calls.

It's been a while since I really geeked out and posted an article that was extremely focused on methods of collecting market research data.  This one has been rolling around in my brain for some time.  For awhile now, I've wondered why more people don't use IVR with more regularity as a method for data collection.  I've come to the conclusion that researchers may be less familiar with the process, probably don't completely understand how it operates, and don't really make the connection to its benefits.

IVR or Interactive Voice Response has been around for quite some time.  About once a week, I receive a phone call from one of my children's schools telling me that they were absent from a class (most times we knew about it).  Candidates in the political arena often use the technology for "Get out the Vote" campaigns. Though it can't be used for research purposes, basic IVR phone technology is built into the structure of most company's telephone systems (ex. when the "phone tree" asks for the extension, your voicemail, etc.)  

The 2009 version of Rockhopper's "Research Industry Trends" report shows us that only 11% of companies actually use this market research data collection method.  I really wonder why the technology is used so infrequently, especially given that it has many of the same advantages as online research, and overcomes some of the barriers.  Here are some advantages to using IVR as a method of collection: 

• IVR deals very effectively with the self selected sampling methods comparable to what you see online (inbound calls from "current customers").  This is the IVR use that most people are familiar with. 
• Most IVR systems have the ability to make outbound calls.  IVR is a capable method for Random Digit Dialed (RDD) or client listed outbound studies.
• Because IVR is automated, the labor associated with the job is minimized.  The net result is a cost per interview that is much less expensive than "typical" phone studies and similar to online costs.
• Similar to online research, the turnaround time on IVR studies can be much faster for outbound dialed projects, with many of the same benefits of phone dialing and fewer of the "risks" associated with online research.
• IVR is particularly capable of generating qualified responses on low incidence studies.  Most systems can be set up to dial through the records and giving the respondent the choice between being transferred to a telephone interviewer (called a Warm Transfer) or completing the interview with the automated system.
• Many IVR systems store data in databases which are easily plugged in to data or research dashboards.

What are your thoughts.  Why don't more people use IVR in their arsenal of market research methods of collecting market research data?  Are there uses for IVR that I've missed?  What about barriers I've overlooked?  I look forward to your responses.

Social Media Market Research Methods are REALLY Unevolved

 Email Article |  Twitter |  Facebook |  digg it |   delicious |   LinkedIn |   Technorati 

Sometimes you just run out of things to say.  We've all experienced it.  When you're engaged in conversation with a group of people, it's the lull in conversation between the end of one topic and the beginning of another.  The quieting of the chatter.  Then something happens, it's a little bit difficult to define what it is, but a stimulus occurs that shoots the conversation down a whole new track, a micro conversation that invigorates the macro conversation.  I believe that this happens in social media, and I experienced it recently with this blog. 

For the first time since starting this blog, for the past couple of weeks, I've frankly had very little to say.  It was a very interesting experience for me.  I'm not a rabid talker to begin with, but I typically have some thought...some idea...some topic for this blog...gestating in my head.  I had nothing.  A lapse in the conversation...

Until last night...

Last night I was given a very simple illustration of the impact social media can have on the conversation.  I've mentioned this before, but I have teens in my household.  Two of them began to argue last night about whether cheerleading is actually a sport.  One of them is a cheerleader, the other a soccer player.  The soccer player posted this simple question to his 300 friends on Facebook..."Who agrees that cheerleading isn't a sport? Sorry Sis."  Incidentally, the cheerleader had just returned from a two-hour tumbling session, was tired, sore, and feisty.  Chaos ensued.  The simple question resulted in 42 Facebook comments (not to mention the internal "conversation" going on in my household).  Both sides of the controversy chimed in with blistering frequency (over an hour and a half) and then the conversation stopped very abruptly when the parents of these teens sent them all to bed around 10:30pm.  

In the process of the conversation, I Googled whether cheerleading was a sport and didn't really come to a definitive answer.  When I didn't get a resolution to the question from Google, I consulted the mother of all immediate answers...ChaCha.

If you've never heard or used this service, it's very unique (and for the most part free).  The teens I know use this service A LOT.  You text ChaCha a question (242242 - spells "ChaCha")...any question...and ChaCha will text you the answer.  You can send some N number of questions per month (data & txt messages apply) without being charged (I don't text them often enough to know what the limit is).  The slogan on their website is "Real people answering your questions!  Crazy Huh?"

I texted this simple question to ChaCha.  "Is cheerleading a sport".  As always, ChaCha came back with a reply in less than 30 seconds.  "ESPN Court rules cheerleading is contact sport, yet many states for high school sports are not ruling it a sport, it depends who you ask.  I would say Cheerleading is a sport."  An ESPN Court ruled that cheerleading is not only a sport but a contact sport.  If you've seen many cheerleading competitions, you'll understand.  In the past several years that I've attended these competitions with my daughter, I've seen more people fall out of "stunts", more girls kicked or inadvertently punched in the face, fallen or dropped from 15-20 feet in the air, and/or hurt than I've seen in most other "sport" activities.  At one point I actually tried to start videoing when these athletes "took a whipper."  I agree with ChaCha.  Cheerleading, at least competitive cheerleading, is a sport.

In connecting the dots from this experience to the market research that many of us provide, something occurred to me.  Social media market research methods are REALLY UNDERDEVELOPED and VERY UNSTANDARDIZED.  As I've followed the #MarketResearch hash tag on Twitter, I realized something.  The way that most of us operating in the market research industry define market research, and the way that a lot of "other" businesses often define market research are very different.

You'll often see this post pop up on Twitter "Conducting #MarketResearch on...".  The interesting point here is that this person is typically not doing any kind of Qualitative or Quantitative research as the market research industry has defined it.  No focus group, no ethnography, no MROC, no survey, no statistical analysis, but is simply "looking stuff up".  They're "looking stuff up" using Google, and Facebook, and Twitter, and article sites, and possibly...when they just can't get the answer, they're shooting the question over to ChaCha...all in the name of market research.  Not exactly our market research methods...or are they?  Are these our evolved research methods for conducting social media market research?

A few years ago I ran across an article in Quirks by Tim Macer.  He was doing an evaluation of a number of industry software packages.  Since then, when I run across his published articles, I try to take a look at them.  Recently, he and an associate published their "Globalpark Annual Market Research Software Survey 2009".  This was their sixth annual survey and well worth a look.  Pertaining to this post, a small part of this study was an evaluation of the online communities being managed by his sample.  The results were a little surprising given the amount of "chatter" that goes on regarding social media and research methods.  He found:

• "Communities are still very rare."
• "Early adopters are still operating very few communities."
• "Over half of companies have no plans to operate an online community."
• Of the companies that were running communities most were using the same software to run their communities that they were using to run their panels.

This recent "cheerleading" experience and the lack of established and solid social media based research tools, leads me to the conclusion that I stated earlier.  Social media research methods, and their accompanying technologies, are REALLY UNDERDEVELOPED and VERY UNSTANDARDIZED.  In fact, I'm not even sure that they are completely defined yet or even exist with any level of sophistication...they are EXTREMELY UNEVOLVED.  I appreciate the efforts by a few early adopters in our industry who have started writing about how to do this work more effectively.  If you've seen or written one of these articles, please post the link to your article here as a reference for the readers.  

Before we face the challenges of the unrepresentative online panel, we as a market research industry, should define what social media research is to begin with (even though the definition will evolve...much like the conversation evolves), and establish best practices for doing good, quality, social media market research that can be analyzed and/or evaluated in reportable ways that represent the opinions of engaged participants willing to add to the conversation. 

• Are you aware of a great article on how to conduct social media research?  If so, please link to it on this post.  For the good of the market research community. 

Enhancing your Market Research...through free software

 Email Article |  Twitter |  Facebook |  digg it |   delicious |   LinkedIn |   Technorati 

I'm constantly looking for a good deal.  If the features and flexibility are available in a product, there's nothing better than "free".  For the holidays...and in preparation for 2010...Here are five software packages that I've run across that, with some thought and some tweaking, could enhance your market research product or market research service offerings.  

(Warning - Some of this may take some involvement from your IT staff...be prepared.)

• The Standard Social Media platforms - Faceboook, LinkedIn, Twitter, etc. Many market research organizations are using these to simplify some pretty standard market research tasks.  Increasingly, I've seen organizations use them as market research recruiting platforms for face-to-face (or ear-to-ear) research respondents, using them as a launching platform for online surveys, gathering qualitative information about a product or a brand, etc.  If you haven't set your company up on these media platforms...you should think about it.
  
• SocialSeek - Along those lines is a fun little piece of software called SocialSeek.  SocialSeek is loaded on your hard drive and allows you to run a search on any subject you can imagine, in any city.  The software returns all of the content on the Social Media webosphere related to that search.  It's easy to download and install and the software is worth taking a look at. 
• LimeSurvey - Speaking of online surveys...There are a million free (or very inexpensive) online survey platforms out there...with very little difference between them.  For the most part they are commercial ASP products housed on the internet.  LimeSurvey is different.  LimeSurvey is an Open Source online survey platform, housed on your own internal servers, with many of the features of the full-blown (and expensive) research platforms sold in the Market Research industry.  It's features are constantly growing because of the nature of open source software, it allows for translation into a host of different languages, and provides the security of housing your data at your own facility instead of through someone's online survey platform.  
• Ning or Elgg - You've heard of MROC's (maybe you haven't)...MROC stands for Market Research Online Community...also called ORC...Online Research Community.  These are market research communities that are created to address the qualitative (and sometimes quantitative) research needs of specific brands, companies, topics, or subjects.  Members of these MROC's are typically interested, engaged, and willing to interact with others regarding the brand, company, topic, or subject which allows companies to collect market research information from engaged research respondents. Ning and Elgg are different software packages that help facilitate the creation of these communities.  Ning is an ASP platform housed online, while Elgg can be housed on your local network and made available online.
• Rapidminer - I have to admit I'm new to this one and haven't explored it to the extent that I'd like.  I stumbled on it while I was looking for something else.  Rapidminer is a "Data Mining" software that appears to have a very wide selection of features.  It also has a strong user-based forum that addresses concerns for the novice to advanced user.

I've been searching for two types of "free" or open-source market research software. 

• The first is a qualitative response...open end...verbatim...coding software.  More than once, I've thought I was very close to finding what I was looking for (RapidMiner...for example). 
  
• The second is a way to pull content off the web, social media, blogs, etc. for qualitative research purposes.  This is a slightly...taboo...subject because most "Content Scrapers" have been historically used for malicious purposes and are not easy to use.  I'm looking for an "easy to use," free, scraper to be used for non-malicious purposes.  

That's all for now...so...

• Have you run across any free software that would be intriguing for the market research industry to examine?
• What are they?
• What's missing from this list?