Market Connections

Research IT
In this issue:

Qualitative Studies Deliver Insights – Not Statistically Valid Data

All too often, organizations assume they can predict or generalize their target audience's behavior based on insights gleaned from qualitative studies like focus groups or in-depth interviews (IDIs).  However, that's often not the case and can actually lead to risky and ill-informed business decisions in the market.

Qualitative research is subjective and directional in nature and reveals the "why" by capturing insights about feelings, attitudes, opinions, and behavior drivers surrounding a defined topic(s). Conversely, quantitative research entails a statistically valid size of the target audience and gleans objective, structured, numeric data that provides insights into the "what".

An important key to obtaining data that can be accurately projected onto an entire target audience is carefully designed survey questions that are precisely replicated from person to person so that the results can be added together and compared.  This isn't possible with a series of focus groups and/or IDIs – even if they entail a fairly large number of nationwide participants -- as open-ended discussions and group dynamics impact the flow, wording, and order of the questions.

Combining Techniques into a Hybrid Study

Smart researchers will often combine both types of research into one program, sometimes using a quantitative study to validate certain hypotheses or ideas gleaned in a prior qualitative study.  For example, a client conducted a follow-on quantitative study to test numerous hypotheses developed from their focus groups, including one about federal customers' contract preferences.  While the quantitative study validated and even shed more light on several hypotheses, it revealed the important finding that civilian and defense employees had different contract preferences – something the focus groups did not uncover.

In addition, though a quantitative survey is made up primarily of close-ended questions, it can also include open-ended questions to reveal the reasons behind specific scores and answers, thoughts on current and future practices, needs unique to each organization, and so forth.  A good research firm will analyze and report on qualitative data separately, as it often drives different follow-up actions than quantitative data.

Once you've defined your knowledge gaps and research budget, rely on your research partner to help you set realistic program objectives and determine the most effective means of meeting them.  However, always keep in mind that qualitative studies, such as focus groups and IDIs, provide an in-depth view of why some in the market think, feel, and behave the way they do.  Quantitative surveys, by contrast, allow you to accurately measure the preferences, perceptions, and behaviors of the market. 

Because these two methodologies are very different, aligning the wrong methodology with the research objectives can result in your organization making important decisions based on an incomplete and potentially misleading picture of the market.  However, when the objectives warrant it, a hybrid study that combines these two complementary approaches can yield a highly detailed and meaningful picture of the target market. 

To Top

Best Practices for Driving Customer Satisfaction Improvements
 
The many customer satisfaction programs for which we've provided research services over the last decade each have their own unique attributes.  Some of our clients conduct their surveys annually, while others do them twice a year or every month.  Service companies typically require relationship surveys, while resellers and product companies conduct surveys that are transactional in nature.  Some use 10-point scales, and others use 5-point scales.  But, the most successful customer satisfaction programs most definitely have some things in common.  Here are a few of the practices we've identified among the very best:

  • Executive management commitment and attention.  An engaged management team – one that eagerly and willingly provides hands-on involvement – makes all the difference.  This means they ensure their area is fully represented in the survey development and process, they personally review the customer satisfaction survey results, and they lead the charge on the process improvement efforts.
  • Measurable satisfaction goals and performance tracking.  Each program that is established to improve customer satisfaction must have associated quantifiable metrics that can be tracked.  For example, one client had repeatedly seen poor scores for their sales representatives' product knowledge.  The company set a goal to significantly improve this rating within one year.  They then introduced a new software application designed to immediately deliver requested product information to their sales department on demand.  With product information right at their finger tips, the sales department was able to share it with customers in a more timely and effective manner.  Within the year, the company met its satisfaction improvement goal and has successfully maintained the score over the long term.
  • Simple, streamlined process improvement tactics.  Sometimes over-eager employees charged with leading the satisfaction improvement efforts unintentionally create tracking mechanisms or processes that are too cumbersome, bureaucratic, or paperwork-intensive.  As a result, the organization doesn't embrace or adopt the new procedures or metrics, which leaves improvement initiatives doomed for failure.  It's best to keep the new processes and procedures as simple as possible – and to have them reviewed and refined by an experienced operations person with an enterprise perspective before they're put into practice.
 

To Top

News
Contact Us
Market Connections, Inc.
13135 Lee Jackson Hwy Suite 380
Fairfax, VA 22033

Phone: 703.378.2025

Email: Email Us

Quick Links