Posted By Jennifer Dale,
Tuesday, September 17, 2019
Qual or Quant? Choosing the best method for your research study
Quantitative and qualitative research are both scientific methods for data collection and analysis. They can be applied alone, or in combination, to maximize insights.
The Basic Difference: Going Beyond What vs. Why
Quantitative research relies on large sample sizes to collect numerical data that can be mathematically analyzed for statistically significantfindings. Surveys are structured, questions are typically closed-ended, and answer choices are fixed. However, quantitative research may also include a limited number of short-answer open-ended questions to help clarify why people responded the way they did to a closed-ended question. Eye tracking, facial coding, and even Big Data fall under the umbrella of quantitative research, with computers analyzing enormous volumes of data incredibly fast.
Quantitative studies produce numerical data, which allows for statistical analysis and ultimately precise findings. The US Census is a great example of a quantitative research study – fixed and close-ended questions, an enormous sample size, a collective review of many respondents, and measured population segments.
In contrast, qualitative research seeks to understand the reasons behind the numbers, as well as what is not yet known. Sample sizes are smaller, questions are unstructured, and results more subjective. Unlike quantitative research, qualitative studies insert the researcher into the data collection process. The researcher probes responses and participants provide more detail. Qualitative data is collected through interviews, group discussions, diaries, personal observations, and a variety of other creative and ever-expanding means.
Qual studies work with textual and visual data, interpreted and analyzed for directional findings. Qualitative research studies include fluid and open-ended questions, a smaller sample size, an in-depth review of each respondent, and emerging themes.
I like to think of the difference visually, where a quant study collects specific data from a large number of people, and a qual study goes deeper to collect greater insights from a small number of people.
How to Choose
The answer to whether you proceed with quantitative or qualitative research lies in your research objective and available resources.
- Why you’re doing the research
- What you need to know
- Your budget, staff, + schedule
- How the findings will be used
Consider these possible scenarios the next time you’re stuck and don’t know which way to go:
Quant + qual can come together in other ways. A questionnaire with open-ended questions, while ultimately coded numerically, can offer a window into the unknown. Focus groups that also include poll questions or surveys can produce hard data when analyzed in total, even if the results are not statistically significant.
With good planning, quantitative and qualitative research come together like a dance, guiding the marketer’s success with every step.
I Say Hybrid, You Say Multimethod
Combining quantitative and qualitative research approaches is an ancient strategy, but the names continue to change with the times. I did a bit of research and found the following terms being used to describe that ideal combination of quantitative and qualitative research. What term do you use? And why? ;)
Jennifer Dale, President + CEO Inside Heads, is a seasoned marketing professional and pioneer in online market research. Her passion for marketing, human behavior, and technology keep InsideHeads on the short list of research providers for some of the world’s most discriminating clients. Jennifer is co-author of Qual-Online, The Essential Guide and has published a number of articles in VIEWS, Alert! and Quirk’s Marketing Research Review.
| Comments (0)
Posted By Bruce Peoples,
Tuesday, August 20, 2019
Updated: Tuesday, August 13, 2019
Moderating vs. Facilitating: What’s the Difference? Can You Do Both?
A few events in my career journey triggered the exploration of facilitating as a business opportunity and value-add for my clients. First was a breakout session at a QRCA conference where “facilitating” — vs. “moderating” — was brought to my attention. The second was when a client called me on a Sunday to replace his facilitator on Monday, to facilitate a session with R&D, sales, and marketing. With so little time to prepare, I trusted my instincts and experience as a moderator and let it fly… and suddenly I was a facilitator! It was a productive session — the client called me back for another session, and later to do consumer focus groups — and my curiosity was piqued to learn more.
Core Elements: The Same
I attended a three-day training session in facilitation (much like those offered at RIVA or Burke) and was pleasantly surprised to confirm that these two disciplines have much in common. The core elements of moderating and facilitating are the same: there is a gathering of people with something in common; there is a purpose behind the meeting; and there are desired outcomes. You guide the discussion in a thoughtful manner by providing structure and process.
Perhaps the biggest commonality is putting together an agenda — what we call a discussion guide — based on the client’s objectives and desired deliverables. Like a focus group discussion guide, much attention must be paid to the flow of the meeting and to the activities that will generate robust discussions.
Many of the exercises you utilize for qualitative can also be used for facilitating meetings. These might include:
- Developing lists and gathering, sorting, and ranking ideas
- Breaking out in small groups
- Mind mapping
- Perceptual mapping
Facilitated meetings are usually longer – a half day – and therefore benefit from energizing exercises interspersed throughout the session.
The Differences: Participants, Output, and Achieving Consensus
One key difference between moderating and facilitating is the participants. Focus group participants have no skin in the outcome; you will never see them again. Facilitated participants have to work with each other. A facilitated meeting may have colleagues from different functions (R&D, marketing, sales) and at different levels of authority (managers to vice presidents). When the meeting is over, they have to work together to achieve common goals. Their strategies and tactics – their jobs – might be affected by the outcome. I ask to conduct a few brief interviews of participants from different areas prior to the meeting to get a feel for the situation, personalities, motives, and issues that might arise.
Another difference is the output: in a focus group, the outputs are insights and determining their implications and developing recommendations. In a facilitated work group or work team meeting, the output is often an action plan that determines what, who, how much, and when. The action plan should be understood and agreed upon by all participants. In other words: achieve consensus, which means participants can live with the decisions that created the action plan and support them.
Two issues you’ll address more often when facilitating a work team than moderating consumers are resolving conflicts and achieving consensus. Marketing wants that new ice cream now; manufacturing can’t make it until next year. Your approach is somewhat intuitive and not much different than if moderating – but requires more attention and care. Things you’ll need to spend more time on include clarifying the issue, understanding its root causes, ensuring everyone understands the issue, brainstorming pros and cons, and ultimately utilizing techniques to rank or prioritize.
Projects and Meetings Where Facilitators Add Value
Facilitators can add value to a lot of different projects and meetings, but common types are:
- Innovation: Brainstorming to create new product ideas.
- Process improvement: This might include flowcharting a process, identifying roadblocks, and developing solutions to clear those roadblocks.
- Strategic planning: This might include a market situation assessment, SWOT analysis, and developing the outlines of a new strategic plan.
- Data Analysis: Sharing, analyzing, and assessing a lot of data from a variety of sources.
- Planning and executing a new product launch: The output is often an action plan.
Implications for You
If you are a good moderator, should you seek out facilitation opportunities? Yes! You already have many of the skills, resources, and experiences to successfully facilitate work group meetings. To pump up your confidence before jumping in, seek and find some formal facilitation training. On your first projects, get a partner to help plan and execute.
Put together a one- or two-page brochure (PDF is fine) highlighting your capabilities – and this can include moderating. Then network your way to generate awareness. Many of you work with research managers at large companies. Let them know and ask them to share your capabilities with their colleagues in other functions, such as marketing, sales, R&D, or HR.
About the Author:
Prior to becoming a qualitative consultant, Bruce Peoples worked in brand management, channel, and customer marketing for several well-known brands in different industries including Hanes and Jack Daniel’s. Bruce has been a QRCA member for about a decade now and utilizes a variety of methods to help his clients solve their marketing problems, whether they be consumer or business-to-business related. Bruce was trained in moderating at RIVA and in facilitation at Leadership Strategies.
| Comments (0)
Posted By Laurie Tema-Lyn,
Tuesday, March 19, 2019
Annual Conference Reporter on the Scene: Step Back to Move Forward: Developing Customer Journey Maps
Bring the POWER of Theater Games to Your Next Session!
Let me start off by saying I am not an actor, although I’ve had some theater training. I earn my living as a researcher, consultant and innovation catalyst, and I’ve been doing that for decades.
I like to bring PLAY into my work as I see the results are well worth it in terms of ramping up the energy of a flagging team, developing empathy, encouraging candid, uncensored conversations and triggering or evaluating new ideas.
Using theater games builds on fundamentals that all face-to-face researchers/facilitators should have in their arsenal. They include:
- The ability to build rapport and have fun;
- Creating a “safe place” so people feel comfortable expressing themselves;
- Being able to read your group through attentive listening and observation;
- Being willing to take a risk, knowing that there are no failures — risks lead to opportunities.
Here are tips and techniques to add to your repertoire:
- Start with an easy game; I call this one Word Salad. It’s a new twist on the tried-and-true technique of Mind Mapping by adding a pulse — a finger snap — as you capture each participant’s words on a flip chart pad. Breathe and repeat each word or phrase that you are given as you chart. It can be a bit hypnotic. Participants stop self-censoring and by pausing a moment as you repeat the words they listen, reflect and connect. A variation is to use a Nerf ball and throw it to participants to respond. Less time for “thinking,” just gut level responses.
- Experiment with Improvs to illuminate brand perceptions, product or service use, or to inform creative strategy or positioning. It’s good to do a bit of pre-planning to identify some people, places, things or situations that you might want to see “acted out” in your work session. Position the exercise as an experiment.Ask for volunteers and give basic improv guidelines including the use of “Yes, And…” to accept or build on their partner’s offers. Remind participants that you are not looking to them to be funny or clever, just authentic to the character or situations. After you conduct a couple of improvs, it’s important to review what all have learned.
- Theater of Exaggeration. Try this out to spice up a concept review. You might begin in your typical fashion and then encourage participants to push the boundaries. What are the Most Outrageous Plusses or Benefits to this concept? Conversely, what are the Most Outrageous Negatives to this idea? You just might end up with some new ideas or identify problems that participants had been too polite to suggest earlier.
- Mouthfeel: Try this out to help evaluate a name and positioning. This is an improv where participants stand up and have a conversation using a new name or positioning. I recently ran a naming session with a colleague for a social services agency. We had six names in the top tier and were trying to evaluate which were the best. One of the name candidates looked great on paper, but when I asked for two volunteers to improv it (one in the role of a crisis hotline operator, the other a client calling for help) we realized it was a bear… too cumbersome to speak when used in context. We nixed that one from the list.
- Spontaneity based on solid preparation. These games work when you mentally prepare yourselfas facilitator, prepare your respondent team by providing clear guidelines of what you are asking them to do, and prepare your client team in advance so that they won’t be shocked or worried if you include a theater game to your discussion guide or agenda.
These are just a small sampling of theater games and activities you might bring to your next gig. I encourage you to try them out and make up your own, and feel free to get in contact with me.
Links to more articles on this topic:
Practical Imagination Enterprises
| Comments (2)
Posted By Kendall Nash,
Tuesday, March 5, 2019
Updated: Wednesday, February 27, 2019
Practical and thoughtful, but a walking contradiction. She made it clear that every decision she made had a purpose, and every item she bought met well-defined criteria. As she described her grocery store trips, she recalled the price associated with each and every item. In order to even make it into her cart, the items on her shopping list had to fall within an acceptable and narrow margin. And yet, her eyes lit up and you could see her lost in her memories as she described the unique metal bracelet on her wrist that she had bought on a whim for 250 euro during a trip to Barcelona. She smiled again and told me about how it was made.
Scratching Our Heads
That moment when the consumer tells you something totally incongruent with the story you’ve crafted in your mind of who they are and how they live…
Those comments that seem to contradict each other within a span of minutes…
We formulate clear pictures in our own minds of who a person is and what matters to them, only for them to turn around and tell us something that leaves us scratching our heads.
In my early years as a Qualitative Researcher, I’d find myself frustrated. Seeking patterns and convergence of themes, I was always challenged when things didn’t line up. Sure, I understood things would vary from person to person, but I was caught off guard and perplexed by the number of things that didn’t add up within the perspective of one individual.
Humans Are Messy
Of course, it didn’t take me long to realize what many before me had contemplated – that humans are, in fact, messy. We don’t follow a logical path down the road. There’s not always a reason – or at least not a consistent, or “good”, one. We don’t always make linear decisions. Sometimes we struggle with opposing internal forces that shape our mindsets and behaviors.
But then something beautiful happened.
When I looked more closely at those incongruencies within a single person, there were valuable opportunities for my client to step in and meet the consumer in the midst of the messiness. We identified opportunities for innovative products and delivery, discovered more meaningful ways to connect with those not yet using their brand, and found unique ways to give someone a great customer experience worth talking about. It was actually in those messy places we were finding our most disruptive learning – you know, the insights that make your team say “whoa, yes.” It’s exhilarating to experience those moments when you are onto something that you know will significantly and positively impact your business.
Unveiling the Mess with Qualitative Research
As a fan of both quantitative and qualitative research, I respect the ways both serve in delivering the information we need to make good decisions. Yes, enough people will tell you that quantitative tells you the what and qualitative tells you the why, but it’s so much more for me. Quantitative offers us sound decisions, confidence in direction before we set sail, and a big, delicious slice of the world. The beauty of qualitative is our ability to get in the nooks and crannies. To discover the mess and bring things into the light that just might unlock something truly magical for the brand. The rapport we build with consumers allows us a richer glimpse into what matters to them, so we can become brands that matter to them.
Embrace the Mess
Knowing that the messiness of the human heart and mind can be where the greatest potential lies for brands, we can see those moments through an entirely different lens. The next time in research you find yourself with a consumer who doesn’t seem to fit into a perfectly shaped box in your mind, celebrate! When things don’t add up exactly the way you expect them to, celebrate! You are probably onto something really good. And we go after good things.
What about you? Where have you found gold in the messiness of incongruent, inconsistent, yet beautiful human beings?
Kendall Nash is a Vice President at Burke, Inc. in Cincinnati, Ohio. She is an instructor for the Burke Institute and a past president of QRCA. Kendall’s curiosity drives her closer to consumers and their experiences. Her thrills come from uncovering what people truly want and need, and translating that so brands can win.
| Comments (3)