Posted By Jennifer Dale,
Tuesday, September 17, 2019
Qual or Quant? Choosing the best method for your research study
Quantitative and qualitative research are both scientific methods for data collection and analysis. They can be applied alone, or in combination, to maximize insights.
The Basic Difference: Going Beyond What vs. Why
Quantitative research relies on large sample sizes to collect numerical data that can be mathematically analyzed for statistically significantfindings. Surveys are structured, questions are typically closed-ended, and answer choices are fixed. However, quantitative research may also include a limited number of short-answer open-ended questions to help clarify why people responded the way they did to a closed-ended question. Eye tracking, facial coding, and even Big Data fall under the umbrella of quantitative research, with computers analyzing enormous volumes of data incredibly fast.
Quantitative studies produce numerical data, which allows for statistical analysis and ultimately precise findings. The US Census is a great example of a quantitative research study – fixed and close-ended questions, an enormous sample size, a collective review of many respondents, and measured population segments.
In contrast, qualitative research seeks to understand the reasons behind the numbers, as well as what is not yet known. Sample sizes are smaller, questions are unstructured, and results more subjective. Unlike quantitative research, qualitative studies insert the researcher into the data collection process. The researcher probes responses and participants provide more detail. Qualitative data is collected through interviews, group discussions, diaries, personal observations, and a variety of other creative and ever-expanding means.
Qual studies work with textual and visual data, interpreted and analyzed for directional findings. Qualitative research studies include fluid and open-ended questions, a smaller sample size, an in-depth review of each respondent, and emerging themes.
I like to think of the difference visually, where a quant study collects specific data from a large number of people, and a qual study goes deeper to collect greater insights from a small number of people.
How to Choose
The answer to whether you proceed with quantitative or qualitative research lies in your research objective and available resources.
- Why you’re doing the research
- What you need to know
- Your budget, staff, + schedule
- How the findings will be used
Consider these possible scenarios the next time you’re stuck and don’t know which way to go:
Quant + qual can come together in other ways. A questionnaire with open-ended questions, while ultimately coded numerically, can offer a window into the unknown. Focus groups that also include poll questions or surveys can produce hard data when analyzed in total, even if the results are not statistically significant.
With good planning, quantitative and qualitative research come together like a dance, guiding the marketer’s success with every step.
I Say Hybrid, You Say Multimethod
Combining quantitative and qualitative research approaches is an ancient strategy, but the names continue to change with the times. I did a bit of research and found the following terms being used to describe that ideal combination of quantitative and qualitative research. What term do you use? And why? ;)
Jennifer Dale, President + CEO Inside Heads, is a seasoned marketing professional and pioneer in online market research. Her passion for marketing, human behavior, and technology keep InsideHeads on the short list of research providers for some of the world’s most discriminating clients. Jennifer is co-author of Qual-Online, The Essential Guide and has published a number of articles in VIEWS, Alert! and Quirk’s Marketing Research Review.
| Comments (3)
Posted By Isabel Aneyba,
Tuesday, June 25, 2019
Updated: Monday, June 24, 2019
Let’s Work Together: The Consumer Co-Creation Camp
While focus groups have long been a part of the innovation process, many clients have voiced their frustration about the limitations of traditional focus groups. To respond to this and other client needs, we created a methodology called Consumer Co-creation Camp. It is designed to expedite the research process while making it fun and provide a more direct connection between the client and consumers.
We had a client that decided it was time for his company to start an innovative process. This is how he requested the research: “I do not want boring focus groups, I want a fun process like a reality show, where we are looking to discover new things. I do not want to listen to top-of-mind responses, I want a deeper understanding. We want to achieve a year’s worth of research in one comprehensive study: understand the target, create product/brand concepts and evaluate those concepts”
To address this client’s broad request, we facilitated three groups simultaneously in three days to create products and brands with consumers. This process involved multiple stakeholders: the client team, the advertising agency and the consumers. We called this engaging process: The Consumer Co-creation Camp.
At the end of the fieldwork, the client stated: “We clearly know what we need to know to make this product a success in the marketplace”. How did this project provide such clarity and confidence to the client team and agency? In my view, it was the co-creation of compelling consumer-ready ideas. Three successive stages lead them to:
We wanted the participants to get to know one another first, so we asked Millennial participants to introduce themselves using a collage they created prior to the Camp. This set the stage that this process was about the Millennials and about being together. They felt appreciated while they found new friends and were free to use their own colloquial language.
During this process, our clients moved from feeling “I want to hear this and that” to “These people are interesting”” to “This is going to be big”. There was a perception shift because it was the first-time clients had a chance to see how these Millennials saw themselves.
Millennials created new concepts after testing the product. Collages helped participants to articulate their feelings because many times participants do not know how to describe their feelings and emotions. Collages were a springboard to show their feelings and it was a great equalizer, giving them all the opportunity to adapt the product and the brand to themselves. Our clients witnessed how the brand concepts matched Millennials’ needs and personal styles.
This stage motivated the clients the most. The Millennials presented their ideas directly to them, in the same room. The client team and Millennial teams had a vigorous conversation. There was ‘one voice in the room’. Consumers and clients worked in tandem focused on the unifying goal, with no barriers, mirrors or attitudes. After the final presentation, all the clients knew what the final output of the research was!
At the end of the process, three key outcomes would significantly impact product management, the brand vision, and consumer engagement.
Product Management. The global R&D and Marketing team became aligned and felt empowered to make necessary product and packaging changes.
Brand Vision. The client and ad agency gained a deeper understanding of Millennials, their needs, and shared this with the entire corporation. This understanding inspired them to create a new brand vision.
Engagement. The marketing teams learned how Millennials made friends, and this insight helped them to better engage with this target – utilizing a relevant marketing platform.
Even after the camp, the participants’ ideas were referred to constantly by the clients and the agency. Their vivid experiences allowed for crisper memories. The co-creation experience anchored the clients’ understanding on this target audience through a human connection. It was clear how the Co-Creation Camp streamlined the research process, and in the end, saved the client money and time while enhancing their understanding.
Do you believe your corporate clients would value working together with the consumers in a fun, engaging process that yields high quality insights and speedier outcomes?
If so, how can you streamline your next research project to generate compelling consumer -ready ideas? Consumer Co-creation Camp is a great alternative. When empowered and enabled by the research process our experience has shown that Millennials and Clients are happy to embrace the challenge of creating new products and services.
Isabel Aneyba is president and chief insight generator of COMARKA, an Austin, Texas research firm. COMARKA empowers marketers to develop meaningful product and brand ideas with their customers through dialogue. www.comarka.com
| Comments (0)
Posted By Jeff Walkowski,
Tuesday, May 28, 2019
Updated: Friday, May 24, 2019
How To Create Effective Screeners
Whether you’re experienced or just breaking into qualitative research, it never hurts to review what makes a screener effective in finding just the right people for a research project. It is a questionnaire that recruiters will use to find qualified participants for the study. It is called a “screener” because it is like panning for gold—we have to sift through many people to find the nuggets (qualified people) to be invited to participate. Screeners are used by telephone recruiters, or they may be online surveys as a way to automate the recruitment process. Automation helps reduce expense by eliminating the human effort of dialing phones and talking to potential participants. Keep in mind that automated screeners still have costs associated with them – most notably programming costs which may include quota control, skip patterns, and conditional questions (all of which are typical of any online survey).
All the rules/guidelines about questionnaire construction apply to qualitative research screeners. The most effective screeners have the following characteristics:
They Are Short
If a screener is too long, participants may hang up the phone with a recruiter or simply decide to discontinue completing an online survey. Ideally, screeners have no more than 10-15 questions, or they take no longer than 5 minutes to administer (online or offline).
They Are Clear about the Purpose at the Beginning
Tell participants that it is not a sales call. Explain that we are looking for people to participate in a market research interview, but we must spend some time asking some questions to determine if they qualify.
They Do Not Provide Hints that Encourage Cheating
They include an intentionally general description of the nature of the research so as to not tip off participants to answer a particular way so that they can be invited. For example, say, “We are putting together a focus group on beverages,” instead of “We are putting together a focus group to determine what consumers think of Starbucks.”
They Include Questions Up Front that Are Easy to Answer and that Quickly Eliminate People Without Taking too Much Time
For example, if we are looking for millennial females, we will first ask about gender and age so that non-millennial males are quickly excused.
They Include Need-to-Know Questions – Not Nice-to-Know Questions
Asking nice-to-know questions lengthens the screener, can be frustrating to potential participants going through the screening process, and makes the recruitment process less efficient and possibly more expensive. Keeping the focus on questions that help determine whether a person should be invited or not is best.
They Include Intriguing Questions
Interesting questions keep survey-takers engaged. The objective is to not lose them along the way due to boredom.
They Feature Mostly Closed-End Questions
Again, this is designed to help the prospective recruit move through the process as quickly as possible. Closed-end responses also make the task easier for the recruiter (no judgment required).
They Often Include One or More of the Following Question Types
- Product/service category use
- If they are not users of a particular product or service, they are unlikely to be useful.
- Brand(s) used more often and/or brands they would never use
- If the project is about a particular brand, we probably do not want individuals who reject the brand outright (unless, of course, the purpose is to attract those who reject the brand).
- Past participation in market research surveys, focus groups, and interviews
- Preference is given to those who are not considered “professional” participants, so that they approach the research experience with a fresh attitude.
- Employment in certain industries
- We typically do not want those who are employed in advertising, public relations, or market research. In addition, we tend to rule out those who are employed in the industry that the project is about, because they may “know too much” and not represent the typical customer for the product/service.
They May Include an “Articulation” Question
Such open-end questions are used to help ensure that a participant will be able to make a meaningful contribution to the discussion. Sometimes questions are asked that pose a creativity challenge to the potential participant (e.g., “List 10 ways in which rubber bands might be used”). Ideally, however, a question that is related to the product category will be more relevant (e.g., in a study of high-end golfing equipment, potential participants might be asked to demonstrate some core knowledge of current equipment). In markets where participants may have differing levels of proficiency with the language to be used in the group (e.g., English), the recruiter may be asked to judge the ability of the potential participant to be clearly understood. This serves as an additional articulation assessment.
Jeff Walkowski is the principal of QualCore.com Inc., a consulting firm providing traditional and online qualitative research services to a wide range of industries including health care, financial services, automotive, and information services. He was schooled as a quantitative specialist and entered the industry in the 1980s as a statistician. He later discovered his talents as a moderator and evolved into a qualitative specialist by the mid-1990s.
| Comments (2)
Posted By Jay Zaltzman,
Tuesday, February 5, 2019
Updated: Monday, February 4, 2019
I know it’s tempting, when a client — whether it be a company or an internal client — says they want four focus groups in Chicago, to answer “coming right up!” But it’s important to remember that, as qualitative researchers, our job isn’t only to conduct discussions or interviews, but rather to design research that will be most effective in answering our clients’ research questions.
We need to remind those clients about the value we can bring to the table. Remember, they may be considering “John in Marketing — he’s good with people, let’s have him ask the questions in the focus group.” But “John in Marketing” doesn’t necessarily know about designing research methodology. And he doesn’t realize that there’s more to a discussion guide than just “asking the questions.”
So, when clients ask if I can do four focus groups in Chicago, I say I can; but then I ask them to give me the background to the project. What are their objectives? How will the results be used? Do they have a budget? Why were they thinking of four focus groups in Chicago, specifically?
In my proposal, I’ll provide a cost for the four focus groups they requested, but based on what I learned, I might also suggest some alternatives. Let’s say it turns out they wanted the four groups in Chicago because that’s local, and they don’t have the budget for executives to travel to view groups. I might suggest two mini-groups in Chicago and four online mini-groups via webcam. Or depending on the topic, perhaps to two groups in Chicago and some online journaling nationwide. And of course, I’ll explain the reasoning behind those suggestions. Even if the clients say “thanks, but we’ll stick with the four groups in Chicago,” they will be impressed by the thinking... and you’ll be more likely to be hired than the competitor who had not included those kinds of options!
And don’t forget to offer to help the clients digest the research results. I try to always include the option of running a workshop with the stakeholders after the research is completed, to discuss the findings and how they might be utilized. It’s fulfilling to see the impact of the research, and it provides more value to your clients... and that’s the name of the game!
By: Jay Zaltzman
Jay Zaltzman believes that qualitative researchers can offer true value to clients by combining empathy with creative methodology and analytical rigor. Jay has been president of Bureau West Market Research/Voice of the Customer for the past twenty years. He is an active member and past president of the QRCA.
| Comments (0)