This website uses cookies to store information on your computer. Some of these cookies are used for visitor analysis, others are essential to making our site function properly and improve the user experience. By using this site, you consent to the placement of these cookies. Click Accept to consent and dismiss this message or Deny to leave this website. Read our Privacy Statement for more.
Qual Power
Blog Home All Blogs

How To Create Effective Screeners

Posted By Jeff Walkowski, Tuesday, May 28, 2019
Updated: Friday, May 24, 2019

How To Create Effective Screeners

Whether you’re experienced or just breaking into qualitative research, it never hurts to review what makes a screener effective in finding just the right people for a research project. It is a questionnaire that recruiters will use to find qualified participants for the study. It is called a “screener” because it is like panning for gold—we have to sift through many people to find the nuggets (qualified people) to be invited to participate. Screeners are used by telephone recruiters, or they may be online surveys as a way to automate the recruitment process. Automation helps reduce expense by eliminating the human effort of dialing phones and talking to potential participants. Keep in mind that automated screeners still have costs associated with them – most notably programming costs which may include quota control, skip patterns, and conditional questions (all of which are typical of any online survey).

All the rules/guidelines about questionnaire construction apply to qualitative research screeners. The most effective screeners have the following characteristics:

They Are Short

If a screener is too long, participants may hang up the phone with a recruiter or simply decide to discontinue completing an online survey. Ideally, screeners have no more than 10-15 questions, or they take no longer than 5 minutes to administer (online or offline).

 

They Are Clear about the Purpose at the Beginning

Tell participants that it is not a sales call. Explain that we are looking for people to participate in a market research interview, but we must spend some time asking some questions to determine if they qualify.

 

They Do Not Provide Hints that Encourage Cheating

They include an intentionally general description of the nature of the research so as to not tip off participants to answer a particular way so that they can be invited. For example, say, “We are putting together a focus group on beverages,” instead of “We are putting together a focus group to determine what consumers think of Starbucks.”

 

They Include Questions Up Front that Are Easy to Answer and that Quickly Eliminate People Without Taking too Much Time

For example, if we are looking for millennial females, we will first ask about gender and age so that non-millennial males are quickly excused.

 

They Include Need-to-Know Questions – Not Nice-to-Know Questions

Asking nice-to-know questions lengthens the screener, can be frustrating to potential participants going through the screening process, and makes the recruitment process less efficient and possibly more expensive. Keeping the focus on questions that help determine whether a person should be invited or not is best.

 

They Include Intriguing Questions

Interesting questions keep survey-takers engaged. The objective is to not lose them along the way due to boredom.

 

They Feature Mostly Closed-End Questions

Again, this is designed to help the prospective recruit move through the process as quickly as possible. Closed-end responses also make the task easier for the recruiter (no judgment required).

 

They Often Include One or More of the Following Question Types

  • Product/service category use
  • If they are not users of a particular product or service, they are unlikely to be useful.
  • Brand(s) used more often and/or brands they would never use
  • If the project is about a particular brand, we probably do not want individuals who reject the brand outright (unless, of course, the purpose is to attract those who reject the brand).
  • Past participation in market research surveys, focus groups, and interviews
  • Preference is given to those who are not considered “professional” participants, so that they approach the research experience with a fresh attitude.
  • Employment in certain industries
  • We typically do not want those who are employed in advertising, public relations, or market research. In addition, we tend to rule out those who are employed in the industry that the project is about, because they may “know too much” and not represent the typical customer for the product/service.

 

They May Include an “Articulation” Question

Such open-end questions are used to help ensure that a participant will be able to make a meaningful contribution to the discussion. Sometimes questions are asked that pose a creativity challenge to the potential participant (e.g., “List 10 ways in which rubber bands might be used”). Ideally, however, a question that is related to the product category will be more relevant (e.g., in a study of high-end golfing equipment, potential participants might be asked to demonstrate some core knowledge of current equipment). In markets where participants may have differing levels of proficiency with the language to be used in the group (e.g., English), the recruiter may be asked to judge the ability of the potential participant to be clearly understood. This serves as an additional articulation assessment.

 

Author Bio

Jeff Walkowski is the principal of QualCore.com Inc., a consulting firm providing traditional and online qualitative research services to a wide range of industries including health care, financial services, automotive, and information services. He was schooled as a quantitative specialist and entered the industry in the 1980s as a statistician. He later discovered his talents as a moderator and evolved into a qualitative specialist by the mid-1990s.

Tags:  market research  outreach  QRCA Digest  qualitative research  Recruiting  Research Methodology 

PermalinkComments (2)
 

Annual Conference Reporter on the Scene: Catch and Release

Posted By Melanie Brewer, Friday, February 22, 2019
Updated: Friday, February 15, 2019
Annual Conference Reporter on the Scene: Catch and Release

Recruit 2.0:  Online Marketplaces

Summary:
Do you want to save time and money on recruiting?  So do I.  That’s why I was really excited for the presentation “Catch & Release: Applying My Experience Learning to Fly Fish to Using New Recruiting Tools and Services” by Ted Kendall of TripleScoop Premium Market Research. New platforms for recruiting respondents are disrupting the marketplace, similar to the ways that Uber and Airbnb disrupted the car services and hotel marketplaces. These platforms put the power into our hands, but as Ted put it, how do you decide whether these new platforms fit your recruiting needs and if they do, how do you adapt all your recruiting skills to the new medium?

Key Takeaways:
While acknowledging that no system is perfect, Ted extolled some of the advantages (big) and challenges (modest) based on his several years of experience with Respondent.io and Userinterviews.com, two platforms that are making it possible to easily recruit for qual studies – sometimes filling a study within just a few short hours and at a significantly lower cost.  Benefits include the ability to authenticate users via LinkedIn or Facebook profiles, 80% or higher show rates, easy screening, and access to diverse groups, professions and geographic locations.  While there can be a learning curve, Ted argues it's well worth it for the benefits.  In addition, the platforms are rapidly evolving and are likely to just keep getting better.  Each offers unique features, so they're both worth trying.  One twist is the need to "market" or "pitch" your study to participants, so be prepared to make your project sound awesome and exciting to motivate them to respond – but ideally without totally giving away your screening criteria.

Putting it into practice:
I plan on exploring the tools Ted presented, along with the new features that are being rolled out on a regular basis, after the conference.

A-ha moment:
The observation that these platforms are disintermediating the marketplace similar to other software tools like Uber and Airbnb, and – just like those tools – are likely to become an increasingly important part of the landscape going forward – meaning we should all learn to use them so we don’t get left behind.

I will leave you with this final pro-tip courtesy of Ted: you can use the tipping feature in Respondent to pay for extra tasks you may wish the participants to complete, like homework or pre- or post-tasks!  

Melanie BrewerQRCA Reporter on the Scene:

Melanie Brewer
Santa Barbara Human Factors, Inc.
Twitter: @melanieinsb
LinkedIn: https://www.linkedin.com/in/melaniebennettbrewer/  

Tags:  Conference Recap  QRCA Annual Conference  QRCA Reporter on the Scene  qualitative research  Recruiting 

PermalinkComments (0)
 
Contact Us

Qualitative Research Consultants Association
1000 Westgate Drive, Suite 252
St. Paul, MN 55114

phone:  651. 290. 7491
fax:  651. 290. 2266
info@qrca.org

Privacy Policy | Site Map | Sign Out
© 2019 Qualitative Research Consultants Association

This website is optimized for Firefox and Chrome. If you have difficulties using this site, see complete browser details.