This website uses cookies to store information on your computer. Some of these cookies are used for visitor analysis, others are essential to making our site function properly and improve the user experience. By using this site, you consent to the placement of these cookies. Click Accept to consent and dismiss this message or Deny to leave this website. Read our Privacy Statement for more.
Qual Power
Blog Home All Blogs

The Beautiful Human Contradiction

Posted By Kendall Nash, Tuesday, March 5, 2019
Updated: Wednesday, February 27, 2019
Untitled Document

Practical and thoughtful, but a walking contradiction. She made it clear that every decision she made had a purpose, and every item she bought met well-defined criteria. As she described her grocery store trips, she recalled the price associated with each and every item. In order to even make it into her cart, the items on her shopping list had to fall within an acceptable and narrow margin. And yet, her eyes lit up and you could see her lost in her memories as she described the unique metal bracelet on her wrist that she had bought on a whim for 250 euro during a trip to Barcelona. She smiled again and told me about how it was made.

Scratching Our Heads
That moment when the consumer tells you something totally incongruent with the story you’ve crafted in your mind of who they are and how they live…

Those comments that seem to contradict each other within a span of minutes…

We formulate clear pictures in our own minds of who a person is and what matters to them, only for them to turn around and tell us something that leaves us scratching our heads.

In my early years as a Qualitative Researcher, I’d find myself frustrated. Seeking patterns and convergence of themes, I was always challenged when things didn’t line up. Sure, I understood things would vary from person to person, but I was caught off guard and perplexed by the number of things that didn’t add up within the perspective of one individual.

Bracelet

Humans Are Messy
Of course, it didn’t take me long to realize what many before me had contemplated – that humans are, in fact, messy. We don’t follow a logical path down the road. There’s not always a reason – or at least not a consistent, or “good”, one. We don’t always make linear decisions. Sometimes we struggle with opposing internal forces that shape our mindsets and behaviors.

But then something beautiful happened.

When I looked more closely at those incongruencies within a single person, there were valuable opportunities for my client to step in and meet the consumer in the midst of the messiness. We identified opportunities for innovative products and delivery, discovered more meaningful ways to connect with those not yet using their brand, and found unique ways to give someone a great customer experience worth talking about. It was actually in those messy places we were finding our most disruptive learning – you know, the insights that make your team say “whoa, yes.” It’s exhilarating to experience those moments when you are onto something that you know will significantly and positively impact your business.

Quote 1

Unveiling the Mess with Qualitative Research

As a fan of both quantitative and qualitative research, I respect the ways both serve in delivering the information we need to make good decisions. Yes, enough people will tell you that quantitative tells you the what and qualitative tells you the why, but it’s so much more for me. Quantitative offers us sound decisions, confidence in direction before we set sail, and a big, delicious slice of the world. The beauty of qualitative is our ability to get in the nooks and crannies. To discover the mess and bring things into the light that just might unlock something truly magical for the brand. The rapport we build with consumers allows us a richer glimpse into what matters to them, so we can become brands that matter to them.

Quote 2

Embrace the Mess
Knowing that the messiness of the human heart and mind can be where the greatest potential lies for brands, we can see those moments through an entirely different lens. The next time in research you find yourself with a consumer who doesn’t seem to fit into a perfectly shaped box in your mind, celebrate! When things don’t add up exactly the way you expect them to, celebrate! You are probably onto something really good. And we go after good things.

What about you? Where have you found gold in the messiness of incongruent, inconsistent, yet beautiful human beings?

Kendall Nash Kendall Nash is a Vice President at Burke, Inc. in Cincinnati, Ohio. She is an instructor for the Burke Institute and a past president of QRCA. Kendall’s curiosity drives her closer to consumers and their experiences. Her thrills come from uncovering what people truly want and need, and translating that so brands can win.

Twitter: @kendallnash
LinkedIn

Tags:  QRCA Digest  qualitative  qualitative research 

PermalinkComments (3)
 

Annual Conference Reporter on the Scene: Using AI for Quantitative Analysis of Qualitative Data

Posted By Michelle Finzel, Thursday, February 28, 2019
Updated: Wednesday, February 27, 2019
Annual Conference Reporter on the Scene: Using AI for Quantitative Analysis of Qualitative Data

Using AI

Summary:
Shamaa Ahmed and Cal Zemelman from Customer Value Partners, gave us a snapshot of the process of using machine learning Artificial Intelligence (AI) to automate large amounts of qualitative data at the 2019 QRCA Annual Conference. Cal went through using AI to summarize the data and assess the emotional state of the respondent through natural language processing. He also gave all of us an opportunity to analyze the data provided from AI into tables and graphs to discover themes.

Key Takeaways:
Through experiencing this process, I discovered that I was able to rapidly classify responses into sentiment buckets and identify outliers easily for more focused review and analysis. I really like that you can create cool charts for the clients (who always want graphics) and you can continuously train the computer model to improve. I was shocked at how easy some of these platforms are to learn and use, most of them are inexpensive or even free, and that it only takes about 100 responses to train a model.

Putting it into practice:
I was really excited to learn about using AI in my practice, especially since it seems like this is the direction our industry is heading! Now that I know that platforms and models are relatively inexpensive, I plan to learn how to program a model for my own research.

A-ha moment:
I always thought, like many of those in our industry do, that AI was something that would be beyond my comfort zone, but I am thrilled to have found out how accessible and easy to learn the platforms and models are and can’t wait to put them into practice. This is the beginning of something and I am intrigued to follow the process of its development!

Michelle FinzelQRCA Reporter on the Scene:

Michelle Finzel
Maryland Marketing Source, Inc.
Twitter: @MichelleFinzel

Tags:  AI  Artificial Intelligencen QRCA Annual Conference  QRCA Reporter on the Scene  qualitative research 

PermalinkComments (0)
 

The QRCA Conference: Why I Loved It & Why You Will, Too

Posted By Vidhika Bansal, Monday, February 25, 2019
Updated: Monday, February 25, 2019
Vidhika Bansal is a 2019 QRCA Young Professionals Grant recipient. First launched in 2014, the Young Professionals Grant helps advance promising young qualitative researchers’ careers by providing access to networking and educational sessions via a free pass to the QRCA’s Annual Conference plus a one-year membership. Visit qrca.org/YPG to learn more.

What often makes quallies like us different from the rest of the world is our collective curiosity, empathy, and ability to transform our knowledge of people’s needs and experiences into strategic direction. Given that the QRCA’s Annual Conference is run and attended by quallies, it’s no surprise then that it’s not your average conference.

My week in Savannah at the 2019 Conference, Charting Your Best Course, was jam-packed and enriching in so many ways. As if the delicious Southern food and relaxing river views weren’t enough, here are three reasons why the QRCA Conference stands out in my mind:



Dessert

Dessert following a scrumptious meal at a local Savannah restaurant, seconds before I devoured it



Networking Made Palatable

As consultants, networking is not just an add-on marketing strategy; it’s practically a necessity. Quite unfortunately though, for many—myself included—networking has almost become a dirty word. It tends to conjure up flashbacks of awkward interactions with strangers, insincere exchanges of pleasantries, and general anxiety and dread. Thankfully, the QRCA conference helps change that.

High friendliness quotient: One thing I learned in almost no time is that QRCA folks are among the friendliest you’ll meet. Perhaps it’s because most of us talk and listen to people for a living, but striking up conversations with fellow conference-goers was refreshingly easy and felt far more authentic than I had expected. The various ribbons added to everyone’s name tags made finding common ground and making connections even easier (especially as a first-timer and YPG recipient). And if you’re shy, have no fear—it’ll just be a matter of time before someone approaches you and breaks the ice!

Stress-free socializing: The organizers orchestrated events that further facilitated pain-free networking, especially if you’re a “first-timer” who has never attended before. First-timers are paired with “ambassadors”, who are QRCA conference veterans that can serve as familiar faces and guides throughout (shout out to my wonderful ambassador, Regina!). There was also a “speed dating” event for first-timers where we got to meet with other ambassadors, and as YPG recipients we were able to connect with fellow early/mid-career quallies at the fun, laidback, young-professionals-only breakfast and dinner events.

(Pro-tip: Remember to bring stacks and stacks of business cards with you—you’ll need them to give to all the new people you’ll meet in quick succession as well as for the vendor raffles!)

Conference Badge

My conference badge, adorned with a couple of colorful ribbons that helped break the ice



Stellar, Actionable Content

One of the main goals of attending any conference is usually to leave with takeaways that you can apply to your work immediately—and the sessions at this one definitely did not disappoint.

Insights about insights: There were so many fantastic talks that it’s not practical for me to list them all right now, but these were some of my favorites.

  • Carmen Simon’s very memorable keynote on using learnings from neuroscience to craft content that sticks, especially by relying on familiar mental models
  • Lisa Lipkin’s engaging anecdotes depicting how to best elicit honest stories from others to learn about them, and how to find “magic in the mundane”
  • Allison Rak’s uber-practical hacks for boosting research and reporting efficiency
  • Liz George’s window into using role-play to glean rich insights when ethnographic methods are not an option due to ethical and logistical constraints
  • Laurie Tema-Lyn’s entertaining workshop on improv exercises as a research tool

FOMO no mo’: With so many intriguing sessions going on in parallel (and without a Time-Turner allowing us to be in multiple places at the same time, a la Hermione Granger), it can sometimes be a challenge to choose which presentation to attend. Luckily, starting this year, all presentations were recorded so attendees could go back and watch them even after the conference was over. On top of that, there were “Reporters on the Scene” taking notes during each session, and those curated notes will be published for those who would prefer reading summaries of sessions they missed over watching full videos. Knowing that I would be able to watch the talks I couldn’t attend in-person saved me a ton of indecision.

(Pro-tip that a few kind members shared with me: If you’re struggling to decide between talks, check out the downloadable presentation decks in advance to give you a sense of which one of the alternatives might be most up your alley.)

Something for everyone: There were talks on a vast variety of topics, including proposal writing, storytelling, recruiting methods, journey mapping, projective techniques, usability testing, and even behavioral science. In addition to the breadth of subject matter, I appreciated the mix of formats in which content was shared, ranging from informal roundtable discussions to vendor exhibits to structured presentations of tools and frameworks.


Dinner Group

Being silly at the Young Professionals Dine-Around (Thank you to Shannon Danzy for the photo!)



Finding Your Tribe

Last, but certainly not least, if I had to sum up what makes the QRCA Conference unique, it would be the unmatched sense of community. Cheesy at it sounds, attending the conference felt more like joining a big, happy family than just congregating with a group of like-minded professionals.

Come for the learnings, stay for the people: Valuable content is no doubt important, but the people you meet at the QRCA Conference are just as important, if not more so. Even though technically attendees could view each other as competitors, I noticed that the environment was overwhelmingly collaborative, with knowledge-sharing and camaraderie aplenty. There are even special interest groups (SIGs) to further hone in on people who share your specific interests (for me, it was the Ethnography, Creativity + Ideation, and UX SIGs). With the QRCA, one thing seems to be true: you get as much as you give.

Hugs, not handshakes: “We’re huggers,” I heard someone say on my first day at the conference. I looked around and—lo and behold—it was true. Not only did people greet each other with a genuine excitement to reconnect, but the good vibes weren’t confined to conference hours. Pre-conference mornings began with “healthy connections”, where passionate QRCA volunteers led dance and meditation sessions to get us started for the day. How cool is that?! Similarly, conference evenings ended with group “dine-arounds”, where we got to reclaim the calories worked off in the morning by indulging at local restaurants—a great way to continue conversations, meet new people, and ensure you always had company for dinner. This personal touch is what makes the QRCA such a special organization.

Needless to say, I’m truly grateful and honored to have been a recipient of the QRCA Young Professionals Grant. Without it, I likely would not have attended this year’s conference, and in turn would have missed out on all of these amazing benefits.

Thanks to the generosity of the grant sponsors and dedication of the event organizers, I left Savannah with fresh insights, a renewed view on networking, and even some new friends. Looking forward to next year’s conference in Austin and hope to see you there!


Vidhika Bansal

Vidhika Bansal is a UX strategist with a background in behavioral science, brand marketing, and human-centered design. She’s passionate about using the power of words and people’s stories to make product and service experiences the best that they can be. You can connect with her on LinkedIn or Twitter.

Tags:  QRCA  QRCA Annual Conference  QRCA Young Professionals Grant  Qualitative Research 

PermalinkComments (0)
 

Annual Conference Reporter on the Scene: Catch and Release

Posted By Melanie Brewer, Friday, February 22, 2019
Updated: Friday, February 15, 2019
Annual Conference Reporter on the Scene: Catch and Release

Recruit 2.0:  Online Marketplaces

Summary:
Do you want to save time and money on recruiting?  So do I.  That’s why I was really excited for the presentation “Catch & Release: Applying My Experience Learning to Fly Fish to Using New Recruiting Tools and Services” by Ted Kendall of TripleScoop Premium Market Research. New platforms for recruiting respondents are disrupting the marketplace, similar to the ways that Uber and Airbnb disrupted the car services and hotel marketplaces. These platforms put the power into our hands, but as Ted put it, how do you decide whether these new platforms fit your recruiting needs and if they do, how do you adapt all your recruiting skills to the new medium?

Key Takeaways:
While acknowledging that no system is perfect, Ted extolled some of the advantages (big) and challenges (modest) based on his several years of experience with Respondent.io and Userinterviews.com, two platforms that are making it possible to easily recruit for qual studies – sometimes filling a study within just a few short hours and at a significantly lower cost.  Benefits include the ability to authenticate users via LinkedIn or Facebook profiles, 80% or higher show rates, easy screening, and access to diverse groups, professions and geographic locations.  While there can be a learning curve, Ted argues it's well worth it for the benefits.  In addition, the platforms are rapidly evolving and are likely to just keep getting better.  Each offers unique features, so they're both worth trying.  One twist is the need to "market" or "pitch" your study to participants, so be prepared to make your project sound awesome and exciting to motivate them to respond – but ideally without totally giving away your screening criteria.

Putting it into practice:
I plan on exploring the tools Ted presented, along with the new features that are being rolled out on a regular basis, after the conference.

A-ha moment:
The observation that these platforms are disintermediating the marketplace similar to other software tools like Uber and Airbnb, and – just like those tools – are likely to become an increasingly important part of the landscape going forward – meaning we should all learn to use them so we don’t get left behind.

I will leave you with this final pro-tip courtesy of Ted: you can use the tipping feature in Respondent to pay for extra tasks you may wish the participants to complete, like homework or pre- or post-tasks!  

Melanie BrewerQRCA Reporter on the Scene:

Melanie Brewer
Santa Barbara Human Factors, Inc.
Twitter: @melanieinsb
LinkedIn: https://www.linkedin.com/in/melaniebennettbrewer/  

Tags:  Conference Recap  QRCA Annual Conference  QRCA Reporter on the Scene  qualitative research  Recruiting 

PermalinkComments (0)
 

My Experience at the QRCA Conference as a First Timer and Young Professionals Grant Winner

Posted By Sonya Shen, Thursday, February 21, 2019
Updated: Friday, February 15, 2019

Forsyth Park, Savannah, Georgia

Forsyth Park, Savannah, Georgia

Sonya Shen is a 2019 QRCA Young Professionals Grant recipient. First launched in 2014, the Young Professionals Grant helps advance promising young qualitative researchers’ careers by providing access to networking and educational sessions via a free pass to the QRCA’s Annual Conference plus a one-year QRCA membership. Visit qrca.org/YPG to learn more.

Conference Swag

Selected Conference Swag

I won a QRCA Young Professionals Grant to the 2019 QRCA Annual Conference, “Charting Your Best Course.” I just returned from spending three packed days in Savannah, Georgia learning from and connecting with other qualitative researchers.

Young Professionals Grant (YPG) Winners Received VIP Service
In October 2018, I learned that I had been awarded a YPG. I had been wanting to focus my career more on qualitative research, and winning the grant was the impetus that I needed to start making my ideas a reality. I immediately felt taken care of: YPG winners received communications leading up to the conference about events geared towards First Time Attendees and Young Professionals. I was also paired up with my own conference ambassador, Susan Sweet of Sweet Insight Group, who helped me prepare for and navigate the conference by sharing tips and introducing me to other attendees. I felt welcomed and prepared even before setting foot in Savannah.

The Conference Schedule Was Packed with Events and Sessions
I recommend planning out which sessions to attend before heading to the conference. The conference app was also helpful in the moment in figuring out where to go next (always a challenge at conferences!). A nice bonus I appreciated is that all sessions are available for viewing after the conference so attendees have less angst about missing a presentation. My FOMO turned to JOMO when I realized I could take a guilt-free break outside to recharge. I treated myself to a walk to Chippewa Square, made famous by the movie Forrest Gump (spoiler alert: there is no bench in the square, it was just there for the movie).

Qually Award Finalist Presentations
The three finalists for the Qually Award presented their proposals and took questions in front of a live and discerning audience. It was clear that a lot of preparation went into the proposals. I was impressed by the amount of camaraderie and openness to sharing that I saw.

Keynote
Dr. Carmen Simon of Memzy delivered a keynote presentation on “The Neuroscience of Memorable Messages”. We learned about memory and the fact that people only remember 90% of what was shared with them after two days. Dr. Simon discussed how to make messages more memorable and how to get people to act on a message (such as if you offer a slight twist, it will bring the brain back to the present).

Sessions
Laurie Tema-Lyn’s session on the topic of “Using Theater Games in Research” demonstrated how to use different techniques to meet a variety of research objectives. I learned how to set the stage so that researchers, respondents, and clients are all comfortable using more out-of-the-box methods such as World Salad, Improv/Role-play, and Theater of Exaggeration. The session allowed me to think creatively, practice my active listening skills, and give myself permission to try new things.

Lisa Lipkin presented on the topic of “Go from Facts to Truth with Neuroscience and Storytelling,” where she encouraged us to “make magic out of the mundane” when we are eliciting stories from respondents. Her tips included seeing the story in everything because what we store in our memories is most meaningful, and everything and everyone has a story. Lisa also encouraged us to dig deeper and be an “emotion detective,” as fact is not truth. Start with the emotion, then hang the facts on it.

Zebra Strategies’ Denene Rodney and Sharon Arthur’s session on “Ensuring Real Diversity in Qualitative Research” examined the role of the researcher as clients’ stewards to educate, guide, and safeguard them, and to better customize marketing messaging that consider cultural nuance. It shared actionable tips of how to ensure personal and collective accountability, accounting for bias, and ethical considerations. I walked away with strategies on how to exemplify this topic by being honest about what I do and don’t know, figuring out how to get answers if I don’t know something, expanding my network, developing empathy and curiosity, and to not run and to not hide.

“Opening Closed Doors with Role-Play” by Elizabeth George of Market Strategies was a deep dive into how to use role-play in research. While ethnography is the gold standard, barriers abound, such as in doctor/patient interactions. Liz walked us through the logistics of a particular type of role-play in which doctors are the respondents, actors are hired to play the patients who interact with the doctors, and the researchers are the facilitators. There was a great deal of information, and I felt like I was equipped to implement this strategy if I wanted to.

Networking Was Plentiful
I highly recommend attending a conference where most attendees are great at asking questions and where organizers are skilled at facilitating experiences. This conference checked both boxes. There were plenty of opportunities to meet other attendees and connect over shared interests. Highlights Include:

  • The First Timers Event: This was set up like a speed dating event where First Timers meet non-First Timer attendees. All the fun with none of the awkward rejection!
  • The Young Professionals Dine-Around Dinner: I connected with other Young Professionals at a restaurant in downtown Savannah. Topics of discussion were varied – from career to food, to kangaroos (friend or foe?).
  • Thursday Night Event at Kevin Barry’s Irish Pub: A giant get-together for everyone at the conference which included First Timers Bingo (Tip: maximize your time in the food line by asking passers-by if they can help you cross off a bingo square).
  • The Young Professional Exchange: Career and Life Hacks to Supercharge Your Growth (Roundtable): Young Professionals convened to discuss solutions to problems they commonly face. One of the many takeaways I left with was to lean into what sets me apart as a researcher.
  • Optional Chapter Meetings: I got the opportunity to meet other qualitative researchers in my area over breakfast.

As a First Timer, I felt completely at ease while networking. The conference size was manageable, and it felt heartening to see that so many other attendees knew each other and were catching up.

There are Many Opportunities to Stay Involved After the Conference
As a winner of the YPG, I was also awarded a one-year QRCA membership. I am already signed up to attend the next SF QRCA Chapter Meeting and plan on volunteering in some capacity. There are many opportunities to stay plugged in through the QRCA forum, through a SIG (Special Interest Group), or with a committee.

Bonus “Wow” Moment: Doing chair yoga with a view overlooking the Savannah River.

The 2019 QRCA Conference was a wonderful learning and networking experience. Thank You to the QRCA and Young Professionals organization for organizing the conference and awarding me a YPG. Hope to see you next year in Austin!

Sonya ShenSonya Shen, Independent Research Consultant

Sonya is a Researcher, Storyteller, and Yoga Teacher located in the San Francisco Bay Area.
Linked In

Tags:  QRCA  QRCA Annual Conference  QRCA Young Professionals Grant  Qualitative Research 

PermalinkComments (0)
 

Two Ways to Quantify User Experience

Posted By Lauren Isaacson, Tuesday, February 19, 2019
Updated: Friday, February 15, 2019

Quantify User Experience

A friend of mine is a designer who has worked with various divisions of the government of Canada. She told me about working with one particular department. She would show them potential design improvements to existing websites based on qualitative usability tests and they would invariably come back with the question, "How do you know it's better?"

Indeed, how does one know for sure a new website is better than the existing version? As researchers, we know the answer — benchmarking data. However, what's the best way to benchmark the usability of a system? Two methods are commonly used by UX researchers:

  • System Usability Scale (SUS)
  • Single Ease Question (SEQ)

System Usability Scale (SUS)

SUS is the most widely used and documented of the two options, with references in over 1,300 articles and publications. It's also free and applicable to pretty much any piece of technology. SUS consists of 10 questions, all using the same 5-point scale.

1 Strongly Agree/2 Agree/3 Neutral/4 Disagree/5 Strongly Disagree

  1. I think that I would use this system frequently.
  2. I found the system unnecessarily complex.
  3. I thought the system was easy to use.
  4. I think that I would need the support of a technical person to be able to use this system.
  5. I found the various functions in this systemwide well integrated.
  6. I thought there was too much inconsistency in this system.
  7. I would imagine that most people would learn to use this system very quickly.
  8. I found the system very cumbersome to use.
  9. I felt very confident using the system.
  10. I needed to learn a lot of things before I could get going with this system.

The numbering of the questions is essential for calculating the overall score. For odd-numbered questions, subtract 1 from each response and subtract the responses from each even-numbered question from 5. This should leave you with a final score between 0 and 40. This score is then multiplied by 2.5 to increase the range of the score to 0 to 100. This final number is a score and should not be confused with a percentage.

Lucky for us, the good folks at Measuring U have analyzed the responses from 5,000 users evaluating 500 websites and have come up with a grading system to help interpret the scores:

  • ~85+ = A
  • ~75 - 84 = B
  • ~65 - 74 = C, 68 is the average score
  • ~55 - 67 = D
  • ~45 or under = F

If you would like a more official and accurate grading system, you can buy Measuring U's guide and calculator package.

Single Ease Question (SEQ)

The other method is SEQ. Single Ease Question is less commonly utilized and has no documented standard wording, but it has the advantage of being much shorter than SUS. I am always in favor of making surveys shorter. SEQ consists of one question rated on a 7-point scale covering ease of completing a technology-enabled task. Like SUS, it is also free and applicable to almost any piece of technology.

  • Overall, how difficult or easy did you find this task?
    • Very easy
    • Easy
    • Somewhat easy
    • Neutral
    • Somewhat difficult
    • Difficult
    • Very difficult

Because there is no documented standard wording of the SEQ, you can tailor the question to cover the metric your stakeholders are most concerned about — confidence, speed, usefulness, etc. The SEQ also pairs very well with unmoderated usability tests often used by researchers who need quick feedback on interfaces.

Measuring U found the average scores across multiple websites to be about 5 (Somewhat easy), but this system is less documented than SUS. Therefore, use it to compare the before and after of a redesign, but not against other sites as you can do with SUS. If you're looking for more than just benchmarking data, you can also add two open-ended questions to the SEQ without risking excessive length.

  • What would make this website/form/app/system better?

Alternatively,

  • What is something you would fix on this website/form/app/system?

These voluntary open-ends give respondents the opportunity to offer their suggestions about what is wrong with the system and how they might make it better. It provides the potential to understand the “why” behind the data.

In the end, by using either of these UX survey question sets before a system redesign is launched and after, you will be able to tell your stakeholders if a redesign is indeed an improvement over the old, and how much better it is.

Sources:

Lauren Isaccson

Lauren Isaacson is a UX and market research consultant living in Vancouver, British Columbia. Over her career she has consulted for various agencies and companies, such as Nissan/Infiniti, Microsoft, Blink UX, TELUS Digital, Applause, Mozilla, and more. You can reach her through her website, LinkedIn, and Twitter.

Tags:  data  QRCA Digest  qualitative research  user experience 

PermalinkComments (0)
 

Annual Conference Reporter on the Scene: The Hidden Forces that Shape our Decisions

Posted By Heather Coda, Thursday, February 14, 2019
Updated: Wednesday, February 13, 2019
Annual Conference Reporter on the Scene: The Hidden Forces that Shape our Decisions

QualPower Blog

Summary:
At the 2019 QRCA Annual Conference, Colleen Welsh-Allen of Kantar Health provided a practical guide to behavioral science, the heuristics that most affect market research, and some clear cut ways to conduct better research with an understanding of these concepts. Behavioral science teaches us that humans are non-rational decision makers who make nearly all their decisions by using mental shortcuts (or "rules of thumb") called heuristics. As researchers we need to take these heuristics into account with our guide writing, moderating, analysis and reporting to uncover real motivations, feelings, and perceptions, and help our clients grasp them. Ultimately, to counsel our clients on how to change behavior, we need to understand behavior better.

Key Takeaways:
Heuristics drive "System 1" thinking which is automatic, effortless, and top of mind. To survive, humans rely on System 1 thinking the majority of the time.  "System 2" thinking is slow, deliberate, logical and calculating, and is used when we are learning something new. Since we as humans use both types of thinking in our lives, our research should incorporate techniques that use both systems of thinking, such as mind maps, blob tree, photo sorts, rapid fire questioning, and narrative and cognitive interviewing.

Putting it into practice:
Colleen shared practical implications of some of the many heuristics people use. Some of the best examples are as follows:

  1. LOSS AVERSION: People are more focused on avoiding loss than gaining, so consider both what respondents, as well as your clients, are concerned about losing
  2. PEAK END RULE: People assess experiences based on how they were at their peak (whether pleasant or unpleasant) and how they ended so be sure to capture their sentiments at these junctures
  3. EGO: Maintaining "face" is a predominant human need which leads people to misstate actual behavior. Thus if capturing behavior is important to study objectives, find methodologies that allow you to see behavior rather than hear about reported behavior.

A-ha moment:
Some of the heuristics provide the scientific explanation to confirm what we already know to be good research practices such as the following:

  1. Word questions as neutrally as possible to avoid bias (FRAMING heuristic);
  2. Ask those questions first that require respondents not be primed. Also, be aware of anything in your appearance or demeanor, or facility surroundings that may bias the respondent (PRIMING heuristic);
  3. Capture top of mind, "gut" reactions to concepts and ads before delving deeper, and take note of body language (AFFECT heuristic). 

Colleen's presentation not only satisfies intellectual curiosity about behavioral science but also provides the rationale behind some important research practices. It introduces new tools and techniques that many researchers may not be aware of to improve the value of research, in terms of both how defend the reasons for techniques to clients, and through the results themselves.

Heather CodaQRCA Reporter on the Scene:

Heather Coda
HMC Marketing Research
LinkedIn: https://www.linkedin.com/in/heather-coda-b054088/

Tags:  Conference Recap  QRCA Annual Conference  QRCA Reporter on the Scene 

PermalinkComments (0)
 

Annual Conference Reporter on the Scene: Using the Power of Podcasts

Posted By Karen Lynch, Thursday, February 7, 2019

Casey Bernard

Casey Bernard of Nimble MR, kicked off her presentation “Using the Power of Podcasts to Explore, Collect, and Deliver Insights” with a stunning fact: “50% of all US homes are "podcast fans", even more shocking is that podcasts are more popular than blogs right now!” From there, she took us on an audio adventure by sharing clips of some of her favorite podcasts and explaining to us all she gets out of the ones she listens to.

Key Takeaways:
As researchers, we can listen to Podcasts to (1) grow our knowledge of ANYTHING if we just look for topics we are researching and (2) glean tips for telling stories by listening to storytelling podcasts and (3) learn from expert interviewers how to hone our own craft and how we question others. There's also an opportunity for all of us to deliver findings via podcast, ensuring a different way for clients to digest information (audibly) by delivering executive summaries or full reports in this format.

Putting it into practice:
I've already subscribed to at least half a dozen of the podcasts Casey referenced in her presentation, including: This American Life, Radio Diaries, Story Corps, Beautiful/Anonymous, Take It From Me, and Everything is Alive and I recommend you do too!

A-ha moment:
How raw emotion can be heard in people's voices, delivering empathy without showcasing "the ugly cry" :-)

I loved Casey’s presentation and honestly, I can't wait to continue my learning and "charting my best course" after the conference by listening to a few episodes on the airplane, notebook in hand to capture insights.

Karen Lynch

QRCA Reporter on the Scene:

Karen Lynch
Insights Now, Inc.
Twitter: @KarenMLynch
LinkedIn: https://www.linkedin.com/in/karenmlynch/

Tags:  Podcast  QRCA Annual Conference  QRCA Reporter on the Scene  Qualitative research  Storytelling 

PermalinkComments (0)
 

Be a Consultant, Not an Order-Taker

Posted By Jay Zaltzman, Tuesday, February 5, 2019
Updated: Monday, February 4, 2019

Blog QualPowerI know it’s tempting, when a client — whether it be a company or an internal client — says they want four focus groups in Chicago, to answer “coming right up!” But it’s important to remember that, as qualitative researchers, our job isn’t only to conduct discussions or interviews, but rather to design research that will be most effective in answering our clients’ research questions.

We need to remind those clients about the value we can bring to the table. Remember, they may be considering “John in Marketing — he’s good with people, let’s have him ask the questions in the focus group.” But “John in Marketing” doesn’t necessarily know about designing research methodology. And he doesn’t realize that there’s more to a discussion guide than just “asking the questions.”

So, when clients ask if I can do four focus groups in Chicago, I say I can; but then I ask them to give me the background to the project. What are their objectives? How will the results be used? Do they have a budget? Why were they thinking of four focus groups in Chicago, specifically?

In my proposal, I’ll provide a cost for the four focus groups they requested, but based on what I learned, I might also suggest some alternatives. Let’s say it turns out they wanted the four groups in Chicago because that’s local, and they don’t have the budget for executives to travel to view groups. I might suggest two mini-groups in Chicago and four online mini-groups via webcam. Or depending on the topic, perhaps to two groups in Chicago and some online journaling nationwide. And of course, I’ll explain the reasoning behind those suggestions. Even if the clients say “thanks, but we’ll stick with the four groups in Chicago,” they will be impressed by the thinking... and you’ll be more likely to be hired than the competitor who had not included those kinds of options!

And don’t forget to offer to help the clients digest the research results. I try to always include the option of running a workshop with the stakeholders after the research is completed, to discuss the findings and how they might be utilized. It’s fulfilling to see the impact of the research, and it provides more value to your clients... and that’s the name of the game!

Jay zaltzman

By: Jay Zaltzman

Jay Zaltzman believes that qualitative researchers can offer true value to clients by combining empathy with creative methodology and analytical rigor.  Jay has been president of Bureau West Market Research/Voice of the Customer for the past twenty years.  He is an active member and past president of the QRCA. 

Website: http://bureauwest.com/
LinkedIn: https://www.linkedin.com/in/jayzaltzman/
Twitter: @zaltzman

Tags:  Focus Groups  QRCA Digest  Qualitative Research  Research Methodology 

PermalinkComments (0)
 

Minimize the Unpredictable: 3 Tips for Great Ethnos

Posted By Rob Volpe, Ignite 360, Tuesday, January 22, 2019
Updated: Friday, January 18, 2019
QRCA 2018 Conference Attendees

“Expect the unexpected” is what I recently said to a client who was about to embark on her first in-home ethnography visit. Out in the real world, away from controlled environs like a facility or online platform, almost anything can happen. That’s the beauty of ethnography. You get to see life as it’s really lived instead of having it explained to you. It’s also the challenge of ethnographies. Like life, an ethnographic project can be unpredictable. While that appeals to some personality types, it doesn’t sit well with everyone, especially clients who don’t do ethnos very often.

Here are 3 ethnographic tips to transform the unpredictable into a certainty:

  1. Pre Field Work Final Prep- QRCA Get to Know Your Participants Ahead of Time – If you think it’s daunting walking into a stranger’s home, try having a group of 4-5 strangers over to your house to “put you under the microscope.” To help respondents feel more at ease, make sure they are a great fit with your recruiting criteria. To help advance the conversation upon arrival, get to know the participants before you visit them.

    This orientation can be completed through “screendowns”—phone or video calls with potential respondents recruited by the field house but not yet booked.  That conversation allows you to verify and validate what was said in the recruit as well as their comfort engaging in conversation. Or you can engage participants in an online or video activity prior to fielding and use that to help select your final participants. Both approaches enable you to get to know the respondent and, just as importantly, they get to know you. When I walk into a respondent’s home and I’m able to mention the names of my colleagues who have talked to them, I always see a glimmer of recognition and the respondent starts to relax as they’ve already made a connection with us through these earlier interactions.

    While these steps add time and dollars to the budget, they help to lower the risk that a session will be a dud. In a focus group or online community with numerous respondents, you can get beyond a quiet respondent or one or two recruits that aren’t quite the right fit. In an ethno, each respondent is the “star” of their own show. If they aren’t spot on and comfortable, it will be a loooooong session that your clients have paid a lot of money to sit through. It’s time you won’t get back, but your clients might ask for their money back. 

  2. QRCA Clients in the Field Prep Your Clients on What to Expect – If clients are joining you in the field (and hopefully they are), help them understand what it’s going to be like. Remember, your clients don’t do ethnos as often as you do. It’s even more important when you have an extended client team joining you in the field.

    We put together pre-field briefing calls and documents explaining what to expect. It aligns everyone and answers the questions they have, big and small. Can they ask questions? What should they do during the session (see tip #3 below)? Can they use the bathroom in a respondent’s house? What should they wear? When will they eat? Can they use their phone?

    The briefing is also the best time to make sure everyone is aligned on the key questions, flow of the conversation, and other points you want to make. At our company we coach clients on the 5 Steps to Building and Applying Empathy. That little bit of coaching can make a big difference in how they engage and ultimately absorb what they experience.

    The risk of not doing this? A big, disorganized mess when you get into the session. Uncomfortable clients will make the respondent uncomfortable and will lead to an unproductive session.

  3. Put Your Clients to Work for You– Ethnographies are a juggling act. Yes, you are moderating, but you are also doing things like taking notes and pictures. If clients are with you, have them help you out. Give them notebooks and ask them to take notes on their observations and what they hear. Those come in handy during debriefs in the car right after the session. You can even incorporate them into your analysis.

    Need pictures from the session? Designate one of your client attendees as the official photographer. Give them direction on what pictures you need (a nice face pic of the respondent for sure). Think ahead about what other images you might need for your report. How might images from the in-home visit help advance the story you will tell? When we have clients take pictures, we try to set a minimum — maybe 30 — so they realize they should take a lot of pictures, not just one or two. You may end up with 18… but it’s a lot better than none.

    Engaging the clients empowers them; they’re immediately more invested and at ease, which helps them get more out of the session. And it reduces your own cognitive load so you can focus on what you are really there to do – moderate the best conversation possible!

It’s unrealistic to try to solve for every variable that could possibly come up on an in-home.  I was in the middle of an in-home during the East Coast earthquake in 2011. You can’t plan for that, but you can give your clients tips on what to do to keep themselves safe. The more you make an investment upfront, the better prepared you’ll be to fully engage and get the most out of each session as the moderator.

What tips do you have for a better ethno? What challenges do you have with ethnos that you’d like to resolve? Ask away!

Rob Volpe By: Rob Volpe

Rob Volpe is CEO and Chief Catalyst of Ignite 360, an insights and strategy firm. When he’s not traveling the globe in search of the answer to the question “why,” he’s at work on his first book, Everyday Americans, his journey to understanding empathy told through his adventures in ethnography.


Sign up today for the 2019 QRCA conference.

Tags:  ethnography  QRCA Digest  qualitative research 

PermalinkComments (1)
 
Page 4 of 8
1  |  2  |  3  |  4  |  5  |  6  |  7  |  8
Contact Us

QRCA
1000 Westgate Drive, Suite 252
St. Paul, MN 55114

phone:  651. 290. 7491
fax:  651. 290. 2266
info@qrca.org

Privacy Policy | Site Map | Sign Out
© 2019 Qualitative Research Consultants Association

This website is optimized for Firefox and Chrome. If you have difficulties using this site, see complete browser details.