How Insights Leaders are Improving Consumer Research Quality
Better Survey Design – Writing Effective Questions
JT reveals, “Most consumer research quality issues arise from the design and experience of a survey. Interactive survey methods, such as gamification, ensure relevance to your ideal type of respondent, and create more realistic conversational experiences. An interesting and enjoyable survey experience delivers more in-depth, relevant survey data that can power consumer-centric innovation.”
Sustaining Engagement – Communicating with Research Participants
Wilson advises: “When first speaking with potential participants, communicate your needs up front, including the estimated completion time so your participants know what they’re committing to. Assign turning points early in the study to avoid wasting participant time.”
Insights leaders are communicating effectively with research participants, and encouraging more detailed complete responses, through:
- Building Trust – Specifying how respondents’ data will be used and protected at the very beginning of the survey assuages any privacy fears. Introducing your organization and transparently outlining the purpose of the survey further establishes the study’s credibility and reinforces the value of the research.
- Valuing Respondents – Pruning questions to avoid repetition both increases the quality of unique, detailed answers and demonstrates that researchers respect the time and effort of respondents. Clear instructions help participants complete the survey without getting frustrated, reducing probability of disengagement and abandonment. Including a progress bar keeps respondents engaged, provided that questions are of similar length and complexity, to avoid misleading audiences of the time and effort involved.
- Consumer Focus – Wilson continues, “Try to think about all users when designing your study. Doing so will not just improve the respondent experience, but also help your performance metrics for the respective study.”
Combining Human & AI Expertise – Harnessing Synthetic Data
Synthetic data and audience data have a 90–95% correlation rate. Whereas proxy audiences don’t get bored with surveys, errors and inconsistencies from human respondents are commonplace thanks to distraction, disengagement and signaling bias. Synthetic data allows researchers to test endless combinations of questions with proxy audiences automatically, at far lower cost and at much greater scalability than real live human studies.
JT explores how businesses are incorporating synthetic data to scale their existing research methodologies: “We’re quickly moving from traditional research processes to always-on data to synthetic predictive models built on survey data. The future of innovative research involves an experimental approach that fuses natural and synthetic. OpenAI and more publicly or easily accessible models are providing capabilities off the shelf. Businesses are incorporating synthetic data at a macro level and layering it on top of their focus group methodologies, in-depth interviews and quantitative research surveys. Insights leaders are augmenting their existing data sets with AI, refining their knowledge lakes for a broader consumer understanding.”
Gartner estimated that by the end of 2024, 60% of all data used to train AI would be synthetic, rising from just 1% in 2021. JT continues, “The quarterly wave of brand tracking and the pre- and post-campaign testing aren’t going to cut it in a world that needs a continuous and consistent training feed. Businesses are evolving from purely their own self-delivery, bringing tracking studies and other continuous data sets together to train AI models to generate the insights they’ve always wanted.
“Natural data from real people provides the quality training data for synthetic models, although training data from a research pool can become out of date very quickly. We deliver daily tracking feeds continuously, with up-to-date data to guarantee recency. I see the fusion of AI and traditional research models as an accelerant to solving many of our industry’s persistent problems. AI isn’t a replacement for quality surveys; consumer-centric innovation will come from the union of CMI teams and artificial intelligence enhancing the quality and accuracy of research.”