Logo image
Using the Cognitive Pretesting Method to Gain Insight Into Participants' Experiences: An Illustration and Methodological Reflection
Journal article   Open access   Peer reviewed

Using the Cognitive Pretesting Method to Gain Insight Into Participants' Experiences: An Illustration and Methodological Reflection

Kristin L. K. Koskey
International journal of qualitative methods, v 15(1)
01 Jan 2016
url
https://journals.sagepub.com/doi/pdf/10.1177/1609406915624577View
Published, Version of Record (VoR) Open
url
https://doi.org/10.1177/1609406915624577View
Published, Version of Record (VoR) Open

Abstract

Social Sciences - Other Topics Social Sciences, Interdisciplinary Social Sciences
Quantitative researchers traditionally use cognitive pretesting methods such as think-alouds to determine whether participants are interpreting close-ended survey items as intended. I applied this method to evaluate the score validity of quantitative survey instruments with a middle school and high school sample of students. Through these applications, the cognitive pretesting method also revealed to be a useful tool for cueing participants' reflection on their experiences related to the phenomenon of interest. Qualitative researchers traditionally use more open-ended interviews guided by general "how" and "why" questions, which might not serve as sufficient prompts to elicit participants' reflection on their experiences, especially younger participants. To date, there are no illustrative examples focused on how having participants think-aloud as they complete a quantitative survey can inform qualitative-focused or mixed research questions. Therefore, the purpose of this article was to illustrate how the cognitive pretesting method, where participants think-aloud as they complete a survey, can be used as an additional technique to gain insight into their experiences of a phenomenon. The phenomenon in this illustration was defined as the participants' experiences with the science content that they were learning in school. Limitations and methodological challenges and recommendations for overcoming these barriers are also discussed.

Metrics

7 Record Views
4 citations in Scopus

Details

UN Sustainable Development Goals (SDGs)

This publication has contributed to the advancement of the following goals:

#4 Quality Education

InCites Highlights

Data related to this publication, from InCites Benchmarking & Analytics tool:

Web of Science research areas
Social Sciences, Interdisciplinary
Logo image