Examining final comment questions with requests for written and oral answers

authored by: Jan Karem Höhne, Joshua Claassen
Abstract: Self-administered web surveys provide respondents only limited opportunities for feedback. Therefore, many web surveys include so-called “final comment questions” (FCQs) that allow respondents to elaborate on the survey in general and the survey questions in particular. Typing in open answers in text boxes is burdensome – especially via smartphones with virtual on-screen keypads – so that respondents frequently provide short or no answers at all. In this study, we make use of new technological advancements in web survey methodology and investigate FCQs with requests for written and oral answers. For this purpose, we conducted an experiment in a smartphone survey (N = 1,001) in a German online panel. The results reveal that FCQs with a request for written and oral answers do not differ with respect to item-nonresponse. However, oral answers are substantially longer than written answers pointing to more in-depth information. The oral answer condition also results in more positive comments than the written answer condition. This study is a methodological showcase for innovative web survey design that contributes to the improvement of data quality.
Organisation(s): Sociology Department
External Organisation(s): German Centre for Higher Education Research and Science Studies (DZHW)
Type: Article
Journal: International Journal of Market Research
Volume: 66
Pages: 550-558
No. of pages: 9
ISSN: 1470-7853
Publication date: 09.2024
Publication status: Published
Peer reviewed: Yes
ASJC Scopus subject areas: Business and International Management, Economics and Econometrics, Marketing
Electronic version(s): https://doi.org/10.1177/14707853241229329 (Access: Open)

BibTeX

@article{19ca322ad7ce4e81b354209d14c686d6,
title = "Examining final comment questions with requests for written and oral answers",
abstract = "Self-administered web surveys provide respondents only limited opportunities for feedback. Therefore, many web surveys include so-called “final comment questions” (FCQs) that allow respondents to elaborate on the survey in general and the survey questions in particular. Typing in open answers in text boxes is burdensome – especially via smartphones with virtual on-screen keypads – so that respondents frequently provide short or no answers at all. In this study, we make use of new technological advancements in web survey methodology and investigate FCQs with requests for written and oral answers. For this purpose, we conducted an experiment in a smartphone survey (N = 1,001) in a German online panel. The results reveal that FCQs with a request for written and oral answers do not differ with respect to item-nonresponse. However, oral answers are substantially longer than written answers pointing to more in-depth information. The oral answer condition also results in more positive comments than the written answer condition. This study is a methodological showcase for innovative web survey design that contributes to the improvement of data quality.",
keywords = "answer behavior, built-in microphone, final comment question, open-ended answers, smartphone survey, survey evaluation",
author = "H{\"o}hne, {Jan Karem} and Joshua Claassen",
note = "Publisher Copyright: {\textcopyright} The Author(s) 2024.",
year = "2024",
month = sep,
doi = "10.1177/14707853241229329",
language = "English",
volume = "66",
pages = "550--558",
journal = "International Journal of Market Research",
issn = "1470-7853",
publisher = "Market Research Society",
number = "5",
}