Hostname: page-component-7b7567c8c-tnkh4 Total loading time: 0 Render date: 2026-11-16T16:04:57.321Z Has data issue: false hasContentIssue false

How Face-to-Face Interviews and Cognitive Skill Affect Item Non-Response: A Randomized Experiment Assigning Mode of Interview

Published online by Cambridge University Press:  13 June 2016

Rights & Permissions [Opens in a new window]

Abstract

Technology and the decreased cost of survey research have made it possible for researchers to collect data using new and varied modes of interview. These data are often analyzed as if they were generated using similar processes, but the modes of interview may produce differences in response simply due to the presence or absence of an interviewer. In this paper, we explore the differences in item non-response that result from different modes of interview and find that mode makes a difference. The data are from an experiment in which we randomly assigned an adult population to an in-person or self-completed survey after subjects agreed to participate in a short poll. For nearly every topic and format of question, we find less item non-response in the self-complete mode. Furthermore, we find the difference across modes in non-response is exacerbated for respondents with low levels of cognitive abilities. Moving from high to low levels of cognitive ability, an otherwise average respondent can be up to six times more likely to say “don’t know” in a face-to-face interview than in a self-completed survey, depending on the type of question.

Information

Type
Original Articles
Copyright
© The European Political Science Association 2016 
Figure 0

Table 1Classification of Survey Responses into “Don’t Know” or Non-Response Outcomes

Figure 1

Table 2Average Rates of Non-Response by Mode and Question Format

Figure 2

Fig. 1Differences in non-response between face-to-face and self-completed surveys on questions with listed “don’t know” options Note: Plotting symbols are the percentage-point difference in non-response (FTF-SC) for each question. The solid bars are 95 percent confidence intervals.

Figure 3

Fig. 2Differences in non-response between face-to-face and self-completed surveys on questions without listed “don’t know” options Note: Plotting symbols are the percentage-point difference in non-response (FTF-SC) for each question. The solid bars are 95 percent confidence intervals.

Figure 4

Table 3Percent of Questions with Significant Differences in Non-Response Due to Mode

Figure 5

Fig. 3Differences by Mode for Open-Ended Knowledge Questions Note: Plotting symbols reflect face-to-face values minus self-complete. Bars represent 95% confidence intervals.

Figure 6

Fig. 4Differences by Mode for Close-Ended Knowledge Questions Note: Plotting symbols reflect face-to-face values minus self-complete. Bars represent 95% confidence intervals. For the Moby Dick question, a DK option was not explicitly given in either mode.

Figure 7

Table 4Questions Included in Non-Response Index by Topic

Figure 8

Table 5Models of Non-Response by Question Topic

Supplementary material: File

Gooch and Vavreck supplementary material

Gooch and Vavreck supplementary material 1

Download Gooch and Vavreck supplementary material(File)
File 148 KB
Supplementary material: PDF

Gooch and Vavreck supplementary material

Gooch and Vavreck supplementary material 2

Download Gooch and Vavreck supplementary material(PDF)
PDF 32.7 KB
Supplementary material: PDF

Gooch and Vavreck supplementary material

Gooch and Vavreck supplementary material 3

Download Gooch and Vavreck supplementary material(PDF)
PDF 180.9 KB
Supplementary material: File

Gooch and Vavreck supplementary material

Gooch and Vavreck supplementary material 4

Download Gooch and Vavreck supplementary material(File)
File 87.1 KB