|
|
What They See Is What We Get
Response Options for Web Surveys
Mick P. Couper
Roger Tourangeau
Frederick G. Conrad
Survey Research Center, University of Michigan and Joint Program in Survey Methodology, University of Maryland
Scott D. Crawford
MSIResearch
Several alternative response formats are available to the web survey designer, but the choice of format is often made with little consideration of measurement error. The authors experimentally explore three common response formats used in web surveys: a series of radio buttons, a drop box with none of the options initially displayed until the respondent clicks on the box, and a scrollable drop box with some of the options initially visible, requiring the respondent to scroll to see the remainder of the options. The authors reversed the order of the response options for half the sample. The authors find evidence of response order effects but stronger evidence that visible response options are endorsed more frequently, suggesting that visibility may be a more powerful effect than primacy in web surveys. The results suggest that the response format used in web surveys does affect the choices made by respondents.
Key Words: web surveys • drop boxes • radio buttons • instrument design • response order effects
Social Science Computer Review, Vol. 22, No. 1,
111-127 (2004)
DOI: 10.1177/0894439303256555
 CiteULike  Connotea  Del.icio.us  Digg  Reddit  Technorati What's this?
This article has been cited by other articles:
|
|
|
|
 
L. M. Christian, N. L. Parsons, and D. A. Dillman
Designing Scalar Questions for Web Surveys
Sociological Methods Research,
February 1, 2009;
37(3):
393 - 425.
[Abstract]
[PDF]
|
|
|
|
|
|
|
N. Malhotra
Completion Time and Response Order Effects in Web Surveys
Public Opin Q,
December 23, 2008;
(2008)
nfn050v2.
[Abstract]
[Full Text]
[PDF]
|
|
|
|
|
|
|
C. A. Klofstad, S. Boulianne, and D. Basson
Matching the Message to the Medium: Results from an Experiment on Internet Survey Email Contacts
Social Science Computer Review,
November 1, 2008;
26(4):
498 - 509.
[Abstract]
[PDF]
|
|
|
|
|
|
|
M. J. Stern
The Use of Client-side Paradata in Analyzing the Effects of Visual Layout on Changing Responses in Web Surveys
Field Methods,
November 1, 2008;
20(4):
377 - 398.
[Abstract]
[PDF]
|
|
|
|
|
|
|
M. Denscombe
The Length of Responses to Open-Ended Questions: A Comparison of Online and Paper Questionnaires in Terms of a Mode Effect
Social Science Computer Review,
August 1, 2008;
26(3):
359 - 368.
[Abstract]
[PDF]
|
|
|
|
|
|
|
B. Healey
Drop Downs and Scroll Mice: The Effect of Response Option Format and Input Mechanism Employed on Data Quality in Web Surveys
Social Science Computer Review,
February 1, 2007;
25(1):
111 - 128.
[Abstract]
[PDF]
|
|
|
|
|
|
|
T. Rosen and J. Olsen
Invited Commentary: The Art of Making Questionnaires Better
Am. J. Epidemiol.,
December 15, 2006;
164(12):
1145 - 1149.
[Abstract]
[Full Text]
[PDF]
|
|
|
|
|
|
|
M. Denscombe
Web-Based Questionnaires and the Mode Effect: An Evaluation Based on Completion Rates and Data Contents of Near-Identical Questionnaires Delivered in Different Modes
Social Science Computer Review,
May 1, 2006;
24(2):
246 - 254.
[Abstract]
[PDF]
|
|
|
|
|
|
|
M. P. Couper
Technology Trends in Survey Data Collection
Social Science Computer Review,
November 1, 2005;
23(4):
486 - 501.
[Abstract]
[PDF]
|
|
|
|
|
|
|
N. E. Kiernan, M. Kiernan, M. A. Oyler, and C. Gilles
Is a Web Survey as Effective as a Mail Survey? A Field Experiment Among Computer Users
American Journal of Evaluation,
June 1, 2005;
26(2):
245 - 252.
[Abstract]
[PDF]
|
|
|
|
|
