Survey Administration Effects?

Abstract

The module “environmental attitudes and values” of the International Social Survey Programme (ISSP) was administered both as a paper-and-pencil questionnaire to a representative sample of the German population and as a web-based survey to an online access panel representative for German Internet users. The two samples differ significantly with regard to sociodemographic and substantive variables. An attempt to weight the data of the web-based sample on the basis of distribution characteristics of several sociodemographic variables resulted in rather inconsistent findings for the comparison of substantive items. However, if only respondents with similar education levels are compared, neither relevant differences in item means nor differences in selected interitem correlations are observable. This means that for high coverage groups (e.g., participants with a high education level), the data gathered via the web are basically identical to those obtained in a traditional self-administered mode.

Get full access to this article

View all access options for this article.

References

Bandilla, W. (2002). Web surveys: An appropriate mode of data collection for the social sciences? In B. Batinic, U.-D. Reips, & M. Bosnjak (Eds.), Online social sciences (pp. 1-7). Seattle, WA: Hogrefe & Huber.

Bandilla, W., & Bosnjak, M. (2000). Online surveys als Herausforderung für die Umfrageforschung: Chancen und Probleme [Online surveys as a challenge for survey research: Chances and limitations]. In P. Ph. Mohler & P. Lüttinger (Eds.), Querschnitt: Festschrift für Max Kaase (pp. 9-28). Mannheim, Germany: ZUMA.

Batinic, B., & Bosnjak, M. (2000). Fragebogenuntersuchungen im Internet [Questionnaire studies on the Internet]. In B. Batinic (Ed.), Internet für Psychologen (2nd ed., pp. 287-318). Göttingen, Germany: Hogrefe.

Batinic, B., Reips, U.-D., & Bosnjak, M. (Eds.). (2002). Online social sciences. Seattle, WA: Hogrefe & Huber.

Birnbaum, M. H. (2001). Introduction to behavioral research on the Internet. Upper Saddle River, NJ: Prentice Hall.

Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum.

Cohen, J. (1992). A power primer. Psychological Bulletin, 112, 155-159.

Couper, M. P. (2001). Web surveys: A review of issues and approaches. Public Opinion Quarterly, 64(4), 464-494.

Dillman, D. A. (2000). Mail and Internet surveys: The tailored design method. New York: John Wiley.

10.

Gabler, S. (1994). ALLBUS-Baseline-Studie 1991 und ALLBUS 1992: Ost-West-Gewichtung der Daten [ALLBUS: East-West Data Weighting]. ZUMA Nachrichten, 35, 77-81.

11.

Häder, S., & Gabler, S. (1997). Deviations from the population and optimal weights. In W. Saris & M. Kaase, Eurobarometer: Measurement instruments for opinions in Europe (pp. 37-51). Mannheim, Germany: ZUMA-Nachrichten Spezial No. 2.

12.

Koch, A., Wasmer, M., Harkness, J., & Scholz, E. (2001). Konzeption und Durchführung der “Allgemeinen Bevölkerungsumfrage der Sozialwissenschaften” (ALLBUS 2000) [ALLBUS method report]. ZUMA Methodenbericht 2001, 05. Retrieved from http://www.gesis.org/Dauerbeobachtung/Allbus/documents/pdfs/tb01_05.pdf

13.

Medienpädagogischer Forschungsverbund Südwest. (2000). JIM 99/2000: Jugend, Information, (Multi-)Media [JIM 99/2000: Youth, information, and multimedia]. Baden-Baden, Germany: SWR Medienforschung.

14.

Reips, U.-D., & Bosnjak, M. (Eds.). (2001). Dimensions of Internet science. Lengerich, Germany: Papst.

15.

Witherspoon, S., Mohler, P., & Harkness, J. (1995). Report on research into environmental attitudes and perceptions. Brussels, Belgium: European Consortium for Comparative Social Surveys. Retrieved from http://www.gesis.org/en/cooperation/research/compass/reap.pdf