The procedure of standardized repeated measurement, as used in panel studies, may hamper the quality of the data, due to the potential “reactivity” of survey interviewing on respondents' attitudes and behavior. In case respondents are interviewed in subsequent waves by different interviewers, differential interviewer effects may occur. These threats to data quality are illustrated with data from a longitudinal study among 2,819 older adults, conducted in the Netherlands. From an analysis of 100 interview protocols, it appears that the behavior of the interviewers has a significant impact on the data obtained. On one hand, interviewers seem to adjust their interviewing strategy to a norm regarding a “normal” personal network and, on the other hand, to a norm about the appropriate interviewing time. Suggestions are formulated to prevent misestimating actual change within respondents over time, leading to incorrect conclusions about causal relationships.
Get full access to this article
View all access options for this article.
References
1.
Bailar, Barbara A.1975. “The Effects of Rotation Group Bias in Estimates From Panel Surveys.”Journal of the American Statistical Association70:23-30.
2.
Bailar, Barbara A.
1989. “Information Needs, Surveys and Measurement Errors.” Pp. 1-24 in Panel Surveys, edited by D. Kasprzyk, G. Duncan, G. Kalton, and M.P. Singh. New York: John Wiley.
3.
Brannen, Julia
. 1993. “The Effects of Research on Participants: Findings From a Study of Mothers and Employment.”The Sociological Review41:328-346.
4.
Bridge, R. Gary
, Leo G. Reeder, David Kanouse, Donald R. Kinder, Vivian Tong Nagy, and Charles M. Judd. 1977. “Interviewing Changes Attitudes—Sometimes.”Public Opinion Quarterly41:56-64.
5.
Cantor, David
. 1989. “Substantive Implications of Longitudinal Design Features: The National Crime Survey as a Case Study.” Pp. 25-51 in Panel Surveys, edited by D. Kasprzyk, G. Duncan, G. Kalton, and M. P. Singh. New York: John Wiley.
Corder, Larry S.
and Daniel G. Horvitz. 1989. “Panel Effects in the National Medical Care Utilization and Expenditure Survey.” Pp. 304-318 in Panel Surveys, edited by D. Kasprzyk, G. Duncan, G. Kalton, and M. P. Singh. New York: John Wiley.
8.
Deeg, Dorly J. H.
and Mariëtte Westendorp-de Serière, eds. 1994. Autonomy and Well-Being in the Aging Population: Report From the Longitudinal Aging Study Amsterdam 1992-1993. Amsterdam: VU University Press.
9.
Feldman, Jack M.
and John G. Lynch. 1988. “Self-Generated Validity and Other Effects of Measurement on Belief, Attitude, Intention, and Behavior.”Journal of Applied Psychology73:421-435.
10.
Glock, C. 1952. “Participation Bias and Reinterview Effects in Panel Studies.” Ph.D. dissertation, Columbia University, New York.
11.
Holt, D.
1989. “Panel Conditioning: Discussion.” Pp. 340-347 in Panel Surveys, edited by D. Kasprzyk, G. Duncan, G. Kalton, and M. P. Singh. New York: John Wiley.
12.
Jagodzinski, Wolfgang
, Stephen M. Kühnel, and Peter Schmidt. 1987. “Is There a `Socratic Effect' in Nonexperimental Panel Studies? Consistency of an Attitude Toward Guestworkers.”Sociological Methods and Research15:259-302.
13.
Klein, Daniel N.
and David R. Rubovits. 1987. “The Reliability of Subjects' Reports on Stressful Life Events Inventories: A Longitudinal Study.”Journal of Behavioral Medicine10:501-512.
14.
Knipscheer, Kees C.P.M.
, Jenny de Jong Gierveld, Theo van Tilburg, and Pearl A. Dykstra, eds. 1995. Living Arrangements and Social Networks of Older Adults. Amsterdam: VU University Press.
15.
O'Muircheartaigh, Colm
. 1989. “Sources of Nonsampling Error: Discussion.” Pp. 271-288 in Panel Surveys, edited by D. Kasprzyk, G. Duncan, G. Kalton, and M. P. Singh. New York: John Wiley.
16.
Porst, Rolf
and Klaus Zeifang. 1987. “A Description of the German General Social Survey Test-Retest Study and a Report on the Stabilities of the Sociodemographic Variables.”Sociological Methods and Research15:177-218.
17.
Presser, Stanley
and Michael Traugott. 1992. “Little White Lies and Social Science Models: Correlated Response Errors in a Panel Study of Voting.”Public Opinion Quarterly56:77-86.
18.
Schaeffer, Nora Cate
and Douglas W. Maynard. 1996. “From Paradigm to Prototype and Back Again: Interactive Aspects of Cognitive Processing in Standardized Survey Interviews.” Pp. 65-88 in Answering Questions: Methodology for Determining Cognitive and Communicative Processes in Survey Research, edited by N. Schwarz and S. Sudman. San Francisco: Jossey-Bass.
19.
Scherpenzeel, Annette 1995. “A Question of Quality: Evaluating Survey Questions by Multitrait-Multimethod Studies.” Ph.D. dissertation, University of Amsterdam.
20.
Silberstein, Adriana R.
and Curtis A. Jacobs. 1989. “Symptoms of Repeated Interview Effects in the Consumer Expenditure Interview Survey.” Pp. 289-303 in Panel Surveys, edited by D. Kasprzyk, G. Duncan, G. Kalton, and M. P. Singh. New York: John Wiley.
21.
Sobol, M. G.1959. “Panel Mortality and Panel Bias.”Journal of the American Statistical Association54:52-68.
22.
Sudman, Seymour
and Norman M. Bradburn. 1974. Response Effects in Surveys: A Review and Synthesis. Chicago: Aldine.
23.
Traugott, Michael W.
and John P. Katosh. 1979. “Response Validity in Surveys of Voting Behavior.”Public Opinion Quarterly43:359-377.
24.
van der Zouwen, Johannes
and Wil Dijkstra. 1988. “Types of Inadequate Interviewer Behavior in Survey Interviews: Their Causes and Effects.”Bulletin de Méthodologie Sociologique18:5-20.
25.
van der Zouwen, Johannes
and Wil Dijkstra. 1996. “Testing (CATI-)Questionnaires Using Computer Assisted Interaction Coding.” Presented at the International Conference on Computer-Assisted Survey Information Collection, December 11-14, San Antonio, TX.
26.
van Tilburg, Theo
. 1998a. “Interviewer Effects in the Measurement of Personal Network Size: A Nonexperimental Study.”Sociological Methods and Research26:300-328.
27.
van Tilburg, Theo
. 1998b. “Losing and Gaining in Old Age: Changes in Personal Network Size and Social Support in a Four-Year Longitudinal Study.”Journal of Gerontology53B:S313-S323.
28.
Veroff, Joseph
, Shirley Hatchett, and Elizabeth Douvan. 1992. “Consequences of Participating in a Longitudinal Study of Marriage.”Public Opinion Quarterly56:315-327.
29.
Waterton, Jennifer
and Denise Lievesley. 1989. “Evidence of Conditioning Effects in the British Social Attitudes Panel.” Pp. 319-339 in Panel Surveys, edited by D. Kasprzyk, G. Duncan, G. Kalton, and M. P. Singh. New York: John Wiley.
30.
Yalch, Richard F.1976. “Pre-Election Interview Effects on Voter Turnout.”Public Opinion Quarterly40:331-336.
