Virtually all survey data are collected by “strangers,” that is, individuals with no prior social relationship with respondents. Although it has long been recognized that attitudes toward strangers vary cross-culturally, there has been no systematic discussion of how this variation might affect survey data. This article attempts such a discussion, using data from a longitudinal research study in rural Kenya. It reviews qualitative impressions of insider-and stranger-related issues within the specific Kenyan field setting, drawing primarily on field notes. Relevant areas of social theory and the data collection literature are reviewed briefly. Finally, using the project's longitudinal survey data, empirical tests are presented which allow for an evaluation of differential data quality across insider-and stranger-interviewers on three dimensions: differential response rates, differential reliability of responses, and differential response validity. The results suggest that insider-interviewers increase response rates and collect more consistent data across survey waves. They also suggest that data collected by female insiders in particular appear to be superior for most questions and of equal quality for others.
Get full access to this article
View all access options for this article.
References
1.
AgarMichael1980. The Professional Stranger: An Informal Introduction to EthnographyNew York: Academic Press.
2.
AndersonMyrdene1986. “Cultural Concatenation of Deceit and Secrecy.”
Pp. 323–8 in Deception: Perspectives on Human and Nonhuman Deceit, edited by MitchellRobert W.ThompsonNicholas S.. New York: State University of New York Press.
3.
AquilinoWilliam S.1994. “Interview Mode Effects in Surveys of Drug and Alcohol Use.”Public Opinion Quarterly58: 210–40.
4.
AxinnWilliam G.1991. “The Influence of Interviewer Sex on Responses to Sensitive Questions in Nepal.”Social Science Research20: 303–18.
5.
AxinnWilliam G.FrickeThomas E.ThorntonArland1991. “The Microdemographic Community-Study Approach: Improving Survey Data by Integrating the Ethnographic Method.”Sociological Methods and Research20: 187–217.
6.
BackKurt W.Mayone StycosJ..1959. The Survey Under Unusual Conditions: Methodological Facets of the Jamaica Human Fertility InvestigationIthaca, NY: Society for Applied Anthropology, Cornell University.
7.
BailarBarbara A.1976. “Some Sources of Error and Their Effect on Census Statistics.”Demography13 (2): 273–85.
8.
BarleyNigel1983. The Innocent Anthropologist: Notes From a Mud HutLondon, England: Penguin Books.
9.
BarnesJohn A.1994. A Pack of Lies: Towards a Sociology of LyingCambridge, England: Cambridge University Press.
10.
BeattyPaul1995. “Understanding the Standardized/Non-Standardized Interviewing Controversy.”Journal of Official Statistics11: 147–60.
11.
BeckerStanFeyistanKaleMakinwa-AdebusoyePaulina.1995. “The Effect of Sex of Interviewers on the Quality of Data in a Nigerian Family Planning Questionnaire.”Studies in Family Planning26: 233–40.
12.
BelcherD. W.WurapaF. K.LourieI. M.KwabiaK.Avle.S. K.1976. Experience in Selecting, Training and Supervising Interviewers in a Rural Health Project: Danfa Project, Ghana, Danfa Project Monograph Series, No. 11. Los Angeles, CA: UCLA School of Public Health.
13.
BerkMarc L.BernsteinAmy B.1988. “Interviewer Characteristics and Performance on a Complex Health Survey.”Social Science Research17: 239–51.
14.
Bignami-van AsscheSimonaReniersGeorgesWeinrebAlexander A.2003. “An Assessment of the KDICP and MDICP Data Quality: Interviewer Effects, Question Reliability and Sample Attrition.”Demographic Research SC1: 31–75.
15.
BlalockHubert M.1961. Causal Inferences in Nonexperimental ResearchChapel Hill: University of North Carolina Press.
16.
BlancAnn K.CroftTrevor N.1992. “The Effect of the Sex of Interviewer on Responses in Fertility Surveys: The Case of Ghana.”Presented at the annual meeting of the Population Association of America, Apri1 30-May 1,
Denver, CO.
17.
BreaultK.D.BarkerChrisLemleRussell1987. “Informal Helping in Partner and Stranger Dyads.”Journal of Marriage and the Family49 (3): 541–47.
18.
BulmerMartin1993. “Interviewing and Field Organization.”
Pp. 205–17 in Social Research in Developing Countries: Surveys and Censuses in the Third World. 2d ed., edited by BulmerMartinWarwickDonald P.. London, England: UCL Press.
19.
BuveA.CaraelM.HayesR.J.2001a. “Multicentre Study on Factors Determining Differences in Rate of Spread of HIV in sub-Saharan Africa: Methods and Prevalence of HIV Infection.”AIDS15, (Suppl 4): S5-S14.
20.
CannellCharles F.MillerPeter V.OksenbergLois1981. “Research on Interviewing Techniques.”Sociological Methodology12: 389–437.
21.
CataniaJoseph A.BinsonDianeCancholaJessePollackLance M.HauckWalterCoatesThomas J.1996. “Effects of Interviewer Gender Interviewer Choice, and Item Wording on Responses to Questions Concerning Sexual Behavior.”Public Opinion Quarterly60: 345–75.
22.
CholdinHarvey M.Majeed KahnA.Hosne AraB..1967. “Cultural Complications in Fertility Interviewing.”Demography4: 244–52.
23.
ChristenfeldNicholasGerinWilliamLindenWolfgangSandersMaraMathurJenniferDeichJames D.PickeringThomas G.1997. “Social Support Effects on Cardiovascular Reactivity: Is a Stranger as Effective as a Friend?”Psychosomatic Medicine59: 388–98.
24.
CicourelAaron V.1974. Theory and Method in a Study of Argentine FertilityNew York: John Wiley and Sons.
25.
CollinsRandall2004. Interaction Ritual ChainsPrinceton, NJ: Princeton University Press.
26.
de LeeuwEdithMellenberghGideon J.HoxJoop J.1996. “The Influence of Data Collection Method on Structural Models: A Comparison of a Mail, a Telephone, and a Face-to-Face Survey.”Sociological Methods and Research24: 443–72.
27.
Demographic and Health Surveys (DHS).1987. Interviewer's Manual: For Use With Model “A” Questionnaire For High Contraceptive Prevalence Countries (Basic Documentation-5)Columbia, MD: Institute for Resource Development.
28.
DentanRobert Knox.1968. The Semai: A Nonviolent People of MalayaNew York: Holt, Rinehart, and Winston.
29.
DijkstraWil1987. “Interviewing Style and Respondent Behavior: An Experimental Study of the Survey Interviewer.”Sociological Methods and Research16: 309–34.
30.
DindiaKathrynAnne FitzpatrickMaryKennyDavid A.1997. “Self-Disclosure in Spouse and Stranger Interaction: A Social Relations Analysis.”Human Communications Research23: 388–412.
31.
DoctorHenry V.Weinreb.A. A.2005. “Mortality Among Married Men in Rural Kenya and Malawi.”Etude de la Population Africaine20: 165–77.
32.
DouglasMary1970. Natural Symbols: Explorations in CosmologyNew York: Pantheon Books.
33.
DurkheimEmile [1926] 1964. The Division of Labor in SocietyNew York: The Free Press.
GarfinkelHarold1967. Studies in EthnomethodologyEnglewood Cliffs, NJ: Prentice-Hall.
36.
GiddensAnthony1990. The Consequences of ModernityStanford, CA: Stanford University Press.
37.
GivensDavid1978. “Greeting a Stranger: Some Commonly Used Nonverbal Signals of Aversiveness.”Semiotica22: 351–67.
38.
GoffmanErving1971. Relations in Public: Microstudies of the Public OrderNew York: Basic Books.
39.
Gwassi.1994.Unpublished KDICP field notes by Susan Watkins (KDICPJournal-HH1-A-Dec-1994.pdf). Available at http://kenya.pop.upenn.edu/level%203/Kenya/level3_kenya_fieldnotes.
40.
Gwassi.1995. Unpublished KDICP field notes by Susan Watkins (KDICP Journal-HH1-B-Jan-1995.pdf). Available at
http://kenya.pop.upenn.edu/level%203/Kenya/level3_kenya_fieldnotes.
41.
Gwassi.2000. Unpublished KDICP field notes by Susan Watkins (KDICPJournal-HH3-K3.pdf). Available at
http://kenya.pop.upenn.edu/level%203/Kenya/level3_kenya_fieldnotes.
42.
HagenaarsJacques A.HeinenTon G.1982. “Effects of Role-Independent Interviewer Characteristics on Responses.”
Pp. 91–130 in Response Behavior in the Survey-Interview, edited by DijkstraW.van der ZouwenJ.. London, England: Academic Press.
43.
HeiselDonald F.1968. “Attitudes and Practice of Contraception in Kenya.”Demography5: 632–41.
44.
HershfieldAllan F.RohlingNiels G.KerrGraham B.Hursch CésarGerald.1993. “Fieldwork in Rural Areas.”
Pp. 241–52 in Social Research in Developing Countries: Surveys and Censuses in the Third World. 2d ed., edited by BulmerMartinWarwickDonald P.. London, England: UCL Press.
45.
HolsteinJames A.GubriumJaber F.1995. The Active InterviewThousand Oaks, CA: Sage Publications.
46.
HymanHerbert H.CobbWilliam J.FeldmanJacob J.HartClyde W.Herbert StemberCharles.1954. Interviewing in Social ResearchChicago, IL: University of Chicago Press.
47.
JacquetteJ.1990. “Gender and Justice in Economic Development.”
Pp. 54–69 in Persistent Inequalities, edited by TinkerIrene. Oxford, England: Oxford University Press.
48.
JansenSue Curry.1980. “The Stranger as Seer or Voyeur: A Dilemma of the Peep-Show Theory of Knowledge.”Qualitative Sociology2: 22–55.
49.
Kawadhgone.2000. Unpublished KDICP field notes by Susan Watkins (KDICPJournal-HH3-K3.pdf). Available at http://kenya.pop.upenn.edu/level%203/Kenya/level3_kenya_fieldnotes.
50.
KearlB., ed.1976. Field Data Collection in the Social Sciences: Experiences in Africa and the Middle EastNew York: Agricultural Development Council, Inc.
51.
KroegerAxel1983. “Health Interview Surveys in Developing Countries: A Review of the Methods and Results.”International Journal of Epidemiology12: 465–81.
52.
KrysanMariaSchumanHowardJo ScottLesliBeattyPaul1994. “Response Rates and Response Content in Mail Versus Face-to-Face Surveys.”Public Opinion Quarterly58: 381–99.
53.
LevyMarion J.Jr.1972. Modernization: Latecomers and SurvivorsNew York: Basic Books.
54.
LitwinM. S.2003. How to Assess and Interpret Survey Psychometrics: The Survey Kit. 2d ed.London, England: Sage Publications.
55.
MangioneThomasHingsonRalphBarrettJane1982. “Collecting Sensitive Data: A Comparison of Three Survey Strategies.”Sociological Methods and Research10: 337–46.
56.
MauldinW. P.1965. “Application of Survey Techniques to Fertility Studies.”
Pp. 93–118 in Public Health and Population Change: Current Research Issues, edited by ShepsMindel C.RidleyJeanne C.. Pittsburgh, PA: University of Pittsburgh Press.
57.
MaynardDouglas W.Cate SchaefferNora.2002. “Standardization and Its Discontents.”
Pp. 3–46 in Standardization and Tacit Knowledge: Interaction and Practice in the Survey Interview, edited by MaynardDouglas W.Houtkoop-SteenstraHannekeCate SchaefferNoravan der ZouwenJohannes. New York: John Wiley and Sons.
58.
MayoniJoseph R.1983. “Eager Visitor, Reluctant Host: The Anthropologist as Stranger.”Anthropologica25: 221–49.
59.
MenschB. S.HewettP. C.Erulkar.A.2003. “The Reporting of Sensitive Behavior Among Adolescents: A Methodological Experiment in Kenya.”Demography40: 247–68.
60.
MolmL. D.TakahashiN.Peterson.G.2000. “Risk and Trust in Social Exchange: An Experimental Test of a Classical Proposition.”American Journal of Sociology105: 1396–427.
61.
Morel-SeytouxSylvie.2000. Review of Gender Issues in the USAID/Kenya Integrated Strategic Plan (ISP) 2001–2005Washington, DC: Women in Development Technical Assistance Project.
Oyugis.1994. Unpublished KDICP field notes by Susan Watkins (KDICPJournal-HH1-A-Dec-1994.pdf). Available at
http://kenya.pop.upenn.edu/level%203/Kenya/level3_kenya_fieldnotes.
64.
Oyugis.2000. Unpublished KDICP field notes by Susan Watkins (KDICPJournal-HH3-K3.pdf). Available at http://kenya.pop.upenn.edu/level%203/Kenya/level3_kenya_fieldnotes.
65.
PlummerMary L.WightDanielRossDavid A.BaliraRebeccaAnemonaAlessandraToddJimSalambaZachayoAngelaI. N.ObasiHeiner GrosskurthChangalungaJohnHayesRichard J.2004. “Asking Semi-Literate Adolescents About Sexual Behaviour: The Validity of Assisted Self-Completion Questionnaire (ASCQ) Data in Rural Tanzania.”Tropical Medicine and International Health9: 737–54.
66.
RossDavid A.Patrick VaughanJ..1986. “Health Interview Surveys in Developing Countries: A Methodological Review.”Studies in Family Planning17: 78–94.
67.
RudolphL.Rudolph.S. H.1958. “Surveys in India: Field Experience in Madras State.”Public Opinion Quarterly33: 235–44.
68.
SchaefferNora C.1980. “Evaluating Race-of-Interviewer Effects in a National Survey.”Sociological Methods and Research8: 400–19.
69.
SchaefferNora C.1991. “Conversation With a Purpose—or Conversation? Interaction in the Standardized Interview.”
Pp. 367–91 in Measurement Errors in Surveys, edited by BiemerPaul B.GrovesRobert M.LybergLars E.MathiowetzNancy A.SudmanSeymourBiemerPaul B.. New York: Wiley and Sons.
70.
SchaefferNora C.PresserStanley2003. “The Science of Asking Questions.”Annual Review of Sociology29: 65–88.
SimmelGeorg1950a. “The Stranger.”
Pp. 402–8 in The Sociology of Georg Simmel, translated and edited by WolfKurt H.. New York: Free Press.
73.
SimmelGeorg1950b. “Knowledge, Truth, and Falsehood in Human Relations.”
Pp. 307–16 in The Sociology of Georg Simmel, translated and edited by WolfKurt H.. New York: Free Press.
74.
SingerEleanorVon ThurnDawn R.MillerEsther R.1995. “Confidentiality Assurances and Response: A Quantitative Review of the Experimental Literature.”Public Opinion Quarterly59: 66–77.
75.
StoneLindaGabriel CampbellJ..1984. “The Use and Misuse of Surveys in International Development: An Experiment from Nepal.”Human Organization43: 27–37.
76.
StycosJ. M.1960. “Sample Surveys for Social Science in Underdeveloped Areas.”
Pp. 375–88 in Human Organization Research, edited by AdamsR. N.PreissJ.. Homewood, IL: The Dorsey Press.
77.
SuchmanLucyJordanBrigitte1990. “Interactional Troubles in Face-to-Face Survey Interviews.”Journal of American Statistical Association85: 232–53.
78.
SudmanSeymourBradburnNorman M.1974. Response Effects in Surveys: A Review and SynthesisChicago, IL: Aldine Publishing Company.
79.
SudmanSeymourBradburnNorman M.BlairEdStockingCarol1977. “Modest Expectations: The Effects of Interviewers' Prior Expectations on Responses.”Sociological Methods and Research6: 171–82.
80.
TaietzPhilip1962. “Conflicting Group Norms and the “Third” Person in the Interview.”American Journal of Sociology68: 97–104.
81.
TönniesFerdinand.1961. Custom: An Essay on Social CodesChicago, IL: Henry Regnery Company.
82.
TourangeauRoger1990. “Comment on Suchman and Jordan.”Journal of American Statistical Association85: 250–51.
83.
TourangeauRogerRipsLance J.RasinskiKenneth2000. The Psychology of Survey Response. Cambridge, England, Cambridge University Press.
84.
United Nations, Department of Economic and Social Affairs.1961. The Mysore Population StudyNew York: United Nations.
85.
van TilbergTheo.1998. “Interviewer Effects in the Measurement of Personal Network Size: A Nonexperimental Study.”Sociological Methods and Research26 (3): 300–328.
86.
SouthWakula1994. Unpublished KDICP field notes by Susan Watkins (KDICPJournal-HH1-B-Jan1995.pdf). Available at http://kenya.pop.upenn.edu/level%203/Kenya/level3_kenya_fieldnotes.
87.
SouthWakula1996. Unpublished KDICP field notes by Susan Watkins (KJournal-HH2-Dec96.pdf) Available from author.
88.
WareHelen1977. Language Problems in Demographic Field Work in Africa: The Case of the Cameroon Fertility SurveyLondon, England: International Statistical Institute & World Fertility Survey, Scientific Report No. 2.
89.
WarrenCarol A. B.1988. Gender Issues in Field Research Qualitative Research Methods Series. Thousand Oaks, CA: Sage Publications.
90.
WatkinsSusan C.2000. “Local and Foreign Models of Reproduction in Nyanza Province, Kenya, 1930–98.”Population and Development Review26: 725–59.
91.
WeinrebAlexander A.2000. Integrating Respondents, the Community, and the State in the Analysis of Contraceptive Use. Ph.D. dissertation, Population Studies Center, University of Pennsylvania, Philadelphia, PA.
92.
WeinrebAlexander A.2001a. “A State-Centered, Political Capital Approach to the Explanation of Demographic Differences: With Special Reference to Regional/Ethnic Inequality in Sub-Saharan Africa.”
In Proceedings of the General Conference of the International Union for the Scientific Study of Population (IUSSP), August 18–24, Salvador, Brazil.
93.
WeinrebAlexander A.2001b. “First Politics, Then Culture: Accounting for Ethnic Differences in Demographic Behavior in Kenya.”Population and Development Review27: 437–67.
94.
ZellerRichard A.CarminesEdward G.1980. Measurement in the Social Sciences: The Link Between Theory and DataNew York: Cambridge University Press.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
