Identifying illicit behavior in survey research is inherently problematic, since self-reports are untrustworthy. We argue that fraudulent interviewers can, however, be identified through statistical deviance of the distributional parameters of their interviews. We document that a high proportion of the variation in the data is due to the interviewer. In addition, we show that the incidence of interviewer-induced anomalies is strongly associated with the perceived level of corruption across the countries participating in the European Social Survey 2010. The major implication of the findings is that the data from some countries cannot be used fruitfully for cross-national comparative research.
AnderssonStaffanHeywoodPaul M.. 2009. “The Politics of Perception: Use and Abuse of Transparency International’s Approach to Measuring Corruption.” Political Studies57(4):746–67.
3.
BardhanPranab. 1997. “Corruption and Development: A Review of Issues.” Journal of Economic Literature35(3):1320–46.
4.
BaumgartnerHansSteenkampJan-Benedict E.M.. 2001. “Response Styles in Marketing Research: A Cross-national Investigation.” Journal of Marketing Research38(2):143–56.
5.
BenfordFrank. (1938). The Law of Anomalous Numbers. Proceedings of the American Philosophical Society78(4):551–72.
6.
BennettArchibald S.1948. “Toward a Solution of the ‘Cheater Problem’ among Part-time Research Investigators.” Journal of Marketing12(4):470–74.
7.
BiemerPaul P.Lynne StokesS.. 1989. “The Optimal Design of Quality Control Samples to Detect Interviewer Cheating.” Journal of Official Statistics5(1):23–39.
8.
BiemerPaul P.LybergLars. 2003. Introduction to Survey Quality. Hoboken, NJ: Wiley.
9.
BlasiusJörg. 2018. “Fabrication of Interview Data.” Quality Assurance in Education26(2): 213–26.
10.
BlasiusJörgFriedrichsJürgen. 2012. “Faked Interviews.” Pp. 49–56 in Methods, Theories, and Empirical Applications in the Social Sciences: Festschrift for Peter Schmidt, edited by SalzbornS.DavidovE.ReineckeJ.. Wiesbaden, Germany: Springer VS.
11.
BlasiusJörgGowerJohn. 2005. “Multivariate Prediction with Nonlinear Principal Components Analysis: Application.” Quality and Quantity39(4):373–90.
12.
BlasiusJörgThiessenVictor. 2006a. “Assessing Data Quality and Construct Comparability in Cross-national Surveys.” European Sociological Review22(3):229–42.
13.
BlasiusJörgThiessenVictor. 2006b. “A Three-step Approach to Assessing the Behavior of Survey Items in Cross-national Research.” Pp. 433–53 in Multiple Correspondence Analysis and Related Methods, edited by GreenacreM.BlasiusJ.. Boca Raton, FL: Chapman & Hall.
14.
BlasiusJörgThiessenVictor. 2009. “Facts and Artifacts in Cross-national Research: The Case of Political Efficacy and Trust”. Pp. 147–69 in Charting the Globe. The International Social Survey Programme 1984–2009, edited by HallerM.JowellR.SmithT.. London, England: Routledge.
15.
BlasiusJörgThiessenVictor. 2012. Assessing the Quality of Survey Data. London, England: Sage.
16.
BlasiusJörgThiessenVictor. 2013. “Detecting Poorly Conducted Interviews.” Pp. 67–88 in Interviewers’ Deviations in Surveys: Impact, Reasons, Detection and Prevention, edited by WinkerP.MenoldN.PorstR.. Frankfurt, Germany: Peter Lang.
17.
BlasiusJörgThiessenVictor. 2015. “Should We Trust Survey Data? Assessing Response Simplification and Data Fabrication.” Social Science Research52:479–93.
18.
BredlSebastianWinkerPeterKötschauKerstin. 2012. “A Statistical Approach to Detect Interviewer Falsification of Survey Data.” Survey Methodology38(1):1–10.
19.
BrehmJohnRahnWendy. 1997. “Individual-level Evidence for the Causes and Consequences of Social Capital.” American Journal of Political Science41(3):999–1023.
20.
CrespiLeo P.1945. “The Cheater Problem in Polling.” Public Opinion Quarterly9:431–45.
21.
CrespiLeo P.1946. “Further Observations on the ‘Cheater’ Problem.” Public Opinion Quarterly10(4):646–49.
22.
DavisJames H.RuheJohn A.. 2003. “Perceptions of Country Corruption: Antecedents and Outcomes.” Journal of Business Ethics43(4):275–88.
23.
De LeeuwJan. 2014. “History of Nonlinear Principal Component Analysis.” Pp. 45–60 in Visualization and Verbalization of Data, edited by BlasiusJ.GreenacreM.. Milton Park, England: Chapman and Hall/CRC.
24.
DelheyJanNewtonKennethWelzelChristian. 2011. “How General Is Trust in ‘Most People’? Solving the Radius of Trust Problem.” American Sociological Review76(5):786–807.
25.
Dimitrova-GrajzlValentinaGrajzlPeterJoseph GuseA.. 2012. “Trust, Perceptions of Corruption, and Demand for Regulation: Evidence from Post-socialist Countries.” The Journal of Socio-Economics41(3):292–303.
26.
DurkheimEmile. [1897] 1951. Suicide: A Study in Sociology. Glencoe, IL: Free Press.
FitzgeraldRoryJowellRoger. 2011. “Measurement Equivalence in Comparative Surveys: the European Social Survey (ESS)—From Design to Implementation and Beyond.” Working Paper No. 03, City University, Centre for Comparative Studies, London, England. Retrieved December 15, 2016 (https://www.city.ac.uk/__data/assets/pdf_file/0016/125134/CCSS-Working-Paper-No-03.pdf).
29.
GifiAlbert. 1990. Nonlinear Multivariate Analysis. New York: Wiley.
HarrisonDavid E.KraussStefanie L.. 2002. “Interviewer Cheating: Implications for Research on Entrepreneurship in Africa.” Journal of Developmental Entrepreneurship7:319–30.
32.
KaminskaOlenaMcCutcheonAllan L.BillietJaak. 2010. “Satisficing among Reluctant Respondents in a Cross-national Context.” Public Opinion Quarterly74(5):956–84.
33.
KatsiosStavros. 2006. “The Shadow Economy and Corruption in Greece.” South-Eastern Europe Journal of Economics4(1):61–80.
34.
KennickellArthur. 2015. “Curbstoning and Culture.” Statistical Journal of the IAOS31(2):237–40.
35.
KoczelaSteveScheurenFritz. 2016. “Progress in Understanding Survey Data Fabrication.” Statistical Journal of the IAOS32(3):277–82.
36.
KreuterFrauke. 2013. Improving Surveys with Paradata: Analytic Uses of Process Information. Hoboken, NJ: Wiley.
37.
KrosnickJon A.1991. “Response Strategies for Coping with the Cognitive Demands of Attitude Measures in Surveys.” Applied Cognitive Psychology5(3):213–36.
38.
KrosnickJon A.1999. “Survey Research.” Annual Review of Psychology50:337–67.
39.
KrosnickJon A.NarayanSowmyaSmithWendy R.. 1996. “Satisficing in Surveys: Initial Evidence.” Pp. 29–44 in Advances in Survey Research: New Directions for Evaluation, edited by BravermanMarc T.SlaterJana Kay. San Francisco, CA: Josey-Bass.
40.
ListChristianKaiSpiekerman. 2013. “Methodological Individualism and Holism in Political Science: A Reconciliation” American Political Science Review107(4):629–643.
41.
LühisteKadri. 2006. “Explaining Trust in Political Institutions: Some Illustrations from the Baltic States.” Communist and Post-Communist Studies39(4):475–96.
42.
MertonRobert K.1938. “Social Structure and Anomie.” American Sociological Review3(5):672–82.
43.
MertonRobert K.1957. Social Theory and Social Structure. Glencoe, IL: Free Press.
44.
MishlerWilliamRoseRichard. 2001. “What Are the Origins of Political Trust? Testing Institutional and Cultural Theories in Post-communist Societies.” Comparative Political Studies34(1):30–62.
45.
MishlerWilliamRoseRichard. 2005. “What Are the Political Consequences of Trust? A Test of Cultural and Institutional Theories in Russia.” Comparative Political Studies38(9):1050–78.
46.
MurphyJoeBaxterRodneyEyermanJoeCunninghamDavidKennetJoel. 2004. “A System for Detecting Interviewer Falsification.” Paper presented at the American Association for Public Opinion Research, 59th Annual Conference, May 13–16, Phoenix, AZ, pp. 4968–75.
47.
NelsonJames E.KieckerPamela L.. 1996. “Marketing Research Interviewers and their Perceived Necessity of Moral Compromise.” Journal of Business Ethics15(10):1107–17.
48.
PorrasJavierEnglishNed. 2004. “Data-driven Approaches to Identifying Interviewer Data Falsification: The Case of Health Surveys”. Paper presented at the American Association for Public Opinion Research, 59th Annual Conference, May 13–16, Phoenix, AZ.
49.
RothsteinBoUslanerEric M.. 2005. “All for All: Equality, Corruption, and Social Trust.” World Politics58(1):41–72.
50.
SchäferChristianSchräplerJörg-PeterMüllerKlaus-RobertWagnerGert G.. 2005. “Automatic Identification of Faked and Fraudulent Interviews in the German SOEP.” Schmollers Jahrbuch125(1):183–93.
51.
SchräplerJörg-PeterWagnerGert G.. 2005. “Characteristics and Impact of Faked Interviews in Surveys: An Analysis of genuine Fakes in the Raw Data of SOEP.” Allgemeines Statistisches Archiv89:7–20.
52.
ThiessenVictorBlasiusJörg. 2016. “Another Look at Survey Data Quality.” Pp. 613–29 in Sage Handbook of Survey Methodology, edited by WolfC.JoyeD.SmithT.W.FuY.-C.. Los Angeles, CA: Sage.
53.
ThomasWilliam I.ThomasDorothy S.. 1928. The Child in America: Behavior Problems and Programs. New York: Knopf.
54.
TreismanDaniel. 2007. “What Have We Learned about the Causes of Corruption from Ten Years of Cross-national Empirical Research.” Annual Review of Political Science10(1):211–44.
55.
TurnerCharles FGribbleJames N.Al-TayyibAlia A.ChromnyJames R.. 2002. “Falsification in Epidemiologic Surveys: Detection and Remediation”. Technical Papers on Health and Behavior Measurement (Report #53). Retrieved December 15, 2016 (http://qcpages.qc.cuny.edu/∼cturner/TechPDFs/53_Falsify.pdf).
56.
WallerLloyd G.2013. “Interviewing the Surveyors: Factors which Contribute to Questionnaire Falsification (Curbstoning) among Jamaican Field Surveyors.” International Journal of Social Research Methodology16(2):155–64.
57.
WestBrady T.BlomAnnelies G.. 2016. “Explaining Interviewer Effects: A Research Synthesis.” Journal of Survey Statistics and Methodology:1–37. doi: 10.1093/jssam/smw024.
58.
WinkerPeterMenoldNataljaPorstRolf. 2013. Interviewers’ Deviations in Surveys: Impact, Reasons, Detection and Prevention. Frankfurt, Germany: Peter Lang.
59.
ZmerliSonjaNewtonKen. 2008. “Social Trust and Attitudes toward Democracy.” Public Opinion Quarterly72(4):706–24.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
