Using data from over 24,000 respondents in the Norwegian Crime Victimization Survey, we conducted a double list experiment to measure domestic violence (DV). Both list experiments revealed a statistically significant decrease in reporting when including a sensitive DV item. This clear violation of the “no design effects” assumption is not only explained by floor effects. One possibility is that the results indicate a “fleeing” behavior whereby respondents try to avoid association with DV. Combined with the inherent power limitations of list experiments in many contexts, these results underscore the need for caution in employing list experiments to measure DV, even in large samples.
AgüeroJorge MFrisanchoVeronica. 2022. “Measuring Violence Against Women with Experimental Methods.” Economic Development and Cultural Change70(4): 1565–90.
2.
AhmadFarahHogg-JohnsonSheilahStewartDonna E.SkinnerHarvey A.GlazierRichard H.LevinsonWendy. 2009. “Computer-assisted Screening for Intimate Partner Violence and Control: a Randomized Trial.” Annals of Internal Medicine151(2): 93–102.
3.
AksoyBillurCarpenterChristopher S.SansoneDario. 2025. “Understanding Labor Market Discrimination Against Transgender People: evidence from a Double List Experiment and a Survey.” Management Science71(1): 659–77.
4.
BlairGraemeCoppockAlexanderMoorMargaret. 2020. “When to Worry About Sensitivity Bias: a Social Reference Theory and Evidence from 30 Years of List Experiments.” American Political Science Review114(4): 1297–315.
5.
BlairG.ImaiK.. 2012. “Statistical Analysis of List Experiments.” Political Analysis20: 47–77.
6.
BulteErwinLensinkRobert. 2019. “Women’s Empowerment and Domestic Abuse: experimental Evidence from Vietnam.” European Economic Review115: 172–91.
7.
ChuangEricaDupasPascalineHuilleryEliseSebanJuliette. 2021. “Sex, Lies, and Measurement: consistency Tests for Indirect Response Survey Methods.” Journal of Development Economics148: 102582.
8.
CoolsSaraKotsadamAndreas. 2017. “Resources and Intimate Partner Violence in Sub-Saharan Africa.” World Development95: 211–30.
9.
CrowneDouglas PMarloweDavid. 1960. “A new Scale of Social Desirability Independent of Psychopathology.” Journal of Consulting Psychology24(4): 349.
10.
CullenClaire. 2023. “Method Matters: the Underreporting of Intimate Partner Violence.” The World Bank Economic Review37(1): 49–73.
11.
DharDivaJainTarunJayachandranSeema. 2022. “Reshaping Adolescents’ Gender Attitudes: evidence from a School-Based Experiment in India.” American Economic Review112(3): 899–927.
12.
EllsbergMaryHeiseLori. 2002. “Bearing Witness: Ethics in Domestic Violence Research.” The Lancet359(9317): 1599–604.
13.
EllsbergMaryHeiseLoriPenaRodolfoAgurtoSoniaWinkvistAnna. 2001. “Researching Domestic Violence Against Women: Methodological and Ethical Considerations.” Studies in Family Planning32(1): 1–16.
14.
FearonJamesHoefflerAnke. 2014. “Benefits and costs of the conflict and violence targets for the post-2015 development agenda,” Conflict and violence assessment paper, Copenhagen Consensus Center, 2014.
15.
GilliganDaniel OHidroboMelissaLeightJessicaTambetHeleene. 2024. “Using a List Experiment to Measure Intimate Partner Violence: cautionary Evidence from Ethiopia.” Applied Economics Letters32(11):1–7.
16.
GlynnAdam N. 2013. “What can we Learn with Statistical Truth serum? Design and Analysis of the List Experiment.” Public Opinion Quarterly77(S1): 159–72.
17.
HaberNoahHarlingGuyCohenJessicaMutevedziTinofaTanserFrankGaretaDickmanHerbstKobusPillayDeenanBärnighausenTillFinkGünther. 2018. “List Randomization for Eliciting HIV status and Sexual Behaviors in Rural KwaZulu-Natal, South Africa: a Randomized Experiment Using Known True Values for Validation.” BMC medical Research Methodology18: 1–12.
18.
HeiseLoriKotsadamAndreas. 2015. “Cross-national and Multilevel Correlates of Partner Violence: an Analysis of Data from Population-Based Surveys.” The Lancet Global Health3(6): e332–40.
19.
HinsleyAmyKeaneAidanSt. JohnFreya AVIbbettHarrietNunoAna. 2019. “Asking Sensitive Questions Using the Unmatched Count Technique: applications and Guidelines for Conservation.” Methods in Ecology and Evolution10(3): 308–19.
20.
Kiewiet de JongeChad P.NickersonDavid W.. 2014. “Artificial Inflation or Deflation? Assessing the Item Count Technique in Comparative Surveys.” Political Behavior36: 659–82.
21.
KishorS.2005. “Domestic Violence Measurement in the Demographic and Health Surveys: The History and the Challenges,” Technical Report, United Nations Expert Paper 1–9 2005.
22.
KlevensJoanneSadowskiLauraKeeRominaTrickWilliamGarciaDiana. 2012. “Comparison of Screening and Referral Strategies for Exposure to Partner Violence.” Women's Health Issues22(1): 45–52.
23.
Kotsadam, Andreas. 2025. “Replication Data for: Is It Time to Put a Moratorium on List Experiments for Domestic Violence Elicitation?” Harvard Dataverse. https://doi.org/doi:10.7910/DVN/CLQSJK.
24.
KotsadamAndreasVillangerEspen. 2022. “Jobs and Intimate Partner Violenceevidence from a Field Experiment in Ethiopia.” Journal of Human Resources86(2):0721–11780R2.
25.
KrebsChristopher PLindquistChristine HWarnerTara DFisherBonnie SMartinSandra LChildersJames M. 2011. “Comparing Sexual Assault Prevalence Estimates Obtained with Direct and Indirect Questioning Techniques.” Violence Against Women17(2): 219–35.
26.
LépineAuréliaTreibichCaroled’ExelleBen. 2020. “Nothing but the Truth: consistency and Efficiency of the List Experiment Method for the Measurement of Sensitive Health Behaviours.” Social Science & Medicine266: 113326.
27.
LiJiayuanVan den NoortgateWim. 2022. “A Meta-Analysis of the Relative Effectiveness of the Item Count Technique Compared to Direct Questioning.” Sociological Methods & Research51(2): 760–99.
PalermoTiaBleckJenniferPetermanAmber. 2014. “Tip of the Iceberg: reporting and Gender-Based Violence in Developing Countries.” American Journal of Epidemiology179(5): 602–12.
31.
RudminFloyd W. 1999. “Norwegian Short-Form of the Marlowe-Crowne Social Desirability Scale.” Scandinavian Journal of Psychology40(3): 229–33.
32.
StrausM. M. A.GellesR. J.SteinmetzS. K.. 2017. Behind Closed Doors: Violence in the American Family. Routledge.
33.
TourangeauRogerRipsLance JRasinskiKenneth. 2000. “The psychology of survey response,” 2000.
34.
TraunmüllerRichardKijewskiSaraFreitagMarkus. 2019. “The Silent Victims of Sexual Violence During war: evidence from a List Experiment in Sri Lanka.” Journal of Conflict Resolution63(9): 2015–42.
35.
TsaiChi-lin.2019. “Statistical Analysis of the Item-Count Technique Using Stata.” The Stata Journal19(2): 390–434.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
