Post-instrument covariates are often included as controls in instrumental variable (IV) analyses to address a violation of the exclusion restriction. However, we show that such analyses are subject to biases unless strong assumptions hold. Using linear constant-effects models, we present asymptotic bias formulas for three estimators (with and without measurement error): IV with post-instrument covariates, IV without post-instrument covariates, and ordinary least squares. In large samples and when the model provides a reasonable approximation, these formulas sometimes allow the analyst to bracket the parameter of interest with two estimators and allow the analyst to choose the estimator with the least asymptotic bias. We illustrate these points with a discussion of the settler mortality IV used by Acemoglu, Johnson, and Robinson.
AcemogluDaronJohnsonSimonRobinsonJames A.. 2001a. “The Colonial Origins of Comparative Development: An Empirical Investigation.” The American Economic Review91(5):1369‐1401.
2.
AcemogluDaronJohnsonSimonRobinsonJames A.. 2001b. “Replication Data: The Colonial Origins of Comparative Development: An Empirical Investigation.” data retrieved from Daron Acemoglu’s website, https://economics.mit.edu/faculty/acemoglu/data/ajr2001.
3.
AlesinaAlbertoDevleeschauwerArnaudEasterlyWilliamKurlatSergioWacziargRomain. 2003. “Fractionalization.” Journal of Economic Growth8:155‐194.
4.
AngristJoshua DavidPischkeJörn-Steffen. 2009. Mostly Harmless Econometrics: An Empiricist’s Companion. Princeton: Princeton University Press.
5.
BetzTimmCookScott J.HollenbachFlorian M.. 2018. “On The Use and Abuse of Spatial Instruments.” Political Analysis 26(4):474‐479.
6.
BjørnskovChristian. 2008. “Social Trust and Fractionalization: A Possible Reinterpretation.” European Sociological Review24(3):271‐283.
7.
BollenKenneth A. 2012. “Instrumental Variables in Sociology and the Social Sciences.” Annual Review of Sociology38:37‐72.
8.
BritoCarlosPearlJudea. 2002. “Generalized Instrumental Variables.” Proceedings Conference on Uncertainty in Artificial Intelligence (UAI) pp. 85–93.
ChouWinston. 2017. “Culture Remains Elusive: On the Identification of Cultural Effects With Instrumental Variables.” American Sociological Review82(2):435‐443.
11.
ConleyTimothy GHansenChristian BRossiPeter E. 2012. “Plausibly Exogenous.” Review of Economics and Statistics94(1):260‐272.
12.
de VaanMathijsStuartToby. 2019. “Does Intra-household Contagion Cause An Increase in Prescription Opioid Use?” American Sociological Review84(4):577‐608.
13.
DeuchertEvaHuberMartin. 2017. “A Cautionary Tale About Control Variables in IV Estimation.” Oxford Bulletin of Economics and Statistics79(3):411‐425.
14.
ElwertFelix. 2013. “Graphical causal models.” Pp. 245-273 in Handbook of causal analysis for social research, edited by. Stephen L Morgan. Springer.
15.
ElwertFelixWinshipChristopher. 2014. “Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable.” Annual Review of Sociology40:31‐53.
16.
ElwertFelixSegarraElan. 2020. “Treatment Induced Selection Bias in Instrumental Variables Analysis: Exact Result.” in Probabilistic and Causal Inference: The Works of Judea Pearl, edited by Hector Geffner, Rina Dechter and Joseph Y. Halpern. ACM Books.
17.
ElwertFelixPfefferFabian T.. 2020. “The Future Strikes Back: Using Future Treatments to Detect and Reduce Hidden Bias.” Sociological Methods & Research0(0):0049124119875958. forthcoming.
18.
FloresCarlos AFlores-LagunesAlfonso. 2013. “Partial Identification of Local Average Treatment Effects With An Invalid Instrument.” Journal of Business & Economic Statistics31(4):534‐545.
19.
GarberStevenKlepperSteven. 1980. “Extending the Classical Normal Errors-in-Variables Model.” Econometrica48(6):1541‐1546.
20.
HughesRachael A.DaviesNeil M.Davey SmithGeorgeTillingaKate. 2019. “Selection Bias When Estimating Average Treatment Effects Using One-sample Instrumental Variable Analysis.” Epidemiology30:350‐357.
21.
ImbensGuido W. et al. 2014. “Instrumental Variables: An Econometrician’s Perspective.” Statistical Science29(3):323‐358.
22.
MealliFabriziaPaciniBarbara. 2013. “Using Secondary Outcomes to Sharpen Inference in Randomized Experiments With Noncompliance.” Journal of the American Statistical Association108(503):1120‐1131.
23.
MontalvoJosé G.Reynal-QuerolMarta. 2005. “Ethnic Polarization, Potential Conflict, and Civil Wars.” American Economic Review95(3):796‐816.
24.
MontgomeryJacob MNyhanBrendanTorresMichelle. 2018. “How Conditioning on Posttreatment Variables Can Ruin Your Experiment and what to Do About it.” American Journal of Political Science62(3):760‐775.
25.
MorganStephen LWinshipChristopher. 2015. Counterfactuals and Causal Inference. Cambridge: Cambridge University Press.
26.
OkedijiTade O. 2005. “The Dynamics of Ethnic Fragmentation.” American Journal of Economics and Sociology64(2):637‐662.
27.
PearlJudea. 2009. Causality. Cambridge: Cambridge University Press.
28.
PearlJudea. 2013. “Linear Models: A Useful “microscope” for Causal Analysis.” Journal of Causal Inference1(1):155‐170.
29.
PolaviejaJavier G. 2015. “Capturing Culture: A New Method to Estimate Exogenous Cultural Effects Using Migrant Populations.” American Sociological Review80(1):166‐191.
30.
PolaviejaJavier G. 2017. “Culture As a Random Treatment: A Reply to Chou.” American Sociological Review82(2):444‐450.
31.
RosenbaumPaul R. 1984. “The Consequences of Adjustment for a Concomitant Variable that Has Been Affected by the Treatment.” Journal of the Royal Statistical Society: Series A (General) 147(5):656‐666.
32.
SchuesslerJulianGlynnAdam NRuedaMiguel R. 2021. “Post-Instrument Bias.” Working Paper.
33.
SharkeyPatrickTorrats-EspinosaGerardTakyarDelaram. 2017. “Community and the Crime Decline: The Causal Effect of Local Nonprofits on Violent Crime.” American Sociological Review82(6):1214‐1240.
34.
SwansonSonja ARobinsJames M.MillerMatthewHernánMiguel A.. 2015. “Instrumental Variable Analyses and Selection Bias.” American Journal of Epidemiology181(3):191‐197.
35.
VanHeuvelenTom. 2020. “The Right to Work, Power Resources, and Economic Inequality.” American Journal of Sociology125(5):1255‐1302.
36.
VansteelandtStijnDidelezVanessa. 2018. “Improving the Robustness and Efficiency of Covariate-Adjusted Linear Instrumental Variable Estimators.” Scandinavian Journal of Statistics45(4):941‐961.
37.
WooldridgeJeffrey M. 2010. Econometric Analysis of Cross Section and Panel Data. Cambridge, MA: The MIT Press.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
