Sage Journals: Discover world-class research

Abstract

Conventional advice discourages controlling for postoutcome variables in regression analysis. By contrast, we show that controlling for commonly available postoutcome (i.e., future) values of the treatment variable can help detect, reduce, and even remove omitted variable bias (unobserved confounding). The premise is that the same unobserved confounder that affects treatment also affects the future value of the treatment. Future treatments thus proxy for the unmeasured confounder, and researchers can exploit these proxy measures productively. We establish several new results: Regarding a commonly assumed data-generating process involving future treatments, we (1) introduce a simple new approach and show that it strictly reduces bias, (2) elaborate on existing approaches and show that they can increase bias, (3) assess the relative merits of alternative approaches, and (4) analyze true state dependence and selection as key challenges. (5) Importantly, we also introduce a new nonparametric test that uses future treatments to detect hidden bias even when future-treatment estimation fails to reduce bias. We illustrate these results empirically with an analysis of the effect of parental income on children’s educational attainment.

Keywords

causal inference confounding bias directed acyclic graphs future treatments

Get full access to this article

View all access options for this article.

References

Bates

G. E.

Neyman

. 1951. “Contributions to the Theory of Accident Proneness. An Optimistic Model of the Correlation between Light and Severe Accidents.” University of California Publications in Statistics 1:215–54.

Biewen

Martin

. 2009. “Measuring State Dependence in Individual Poverty Histories When There Is Feedback to Employment Status and Household Composition.” Journal of Applied Econometrics 24:1095–116.

Brito

Carlos

Pearl

Judea

. 2002. “Generalized Instrumental Variables.” Pp. 85–93 in Proceedings of the Eighteenth Conference on Uncertainty in Artificial Intelligence, edited by Darwiche

Friedman

. San Francisco, CA: Morgan Kaufmann.

Buchmann

Claudia

Condron

Dennis

Roscigno

Vincent

. 2010. “Shadow Education, American Style. Test Preparation, the SAT and College Enrollment.” Social Forces 89:435–62.

Cappellari

Lorenzo

Jenkins

Stephen P.

. 2004. “Modelling Low Income Transitions.” Journal of Applied Econometrics 19:593–610.

Chamberlain

Gary

. 1982. “Multivariate Regression Models for Panel Data.” Journal of Econometrics 18:5–46.

Chan

Hei

Kuroki

Manabu

. 2010. “Using Descendants as Instrumental Variables for the Identification of Direct Causal Effects in Linear SEMs.” Pp. 73–80 in International Conference on Artificial Intelligence and Statistics.

Deluca

Stefanie

. 2012. “What Is the Role of Housing Policy? Considering Choice and Social Science Evidence.” Journal of Urban Affairs 34:21–8.

DiNardo

John

Pischke

Jorn-Steffen

. 1997. “The Returns to Computer Use Revisited: Have Pencils Changed the Wage Structure Too?” Quarterly Journal of Economics 112:291–303.

10.

DiPrete

Thomas A.

Eirich

Gregory M.

. 2006. “Cumulative Advantage as a Mechanism for Inequality: A Review of Theoretical and Empirical Developments.” Annual Review of Sociology 32:271–97.

11.

Duncan

Greg J

. 2017. “Household Income and Child Development in the First Three Years of Life.” NIH Grant 1R01HD087384-01A1.

12.

Duncan

Greg J.

Connell

James P.

Klebanov

Pamela K.

. 1997. “Conceptual and Methodological Issues in Estimating Causal Effects of Neighborhoods and Family Conditions on Individual Development.” Pp. 219–50 in Neighborhood Poverty, Volume 1: Context and Consequences for Children, edited by Brooks-Gunn

Jeanne

Duncan

Greg J.

Lawrence Aber

. New York, NY: Russell Sage.

13.

Elwert

Felix

. 2013. “Graphical Causal Models.” Pp. 245–73 in Handbook of Causal Analysis for Social Research, edited by Morgan

S. L.

. Dordrecht, the Netherlands: Springer.

14.

Elwert

Felix

Christakis

Nicholas A.

. 2008. “Wives and Ex-wives: A New Test for Homogamy Bias in the Widowhood Effect.” Demography 45:851–73.

15.

Elwert

Felix

Winship

Christopher

. 2014. “Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable.” Annual Review of Sociology 40:31–53.

16.

Gottschalk

Peter

. 1996. “Is the Correlation in Welfare Participation across Generations Spurious?” Journal of Public Economics 63:1–25.

17.

Grogger

1995. “The Effect of Arrests on the Employment and Earnings of Young Men.” The Quarterly Journal of Economics 110:51–71.

18.

Heckman

James J.

1981a. “Heterogeneity and State Dependence.” Pp. 91–140 in Studies in Labor Markets, edited by Rosen

. Chicago, IL: University of Chicago Press.

19.

Heckman

James J

. 1981b. “Statistical Models for Discrete Panel Data.” Pp. 114–78 in Structural Analysis of Discrete Data and Econometric Applications, edited by Manski

Charles F.

McFadden

Daniel L.

. Cambridge: MIT Press.

20.

Hout

Michael

. 2017. “Models for Three-wave Panel Data: Examples Using the General Social Survey Panels.” Sociological Methods & Research 46:41–3.

21.

Jöreskog

Karl G.

1999. “How Large Can Standardized Coefficients Be?” Unpublished Manuscript. Retrieved April 16, 2019 (https://wenku.baidu.com/view/f5159e1d10a6f524cdbf8500.html).

22.

Kim

Jerry W.

Kogut

Bruce

Yang

Jae-Suk

. 2015. “Executive Compensation, Fat Cats, and Best Athletes.” American Sociological Review 80:299–328.

23.

Kim

Yongnam

Steiner

Peter

. in press. “Gain Scores Revisited: A Graphical Models Perspective.” Sociological Methods & Research. https://journals.sagepub.com/doi/full/10.1177/0049124119826155.

24.

Kornrich

Sabino

Furstenberg

Frank

. 2012. “Investing in Children. Changes in Parental Spending on Children, 1972–2007.” Demography 50:1–23.

25.

Mayer

Susan E.

1997. What Money Can’t Buy. Family Income and Children’s Life Chances. Cambridge, MA: Harvard University Press.

26.

Morgan

Stephen L.

Winship

Christopher

. 2015. Counterfactuals and Causal Inference. Methods and Principles for Social Research. 2nd ed. Cambridge, MA: Cambridge University Press.

27.

Pearl

Judea

. 2009. Causality: Models, Reasoning, and Inference. 2nd ed. Cambridge, MA: Cambridge University Press.

28.

Pearl

Judea

. 2013. “Linear Models: A Useful ‘Microscope’ for Causal Analysis.” Journal of Causal Inference 1:155–70.

29.

Panel Study of Income Dynamics (PSID). 2019. Panel Study of Income Dynamics, Public Use Dataset. Produced and Distributed by the Survey Research Center, Institute for Social Research. Ann Arbor, MI: University of Michigan.

30.

Piketty

Thomas

. 2014. Capital in the Twenty-first Century. Cambridge, England: Belknap Press.

31.

Porter

Lauren C.

King

Ryan D.

. 2014. “Absent Fathers or Absent Variables? A New Look at Paternal Incarceration and Delinquency.” Journal of Research in Crime and Delinquency 52:414–43.

32.

Robins

James M.

1994. “Correcting for Non-compliance in Randomized Trials Using Structural Nested Mean Models.” Communications in Statistics—Theory and Methods 23:2379–412.

33.

Rosenbaum

Paul R.

2002. Observational Studies. 2nd ed. New York, NY: Springer.

34.

Schneider

Daniel

Hastings

Orestes P.

LaBriola

Joe

. 2018. “Income Inequality and Class Divides in Parental Investments.” American Sociological Review 83:475–507.

35.

Steiner

Peter

Kim

Yongnam

. 2016. “The Mechanics of Omitted Variable Bias: Bias Amplification and Cancellation of Offsetting Biases.” Journal of Causal Inference 4:983982.

36.

Sobel

Michael E.

1998. “Causal Inference in Statistical Models of the Process of Socioeconomic Achievement.” Sociological Methods & Research 27:318–48.

37.

Vaisey

Stephen

Miles

Andrew

. 2017. “What You Can—and Can’t—Do with Three-wave Panel Data.” Sociological Methods & Research 46:44–67.

38.

Verma

Tom S.

Pearl

Judea

. 1988. “Causal Networks: Semantics and Expressiveness.” Proceedings of the Fourth Workshop on Uncertainty in Artificial Intelligence. https://www.sciencedirect.com/science/article/pii/B9780444886507500111

39.

Wildeman

Christopher

. 2010. “Paternal Incarceration and Children’s Physically Aggressive Behaviors: Evidence from the Fragile Families and Child Wellbeing Study.” Social Forces 89:285–309.

40.

Wodtke

Geoffrey T.

Almirall

Daniel

. 2017. U → F “Estimating Moderated Causal Effects with Time-varying Treatments and Time-varying Moderators: Structural Nested Mean Models and Regression with Residuals.” Sociological Methodology 47:212–45.

41.

Wright

Sewall

. 1921. “Correlation and Causation.” Journal of Agricultural Research 20:557–85.

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

1.39 MB

The Future Strikes Back: Using Future Treatments to Detect and Reduce Hidden Bias

Abstract

Keywords

Get full access to this article

References

Supplementary Material