Causal search algorithms have been effectively applied in different fields including biology, genetics, climate science, medicine, and neuroscience. However, there have been scant applications of these methods in social and behavioral sciences. This article provides an illustrative example of how causal search algorithms can shed light on important social and behavioral problems by using these algorithms to find the proximal mechanisms of academic achievement. Using a nationally representative data set with a wide range of relevant contextual and psychological factors, I implement four causal search procedures that varied important dimensions in the algorithms. Consistent with previous research, the algorithms identified prior achievement, executive functions (in particular, working memory, cognitive flexibility, and attentional focusing), and motivation as direct causes of academic achievement. I discuss the advantages and limitations of graphical models in general and causal search algorithms in particular for understanding social and behavioral problems.
AikensN. L.BarbarinO.. 2008. “Socioeconomic Differences in Reading Trajectories: The Contribution of Family, Neighborhood, and School Contexts.” Journal of Educational Psychology100(2):235–51.
2.
AliferisC. F.StatnikovA.TsamardinosI.ManiS.KoutsoukosX. D.. 2010. “Local Causal and Markov Blanket Induction for Causal Discovery and Feature Selection for Classification Part I: Algorithms and Empirical Evaluation.” Journal of Machine Learning Research11:171–234.
3.
AmatoP. R.AnthonyC. J.. 2014. “Estimating the Effects of Parental Divorce and Death with Fixed Effects Models.” Journal of Marriage and Family76(2):370–86.
4.
AndrewsBryanRamseyJosephCooperGregory F.. 2018. “Scoring Bayesian Networks of Mixed Variables.” International Journal of Data Science and Analytics6(1):3–18.
5.
AngristJ. D.PischkeJ. S.. 2008. Mostly Harmless Econometrics: An Empiricist’s Companion. Princeton, NJ: Princeton University Press.
6.
AngristJ. D.PischkeJ. S.. 2010. “The Credibility Revolution in Empirical Economics: How Better Research Design Is Taking the Con Out of Econometrics.” Journal of Economic Perspectives24(2):3–30.
7.
BaileyD. H.WattsT. W.LittlefieldA. K.GearyD. C.. 2014. “State and Trait Effects on Individual Differences in Children’s Mathematical Development.” Psychological Science25(11):2017–26.
8.
BernierA.CarlsonS. M.WhippleN.. 2010. “From External Regulation to Self-regulation: Early Parenting Precursors of Young Children’s Executive Functioning.” Child Development81(1):326–39.
9.
BollenK. A.PearlJ.. 2013. “Eight Myths about Causality and Structural Equation Models.” Pp. 301–28 in Handbook of Causal Analysis for Social Research, edited by MorganS. L.. Dordrecht, the Netherlands: Springer.
10.
BronfenbrennerU.MorrisP. A.. 2006. “The Bioecological Model of Human Development.” Pp. 793–828 in Handbook of Child Development: Vol. 1. Theoretical Models of Human Development, 6th ed, edited by LernerR. M.. Hoboken, NJ: Wiley.
11.
Burdick-WillJ.2013. “School Violent Crime and Academic Achievement in Chicago.” Sociology of Education86(4):343–61.
12.
ChickeringD. M.2002. “Optimal Structure Identification with Greedy Search.” Journal of Machine Learning Research3:507–54.
13.
CollinsA.KoechlinE.. 2012. “Reasoning, Learning, and Creativity: Frontal Lobe Function and Human Decision-making.” PLoS Biology10(3):e1001293.
14.
CookT. D.CampbellD. T.ShadishW.. 2002. Experimental and Quasi-experimental Designs for Generalized Causal Inference. Boston, MA: Houghton Mifflin.
15.
CunhaF.HeckmanJ.. 2007. “The Technology of Skill Formation.” American Economic Review97(2):31–47.
16.
Davis-KeanP. E.2005. “The Influence of Parental Education and Family Income on Child Achievement: The Direct Role of Parental Expectations and the Home Environment.” Journal of Family Psychology19:294–304.
17.
DawidA. P.2008. “Beware of the DAG!” Journal of Machine Learning Research: Workshop and Conference Proceeding6:59–86.
18.
DeatonA.CartwrightN.. 2018. “Understanding and Misunderstanding Randomized Controlled Trials.” Social Science & Medicine210:2–21.
19.
DehaeneS.SpelkeE.PinelP.StanescuR.TsivkinS.. 1999. “Sources of Mathematical Thinking: Behavioral and Brain-imaging Evidence.” Science284(5416):970–74.
20.
DiamondA.2013. “Executive Functions.” Annual Review of Psychology64:135–68.
21.
Diez RouxA. V.2004. “Estimating the Neighborhood Health Effects: The Challenges of Casual Inference in a Complex World.” Epidemiologic Reviews26:104–11.
22.
EberhardtF.2017. “Introduction to the Foundations of Causal Discovery.” International Journal of Data Science and Analytics3(2):81–91.
23.
Ebert-UphoffI.DengY.. 2012. “Causal Discovery for Climate Research Using Graphical Models.” Journal of Climate25(17):5648–65.
24.
ElsterJ.1998. “A Plea for Mechanisms.” Pp. 45–73 in Social Mechanisms: An Analytical Approach to Social Theory, edited by HedstromP.SwedbergR.. Cambridge, England: Cambridge University Press.
25.
ElwertF.2013. “Graphical Causal Models.” Pp. 245–73 in Handbook of Causal Analysis for Social Research, edited by MorganS. L.. New York: Springer.
26.
ElwertF.WinshipC.. 2014. “Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable.” Annual Review of Sociology40:31–53.
27.
EspelageD. L.HoltM.. 2001. “Bullying and Victimization during Early Adolescence: Peer Influences and Psychosocial Correlates.” Journal of Emotional Abuse2:123–42.
28.
FollmerD. J.2018. “Executive Function and Reading Comprehension: A Meta-analytic Review.” Educational Psychologist53(1):42–60.
29.
ForgasJ. P.2008. “Affect and Cognition.” Perspectives on Psychological Science3(2):94–101.
30.
FriedmanJ.HastieT.TibshiraniR.. 2001. The Elements of Statistical Learning. New York: Springer Series in Statistics.
31.
FryerR. G.JrLevittS. D.. 2004. “Understanding the Black-white Test Score Gap in the First Two Years of School.” Review of Economics and Statistics86(2):447–64.
32.
GalindoC.SheldonS. B., 2012. “School and Home Connections and Children’s Kindergarten Achievement Gains: The Mediating Role of Family Involvement.” Early Childhood Research Quarterly27(1):90–103.
33.
GlymourC.ZhangK.SpirtesP.. 2019. “Review of Causal Discovery Methods Based on Graphical Models.” Frontiers in Genetics10:1–15.
34.
GlymourM. M.GreenlandS.. 2008. “Causal Diagrams.” Pp. 183–209 in Modern Epidemiology. 3rd ed. edited by RothmanK. J.GreenlandS.LashT.. Philadelphia, PA: Lippincott.
35.
GrecaA. M.StoneW. L.. 1993. “Social Anxiety Scale for Children—Revised: Factor Structure and Concurrent Validity.” Journal of Clinical Child Psychology22(1):17–27.
36.
GreenlandS.2010. “Overthrowing the Tyranny of Null Hypotheses Hidden in Causal Diagrams.” Pp. 365–82 in Heuristics, Probability and Causality: A Tribute to Judea Pearl, edited by DechterR.GeffnerH.HalpernJ. Y.. London, England: College Publications.
37.
GreshamF. M.ElliottS. N.. 1990. The Social Skills Rating System. Circle Pines, MN: American Guidance Service.
38.
HairN. L.HansonJ. L.WolfeB. L.PollakS. D.. 2015. “Association of Child Poverty, Brain Development, and Academic Achievement.” JAMA Pediatrics169(9): 822–29.
39.
HarteminkA. J. 2001. “Principled Computational Methods for the Validation of and Discovery of Genetic Regulatory Networks.” Unpublished doctoral thesis, MassachusettsInstitute of Technology, Cambridge, MA.
40.
HattieJ.2009. Visible Learning: A Synthesis of over 800 Meta-analyses Relating to Achievement. London, England: Routledge.
41.
HarlaarN.KovasY.DaleP. S.PetrillS. A.PlominR.. 2012. “Mathematics is Differentially Related to Reading Comprehension and Word Decoding: Evidence from a Genetically Sensitive Design.” Journal of educational psychology104(3):622–635.
42.
HeckmanJ. J.2005. “The Scientific Model of Causality.” Sociological Methodology35(1):1–97.
43.
HedströmP.SwedbergR.. 1998. “Social Mechanisms: An Introductory Essay.” Pp. 1–31 in Social Mechanisms: An Analytical Approach to Social Theory, edited by HedströmP.SwedbergR.. Cambridge, England: Cambridge University Press.
44.
HedströmP.YlikoskiP.. 2010. “Causal Mechanisms in the Social Sciences.” Annual Review of Sociology36:49–67.
45.
HernánM. A.Hernández-DíazS.WerlerM. M.MitchellA. A.. 2002. “Causal Knowledge as a Prerequisite for Confounding Evaluation: An Application to Birth Defects Epidemiology.” American Journal of Epidemiology155(2):176–84.
HollandP. W.1986. “Statistics and Causal Inference.” Journal of the American Statistical Association81(396):945–60.
48.
HoxbyC.2000. “Peer Effects in the Classroom: Learning from Gender and Race Variation.” NBER Working Paper No. 7867, National Bureau of Economic Research, Cambridge, MA.
49.
HuangC.2011. “Self-concept and Academic Achievement: A Meta-analysis of Longitudinal Relations.” Journal of School Psychology49:505–28.
50.
HullemanC. S.SchragerS. M.BodmannS. M.HarackiewiczJ. M.. 2010. “A Meta-analytic Review of Achievement Goal Measures: Different Labels for the Same Constructs or Different Constructs with Similar Labels?” Psychological Bulletin136(3):422–49.
51.
ImaiK.KeeleL.TingleyD.YamamotoT.. 2011. “Unpacking the Black Box of Causality: Learning about Causal Mechanisms from Experimental and Observational Studies.” American Political Science Review105:765–89.
52.
JacobR.ParkinsonJ.. 2015. “The Potential for School-based Interventions That Target Executive Function to Improve Academic Achievement: A Review.” Review of Educational Research85(4): 512–52.
53.
JanzingD.ScholkopfB.. 2010. “Causal Inference Using the Algorithmic Markov Condition.” IEEE Transactions on Information Theory56(10):5168–94.
54.
KalischM.BühlmannP.. 2014. “Causal Structure Learning and Inference: A Selective Review.” Quality Technology & Quantitative Management11(1):3–21.
55.
KalischM.FellinghauerB. A.GrillE.MaathuisM. H.MansmannU.BühlmannP.StuckiG.. 2010. “Understanding Human Functioning Using Graphical Models.” BMC Medical Research Methodology10(1):14.
56.
KnightC. R.WinshipC.. 2013. “The Causal Implications of Mechanistic Thinking: Identification using Directed Acyclic Graphs.” Pp. 275–300 in Handbook of Causal Analysis for Social Research, edited by MorganS. L.. New York: Springer.
57.
KoechlinE.SummerfieldC.. 2007. “An Information Theoretical Approach to Prefrontal Executive Function.” Trends in Cognitive Sciences11(6):229–35.
58.
KruglanskiA. W.ShahJ. Y.FishbachA.FriedmanR.ChunW. Y.Sleeth-KepplerD.. 2002. “A Theory of Goal-systems.” Advances in Experimental Social Psychology34:311–78.
59.
KuhnM.JohnsonK.. 2013. Applied Predictive Modeling. New York: Springer.
60.
LazowskiR. A.HullemanC. S.. 2016. “Motivation Interventions in Education: A Meta-analytic Review.” Review of Educational Research86(2):602–40.
61.
LiuH.LaffertyJ.WassermanL.. 2009. “The Nonparanormal: Semiparametric Estimation of High Dimensional Undirected Graphs.” Journal of Machine Learning Research10:2295–28.
62.
LowensteinA. E.Friedman-KraussA.H.RaverC.C.JonesS.M.PessR.A.. 2015. “School Climate, Teacher-child Closeness, and Low-income Children’s Academic Skills in Kindergarten.” Journal of Educational and Developmental Psychology5(2):89–108.
63.
MachamerP.DardenL.CraverC. F.. 2000. “Thinking about Mechanisms.” Philosophy of Science67(1):1–25.
64.
MalinskyD.DanksD.. 2018. “Causal Discovery Algorithms: A Practical Guide.” Philosophy Compass13(1):e12470.
65.
MarshH. W.BarnesJ.CairnsL.TidmanM.. 1984. “Self-description Questionnaire: Age and Sex Effects in the Structure and Level of Self-concept for Preadolescent Children.” Journal of Educational Psychology83:377–92.
66.
MarshH. W.TrautweinU.LüdtkeO.KöllerO.BaumertJ.. 2005. “Academic Self-concept, Interest, Grades, and Standardized Test Scores: Reciprocal Effects Models of Causal Ordering.” Child Development76(2):397–416.
67.
McCandlissB. D.CohenL.DehaeneS.. 2003. “The Visual Word form Area: Expertise for Reading in the Fusiform Gyrus.” Trends in Cognitive Sciences7(7):293–99.
68.
McKownC.2013. “Social Equity Theory and Racial-ethnic Achievement Gaps.” Child Development84(4):1120–36.
69.
MilamA. J.Furr-HoldenC. D. M.LeafP. J.. 2010. “Perceived School and Neighborhood Safety, Neighborhood Violence and Academic Achievement in Urban School Children.” The Urban Review42(5):458–67.
70.
MirandaA.ColomerC.MercaderJ.FernándezM. I.PresentaciónM. J.. 2015. “Performance-based Tests versus Behavioral Ratings in the Assessment of Executive Functioning in Preschoolers: Associations with ADHD Symptoms and Reading Achievement.” Frontiers in Psychology6:545.
71.
MorganS. L.WinshipC.. 2015. Counterfactuals and Causal Inference: Methods and Principles for Social Research. Cambridge, England: Cambridge University Press.
72.
NajarianM.TourangeauK.NordC.Wallner-AllenK.. 2018. “Early Childhood Longitudinal Study, Kindergarten Class of 2010–11 (ECLS-K:2011), First- and Second-grade Psychometric Report (NCES 2018-183).” Washington, DC: National Center for Education Statistics, Institute of Education Sciences, U.S. Department of Education.
73.
NguyenC. D.CarlinJ. B.LeeK. J.. 2017. “Model Checking in Multiple Imputation: An Overview and Case Study.” Emerging Themes in Epidemiology14(1):8.
74.
PearlJ.2009. Causality: Models, Reasoning, and Inference. 2nd ed. New York: Cambridge University Press.
75.
PearlJ.2011. “Invited Commentary: Understanding Bias Amplification.” American Journal of Epidemiology174(11):1223–27.
76.
PearlJ.2019. “The Seven Tools of Causal Inference, with Reflections on Machine Learning.” Communications of the ACM62(3):54–60.
77.
PelletJ. P.ElisseeffA.. 2008. “Using Markov Blankets for Causal Structure Learning.” Journal of Machine Learning Research9:1295–342.
78.
PetersJ.BühlmannP.MeinshausenN.. 2016. “Causal Inference by Using Invariant Prediction: Identification and Confidence Intervals.” Journal of the Royal Statistical Society: Series B (Statistical Methodology)78(5):947–1012.
79.
PfostM.HattieJ.DörflerT.ArteltC.. 2014. “Individual Differences in Reading Development: A Review of 25 Years of Empirical Research on Matthew Effects in Reading.” Review of Educational Research84(2):203–44.
80.
PhelpsE. A.2006. “Emotion and Cognition: Insights from Studies of the Human Amygdala.” Annual Review of Psychology57:27–53.
PimpertonH.NationK.. 2010. “Understanding Words, Understanding Numbers: An Exploration of the Mathematical Profiles of Poor Comprehenders.” British Journal of Educational Psychology80(2):255–268.
83.
RamseyJ. D. 2014. “A Scalable Conditional Independence Test for Nonlinear, Non-Gaussian Data.” arXiv preprint arXiv:1401.5031.
84.
RamseyJ. D.MalinskyD.. 2016. Comparing the Performance of Graphical Structure Learning Algorithms with TETRAD. arXiv preprint arXiv:1607.08110.
85.
RamseyJ. D.GlymourM.Sanchez-RomeroR.GlymourC.. 2017. “A Million Variables and More: The Fast Greedy Equivalence Search Algorithm for Learning High-dimensional Graphical Causal Models, with an Application to Functional Magnetic Resonance Images.” International Journal of Data Science and Analytics3(2):121–29.
86.
RamseyJ. D.Sanchez-RomeroR.GlymourC.. 2014. “Non-Gaussian Methods and High-pass Filters in the Estimation of Effective Connections.” Neuroimage84:986–1006.
87.
RubinD. B.1974. “Estimating Causal Effects of Treatments in Randomized and Nonrandomized Studies.” Journal of Educational Psychology66(5):688.
88.
RutterM.2007. “Proceeding from Observed Correlation to Causal Inference: The Use of Natural Experiments.” Perspectives on Psychological Science2(4):377–95.
Sanchez-RomeroR.RamseyJ. D.ZhangK.GlymourM. R.HuangB.GlymourC.. 2019. “Estimating Feedforward and Feedback Effective Connections from fMRI Time Series: Assessments of Statistical Methods.” Network Neuroscience3(2):274–306.
92.
ScheinesR.1997. “An Introduction to Causal Inference.” Pp. 185–99 in Causality in Crisis? Statistical Methods and the Search for Causal Knowledge in the Social Sciences, edited by McKimV. R.TurnerS. P.. Notre Dame, IN: Notre Dame University Press.
93.
SimondsJ.RothbartM. K.. 2004. “The Temperament in Middle Childhood Questionnaire (TMCQ): A Computerized Self-report Measure of Temperament for Ages 7–10.” Poster Session Presented at the Occasional Temperament Conference, Athens, GA.
SmithersL. G.SawyerA. C.ChittleboroughC. R.DaviesN. M.SmithG. D.LynchJ. W.. 2018. “A Systematic Review and Meta-analysis of Effects of Early Life Non-cognitive Skills on Academic, Psychosocial, Cognitive and Health Outcomes.” Nature Human Behaviour2(11):867–80.
96.
SpirtesP.2010. “Introduction to Causal Inference.” Journal of Machine Learning Research11:1643–62.
97.
SpirtesP.GlymourC. N.ScheinesR.HeckermanD.MeekC.CooperG.RichardsonT.. 2000. Causation, Prediction, and Search. Cambridge: MIT Press.
98.
SpirtesP.MeekC.RichardsonT. S.. 1995. “Causal Inference in the Presence of Latent Variables and Selection Bias.” Pp. 296-305 inProceedings of the Eleventh Conference on Uncertainty in Artificial Intelligence, edited by BesnardP.HanksS.. San Francisco: Morgan Kaufmann.
99.
SpirtesP.ScheinesR.. 2004. “Causal Inference of Ambiguous Manipulations.” Philosophy of Science71(5):833–45.
100.
SpirtesP.ZhangK.. .2016. “Causal Discovery and Inference: Concepts and Recent Methodological Advances.” Applied Informatics3:1–28.
101.
StanovichK. E.1986. “Matthew Effects in Reading: Some Consequences of Individual Differences in the Acquisition of Literacy.” Reading Research Quarterly21:360–407.
102.
SusperreguyM. I.Davis-KeanP. E.DuckworthK.ChenM.. 2018. “Self-concept Predicts Academic Achievement across Levels of the Achievement Distribution: Domain Specificity for Math and Reading.” Child Development89(6):2196–14.
103.
TourangeauK.NordC.LêT.Wallner-AllenK.Vaden-KiernanN.BlakerL.NajarianM.. 2017. “Early Childhood Longitudinal Study, Kindergarten Class of 2010–11 (ECLS-K:2011) User’s Manual for the ECLS-K:2011 Kindergarten—Second Grade Data File and Electronic Codebook, Public Version (NCES 2017-285).” Washington, DC: U.S. Department of Education, National Center for Education Statistics.
104.
van LierP. A.VitaroF.BarkerE. D.BrendgenM.TremblayR. E.BoivinM.. 2012. “Peer Victimization, Poor Academic Achievement, and the Link between Childhood Externalizing and Internalizing Problems.” Child Development83(5):1775–88.
105.
VanderWeeleT. J.2015. Explanation in Causal Inference. New York: Oxford University Press.
106.
VanderWeeleT. J.ShpitserI.. 2011. “A New Criterion for Confounder Selection.” Biometrics67(4):1406–13.
107.
VerdugoR. A.ZellerT.RotivalM.WildP. S.MünzelT.LacknerK. J.WeidmannH.NinioE.TrégouëtD. A.CambienF.BlankenbergS.TiretS.. 2013. “Graphical Modeling of Gene Expression in Monocytes Suggests Molecular Mechanisms Explaining Increased Atherosclerosis in Smokers.” PLoS ONE8:e50888.
108.
WattsT. W.DuncanG. J.ChenM.ClaessensA.Davis-KeanP. E.DuckworthK.EngelM.SieglerR.SusperreguyM. I.. 2015. “The Role of Mediators in the Development of Longitudinal Mathematics Achievement Associations.” Child Development86(6):1892–907.
109.
WodtkeG. T.HardingD. J.ElwertF.. 2011. “Neighborhood Effects in Temporal Perspective: The Impact of Long-term Exposure to Concentrated Disadvantage on High School Graduation.” American Sociological Review76(5):713–36.
110.
WoodcockR.McGrewK.MatherN.. 2001. Woodcock–Johnson III. Itasca, IL: Riverside.
111.
WoodwardJ.2002. “What Is a Mechanism? A Counterfactual Account.” Philosophy of Science69(S3):S366–77.
112.
WoodwardJ. 2016. “The Problem of Variable Choice.” Synthese193(4):1047–72.
113.
ZelazoP. D.2006. “The Dimensional Change Card Sort (DCCS): A Method of Assessing Executive Function in Children.” Nature Protocols1(1):297–301.
114.
ZhangK.GongM.RamseyJ.BatmanghelichK.SpirtesP.GlymourC.. 2017. “Causal Discovery in the Presence of Measurement Error: Identifiability Conditions.” Paper presented at the UAI 2017 Workshop on Causality, August 11–15, Sydney, Australia.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
