A rapidly growing number of algorithms are available to researchers who apply statistical or machine learning methods to answer social science research questions. The unique advantages and limitations of each algorithm are relatively well known, but it is not possible to know in advance which algorithm is best suited for the particular research question and the data set at hand. Typically, researchers end up choosing, in a largely arbitrary fashion, one or a handful of algorithms. In this article, we present the Super Learner—a powerful new approach to statistical learning that leverages a variety of data-adaptive methods, such as random forests and spline regression, and systematically chooses the one, or a weighted combination of many, that produces the best forecasts. We illustrate the use of the Super Learner by predicting violence among inmates from the 2005 Census of State and Federal Adult Correctional Facilities. Over the past 40 years, mass incarceration has drastically weakened prisons’ capacities to ensure inmate safety, yet we know little about the characteristics of prisons related to inmate victimization. We discuss the value of the Super Learner in social science research and the implications of our findings for understanding prison violence.
BeijersbergenKarin A.DirkzwagerAnja J. E.van der LaanPeter H.NieuwbeertaPaul. 2014. “A Social Building? Prison Architecture and Staff–Prisoner Relationships.” Crime & Delinquency62:843–74.
2.
BerkRichard A.2008. Statistical Learning From a Regression Perspective. New York: Springer.
3.
BerkRichard A.BleichJustin. 2013. “Statistical Procedures for Forecasting Criminal Behavior.” Criminology & Public Policy12:513–44.
4.
BerkRichard A.KrieglerBrianBaekJong-Ho. 2006. “Forecasting Dangerous Inmate Misconduct: An Application of Ensemble Statistical Procedures.” Journal of Quantitative Criminology22:131–45.
5.
BierieDavid M.2012. “Is Tougher Better? The Impact of Physical Prison Conditions on Inmate Violence.” International Journal of Offender Therapy and Comparative Criminology56:338–55.
6.
BottomsAnthony E.1999. “Interpersonal Violence and Social Order in Prisons.” Crime and Justice26:205–81.
BushwayShawn D.2013. “Is there Any Logic to Using Logit.” Criminology & Public Policy12:563–67.
10.
ByrneJ. M.HummerDon. 2008. “Examining the Impact of Institutional Culture On Prison Violence and Disorder: An Evidence-based Review.” Pp. 40–90 in The Culture of Prison Violence, edited by ByrneJ. M.HummerDonTaxmanF. S.. Boston, MA: Pearson.
11.
CampScott D.GaesGerald G.LanganNeal P.SaylorWilliam G.. 2003. “The Influence of Prisons on Inmate Misconduct: A Multilevel Investigation.” Justice Quarterly20:501–33.
12.
ChipmanHugh A.GeorgeEdward I.McCullochRobert E.. 2010. “BART: Bayesian Additive Regression Trees.” The Annals of Applied Statistics4:266–98.
13.
ClearTodd R.1994. Harm in American Penology: Offenders, Victims, and Their Communities. Albany: SUNY Press.
14.
ClearTodd R.FrostNatasha A.. 2013. The Punishment Imperative: The Rise and Failure of Mass Incarceration in America. New York: NYU Press.
15.
CreweBen. 2013. “The Sociology of Imprisonment.” Pp. 123–51 in Handbook on Prisons, edited by JewkesYvonne. New York: Routledge.
16.
FinnPeter. 1996. “No-frills Prisons and Jails: A Movement in Flux.” Federal Probation60:35–44.
17.
FranklinTravis W.FranklinCortney A.PrattTravis C.. 2006. “Examining the Empirical Relationship Between Prison Crowding and Inmate Misconduct: A Meta-analysis of Conflicting Research Results.” Journal of Criminal Justice34:401–12.
18.
FrenchSheila A.GendreauPaul. 2006. “Reducing Prison Misconducts: What Works!” Criminal Justice and Behavior33:185–218.
19.
FreundYoavSchapireRobert E.. 1997. “A Decision-theoretic Generalization of On-line Learning and an Application to Boosting.” Journal of Computer and System Sciences55:119–39.
20.
FriedmanJerome H.1991. “Multivariate Adaptive Regression Splines.” The Annals of Statistics19:1–67.
21.
GaesGerald G.1994. “Prison Crowding Research Reexamined.” The Prison Journal74:329–63.
GlymourM. MariaOsypukTheresa L.RehkopfDavid H.. 2013. “Invited Commentary: Off-roading With Social Epidemiology–Exploration, Causation, Translation.” American Journal of Epidemiology178:858–63.
25.
GonçalvesLeonel C.GonçalvesRui A.MartinsCarlaDirkzwagerAnja J. E.. 2014. “Predicting Infractions and Health Care Utilization in Prison a Meta-analysis.” Criminal Justice and Behavior41:921–41.
26.
GottschalkMarie. 2014. “Democracy and the Carceral State in America.” The ANNALS of the American Academy of Political and Social Science651:288–95.
27.
HamiltonZacharyNeuillyMelanie-AngelaLeeStephenBarnoskiRobert. 2014. “Isolating Modeling Effects in Offender Risk Assessment.” Journal of Experimental Criminology11:299–318.
28.
HaneyCraig. 2006. “The Wages of Prison Overcrowding: Harmful Psychological Consequences and Dysfunctional Correctional Reactions.” Washington University Journal of Law & Policy22:265–93.
29.
HardingRichard. 2001. “Private Prisons.” Crime and Justice28:265–346.
HastieTrevorTibshiraniRobertFriedmanJerome. 2009. The Elements of Statistical Learning: Data Mining, Inference, and Prediction. New York: Springer.
32.
KinlockTimothy W.O’GradyKevin E.HanlonThomas E.. 2003. “The Effects of Drug Treatment on Institutional Behavior.” The Prison Journal83:257–76.
33.
LahmKaren F.2008. “Inmate-on-inmate Assault: A Multilevel Examination of Prison Violence.” Criminal Justice and Behavior35:120–37.
34.
LandenbergerNana A.LipseyMark W.. 2005. “The Positive Effects of Cognitive–Behavioral Programs for Offenders: A Meta-analysis of Factors Associated With Effective Treatment.” Journal of Experimental Criminology1:451–76.
35.
LoganCharles H.1992. “Well Kept: Comparing Quality of Confinement in Private and Public Prisons.” Journal of Criminal Law and Criminology83:577–613.
36.
MacKenzieDoris Layton. 2006. What Works in Corrections: Reducing the Criminal Activities of Offenders and Delinquents. New York: Cambridge University Press.
37.
McCorkleRichard C.MietheTerance D.DrassKriss A.. 1995. “The Roots of Prison Violence: A Test of the Deprivation, Management, and ‘Not-so-total’ Institution Models.” Crime & Delinquency41:317–31.
38.
McFarlandDaniel A.LewisKevinGoldbergAmir. 2016. “Sociology in the Era of Big Data: The Ascent of Forensic Social Science.” The American Sociologist47:12–35.
39.
MorrisRobert G.CarriagaMichael L.DiamondBriePiqueroNicole LeeperPiqueroAlex R.. 2012. “Does Prison Strain Lead to Prison Misbehavior? An Application of General Strain Theory to Inmate Misconduct.” Journal of Criminal Justice40:194–201.
40.
NeugebauerRomainFiremanBruceRoyJason A.RaebelMarsha A.NicholsGregory A.O’ConnorPatrick J.. 2013. “Super Learning to Hedge Against Incorrect Inference from Arbitrary Parametric Assumptions in Marginal Structural Modeling.” Journal of Clinical Epidemiology66: S99–109.
41.
NeugebauerRomainSchmittdielJulie A.van der LaanMark J.. 2014. “Targeted Learning in Real-world Comparative Effectiveness Research with Time-varying Interventions.” Statistics in Medicine33:2480–520.
42.
NgoFawn T.GovinduRamakrishnaAgarwalAnurag. 2015. “Assessing the Predictive Utility of Logistic Regression, Classification and Regression Tree, Chi-squared Automatic Interaction Detection, and Neural Network Models in Predicting Inmate Misconduct.” American Journal of Criminal Justice40:47–74.
43.
PearsonFrank S.LiptonDouglas S.. 1999. “A Meta-analytic Review of the Effectiveness of Corrections-based Treatments for Drug Abuse.” The Prison Journal79:384–410.
44.
PirracchioRomainPetersenMaya L.LaanMark van der. 2015. “Improving Propensity Score Estimators’ Robustness to Model Misspecification Using Super Learner.” American Journal of Epidemiology181:108–19.
45.
RoseSherri. 2013. “Mortality Risk Score Prediction in an Elderly Population Using Machine Learning.” American Journal of Epidemiology177:443–52.
46.
SampsonRobert J.Byron GrovesW.. 1989. “Community Structure and Crime: Testing Social-disorganization Theory.” American Journal of Sociology94:774–802.
47.
SelmanDonnaLeightonPaul. 2010. Punishment for Sale: Private Prisons, Big Business, and the Incarceration Binge. Plymouth, UK: Rowman & Littlefield.
48.
ShawClifford R.McKayHenry D.. 1942. Juvenile Delinquency and Urban Areas. Chicago, IL: University of Chicago Press.
49.
SimonEllen. 1992. “Who’s Minding the Rights of Inmates When Justice Goes to the Lowest Bidder.” Human Rights19:22.
50.
SteinerBenjamin. 2009. “Assessing Static and Dynamic Influences on Inmate Violence Levels.” Crime & Delinquency55:134–61.
51.
SteinerBenjaminDaniel ButlerH.EllisonJared M.. 2014. “Causes and Correlates of Prison Inmate Misconduct: A Systematic Review of the Evidence.” Journal of Criminal Justice42:462–70.
52.
SteinerBenjaminWooldredgeJohn. 2014. “Comparing Self-report to Official Measures of Inmate Misconduct.” Justice Quarterly31:1074–101.
53.
StucklerDavidBasuSanjay. 2013. The Body Economic: Why Austerity Kills. New York: Basic Books.
54.
SykesGresham M.2007. The Society of Captives: A Study of a Maximum Security Prison. Princeton, NJ: Princeton University Press.
55.
TaxmanFaye S.KitsantasPanagiota. 2009. “Availability and Capacity of Substance Abuse Programs in Correctional Settings: A Classification and Regression Tree Analysis.” Drug and Alcohol Dependence103:S43–53.
56.
TibshiraniRobert. 1996. “Regression Shrinkage and Selection via the Lasso.” Journal of the Royal Statistical Society. Series B (Methodological)58:267–88.
57.
van der LaanMark J.DudoitSandrine. 2003. “Unified Cross-validation Methodology for Selection Among Estimators and a General Cross-validated Adaptive Epsilon-net Estimator: Finite Sample Oracle Inequalities and Examples.” UC Berkeley Division of Biostatistics Working Paper SeriesPaper 130. Retrieved fromhttp://biostats.bepress.com/ucbbiostat/paper130
58.
van der LaanMark J.PolleyEric C.HubbardAlan E.. 2007. “Super Learner.” Statistical Applications in Genetics and Molecular Biology6:1–21.
59.
van der LaanMark J.RoseSherri. 2011. Targeted Learning: Causal Inference for Observational and Experimental Data. New York: Springer.
60.
WaltersGlenn D.1998. “Time Series and Correlational Analyses of Inmate-initiated Assaultive Incidents in a Large Correctional System.” International Journal of Offender Therapy and Comparative Criminology42:124–32.
WooldredgeJohnGriffinTimothyPrattTravis. 2001. “Considering Hierarchical Models for Research on Inmate Behavior: Predicting Misconduct With Multilevel Data.” Justice Quarterly18:203–31.
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
