Restricted accessResearch articleFirst published online 2018-4
The Validity of the Cracow Instrument in the Prediction of Antisocial Development in Preschool Children: A Five-Year Longitudinal Community-Based Study
Risk-focused early intervention is a very promising approach for preventing antisocial development in childhood and youth. Therefore, at a NATO Advanced Study Institute the Cracow Instrument was developed (Corrado, 2002). The Cracow Instrument is a developmentally based risk management instrument designed to identify children and youth at-risk for serious and violent antisocial behavior. The current study examines the prospective validity of the Cracow Instrument utilizing the Erlangen-Nuremberg Development and Prevention Study (e.g., Lösel, Stemmler, & Bender, 2013). At the first assessment, the community sample contained 675 male and female children at preschool age (M = 4.7 years). For example, for a broad scale on externalizing problems the predictive validity was r = .52 (AUC = .78) after one year and r = .42 (AUC = .75) after five years. Overall, the predictive validity of the Cracow Instrument was satisfactory. Implications for its practical application in risk management are discussed.
Get full access to this article
View all access options for this article.
References
1.
AchenbachT. M. (2006). As others see us: Clinical and research implications of crossinformant correlations for psychopathology. Current Directions in Psychological Science, 15, 94–98. doi:10.1111/j.0963-7214.2006.00414
2.
ÆgisdóttirS.WhiteM. J.SpenglerP. M.MaughermanA. S.AndersonL. A.CookR. S.RushJ. D. (2006). The Meta-Analysis of Clinical Judgment Project: Fifty-Six Years of Accumulated Research on Clinical versus Statistical Prediction. The Counseling Psychologist, 34(3), 341–382. doi:10.1177/0011000005285875
3.
AndershedH.AndershedA.-K. (2010). Risk-need assessment for youth with or at risk for conduct problems: Introducing the assessment system ESTER. Procedia Social and Behavioral Sciences, 5, 377–383. doi:10.1016/j.sbspro.2010.07.108
4.
AugimeriL. K.EnebrinkP.WalshM.JiangD. (2010). Gender-specific childhood risk assessment tools. In OttoR. K.DouglasK. S. (eds.), Handbook of violence risk assessment (pp. 43–62). NY: Routledge.
5.
AugimeriL. K.KoeglC. J.WebsterC. D.LeveneK. S. (2001). Early Assessment Risk List for Boys: EARL-20B (Version 2). Toronto: Earlscourt Child and Family Centre.
6.
BeelmannA.LöselF.StemmlerM.JaurschS. (2006). Beurteilung von sozialen erhaltensproblemen und Erziehungsschwierigkeiten im Vorschulalter: Eine Untersuchung zur deutschen Adaptation des Eyberg Child Behavior Inventory (ECBI). Diagnostica, 52(4), 189–198. doi:10.1026/0012-1924.52.4.189
7.
BennettK. J.OffordD. R. (2001). Screening for conduct problems: Does the predictive accuracy of conduct disorders improve with age?Journal of the American Academy of Child and Adolescent Psychiatry, 40, 1418–1425. doi:10.1097/00004583-200112000-00012
8.
BeuhringT. (2002). The Risk Factor Profile Instrument: Identifying children at risk for serious and violent delinquency. In CorradoR. R.RoeschR.HartS. D.GierowskiJ. K. (eds.), Multi-problem violent youth: A foundation for comparative research on needs, interventions, and outcomes (pp. 191–206). Amsterdam: IOS Press.
9.
BontaJ.AndrewsD. (2010). Viewing offender assessment and rehabilitation through the lens of the risk-need-responsivity model. In McNeillF.RaynorP.TrotterC. (eds.), Offender supervision: New directions in theory, research and practice (pp. 19–40). New York: Routledge.
10.
BurgessE. W. (1968). Factors making for success or failure on parole. In BruceA. A.HarnoA. J.BurgessE. W.LandescoJ. (eds.), The workings of the Indeterminate-Sentence Law and the parole system in Illinois (pp. 221–234). Montclair, NJ: Patterson Smith.
11.
CohenJ. (1988). Statistical power analysis for the behavioral sciences. New York: Academic Press.
12.
CohenM. A.PiqueroA. R. (2009). New evidence on the monetary value of saving a high risk youth. Journal of Quantitative Criminology, 25, 25–49. doi:10.1007/s10940-008-9057-3
13.
CookeD. J.MichieC. (2010). Limitations of diagnostic precision and predictive utility in the individual case: A challenge for forensic practice. Law and Human Behavior, 34, 259–274. doi:10.1007/s10979-009-9176-x
14.
CookeD.MichieC.De BritoS. A.HodginsS.SparkesL. (2011). Measuring life-long patterns of instrumental aggression: A methodological note. Psychology, Crime & Law, 17, 319–329. doi:10.1080/10683160903203953
15.
CooperH.HedgesL. V. (1994). The handbook of research synthesis. New York: Russell Sage Foundation.
16.
CorradoR. R. (2002). An introduction to the risk/needs case management instrument for children at risk for violence. In CorradoR. R.RoeschR.HartS. D.GierowskiJ. K. (eds.), Multi-problem violent youth: A foundation for comparative research on needs, interventions and outcomes (pp. 295–301). Amsterdam: IOS Press.
17.
CorradoR. R. (2012). Comprehensive risk management instruments for serious and violent young offenders. Challenges and advantages. In BliesenerT.BeelmannA.StemmlerM. (eds.). Antisocial behavior and crime: Contributions of developmental and evaluation research to prevention and intervention (pp. 239–260). Göttingen, Germany: Hogrefe.
18.
DawesR. M.FaustD.MeehlP. E. (1989). Clinical versus actuarial judgement. Science, 243, 1668–1674. doi:10.1126/science.2648573
19.
DöpfnerM.BernerW.FleischmannT.SchmidtM. H. (1993). Verhaltensbeurteilungsbogen für Vorschulkinder (VBV). Weinheim: Beltz.
20.
DolanM.DoyleM. (2000). Violence risk prediction: Clinical and actuarial measures and the role of the Psychopathy Checklist. British Journal of Psychiatry, 177, 303–311. doi:10.1192/bjp.177.4.303
21.
DonkerA. (2004). Individual stability of antisocial behavior from childhood to adulthood: Testing the stability postulate of Moffitt's developmental theory. In DonkerA.Precursors and prevalence of young-adult and adult delinquency (pp. 73–89). Dissertation. Amsterdam: The Netherlands Institute for the Study of Crime and Law Enforcement (NSCR).
22.
EnebrinkP. (2005). Antisocial behavior in clinically referred boys: Early identification and assessment procedures in child psychiatry. Stockholm: Karolinska University Press.
23.
EnebrinkP.LångströmN.GumpertC. H. (2006). Predicting aggressive and disruptive behavior in referred 6- to 12-year-old boys: Prospective validation of the EARL-20B Risk/Needs Checklist. Assessment, 13, 356–367. doi:10.1177/1073191106290649
24.
EpsteinS. (1983). Aggregation and beyond: Some basic issues on the prediction of behavior. Journal of Personality, 51, 360–392. doi:10.1111/j.1467-6494.1983.tb00338.x
25.
FarringtonD. P.OhlinL. E.WilsonJ. Q. (1986). Understanding and controlling crime: Toward a new research strategy. New York: Springer.
26.
FarringtonD. P.PiqueroA. R.JenningsW. G. (2013). Offending from childhood to late middle age: Recent results from the Cambridge Study in Delinquent Development. New York: Springer.
27.
FarringtonD. P.WelshB. C. (2007). Saving children from a life of crime: Early risk factors and effective interventions. Oxford: Oxford University Press.
28.
GavazziS.YarcheckC. M.Chesney-LindM. (2006). Global risk indicators and the role of gender in a juvenile detention sample. Criminal Justice and Behavior, 33, 597–612. doi:10.1177/0093854806288184
29.
GeißlerR. (ed.) (1994). Soziale Schichtung und Lebenschancen in Deutschland. Stuttgart: Enke.
30.
GlueckS.GlueckE. (1950). Unraveling juvenile delinquency. New York: Commonwealth Fund.
31.
GlueckS.GlueckE. (1964). Ventures in criminology. Cambridge, MA: Harvard University Press.
32.
Gorman-SmithD.LoeberR. (2005). Are Developmental Pathways in Disruptive Behaviors the Same for Girls and Boys?Journal of Child and Family Studies, 14(1), 15–27. doi:10.1007/s10826-005-1109-9
33.
GrissoT.AppelbaumP. S. (1993). Structuring the debate about ethical predictions of future violence. Law and Human Behavior, 17, 482–485. doi:10.1007/BF01044381
34.
GroveW. M.MeehlP. E. (1996). Comparative efficiency of informal (subjective, impressionistic) and formal (mechanical, algorithmic) prediction procedures: The clinical-statistical controversy. Psychology, Public Policy, and Law, 2, 293–323. doi:10.1037/1076-8971.2.2.293
35.
HahlwegK. (1996). Fragebogen zur Partnerschaftsdiagnostik. Diagnostica, 44, 113–115.
36.
HahnR.Fuqua-WhitleyD.WethingtonH.LowyJ.CrosbyA.FulliloveM.Task Force on Community Preventive Services. (2007). Effectiveness of universal school-based programs to prevent violent and aggressive behavior: A systematic review. American Journal of Preventive Medicine, 33, 114–129. doi:10.1016/j.amepre.2007.04.012
37.
HansonR. K.HowardP. D. (2010). Individual confidence intervals do not inform decision-makers about the accuracy of risk assessment evaluations. Law and Human Behavior, 34(4), 275–281. doi:10.1007/s10979-010-9227-3
38.
HawkinsJ. D.HerrenkohlT.FarringtonD. P.BrewerD.CatalanoR. F.HarachiT. W. (1998). A review of predictors of youth violence. In LoeberR.FarringtonD. P. (eds.), Serious and violent juvenile offenders: Risk factors and successful interventions (pp. 106–146). CA: Sage.
39.
HeilbrunK.YasuharaK.ShahS. (2010). Violence risk assessment tools: Overview and critical analysis. In OttoR. K.DouglasK. S. (eds.), Handbook of violence risk assessment (pp. 1–17). New York: Routledge.
40.
HowellJ. C. (2001). Risk/needs assessment and screening devices. In LoeberR.FarringtonD. P. (eds.), Child delinquents: Development, intervention, and service needs (pp. 395–404). CA: Sage.
41.
JenningsW. G.ReingleJ. M. (2012). On the number and shape of developmental/life-course violence, aggression, and delinquency trajectories: A state-of-the-art review. Journal of Criminal Justice, 40, 472–489. doi:10.1016/j.jcrimjus.2012.07.001
42.
JohnstonC.MashE. J. (1989). A measure of parenting satisfaction and efficacy. Journal of Clinical Child Psychology, 18, 167–175. doi:10.1207/s15374424jccp1802_8
43.
KoeglC. J. (2010). Calculation of the long-term medical, mental health and criminal justice system costs associated with early childhood conduct disorder in an Ontario sample children: Structures clinical risk assessment through the Early Assessment Risk List for Boys and Girls. Final outcomes report. Graduate Award GA-272: Submitted to the Centre of Excellence in Child and Youth Mental Health at CHEO.
44.
KoehlerJ. A.LöselF.AkoensiT. D.HumphreysD. K. (2013). A systematic review and meta-analysis on the effects of young offender treatment programs in Europe. Journal of Experimental Criminology, 9, 19–43. doi:10.1007/s11292-012-9159-7
45.
Le BlancM. (1998). Screening of serious and violent juvenile offenders: Identification, classification and prediction. In LoeberR.FarringtonD. P. (eds.), Serious and violent juvenile offenders: Risk factors and successful interventions (pp. 167–193). CA: Sage.
46.
Le BlancM. (2002). Review of clinical assessment strategies and instruments for adolescent offenders. In CorradoR. R.RoeschR.HartS. D.GierowskiJ. K. (eds.), Multi-problem violent youth: A foundation for comparative research on needs, interventions and outcomes (pp. 171–190). Amsterdam: IOS Press.
47.
LipseyM. W.DerzonJ. H. (1998). Predictors of violent or serious delinquency in adolescence and early adulthood: A synthesis of longitudinal research. In LoeberR.FarringtonD. P. (eds.), Serious and violent juvenile offenders: Risk factors and successful interventions (pp. 167–193). CA: Sage.
48.
LoeberR.FarringtonD. P. (1998). Executive Summary. In LoeberR.FarringtonD. P. (eds.), Serious and violent juvenile offenders: Risk factors and successful interventions (pp. XIX–XXV). CA: Sage.
49.
LoeberR.FarringtonD. P. (2001a). Executive Summary. In LoeberR.FarringtonD. P. (eds.), Child delinquents: Development, intervention, and service needs (pp. XIX–XXXII). CA: Sage.
50.
LoeberR.FarringtonD. P. (2001b). The significance of child delinquency. In LoeberR.FarringtonD. P. (eds.), Child delinquents: Development, intervention, and service needs (pp. 1–22). CA: Sage.
51.
LoevingerJ. (1954). The attenuation paradox in test theory. Psychological Bulletin, 51(5), 493–504. doi:10.1037/h0058543
52.
LöselF. (1975). Handlungskontrolle und Jugenddelinquenz. Stuttgart: Enke.
53.
LöselF. (2002). Risk/need assessment and prevention of antisocial development in young people: Basic issues from a perspective of cautionary optimism. In CorradoR. R.RoeschR.HartS. D.GierowskiJ. K. (eds.), Multi-problem violent youth: A foundation for comparative research on needs, interventions and outcomes (pp. 35–57). Amsterdam: IOS Press.
54.
LöselF.BeelmannA.JaurschS.KoglinU.StemmlerM. (2005). Entwicklung und Prävention früher Probleme des Sozialverhaltens: Die Erlangen-Nürnberger Studie. In CierpkaM.VogelK. (eds.), Maßnahmen gegen Gewalt: Unterbrechung der Gewaltspirale (pp. 200–228). Göttingen: Vandenhoeck & Ruprecht.
55.
LöselF.BeelmannA.StemmlerM. (2002). Skalen zur Messung sozialen Problemverhaltens bei Vorschul- und Grundschulkindern. Die deutschen Versionen des Eyberg Child Behavior Inventory (ECBI) und des Social Behavior Questionnaire (SBQ). Erlangen: Universität Erlangen-Nürnberg, Institut für Psychologie.
56.
LöselF.BenderD. (2003). Resilience and protective factors. In FarringtonD.CoidJ. (eds.), Early prevention of adult antisocial behaviour (pp. 130–204). New York: Cambridge University Press.
57.
LöselF.BenderD. (2006). Risk factors for serious and violent antisocial behaviour in children and youth. In HagellA.Jeyarajah-DentR. (eds.), Children who commit acts of serious interpersonal violence: Messages for practice (pp. 42–72). London: Jessica Kingsley Publishers.
58.
LöselF.BenderD. (2012). Child social skills training in the prevention of antisocial development and crime. In FarringtonD. P.WelshB. C. (eds.), The Oxford handbook of crime prevention (pp. 102–129). Oxford: Oxford University Press.
59.
LöselF.BenderD. (2014). Aggressive, delinquent and violent outcomes of school bullying: Do family and individual factors have a protective function?Journal of School Violence, 13, 59–79. doi:10.1080/15388220.2013.840644
60.
LöselF.FarringtonD. P. (2012). Direct protective and buffering protective factors in the development of youth violence. American Journal of Preventive Medicine, 43(2S1), 8–23. doi:10.1016/j.amepre.2012.04.029
61.
LöselF.HackerS.JaurschS.StemmlerM.WallnerS. (2006). Skalen zur Messung sozialen Problemverhaltens bei Vorschul- und Grundschulkindern. Die Deutschen Versionen des Social Behavior Questionnaire (SBQ) für Erzieherinnen und Lehrer. Erlangen: Universität Erlangen-Nürnberg, Institut für Psychologie.
62.
LöselF.StemmlerM. (2012a). Continuity and patterns of externalizing and internalizing behavior problems in girls: A variable- and person-oriented study from preschool to youth age. Psychological Tests and Assessment Modeling, 54, 308–319.
63.
LöselF.StemmlerM. (2012b). Preventing child behavior problems in the Erlangen-Nuremberg Development and Prevention Study: Results from preschool to secondary school age. International Journal of Conflict and Violence, 6, 214–224.
64.
LöselF.StemmlerM.BenderD. (2013). Long-term evaluation of a bimodal universal prevention program: Effects on antisocial development from kindergarten to adolescence. Journal of Experimental Criminology, 9, 429–449. doi:10.1007/s11292-013-9192-1
65.
LöselF.WallnerS.JaurschS.StemmlerM. (2007). Das Cracow Risk Assessment Instrument zur Prognose von Dissozialität: Die deutsche Fassung der kanadischen Originalversion von Corrado et al. Erlangen: Universität Erlangen-Nürnberg, Institut für Psychologie.
66.
LussierP.CorradoR.HealeyJ.TzoumakisS.Deslauriers-VarinN. (2011). The Cracow instrument for multi-problem violent youth: Examining the postdictive validity with a sample of preschoolers. International Journal of Child, Youth and Family Studies, 2, 294–329. doi:10.18357/ijcyfs22.120117709
67.
LynamD. R. (1996). Early identification of chronic offenders: Who is the fledgling psychopath?Psychological Bulletin, 120, 209–234. doi:10.1037/0033-2909.120.2.209
68.
MelchersP.PreußU. (1991). Kaufman-Assessment-Battery for Children (K-ABC). Deutsche Version. Amsterdam: Swets & Zeitlinger.
69.
MoffittT. E.CaspiA.RutterM.SilvaP. A. (2001). Sex differences in antisocial behaviour: Conduct disorder, delinquency, and violence in the Dunedin Longitudinal Study. Cambridge: Cambridge University Press.
70.
MonahanJ. (1984). The prediction of violent behavior: Toward a second generation of theory and policy. American Journal of Psychiatry, 141, 10–15. doi:10.1176/ajp.141.1.10
71.
MonahanJ. (1989). Prediction of criminal behavior: Recent developments in research and policy in the United States. In WegenerH.LöselF.HaischJ. (eds.), Criminal behavior and the justice system: Psychological perspectives (pp. 40–52). New York: Springer.
72.
MorettiM.OdgersC. (2002). Aggressive and violent girls: Prevalence, profiles and contributing factors. In CorradoR. R.RoeschR.HartS. D.GierowskiJ. K. (eds.), Multi-problem violent youth: A foundation for comparative research on needs, interventions and outcomes (pp. 116–129). Amsterdam: IOS Press.
73.
MurrayJ.IrvingB.FarringtonD. P.ColmanI.BloxsomC. A. J. (2010). Very early predictors of conduct problems and crime: Results from a national cohort study. Journal of Child Psychology and Psychiatry, 51(11), 1198–1207. doi:10.1111/j.1469-7610.2010.02287.x
74.
OdgersC.VincentG. M.CorradoR. R. (2002). A preliminary conceptual framework for the prevention and management of multi-problem youth. In CorradoR. R.RoeschR.HartS. D.GierowskiJ. K. (eds.), Multi-problem violent youth: A foundation for comparative research on needs, interventions and outcomes (pp. 302–329). Amsterdam: IOS Press.
75.
PiqueroA. R.FarringtonD. P.BlumsteinA. (2007). Key issues in criminal career research. Cambridge: Cambridge University Press.
76.
QuinseyV. L. (1995). The prediction and explanation of criminal violence. International Journal of Law and Psychiatry, 18, 117–127. doi:10.1016/0160-2527(95)00001-X
77.
RutterM. (2012). Resilience as a dynamic concept. Development and Psychopathology, 24, 335–344. doi:10.1017/S0954579412000028
78.
RyderJ. A.GordonC.BulgerJ. (2009). Contextualizing girls' violence: Assessment and treatment decisions. In AndradeJ. T. (ed.), Handbook of Violence Risk Assessment and Treatment: New Approaches for Mental Health Professionals (pp. 449–493). NY: Springer Publishing Company.
79.
SampsonR. J.LaubJ. H. (1993). Crime in the making: Pathways and turning points through life. Cambridge, MA: Harvard University Press.
80.
SarasonI. G.JohnsonJ. H.SiegelJ. M. (1978). Assessing the impact of life changes: Development of the Life Experiences Survey. Journal of Consulting and Clinical Psychology, 46(2), 932–946. doi:10.1037/0022-006X.46.5.932
81.
SawyerJ. (1966). Measurement and prediction, clinical and statistical. Psychological Bulletin, 66(3), 178–200. doi:10.1037/h0023624
82.
SheltonK. K.FrickP. J.WoottonJ. (1996). Assessment of parenting practices in families of elementary school-age children. Journal of Clinical Child Psychology, 25(3), 317–329. doi:10.1207/s15374424jccp2503_8
83.
ShepardS. M.LuebbersS.DolanM. (2013). Identifying gender differences in an Australian youth offender population. SAGE Open, 2013(3), 1–12. doi:10.1177/2158244013492082.
84.
SilverthorneP.FrickP. J. (1999). Developmental pathways to antisocial behaviour: The delayed-onset pathway in girls. Development and Psychopathology, 11, 101–126. doi:10.1017/S0954579499001972
85.
SinghJ. P.GrannM.FazelS. (2011). A comparative study of violence risk assessment tools: A systematic review and metaregression analysis of 68 studies involving 25,980 participants. Clinical Psychology Review, 31(3), 499–513. doi:10.1016/j.cpr.2010.11.009
86.
SommerG.FydrichT. (1991). Entwicklung und Überprüfung eines Fragebogens zur sozialen Unterstützung (F-SOZU). Diagnostica, 37, 160–178.
87.
SwetsJ. A.DawesR. M.MonahanJ. (2000). Psychological science can improve diagnostic decisions. Psychological Science in the Public Interest, 1(1), 1–26. doi:10.1111/1529-1006.001
88.
TiffinP. A.NadkarniJ. M. (2010). Evaluating violence risk in young people. In BrownJ. M.CampbellE. A. (eds.), The Cambridge handbook of forensic psychology (pp. 166–176). Cambridge: University Press.
89.
TiffinP. A.RichardsonG. (2006). The use of structured instruments in the assessment of violence risk. In HagellA.Jeyarajah-DentR. (eds.), Children who commit acts of serious interpersonal violence: Messages for practice (pp. 205–210). London: Jessica Kingsley Publishers.
90.
TremblayR. E. (2000). The development of aggressive behavior during childhood: What have we learned in the past century?International Journal of Behavioral Development, 24, 129–141. doi:10.1080/016502500383232
91.
TremblayR. E.VitaroF.GagnonC.PichéC.RoyerN. (1992). A prosocial scale for the Preschool Behavior Questionnaire: Concurrent and predictive correlates. International Journal of Behavioral Development, 15, 227–245. doi:10.1177/016502549201500204
VincentG.M.TerryA.M.ManeyS.M. (2009). Risk/needs tools for antisocial behavior and violence among youthful populations. In AndradeJ. T. (ed.), Handbook of Violence Risk Assessment and Treatment: New Approaches for Mental Health Professionals (pp. 377–424). NY: Springer.
94.
WallnerS. (2007). Die Prognose von Dissozialität mit dem Cracow Risk Assessment Instrument. Dissertation. Erlangen: Universität Erlangen-Nürnberg, Institut für Psychologie.
95.
WebsterC. D.AugimeriL. K.KoeglC. J. (2002). The Under 12 Outreach Project for antisocial boys: A research based clinical program. In CorradoR. R.RoeschR.HartS. D.GierowskiJ. K. (eds.), Multi-problem violent youth: A foundation for comparative research on needs, interventions, and outcomes (pp. 207–218). Amsterdam: IOS Press.
96.
WernerE. E.SmithR. S. (2001). Journeys from childhood to midlife: Risk, resilience, and recovery. Ithaca, NY: Cornell University Press.
97.
WetzelsP.GreveW.MecklenburgE.BilskyW.PfeifferC. (1995). Kriminalität im Leben alter Menschen. Stuttgart: Kohlhammer.
98.
WolfgangM.FiglioR. M.SellinT. (1972). Delinquency in a Birth Cohort. Chicago: University of Chicago Press.
99.
YangM.WongS.CoidJ. (2010). The efficacy of violence prediction: A meta-analytic comparison of nine risk assessment tools. Psychological Bulletin, 136, 740–767. doi:10.1037/a0020473
