Abstract
Empirical support for the usage of the SAVRY has been reported in studies conducted in many Western contexts, but not in a Singaporean context. This study compared the predictive validity of the SAVRY ratings for violent and general recidivism against the Youth Level of Service/Case Management Inventory (YLS/CMI) ratings within the Singaporean context. Using a sample of 165 male young offenders (
Youth violence leads to large costs to victims and government. The estimated cost of homicides and assault-related injuries among youth in the United States is $16.2 billion—in terms of lifetime combined medical and work loss costs (Centers for Disease Control and Prevention, 2015). Considering the high stakes to the youth and also to public safety, accurate and comprehensive risk assessment procedures play a critical part in the juvenile justice system. Specifically, risk assessment procedures assist in identifying the level of intervention needs for each offender and making decisions regarding placements, supervision levels, case management planning, and treatment, with the ultimate aim of preventing future reoffending (Andrews & Bonta, 2010; Lodewijks, Doreleijers, & de Ruiter, 2008).
Assessing Risk of Violent and General Recidivism in Youth Offenders
Research studies have shown that structured risk assessment methods (i.e., actuarial and structured clinical judgment approaches) are not only more accurate than unstructured clinical judgment, but they are also preferred because of their increased transparency and reliability (see Heilbrun, Yasuhara, & Shah, 2010, for a review). Although it is efficient, highly flexible, and allows clinicians to focus on case-specific information and violence prevention, unstructured clinical judgment has been criticized for being subjective, unreliable, poorly validated, and unable to detail the decision-making process (Monahan & Steadman, 1994; Quinsey, Harris, Rice, & Cormier, 2006; Webster, Douglas, Eaves, & Hart, 1997). However, purely actuarial and structured clinical judgment approaches have been found to be moderately predictive of violence (Ægisdóttir et al., 2006; de Vogel, de Ruiter, van Beek, & Mead, 2004; Singh, Grann, & Fazel, 2011).
In the area of youth risk assessment, the Structured Assessment of Violence Risk in Youth (SAVRY; Borum, Bartel, & Forth, 2002, 2006) is a widely used structured risk assessment measure for assessing a youth offender’s risk of violent recidivism. Comprising risk factors that assess historical, social/contextual, and individual/clinical domains, the SAVRY also contains protective factors. In particular, the historical risk factors are commonly viewed as static risk factors that are not amenable to change through planned intervention over time. Hence, these static factors are unlikely to be ameliorated for purpose of managing or reducing the risk of future offending over time (Douglas & Skeem, 2005). However, the social/contextual, individual/clinical, and protective factors can be considered dynamic risk factors for reoffending, which can be changed as a result of deliberate intervention (Webster, Douglas, Belfrage, & Link, 2000), and hence reducing the overall level of risk for future offending. Concomitantly, the Youth Level of Service/Case Management Inventory (YLS/CMI; Hoge & Andrews, 2002, 2011) represents one of the most widely used, structured risk assessment measures for assessing the risk of general recidivism and criminogenic needs in youth offenders. Similar to the SAVRY, the YLS/CMI is composed of static and dynamic risk factors that are associated with reoffending.
Some empirical support for the usage of the SAVRY have been reported in studies conducted in the many Western jurisdictions, which include the United States (e.g., McGowan, Horn, & Mellott, 2011; Area Under Curve [AUC]Violence = .72), 1 the United Kingdom (e.g., Dolan & Rennie, 2008; AUCGR = .69, AUCVR = .64), 2 Canada (e.g., Schmidt, Campbell, & Houlding, 2011; AUCVR = .57 − .78, AUCNVR = .63 − .78), 3 the Netherlands (e.g., Lodewijks, Doreleijers, & de Ruiter, 2008; AUCVR = .65 − .76), Finland (e.g., Gammelgård, Koivisto, Eronen, & Kaltiala-Heino, 2008; AUCViolence = .55 − .84), Spain (e.g., Hilterman, Nicholls, & van Nieuwenhuizen, 2014; AUCGR = .70 − .71, AUCVR = .68 − .75), and Australia (e.g., Shepherd, Luebbers, Ferguson, Ogloff, & Dolan, 2014; AUCGR = .49 − .81, AUCVR = .47 − .76). Currently, there is no published study on the predictive validity of SAVRY risk and protective factor ratings for recidivism in an Asian context.
In comparison, there is a large body of empirical evidence that supports the usage of YLS/CMI across Western and Asian contexts. In particular, these studies have been conducted in the United States (e.g., Onifade et al., 2008; AUCGR = .62), the United Kingdom (e.g., Marshall, Egan, English, & Jones, 2006; AUCViolence = .73 − .75, AUCNo of Charges = .73), Canada (e.g., Schmidt et al., 2011; AUCVR = .58 − .65, AUCNVR = .53 − .73), Spain (e.g., Hilterman et al., 2014; AUCGR = .67 − .71, AUCVR = .69 − .73), Australia (e.g., McGrath & Thompson, 2012; AUCGR = .65), Japan (e.g., Takahashi, Mori, & Kroner, 2013; AUCGR = .61 − .87, AUCVR = .50 − .85, AUCNVR = .64 − .87), and Singapore (e.g., Chu et al., 2015; AUCGR = .65 − .67).
In a meta-analytic study on the youth risk assessment measures, Olver, Stockdale, and Wormith (2009) found that the mean-weighted correlation between SAVRY Total Scores and general recidivism was .32 (
In addition, several studies have shown that the SAVRY Protective Total Score has poor to good predictive validity for desistance from general (AUC = .58 − .91) and violent (AUC = .56 − .77) recidivism—although closer examination revealed that they were cross-cultural differences relating to gender and ethnicity issues (e.g., Dolan & Rennie, 2008; Lodewijks et al., 2008; Rennie & Dolan, 2010; Schmidt et al., 2011; Shepherd et al., 2014). For example, Shepard et al. (2005) found that there were differences between ethnic groups in Australia in terms of predictive validity of the SAVRY protective factor domain for violent and general recidivism whereby the SAVRY ratings yielded moderate to high AUCs for the English Speaking Background and Indigenous subgroups but poor effect sizes for the Culturally and Linguistically Diverse subgroup. Presumably, the differences in the cultural experiences and applicability of the SAVRY items to these culturally diverse groups are central to the differences in performance of the measure.
In their meta-analysis, Olver et al. (2009) also showed that the ratings of the SAVRY and YLS measures had lower predictive validity for violent (for SAVRY: mean-weighted correlation of .26 vs. .34; for YLS measures: mean-weighted correlation of .18 vs. .28) and general recidivism (for SAVRY: mean-weighted correlation of .26 vs. .38; for YLS measures: mean-weighted correlation of .26 vs. .35) when they were used in other Western contexts outside Canada. Olver et al. suggested that “‘international’ differences contributed to the variability across studies” (p. 348). Furthermore, Andrews et al. (2011) postulated that such variability across contexts could be a function of the authors’ allegiance and reliability of outcome measure(s), as well as the differences in legislations, definitions of outcomes, and interpretation of the criteria for rating the risk assessment measure.
The few studies on the YLS/CMI in Asian settings (e.g., Chu et al., 2015; Takahashi et al., 2013) suggest that the predictive validity of the ratings for recidivistic outcomes were lower than those obtained in Canadian contexts, but were similar to the rest of the non-Canadian studies. Taken together, there is a strong rationale to investigate the applicability of youth offender risk assessment measures when adapting them for another jurisdiction.
The Usage of Youth Risk Assessment Measures in Singapore
Singapore is an independent island-state in South East Asia with a land area of 718 square kilometers and a total population of 5.54 million (Singapore Department of Statistics, 2015). Apropos of crime statistics, youth arrests accounted for about 10% of all arrests in Singapore (Singapore Police Force, 2013). Many statutes in Singapore are based on English common law (e.g., the Criminal Procedure Code, 2012), but there are some statutes that are based on legislation from other jurisdictions (e.g., India), which (nonetheless) are still formulated by the English in 1800s. Therefore, similarities with other jurisdictions exist in the way that offenses are defined in Singapore, but the exact language of the laws might differ. It is important to note that cultures and societies define what attitudes and behaviors are deemed as normal and deviant. Notwithstanding that there is cross-cultural agreement about what constitutes offending behavior, the development of deviant attitudes and behaviors can vary as a result of cultural norms, gender roles, morals, religion, taboos, and expectations (e.g., Bhugra, Popelyuk, & McMullen, 2010; Lahlah, Van der Knaap, Bogaerts, & Lens, 2013). These can lead to differences in motivation, risk factors, and pathways for offending especially when cross-cultural differences as to how individuals cope, self-regulate, or even report crime are also taken into account. For example, there are variations in how individuals express anger across different cultures (Matsumoto, Yoo, & Chung, 2010), and this could lead to differences in the manifestation and perpetuation of violence in situations when provocation happens.
In Singapore, the YLS/CMI (Hoge & Andrews, 2002, 2011) was chosen by the relevant youth justice agencies as the primary risk assessment measure to assess the risk and needs of youth offenders in early to mid-2000s (see Chua, Chu, Yim, Chong, & Teoh, 2014). The utility of the YLS/CMI and its screening version for assessing the risk of recidivism and identifying criminogenic needs in youth offenders was investigated in several studies (e.g., Chu et al., 2015; Chu, Ng, Fong, & Teoh, 2012; Chu, Yu, Lee, & Zeng, 2014; Zeng, Chu, Koh, & Teoh, 2015), and the YLS measures were found to have adequate predictive validity for assessing the risk of violent (AUCYLS/CMI-SV_Male = .62) and general recidivistic outcomes (AUCYLS/CMI_Male = .65; AUCYLS/CMI_Female = .67; AUCYLS/CMI-SV_Male = .65; AUCYLS/CMI-SV_Female = .59) but not sexual recidivism (AUCYLS/CMI_Male = .29). In addition, there was a local study that used the SAVRY to identify criminogenic needs in gang-affiliated and nongang-affiliated youth offenders, and group differences were only found for one risk factor (i.e., peer delinquency) after adjusting for multiple comparisons (Chu, Daffern, Thomas, & Lim, 2011).
Given that the SAVRY is a risk assessment measure that is specifically developed to assess violence risk in youth, there is justification for usage despite the widespread adoption of the validated YLS/CMI within the Singapore context. Such a violence risk assessment measure can presumably provide better resolution on the risk factors for violence and provide important information for the management of violence risk. Nevertheless, there is currently no published study on the predictive validity of the SAVRY ratings for assessing the risk of recidivism in youth offenders in Singapore.
Present Study
The present study sought to (a) compare the predictive validity of the SAVRY risk ratings for violent and general recidivism in Singapore against YLS/CMI, an established youth risk assessment measure, and (b) examine the predictive validity of the SAVRY protective factor ratings for desistance from violent and general recidivism.
The following hypotheses were formulated for the present study: (a) The SAVRY ratings would have higher predictive validity for violent recidivism than YLS/CMI ratings, and (b) the SAVRY and YLS/CMI ratings would have comparable predictive validity for general recidivism.
Method
Definition of Violence and Violent Offenses
This study generally adopted the definition provided in the SAVRY manual, which defined violence as “an act of battery or physical violence that is sufficiently severe to cause injury to another person or persons, regardless of whether the injury occurs . . . or a threat made with a weapon in hand” (Borum et al., 2002, p. 19), but this study excluded sexual violence in its definition of violence. Violence offenses included armed robbery, (physical) assault, attempted murder, causing bodily harm, making threats to harm or kill, murder, rioting, robbery, and unlawful use of weapon.
Source Sample
The sample comprised 163 4 youth male offenders (aged 12 to 18 years), who were consecutively referred for psychological evaluation and/or treatment at the Clinical and Forensic Psychology Service (CFPS) of the Ministry of Social and Family Development, Singapore, between January 2004 and December 2005. All youth were charged with and convicted of criminal offenses, and were placed on probation following evaluation and sentencing. The probation services and the courts refer youth offenders to CFPS for a psychological evaluation during pre-sentence assessment when required. Typically, referrals include youth offenders with sexual and violent offending issues, chronic and repetitive offending patterns, and mental health issues. In addition, CFPS also accepts referrals post sentence from the probation services and youth correctional institutions for assessment and treatment of offense-related and/or mental health issues.
Sociodemographics
The average age of the sample at time of referral was 15.96 years (
Offender Characteristics
The average age of the youth offenders at their first charged offense was 15.42 years (
Measures
Savry
The SAVRY (Borum et al., 2002, 2006) is a 24-item risk assessment instrument that was developed from existing research and the professional literature on adolescent development, as well as youth violence. It is based on the structured clinical judgment model (see Webster et al., 1997) and is designed to assist in the assessment and intervention planning for youths (aged 12 to 18 years) where there appears to be a risk of violence. The risk items are classified into three risk domains (Historical, Social/Contextual, and Individual/Clinical), and each risk item is rated on a 3-point scale (Low, Moderate, High) according to specific rating guidelines. For the purpose of the present study, the SAVRY ratings were assigned numerical values “0” to
Yls/Cmi
The YLS/CMI (Hoge & Andrews, 2002, 2011) is a structured assessment instrument designed to facilitate the effective intervention and rehabilitation of youth offenders (aged 12 to 18 years) by assessing their risk level and criminogenic needs. It consists of 42 items divided into eight subscales (Prior/Current Offenses/Dispositions, Family Circumstances/Parenting, Education/Employment, Peer Relations, Substance Abuse, Leisure/Recreation, Personality/Behavior, and Attitudes/Orientation). The item scores (i.e., the number of indicated risk factors/needs) can be aggregated to obtain a total risk/needs score. With regard to the determination of the cutoff scores, the distributions of scores from the original normative samples, the probability of future recidivism for individuals with particular scores, and the specificity and sensitivity of the scores were considered (as advised by Professor Hoge). The cutoff scores of the risk bins for the male youth offenders under community supervision in Singapore are 0 to 10 (
Procedure
Approval to conduct this retrospective study of research was granted by the Ministry of Social and Family Development, Singapore. Due to the retrospective nature of the study, informed consent could not be obtained from the participants for the release of information, but the data were deidentified following successful linkage of data sources. Data were collected from multiple data sources, including (a) psychological reports prepared by psychologists at CFPS, (b) pre-sentencing reports prepared by probation officers, (c) charge sheets, (d) statement of facts, (e) any previously existing assessment and treatment reports on the youths’ CFPS files, and (f) school reports. All psychological reports contain specific information pertaining to several key areas of assessment, which includes personal, family, psychiatric, and criminal offending histories, as well as the current offending behaviors and risk management issues.
The following information was collated from the various data sources:
Sociodemographic characteristics: age at referral, ethnicity (i.e., Chinese vs. non-Chinese), and family structure (i.e., intact vs. non-intact family of origin).
Offender characteristics: age at first charged offense, type and number of index offenses, past offense history (i.e., previous charged and convicted offenses), history of weapon use, and history of substance use (i.e., alcohol, illicit drugs, and inhalants).
Recidivism: Recidivism data were obtained on February 4, 2009, following the completion of coding of all other variables. In terms of definition, general recidivism refers to any presence of sexual, violent, or nonviolent offenses that were committed following the initial court order, breaches of court orders, or any combination of the aforementioned outcomes. Violent recidivism refers to the violent offenses (e.g., physical assault, rioting, murder, and robbery) that were committed following the initial court order, whereas nonviolent recidivism refers to the nonviolent nonsexual offenses (e.g., theft, fraud, burglary, drug use, and drug trafficking) that were committed after the initial court order. In addition, sexual recidivism refers to sexual offenses (e.g., indecent exposure, molestation, peeping, rape, and sodomy) that were committed after the initial court order.
For the purpose of this study, the SAVRY and YLS/CMI were coded from case files using the aforementioned materials between November 2008 and January 2009. With regard to the coding of the SAVRY and YLS/CMI, three research assistants and two psychologists received formal training at CFPS to score the SAVRY and YLS/CMI. The raters coded up to 30 randomly selected files for inter-rater reliability purpose, and the intra-class correlation coefficients (ICC; two-way random, single-rater, and absolute agreement) for the SAVRY Total Score, SAVRY SRR, SAVRY Total Protective score, and YLS/CMI Total Score were .67 (good), .88 (excellent), .85 (excellent), and .79 (excellent), respectively (see Cicchetti, 1994, for a classification of ICCs). In addition, the ICCs for the SAVRY Historical, Social/Contextual, and Individual/Clinical subscales were .69 (good), .42 (fair), and .68 (good). Furthermore, the inter-rater agreement for the YLS/CMI subscales was 88% for Prior/Current Offenses/Dispositions, 73.3% for Family Circumstances/Parenting, 82.9% for Education/Employment, 85% for Peer Relations, 88% for Substance Abuse, 80% for Leisure/Recreation, 71.4% for Personality/Behavior, and 92% for Attitudes/Orientation.
Inter-rater reliability were specifically not examined for sociodemographic and offense variables, but the research assistants were aided by a set of detailed coding guidelines and were given a daily group debrief to address any coding difficulties. A SAVRY or YLS/CMI item was not scored if information necessary for coding was unavailable. The relevant risk assessment data for the SAVRY and YLS/CMI were not analyzed if there were more than two and five omitted items, respectively; only two cases had more than two omitted items for the SAVRY (which were deleted from the sample; hence, we have a total of 163 youth). When necessary, the subscale and total scores were subsequently prorated for missing ratings before analyses (prorated score = raw score / [total number of items − number of missing items] × total number of items). All the research assistants were blind to the recidivism data, which were subsequently obtained on February 4, 2009, and coded by first author following the completion of the initial coding of sociodemographic and offense information.
Statistical Analyses
The sample was characterized using descriptive statistics, with categorical data reported as numbers and percentages, and continuous data presented in relation to the mean and standard deviation. Histograms of the continuous data were plotted to check for skewed distributions. Correlational and Receiver Operating Characteristics (ROC) analyses were conducted to examine the predictive validity of the SAVRY ratings (correlation coefficient and the AUC were reported for each type of rating) during entire follow-up period. To compare the AUCs of ROC curves for SAVRY and YLS/CMI ratings,
In addition, Cox regression analyses were conducted to compare the general and violent recidivistic outcomes of the offenders with different risk levels to account for the differences in time-at-risk. In particular, the total scores, risk ratings, protective or strengths were entered as single predictors in the Cox regression models. Furthermore, SAVRY subscale scores (i.e., Historical, Social/Contextual, and Individual/Clinical) were simultaneously entered into Cox regression models to examine their unique contributions to predicting violent and general recidivism while accounting for differences in time-at-risk. Last, SAVRY subscale Score and Protective Total Score were entered sequentially as two blocks (i.e., SAVRY Total Scores, then Protective Total Score) in Cox regression models to examine the incremental contribution of the protective factors in predicting both violent and general recidivism. Analyses were carried out using the SPSS Version 19.
Results
Recidivism data
The mean follow-up period was 1,658.9 days (
Predictive Validity of the Savry and YLS/CMI Ratings for Recidivistic Outcomes
Correlational Analyses
Table 1 shows the correlations between the ratings for the risk assessment measures and recidivistic outcomes. The SAVRY Total Score, SAVRY SRR, and YLS/CMI Total Score were positively and significantly correlated with violent and general recidivism. Moreover, the SAVRY Protective Total Score was negatively and significantly correlated with the SAVRY Total Score and SRR, as well as YLS/CMI Total Score and Overall Risk Rating (ORR). However, it was noted that the SAVRY Protective Total Score was negatively and significantly correlated with general but not with violent recidivism.
Correlations Between SAVRY and YLS/CMI Ratings and Recidivistic Outcomes
ROC Analyses
Table 2 shows the means, as well as predictive validity, for the SAVRY Total Score, SAVRY SRR, SAVRY Protective Total Score, YLS/CMI Total Score, and YLS/CMI ORR in relation to predicting recidivistic outcomes. In terms of predicting violent recidivism, the differences between the predictive validity of the SAVRY Total Score and SAVRY SRR, as well as SAVRY Total Score and YLS/CMI Total Score were nonsignificant, with analyses revealing moderate effect sizes for the prediction of violent recidivistic outcomes (AUCs = .63-.69). It was also observed that the YLS/CMI ORR was poor at predicting violent recidivism (AUC = .59).
The Predictive Validity of SAVRY and YLS/CMI Ratings for Violent and General Recidivism (ROC analyses) for Entire Follow-Up Period
a,b. The same alphabet denotes that the AUCs differ significantly.
Denotes that the SAVRY Protective Total Score was used to predict desistance from recidivism instead of recidivism.
With regard to predicting general recidivism, the SAVRY and YLS/CMI Total Scores showed large effect sizes (AUCs = .72), and that the YLS/CMI ORR significantly predicted general recidivism with a moderate effect size (AUC = .64). However, the SAVRY ORR was poor at predicting general recidivism (AUC = .55; presumably because the ORRs were for violent and not general recidivistic outcomes). Furthermore, there were some significant differences in terms of the effect sizes for predicting general recidivism when comparing the SAVRY and YLS/CMI Total Scores versus the SAVRY SRR and YLS/CMI ORR (see Table 2). Last, the SAVRY Protective Total Score showed moderate predictive validity for desistance from general recidivism but was poor at predicting desistance from violent recidivism.
Cox Regression Analyses
Table 3 shows the Cox regression analyses for the SAVRY and YLS/CMI ratings in terms of predicting violent and general recidivism. The SAVRY and YLS/CMI Total Scores were significantly associated with the speed of violent and general recidivism. The SAVRY SRR classifications (see also Figure 1) consistently showed significant differences between low- and high-risk offenders in terms of their rate of violent and general recidivism, whereas the YLS/CMI ORR were only useful for classifying offenders in terms of their risk of general recidivism but not violent recidivism. The distributions of violent recidivists to SAVRY SRR classifications of low, moderate, and high were 8.9%, 13.7%, and 26.7%, respectively. Furthermore, SAVRY Protective Total Score significantly predicted general recidivism after accounting for time-at-risk but not violent recidivism.
The Predictive Validity of SAVRY and YLS/CMI Ratings for Violent and General Recidivism (One-Predictor Cox Regression Models)

Survival Curve for SAVRY SRR and Violent Recidivism
Table 4 shows the predictive validity of the SAVRY subscales for violent and general recidivism. None of the SAVRY subscales significantly predicted violent recidivism when entered into the Cox regression model simultaneously; however, only the Historical subscale significantly predicted general recidivism. Last, the SAVRY Protective Total Score did not add incremental predictive validity for violent and general recidivism after controlling for SAVRY Total Score in the Cox regression models (see Table 5).
The Predictive Validity of the SAVRY Subscales for Violent and General Recidivism (Subscales Were Entered Simultaneously Into the Cox Regression Models)
The Predictive Validity of the SAVRY Prot. Total Score After Accounting for SAVRY Total Score (Cox Regression Model)
Discussion
Predictive Validity of the Savry Ratings in a Non-Western Context
Overall, the ROC and correlational analyses (with a mean follow-up of about 4.5 years) revealed that the SAVRY Total Scores and SRR were moderately predictive of violent (AUCTotal = .65,
The mean SAVRY Total Score for this Singaporean sample was generally lower than the Western studies (e.g., Dolan & Rennie, 2008; Gammelgård et al., 2008; Hilterman et al., 2014; Lodewijks et al., 2008; Meyers & Schmidt, 2008; Shepherd et al., 2014), but the mean SAVRY Protective Total Score was noted to be higher than most except Hilterman et al.’s results. In addition, closer examination revealed that higher Historical and Individual/Clinical subscale scores were reported in the Western studies in comparison with our present study. Similar to the SAVRY Total Score, the mean YLS/CMI Total score for this sample was lower than those obtained in the Western studies. However, the YLS/CMI Total Score was higher than those reported in Chu et al. (2015) and Takahashi et al. (2013). These observed differences could be a function of the characteristics of the comparison groups (e.g., high-risk, institutionalized youth offenders, and those with mental health issues), differences in the operationalization and enforcement of legislations, and cross-boundary differences (e.g., a relatively less serious youth crime situation in Singapore as compared with other Western contexts). Within Singapore, this present sample represented a group of youth offenders with more serious offending issues who were referred by the Probation Services Branch for psychological assessment; hence, it was expected that their YLS/CMI Total Scores would be higher than the scores reported for the general probation sample in Chu et al.
In comparison with the indices obtained from Olver et al.’s (2009) meta-analysis for non-Canadian samples, the effect sizes from the present study were somewhat lower when examining the predictive validity of the SAVRY ratings for violent recidivism, but were higher for general recidivism. Further examination revealed that the AUCs obtained for this study were somewhat lower than the Canadian studies that included at least 3 years of follow-up (see Table 6), but were similar to those from the United States and the Netherlands. Nevertheless, the base rates for violent recidivism in the Canadian samples were much higher than the present study as well as those from the United States and the Netherlands, which is a possible factor that could affect predictive validity for violent recidivism. In comparison, the effect sizes of the YLS/CMI ratings from this study were also higher than Olver et al.’s for general recidivism. Notwithstanding the significant predictive validity of the SAVRY and YLS/CMI ratings, there is still substantial variance in the violent and general recidivism rates between the offenders that is unaccounted for by the variables that were examined, and this unexplained variance could be due to differences in intraindividual-, environmental-, and system-level variables (e.g., developmental changes across the follow-up period, differences between actual and reported crimes as well as neighborhood crime rates and socioeconomic factors; Olver et al., 2009; Onifade, Petersen, Bynum, & Davidson, 2011). Nevertheless, this is the first study that had examined the predictive validity of SAVRY in the Singapore context—in comparison with a locally established youth offender risk assessment measure, YLS/CMI.
Predictive Validity of SAVRY Ratings in Published Studies Across Different Countries (Nonexhaustive List)
m,f. Refer to male and female, respectively.
nc,c,es,cld,ind. Refer to native Canadian, Caucasian, English-speaking background, culturally and language diverse background, and Indigenous background, respectively.
s,p. Refer to summary risk rating and protective factor domain, respectively.
e,r. Refer to a strictly education and residential sample, respectively.
mv,sv. Refer to minor violence and serious violence, respectively.
Apropos of comparing the SAVRY and YLS/CMI Total Scores against the SAVRY SRR and YLS/CMI ORR, it appeared the AUCs of the total scores for violent and general recidivism were better than the omnibus ratings (i.e., SRR and ORR). Cox regression analyses showed similar results, and closer examination suggests that the SAVRY SRR was only somewhat useful for predicting violent recidivism. The YLS/CMI ORR was poor in discriminating the violent recidivists from nonrecidivists after accounting for time, but was good for predicting general recidivism. Apart from the SAVRY Historical subscale that showed significant predictive validity for general recidivism, the rest of the SAVRY subscales did not predict violent and general recidivism when entered simultaneously into Cox regression models. These results suggest that the dynamic risk factors may contribute less than the static risk factors over longer term (Chu, Thomas, Ogloff, & Daffern, 2013), but this is an area that warrants more empirical investigation. With regard to the distribution of violent recidivists to SRR, 26.7% and 13.7% of the high-risk and moderate-risk group reoffended violently, respectively. When compared with existing literature (e.g., Meyers & Schmidt, 2008), these figures seemed low—about half the rate over a similar follow-up period. However, it is important to examine these recidivism rates in the context of low crime and recidivism rates within the Singaporean context. For example, the 3-year recidivism rate for youth offenders placed on community supervision is usually around 10%.
With regard to the SAVRY Protective Total Score, the present findings showed that it was only useful for predicting desistance from general recidivism (albeit a relatively modest effect size), and not violent recidivism. Correlational, Cox regression, and ROC analyses consistently revealed that there was a lack of relationship between SAVRY Protective Total Score and violent recidivism. This finding could, in part, explain the lower predictive validity of the SAVRY SRR (as compared with SAVRY Total Score) for both violent and general recidivism because the raters took into account the protective factors when making SRRs. More importantly, the present results were somewhat inconsistent with existing findings (e.g., Hilterman et al., 2014; Lodewijks, de Ruiter, & Doreleijers, 2010; Schmidt et al., 2011), which showed that the SAVRY Protective Total Score has significant predictive validity for desistance from violent recidivism. However, Shepherd et al. (2014) found that ethnic and cultural differences could affect the predictive validity of protective factors for desistance from violent recidivism, and Shepherd et al.’s and the present findings collectively suggest that there is a need to reexamine the protective factors that buffer youth against violent recidivism when the SAVRY is used cross-culturally. Last, the SAVRY Protective Total Score did not show incremental predictive validity for violent and general recidivism over the SAVRY Total Score, suggesting that the protective factors did not contribute incremental information over and above the baseline risk.
Overall, it is arguable whether the SAVRY should be used to predict violence in Singaporean youth offenders. At the moment, the present findings suggest that there was no compelling advantage to use the SAVRY over the YLS/CMI when predicting violent and general recidivism in the absence of further data. Moreover, the SAVRY protective factors did not offer a lot in terms of predicting desistance to recidivism. Nevertheless, it is understandable that clinicians might prefer to use the SAVRY for case formulation, and ultimately violence prevention, due to the inclusion of many purported, violence-specific criminogenic risk factors/needs.
Limitations and Future Directions
First, electronic data and archival file data were used to code the SAVRY and recidivism follow-up; thus, it is likely that there would be an underestimate of the reoffending due to the further offenses not having been detected. Moreover, it is unclear whether some risk and protective factors should be equally weighted when we consider these variables in determining risk; these issues need to be explored further. We also did not check the reliability and validity of the SRR from file information—this should be addressed in future studies. Furthermore, we did not compare the predictive validity of the ratings that were completed by the clinicians and researchers. It would be important to clarify whether there are significant differences in future studies.
Future research on the SAVRY should use prospective and repeated-measures designs, in which the SAVRY ratings are based on interviews as well as available information from archival records. Moreover, it is beneficial to examine gender differences with regard to the usage of the SAVRY in the local context, so that the necessary adaptation can be made. There was a large proportion of the high-risk youth offenders who did not reoffend violently; as such, the predictive accuracy of the SAVRY would be improved if research can identify which factors (or combination) can characterize the violent recidivists better. In addition, it might also be helpful to identify what a specific score from the SAVRY means in relation to another score from the YLS/CMI when we examine this issue through a risk communication perspective. Last, future research can focus on identifying the relevant protective factors for desistance from violent recidivism in non-Western contexts, and also to clarify the pathways through which the protective factors operate.
Conclusion
Notwithstanding the limitations, the present findings suggest that there is value in using the SAVRY for assessing the risk of violent and general recidivism in youth offenders within the Singaporean context. Broadly speaking, the results of this study are generally comparable with other studies from non-Canadian jurisdictions despite some differences, and provide evidence that the SAVRY ratings maintain their predictive validity for at least 3 years (with stronger results observed in the second- and third-year of follow-up). Interestingly, the present study showed that the SAVRY risk and protective ratings are able to predict general recidivism better than violent recidivism; this suggests that many items on the SAVRY tap into the larger construct of general recidivism and that there is a big overlap in risk factors for violent recidivism and general antisociality. Risk and need assessment measures are best used for preventive purposes to classify target groups, as well as to guide and allocate resources for intervention. In addition, they can be used to encourage the youth offender to work toward the development of prosocial trajectories. Pertaining to these aspects, this study demonstrated that the SAVRY offers promise for such purposes in Singapore to varying extents.
Footnotes
Acknowledgements
The authors thank the staff of Clinical and Forensic Psychology Service for their support for this study.
The views expressed are those of the authors’ and do not represent the official position or policies of the Ministry of Social and Family Development.
