Sage Journals: Discover world-class research

Abstract

The National Institutes of Health (NIH) data harmonization project on existing measures (www.phenx.org) has recommended the Global Appraisal of Individual Needs (GAIN)–-Short Screener (GSS) as one of the most reliable, valid, efficient, and inexpensive general behavioral health screeners to quickly identify people with internalizing and externalizing mental health disorders, substance use disorders, and crime/violence problems. The present study examined how well the four GSS screeners and their sum predict future arrest or incarceration among individuals entering treatment for a substance use disorder. Using a cross-validation design, a diverse sample of 6,815 youth with substance use disorders was split into a development sample and a validation sample. Overall, results found the GSS's crime and violence screener (CVScr) and the substance disorder screener (SDScr) to be the two best predictors of arrest/incarceration within the 12 months following treatment intake. Additionally, we found that these screeners could be used to categorize individuals into three groups (low risk, moderate risk, high risk) and this simplified classification had good predictive validity (Area Under the Curve = 0.601). In sum, the GSS's predictive validity was similar to other instruments that have been developed to predict risk for recidivism; however, the GSS takes only a fraction of the time to collect (ie, approximately 2–3 minutes for just these two screeners).

Keywords

juvenile justice recidivism substance abuse treatment crime violence

Introduction

In the United States, there exists a high degree of overlap between substance use and criminal behaviors such that among youth in treatment for substance use disorders (SUDs), 50% are also involved in the juvenile justice system (JJS),¹ and among youth in community supervision, 50% require treatment for SUDs.^2,3 The JJS system is the largest source of referral to adolescent SUD treatment, yet less than one-third of the youth in the JJS with an SUD receive any treatment, with even fewer receiving the kind of evidence-based treatments associated with better outcomes.^4–7 In most of the SUD treatment system for adolescents, there is currently no widespread practice of assessing for risk of recidivism or using this assessment of risk to assign them to interventions that might help reduce their risk.

Calls for an integrated public safety (eg, supervision, judicial hearings, consequences) and public health (eg, community treatment) approach for those having co-occurring drug and criminal activity problems have been made,⁸ with the realization that the limitations of pursuing either approach singularly translates into serious consequences for this population, such as increased JJS involvement, higher rates of the human immunodeficiency virus (HIV) and other sexually transmitted infections, victimization, mental health problems, family and environmental problems, health problems, and death.^3,9–15 On the positive side, it has been found that when integrated treatment approaches that emphasize both public safety and public health can be provided in a tailored fashion to individuals based on their level of risk (an idea known as the Risk Principle), it leads to even more effective outcomes.¹⁶ Per the Risk Principle,¹⁷ those at high risk are provided more intensive treatment than those at low risk.

Borne out of a need to assess risk, interest in developing reliable and valid assessment instruments to identify individuals’ levels of risk has flourished. The justification for developing these instruments is further based on a considerable body of research that has demonstrated the superiority of actuarial methods (ie, those that rely on standardized assessment tools) over “professional judgments” in limiting biases and disparate outcomes^18–22 and perhaps a recognition that assessing risk and tailoring treatments respectively is better than the null behavior of not conducting risk assessment at all. Within the current behavioral health landscape, given the large magnitude in co-occurrence of SUD and crime, multiple expert groups have recommended assessing and treating a wide range of behavioral health needs to reduce both substance use and recidivism^{15,21,23–29}; however, a recognition that the need for services often exceeds available resources and that limited resources be used efficiently has led to a focus on developing simpler screening tools with the goal of helping make efficient decisions regarding the need for further assessment and/or treatment placement.

The most recent meta-analysis of juvenile justice risk assessments³¹ identified 28 risk assessment instruments, with two of the most commonly studied assessment instruments being the Youth Level of Service/Case Management Inventory (YLS/CMI)^32–34 and Psychopathy Checklist–-Youth Version (PCL-YV).³⁵ The weighted average AUC of all 28 assessment instruments was 0.640 and ranged from 0.532 to 0.780, indicating that no current risk instrument offers excellent prediction of future behavior. Additionally, even within the same measure, the AUC varied significantly (eg, 30- to 40-minute YLS/CMI varied from 0.571 to 0.750 across 11 studies and the 90- to 120-minute PCL-YV varied from 0.644 to 0.780 across three studies). In addition to their time to administer, these measures take considerable effort to train and conduct quality assurance, and in some cases require 60-minute or longer collateral interviews (eg, for PCL-YV). Thus, there appears to be a need for brief screeners that can assist in determining whether or not to invest additional resources for more detailed assessment, more intensive monitoring, or more secure level of service placements.

Although there are “screening versions” of these existing instruments available, the Level of Service Inventory –-Revised: Screening Version (LSI-R:SV)³⁶ still requires 10–15 minutes and the Psychopathy Checklist: Screening Version (PCL:SV)³⁷ requires approximately 45 minutes (plus a 35-minute collateral interview). Additionally, each of these screeners has an administration fee per assessment and lacks published studies of their predictive validity. As such, they may not meet the pressing need for reliable, valid, efficient, and low cost screeners to predict risk for future offending.

In summary, selection of a screening and/or assessment instrument is an important decision that requires carefully balancing several important factors (eg, reliability, validity, staff training/administration time, and cost per administration). While previous research has demonstrated the GSS excels in these areas relative to the longer GAIN at intake,³⁰ it did not look at the GSS’ predictive validity in terms of subsequent criminal activity. Thus, the primary goals of this paper were to: 1) examine the extent to which each of the GSS screeners and their sum predict arrest or incarceration within the 12 months following SUD treatment intake, 2) examine which of the GSS screeners or their sum is the most predictive, and 3) develop and validate a relatively simple classification system for the GSS that would facilitate its implementation as a practical risk measure that could assist in efficiently making appropriate decisions about the level of additional assessment and/or treatment that individuals need.

Method

Data Source

Data for the current study came from the 2011 GAIN Summary Analytic dataset, which is currently one of the largest SUD treatment datasets, with longitudinal outcomes (intake and 3-, 6-, 9-, and 12-month follow-up) on 29,782 individuals with substance use disorders between 2002 and 2011. Over two-thirds of the assessments were conducted by independent investigators, funded by a wide range of organizations (eg, Substance Abuse and Mental Health Services Administration's Center for Substance Abuse Treatment, National Institute on Alcohol Abuse and Alcoholism, National Institute on Drug Abuse, Robert Wood Johnson Foundation), and conducted in a variety of adolescent settings and levels of care. All data were collected as part of general clinical practice or specific research studies under their respective voluntary consent procedures. Data were subsequently deidentified and made available for secondary analysis under the supervision of Chestnut Health Systems Institutional Review Board.

Sample

Using the 2011 GAIN Summary Analytic dataset as a starting point, we only included cases that met the following inclusion criteria, which maximize the generalizability and validity of our final results. These inclusion criteria were: (a) adolescents between the ages of 12 and 17 years of age (n = 22,976), (b) who were from SUD treatment sites having a 70% or greater 12-month follow-up interview rate (calculated as the number who completed a 12-month follow-up assessment interview divided by the number due for a 12-month follow-up assessment interview) (n = 9,261), and (c) who either had a 12-month assessment or who indicated they had been arrested/incarcerated in the past 90 days at their 3-, 6-, or 9-month assessment interview (n = 6,925). Additionally, we further subset to those having valid predictors and dependent variables necessary for our analysis in order to obtain a final sample of 6,815 youth from 55 treatment sites across the United States. A 70% follow-up rate falls within an acceptable range of follow-up rates (65–80%) that have been demonstrated with empirical support as not compromising the credibility of study findings.³⁸ Figure 1 illustrates the subset criteria and participant flow.

Figure 1

Participant flow diagram.

Measures

For this study, we utilized data from GSS items that are embedded in the full-length GAIN-I assessment. Validity for the GAIN instrument has been documented in many prior studies using multiple methods (eg, urine tests, collateral reports, Rasch measurement models, time-line follow-back).^39–49 Additionally, as noted in the introduction, validity for the GSS has been established through sensitivity, specificity, and area under the curve analyses.³⁰ Finally, the GSS measures recency of having problems, with response choices including: past-month (score of 3), 2–12 months ago (score of 2), over a year ago (score of 1), and never (score of 0). To obtain a score for each screener, the number of responses endorsed per time period are counted. In this case, we were interested in past-year scores on the GSS and thus counted responses of 2s and 3s to obtain a final score between 1 and 5 for each screener.

Independent Measures

The primary independent measures were continuous and grouped versions of each of the four 5-item GSS screeners and their sum (20 items total). The Internalizing Disorder Screener (IDScr; alpha = 0.74) contains items related to depression, anxiety, trauma, and suicide. The Externalizing Disorder Screener (EDScr; alpha = 0.76) contains items on inattentiveness, hyperactivity, conduct, gambling disorders, and other impulse control problems. The Substance Disorder Screener (SDScr; alpha = 0.76) contains items about frequent use, abuse, dependence, and induced disorders and symptoms. Finally, the Crime and Violence Screener (CVScr; alpha = 0.72) contains items related to domestic violence, as well as property, drug, and violent crimes. The Total Disorder Screener (TDScr; alpha = 0.87) is the sum of the 20 items from these 4 screeners. Copies of the instrument, manual, psychometrics and publications related to the GAIN SS are available at www.gaincc.org/gainss.

Dependent Measure

The primary dependent variable for the current study was 1-year arrest/incarceration based on self report. This operationalization is consistent with part 1 of the Council of Juvenile Correctional Administrators’ (CJCA) two-part standard for measuring recidivism,⁵⁰ which includes 1) the commission of an offense (in our case, operationalized as arrest or incarceration), and 2) by an individual already known to have committed at least one other offense. Our dichotomous (yes/no) outcome variable for 1-year arrest/incarceration was calculated using items from four quarterly follow-up assessments during the year post-intake (3-, 6-, 9-, and 12-month follow-up). The following GAIN follow-up items were used in the operationalization of arrest/incarceration: 1) When was the last time you were arrested and charged with a crime?; 2) During the past 90 days, how many times have you been arrested and charged with breaking a law?; 3) During the past 90 days, how many days have you been in juvenile detention, jail, or prison?; 4) A re you currently in jail, prison, or detention?; 5) Are you currently involved with the criminal justice system in any of the following ways: In jail or prison?; and 6) Are you currently involved with the criminal justice system in any of the following ways: In detention? Any positive response (Yes or 1+ days) was sufficient to indicate 1-year arrest/incarceration.

Procedures

As noted previously, data collection for this study followed guidelines set forth by each site's voluntary consent procedures and were either part of specific research studies or general clinical practice. Data pooled for secondary analysis purposes are under data sharing agreements from Chestnut Health Systems’ Institutional Review Board. All treatment sites received standardized training and quality assurance checks of their data collection to facilitate comparisons with other sites utilizing the GAIN instrument.

Analytic Procedures

The initial sample of 6,815 youth was split into two random split half samples stratified by site in order to run cross-validation analyses. The first was used for initial model development and the second for validation. There were no significant differences in these samples on key variables, such as gender, race, level-of-care, treatment type, co-occurring disorders, substance use severity, victimization, and intensity of juvenile justice involvement. Because ours was an exploratory study of the GSS in predicting recidivism, the main analyses consisted of a) running bivariate logistic regressions separately using each of the four GSS screeners and their sum at baseline to predict the dichotomous 12-month arrest/incarceration, then b) running multivariate analyses in a stepwise fashion. The stepwise regression started with all five baseline predictor variables in the model, and then removing one non-significant predictor at a time from the model and testing the change in model fit. At each step, we also ran AUC analyses to determine the accuracy of the prediction, where 0.5 is no better than chance and 1.0 is perfect prediction. Unlike cross-sectional use comparing two measures (where AUC should be high), when predicting 12 months into the future they are often much lower so it is important to compare how well a new measure works relative to what other existing measures can do. To interpret our results we compared them to Schwalbe's³¹ meta-analysis of juvenile justice recidivism studies, in which the bottom 25% of the studies had AUC in the range of 0.532 to 0.594 (poor), the middle 50% of the studies had AUC between 0.595 to 0.718 (good), and the top 25% of the studies AUC between 0.719 to 0.780 (excellent).

Results

Sample Characteristics

Table 1 displays the characteristics of the development and validation samples. Note the samples do not differ on any of the demographic and/or pretreatment characteristics at a 0.05 alpha level. The development sample was mainly male (76%) with a mean age of 15.1 years. Most were White (41%), followed by Hispanic (28%), African American (16%), Mixed Race (11%), and Other race (5%). The majority of adolescents (54%) had used substances for three or more years, and met full criteria for past-year SUD (87%). Only 28% perceived they had a substance problem, but 75% reported recognizing a need for some kind of treatment. The majority (69%) had a co-occurring disorder, with 55% meeting criteria for Conduct Disorder, 72% reporting past-year physical violence, and 73% reporting past year illegal activity. Additionally, nearly half of the adolescents (48%) reported a high degree of victimization in their lifetime.

Table 1

Sample characteristics.

VARIABLE	DEVELOPMENT SAMPLE (N = 3,420)	VALIDATION SAMPLE (N = 3,395)
	MEAN (SD) OR %	MEAN (SD) OR %
Mean Age	15.1 (1.2)	15.1 (1.2)
Single parent	52%	52%
Female	24%	25%
Race
African American	16%	17%
White	41%	41%
Hispanic	28%	26%
Mixed	11%	11%
Other	5%	5%
Level of care
Outpatient	68%	68%
Intensive outpatient	8%	9%
Short-term residential	4%	4%
Mid-to-long term residential	15%	15%
Outpatient-continuing care	5%	5%
Type of treatment
A-CRA/ACC	27%	27%
MET/CBT	35%	36%
Seven challenges	1%	1%
MDFT	2%	3%
Other EBT	4%	4%
Specific manualized programs	20%	20%
Other	10%	10%
Homeless/Runaway	29%	31%
Used substances for 3+ years	54%	54%
Past year dependence	53%	53%
Past year abuse	34%	34%
Self-perceived substance problem	28%	27%
Self-perceived need for Treatment	75%	76%
Any co-occurring disorder	69%	70%
Conduct disorder	55%	56%
High victimization (lifetime)	48%	46%
Days in justice system involvement	40.8 (41.5)	41.2 (41.8)
Any past-year physical violence	72%	72%
Any past-year illegal activity	73%	74%
In school during past 90 Days	89%	90%
Expelled/Dropped out of school	18%	18%

Note: ^*indicates P < 0.05.

Bivariate and multivariate analyses

Results of the bivariate analysis (see Table 2) indicated that, with the exception of the EDScr, moderate and high scores on each of the screeners, relative to low scores, were predictive of arrest/incarceration in the year after intake in the development sample (P < 0.05). Values for the AUC suggest that any of the sub-screeners would individually predict arrest/incarceration more accurately than by chance (ie, each of the four AUC statistics were significant at P < 0.05). Still, because the AUC for each of the screeners individually indicated only slightly better prediction than by chance, we wanted to examine whether the screeners together would perform better. Table 3 shows the results of the multivariate analysis, in which all four predictors were initially included and a stepwise procedure was applied in which one predictor that did not significantly contribute to the solution was removed from the model at each step. The four screeners and their sum could not be in at the same time due to multi-collinearity. Since its AUC was lower than several shorter screeners, we chose to drop the sum based on the parsimony principle. Results indicated that EDScr and IDScr did not significantly contribute to a multivariate model in which the GSS screeners predict arrest/incarceration in the year following intake (Model 1 and Model 2); however, CVS and SDS together were significant predictors of arrest/incarceration (Model 3; P < 0.001). Values of the AUC in the multivariate analysis phase indicate that each of the models predicted arrest/incarceration more accurately than by chance (ie, each of the three AUC statistics were significant at P < 0.001).

Table 2

Bivariate results using development sample (n = 3,420).

MEASURE	B	SE	AUC	95% CI
Total Disorder Screener (TDS)			0.515	(0.496–0.534)
Low (Referent group)
Moderate	0.0 41	0.46
High	0.982*	0.397
Internalizing Disorder Screener (IDS)			0.522*	(0.503–0.541)
Low (Referent group)
Moderate	0.228**	0.081
High	0.176*	0.085
Externalizing Disorder Screener (EDS)			0.551***	(0.531–0.57)
Low (Referent group)
Moderate	0.18 6	0.095
High	0.446***	0.083
Substance Disorder Screener (SDS)			0.570***	(0.551–0.589)
Low (Referent group)
Moderate	0.468***	0.117
High	0.838***	0.111
Crime and Violence Screener (CVS)			0.601***	(0.582–0.62)
Low (Referent group)
Moderate	0.506***	0.087
High	0.965***	0.090

Notes: *P < 0.05; **P < 0.01; ***P < 0.001.

Table 3

Multivariate results using development sample (n = 3,420).

MEASURE	MODEL 1				MODEL 2				MODEL 3
	B	SE	AUC	95% CI	B	SE	AUC	95% CI	B	SE	AUC	95% CI
Externalizing Disorder Screener (EDS)			0.619***	(0.600–0.637)	–	–	–	–	–	–	–
Low (Referent group)					–	–	–	–	–	–	–	–
Moderate	0.012	0.100			–	–	–	–	–	–	–	–
High	0.066	0.099			–	–	–	–	–	–	–	–
Internalizing Disorder Screener (IDS)							0.619***	(0.600–0.637)	–	–	–	–
Low (Referent group)									–	–	–	–
Moderate	0.042	0.086			0.054	0.084			–	–	–	–
High	-0.1 6 4	0.098			-0.14 2	0.093			–	–	–	–
Substance Disorder Screener (SDS)											0.615***	(0.596–0.633)
Low (Referent group)
Moderate	0.385**	0.119			0.385**	0.119			0.381**	0.119
High	0.593***	0.120			0.602***	0.119			0.567***	0.116
Crime and Violence Screener (CVS)
Low (Referent group)
Moderate	0.434***	0.089			0.443***	0.088			0.442***	0.088
High	0.815***	0.100			0.837***	0.096			0.825***	0.095

Notes: *P < 0.05; **P < 0.01; ***P < 0.001.

Interaction Analyses

Because multivariate analyses indicated that the CVS and the SDS were the two best predictors of arrest/incarceration in the year after intake, it was decided that their cross-interaction should be examined more closely. To this end, each of the three levels of the CVS (low, moderate, and high) were crossed with each of the three levels of the SDS (low, moderate, and high) to form a 3 x 3 = 9 level variable. Figure 2 presents the nine-level variable resulting from the CVS x SDS cross on the x-axis. The y-axis on this figure is the percent of adolescents who were arrested/incarcerated in the year after intake. The positive slope of the line suggests that adolescents with low scores on the CVS and SDS at baseline (far left) were less likely to be arrested/incarcerated and that those with high scores on the CVS and SDS at baseline (far right) were at greatest risk to be arrested/incarcerated. The AUC was 0.614 (P < 0.001), indicating that prediction using this nine-level variable was significantly more accurate than chance, and thus this nine-level variable could be used to triage adolescents into relative risk for arrest/incarceration in the year after intake based on scores on the GSS at baseline.

Figure 2

Arrest/Incarceration for 9-Level (CVS x SDS) grouping using development sample (n = 3,420).

Due to the large number of levels (ie, nine) in this solution, we thought its real-world application may not be optimal. Thus, based on visual inspection of Figure 2, we found that rates of arrest/incarceration appeared to cluster in the 40% range, the 50% range, and the 60% range (these clusters are separated by large parentheses in Fig. 2). The cluster to the left includes any adolescents who score ‘low’ on the CVS (regardless of their scores on the SDS) or those who score ‘moderate’ on the CVS and ‘low’ on the SDS. The middle cluster includes adolescents who score ‘moderate’ on the CVS and either ‘moderate’ or ‘high’ on the SDS, or ‘high’ on the CVS and ‘low’ on the SDS. Finally, the cluster on the right includes adolescents who score ‘high’ on the CVS and either ‘moderate’ or ‘high’ on the SDS. These clusters correspond to three distinct groups–-low, moderate, and high risk for arrest/incarceration–-which we believe is a more practical solution to help GSS users interpret baseline scores on the CVS and SDS with respect to predicting future arrest/incarceration. Analyses using this three-group solution (see Fig. 3) indicated it was a significant predictor of arrest/incarceration during the year after intake (AUC = 0.605, P < 0.001) and that the AUC of this three-group solution (0.605) is not significantly different than that of the nine-group solution (0.614) based on their overlapping 95% confidence intervals as well as results of effect size (ES) analyses comparing the difference between the two AUCs, which yielded an insignificant ES of 0.02.

Figure 3

Arrest/Incarceration for 3-group simplified solution using developmental sample (n = 3,420).

Cross-validation analysis

Using the validation sample, we examined rates of arrest/incarceration and the AUC for both the nine- and three-group solutions. Figure 4 presents the results of the nine-group solution with the validation sample. Similar to results with the development sample, we found rates of arrest/incarceration to cluster in the 40% range, the 50% range, and the 60% range (these clusters are separated by large parentheses in Fig. 4). The AUC for the nine-group solution was 0.603 and was significant at P < 0.001.

Figure 4

Arrest/Incarceration for 9-Level (CVS x SDS) grouping using validation sample (n = 3,395).

Figure 5 presents the results of the simplified three-group solution using the validation sample. Again, similar to the findings from the development sample, the rate of arrest/incarceration increased from 42% for adolescents in the low risk group to 52% (moderate risk group) and then to 65% (high risk group). The AUC for the three-group solution was 0.601 and was significant at P < 0.001.

Figure 5

Arrest/Incarceration for 3-group simplified solution using validation sample (n = 3,395).

Discussion

Given the high rate of overlap in youth who have SUDs and involvement in the juvenile justice system, expert panels have consistently recommended evidence-based screening and assessment for a range of behavioral health issues. The high costs and need to target the limited assessment resources suggest the need for a multistage process, starting with an efficient screener to do the initial triage. This study built on earlier research showing the value of the GSS as a triage tool for clinical assessment and demonstrated its value as a reliable, valid, efficient, and inexpensive tool for triaging youth based on their risk for future arrest or incarceration and in accordance with the Risk Principle.

Schwalbe³¹ noted that “The hallmark of the actuarial approach is an empirical development strategy that separates instrument development from validation,” as we have done here. Instrument development here was conducted on an ‘estimation sample,’ which was used to predict recidivism and create the 3 risk-groups. Instrument validation took place on a separate sample in which the overall predictive validity of the index was tested. Based on analyses with the development sample, each of the four GSS screeners (ie, IDScr, EDScr, SDScr, CVScr) were significant predictors of arrest/incarceration during the year after intake (AUCs ranging from 0.551 to 0.601). A series of multivariate analyses using the development sample suggested that the combination of all four screeners was the best predictor of future arrest/incarceration (AUC = 0.619, P < 0.001), but that a similar level of prediction could be achieved with just the SDScr and CVScr (AUC = 0.615, P < 0.001). Thus, among the four GSS screeners, CVScr and SDScr were found to be the two best predictors of future arrest/incarceration. Additionally, results indicated that both a nine-group and simplified three-group classification approach were significant (P < 0.001) predictors of future arrest/incarceration, with AUCs of .614 and 0.605, respectively. After completion of analyses using the development sample, analyses were conducted on the validation sample. These subsequent analyses focused on examination of the predictive validity of both the nine- and three-group solutions. Consistent with results from the developmental sample, analyses using the validation sample indicated that both the nine-group and simplified three-group classification approach were significant (P < 0.001) predictors of future arrest/incarceration, with AUCs of 0.603 and 0.601, respectively.

Overall, the AUCs reported as part of this study fall within the good or middle 50% range (0.595 to 0.718) of AUCs reported within Schwalbe's meta-analysis of juvenile risk assessments.³¹ While it must be acknowledged that other assessments, such as the YLS-CMI^32,33 or PCL-YV,³⁵ have better predictive validity, the full and screening versions of these other instruments take three to 60 times longer to complete than the five-minute GSS or the 2–3 minutes it would take for just the CVScr and SDScr. Thus, the GSS not only appears to represent a highly efficient screener for internalizing disorders, externalizing disorders, substance disorders, and crime/violence,³⁰ but also a highly efficient screener for future arrest or incarceration. It could also be used in a multi-step process to decide “whether” to invest in a more extensive risk assessment.

Strengths and limitations

The study's strengths include a large, diverse, and multi-site sample, cross-validation design, and multiple follow-up assessment points of data. Yet, it also has some limitations that must be acknowledged. First, all data, including arrest/incarceration, was based only on self-report. Ideally this should be validated with records. Second, the follow-up time period for arrest/incarceration was limited to one year. Third, because individuals used for the current study were adolescents with SUD presenting to treatment, it should ideally be replicated in other samples and settings.

General summary and directions for future research

Overall, the current study provides evidence that supports use of the CVS and SDS of the GSS as very brief, yet valid predictors of criminogenic risk among youth in SUD treatment. Thus, in addition to serving as a cost-effective front door screener to identify people with co-occurring disorders across multiple systems,³⁰ the GSS also can serve as a cost-effective risk screener. Importantly, although a key goal of risk assessment is to help classify individuals into different risk categories, it is equally (if not more) important that once a reliable and valid risk prediction system has been implemented to match the level of risk with the most appropriate level of treatment service(s).⁵¹ Thus, in addition to further improving the predictive validity of risk screeners and assessments, future research on the integration of risk assessment and treatment planning is needed.⁵² It also would be beneficial for future research to focus on future illegal activity, which is more than twice as common as future re-arrest or incarceration. While the two mental health screeners did not necessarily add to our ability to predict recidivism, the rates of mental health problems and need for associated services were high. Since most systems care about other outcomes as well (eg, suicide, change in victimization or emotional problem, family problems, HIV risk behaviors), it would still make sense to use the full screener.

Author Contributions

Conceived and designed the experiments: MLD, BRG. Analyzed the data: BRG, VKB, MLD. Wrote the first draft of the manuscript: BRG, VKB. Contributed to the writing of the manuscript: BRG, VKB, MLD. Agree with manuscript results and conclusions: BRG, VKB, MLD. Jointly developed the structure and arguments for the paper: BRG, VKB, MLD. Made critical revisions and approved final version: BRG, VKB, MLD. All authors reviewed and approved of the final manuscript.

Disclosures and ETHICS

As a requirement of publication the authors have provided signed confirmation of their compliance with ethical and legal obligations including but not limited to compliance with ICMJE authorship and competing interests guidelines, that the article is neither under consideration for publication nor published elsewhere, of their compliance with legal and ethical guidelines concerning human and animal research participants (if applicable), and that permission has been obtained for reproduction of any copyrighted material. This article was subject to blind, independent, expert peer review. The reviewers reported no competing interests.

References

United States Department of Health and Human Services. Substance Abuse and Mental Health Services Administration. Center for Behavioral Health Statistics and Quality. Treatment Episode Data Set—Admissions (TEDS-A), 2010. ICPSR33261-v1. Ann Arbor, MI: Inter-university Consortium for Political and Social Research [distributor], 2012–07–17.

Office of Juvenile Justice and Delinquency Prevention (OJJDP). Juvenile Drug Court Program. Washington, DC: Department of Justice, OJJDP; 2001. NCJ184744.

Teplin

L.A.

Abram

K.M.

McClelland

G.M.

Dulcan

M.K.

Mericle

A.A.

Psychiatric disorders in youth in juvenile detention.

Arch Gen Psychiatry. 2002; 59: 1133–43.

James

Karberg

Substance Dependence, Abuse, and Treatment of Jail Inmates, 2002. Rockville, MD: Bureau of Justice Statistics, US Department of Justice; 2005.

Peterson

Juvenile Boot Camps: Lessons Learned. Washington, DC: Office of Juvenile Justice and Delinquency Prevention; 2001.

McClelland

G.M.

Teplin

L.A.

Abram

K.M.

Detection and Prevalence of Substance Use Among Juvenile Detainees. Washington, DC: US. Department of Justice; 2004.

Young

D.W.

Dembo

Henderson

C.E.

A national survey of substance abuse treatment for juvenile offenders.

J Subst Abuse Treat. 2007; 32: 255–66.

Marlowe

D.B.

Integrating substance abuse treatment and criminal justice supervision.

Sci Pract Perspect. 2003; 2: 4–17.

Chan

Y.F.

Godley

M.D.

Godley

S.H.

Dennis

M.L.

Utilization of mental health services among adolescents in community-based substance abuse outpatient clinics.

J Behav Health Serv Res. 2009; 36: 35–51.

10.

Chan

Y.F.

Passetti

L.L.

Garner

B.R.

Lloyd

J.J.

Dennis

M.L.

HIV risk behaviors: Risky sexual activities and needle use among adolescents in substance abuse treatment.

AIDS Behav. 2011; 15: 114–24.

11.

Inciardi

J.A.

Pottieger

A.E.

Forney

M.A.

Chitwood

D.D.

McBride

D.C.

Prostitution, IV drug use, and sex-for-crack exchanges among series delinquents: Risks for HIV infection.

Criminology. 1991; 29: 221–35.

12.

Robertson

A.A.

Husain

D.L.

Undesser

Prevalence of mental illness and substance abuse disorders among incarcerated juvenile offenders in Mississippi.

Child Psychiatry Hum Dev. 2004; 35: 55–74.

13.

Scott

C.K.

Dennis

M.L.

Laudet

Funk

R.R.

Simeone

R.S.

Surviving drug addiction: The effect of treatment and abstinence on mortality.

Am J Public Health. 2011; 101: 737–44.

14.

Young

First count to ten: Innovation and implementation in juvenile reintegration programs.

Offender Substance Abuse Report. 2006; 6(4): 49–50, 58–64.

15.

Young

D.W.

Farrell

J.L.

Henderson

C.E.

Taxman

F.S.

Filling service gaps: Providing intensive treatment services for offenders.

Drug Alcohol Depend. 2009; 103S: S33–42.

16.

Marlowe

D.B.

Festinger

D.S.

Dugosh

K.L.

Lee

P.A.

Benasutti

K.M.

Adapting judicial supervision to the risk level of drug offenders: Discharge and 6-month outcomes from a prospective matching study.

Drug Alcohol Depend. 2007; 88: S4–13.

17.

Andrews

D.A.

Bonta

The Psychology of Criminal Conduct. 2nd ed. Cincinnati, OH: Anderson; 1998.

18.

Substance Abuse and Mental Health Services Administration, Office of Applied Studies. National Survey on Drug Use and Health, 2009 [Computer file] ICPSR29621-v2. Ann Arbor, MI: Inter-university Consortium for Political and Social Research [distributor]; 2012. Available at: http://www.icpsr.umich.edu/icpsrweb/SAMHDA/studies/29621/detail Accessed August 12, 2013.

19.

Dennis

M.L.

The quality chasm in the behavioral health treatment for America's youth. Presented at: 26th Annual Children's Mental Health Research and Policy Conference; March 3–6, 2013; Tampa, Florida.

20.

Institute of Medicine. Improving the Quality of Health Care for Mental and Substance-use Conditions: Quality Chasm Series. Washington, DC: National Academy Press; 2006.

21.

Substance Abuse and Mental Health Services Administration. Identifying Mental Health and Substance Use Problems of Children and Adolescents: A Guide for Child-Serving Organizations. Rockville, MD: Author.

22.

Tanner-Smith

E.E.

Wilson

S.J.

Lipsey

M.W.

The comparative effectiveness of outpatient treatment for adolescent substance abuse: A meta-analysis.

J Subst Abuse Treat. 2013; 44: 145–58.

23.

Bureau of Justice Assistance. Juvenile Drug Courts: Strategies in Practice. Washington, DC: US. Department of Justice; 2003.

24.

Drug Strategies. Treating Teens: A Guide to Adolescent Drug Programs. Washington, DC: Author; 2003.

25.

Drug Strategies. Bridging the Gap: A Guide to Drug Treatment in the Juvenile Justice System. Washington, DC: Author; 2005.

26.

National Institute on Drug Abuse. Principles of Drug Abuse Treatment: A Research-based Guide. Third edition. Washington, DC: National Institutes of Health; 2012.

27.

National Institute on Drug Abuse. Principles of Drug Abuse Treatment for Criminal Justice Populations: A Research-based Guide. NIH Publication No. 11–5316. Washington, DC: National Institutes of Health; 2012.

28.

National Institute on Drug Abuse. Principles of adolescent substance use disorder treatment: A Research-based guide. Rockville, MD: National Institutes of Health. Washington, DC: National Institutes of Health; in press.

29.

National Research Council. Reforming Juvenile Justice: A Developmental Approach. Washington, DC: The National Academies Press; 2012.

30.

Dennis

M.L.

Chan

Y.F.

Funk

Development and validation of the GAIN Short Screener (GSS) for internalizing, externalizing, and substance use disorders and crime/violence problems among adolescents and young adults.

Am J Addict. 2006; 15(Suppl. 1): S80–91.

31.

Schwalbe

C.S.

Risk assessment for juvenile justice: A meta-analysis.

Law Hum Behav. 2007; 31: 449–62.

32.

Hoge

R.D.

Andrews

D.A.

Assessing the Youthful Offender: Issues and Techniques. New York: Plenum; 1996.

33.

Hoge

R.D.

Andrews

D.A.

The Youth Level of Service/Case Management Intake Manual and Item Scoring Key. Ottawa: Carleton University; 2001.

34.

Schmidt

Hoge

R.D.

Gomes

Reliability and validity analyses of the Youth Level of Service/Case Management Inventory.

Crim Justice Behav. 2005; 32: 329–44.

35.

Forth

Kosson

Hare

The Hare Psychopathy Checklist: Youth Version, Technical Manual. New York: Multi-Health Systems, Inc.; 2003.

36.

Andrews

D.A.

Bonta

Level of Service Inventory-Revised: Screening Version, User's Manual. Toronto: Multi-Health Systems; 1998.

37.

Hart

S.D.

Cox

D.N.

Hare

R.D.

The Hare Psychopathy Checklist: Screening Version. Toronto: Multi-Health Systems; 1995.

38.

Hansten

M.L.

Downey

Rosengren

D.B.

Donovan

D.M.

Relationship between follow-up rates and treatment outcomes in substance abuse research: More is better but when is “enough” enough?

Addiction. 2000; 95: 1403–6.

39.

Dennis

M.L.

Godley

S.H.

Diamond

The Cannabis Youth Treatment (CYT) Study: Main findings from two randomized trials.

J Subst Abuse Treat. 2004; 27: 197–213.

40.

Dennis

M.L.

Scott

C.K.

Funk

An experimental evaluation of recovery management checkups (RMC) for people with chronic substance use disorders.

Eval Program Plann. 2003; 26: 339–52.

41.

Dennis

M.L.

Titus

J.C.

Diamond

The Cannabis Youth Treatment (CYT) experiment: Rationale, study design, and analysis plans.

Addiction. 2002; 97(suppl 1): S16–34.

42.

Godley

M.D.

Godley

S.H.

Dennis

M.L.

Funk

Passetti

Preliminary outcomes from the assertive continuing care experiment for adolescents discharged from residential treatment.

J Subst Abuse Treat. 2002; 23: 21–32.

43.

Godley

M.D.

Godley

S.H.

Dennis

M.L.

Funk

R.R.

Passetti

L.L.

The effect of Assertive Continuing Care on continuing care linkage, adherence and abstinence following residential treatment for adolescents with substance use disorders.

Addiction. 2007; 102: 81–93.

44.

Lennox

Dennis

M.L.

Ives

White

M.K.

The construct and predictive validity of different approaches to combining urine and self-reported drug use measures among older adolescents after substance abuse treatment.

Am J Addict. 2006; 15: 92–101.

45.

Lennox

R.D.

Dennis

M.L.

Scott

C.K.

Funk

R.R.

Combining psychometric and biometric measures of substance use.

Drug Alcohol Depend. 2006; 83: 95–103.

46.

Riley

B.B.

Conrad

K.J.

Bezruczko

Dennis

M.L.

Relative precision, efficacy and construct validity of different starting and stopping rules for a computerized adaptive test: The GAIN substance problem scale.

J Appl Meas. 2007; 8: 48–64.

47.

Shane

Jasiukaitis

Green

R.S.

Treatment outcomes among adolescents with substance abuse problems: The relationship between comorbidities and post-treatment substance involvement.

Eval Program Plann. 2003; 26: 393–402.

48.

White

Predicting violence in juvenile offenders: The interaction of individual, social and environmental influences.

Offender Substance Abuse Report. 2005; 83: 89–90.

49.

White

M.K.

Funk

R.R.

White

W.L.

Dennis

M.L.

Predicting violent behavior in adolescent cannabis users: The GAIN-CVI. In: Knight

Farabee

, editors. Treating Addicted Offenders: A Continuum of Effective Practices. Kingston, NJ: Civic Research Institute; 2004: 3-1–3-7.

50.

Harris

P.W.

Lockwood

Mengers

Stoodley

B.H.

Measuring recidivism in juvenile corrections.

Journal of Juvenile Justice. 2011; 1: 1–16.

51.

Andrews

D.A.

Bonta

Hoge

R.D.

Classification for effective rehabilitation: Redisovering psychology.

Crim Justice Behav. 1990; 17: 19–52.

52.

Schwalbe

C.S.

Strengthening the integration of actuarial risk assessment with clinical judgment in an evidence based framework.

Child Youth Serv Rev. 2008; 30: 1458–64.

The GAIN Short Screener (GSS) as a Predictor of Future Arrest or Incarceration among Youth Presenting to Substance Use Disorder (SUD) Treatment

Abstract

Keywords

Introduction

Method

Data Source

Sample

Measures

Independent Measures

Dependent Measure

Procedures

Analytic Procedures

Results

Sample Characteristics

Bivariate and multivariate analyses

Interaction Analyses

Cross-validation analysis

Discussion

Strengths and limitations

General summary and directions for future research

Author Contributions

Disclosures and ETHICS

References