Restricted accessResearch articleFirst published online 2016-11
Student Risk Screening Scale for Internalizing and Externalizing Behaviors: Preliminary Cut Scores to Support Data-Informed Decision Making in Middle and High Schools
We report findings of a convergent validity study examining the internalizing subscale (SRSS-16) of the Student Risk Screening Scale for Internalizing and Externalizing (SRSS-IE) with the internalizing subscale of the Teacher Report Form (TRF; Achenbach, 1991). Participants included 227 sixth- through 12th-grade students from nine schools across two states. Results of logistic regression and receiver operating characteristic curves suggest the following cut scores for the SRSS-16 for middle and high school students: 0–3 (low risk), 4–5 (moderate risk), and 6–18 (high risk) for internalizing behavior patterns, relative to the internalizing subscale of the TRF subscale. We conclude with a discussion of the findings and illustrations of how to use screening scale scores for decision making in a tiered system of supports, offering limitations and future directions for consideration.
Get full access to this article
View all access options for this article.
References
1.
AchenbachT. M. (1991). Integrative guide for the 1991 CBCL/4–18, YRS, & TRF profiles.Burlington, VT: University of Vermont, Department of Psychiatry.
2.
AchenbachT. M., & RescorlaL. A. (2001). Manual for the ASEBA School-Age Forms & Profiles.Burlington, VT: University of Vermont, Research Center for Children, Youth, & Families.
3.
American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). Arlington, VA: Author.
4.
BradshawC. P., BuckleyJ., & IalongoN. (2008). School-based service utilization among urban children with early-onset educational and mental health problems: The squeaky wheel phenomenon.School Psychology Quarterly23, 169–186. doi.org/10.1037/1045-3830.23.2.169
5.
BuneviciusA., PeceliunieneJ., MickuvieneN., ValiusL., & BuneviciusR. (2007). Screening for depression and anxiety disorders in primary care patients.Depression and Anxiety24, 455–460. doi.org/10.1002/da.20274
6.
CampbellD. T., & FiskeD. W. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix.Psychological Bulletin56, 81–105. doi.org/10.1037/h0046016
7.
ChafouleasS. M., KilgusS. P., JafferyR., Riley-TillmanT. C., WelshM., & ChristT. J. (2013). Direct behavior rating as a school-based behavior screener for elementary and middle grades.Journal of School Psychology51, 367–385. doi:10.1016/j.jsp.2013.04.002
8.
CostelloE. J., ErkanliA., & AngoldA. (2006). Is there an epidemic of child or adolescent depression?Journal of Child Psychology and Psychiatry47, 1263–1271. doi:10.1111/j.1469-7610.2006.01682.x
9.
CoxM., GriffinM. M., HallR., OakesW. P., & LaneK. L. (2011). Using a functional assessment-based intervention to increase academic engaged time in an inclusive middle school setting.Beyond Behavior20, 44–54.
10.
CronbachL. J., & ShavelsonR. J. (2004). My current thoughts on coefficient alpha and successor procedures.Educational and Psychological Measurement64, 391–418. doi.org/10.1177/0013164404266386
11.
DrummondT. (1994). The Student Risk Screening Scale (SRSS).Grants Pass, OR: Josephine County Mental Health Program.
12.
FarmerT. W., IrvinM.J., MotocaL. M., LeungM. C., HutchinsB. C.BrooksD. S., & HallC. M. (2015). Externalizing and internalizing behavior problems, peer affiliations, and bullying involvement across the transition to middle school.Journal of Emotional and Behavioral Disorders23, 3–16. doi:10.1177/1063426613491286
13.
FiskeD. W., & CampbellD. T. (1992). Citations do not solve problems.Psychological Bulletin112, 393–395. doi.org/10.1037//0033-2909.112.3.393
14.
FornessS. R., FreemanS. F. N., PaparellaT., KauffmanJ. M., & WalkerH. M. (2012). Special education implications of point and cumulative prevalence for children with emotional or behavioral disorders.Journal of Emotional and Behavioral Disorders20, 4–18. doi.org/10.1177/1063426611401624
15.
GoodmanR. (1997). The Strengths and Difficulties Questionnaire: A research note.Journal of Child Psychology and Psychiatry38, 581–586. doi.org/10.1111/j.1469-7610.1997.tb01545.x
16.
HammJ. V., & FairclothB. S. (2005). The role of friendship in adolescents’ sense of school belonging.New Directions for Child and Adolescent Development107, 61–78. doi:10.1002/cd.121
17.
KalbergJ. R., LaneK. L., & LambertW. (2012). The utility of conflict resolution and social skills interventions with middle school students at risk for antisocial behavior: A methodological illustration.Remedial and Special Education22, 23–38. doi:l0.1177/0741932510362514
18.
KernL., Hilt-PanahonA., & MukherjeeA. A. (2013). Strategies to address internalizing behavior problems. In LaneK. L., CookB. G., & TankersleyM. (Eds.), Research-based strategies for improving outcomes in behavior (pp. 59–72). New York: Pearson.
19.
LaddG. W., Kochenderfer-LaddB., EggumN. D., KochelK. P., & McConnellE. M. (2011). Characterizing and comparing friendships of anxious-solidary and unsociable preadolescents.Child Development85, 1434–1453. doi:10.1111/j.1467-8624.2011.01632.x
20.
LaneK. L., BruhnA. L., EisnerS. L., & KalbergJ. R. (2010). Score reliability and validity of the Student Risk Screening Scale: A psychometrically-sound, feasible tool for use in urban middle schools.Journal of Emotional and Behavioral Disorders18, 211–224. doi:10.1177/1063426609349733
21.
LaneK. L., KalbergJ. R., LambertW., CrnoboriM., & BruhnA. (2010). A comparison of systematic screening tools for emotional and behavioral disorders: A replication.Journal of Emotional and Behavioral Disorders18, 100–112. doi.org/10.1177/1063426609341069
22.
LaneK. L., KalbergJ. R., & MenziesH. M. (2009). Developing schoolwide programs to prevent and manage problem behaviors: A step-by-step approach.New York: Guilford.
23.
LaneK. L., KalbergJ. R., ParksR. J., & CarterE. W. (2008). Student Risk Screening Scale: Initial evidence for score reliability and validity at the high school level.Journal of Emotional and Behavioral Disorders16, 178–190. doi:10.1177/1063426608314218
24.
LaneK. L., LittleM. A., CaseyA. M., LambertW., WehbyJ. H., WeisenbachJ. L., & PhillipsA. (2009). A comparison of systematic screening tools for emotional and behavioral disorders: How do they compare?Journal of Emotional and Behavioral Disorders17, 93–105. doi: 10.1177/1063426609341069
25.
LaneK. L., & MenziesH. M. (2009). Student Risk Screening Scale for Early Internalizing and Externalizing Behavior (SRSS-IE). Retrieved from http://www.ci3t.org/screening#srssie.
26.
LaneK. L., MenziesH. M., OakesW. P., LambertW., CoxM. L., & HankinsK. (2012). A validation of the Student Risk Screening Scale for Internalizing and Externalizing Behaviors: Patterns in rural and urban elementary schools.Behavioral Disorders37, 244–270.
27.
LaneK. L., & OakesW. P. (2010). Social validity: Screening tool rating scale. Unpublished rating scale.
28.
LaneK. L., OakesW. P., CantwellE. D., MenziesH. M., SchatschneiderC., LambertW., & CommonE. A. (2016). Psychometric evidence of SRSS-IE scores in middle and high schools. Manuscript in preparation.
29.
LaneK. L., OakesW. P., CarterE. W., LambertW., & JenkinsA. (2013). Initial evidence for the reliability and validity of the Student Risk Screening Scale for Internalizing and Externalizing Behaviors at the middle school level.Assessment for Effective Intervention39, 24–38. doi:10.1177/1534508413489336
30.
LaneK. L., OakesW. P., EnnisR. P., CoxM. L., SchatschneiderC., & LambertW. (2013). Additional evidence for the reliability and validity of the Student Risk Screening Scale at the high school level: A replication and extension.Journal of Emotional and Behavioral Disorders21, 97–115. doi:10.1177/1063426611407339
31.
LaneK. L., OakesW. P., EnnisR. P., & HirschS. E. (2014). Identifying students for secondary and tertiary prevention efforts: How do we determine which students have Tier 2 and Tier 3 needs?Preventing School Failure58, 171–182. doi:10.1080/1045988X.2014.895573
32.
LaneK. L., OakesW. P., HarrisP. J., MenziesH. M., CoxM. L., & LambertW. (2012) Initial evidence for the reliability and validity of the Student Risk Screening Scale for Internalizing and Externalizing Behaviors at the elementary level.Behavioral Disorders, 37, 99–122.
33.
LaneK. L., OakesW. P., LuskM. E., CantwellE. D., & SchatschneiderC. (2015). Screening for intensive intervention needs at the secondary level: Directions for the future.Journal of Emotional and Behavioral Disorders.doi:10.1177/1063426615618624
34.
LaneK. L., OakesW. P., SwoggerE. D., SchatschneiderC., MenziesH.M., & SanchezJ. (2015). Student Risk Screening Scale for Internalizing and Externalizing Behaviors: Preliminary cut scores to support data-informed decision making.Behavioral Disorders40, 159–170. doi:10.17988/0198-7429-40.3.159
35.
LaneK. L., ParksR. J., KalbergJ. R., & CarterE. W. (2007). Systematic screening at the middle school level: Score reliability and validity of theStudent Risk Screening Scale. Journal of Emotional and Behavioral Disorders15, 209–222. doi: 10.1177/10634266070150040301
36.
LaneK. L., & WalkerH. M. (2015). The connection between assessment and intervention: How does screening lead to better interventions? In BatemanB., TankersleyM., & LloydJ. (Eds.), Issues in special education.New York: Routledge.
37.
MaleckiC. K., & ElliottS. N. (2002). Children's social behaviors as predictors of academic achievement: A longitudinal analysis.School Psychology Quarterly17, 1–23. doi.org/10.1521/scpq.17.1.1.19902
38.
McDougallP., & VaillancourtT. (2015). Long-term adult outcomes of peer victimization in childhood and adolescence: Pathways to adjustment and maladjustment.American Psychologist70, 300–310. doi:10.1037/a0039174
39.
McIntoshK., CampbellA. L., CarterD. R., & ZumboB. D. (2009). Concurrent validity of office discipline referrals and cut points used in schoolwide positive behavior support.Behavioral Disorders34, 100–113.
40.
MenziesH. M., & LaneK. L. (2012). Validity of the student risk screening scale: Evidence of predictive validity in a diverse, suburban elementary setting.Journal of Emotional and Behavioral Disorders20, 82–91. doi:10.1177/1063426610389613
41.
OakesW. P., LaneK. L., CoxM., & MessengerM. (2014). Logistics of behavior screenings: How and why do we conduct behavior screenings at our school?Preventing School Failure58, 159–170. doi:10.1080/1045988X.2014.895572
42.
PetrasH., ChilcoatH., LeafP. J., IalongoN. S., & KellamS. G. (2004). Utility of TOCA-R scores during the elementary school years in identifying later violence among adolescent males.Journal of the American Academy of Child and Adolescent Psychiatry43, 88–96. doi.org/10.1097/00004583-200401000-00018
43.
RubinK. H., BukowskiW. M., & ParkerJ. G. (2007). Peer interactions, relationships, and groups.Handbook of child psychology (pp. 571–645). Hoboken, NJ: Wiley. doi:10.1002/9780470147658.chpsy0310
44.
SimonsenB., MacSuga-GageA. S., BriereD. E., FreemanJ., MyersD., ScottT. M., & SugaiG. (2014). Multitiered support framework for teachers’ classroom-management practices: Overview and case study of building the triangle for teachers.Journal of Positive Behavior Interventions16, 179–190. doi:10.1177/1098300713484062
45.
VannestK. J., ReynoldsC. R., & KamphausR. W. (2008). BASC-2 Intervention Guide for Behavioral and Emotional Issues.San Antonio, TX: Pearson Education.
46.
WalkerH. M., FornessS. R., & LaneK. L. (2014). Design and management of scientific research in applied school settings. In CookB., TankersleyM., & LandrumT. (Eds.) Advances in learning and behavioral disabilities (Vol. 27, pp. 141–169). Bingley, UK: Emerald.
