A Comparison Between SRSS-IE and BASC-2 BESS Scores at the Middle School Level

Abstract

We report findings of a psychometric study comparing scores from two screening tools: Student Risk Screening Scale–Internalizing and Externalizing (SRSS-IE, an adapted version of the Student Risk Screening Scale) and Behavior Assessment System for Children–Second Edition, Behavioral and Emotional Screening System (BASC-2 BESS). Participants were 624 sixth-, seventh-, and eighth-grade students attending a rural middle school in a southeastern state. Pearson correlation coefficients indicated statistically significant, positive relations between SRSS-IE and BASC-2 BESS scores, with very strong relations on externalizing and comorbid (internalizing and externalizing) scales. Results of concurrent classification accuracy analyses, kappa, and receiver operating curve analyses suggest the seven externalizing items on the SRSS (SRSS-E7) and BASC-2 BESS scores function in a similar manner with respect to detecting students with externalizing behaviors, but less so in detecting students with internalizing behaviors. Limitations and future direction are discussed.

Keywords

systematic screening internalizing and externalizing behavior emotional and behavioral disorders middle schools

Get full access to this article

View all access options for this article.

References

Achenbach

T. M

. (1991a). Integrative guide for the 1991 CBCL/4-18, YRS, & TRF profiles. Burlington, VT: Department of Psychiatry, University of Vermont.

Achenbach

T. M.

(1991b). Manual for the child behavior checklist/4-18 and 1991 profile. Burlington, VT: Department of Psychiatry, University of Vermont.

Akos

Queen

J. A.

Lineberry

(2005). Promoting a successful transition to middle school. Larchmont, NY: Eye on Education.

Bellmore

(2011). Peer rejection and unpopularity: Associations with GPAs across the transition to middle school. Journal of Educational Psychology, 103, 282–295. doi:10.1037/a0023312

Bennett

K. J.

Offord

D. R.

(2001). Screening for conduct problems: Does the predictive accuracy of conduct disorder symptoms improve with age? Journal of the American Academy of Child and Adolescent Psychiatry, 40, 1418–1425.

Bradshaw

C. P.

Buckley

J. A.

Ialongo

N. S

. (2008). School-based service utilization among urban children with early onset educational and mental health problems: The squeaky wheel phenomenon. School Psychology Quarterly, 23, 169–186. doi:10.1037/1045-3830.23.2.169

Bunevicius

Peceliuniene

Mickuviene

Valius

Bunevicius

(2007). Screening for depression and anxiety disorders in primary care patients. Depression and Anxiety, 24, 455–460.

Cartwright-Hatton

McNicol

Doubleday

(2006). Anxiety in a neglected population: Prevalence of anxiety disorders in pre-adolescent children. Clinical Psychology Review, 26, 817–833. doi:10.1016/j.cpr.2005.12.002

Cauley

K. M.

Jovanovich

(2006). Developing an effective transition program for students entering middle school or high school. The Clearing House: A Journal of Educational Strategies, Issues and Ideas, 80, 15–25. doi:10.3200/TCHS.80.1.15-25

10.

Chin

J. K.

Dowdy

Quirk

M. P.

(2013). Universal screening in middle school: Examining the behavioral and emotional screening system. Journal of Psychoeducational Assessment, 31, 53–60. doi:10.1177/0734282912448137

11.

Cohen

(1968). Weighted kappa: Nominal scale agreement provision for scaled disagreement or partial credit. Psychological Bulletin, 70, 213–220.

12.

Dever

B. V.

Mays

K. L.

Kamphaus

R. W.

Dowdy

(2012). The factor structure of the BASC-2 behavioral and emotional screening system teacher form, child/adolescent. Journal of Psychoeducational Assessment, 30, 488–495. doi:10.1177/0734282912438869

13.

Dowdy

Chin

J. K.

Twyford

J. M.

Dever

B. V.

(2011). A factor analytic investigation of the BASC-2 behavioral and emotional screening system parent form: Psychometric properties, practical implications, and future directions. Journal of School Psychology, 49, 265–280. doi:10.1016/j.jsp.2011.03.00

14.

Drummond

(1994). The Student Risk Screening Scale (SRSS). Grants Pass, OR: Josephine County Mental Health Program.

15.

Eklund

Renshaw

T. L.

Dowdy

Jimerson

S. R.

Hart

S. R.

Jones

C. N.

Earhart

(2009). Early identification of behavioral and emotional problems in youth: Universal screening versus teacher-referral identification. The California School Psychologist, 14, 89–95.

16.

Elliott

S. N.

Gresham

(2017). Social Skills Improvement System (SSiS)—Social emotional learning. San Antonio, TX: PsychCorp Pearson Education.

17.

Forness

Freeman

Paperella

Kauffman

Walker

. (2012). Special education implications of point and cumulative prevalence for children with emotional and behavioral disorder. Journal of Emotional and Behavioral Disorders, 20(1), 4–18. doi:10.1177/1063426611401624

18.

Forstmeier

Maercker

(2007). Comparison of two diagnostic systems for complicated grief. Journal of Affective Disorders, 99, 203–211.

19.

Fuchs

L. S.

Fuchs

Compton

. (2010). Rethinking response to intervention at middle and high school. School Psychology Review, 39(1), 22–28.

20.

Gandhi

Lane

K. L.

Kilgus

(2018, March). The role of behavior screening in tiered systems of support. Paper presented at the 15th International Conference on Positive Behavior Support, San Diego, CA.

21.

Glover

T. A.

Albers

C. A.

(2007). Considerations for evaluating universal screening assessment. Journal of School Psychology, 45, 117–135. doi:10.1016/j.jsp.2006.05.005

22.

Goodman

(2001). Psychometric properties of the Strengths and Difficulties Questionnaire (SDQ). Journal of the American Academy of Child and Adolescent Psychiatry, 40, 1337–1345. doi:10.1097/00004583-200111000-00015

23.

Harrison

J. R.

Vannest

K. J.

Reynolds

C. R.

(2013). Social acceptability of five screening instruments for social, emotional, and behavioral challenges. Behavioral Disorders, 38, 171–189.

24.

Hopkins

W. G.

(2001). A scale of magnitudes for effect statistics. Retrieved from http://www.sportsci.org/resource/stats/effectmag.html

25.

Horner

R. H.

Sugai

(2015). School-wide PBIS: An example of applied behavior analysis implemented at a scale of social importance. Behavior Analysis in Practice, 8, 80–85. doi:10.1007/s40617-015-0045-4

26.

Individuals with Disabilities Education Improvement Act of 2004, 20 U.S.C. 1400 et esq. (2004).

27.

Kamphaus

R. W.

Reynolds

C. R.

(2007). BASC-2 Behavioral and Emotional Screening System (BASC-2 BESS). San Antonio, TX: Pearson.

28.

Kamphaus

R. W.

Reynolds

C. R.

(2015). Behavior Assessment System for Children–Third edition (BASC-3): Behavioral and Emotional Screening System (BESS). Bloomington, MN: Pearson.

29.

Kilgus

S. P.

Chafouleas

S. M.

Riley-Tillman

T. C.

von der Embse

N. P.

(2014). Social, Academic, and Emotional Behavior Risk Screener (SAEBRS). Minneapolis, MN: Theodore J. Christ & Colleagues.

30.

Kraemer

H. C.

(1992). Evaluating medical tests: Objective and quantitative guidelines. Newbury Park, CA: SAGE.

31.

Lane

K. L.

Little

M. A.

Casey

A. M.

Lambert

Wehby

J. H.

Weisenbach

J. L.

Phillips

(2009). A comparison of systematic screening tools for emotional and behavioral disorders: How do they compare? Journal of Emotional and Behavioral Disorders, 17, 93–105.

32.

Lane

K. L.

Menzies

H. M.

(2009). Student Risk Screening Scale for Early Internalizing and Externalizing behavior (SRSS-IE). Unpublished rating scale.

33.

Lane

K. L.

Menzies

H. M.

Oakes

W. P.

Kalberg

J. R.

(2012). Systematic screenings of behavior to support instruction: From preschool to high school. New York, NY: Guilford Press.

34.

Lane

K. L.

Menzies

H. M.

Oakes

W. P.

Lambert

Cox

M. L.

Hankins

(2012). A validation of the Student Risk Screening Scale for internalizing and externalizing behaviors: Patterns in rural and urban elementary schools. Behavioral Disorders, 37, 244–270.

35.

Lane

K. L.

Oakes

W. P.

Cantwell

E. D.

Menzies

H. M.

Schatschneider

Lambert

Common

E. A.

(2017). Psychometric evidence of SRSS-IE scores in middle and high schools. Journal of Emotional and Behavioral Disorders, 25, 233–245. doi:10.1177/1063426616670862

36.

Lane

K. L.

Oakes

W. P.

Cantwell

E. D.

Schatschneider

Menzies

Crittenden

Messenger

(2016). Student Risk Screening Scale for internalizing and externalizing behaviors: Preliminary cut scores to support data-informed decision making in middle and high schools. Behavioral Disorders, 42, 271–284. doi:10.17988/BD-16-115.1

37.

Lane

K. L.

Oakes

W. P.

Carter

E. W.

Lambert

Jenkins

(2013). Initial evidence for the reliability and validity of the Student Risk Screening Scale for internalizing and externalizing behaviors at the middle school level. Assessment for Effective Intervention, 39, 24–38. doi:10.1177/1534508413489336

38.

Lane

K. L.

Oakes

W. P.

Carter

E. W.

Messenger

(2015). Examining behavioral risk and academic performance for students transitioning from elementary to middle school. Journal of Positive Behavior Interventions, 17, 39–49. doi:10.1177/1098300714524825

39.

Lane

K. L.

Oakes

W. P.

Common

E. A.

Zorigian

Brunsting

Schatschneider

(2015). A comparison between SRSS-IE and SSiS-PSG scores: Examining convergent validity. Assessment for Effective Intervention, 40, 114–126. doi:10.1177/1534508414560346

40.

Lane

K. L.

Oakes

W. P.

Ennis

R. P.

Royer

D. J.

(2015). Additional evidence of convergent validity between SRSS-IE and SSiS-PSG scores. Behavioral Disorders, 40, 213–229.

41.

Lane

K. L.

Oakes

W. P.

Harris

P. J.

Menzies

H. M.

Cox

M. L.

Lambert

(2012). Initial evidence for the reliability and validity of the Student Risk Screening Scale for internalizing and externalizing behaviors at the elementary level. Behavioral Disorders, 37, 99–122. doi:10.1177/019874291203700204

42.

McIntosh

Filter

K. J.

Bennett

J. L.

Ryan

Sugai

(2010). Principles of sustainable prevention: Designing scale-up of school-wide positive behavior support to promote durable systems. Psychology in the Schools, 47, 5–21. doi:10.1002/pits.20448

43.

McIntosh

Flannery

K. B.

Sugai

Braun

D. H.

Cochrane

K. L.

(2008). Relationships between academics and problem behavior in the transition from middle school to high school. Journal of Positive Behavior Interventions, 10, 243–255. doi:10.1177/1098300708318961

44.

McIntosh

Frank

J. L.

Spaulding

S. A.

(2010). Establishing research-based trajectories of office discipline referrals for individual students. School Psychology Review, 39, 380–394.

45.

McIntosh

Goodman

. (2015). Integrating multi-tiered systems of support: Blending RTI and PBIS. New York, NY. Guilford Press.

46.

McIntosh

S. V.

Miller

L. D.

(2014). Effects of school-wide positive behavioral interventions and supports on internalizing problems: Current evidence and future direction. Journal of Positive Behavior Interventions, 16, 209–218. doi:10.1177/1098300713491980

47.

Miller

F. G.

Cohen

Chafouleas

S. M.

Riley-Tillman

T. C.

Welsh

M. E.

Fabiano

G. A.

(2015). A comparison of measures to screen for social, emotional, and behavioral risk. School Psychology Quarterly, 30, 184–196.

48.

Mullins

E. R.

Irvin

J. L.

(2000). Transition into middle school. Middle School Journal, 31, 57–60.

49.

National Center for Education Statistics. (n.d.). Identification of rural locales. Washington, DC: Institute of Education Sciences, U.S. Department of Education. Retrieved from http://nces.ed.gov/ccd/rural_locales.asp

50.

Nelson

J. R.

Benner

G. J.

Lane

Smith

B. W

. (2004). Academic achievement of K-12 students with emotional and behavioral disorders in public school settings. Exceptional Children, 71, 59–73. doi:10.1177/001440290407100104

51.

No Child Left Behind Act of 2001, Pub. L. No. 107-100 § 115 Stat. 1425 (2002).

52.

Nordness

P. D.

Epstein

M. H.

Cullinan

Pierce

C. D.

(2014). Emotional and behavioral screener: Test-retest reliability, inter-rater reliability, and convergent validity. Remedial and Special Education, 35, 211–217.

53.

Oakes

W. P.

Lane

K. L.

Cantwell

E. D.

Royer

D. J.

(2017). Systematic screening for behavior in K-12 settings as regular school practice: Practical considerations and recommendations. Journal of Applied School Psychology, 33, 369–393. doi:10.1080/15377903.2017.1345813

54.

Oakes

W. P.

Lane

K. L.

Common

E. A.

Buckman

M. M

. (in press). Systematic screening for behavior in early childhood settings: Early identification and intervention. Perspectives in Early Childhood Psychology and Education.

55.

Reinke

W. M.

Herman

K. C.

Petras

Ialongo

N. S.

(2008). Empirically derived subtypes of child academic and behavior problems: Co-occurrence and distal outcomes. Journal of Abnormal Child Psychology, 36, 759–770. doi:10.1007/s10802-007-9208-2

56.

Renshaw

T. L.

Eklund

Dowdy

Jimerson

S. R.

Hart

S. R.

Earhart

Jones

C. N.

(2009). Examining the relationship between scores on the Behavioral and Emotional Screening System and student academic, behavioral, and engagement outcomes: An investigation of concurrent validity in elementary school. California School Psychologist, 14, 81–88.

57.

Reynolds

C. R.

Kamphaus

R. W.

(2006). BASC-2: Behavior Assessment System for Children (2nd ed.). Upper Saddle River, NJ: Pearson Education.

58.

Reynolds

C. R.

Kamphaus

R. W.

(2009). Behavior assessment system for children progress monitor (2nd ed.). Minneapolis, MN: NCS Pearson.

59.

Theriot

M. T.

Dupper

D. R.

(2010). Student discipline problems and the transition from elementary to middle school. Education and Urban Society, 42, 205–222. doi:10.1177/0013124509349583

60.

U.S. Department of Education. (2011). Common core of data 2011. Washington, DC: Institute of Education Sciences, National Center for Education Statistics.

61.

Vannest

K. J.

Reynolds

Kamphaus

(2008). BASC-2 intervention guide for learning and behavior problems. Minneapolis, MN: Pearson.

62.

Walker

H. M.

Ramsey

Gresham

F. M

. (2004). Antisocial behavior in school: Evidence-based practices (2nd ed.). Belmont, CA: Wadsworth.

63.

Walker

H. M.

Severson

H. H.

Feil

E. G.

(2014). Systematic Screening for Behavior Disorders (SSBD) (2nd ed.). Eugene, OR: Pacific Northwest Publishing.