Developing a Brief Behavior Rating Scale for Progress Monitoring of Depression in School Settings

Abstract

Frequent formative assessment of students’ functioning, or progress monitoring, is a critical component of multi-tiered systems of support as data inform data-driven decisions about response to treatment. Progress monitoring tools for students’ academic and behavioral functioning are readily available and widely researched; however, despite the documented prevalence of depressive disorders among youth and that schools have been put forth as an ideal location for the delivery of mental health services, there are currently no progress monitoring tools to examine students’ response to interventions that target depression. To address this gap, this study sought to develop a progress monitoring assessment of students’ depressive symptoms using an empirically informed model for creating Brief Behavior Rating Scales (BBRS). Using this model, a four-item BBRS of depressive symptoms (BBRS-D) was created from the item pools of the Beck Depression Inventory for Youth (BDI-Y) and Children’s Depression Inventory (CDI) administered during a treatment study of depression in female youth; the resulting short scale corresponds well to the full-length assessments (i.e., r = .65 and r = .59); however, the BBRS-D possessed lower than adequate internal consistency (α = .50) and test–retest reliability (r = .56). Limitations and future directions are discussed.

Keywords

progress monitoring rating scales emotional/behavioral disorders

Get full access to this article

View all access options for this article.

References

American Educational Research Association, American Psychological Association, National Council on Measurement in Education, Joint Committee on Standards for Educational, & Psychological Testing. (1999). Standards for educational and psychological testing. Washington, DC: American Educational Research Association.

American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). Arlington, VA: American Psychiatric Publishing.

Angold

Costello

E. J.

(2001). Epidemiology of depression in children and adolescents. In Goodyer

(Ed.), The depressed child and adolescent (2nd ed. pp. 143–178). Cambridge, UK: Cambridge University Press.

Ardoin

S. P.

Christ

T. J.

(2009). Curriculum-based measurement of oral reading: Estimates of standard error when monitoring progress using alternate passage sets. School Psychology Review, 38, 266–283.

Arora

P. G.

Nastasi

Leff

S. S.

(2017). Rationale for the cultural construction of school mental health programming. International Journal of School & Educational Psychology, 5, 141–151.

Avenevoli

Swendsen

J. P.

Burstein

Merikangas

K. R.

(2015). Major depression in the national comorbidity survey-adolescent supplement: Prevalence, correlates, and treatment. Journal of the American Academy of Child and Adolescent Psychiatry, 54, 37–44.

Beck

J. S.

Beck

A. T.

Jolly

J. B.

(2001). Beck Youth Inventories. San Antonio, TX: Psychological Corporation.

Carnevale

T. D.

(2013). Universal adolescent depression prevention programs: A review. The Journal of School Nursing, 29, 181–195.

Center for Behavioral Health Statistics and Quality. (2015). Behavioral health trends in the United States: Results from the 2014 National Survey on Drug Use and Health (HHS Publication No. SMA 15-4927, NSDUH Series H-50). Retrieved from http://www.samhsa.gov/data/

10.

Chafouleas

S. M.

Volpe

R. J.

Gresham

F. M.

Cook

C. R.

(2010). School-based behavioral assessment within problem-solving models: Current status and future directions. School Psychology Review, 39, 343–349.

11.

Christ

T. J.

Riley-Tillman

T. C.

Chafouleas

S. M.

(2009). Foundation for the development and use of Direct Behavior Rating (DBR) to assess and evaluate student behavior. Assessment for Effective Intervention, 34, 201–213.

12.

Clarke

G. N.

Lewinsohn

P. M.

Hops

(1990). Instructor’s manual for the adolescent coping with depression course (The therapist manual and the adolescent workbook may be downloaded for free from the Internet at http://www.kpchr.org/acwd/acwd.html). Eugene, OR: Castalia.

13.

Cohen

(1992). A power primer. Psychological Bulletin, 112, 155–159.

14.

Cohen

Kasen

Velez

C. N.

Hartmark

Johnson

. . . Streuning

E. L.

(1993). An epidemiological study of disorders in late childhood and adolescence—I. Age- and gender-specific prevalence. Journal of Child Psychology and Psychiatry, 34, 851–867.

15.

Cook

C. R.

Rasetshwane

K. B.

Truelson

Grant

Dart

E. H.

Collins

T. A.

Sprague

(2011). Development and validation of the student internalizing behavior screener: Examination of reliability, validity, and classification accuracy. Assessment for Effective Intervention, 36, 71–79. doi:10.1177/1534508410390486

16.

Cook

C. R.

Volpe

R. J.

Delport

(2013). Systematic progress monitoring of students with emotional and behavioral disorders: The promise of change-sensitive brief behavior rating scales. In Walker

H. M.

Gresham

F. M.

(Eds.), Handbook of evidence-based practices for emotional and behavioral disorders: Applications in schools (pp. 211–228). New York, NY: Guilford Press.

17.

Costello

E. J.

J. P.

Sampson

N. A.

Kessler

R. C.

Merikangas

K. R.

(2014). Services for adolescents with psychiatric disorders: 12-month data from the National Comorbidity Survey-Adolescent. Psychiatric Services, 65, 359–366.

18.

Cronbach

L. J.

(1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16, 297–334.

19.

Cunningham

J. M.

Suldo

S. M.

(2014). Accuracy of teachers in identifying elementary school students who report at-risk levels of anxiety and depression. School Mental Health, 6, 237–250. doi:10.1007/s12310-014-9125-9

20.

Dart

E. H.

Arora

P. G.

Collins

T. A.

Doll

(under review). Progress Monitoring Measures for Internalizing Symptoms: A Systematic Review of the Literature. School Mental Health.

21.

David-Ferdon

Kaslow

N. J.

(2008). Evidence-based psychosocial treatments for child and adolescent depression. Journal of Clinical Child & Adolescent Psychology, 37, 62–104. doi:10.1080/15374410701817865

22.

de Vet

H. C.

Terwee

C. B.

Bouter

L. M

. (2003). Current challenges in clinimetrics. Journal of Clinical Epidemiology, 56, 1137–1141.

23.

Doerfler

L. A.

Felner

R. D.

Rowlison

R. T.

Raley

P. A.

Evans

(1988). Depression in children and adolescents: A comparative analysis of the utility and construct validity of two assessment measures. Journal of Consulting and Clinical Psychology, 56, 769–772.

24.

Faulstich

M. E.

Carey

M. P.

Ruggiero

Enyart

Gresham

(1986). Assessment of depression in childhood and adolescence: An evaluation of the Center for Epidemiological Studies Depression Scale for Children (CES-DC). The American Journal of Psychiatry, 143, 1024–1027.

25.

Fuchs

L. S.

Fuchs

(2011). Using CBM for progress monitoring in reading. Washington, DC: National Center on Student Progress Monitoring.

26.

Galambos

Leadbeater

Barker

(2004). Gender differences in and risk factors for depression in adolescence: A 4-year longitudinal study. International Journal of Behavioral Development, 28, 16–25.

27.

Gresham

F. M.

Cook

C. R.

Collins

Dart

Rasetshwane

Truelson

Grant

(2010). Developing a change-sensitive brief behavior rating scale as a progress monitoring tool for social behavior: An example using the social skills rating system-teacher form. School Psychology Review, 39, 364–379.

28.

Gould

M. S.

King

Greenwald

Fisher

Schwab-Stone

Kramer

… & Shaffer

(1998). Psychopathology associated with suicidal ideation and attempts among children and adolescents. Journal of the American Academy of Child & Adolescent Psychiatry, 37, 915-923.

29.

Hankin

B. L.

Abramson

L. Y.

(2001). Development of gender differences in depression: An elaborated cognitive vulnerability-transactional stress theory. Psychological Bulletin, 127, 773–796.

30.

Hawken

L. S.

Vincent

C. G.

Schumann

(2008). Response to intervention for social behavior: Challenges and opportunities. Journal of Emotional and Behavioral Disorders, 16, 213-225.

31.

Herman

K. C.

Merrell

K. W.

Reinke

W. M.

Tucker

C. M.

(2004). The role of school psychology in preventing depression. Psychology in the Schools, 41, 763–775.

32.

Huang

Stroul

Friedman

Mrazek

Friesen

Pires

Mayberg

(2005). Transforming mental health care for children and their families. American Psychologist, 60, 615–627.

33.

IBM Corp. Released. (2012). IBM SPSS statistics for Windows (Version 21.0). Armonk, NY: IBM Corp.

34.

Kazdin

A. E.

Weisz

J. R.

(1998). Identifying and developing empirically supported child and adolescent treatments. Journal of Consulting and Clinical Psychology, 66, 19–36.

35.

Kovacs

(1992). Children’s Depression Inventory. North Tonawanda, NY: Multi-Health Systems.

36.

Lewinsohn

P.M.

Roberts

R.E.

Seeley

J.R.

Rohde

Gotlib

I.H.

Hops

(1994). Adolescent psychopathology: II. Psychosocial risk factors for depression. Journal of Abnormal Psychology, 103, 302-315.

37.

Maag

J. W.

Swearer

S. M.

Toland

M. D.

(2009). Cognitive-behavioral interventions for depression in children and adolescents: Meta-analysis, promising programs, and implications for school personnel. In Mayer

M. J.

Lochman

J. E.

Van Acker

(Eds.), Cognitive-behavioral interventions for emotional and behavioral disorders: School-based practice (pp. 235–265). New York, NY: Guilford Press.

38.

McCarty

C. A.

Violette

H. D.

Duong

M. T.

Cruz

R. A.

McCauley

(2013). A randomized trial of the positive thoughts and action program for depression among early adolescents. Journal of Clinical Child & Adolescent Psychology, 42, 554–563.

39.

McIntosh

S. V.

Miller

L. D.

(2014). Effects of school-wide positive behavioral interventions and supports on internalizing problems: Current evidence and future directions. Journal of Positive Behavior Interventions, 16, 209–218.

40.

Merikangas

K. R.

J. P.

Burstein

Swanson

S. A.

Avenevoli

Cui

. . . Swendsen

(2010). Lifetime prevalence of mental disorders in U.S. adolescents: Results from the National Comorbidity Survey Replication–Adolescent Supplement (NCS-A). Journal of the American Academy of Child and Adolescent Psychiatry, 49, 980–989.

41.

Merrell

K. W.

(2013). Helping students overcome depression and anxiety: A practical guide. New York, NY: Guilford Publications.

42.

Nunnally

J. C.

Bernstein

I. H.

(1994). The assessment of reliability. Psychometric Theory, 3, 248–292.

43.

Patel

P. G.

Stark

K. D.

Metz

K. L.

Banneyer

K. N.

(2014). School-based interventions for depression. In Weist

M. S.

Lever

N. A.

Bradshaw

C. P.

Owens

J. S.

(Eds.), Handbook of school mental health (pp. 369–385). New York, NY: Springer.

44.

Renshaw

T. L.

Cook

C. R.

(2018). Initial development and validation of the youth internalizing problems screener. Journal of Psychoeducational Assessment, 36, 366–378.

45.

Rones

Hoagwood

(2000). School-based mental health services: A research review. Clinical Child and Family Psychology Review, 3, 223–241.

46.

Ruffalo

Fischer

(2009). Using an evidence-based CBT group intervention model for adolescents with depressive symptoms: Lessons learned from a school-based adaptation. Child & Family Social Work, 14, 189–197.

47.

Sheridan

S. M.

Eagle

J. W.

Cowan

R. J.

Mickelson

(2001). The effects of conjoint behavioral consultation results of a 4-year investigation. Journal of School Psychology, 39, 361–385.

48.

Smucker

M. R.

Craighead

W. E.

Craighead

L. W.

Green

B. J.

(1986). Normative and reliability data for the Children’s Depression Inventory. Journal of Abnormal Child Psychology, 14, 25–39.

49.

Stapleton

L. M.

Sander

J. B.

Stark

K. D.

(2007). Psychometric properties of the Beck Depression Inventory for Youth in a sample of girls. Psychological Assessment, 19, 230–235.

50.

Stark

K. D.

Arora

Funk

(2011). CBT for youth depression: Implications for training school psychologists to become cognitive behavioral therapists. Psychology in the Schools, 48, 272–282.

51.

Stark

K. D.

Streusand

Arora

Patel

(2011). Treatment of childhood depression: The ACTION treatment program. In Kendall

P. C.

(Ed.), Child and adolescent therapy: Cognitive behavioral procedures (4th ed.; pp. 190–233). New York, NY: Guilford Press.

52.

Stice

Shaw

Bohon

Marti

C. N.

Rohde

(2009). A meta-analytic review of depression prevention programs for children and adolescents: Factors that predict magnitude of intervention effects. Journal of Consulting and Clinical Psychology, 77, 486–503. doi:10.1037/a0015168

53.

von der Embse

N. P.

Scott

E. C.

Kilgus

S. P

. (2015). Sensitivity to change and concurrent validity of direct behavior ratings for academic anxiety. School Psychology Quarterly, 30, 244–259.

54.

Weisz

J. R.

Thurber

Sweeney

Proffitt

V. D.

LeGagnoux

G. L.

(1997). Brief treatment of mild-to-moderate child depression using primary and secondary control enhancement training. Journal of Consulting and Clinical Psychology, 65, 703–707.