Measurement Properties of the Thought Disturbance Scale of the MAYSI-2: An Assessment of Its Appropriateness for Girls

Abstract

Studies informing gender-responsive programming in the juvenile justice system reveal high levels of mental health problems amongst girls; however, relatively neglected has been attention to thought disturbances. A major impediment in this regard is that the Thought Disturbance subscale of the Massachusetts Youth Screening Instrument-2 (MAYSI-2), the most widely used screening measure for mental health problems amongst detained youth, was not deemed reliable for use with girls in the original validation studies. Given the pervasive use of the MAYSI-2 and the importance of identifying thought disturbance amongst girls, a more robust evaluation is needed. An evaluation of the measurement properties, including confirmatory factor analysis, item response theory, and measurement invariance models, was conducted in a sample of 5615 detained youth. Findings suggested that the Thought Disturbance subscale may be suitable for mental health screening with girls.

Keywords

MAYSI-2 screening thought disturbance gender comparison factor analysis

Get full access to this article

View all access options for this article.

References

Abram

K. M.

Teplin

L. A.

McClelland

G. M.

Dulcan

M. K.

(2003). Comorbid psychiatric disorders in youth in juvenile detention. Archives of General Psychiatry, 60(11), 1097–1108. https://doi.org/10.1001/archpsyc.60.11.1097

American Psychological Association . (2002). Ethical principles of psychologists and code of conduct. American Psychologist, 57(12), 1060–1073. https://doi.org/10.1037/0003-066x.57.12.1060

Anderson

V. R.

Walerych

B. M.

(2019). Contextualizing the nature of trauma in the juvenile justice trajectories of girls. Journal of Prevention & Intervention in the Community, 47(2), 138–153. https://doi.org/10.1080/10852352.2019.1582141

Anderson

V. R.

Walerych

B. M.

Campbell

N. A.

Barnes

A. R.

Davidson

W. S.

Campbell

C. A.

Onifade

Petersen

J. L.

(2019). Gender-responsive intervention for female juvenile offenders: A quasi-experimental outcome evaluation. Feminist Criminology, 14(1), 24–44. https://doi.org/10.1177/1557085116677749

Archer

R. P.

Simonds-Bisbee

E. C.

Spiegel

D. R.

Handel

R. W.

Elkins

D. E.

(2010). Validity of the Massachusetts youth screening instrument–2 (MAYSI–2) scales in juvenile justice settings. Journal of Personality Assessment, 92(4), 337–348. https://doi.org/10.1080/00223891.2010.482009

Archer

R. P.

Stredny

R. V.

Mason

J. A.

Arnau

R. C.

(2004). An examination and replication of the psychometric properties of the Massachusetts Youth Screening Instrument-(MAYSI-2) among adolescents in detention settings. Assessment, 11(4), 290–302. https://doi.org/10.1177/1073191104269863

Arciniegas

D. B.

(2015). Psychosis. Continuum, 21(3 Behavioral Neurology and Neuropsychiatry), 715–736. https://doi.org/10.1212/01.CON.0000466662.89908.e7

Baker

F. B.

(2001). The basics of item response theory (2nd ed.) ERIC Clearinghouse on Assessment and Evaluation.

Bendall

Eastwood

Spelman

McGorry

Hickie

Yung

A. R.

Amminger

Wood

S. J.

Pantelis

Purcell

Phillips

(2023). Childhood trauma is prevalent and associated with co-occurring depression, anxiety, mania and psychosis in young people attending Australian youth mental health services. Australian and New Zealand Journal of Psychiatry, 57(12), 1518–1526. https://doi.org/10.1177/00048674231177223

10.

Bentler

P. M.

(1990). Comparative fit indexes in structural models. Psychological Bulletin, 107(2), 238–246. https://doi.org/10.1037/0033-2909.107.2.238

11.

Bock

R. D.

Mislevy

R. J.

(1982). Estimating item parameters and ability parameters in item response theory. Psychometrika, 47(2), 253–271. https://doi.org/10.1007/BF02293801

12.

Campos

T. R. L.

(2014). Massachusetts Youth Screening Instrument-2 (MAYSI-2): Relationships with the Posttraumatic Stress Disorder Checklist - Civilian Version (Modified version) among youth from the community and detention facilities ProQuest Dissertations & Theses.

13.

Caplan

(2009). Cognitive dysfunction and other comorbidities. Language and communication disorders. In Encyclopedia of basic epilepsy research (pp. 176–180). Elsiver Ltd. https://doi.org/10.1016/B978-012373961-2.00042-4

14.

Cauffman

(2004). A statewide screening of mental health symptoms among juvenile offenders in detention. Journal of the American Academy of Child & Adolescent Psychiatry, 43(4), 430–439. https://doi.org/10.1097/00004583-200404000-00009

15.

Cauffman

Lexcen

F. J.

Goldweber

Shulman

E. P.

Grisso

(2007). Gender differences in mental health symptoms among delinquent and community youth. Youth Violence and Juvenile Justice, 5(3), 287–307. https://doi.org/10.1177/1541204007301292

16.

Cauffman

MacIntosh

(2006). A Rasch differential item functioning analysis of the Massachusetts Youth Screening Instrument. Educational and Psychological Management, 66(3), 502–521. https://doi.org/10.1177/0013164405282460

17.

Chernoff

W. A.

(2022). Treating girls like boys: The juvenile court and the burden of gender neutral programming. Child & Youth Services, 43(4), 309–345. https://doi.org/10.1080/0145935X.2021.1918542

18.

Cook

R. D.

(1977). Detection of influential observations in linear regression. Technometrics, 19(1), 15–18. https://doi.org/10.1080/00401706.1977.10489493

19.

Curran

P. J.

West

S. G.

Finch

J. F.

(1996). The robustness of test statistics to nonnormality and specification error in confirmatory factor analysis. Psychological Methods, 1(1), 16–29. https://doi.org/10.1037/1082-989x.1.1.16

20.

Cutler

B. L.

(2008). Massachusetts youth screening instrument–version 2 (MAYSI–2). In Encyclopedia of psychology and law (2, 479). Sage Publications, Inc. https://doi.org/10.4135/9781412959537

21.

Embretson

S. E.

Reise

S. P.

(2000). Item response theory for psychologists. Lawrence Erlbaum Associates.

22.

Ford

(2024). Introduction to the Massachusetts Youth Screening Instrument – Web version 2 (web MAYSI 2) and collaborative case works. https://www.courts.michigan.gov/4a148f/siteassets/blocks/web-maysi-2-webinar-slides-6-25-24

23.

Ford

J. D.

Chapman

J. F.

Pearson

Borum

Wolpaw

J. M.

(2008). Psychometric status and clinical utility of the MAYSI-2 with girls and boys in juvenile detention. Journal of Psychopathology and Behavioral Assessment, 30(2), 87–99. https://doi.org/10.1007/s10862-007-9058-9

24.

Ford

J. D.

Elhai

J. D.

Connor

D. F.

Frueh

B. C.

(2010). Poly-victimization and risk of posttraumatic, depressive, and substance use disorders and involvement in delinquency in a national sample of adolescents. Journal of Adolescent Health, 46(6), 545–552. https://doi.org/10.1016/j.jadohealth.2009.11.212

25.

Ford

J. D.

Kerig

P. K.

(2023). Assessing exposure to psychological trauma and posttraumatic stress symptoms in the juvenile justice population. National Center for Child Traumatic Stress.

26.

Fusar-Poli

Tantardini

S. S.

Ramella-Cravaro

Oliver

Kingdon

Kotlicka-Antczak

Valmaggia

Lee

Millan

Galderisi

Balottin

Ricca

McGuire

(2017). Deconstructing vulnerability for psychosis: Meta-analysis of environmental risk factors for psychosis in subjects at ultra high-risk. European Psychiatry, 40, 65–75. https://doi.org/10.1016/j.eurpsy.2016.09.003

27.

Grisso

Barnum

(2003). Massachussettes Youth Screening Instrument version 2: User’s manual and technical report. Professional Resource Press.

28.

Grisso

Barnum

Fletcher

K. E.

Cauffman

Peuschold

(2001). Massachusetts youth screening instrument for mental health needs of juvenile justice youths. Journal of the American Academy of Child & Adolescent Psychiatry, 40(5), 541–548. https://doi.org/10.1097/00004583-200105000-00013

29.

Grisso

Fusco

Paiva-Salisbury

Perrauot

Williams

Barnum

(2016). The Massachusetts Youth Screening Instrument-Version 2 (MAYSI-2): Comprehensive research review. University of Massachusetts Medical School.

30.

Hair

Jr., J. F.

Black

W. C.

Babin

B. J.

Anderson

R. E.

(2019). Multivariate data analysis (8th edition). Cengage.

31.

L. T.

Bentler

P. M.

(1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1–55. https://doi.org/10.1080/10705519909540118

32.

Jaggers

J. W.

Cambron

Kerig

P. K.

Osteen

P. J.

(2021). Measurement equivalence across multiple administrations of the Massachusetts Youth Screening Instrument. Journal of Psychopathology and Behavioral Assessment, 43(4), 882–889. https://doi.org/10.1007/s10862-021-09887-y

33.

Kelleher

(2025). Annual research review: Psychosis in children and adolescents: Key ipdates from the past 2 decades on psychotic disorders, psychotic experiences, and psychosis risk. Journal of Child Psychology and Psychiatry, 66(4), 460–476. https://doi.org/10.1111/jcpp.14088

34.

Kelleher

Harley

Lynch

Arseneault

Fitzpatrick

Cannon

(2008). Associations between childhood trauma, bullying and psychotic symptoms among a school-based adolescent sample. The British Journal of Psychiatry, 193(5), 378–382. https://doi.org/10.1192/bjp.bp.108.049536

35.

Kerig

P. K.

Becker

S. P.

(2012). Trauma and girls' delinquency. In Miller

Leve

L. D.

Kerig

P. K.

(Eds.), Delinquent girls: Contexts, relationships, and adaptation (pp. 119–143). Springer.

36.

Kerig

P. K.

Arnzen-Moeddel

Becker

S. P.

(2011). Assessing the sensitivity and specificity of the MAYSI-2 for detecting trauma among youth in juvenile detention. Child and Youth Care Forum, 40(5), 345–352. https://doi.org/10.1007/s10566-010-9124-4

37.

Kerig

P. K.

Ford

J. D.

(2023). Trauma and posttraumatic stress reactions among girls in the juvenile justice system. National Center for Child Traumatic Stress.

38.

Kerig

P. K.

Schindler

S. R.

(2013). Engendering the evidence base: A critical review of the conceptual and empirical foundations of gender-responsive interventions for girls’ delinquency. Laws, 2(3), 244–282. https://doi.org/10.3390/laws2030244

39.

Kerig

P. K.

Vanderzee

K. L.

Becker

S. P.

Ward

R. M.

(2012). Deconstructing PTSD: Traumatic experiences, posttraumatic symptom clusters, and mental health problems among delinquent youth. Journal of Child & Adolescent Trauma, 5(2), 129–144. https://doi.org/10.1080/19361521.2012.671796

40.

Kim

(2013). Statistical notes for clinical researchers: Assessing normal distribution (2) using skewness and kurtosis. Restorative Dentistry & Endodontics, 38(1), 52–54. https://doi.org/10.5395/rde.2013.38.1.52

41.

Kuder

G. F.

Richardson

M. W.

(1937). The theory of the estimation of test reliability. Psychometrika, 2(3), 151–160. https://doi.org/10.1007/BF02288391

42.

Leve

L. D.

Chamberlain

Kim

H. K.

(2015). Risks, outcomes, and evidence-based interventions for girls in the US juvenile justice system. Clinical Child and Family Psychology Review, 18(3), 252–279. https://doi.org/10.1007/s10567-015-0186-6

43.

Mahalanobis

P. C.

(1936). On the generalized distance in statistics. Proceedings of the National Institute of Science of India, 2, 49–55.

44.

McCoy

Vaughn

M. G.

Maynard

B. R.

Salas-Wright

C. P.

(2014). Caution or warning? A validity study of the MAYSI–2 with juvenile offenders. Behavioral Sciences & the Law, 32(4), 508–526. https://doi.org/10.1002/bsl.2128

45.

McDonald

(2002). A teaching note on Cook’s distance – A guideline. Research Letters in the Information and Mathematical Sciences, 2002(3), 127–128.

46.

Morgan

Patton

(2002). Gender-responsive programming in the justice system—Oregon’s guidelines for effective programming for girls. Federal Probation, 66(2), 67.

47.

Mueser

K. T.

Gingerich

(2013). Treatment of co-occurring psychotic and substance use disorders. Social Work in Public Health, 28(3–4), 424–439. https://doi.org/10.1080/19371918.2013.774676

48.

Muthén

(2002). How to use a Monte Carlo study to decide on sample size and determine fit. Structural Equation Modeling: A Multidisciplinary Journal, 9(4), 599–620. https://doi.org/10.1207/S15328007SEM0904_8

49.

Muthén

L. K.

Muthén

B. O.

(2017). Mplus User's guide (8th ed.) Muthén & Muthén.

50.

National Youth Screening & Assessment Partners (n.d.). Who uses the MAYSI-2? https://www.nysap.us/.

51.

Quraishi

(2013). Enhancing mental health advocacy for girls in the juvenile justice system. https://youthlaw.org/news/enhancing-mental-health-advocacy-girls-juvenile-justice-system

52.

Russell

J. D.

Marsee

M. A.

Ryals

J. S.

(2017). Identifying mental health issues in detained youth: Testing the structure and invariance of the Massachusetts Youth Screening Inventory-Version 2 (MAYSI-2). Psychological Assessment, 29(6), 720–726. https://doi.org/10.1037/pas0000410

53.

Schwartz

Steffensmeier

(2012). Stability and change in girls’ delinquency and the gender gap: Trends in violence and alcohol offending across multiple sources of evidence. In Miller

Leve

L. D.

Kerig

P. K.

(Eds.), Delinquent girls: Context, relationships, and adaptation (pp. 3–23). Springer.

54.

Stanton

K. J.

Denietolis

Goodwin

B. J.

Dvir

(2020). Childhood trauma and psychosis: An updated review. Child and Adolescent Psychiatric Clinics of North America, 29(1), 115–129. https://doi.org/10.1016/j.chc.2019.08.004

55.

Tabachnick

B. G.

Fidell

L. S.

(2019). Using multivariate statistics (7th ed.). Pearson.

56.

Tavakol

Dennick

(2011). Making sense of Cronbach’s alpha. International Journal of Medical Education, 2, 53–55. https://doi.org/10.5116/ijme.4dfb.8dfd

57.

Taylor-Desir

(2022). What is posttraumatic stress disorder (PTSD)? American Psychiatric Association. https://www.psychiatry.org/patients-families/ptsd/what-is-ptsd

58.

The National Institute of Mental Health (NIMH) . (2024). Understanding psychosis. https://www.nimh.nih.gov/health/publications/understanding-psychosis

59.

Thompson

(2004). Exploratory and confirmatory factor analysis: Understanding concepts and applications. American Psychological Association.

60.

Thompson

E. C.

Fox

K. A.

Lapomardo

Hunt

J. I.

Wolff

J. C.

(2020). Youth self report thought problems and sleep difficulties are linked to suicidal ideation among psychiatrically hospitalized adolescents. Journal of Child and Adolescent Psychopharmacology, 30(8), 522–525. https://doi.org/10.1089/cap.2019.0160

61.

Tillman

K. S.

Prazak

M. D.

(2018). Trauma in forensic adolescent females: Predictors, correlates and mental health outcomes. Journal of Child & Adolescent Trauma, 11(4), 401–409. https://doi.org/10.1007/s40653-018-0216-x

62.

Tucker

L. R.

Lewis

(1973). A reliability coefficient for maximum likelihood factor analysis. Psychometrika, 38(1), 1–10. https://doi.org/10.1007/BF02291170

63.

U.S. Census Bureau . (2024). Population estimates (V2024). U.S. Department of Commerce. https://data.census.gov/

64.

Vandenberg

R. J.

Lance

C. E.

(2000). A review and synthesis of the measurement invariance literature: Suggestions, practices, and recommendations for organizational research. Organizational Research Methods, 3(1), 4–70. https://doi.org/10.1177/109442810031002

65.

Varese

Smeets

Drukker

Lieverse

Lataster

Viechtbauer

Read

van Os

Bentall

R. P.

(2012). Childhood adversities increase the risk of psychosis: A meta-analysis of patient-control, prospective- and cross-sectional cohort studies. Schizophrenia Bulletin, 38(4), 661–671. https://doi.org/10.1093/schbul/sbs050

66.

Vincent

Grisso

Terry

Banks

(2008). Sex and race differences in mental health symptoms in juvenile justice: The MAYSI-2 national meta-analysis. Journal of the American Academy of Child & Adolescent Psychiatry, 47(3), 282–290. https://doi.org/10.1097/CHI.0b013e318160d516

67.

Walker

S. C.

Muno

Sullivan-Colglazier

(2015). Principles in practice: A multistate study of gender-responsive reforms in the juvenile justice system. Crime & Delinquency, 61(5), 742–766. https://doi.org/10.1177/0011128712449712

68.

Wasserman

G. A.

McReynolds

L. S.

Schwalbe

C. S.

Keating

J. M.

Jones

S. A.

(2010). Psychiatric disorder, comorbidity, and suicidal behavior in juvenile justice youth. Criminal Justice and Behavior, 37(12), 1361–1377. https://doi.org/10.1177/0093854810382751

69.

Zahn

M. A.

Agnew

Fishbein

Miller

Winn

D. M.

Dakoff

Kruttschnitt

Giordano

Gottfredson

D. C.

Payne

A. A.

Feld

B. C.

Chesney-Lind

(2010). Causes and correlates of girls' delinquency. U.S. Department of Justice, Office of Justice Programs, Office of Juvenile Justice and Delinquency Prevention.