Psychometric Properties of the Modified Illinois Bully/Victim/Fight Scale for Youth in Restrictive Education Settings

Abstract

Bullying is a pervasive problem in U.S. educational settings, yet research has predominantly focused on traditional K–12 schools, with limited attention to restrictive educational environments such as juvenile justice facilities and residential treatment centers. These settings present unique challenges, such as highly structured conditions that restrict youth autonomy in movement, social interactions, and peer selection, potentially intensifying bullying behaviors and undermining rehabilitative goals. Despite the critical need for accurate assessment in these high-risk contexts, few validated measures are available for this population. This study evaluated the psychometric properties of a modified version of the Illinois Bully/Victim/Fight Scale in restrictive educational settings. We adopted exploratory structural equation modeling (ESEM), which combines the advantages of exploratory factor analysis (EFA) and confirmatory factor analysis (CFA), allowing for a more accurate representation of construct overlap. Results demonstrated that the four-factor structure (bullying, victimization, fighting, and anger) provided an adequate fit with ESEM, whereas traditional CFA yielded a less satisfactory fit. The ESEM revealed theoretically meaningful cross-loadings, with several items loading on multiple dimensions. Internal consistency was acceptable (ω = .74–.93). Findings support cautious use of this modified scale in restrictive education settings, with ESEM recommended to accommodate construct overlap.

Keywords

restrictive school setting/environment Illinois Bully/Victim/Fight Scale exploratory structural equation modeling

Get full access to this article

View all access options for this article.

References

Acosta

Chinman

Ebener

Malone

P. S.

Phillips

Wilks

(2019). Understanding the relationship between perceived school climate and bullying: A mediator analysis. Journal of School Violence, 18(2), 200–215. https://doi.org/10.1080/15388220.2018.1453820

AERA, APA, & NCME (Ed.). (2014). Standards for educational and psychological testing. American Educational Research Association.

Ahmed

Moore

T. M.

Lewis

Butler

Benton

T. D.

Boyd

R. C.

(2018). Psychometric properties of bully, fighting, and victimization scales among clinically referred youth. Journal of Aggression, Maltreatment & Trauma, 27(10), 1110–1124. https://doi.org/10.1080/10926771.2017.1420718

Asparouhov

Muthén

(2009). Exploratory structural equation modeling. Structural Equation Modeling: A Multidisciplinary Journal, 16(3), 397–438. https://doi.org/10.1080/10705510903008204

Bender

Perron

Howard

M. O.

Jenson

J. M.

(2010). Strong-arm bullying prior to incarceration among a sample of young offenders. Journal of the Society for Social Work and Research, 1(1), 1–13. https://doi.org/10.5243/jsswr.2010.1

Berthold

K. A.

Hoover

J. H.

(2000). Correlates of bullying and victimization among intermediate students in the midwestern USA. School Psychology International, 21(1), 65–78. https://doi.org/10.1177/0143034300211005

Browne

M. W.

(2001). An overview of analytic rotation in exploratory factor analysis. Multivariate Behavioral Research, 36(1), 111–150. https://doi.org/10.1207/S15327906MBR3601_05

Browne

M. W.

Cudeck

(1992). Alternative ways of assessing model fit. Sociological Methods & Research, 21(2), 230–258. https://doi.org/10.1177/0049124192021002005

Byrne

B. M.

(1994). Structural equation modeling with EQS and EQS/windows: Basic concepts, applications, and programming. Sage.

10.

Callaghan

Joseph

(1995). Self-concept and peer victimization among schoolchildren. Personality and Individual Differences, 18(1), 161–163. https://doi.org/10.1016/0191-8869(94)00127-E

11.

Centers for Disease Control and Prevention. (2021). Youth risk behavior survey questionnaire. www.cdc.gov/yrbs

12.

Cook

C. R.

Williams

K. R.

Guerra

N. G.

Kim

T. E.

Sadek

(2010). Predictors of bullying and victimization in childhood and adolescence: A meta-analytic investigation. School Psychology Quarterly, 25(2), 65–83. https://doi.org/10.1037/a0020149

13.

Cook

N. E.

Faust

Meyer

J. F.

Faust

K. A.

(2016). The impact of careless and random responding on juvenile forensic assessment: Susceptibility of commonly used measures and implications for research and practice. Journal of Forensic Psychology Practice, 16(5), 425–447. https://doi.org/10.1080/15228932.2016.1234146

14.

Crick

N. R.

Grotpeter

J. K.

(1996). Children’s treatment by peers: Victims of relational and overt aggression. Development and Psychopathology, 8(2), 367–380. https://doi.org/10.1017/S0954579400007148

15.

Crothers

L. M.

Levinson

E. M.

(2004). Assessment of bullying: A review of methods and instruments. Journal of Counseling & Development, 82(4), 496–503. https://doi.org/10.1002/j.1556-6678.2004.tb00338.x

16.

de Beer

van Zyl

L. E.

(2021). ESEM code generator for Mplus: A convenient tool for ESEM, Bi-factor ESEM, ESEM within CFA, and Hierarchical ESEM code generation in Mplus. https://doi.org/10.6084/M9.FIGSHARE.8320250

17.

Demaray

M. K.

Summers

K. H.

Jenkins

L. N.

Becker

L. D.

(2016). Bullying participant behaviors questionnaire (BPBQ): Establishing a reliable and valid measure. Journal of School Violence, 15(2), 158–188. https://doi.org/10.1080/15388220.2014.964801

18.

Dembo

Krupa

J. M.

Faber

DiClemente

R. J.

Wareham

Schmeidler

(2021). An examination of gender differences in bullying among justice-involved adolescents. Deviant Behavior, 42(2), 268–287. https://doi.org/10.1080/01639625.2019.1666608

19.

Espelage

D. L.

(2012). Bullying prevention: A research dialogue with Dorothy Espelage. Prevention Researcher, 19(3), 17–19. https://doi.org/10.1037/e534992013-006

20.

Espelage

D. L.

Basile

K. C.

De La Rue

Hamburger

M. E.

(2015). Longitudinal associations among bullying, homophobic teasing, and sexual violence perpetration among middle school students. Journal of Interpersonal Violence, 30(14), 2541–2561. https://doi.org/10.1177/0886260514553113

21.

Espelage

D. L.

Holt

M. K.

(2001). Bullying and victimization during early adolescence: Peer influences and psychosocial correlates. Journal of Emotional Abuse, 2(2–3), 123–142. https://doi.org/10.1300/J135v02n02_08

22.

Fabrigar

L. R.

Wegener

D. T.

MacCallum

R. C.

Strahan

E. J.

(1999). Evaluating the use of exploratory factor analysis in psychological research. Psychological Methods, 4(3), 272–299. https://doi.org/10.1037/1082-989X.4.3.272

23.

Finkelhor

Turner

H. A.

Hamby

(2012). Let’s prevent peer victimization, not just bullying. Child Abuse & Neglect, 36(4), 271–274. https://doi.org/10.1016/j.chiabu.2011.12.001

24.

Hamburger

Basile

Vivolo

(2011). Measuring bullying victimization, perpetration, and bystander experiences: A compendium of assessment tools. Centers for Disease Control and Prevention, National Center for Injury Prevention and Control. https://stacks.cdc.gov/view/cdc/5994

25.

Harbin

S. M.

Kelley

M. L.

Piscitello

Walker

S. J.

(2019). Multidimensional bullying victimization scale: Development and validation. Journal of School Violence, 18(1), 146–161. https://doi.org/10.1080/15388220.2017.1423491

26.

Hinduja

Patchin

J. W.

(2019). Connecting adolescent suicide to the severity of bullying and cyberbullying. Journal of School Violence, 18(3), 333–346. https://doi.org/10.1080/15388220.2018.1492417

27.

Bentler

P. M.

(1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1–55. https://doi.org/10.1080/10705519909540118

28.

Hunt

Moodie-Mills

(2012). The unfair criminalization of gay and transgender youth: An overview of experiences of LGBT youth in the juvenile justice system. Center for American Progress. https://cdn.americanprogress.org/wp-content/uploads/issues/2012/06/pdf/juvenile_justice.pdf

29.

Hymel

Swearer

S. M.

(2015). Four decades of research on school bullying: An introduction. American Psychologist, 70(4), 293–299. https://doi.org/10.1037/a0038928

30.

Jolivette

Swoszowski

N. C.

McDaniel

S. C.

Duchaine

E. L.

(2016). Using positive behavioral interventions and supports to assist in the transition of youth from juvenile justice facilities back to their neighborhood school: An illustrative example. Journal of Correctional Education, 67(2), 9–24. http://www.jstor.org/stable/26506633

31.

Klomek

A. B.

Sourander

Gould

(2010). The association of suicide and bullying in childhood to young adulthood: A review of cross-sectional and longitudinal research findings. The Canadian Journal of Psychiatry, 55(5), 282–288. https://doi.org/10.1177/070674371005500503

32.

Marsh

H. W.

Morin

A. J. S.

Parker

P. D.

Kaur

(2014). Exploratory structural equation modeling: An integration of the best features of exploratory and confirmatory factor analysis. Annual Review of Clinical Psychology, 10, 85–110. https://doi.org/10.1146/annurev-clinpsy-032813-153700

33.

McDonald

R. P.

(1999). Test theory: A unified treatment (1st ed.). Taylor & Francis.

34.

McNeish

(2023). Psychometric properties of sum scores and factor scores differ even when their correlation is 0.98: A response to Widaman and Revelle. Behavior Research Methods, 55(8), 4269–4290. https://doi.org/10.3758/s13428-022-02016-x

35.

Meade

A. W.

Craig

S. B.

(2012). Identifying careless responses in survey data. Psychological Methods, 17(3), 437–455. https://doi.org/10.1037/a0028085

36.

Morin

A. J. S.

Marsh

H. W.

Nagengast

(2013). Exploratory structural equation modeling. In Hancock

G. R.

Mueller

R. O.

(Eds.), Structural equation modeling: A second course (2nd ed.; pp. 395–436). IAP Information Age Publishing.

37.

Muthén

L. K.

Muthén

B. O.

(1998–2017). Mplus user’s guide (Version Eighth Edition.) [Computer software].

38.

Nansel

T. R.

Overpeck

Pilla

R. S.

Ruan

W. J.

Simons-Morton

Scheidt

(2001). Bullying behaviors among US youth prevalence and association with psychosocial adjustment. JAMA, 285(16), 2094–2100. https://doi.org/10.1001/jama.285.16.2094

39.

National Center for Education Statistics. (2020). Indicators of school crime and safety: 2019 (NCES 2020063). National Center for Education Statistics. https://nces.ed.gov/pubsearch/pubsinfo.asp?pubid=2020063

40.

Olweus

(1993). Bullying at school: What we know and what we can do (Reprinted). Blackwell.

41.

Olweus

(1994). Bullying at school. In Huesmann

L. R.

(Ed.), Aggressive behavior: Current perspectives (pp. 97–130). Springer.

42.

Olweus

Limber

S. P.

(2010). Bullying in school: Evaluation and dissemination of the Olweus Bullying Prevention Program. American Journal of Orthopsychiatry, 80(1), 124–134. https://doi.org/10.1111/j.1939-0025.2010.01015.x

43.

Pearce

Cross

Monks

Waters

Falconer

(2011). Current evidence of best practice in whole-school bullying intervention and its potential to inform cyberbullying interventions. Australian Journal of Guidance and Counselling, 21(1), 1–21. https://doi.org/10.1375/ajgc.21.1.1

44.

Poteat

V. P.

Espelage

D. L.

(2005). Exploring the relation between bullying and homophobic verbal content: The homophobic content agent target (HCAT) scale. Violence and Victims, 20(5), 513–528. https://doi.org/10.1891/vivi.2005.20.5.513

45.

Poteat

V. P.

Espelage

D. L.

(2007). Predicting psychosocial consequences of homophobic victimization in middle school students. The Journal of Early Adolescence, 27(2), 175–191. https://doi.org/10.1177/0272431606294839

46.

R Core Team. (2025). R: A language and environment for statistical computing [Computer software]. R Foundation for Statistical Computing. https://www.R-project.org/

47.

Rose

C. A.

(2010). Social-ecological factors related to the involvement of students with learning disabilities in the bullying dynamic [Doctoral Dissertation, University of Illinois at Urbana-Champaign]. https://www.proquest.com/dissertations-theses/social-ecological-factors-related-involvement/docview/867846902/se-2

48.

Rose

C. A.

Simpson

C. G.

Moss

(2015). The bullying dynamic: Prevalence of involvement among a large-scale sample of middle and high school youth with and without disabilities. Psychology in the Schools, 52(5), 515–531. https://doi.org/10.1002/pits.21840

49.

Solberg

M. E.

Olweus

(2003). Prevalence estimation of school bullying with the Olweus Bully/Victim Questionnaire. Aggressive Behavior, 29(3), 239–268. https://doi.org/10.1002/ab.10047

50.

Swearer

S. M.

Cary

P. T.

(2003). Perceptions and attitudes toward bullying in middle school youth: A developmental examination across the bully/victim continuum. Journal of Applied School Psychology, 19(2), 63–79. https://doi.org/10.1300/J008v19n02_05

51.

Thissen

Steinberg

Pyszczynski

Greenberg

(1983). An item response theory for personality and attitude scales: Item analysis using restricted factor analysis. Applied Psychological Measurement, 7(2), 211–226. https://doi.org/10.1177/014662168300700209

52.

Tucker

L. R.

Lewis

(1973). A reliability coefficient for maximum likelihood factor analysis. Psychometrika, 38(1), 1–10. https://doi.org/10.1007/BF02291170

53.

Ulitzsch

Pohl

Khorramdel

Kroehne

von Davier

(2024). Using response times for joint modeling of careless responding and attentive response styles. Journal of Educational and Behavioral Statistics, 49(2), 173–206. https://doi.org/10.3102/10769986231173607

54.

Vieno

Gini

Santinello

(2011). Different forms of bullying and their association to smoking and drinking behavior in Italian adolescents. Journal of School Health, 81(7), 393–399. https://doi.org/10.1111/j.1746-1561.2011.00607.x

55.

Walker

H. M.

Ramsey

Gresham

F. M.

(2004). Antisocial behavior in school: Evidence-based practices. Thomson Wadsworth.

56.

Watkins

M. W.

(2021). A step-by-step guide to exploratory factor analysis with SPSS. Routledge.

57.

Xie

Man

Liu

(2023). A PRISMA-based systematic review of measurements for school bullying. Adolescent Research Review, 8(2), 219–259. https://doi.org/10.1007/s40894-022-00194-5