The present study explored the psychometric properties of ratings made using the Scales for Assessing Emotional Disturbance–Third Edition: Rating Scale (SAED-3 RS), a scale developed for use in identifying school-age students with emotional and behavioral problems. The purposes of the study were to assess differential item functioning (DIF) for SAED-3 RS items between White and Hispanic students and to assess the impact of DIF on SAED-3 RS scale scores. The sample consisted of 979 students without disabilities who were identified as White/Non-Hispanic (71.91%) and Hispanic (28.09%). The data indicated that SAED-3 RS items demonstrated small to negligible levels of DIF and that DIF did not saliently impact scores. The data suggest that items and scores yielded from the SAED-3 RS are consistent in measuring the emotional and behavioral functioning of school-age students from diverse backgrounds. Research limitations, future research directions, and practical use implications for school personnel are discussed.
AchenbachT. M. (2009). The Achenbach system of empirically based assessment (ASEBA): Development, findings, theory, and applications. University of Vermont Research Center for Children, Youth, & Families.
2.
AlgozzineB. (2017). Toward an acceptable definition of emotional disturbance: Waiting for the change. Behavioral Disorders, 42, 136–144.
3.
American Educational Research Association, American Psychological Association, & National Council on Measurement in Education. (2014). The standards for educational and psychological testing.
4.
AtkinsM. S.RuschD.MehtaT. G.LakindD. (2016). Future directions for dissemination and implementation science: Aligning ecological theory and public health to close the research to practice gap. Journal of Clinical Child & Adolescent Psychology, 45, 215–226. https://doi.org/10.1080/15374416.2015.1050724
5.
BatesL. A.GlickJ. E. (2013). Does it matter if teachers and schools match the student? Racial and ethnic disparities in problem behaviors. Social Science Research, 42, 1180–1190.
6.
BeckerS.PeterniteC.EvansS.AndrewsC.ChristensenO.KraanE.WeistM. (2011). Eligibility, assessment and educational placement issues for students classified with emotional disturbance: Federal and state-level analyses. School Mental Health, 3, 24–34.
7.
BradleyR.DoolittleJ.BartolottaR. (2008). Building on the data and adding to the discussion: The experiences and outcomes of students with emotional disturbance. Journal of Behavioral Education, 17, 4–23. https://doi.org/10.1007/s10864-007-9058-6
8.
BringewattE. H.GershoffE. T. (2010). Falling through the cracks: Gaps and barriers in the mental health system for America’s disadvantaged children. Children and Youth Services Review, 32, 1291–1299. https://doi.org/10.1016/j.childyouth.2010.04.021
9.
BrownT. A. (2006). Confirmatory factor analysis for applied research. Guilford Press.
10.
ChoiS. W.GibbonsL. E.CraneP. K. (2011). lordif: An R package for detecting differential item functioning using iterative hybrid ordinal logistic regression/item response theory and Monte Carlo simulations. Journal of Statistical Software, 39(8), 1–30. https://doi.org/10.18637/jss.v039.i08
ConroyM. A.HendricksonJ. M.SesterP. P. (2004). Early identification and prevention of emotional and behavioral disorders. In RutherfordR. B.QuinnM. M.MathurS. R. (Eds.), Handbook of research in emotional and behavioral disorders (pp. 199–215). Guilford Press.
13.
CostelloE. J.MustilloS.ErkanliA.KeelerG.AngoldA. (2003). Prevalence and development psychiatric disorders in childhood and adolescence. Archives of General Psychiatry, 60, 837–844. https://doi.org/10.1001/archpsyc.60.8.837
14.
CullinanD.HarnissM. K.EpsteinM. H.RyserG. (2002). The scale for assessing emotional disturbance: Concurrent validity. Journal of Child and Family Studies, 10, 449–466.
15.
EgaliteA. J.KisidaB. (2018). The effects of teacher match on students’ academic perceptions and attitudes. Educational Evaluation and Policy Analysis, 40, 59–81.
16.
EpsteinM. H.CullinanD. (1998). Scale for assessing emotional disturbance (SAED). PRO-ED.
EpsteinM. H.CullinanD.RyserG.PearsonN. (2002). Development of a scale to assess emotional disturbance. Behavioral Disorders, 28, 5–22. https://doi.org/10.1177/019874290202800101
21.
EpsteinM. H.NordnessP. D.CullinanD.HertzogM. (2002). Scale for assessing emotional disturbance: Long term test-retest reliability and convergent validity with kindergarten and first grade students. Remedial and Special Education, 23, 141–148. https://doi.org/10.1177/07419325020230030201
22.
EssexM.KraemerH. C.SlatteryM. J.BurkL. R.BoyceW. T.WoodwardH. R.KupferD. J. (2009). Screening for childhood mental health problems: Outcomes and early identification. Journal of Child Psychology and Psychiatry, 50, 562–570. https://doi.org/10.1111/j.1469-7610.2008.02015.x
23.
FlorellD. (2018). Historical foundations. In GrapinS. L.KranzlerJ. H. (Eds.), School psychology: Professional issues and practices (pp. 21–41). Springer.
24.
FornessS. R.KnitzerJ. (1992). A new proposed and definition and terminology to replace “serious emotional disturbance” in Individuals with Disabilities Education Act. School Psychology Review, 21, 12–20.
25.
GloverT. A.AlbersC. A. (2007). Considerations for evaluating universal screening assessments. Journal of School Psychology, 45, 117–135. https://doi.org/10.1016/j.jsp.2006.05.005
26.
GoodmanR. (2001). Psychometric properties of the strengths and difficulties questionnaire. Journal of the American Academy of Child and Adolescent Psychiatry, 40(11), 1337–1345. https://doi.org/10.1097/00004583-200111000-00015
27.
GudiñoO. G.LauA. S.YehM.McCabeK. M.HoughR. L. (2009). Understanding racial/ethnic disparities in youth mental health services: Do disparities vary by problem type?Journal of Emotional and Behavioral Disorders, 17, 3–16. https://doi.org/10.1177/1063426608317710
28.
HanchonT.AllenR. (2013). Identifying students with emotional disturbance: School psychologists’ practices and perceptions. Psychology in the Schools, 50, 193–208. https://doi.org/10.1002/pits.21668
29.
HanchonT. A.AllenR. A. (2018). The identification of students with emotional disturbance: Moving the field toward responsible assessment practice. School psychologists’ practices and perceptions. Psychology in the Schools, 55, 176–189. https://doi.org/10.1002/pits.22099
30.
HillN. E.TorresK. (2010). Negotiating the American dream: The paradox of aspirations and achievement among Latino students and engagement between their families and schools. Journal of Social Issues, 66, 95–112. https://doi.org/10.1111/j.1540-4560.2009.01635.x
31.
HussarW. J.BaileyT. M. (2016). Projections of education statistics to 2024 (NCES 2016-013). National Center for Education Statistics, U.S. Department of Education, U.S. Government Printing Office.
32.
IsasiC. R.RastogiD.MolinaK. (2016). Health issues in Hispanic/Latino youth. Journal of Latina/o Psychology, 4, 67–82. https://doi.org/10.1037/lat0000054
33.
JaffeeS. R.HarringtonH.CohenP.MoffittT. E. (2005). Cumulative prevalence of psychiatric disorder in youths. Journal of the American Academy of Child and Adolescent Psychiatry, 44, 406–407. https://doi.org/10.1097/01.chi.0000155317.38265.61
34.
JimersonS. R.BurnsM. K.VanDerHeydenA. M. (Eds.). (2016). Handbook of response to intervention: The science and practice of multi-tiered systems of support (2nd ed.). Springer.
35.
JodoinM. G.GierlM. J. (2001). Evaluating Type I error and power rates using an effect size measure with the logistic regressions procedure for DIF detection. Applied Measurement in Education, 14(4), 329–349. https://doi.org/10.1207/S15324818AME1404_2
36.
KauffmanJ. M.LandrumT. J. (2017). Characteristics of emotional and behavioral disorders of children and youth (11th ed.). Pearson.
37.
KerrM. M.NelsonC. M. (2010). Strategies for addressing behavior problems in the classroom (6th ed.). Pearson Merrill.
38.
KritikosE. P.McLoughlinJ. A.LewisR. B. (2017). Assessing students with special needs. Pearson.
39.
LambertM. C.MartinJ.EpsteinM. H.CullinanD.KatsiyannisA. (2020). Differential item functioning of the Scales for Assessing Emotional Disturbance – 3 Rating Scale for White and African-American students. Psychology in the Schools. https://doi.org/10.1002/pits.22463
40.
LordF. M. (1980). Application of item response theory to practical testing problems. Lawrence Erlbaum Associates.
41.
MerikangasK. R.HeJ.-P.BrodyD.FisherP. W.BourdonK.KoretzD. S. (2010). Prevalence and treatment of mental disorders among U.S. children in the 2001–2004 NHANES. Pediatrics, 125, 75–81. https://doi.org/10.1542/peds.2008-2598
42.
MerrillK. W.WalkerH. M. (2004). Deconstructing a definition: Social maladjustment versus emotional disturbance and moving the EBD field forward. Psychology in the Schools, 41, 899–910. https://doi.org/10.1002/pits.20046
43.
MitchellB. S.KernL.ConroyM. A. (2019). Supporting students with emotional or behavioral disorders: State of the field. Behavioral Disorders, 44, 70–84. https://doi.org/10.1177/0198742918816518
44.
MrazekD.MrazekP. J. (2005). Prevention of psychiatric disorders in children and adolescents. In SadockB. J.SadockV. A. (Eds.), Kaplan & Sadock’s comprehensive textbook of psychiatry (Vol. 2, pp. 3513–3518). Lippincott Williams & Wilkins.
45.
National Association of School Psychologists. (2010). Model for comprehensive and integrated school psychological services.
46.
National Association of School Psychologists. (2016a). Integrated model of academic and behavioral supports.
47.
National Association of School Psychologists. (2016b). School psychologists’ involvement in assessment.
48.
National Research Council and Institute of Medicine. (2009). Preventing mental, emotional, and behavioral disorders among young people: Progress and possibilities [Committee on the Prevention of Mental Disorders and Substance Abuse Among Children, Youth, and Young Adults: Research Advances and Promising Interventions. M. E. O’Connell, T. Boat, & K. E. Warner (Eds.). Board on Children, Youth, and Families, Division of Behavioral and Social Sciences and Education]. National Academies Press.
49.
ProQuestL. L. C. (2018). ProQuest statistical abstracts of the United States, 2019 (7th ed.). Bernan.
50.
PumariegaA. J.RotheE. (2010). Leaving no children or families outside: The challenges of immigration. American Journal of Orthopsychiatry, 80, 505–515. https://doi.org/10.1111/j.1939-0025.2010.01053.x
ReyesJ. A.EliasM. J. (2011). Fostering social-emotional resilience among Latino youth. Psychology in the Schools, 48, 723–737. https://doi.org/10.1002/pits.20580
53.
ReynoldsC. R.KamphausR. W. (2015). Behavioral assessment system for children third edition (BASC-3). Pearson.
54.
RodriquezA.ReiseS. P.HavilandM. G. (2016). Evaluating bifactor models: Calculating and interpreting statistical indices. Psychological Methods, 21, 137–150. https://doi.org/10.1037/met0000045
55.
SalviaJ.YsseldykeJ.WitmerS. (2016). Assessment in special and inclusive education (13th ed.). Cengage.
56.
SamejimaF. (1969). Estimation of latent ability using a response pattern of graded scores (Psychometric monograph no. 17). Psychometric Society.
57.
SkibaR. J.GrizzleK. (1992). The social maladjustment exclusion: Issues of definition and assessment. School Psychology Review, 20, 580–598.
58.
SkibaR. J.HornerR. H.ChungC. G.RauschM. K.MayS. L.TobinT. (2011). Race is not neutral: A national investigation of African American and Latino disproportionality in school discipline. School Psychology Review, 40, 85–107.
59.
StockingM. L.LordF. M. (1983). Developing a common metric in item response theory. Applied Psychological Measurement, 7, 201–210. https://doi.org/10.1177/014662168300700208
60.
StoiberK.GettingerM. (2016). Multi-tiered systems of support and evidence-based practices. In JimersonS. R.BurnsM. K.VanDerHeydenA. M. (Eds.), Handbook of response to intervention: The science and practice of multi-tiered systems of support (2nd ed., pp. 121–141). Springer.
61.
SugaiG. M.HornerR. R. (2006). A promising approach for expanding and sustaining school-wide positive behavior support. School Psychology Review, 35, 245–259.
62.
SwaminathanH.RogersH. J. (1990). Detecting differential item functioning using logistic regression procedures. Journal of Educational Measurement, 27, 361–370. https://doi.org/10.1111/j.1745-3984.1990.tb00754.x
63.
U.S. Department of Education. (2018). 40th annual report to Congress on the implementation of the Individuals with Disabilities Education Act. http://www.ed.gov/about/reports/annual/osep
64.
U.S. Department of Health and Human Services. (1999). Mental health: A report of the Surgeon General. U.S. Department of Health and Human Services, Substance Abuse and Mental Health Services Administration, Center for Mental Health Services, National Institutes of Health, National Institute of Mental Health.
65.
WagnerM. W.KutashK.DuchnowskiA. J.EpsteinM. H.SumiW. C. (2005). The children and youth we serve: A national picture of the characteristics of students with emotional disturbances receiving special education. Journal of Emotional and Behavioral Disorders, 13, 79–96. https://doi.org/10.1177/10634266050130020201
66.
WagnerM. W.NewmanL.CametoR.GarzaN.LevinP. (2005). After high school: A first look at the postschool experiences of youth with disabilities. A report from the National Longitudinal Transition Study-2 (NLTS2). SRI International.
67.
ZumboB. D. (1999). A handbook on the theory and methods of differential item functioning (DIF). Logistic regression modeling as a unitary framework for binary and Likert-type (ordinal) item scores. Directorate of Human Resources Research and Evaluation, Department of National Defense.
