The Social Skills Improvement System–Teacher Rating Scale (SSIS-TRS) has been widely used to measure the social skills and behaviors of children and adolescents that are challenging. Studies examining the psychometric properties of the SSIS-TRS have been conducted, but the dimensional structure and item properties of the SSIS-TRS have not been extensively examined with samples of preschool-age children at risk for social-emotional and behavioral difficulties. This current study was designed to examine (a) the dimensional structure of the Social Skills scale and Problem Behaviors scale of the SSIS-TRS and (b) the item function of the SSIS-TRS using item response theory analyses with data collected from teachers of a sample of 469 preschool-age children at risk for social–emotional and behavioral difficulties. A four-dimensional structure (i.e., Cooperation, Empathy and Relationship, Engagement and Interaction, and Self-Control) and a three-dimensional structure (i.e., Aggression and Defiance, Disruptiveness and Stereotypy, and Withdrawal) were identified for the Social Skills and Problem Behaviors scales, respectively. Item parameters of the SSIS-TRS were estimated using the generalized partial credit model. Item information curves were plotted for individual items; behavior indicators providing higher information for measuring corresponding social skills and problem behaviors constructs were identified. The limitations and implications for the present study are discussed.
AnthonyC. J.ElliottS. N.DiPernaJ. C.LeiP. W. (2020). Multirater assessment of young children’s social and emotional learning via the SSIS SEL Brief Scales—Preschool Forms. Early Childhood Research Quarterly, 53(4), 625–637. https://doi.org/10.1016/j.ecresq.2020.07.006
BiermanK. L.CoieJ.DodgeK.GreenbergM.LochmanJ.McMohanR.PinderhughesE., & Conduct Problems Prevention Research Group. (2013). School outcomes of aggressive-disruptive children: Prediction from kindergarten risk factors and impact of the Fast Track prevention program. Aggressive Behavior, 39(2), 114–130. https://doi.org/10.1002/ab.21467
4.
ChalmersR. P. (2012). mirt: A multidimensional item response theory package for the R environment. Journal of Statistical Software, 48(6), 1–29. https://doi.org/10.18637/jss.v048.i06
5.
ChenX.HuangX.ChangL.WangL.LiD. (2010). Aggression, social competence, and academic achievement in Chinese children: A 5-year longitudinal study. Development and Psychopathology, 22(3), 583–592. https://doi.org/10.1017/S0954579410000295
6.
ClopetT. C.Bulotsky-ShearerR. (2016). Relationship between peer social competence and academic readiness for Head Start children: A multi-method, multi-source measurement approach. NHSA Dialog, 19(1), 1–25. https://journals.uncc.edu/dialog/article/view/409
ConroyM. A.SutherlandK. S.GrangerK. L.MarcoulidesK. M.HuangK.MontesionA. (2021). Preliminary study of the effects of BEST in CLASS—Web on young children’s social-emotional and behavioral outcomes. Journal of Early Intervention, 44(1), 78–96. https://doi.org/10.1177/10538151211018662
9.
De AyalaR. J. (2013). The theory and practice of item response theory. Guilford.
10.
EisenbergN.MorrisA. S. (2001). The origins and social significance of empathy-related responding. A review of empathy and moral development: Implications for caring and justice by M. L. Hoffman. Social Justice Research, 14, 95–120. https://doi.org/10.1023/A:1012579805721
11.
EisenbergN.ValienteC.SpinradT. L.CumberlandA.LiewJ.ReiserM.ZhouQ.LosoyaS. H. (2009). Longitudinal relations of children’s effortful control, impulsivity, and negative emotionality to their externalizing, internalizing, and co-occurring behavior problems. Developmental Psychology, 45(4), 988–1008. https://doi.org/10.1037/a0016213
12.
EmbretsonS. E.ReiseS. P. (2000). Item response theory for psychologists. Erlbaum.
13.
FoxL.DunlapG.PowellD. (2002). Young children with challenging behavior: Issues and considerations for behavior support. Journal of Positive Behavior Interventions, 4(4), 208–217. https://doi.org/10.1177/10983007020040040401
14.
FreyA. J.SmallJ. W.FeilE. G.SeeleyJ. R.WalkerH. M.FornessS. (2015). First Step to Success: Applications to preschoolers at risk of developing autism spectrum disorders. Education and Training in Autism and Developmental Disabilities, 50(4), 397–407. https://eric.ed.gov/?id=ED581234
15.
FreyJ. R.ElliottS. N.KaiserA. P. (2014). Social skills intervention planning for preschoolers: Using the SSiS-Rating Scales to identify target behaviors valued by parents and teachers. Assessment for Effective Intervention, 39(3), 182–192. https://doi.org/10.1177/1534508413488415
16.
GreshamF. M.ElliottS. N. (2008a). Social Skills Improvement System: Rating scales. Pearson Assessments.
17.
GreshamF. M.ElliottS. N. (2008b). Social Skills Improvement System: Rating scales manual. Pearson Assessments.
18.
GreshamF. M.ElliottS. N. (2017). Social Skills Improvement System Social–Emotional Learning Edition Rating Forms. Pearson Assessments.
19.
GreshamF. M.ElliottS. N.MetalloS.ByrdS.WilsonE.EricksonM.CassidyK.AltmanR. (2018). Psychometric fundamentals of the Social Skills Improvement System: Social–Emotional Learning Edition Rating Forms. Assessment for Effective Intervention, 45(3), 194–209. https://doi.org/10.1177/1534508418808598
20.
GuralnickM. J. (2010). Early intervention approaches to enhance the peer-related social competence of young children with developmental delays: A historical perspective. Infants and Young Children, 23(2), 73–83. https://doi.org/10.1097/IYC.0b013e3181d22e14
21.
HanniganL. J.WalakerN.WaszczukM. A.McAdamsT. A.EleyT. C. (2017). Aetiological influences on stability and change in emotional and behavioural problems across development: A systematic review. Psychopathology Review, 4(1), 52–108. https://doi.org/10.5127/pr.038315
22.
HemmeterM. L.FoxL.SnyderP.AlginaJ.HardyJ. K.BishopC.VeguillaM. (2021). Corollary child outcomes from the Pyramid Model professional development intervention efficacy trial. Early Childhood Research Quarterly, 54(1), 204–218. https://doi.org/10.1016/j.ecresq.2020.08.004
23.
HeymanM.PoulakosA.UpshurC.Wenz-GrossM. (2018). Discrepancies in parent and teacher ratings of low-income preschooler’s social skills. Early Child Development and Care, 188(6), 759–773. https://doi.org/10.1080/03004430.2016.1236257
24.
HosokawaR.KatsuraT. (2017). A longitudinal study of socioeconomic status, family processes, and child adjustment from preschool until early elementary school: The role of social competence. Child and Adolescent Psychiatry and Mental Health, 11(1), 62–89. https://doi.org/10.1186/s13034-017-0206-z
25.
HuL. T.BentlerP. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1–55. https://doi.org/10.1080/10705519909540118
26.
HuberL.PlötnerM.SchmitzJ. (2019). Social competence and psychopathology in early childhood: A systematic review. European Child & Adolescent Psychiatry, 28(4), 443–459. https://doi.org/10.1007/s00787-018-1152-x
27.
KangT.ChenT. T. (2008). Performance of the generalized S-X2 item fit index for polytomous IRT models. Journal of Educational Measurement, 45(4), 391–406. https://doi.org/10.1111/j.1745-3984.2008.00071.x
28.
KostelnikM. J.WhirenA. P.SodermanA. K.GregoryK. M. (2018). Guiding children’s social development and learning (9th ed.). Cengage Learning.
29.
MartíM.BonilloA.JanéM. C.FisherE. M.DuchH. (2016). Cumulative risk, the mother–child relationship, and social-emotional competence in Latino Head Start children. Early Education and Development, 27(5), 590–622. https://doi.org/10.1080/10409289.2016.1106202
OdomS. L.McConnellS. R.BrownW. H. (2008). Social competence of young children: Conceptualization, assessment, and influences. In BrownW.OdomS.McConnellS. (Eds.), Social competence of young children: Risk, disability, and intervention (pp. 3–29). Paul H. Brookes.
PoulouM. S. (2015). Emotional and behavioural difficulties in preschool. Journal of Child and Family Studies, 24(2), 225–236. https://doi.org/10.1007/s10826-013-9828-9
34.
RevelleW. (2022). Psych: Procedures for psychological, psychometric, and personality research (Version 2.2.9) [Computer software]. https://CRAN.R-project.org/package=psych
35.
SetteS.SpinradT. L.BaumgartnerE. (2013). Links among Italian preschoolers’ socioemotional competence, teacher–child relationship quality, and peer acceptance. Early Education & Development, 24(6), 851–864. https://doi.org/10.1080/10409289.2013.744684
SpiraE. G.FischelJ. E. (2005). The impact of preschool inattention, hyperactivity, and impulsivity on social and academic development: A review. Journal of Child Psychology and Psychiatry, 46(7), 755–773. https://doi.org/10.1111/j.1469-7610.2005.01466.x
38.
SutherlandK. S.ConroyM. A.AlginaJ.LadwigC.JesseeG.GyureM. (2018). Reducing child problem behaviors and improving teacher–child interactions and relationships: A randomized controlled trial of BEST in CLASS. Early Childhood Research Quarterly, 42(1), 31–43. https://doi.org/10.1016/j.ecresq.2017.08.001
39.
WalkerH. M.IrvinL. K.NoellJ.SingerG. H. (1992). A construct score approach to the assessment of social competence: Rationale, technological considerations, and anticipated outcomes. Behavior Modification, 16(4), 448–474. https://doi.org/10.1177/01454455920164002
40.
WalkerH. M.SeversonH. H.FeilE. G. (1995). Early Screening Project: A proven child find process. Sopris West.
41.
YenW. M. (1984). Effects of local item dependence on the fit and equating performance of the three-parameter logistic model. Applied Psychological Measurement, 8(2), 125–145. https://doi.org/10.1177/014662168400800201
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
