Korean Behavior Assessment System for Children 3rd Edition Teacher Rating Scales-Child Form: A Validation Study

Abstract

The purpose of this study was to evaluate the reliability and validity of the Korean Behavior Assessment System for Children 3rd Edition Teacher Rating Scales-Child Form (K·BASC-3 TRS-C). We used the generalized partial credit model based on item response theory (IRT) to examine the internal validity of the scale’s items and the latent trait in a sample of Korean children (n = 318). Findings based on IRT provided strong evidence for the discriminative characteristics of the items. Additionally, the results revealed that the difficulty and discrimination of most items were appropriate, and the reliability of the K·BASC-3 TRS-C was excellent. Concurrent validity was tested using the Teacher’s Report Form for Ages 6–18 (TRF). Support for the external validity of subscale scores was found. A separate sample of 105 Korean children was used to examine the concurrent validity of a subset of the K·BASC-3 TRS-C subscales related to Anxiety, Hyperactivity, and Attention Problems demonstrated strong concurrent validity with TRF of related constructs. Other relevant findings, practical implications regarding the use of the K·BASC-3 TRS-C, and suggestions for future research are included in the discussion.

Keywords

Korean behavior assessment system for children 3rd edition teacher rating scales-child form reliability item response theory validity

Get full access to this article

View all access options for this article.

References

Ahn

M. (2020) (In preparation). Standardization of the Behavior Assessment System for Children-3, Teacher Rating Scales-Child Form (K·BASC-3 TRS-C) Among Korean Sample . Unpublished manuscript.

Ahn

C. M.

Shin

H. S.

(2012). Maternal psychological control and child depression: A mediation model. Korean Journal of Youth Studies, 19(2), 227–253.

American Psychiatric Association . (2013). Diagnostic and statistical manual of mental disorders (5th ed.). American Psychiatric Association. https://doi.org/10.1176/appi.books.9780890425596

Baker

F. B.

(2001). The basics of item response theory. In ERIC clearinghouse on assessment and evaluation. ERIC.

Benson

N. F.

Beaujean

A. A.

McGill

R. J.

Dombrowski

S. C.

(2018). Revisiting Carroll’s survey of factor-analytic studies: Implications for the clinical assessment of intelligence. Psychological Assessment, 30(8), 1028–1038. https://doi.org/10.1037/pas0000556

Bentler

P. M.

(1992). On the fit of models to covariances and methodology to the Bulletin. Psychological Bulletin, 112(3), 400–404. https://doi.org/10.1037/0033-2909.112.3.400

Birmaher

Ryan

Williamson

Brent

Kaufman

Dahl

Perel

Nelson

(1996). Childhood and adolescent depression: A review of the past 10 years (part I). Journal of the American Academy of Child & Adolescent Psychiatry, 35(11), 1427–1439. https://doi.org/10.1097/00004583-199611000-00011

Brady

E. U.

Kendall

P. C.

(1992). Comorbidity of anxiety and depression in children and adolescents. Psychological Bulletin, 111(2), 244–255. https://doi.org/10.1037/0033-2909.111.2.244

Brislin

R. W.

(1970). Back-translation for cross-cultural research. Journal of Cross-Cultural Psychology, 1(3), 185–216.

10.

Browne

Cudeck

(1993). Alternative ways of assessing model fit. In Bollen

K. A.

Long

J. S.

(Eds.), Testing structural equation models (pp. 136–159). Sage.

11.

Byrne

B. M.

(1998). Structural equation modeling with LISREL, PRELIS, and SIMPLIS: Basic concepts, applications, and programming. Lawrence Erlbaum Associates Publishers.

12.

Chalmers

R. P.

(2012). Mirt: A multidimensional item response theory package for the R environment. Journal of Statistical Software, 48(6), 1–29. https://doi.org/10.18637/jss.v048.i06

13.

Cohen

(1988). Statistical Power Analysis for the Behavioral Sciences (2nd ed.). Lawrence Erlbaum Associates, Publishers.

14.

Dai

T. T.

Kehinde

O. J.

Xue

Demir

Wang

(2021). Performance of polytomous IRT models with rating scale data: An investigation over sample size, instrument length, and missing data. Frontiers in Education, 6(2021), 1–18. https://doi.org/10.3389/feduc.2021.721963

15.

De Ayala

R. J.

(2013). The theory and practice of item response theory. Guilford Publications.

16.

Dedrick

R. F.

Greenbaum

P. E.

Friedman

R. M.

Wetherington

C. M.

Knoff

H. M.

(1997). Testing the structure of the child behavior checklist/4-18 using confirmatory factor analysis. Educational and Psychological Measurement, 57(2), 306–313. https://doi.org/10.1177/0013164497057002009

17.

Edelbrock

Achenbach

T. M.

(1980). A typology of child behavior profile patterns: Distribution and correlates for disturbed children aged 6–16. Journal of Abnormal Child Psychology, 8(4), 441–470. https://doi.org/10.1007/BF00916500

18.

Eklund

Dowdy

Jones

Furlong

(2011). Applicability of the dual-factor model of mental health for college students. Journal of College Student Psychotherapy, 25(1), 79–92. https://doi.org/10.1080/87568225.2011.532677

19.

Fabrigar

L. R.

Wegener

D. T.

MacCallum

R. C.

Strahan

E. J.

(1999). Evaluating the use of exploratory factor analysis in psychological research. Psychological Methods, 4(3), 272–299. https://doi.org/10.1037/1082-989X.4.3.272

20.

Frick

P. J.

Barry

C. T.

Kamphaus

R. W.

(2010). Clinical assessment of child and adolescent personality and behavior (3rd ed.). Springer Science + Business Media.

21.

Glover

Albers

(2007). Considerations for evaluating universal screening assessments. Journal of School Psychology, 45(2), 117–135. https://doi.org/10.1016/j.jsp.2006.05.005

22.

Huang

F. L.

Reinke

W. M.

Thompson

Herman

K. C.

County Schools Mental Health Coalition . (2019). An investigation of the psychometric properties of the early identification system-student report. Journal of Psychoeducational Assessment, 37(4), 473–485. https://doi.org/10.1177/0734282918758791

23.

Hunter

Hoagwood

Evans

Weist

Smith

Paternite

the School Mental Health Alliance . (2005). Working together to promote academic performance, social and emotional learning, and mental health for all children. Center for the Advancement of Children’s Mental Health at Columbia University.

24.

Kamphaus

R. W.

Reynolds

C. R.

(2007). BASC-2 behavioral and emotional screening system. Pearson Assessment. https://doi.org/10.1037/t29902-000

25.

Kang

Cohen

A. S.

Sung

H. J.

(2009). Model selection indices for polytomous items. Applied Psychological Measurement, 33(7), 499–518. https://doi.org/10.1177/0146621608327800

26.

Kokou-Kpolou

C. K.

Lenferink

L. I. M.

Brunnet

A. E.

Park

Megalakaki

Boelen

Cénat

J. M.

(2022). The ICD-11 and DSM-5-TR prolonged grief criteria: Validation of the traumatic grief inventory-self report plus using exploratory factor analysis and item response theory. Clinical Psychology & Psychotherapy, 29(6), 1950–1962. https://doi.org/10.1002/cpp.2765

27.

Korean Educational Development Institute . (2012, October 10). How to revitalize the crisis student support program (Wee Project). Korean Educational Development Institute. https://www.edpolicy.net/

28.

Kwon

J. S.

(2017). Influence of public self-consciousness on bulimia nervosa among women in their 20s: The mediating role of immature defense mechanism and negative urgency. Master’s Thesis. Sogang University. https://dcollection.sogang.ac.kr/dcollection/public_resource/pdf/000000063162_20210712121113.pdf

29.

Lin

C.-Y.

Imani

Griffiths

M. D.

Pakpour

A. H.

(2021). Psychometric properties of the Persian generalized trust scale: Confirmatory factor analysis and Rasch models and relationship with quality of life, happiness, and depression. International Journal of Mental Health and Addiction, 19(5), 1854–1865. https://doi.org/10.1007/s11469-020-00278-0

30.

Muraki

(1992). A generalized partial credit model: Application of an EM algorithm. Applied Psychological Measurement, 1992(1), 159–176. https://doi.org/10.1002/j.2333-8504.1992.tb01436.x

31.

K. J.

Kim

Y. A.

Kim

M. Y.

(2012). Standardization study for the Korean version of the teacher’s report Form. The Korean Journal of School Psychology, 9(2), 367–391. https://doi.org/10.16983/kjsp.2012.9.2.367

32.

Professional Testing, Inc . (2020, September 3). Conduct the item analysis. Professional Testing, Inc. https://www.proftesting.com/test_topics/steps_9.php

33.

R Core Team . (2017). R: A language and environment for statistical computing. R Foundation for Statistical Computing. Retrieved from. https://www.R-project.org/

34.

Reise

S. P.

Waller

N. G.

(2009). Item response theory and clinical measurement. Annual Review of Clinical Psychology, 5, 27–48. https://doi.org/10.1146/annurev.clinpsy.032408.153553

35.

Reynolds

C. R.

Kamphaus

R. W.

(2015). BASC-3 behavior assessment system for children (3rd ed.). Pearson. https://doi.org/10.1007/s10864-021-09458-x

36.

Rosseel

(2012). lavaan: An R package for structural equation modeling. Journal of Statistical Software, 48(2), 1–36. https://doi.org/10.18637/jss.v048.i02

37.

semTools Contributors . (2018). semTools: Useful tools for structural equation modeling. R package version 0.4-15.915. semTools Contributors. Retrieved from. https://cran.rproject.org/web/packages/semTools/semTools.pdf

38.

The National Mental Health and Welfare Commission . (2019, May 31). Mean score of stress scale on the national survey of children. The National Mental Health and Welfare Commission. https://kosis.kr/statHtml/statHtml.do?orgId=117&tblId=TX_117_2013_H090&conn_path=I3

39.

Zhou

Min

Sun

Kim

S. J.

Ahn

J. S.

Peng

Noh

Ryder

A. G.

(2015). Extending a structural model of somatization to South Koreans: Cultural values, somatization tendency, and the presentation of depressive symptoms. Journal of Affective Disorders, 176(1), 151–154. https://doi.org/10.1016/j.jad.2015.01.040