Validation of Child Behavior Rating Scale in Singapore (Part 1): Rasch Analysis

Abstract

Background

Young children demonstrate both interpersonal social skills (IPS) and learning-related social skills (LRSS) in the early childhood environments.

Objective

The aim of the paper was to investigate the construct validity and measurement properties of the Child Behavior Rating Scale (CBRS) when used to assess young children's IPS and LRSS within early childhood environments in Singapore.

Methods

The participants included 117 children aged 3–6 years, recruited from six preschools in Singapore. Among these children, 28 of them have special needs. The teachers completed the CBRS for all the children.

Results

Eight items were found to fit in a unidimensional scale to measure IPS, while 12 items to measure LRSS. The measurement properties of these two scales were found to be satisfactory.

Conclusion

This study has validated the use of the CBRS to assess IPS and LRSS demonstrated by young Singaporean children. The importance of considering the cultural context when assessing young children's social skills is discussed in the paper.

Keywords

Rasch analysis Singapore Social skills Young children

References

Bond

(2003). Validity and assessment: A Rasch measurement perspective. Metodología de las Ciencias del Comportamiento, 5, 179–194.

Bond

T. G.

, & Fox

C. M.

(2007). Applying the Rasch model: Fundamental measurement in the human sciences (2nd ed.). Mahwah, NJ: Lawrence Erlbaum Associates.

Bronson

M. B.

(1985). Manual for the Bronson social and task skills profile. Chestnut Hill, MA: Boston College.

Bronson

M. B.

(1994). The usefulness of an observational measure of young children's social and mastery behaviors in early childhood classrooms. Early Childhood Research Quarterly, 9, 19–43.

Bronson

M. B.

, Goodson

B. D.

, Layzer

J. I.

, & Love

J. M.

(1990). Child Behavior Rating Scale. Cambridge, MA: Abt Associates.

Bronson

M. B.

, Tivnan

, & Seppanen

P. S.

(1995). Relations between teacher and classroom activity variables and the classroom behaviors of prekindergarten children in chapter 1 funded programs. Journal of Applied Developmental Psychology, 16, 253–282.

Brown

, & Rodger

(2008). Validity of the developmental test of visual-motor integration supplemental developmental test of visual perception. Perceptual and Motor Skills, 106, 659–678.

Caldwell

(1976). Preschool inventory-revised. Princeton, NJ: Educational Testing Service.

Chen

, Chang

, Liu

, & He

(2008). Effects of the peer group on the development of social functioning and academic achievement: A longitudinal study in Chinese children. Child Development, 79, 235–251.

10.

Chen

, Rubin

K. H.

, & Sun

(1992). Social reputation and peer relationships in Chinese and Canadian children: a cross-cultural study. Child Development, 63, 1336–1343.

11.

Chien

C. W.

, & Bond

T. G.

(2009). Measurement properties of Fine Motor Scale of Peabody Developmental Motor Scales-second edition. American Journal of Physical Medicine & Rehabilitation, 88, 376–386.

12.

Chiu

Y. P.

, Fritz

S. L.

, Light

K. E.

, & Velozo

C. A.

(2006). Use of item response analysis to investigate measurement properties and clinical validity of data for the Dynamic Gait Index. Physical Therapy, 86, 778–787.

13.

Coolahan

, Fantuzzo

, Mendez

, & McDermott

(2000). Preschool peer interactions and readiness to learn: Relationships between classroom peer play and learning behaviors and conduct. Journal of Educational Psychology, 92, 458–465.

14.

Cooper

D. H.

, & Farran

D. C.

(1991). The Cooper-Farran behavioral rating scales. Brandon, VT: Clinical Psychology.

15.

Coster

, Haley

S. M.

, Andres

P. L.

, Ludlow

L. H.

, Bond

, & Ni

(2004). Refining the conceptual basis for rehabilitation outcome measurement: Personal care and instrument activities domain. Medical Care, 42, 62–72.

16.

Coster

W. J.

(2008). Embracing ambiguity: Facing the challenge of measurement. American Journal of Occupational Therapy, 62, 743–752.

17.

Donovan

N. J.

, Rosenbek

J. C.

, Ketterson

T. U.

, & Velozo

C. A.

(2006). Adding meaning to measurement: Initial Rasch analysis of the ASHA FACS Social Communication Subtest. Aphasiology, 20, 362–373.

18.

Fisher

W. P. J.

(2007). Rating scale instrument quality criteria. Rasch Measurement Transactions, 21, 1095.

19.

French

, & Song

(1998). Developmentally appropriate teacher-directed approaches: Images from Korean kindergartens Journal of Curriculum Studies, 30, 409–430.

20.

Funk

, Fox

, Chan

, & Curtiss

(2008). The development of the Children's Empathic Attitudes Questionnaire using classical and Rasch analyses. Journal of Applied Developmental Psychology, 29, 187–196.

21.

Guralnick

M. J.

(2003). Assessment of peer relations. Child Development and Mental Retardation Center, University of Washington [Electronic Version]. Retrieved November 1, 2007, from http://depts.washington.edu/chdd/guralnick/research_peer.html.

22.

Jose

P. E.

, Huntsinger

C. S.

, Huntsinger

P. R.

, & Liaw

F. R.

(2000). Parental values and practices relevant to young children's soical development in Taiwan and the United States. Journal of Cross-Cultural Psychology, 31, 677–702.

23.

Kielhofner

(2002). Motives, patterns, and performance of occupation: Basic concepts. In Kielhofner

(Ed.), A model of human occupation: Theory and application (3rd ed., pp. 13–27). Baltimore, MD: Williams & Wilkins.

24.

Kook

S. H.

, & Varni

J. W.

(2008). Validation of the Korean version of the pediatric quality of life inventory 4.0 (PedsQL) generic core scales in school children and adolescents using the Rasch model Health and Quality of Life Outcomes, 6, 41.

25.

Kwon

Y. I.

(2002). Western influences in Korean preschool education. International Education Journal, 3, 153–164.

26.

Ladd

G. W.

, Herald

S. L.

, & Andrews

R. K.

(2006). Young children's peer relations and social competence. In Spodek

, & Saracho

O. N.

(Eds.), Handbook of research on the education of young children (2nd ed., pp. 23–45). Mahwah, NJ: Lawrence Erlbaum Associates.

27.

Layzer

J. L.

, Goodson

B. D.

, & Layzer

J. A.

(1990). Evaluation of Project Giant Step. Year two report: The study of program effects. Cambridge, MA: Abt Associates.

28.

Lewis

, Koyasu

, Oh

, Ogawa

, Short

, & Huang

(2009). Culture, executive functioning, and social understanding. New Directions in Child and Adolescent Development, 123, 69–85.

29.

Li-Grining

C. P.

(2007). Effortful control among low-income preschoolers in three cities: Stability, change, and individual differences. Developmental Psychology, 43(1), 208–221.

30.

, & Rao

(2000). Parental influences on Chinese literacy development: A comparison of preschoolers in Beijing, Hong Kong, and Singapore. International Journal of Behavioural Development, 24, 82–90.

31.

Lim

S. M.

, Rodger

, & Brown

(2009a). Young children's social competence: From theoretical framework to measurement. Paper presented at the 16th Biennial Australasian Human Development Association Conference, Adelaide, Australia.

32.

Lim

S. M.

, Rodger

, & Brown

(2009b). Using Rasch analysis to establish the construct validity of rehabilitation assessment tools. International Journal of Therapy and Rehabilitation, 16(5), 251–260.

33.

Lim

S. M.

, Rodger

, & Brown

(2010a). Assessments of learning-related skills and interpersonal skills constructs within early childhood environments in Singapore. Infant and Child Development, 19, 366–384. doi:10.1002/icd673.

34.

Lim

S. M.

, Rodger

, & Brown

(2010b). Learning-related and interpersonal social skills constructs in two existing social skills assessments. Occupational Therapy in Mental Health, 26, 131–150.

35.

Linacre

J. M.

(2008a). Winsteps (Version 3.67.0) [Computer software]. Chicago, IL: Winsteps.com.

36.

Linacre

J. M.

(2008b). WINSTEPS Rasch measurement computer program. Chicago, IL: Winsteps.com.

37.

Liu

H. C.

(2008). The effect of a learning-related social skills (LRSS) physical education training program on kindergarten children. Dissertation Abstracts International, 69(5). (UMI No. 3313914)

38.

Matthews

J. S.

, Ponitz

C. C.

, & Morrison

F. J.

(2009). Early gender differences in self-regulation and academic achievement. Journal of Educational Psychology, 101, 689–704.

39.

McAllister

(2008). Introduction to the use of Rasch analysis to assess patient performance. International Journal of Therapy and Rehabilitation, 15, 482–490.

40.

McClelland

M. M.

, Acock

A. C.

, & Morrison

F. J.

(2006). The impact of kindergarten learning-related skills on academic trajectories at the end of elementary school. Early Childhood Research Quarterly, 21, 471–490.

41.

McClelland

M. M.

, Cameron

C. E.

, Connor

C. M.

, Farris

C. L.

, Jewkes

A. M.

, & Morrison

F. J.

(2007). Links between behavioral regulation and preschooler's literacy, vocabulary, and maths skills. Developmental Psychology, 43, 947–959.

42.

McClelland

M. M.

, Cameron

C. E.

, Wanless

S. B.

, & Murray

(2007). Executive function, behavioral self-regulation, and social-emotional competence: Links to school readiness. In Saracho

O. N.

, & Spodek

(Eds.), Contemporary perspectives on research in social learning in early childhood education (pp. 83–107). Charlotte, NC: Information Age.

43.

McClelland

M. M.

, & Morrison

F. J.

(2003). The emergence of learning-related social skills in preschool children. Early Childhood Research Quarterly, 18, 206–224.

44.

McClelland

M. M.

, Morrison

F. J.

, & Holmes

D. L.

(2000). Children at risk for early academic problems: The role of learning-related social skills. Early Childhood Research Quarterly, 15, 307–329.

45.

Moilanen

K. L.

, Shaw

D. S.

, Dishion

T. J.

, Gardner

, & Wilson

(2009). Predictors of longitudinal growth in inhibitory control in early childhood. Social Development, doi: 10.1111/j.1467-9507.2009.00536.x.

46.

Nilsson

A. L.

, Sunnerhagen

K. S.

, & Grimby

(2005). Scoring alternatives for FIM in neurological disorders applying Rasch analysis. Acta Neurologica Scandinavica, 111, 264–273.

47.

Pesudovs

, & Noble

B. A.

(2005). Improving subjective scaling of pain using Rasch analysis. The Journal of Pain, 6, 630–636.

48.

Ponitz

C. C.

, McClelland

M. M.

, Matthews

J. S.

, & Morrison

F. J.

(2009). A structured observation of behavioral self-regulation and its contribution to kindergarten outcomes. Developmental Psychology, 45, 605–619.

49.

Pont

, Wallen

, Bundy

, & Case-Smith

(2008). Reliability and validity of the test of in-hand manipulation in children ages 5 to 6 years. American Journal of Occupational Therapy, 62, 384–392.

50.

Segrin

(2000). Social skills deficits associated with depression. Clinical Psychology Review, 20, 379–403.

51.

Singapore Department of Statistics. (2008). Population trends 2008. Singapore: Department of Statistics, Ministry of Trade and Industry.

52.

Smith

R. M.

(2000). Fit analysis in latent trait measurement models. Journal of Applied Measurement, 1, 199–218.

53.

Spence

S. H.

, Donovan

, & Brechman-Toussaint

(1999). Social skills, social outcomes, and cognitive features of childhood social phobia. Journal of Abnormal Psychology, 108, 211–221.

54.

Tan

C. T.

(2007). Policy developments in pre-school education in Singapore: A focus on the key reforms of kindergarten education. International Journal of Child Care and Education Policy, 1, 35–43.

55.

Weinberg

M. K.

, Tronick

E. Z.

, Cohn

J. F.

, & Olson

K. L.

(1999). Gender differences in emotional expressivity and self-regulation during early infancy. Developmental Psychology, 35, 175–188.

56.

Wright

B. D.

, & Masters

G. N.

(2002). Number of person or item strata. Rasch Measurement Transactions, 16, 888.