Measurement Properties of the SEAM Questionnaire Using Rasch Analysis on Data From a Representative Danish Sample of 0- to 6-Year-Olds

Abstract

In the current study, the strength-based questionnaire Social-Emotional Assessment/Evaluation Measure (SEAM)–Research Edition was for the first time applied in a nationally representative sample of 0- to 6-year-old children. The focus of this study was the measurement properties of a Danish adaptation of SEAM. Rasch analysis was used to examine the criterion-related construct validity as well as accuracy and reliability of the measurement. The primary goal was to determine whether the 10 SEAM benchmarks could be combined into one total score or into a limited number of subscores. Data were collected by child-care providers in nonparental child-care facilities, and the response rate was high (95%; N = 9,827). The 10 benchmarks were successfully combined into two overall indexes: Empathy and Self-regulation & Cooperation. The reliability coefficients ranged from adequate (0.79) to excellent (0.94). However, standard errors of measurements were relatively large for the two indexes.

Keywords

Social-Emotional Assessment/Evaluation Measure (SEAM)questionnaire infant toddler preschool strength-based assessment

Get full access to this article

View all access options for this article.

References

Achenbach

T. M.

Becker

Döpfner

Heiervang

Roessner

Steinhausen

H.-C.

Rothenberger

(2008). Multicultural assessment of child and adolescent psychopathology with ASEBA and SDQ instruments: Research findings, applications, and future directions. Journal of Child Psychology and Psychiatry, 49, 251-275. doi:10.1111/j.1469-7610.2007.01867.x

American Association on Intellectual and Developmental Disabilities. (2010). Intellectual disability: Definition, classification, and systems of supports. Washington, DC: Author.

Bjorner

J. B.

Kreiner

Ware

J. E.

Damsgaard

M. T.

Bech

(1998). Differential item functioning in the Danish translation of the SF-36. Journal of Clinical Epidemiology, 51, 1189-1202.

Bleses

Højen

Justice

L. M.

Dale

P. S.

Dybdal

Piasta

S. B.

. . . Haghish

E. F.

(2018). The effectiveness of a large-scale language and preliteracy intervention: The SPELL randomized controlled trial in Denmark. Child Development, 89, e342-e363.

Bleses

Jensen

Nielsen

Sehested

K. K.

Sjoe

N. M.

(2016). Børns tidlige udvikling og læring. Målgrupperapport. Rambøll Management Consulting, Aarhus University, & University of Southern Denmark. Retrieved from http://www.ramboll.dk/medier/rdk/~/media/DCB01463CD8343808D7E327008062344.ashx

Christensen

K. B.

Kreiner

Mesbah

(Eds.). (2013). Rasch models in health. Surrey, UK: Wiley-ISTE.

Collaborative for the Advancement of Social and Emotional Learning. (2012). 2013 CASEL guide: Effective social and emotional learning programs’: Preschool and elementary school edition. Chicago, IL: Author. Retrieved from http://www.casel.org/preschool-and-elementary-edition-casel-guide

Dewolf

Koller

Velikova

Johnson

Scott Neil Bottomley

,on behalf of the, EORTC Quality of Life Group. (2009). EORTC quality of life group translation procedure (3rd ed.). Brussels, Belgium: EORTC Quality of Life Group Publication.

Engel

(2011). Children’s need to know: Curiosity in schools. Harvard Educational Review, 81, 625-645. doi:10.17763/haer.81.4.h054131316473115

10.

Evers

Hagemeister

Høstmælingen

Lindley

Muñiz

Sjöberg

(2013). EFPA 2013. The revised EFPA Test review model (Version 4.2.6). European Federation of Psychologists’ Associations. Retrieved from http://www.efpa.eu/professional-development/assessment

11.

Fonagy

Allison

(2012). What is mentalization? The concept and its foundations in developmental research. In Midgley

Vrouva

(Eds.), Minding the child: Mentalization-based interventions with children, young people, and their families (pp. 11-34). New York, NY: Routledge.

12.

Gopnik

Meltzoff

A. N.

Kuhl

P. K.

(2001). The scientist in the crib: What early learning tells us about the mind. New York, NY: Perennial.

13.

Hamon

Mesbah

(2002). Questionnaire reliability under the Rasch model. In Mesbah

Cole

B. F.

Lee

M.-L. T.

(Eds.), Statistical methods for quality of life studies: Design, measurements, and analysis (pp. 155-168). Dordrecht, The Netherlands: Kluwer Academic.

14.

Ivanova

M. Y.

Rescorla

L. A.

Bjarnadottir

Dias

Doepfner

Frigerio

. . . Machado

B. C.

(2011). Syndromes of preschool psychopathology reported by teachers and caregivers in 14 societies using the caregiver-teacher report form (C-TRF). Journal of Early Childhood & Infant Psychology, 7, 87-103.

15.

Kautz

Heckman

J. J.

Diris

Weel

ter Borghans

(2014, November). Fostering and measuring skills: Improving cognitive and non-cognitive skills to promote lifetime success (OECD Education Working papers). Paris, France: Organisation for Economic Co-operation and Development. Retrieved from https://doi.org/10.1787/5jxsr7vr78f7-en

16.

Kelderman

(1984). Loglinear Rasch model tests. Psychometrika, 49, 223-245.

17.

Kochanska

Coy

K. C.

Murray

K. T.

(2001). The development of self-regulation in the first four years of life. Child Development, 72, 1091-1111.

18.

Kreiner

(2003). Introduction to DIGRAM (Research Report No. 03/10). Copenhagen, Denmark: Department of Biostatistics, University of Copenhagen. Retrieved from http://publichealth.ku.dk/sections/biostatistics/reports/2003/

19.

Kreiner

(2007). Validity and objectivity: Reflections on the role and nature of Rasch models. Nordic Psychology, 59, 268-298. doi:10.1027/1901-2276.59.3.268

20.

Kreiner

(2011). A note on Item-Restscore association in Rasch models. Applied Psychological Measurement, 35, 557-561. doi:10.1177/0146621611410227

21.

Kreiner

Christensen

K. B.

(2002). Graphical Rasch models. In Mesbah

Cole

B. F.

Lee

M.-L. T.

(Eds.), Statistical methods for quality of life studies, design, measurements, and analysis (pp. 187-204). Dordrecht: Kluwer Academic.

22.

Kreiner

Christensen

K. B.

(2004). Analysis of local dependence and multidimensionality in graphical loglinear Rasch models. Communications in Statistics—Theory and Methods, 33, 1239-1276. doi:10.1081/STA-120030148

23.

Kreiner

Christensen

K. B.

(2011). Item screening in graphical loglinear Rasch models. Psychometrika, 76, 228-256. doi:10.1007/s11336-011-9203-y

24.

Kreiner

Christensen

K. B.

(2014). Analyses of model fit and robustness. A new look at the PISA scaling model underlying ranking of countries according to reading literacy. Psychometrika, 79, 210-231. doi:10.1007/S11336-013-9347-Z

25.

Kreiner

Nielsen

(2013). Item analysis in DIGRAM 3.04—Part I: Guided tours. Department of Biostastistics, University of Copenhagen. Retrieved from https://ifsv.sund.ku.dk/biostat/biostat_annualreport/images/0/01/Research_Report_13-06-ny.pdf

26.

Miyake

Friedman

N. P.

(2012). The nature and organization of individual differences in executive functions: Four general conclusions. Current Directions in Psychological Science, 21, 8-14. doi:10.1177/0963721411429458

27.

Nielsen

Kreiner

(2011). Reducing the item number to obtain same-length self-assessment scales: A systematic approach using result of graphical loglinear Rasch modeling. Journal of Applied Measurement, 12, 310-323.

28.

Nordling

J. K.

Boldt

L. J.

O’Bleness

Kochanska

(2016). Effortful control mediates relations between children’s attachment security and their regard for rules of conduct: Effortful control, attachment, regard for rules. Social Development, 25, 268-284. doi:10.1111/sode.12139

29.

Organisation for Economic Co-operation and Development. (2015). Skills for social progress—The power of social and emotional skills. Paris, France: Author. Retrieved from https://doi.org/10.1787/9789264226159-en

30.

Rescorla

L. A.

Achenbach

T. M.

Ivanova

M. Y.

Bilenberg

Bjarnadottir

Denner

. . . Verhulst

F. C.

(2012). Behavioral/emotional problems of preschoolers: Caregiver/teacher reports from 15 societies. Journal of Emotional and Behavioral Disorders, 20, 68-81. doi:10.1177/1063426611434158

31.

Rosenbaum

P. R.

(1989). Criterion-related construct validity. Psychometrika, 54, 625-633.

32.

Sjoe

N. M.

(2016). Measuring socio-emotional and pre-math skills in early childhood (PhD dissertation). Aarhus University, Arts & TrygFonden’s Centre for Child Research.

33.

Squires

J. K.

Bricker

Waddell

M. L.

Funk

Clifford

J. R.

Hoselton

R. M.

(2014). Social-Emotional Assessment/Evaluation Measure (SEAM^TM), Research edition. Baltimore, MD: Paul H. Brookes.

34.

Squires

J. K.

Waddell

M. L.

Clifford

J. R.

Funk

Hoselton

R. M.

Chen

C.-I.

(2013). A psychometric study of the infant and toddler intervals of the Social Emotional Assessment Measure. Topics in Early Childhood Special Education, 33, 78-90. doi:10.1177/0271121412463445

35.

StataCorp. (2015). Stata statistical software (Version Release 14). College Station, TX: Author.

36.

Statistics Denmark. (2016). Statistical Yearbook 2016 (No. 120). Statistics Denmark. Retrieved from www.dst.dk/yearbook

37.

Vandecandelaere

Schmitt

Vanlaar

De Fraine

Van Damme

(2016). Effects of kindergarten retention for at-risk children’s psychosocial development. Educational Psychology, 36, 1354-1389. doi:10.1080/01443410.2014.950194

38.

Whitcomb

Merrell

K. W.

(2013). Assessing social skills and social-emotional strengths. In Behavioral, social, and emotional assessment of children and adolescents (4th ed., pp. 379-410). New York, NY: Routledge.

39.

Wiebe

S. A.

Espy

K. A.

Charak

(2008). Using confirmatory factor analysis to understand executive control in preschool children: I. Latent structure. Developmental Psychology, 44, 575-587. doi:10.1037/0012-1649.44.2.575

40.

Zelazo

P. D.

Carlson

S. M.

(2012). Hot and cool executive function in childhood and adolescence: Development and plasticity. Child Development Perspectives, 6, 354-360. doi:10.1111/j.1750-8606.2012.00246.x

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

1.21 MB