Developing and Piloting a Computerized Adaptive Test for a Culturally Appropriate Measure of Adaptive Behavior

Abstract

Culturally bounded in nature, adaptive behavior is the degree to which a person meets the requirements of personal independence and social responsibilities. This study aimed to develop a computerized adaptive test (CAT) of a culturally appropriate adaptive behavior measure (i.e., the Activities and Participation Rating Scale [APRS]) in the Singapore context for children aged 7 to 12 years, that is, the CAT-APRS-Primary. In Study 1, an item bank consisting of 310 adaptive skills was developed and piloted among 56 caregivers. In Study 2, the refined 310 items were calibrated using Rasch analysis among 352 caregivers. After the removal of five poor items based on the Rasch analysis, the finalized 305 items were used for the CAT development, with these items showing good Rasch person and item fit statistics. Preliminary utility of the CAT-APRS-Primary was established, with participants completing 24 items on average. Limitations and implications for future research were discussed.

Keywords

item bank computerized adaptive test adaptive behavior culturally appropriate

Get full access to this article

View all access options for this article.

References

Abd El Qadir

Berte

D. Z.

Barakat

Mahamid

F. A.

(2020). Validation of the Vineland Adaptive Behavior scale in Arabic language within a Palestinian context. International Journal of Indian Psychology, 8(4), 566-585. https://doi.org/10.25215/0804.072

Abessa

T. G.

Worku

B. N.

Kibebew

M. W.

Valy

Lemmens

Thijs

Yimer

W. K.

Kolsteren

Granitzer

(2016). Adaptation and standardization of a western tool for assessing child development in non-western low-income context. BMC Public Health, 16(1), 652. https://doi.org/10.1186/s12889-016-3288-2

American Association on Intellectual and Developmental Disabilities (AAIDD) (2010). Definition of intellectual disability. http://aaidd.org/intellectual-disability/definition.

American Psychiatric Association (2013). Diagnostic and statistical manual of mental disorders (5th ed.). American Psychiatric Association.

Andrich

(1978). Application of a psychometric rating model to ordered categories which are scored with successive integers. Applied Psychological Measurement, 2(4), 581-594. https://doi.org/10.1177/014662167800200413

Bock

R. D.

Aitkin

(1981). Marginal maximum likelihood estimation of item parameters: Application of an EM algorithm. Psychometrika, 46(4), 443-459. https://doi.org/10.1007/bf02293801

Boone

W. J.

Noltemeyer

(2017). Rasch analysis: A primer for school psychology researchers and practitioners. Cogent Education, 4, 1416898. https://doi.org/10.1080/2331186X.2017.1416898

Department of Statistics Singapore (2017). Population trend. https://web.archive.org/web/20171107010632/http://www.singstat.gov.sg/docs/default-source/default-document-library/publications/publications_and_papers/population_and_population_structure/population2017.pdf.

Du Plessis

(2016). Adaptive behaviour assessment system: Indigenous Australian adaptation model (ABAS: IAAM). The European Journal of Social & Behavioural Sciences, 15(1), 1999-2013. https://doi.org/10.15405/ejsbs.181

10.

Emam

M. M.

Al-Sulaimani

Omara

Al-Nabhany

(2020). Assessment of adaptive behaviour in children with intellectual disability in Oman: An examination of ABAS-3 factor structure and validation in the Arab context. International Journal of Developmental Disabilities, 66(4), 317-326. https://doi.org/10.1080/20473869.2019.1587939

11.

Floyd

R. G.

Shands

E. I.

Alfonso

V. C.

Phillips

J. F.

Autry

B. K.

Mosteller

J. A.

Skinner

Irby

(2015). A systematic review and psychometric evaluation of adaptive behavior scales and recommendations for practice. Journal of Applied School Psychology, 31(1), 83-113. https://doi.org/10.1080/15377903.2014.979384

12.

Gibbons

R. D.

Weiss

D. J.

Kupfer

D. J.

Frank

Fagiolini

Grochocinski

V. J.

Bhaumik

D. K.

Stover

Bock

R. D.

Immekus

J. C.

(2008). Using computerized adaptive testing to reduce the burden of mental health assessment. Psychiatric Services, 59(4), 361-368. https://doi.org/10.1176/ps.2008.59.4.361

13.

Goldberg

M. R.

Dill

C. A.

Shin

J. Y.

Nhan

N. V.

(2009). Reliability and validity of the Vietnamese Vineland adaptive behavior scales with preschool-age children. Research in Developmental Disabilities, 30(3), 592-602. https://doi.org/10.1016/j.ridd.2008.09.001

14.

Haley

S. M.

Coster

W. J.

Dumas

H. M.

Moed

M. A. P.

(2013). Pediatric Evaluation of disability inventory computer adaptive test. Pearson Publishing.

15.

Harrison

P. L.

Oakland

(2015). ABAS-3: Adaptive behavior assessment system (3rd ed.). Western Psychological Services.

16.

Hill

T. L.

Gray

S. A. O.

Kamps

J. L.

Enrique Varela

(2015). Age and adaptive functioning in children and adolescents with ASD: The effects of intellectual functioning and ASD symptom severity. Journal of Autism and Developmental Disorders, 45(12), 4074-4083. https://doi.org/10.1007/s10803-015-2522-6

17.

Kolen

M. J.

Brennan

R. L.

(2014). Test equating, scaling, and linking: Methods and practices. Springer. https://doi.org/10.1007/978-1-4939-0317-7_1

18.

Kumar

Shankar

Kush

Kumar

Bhave

Agarwal

(2016). Adaptation: Vineland adaptive behavior scale for 3–9 year-old Indian children. International Journal on Disability and Human Development, 15(1), 49-55.

19.

Lang

J. W. B.

Tay

(2021). The science and practice of item response theory in organizations. Annual Review of Organizational Psychology and Organizational Behavior, 8, 311-338. https://doi.org/10.1146/annurev-orgpsych-012420-061705

20.

Linacre

J. M.

(2004). Rasch model estimation: Further topics. Journal of Applied Measurement, 5(1), 95-110. https://psycnet.apa.org/record/2004-10772-007

21.

Linacre

J. M.

(2019). Winsteps® Rasch measurement computer program. Winsteps.com

22.

Magis

Barrada

J. R.

(2017). Computerized adaptive testing with R: Recent updates of the package catR. Journal of Statistical Software, 76, 1-29. https://www.jstatsoft.org/article/view/v076c01.

23.

Ministry of Education Singapore (MOE) (2017). Syllabi. https://www.moe.gov.sg/education/syllabuses.

24.

Mokkink

L. B.

Terwee

C. B.

Patrick

D. L.

Alonso

Stratford

P. W.

Knol

D. L.

Bouter

L. M.

de Vet

H. C. W.

(2010). The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes. Journal of Clinical Epidemiology, 63, 737-745. https://doi.org/ 10.1016/j.jclinepi.2010.02.006

25.

Oakland

Daley

(2013). Adaptive behavior: Its history, concepts, assessment, and applications. In Geisinger

K. F.

Bracken

B. A.

Carlson

J. F.

Hansen

J.-I. C.

Kuncel

N. R.

Reise

S. P.

Rodriguez

M. C.

(Eds.), APA handbook of testing and assessment in psychology, Testing and assessment in school psychology and education (Vol. 3, pp. 183-212). American Psychological Association. https://doi.org/10.1037/14049-009

26.

Poon

K. K.

(2011). The activities and participation of adolescents with autism spectrum disorders in Singapore: Findings from an ICF-based instrument. Journal of Intellectual Disability Research, 55(8), 790-800. https://doi.org/10.1111/j.1365-2788.2011.01397.x

27.

Qualtrics (2018). Qualtrics. https://www.qualtrics.com.

28.

Salekin

K. L.

Neal

T. M. S.

Hedge

K. A.

(2018). Validity, interrater reliability, and measures of adaptive behavior: Concerns regarding the probative versus prejudicial value. Psychology, Public Policy, and Law, 24(1), 24-35. https://doi.org/10.1037/law0000150

29.

Schalock

R. L.

Borthwick-Duffy

S. A.

Bradley

V. J.

Buntinx

W. H. E.

Coulter

D. L.

Craig

E. M.

Gomez

S. C.

Lachapelle

Luckasson

Reeve

Shogren

K. A.

Snell

M. E.

Spreat

Tassé

M. J.

Thompson

J. R.

Verdugo-Alonso

M. A.

Wehmeyer

M. L.

Yeager

M. H.

(2010). Intellectual disability: Definition, classification, and systems of supports (11th ed.). American Association on Intellectual and Developmental Disabilities.

30.

Sparrow

S. S.

Cicchetti

D. V.

Saulnier

C. A.

(2016). Vineland adaptive behavior scales (3rd ed.). NCS Pearson, Inc.

31.

Tan

Reich

Hart

Thuma

P. E.

Grigorenko

E. L.

(2014). Examining the specific effects of context on adaptive behavior and achievement in a rural African community: Six case studies from rural areas of Southern Province, Zambia. Journal of Autism and Developmental Disorders, 44(2), 271-282. https://doi.org/10.1007/s10803-012-1487-y

32.

Tombokan-Runtukahu

Nitko

A. J.

(1992). Translation, cultural adjustment, and validation of a measure of adaptive behavior. Research in Developmental Disabilities, 13(5), 481-501.

33.

van der Linden

W. J.

Hambleton

R. K.

(Eds.), (2013). Handbook of modern item response theory. Springer Science & Business Media.

34.

VandenBos

G. R.

(2006). APA dictionary of psychology: American Psychological Association. https://doi.org/10.1037/14646-000

35.

Wainer

Dorans

N. J.

Flaugher

Green

B. F.

Mislevy

R. J.

(2000). Computerized adaptive testing: A primer (3rd ed.). Routledge.

36.

Weiss

D. J.

Kingsbury

G. G.

(1984). Application of computerized adaptive testing to educational problems. Journal of Educational Measurement, 21(4), 361-375. https://doi.org/10.1111/j.1745-3984.1984.tb01040.x

37.

World Health Organization (2001). International classification of functioning, disability, and health (ICF). WHO.

38.

Wright

B. D.

Stone

M. H.

(1979). Best test design: Rasch measurement. MESA Press.

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.28 MB

1.60 MB