This study addresses the test reliability of a screening test and stability of children's cognitive functioning. Children aged 5 to 8 years in western Sydney were assessed on three occasions. The first assessment provided a baseline, with the second assessment at 2-, 4-, or 12-week intervals. The final assessment was 4 weeks later. Indicators of reliability and stability suggested that a distinction can be made between test reliability and the phenomenon (cognitive functioning) stability. Cognitive functioning was assessed using the School-Years Screening Test for the Evaluation of Mental Status (SYSTEMS). The findings have implications for indicators of reliability and stability of cognitive assessments in developmental research and clinical practice. (J Child Neurol 2003; 18: 5—11).
Get full access to this article
View all access options for this article.
References
1.
Ouvrier R., Hendy J., Bornholt L., Black F.: The School-Years Screening Test for the Evaluation of Mental Status (SYSTEMS) . J Child Neurol1999;14:772—780.
2.
Baltes PB, Reese W., Nesselroade JR: Life-Span Developmental Psychology: Introduction to Research Methods. Monterey, CA, Brooks/Cole, 1977 .
3.
Bjorklund DF: Children's Thinking: Developmental Function and Individual Differences, 2nd ed. Sydney, NSW, Brooks/Cole , 1995.
4.
Nesselroade JR : Adult personality development: Issues in assessing constancy and change, in Rabin AI, Zucker RA, Emmons RA, Frank S (eds): Studying Persons and Lives . New York, Springer, 1990, 41—83.
5.
Nesselroade JR, Pruchno R., Jacobs A.: Reliability vs. stability in the measurement of psychological states: An illustration with anxiety measures. Psychol Beitr1986;28:255—264.
6.
Wu X., Hart CH, Draper TW, Olsen JA: Peer and teacher socio-metrics for preschool children: Cross-informant concordance, temporal stability, and reliability. Merrill-Palmer Q2001;47: 416—443.
7.
Heise DR: Separating reliability and stability in test-retest correlation. Am Sociol Rev1969;34:93—101.
8.
Heise DR: Comment on “The estimation of measurement error in panel data.” Am Sociol Rev1970;35:117.
9.
Valera JB: Two path analytic models of test-retest reliability: Examples from social psychology. PhilippineJ Psychol1991; 24: 49—58.
10.
Wiley DE, Wiley JA: The estimation of measurement error in panel data. Am Sociol Rev1970;35:112—117.
11.
Crocker LM, Algina J.: Introduction to Classical and Modern Test Theory. New York , Holt, Reinhart & Winston, 1986.
12.
Anastasi A., Urbina S.: Psychological Testing, 7th ed. Upper Saddle River, NJ, Prentice-Hall International , 1997.
13.
American Education Research Association, American Psychological Association, and The National Council on Measurement in Education : Standards for Educational and Psychological Testing. Washington, DC, American Educational Research Association , 1999.
14.
Berry JM, West RL, Dennehey DM: Reliability and validity of memory self-efficacy questionnaire. Dev Psychol1989; 25: 701—713.
15.
Gergen KJ: From self to science: What is there to know? in Suls J (ed): Psychological Perspectives on the Self. London, Lawrence Erlbaum, 1982, 129—149.
16.
Ottenbacher KJ: An examination of reliability in developmental research. J Dev Behav Pediatr1995;16:177—182.
17.
Statistical Package for the Social Sciences (SPSS), Version 10.05th ed. Chicago, SPSS Inc, 1999.
18.
Tisak J., Tisak MS: Permanency and ephemerality of psychological measures with application to organizational commitment. Psychol Methods2000;5:175—198.
19.
Ellis HC, Hunt RR: Fundamentals of Human Memory and Cognition, 4th ed. Dubuque, IA, WC Brown, 1989.
20.
Strub RL, Black FW: The Mental Status Examination in Neurology, 3rd ed. Philadelphia, FA Davis, 1993.
21.
Bjorklund DF: Children's Thinking: Developmental Function and Individual Differences, 3rd ed. Sydney, NSW, Brooks/Cole , 2000.
22.
Richardson Jte: Introduction to the study of gender differences in cognition, in Caplan PJ, Crawford M, Hyde JS, Richardson JTE (eds): Gender Difference in Human Cognition. New York, Oxford University Press, 1997 , 3—29.
23.
Ouvrier R., Hendy J., Bornholt L., Black F.: The Administration and Scoring Manual for the School-Years Screening Test for the Evaluation of Mental Status (SYSTEMS). Westmead, NSW, The NewChildren's Hospital, 2000.
24.
Coleman JS: The mathematical study of change, in Blalock HM Jr, Blalock AB (eds): Methodology in Social Research. New York, McGraw-Hill, 1968, 428—478.
25.
Australian Bureau of Statistics: Socio-Economic Indices for Areas (SEIFA). Canberra, Australian Capital Territory, Australian Government Printing Service, 1990.
26.
Ouvrier RA, Goldsmith RF, Ouvrier S., Williams DC: The value of the Mini Mental State Examination in childhood. A preliminary study. J Child Neurol1993;8:145—148.
27.
Bach LA, Sharpe K.: Sample size for clinical and biological research. Aust N Z J Med1989;19:64—68.
28.
Folstein MF , Folstein SE, McHugh PR: Mini-Mental State: A practical method for grading the cognitive state of patients for the clinician. J Psychiatr Res1975;12:189—198.
29.
Thorndike RL, Hagen EP, Sattler JM: The Stanford Binet Intelligence Test, 4th ed. Marrickville, NSW, Harcourt Assessment Company and the Psychological Corporation, 1986.
30.
Elliot CD: The Differential Ability Scales. Marrickville, NSW, Harcourt Assessment Company and thePsychological Corporation, 1990 .
