This study examined for the first time the test-retest reliability of theory-of-mind tasks when administered to children with Autism Spectrum Disorders (ASD). A total of 16 questions within 9 tasks targeting a range of content and complexity were administered at 2 times to 17 children with ASD. In all, 13 questions demonstrated adequate test-retest reliability and high internal consistency. Items that did not achieve reliability violated a pragmatic convention, were ambiguous, or were associated with a response bias. No effect of verbal ability or diagnosis was found on consistency of performance. There was no effect of interval (i.e., short vs. long) on change in score although modest increases in performance occurred generally across administrations. Implications for research and practice are considered.
American Psychiatric Association. (1994). Diagnostic and statistical manual of mental disorders (4th ed.). Washington, DC: Author .
2.
Baron-Cohen, S. (1991). Do people with autism understand what causes emotion ? Child Development, 62, 385-395.
3.
Baron-Cohen, S., Leslie, A.M., & Frith, U. (1985). Does the autistic child have a theory of mind ? Cognition, 21, 37-46.
4.
Beukelman, D., & Mirenda, P. (1992). Augmentative and alternative communication: Management of severe communication disorders in children and adults. Baltimore: Paul H. Brookes.
5.
Bishop, D. (1989). The Test for Reception of Grammar. London: Medical Research Group.
6.
Charman, T., & Campbell, A. (1997). Reliability of theory of mind task performance by individuals with a learning disability. Journal of Child Psychology & Psychiatry, 38, 725-730.
7.
Cicchetti, D.V., & Feinstein, A.R. (1990). High agreement but low kappa: II. Resolving the paradoxes. Journal of Clinical Epidemiology , 43, 551-558.
8.
Dettmer, S., Simpson, R.L., Myles, B.S., & Ganz, J.B. (2000). The use of visual supports to facilitate transitions of students with autism. Focus on Autism and Other Developmental Disabilities, 15, 163-169.
9.
Dunn, L.M., & Dunn, L.M. (1997). Examiner's manual for the Peabody Picture Vocabulary Test (3rd ed.). Circle Pines, MN: American Guidance Service.
10.
Feinstein, A.R., & Cicchetti, D.V. (1990). High agreement but low kappa: The problems of two paradoxes. Journal of Clinical Epidemiology, 43, 543-549.
11.
Flavell, J.H., Everett, B.A., Croft, K., & Flavell, E.R. (1981). Young children's knowledge about visual perception: Further knowledge about the Level 1-Level 2 distinction. Developmental Psychology, 17, 99-103.
12.
Fleiss, J.L., Cohen, J., & Everitt, B.S. (1969). Large sample standard errors of kappa and weighted kappa. Psychological Bulletin, 72, 323-327.
13.
Grandin, T. (1995). The learning styles of people with autism: An autobiography. In K. A. Quill (Ed.), Teaching children with autism: Strategies to enhance communication and socialization (pp. 33-52). Albany, NY: Delamar.
14.
Hadwin, J., Baron-Cohen, S., Howlin, P., & Hill, K. (1996). Can we teach children with autism to understand emotions, belief, or pretence?Development and Psychopathology , 8, 345-365.
15.
Happe, F. (1995). The role of age and verbal ability in the theory of mind task performance of subjects with autism. Child Development , 66, 843-855.
16.
Hughes, C., Adlam, A., Happe, F., Jackson, J., Taylor, A., & Caspi, A. (2000). Good test-retest reliability for standard and advanced false-belief tasks across a wide range of abilities. Journal of Child Psychology & Psychiatry, 41, 483-490.
17.
Johnston, S., Nelson, C., Evans, J., & Palazolo, K. (2003). The use of visual supports in teaching young children with Autism Spectrum Disorder to initiate interactions. Augmentative and Alternative Communication, 19, 86-103.
18.
Kaplan, R.M., & Saccuzzo, D.P. (1989). Psychological testing: Principles, applications, and issues. Pacific Grove, CA : Brooks/Cole.
19.
Leslie, A.M. (1987). Pretense and representation: The origins of "theory of mind." Psychological Review, 94, 412-426.
20.
Lord, C., Rutter, M., DiLavore, P.C., & Risi, S. (1999). Autism Diagnostic Observation Schedule-Generic (ADOS-G). Los Angeles: Western Psychological Services.
21.
Mayes, L., Klin, A., Tercyak, K.P., Cicchetti, D.V., & Cohen, D.J. (1996). Test-retest reliability for false-belief tasks . Journal of Child Psychology and Psychiatry, 37, 313-319.
22.
McCauley, R. (2001). Assessment of language disorders in children. Mahwah, NJ: Lawrence Erlbaum.
23.
McReynolds, L.V., & Kearns, K.P. (1983). Single-subject experimental designs in communicative disorders. Baltimore: University Park Press.
24.
Mitchell, P., Saltmarsh, R., & Russell, H. (1997). Overly literal interpretations of speech in autism: Understanding that messages arise from minds. Journal of Child Psychology and Psychiatry & Allied Disciplines, 38, 658-691.
25.
Muris, P., Steerneman, P., Meesters, C., Merckelbach, H., Horselenberg, R., van den Hogen, T., et al. (1999). The TOM Test: A new instrument for assessing theory of mind in normal children and children with Pervasive Developmental Disorders. Journal of Autism and Developmental Disorders, 29, 67-80.
Perner, J., Frith, U., Leslie, A.M., & Leekam, S.R. (1989). Exploration of the autistic child's theory of mind: Knowledge, belief, and communication. Child Development , 60, 689-700.
28.
Peterson, C.C., Wellman, H.M., & Liu, D. (2005). Steps in theory-of-mind development for children with deafness or autism. Child Development, 76, 502-517.
29.
Prior, M., Dahlstrom, B., & Squires, T.L. (1990). Autistic children's knowledge of thinking and feeling in other people. Journal of Child Psychology & Psychiatry, 31, 587-601.
30.
Siegal, M., & Beattie, K. (1991). Where to look first for children's knowledge of false beliefs. Cognition, 38, 1-12.
31.
Silliman, E.R., Diehl, S.F., Bahr, R.H., Hnath-Chisolm, T., Zenko, C.B., & Friedman, S.A. (2003). A new look at performance on theory-of-mind tasks by adolescents with Autism Spectrum Disorder. Language, Speech, and Hearing Services in Schools, 34, 236-252.
32.
Sullivan, K., Zaitchik, D., & Tager-Flusberg, H. (1994). Preschoolers can attribute second-order beliefs. Developmental Psychology, 30(3), 395-402.
33.
Tager-Flusberg, H. (2000). Language and understanding minds: Connections in autism. In S. Baron-Cohen, H. Tager-Flusberg, & D. H. Cohen (Eds.), Understanding other minds: Perspectives from developmental cognitive neuroscience (2nd ed., pp. 124-149). Oxford, UK: Oxford University Press.
34.
Tager-Flusberg, H. (2001). A reexamination of the theory of mind hypothesis of autism. In J. A. Burack, T. Charman., N. Yirmiya. , & P. R. Zelazo (Eds.), The development of autism: Perspectives from theory and research (pp.173-193). Mahwah, NJ: Lawrence Erlbaum.
35.
Wechsler, D. (1990). Wechsler Preschool and Primary Scale of Intelligence-Revised . London: Psychological Corporation, Harcourt Brace.
36.
Wellman, H.M., Cross, D., & Watson, J. (2001). Meta-analysis of theory-of-mind development: The truth about false beliefs. Child Development, 72, 655-684.
37.
Wellman, H.M., & Liu, D. (2004). Scaling of ToM tasks. Child Development , 75, 523-541.
38.
Williams, K.T., & Wang, J. (1997). Technical references to the Peabody Picture Vocabulary Test (3rd ed.). Circle Pines, MN: American Guidance Service.
39.
Wimmer, H., & Perner, J. (1983). Beliefs about beliefs: Representation and the constraining function of wrong beliefs in young children's understanding of deception. Cognition, 13, 103-128.
40.
Yirmiya, N., Erel, O., Shaked, M., & Solomonica-Levi, D. (1998). Meta-analyses comparing theory of mind abilities of individuals with autism, individuals with mental retardation, and normally developing individuals. Psychological Bulletin, 124, 283-307.
