This study examined psychometric properties of the Tempe Sorting Task (TST), a new measure of executive function (EF) for children. To increase the meaningfulness of test score interpretations, an age-appropriate construct was employed to incorporate Denckla's description of EF. Multiple measures of EF, including the TST, were collected for children (N = 81). Interrater reliability estimates of the TST scores across trials were high. Split-half reliability estimates were slightly lower and varied across trials. Multiple significant correlations were observed between the TST, Expressive Attention task, and teacher Attention Deficit Hyperactivity Disorder (ADHD) rating scales. Furthermore, statistically significant differences in TST scores between children with elevated versus normal-range ADHD ratings (dTrial1 = 1:49, dTrial2 = 0:86) provided some evidence of the discriminatory power of the TST. Overall, results provided some evidence supporting the interpretation of TST measures as indicators of children's EF. Advantages of the TST over existing children's EF measures are considered.
American Psychiatric Association. (2000). Diagnostic and statistical manual of mental disorders (4th ed.). Washington, DC: Author .
2.
Barkley, R.A. (1997). ADHD and the nature of self-control. New York: Guilford.
3.
Barkley, R.A., & Grodzinsky, G. (1994). Are tests of frontal lobe functions useful in the diagnosis of attention deficit disorder? Clinical Neuropsychologist, 8, 121-139.
4.
Bedard, A., Ickowicz, A., Logan, G.D., Hogg-Johnson, S., Schachar, R., & Tannock, R. (2003). Selective inhibition in children with attention-deficit hyperactivity disorder off and on stimulant medication. Journal of Abnormal Child Psychology, 31, 315-327.
5.
Denckla, M.B. (1994). Measurement of executive function. In G. R. Lyon (Ed.), Frames of reference for the assessment of learning disabilities (pp. 117-142), Baltimore: Brookes.
6.
DuPaul, G.P., Power, T.J., Anastopoulos, A.D., & Reid, R. (1998). ADHD Rating Scale-IV: Checklists, norms, and clinical interpretation. New York: Guilford .
Embretson, S.E. (1998). A cognitive design system approach to generating valid tests: Application to abstract reasoning. Psychological Methods, 3, 380-396.
9.
Embretson, S.E., & Gorin, J. (2001). Improving construct validity with cognitive psychology principles. Journal of Educational Measurement, 38, 343-368.
10.
Ferrara, S., & DeMauro, G.E. (2006). Standardized assessment of individual achievement in K-12. In R. L. Brennan (Ed.), Educational measurement (4th ed., pp. 579-621). Westport, CT: American Council on Education/ Praeger.
11.
Gordon, M. (1983). The Gordon Diagnostic System. DeWitt, NY: Gordon Systems.
12.
Gorin, J.S. (2006). Item design with cognition in mind. Educational Measurement: Issues and Practice, 25, 21-35.
13.
Hughes, C., & Graham, A. (2002). Measuring executive functions in childhood: Problems and solutions? Child and Adolescent Mental Health, 7, 131-142.
14.
Korkman, M., Kirk, U., & Kemp, S. (1998). NESPY: A Developmental Neuropsychological Assessment . San Antonio: TX: Psychological Corporation.
15.
Landau, S., Milich, R., & Widiger, T.A. (1991). Predictive power methods may be more helpful for diagnosis than sensitivity and specificity. Journal of Child and Adolescent Psychopharmacology, 2, 343-351.
16.
Messick, S. (1995). Validity of psychological assessment: Validation of inferences from persons' responses and performances as scientific inquiry into score meaning. American Psychologist, 50, 741-749.
17.
Mislevy, R.J. (2007). Validity by design. Educational Researcher, 36(8),463-469.
Nigg, J.T., Hinshaw, S.P., Carte, E., & Treuting, J. (1998). Neuropsychological correlates of childhood attention deficit hyperactivity disorder: Explainable by comorbid disruptive behavior or reading problems? Journal of Abnormal Psychology, 107, 468-480.
20.
Oosterlaan, J., Logan, G.D., & Sergeant, J.A. (1998). Response inhibition in AD/HD, CD, comorbid AD/HD + CD, anxious, and control children: A meta-analysis of studies with the stop task. Journal of Child Psychology and Psychiatry, 39, 411-425.
21.
Ozonoff, S. (1997). Components of executive function in autism and other disorders. In E. Schopler & G. B. Mesibov (Eds.), Learning and cognition in autism. Current issues in autism (pp. 199-219). New York: Plenum.
22.
Pennington, B.F. (2002). The development of psychopathology: Nature and nurture. New York: Guilford.
23.
Reitan, R.M. (1955). The relation of the Trail Making Test to organic brain damage. Journal of Consulting Psychology, 19, 393-394.
24.
Reynolds, C.R., Livingston, R.B., & Willson, V. (2006). Measurement and assessment in education. Boston: Allyn & Bacon.
25.
Rimm-Kaufman, S.E., Pianta R. C., & Cox, M.J. (2000). Teachers' judgment of problems in the transition to kindergarten. Early Childhood Quarterly , 15, 147-166.
26.
Root, R.W., II, & Resnick, R.J. (2003). An update on the diagnosis and treatment of attention-deficit/ hyperactivity disorder in children. Professional Psychology: Research and Practice, 34, 34-41.
27.
Sattler, J.M. (2001). Assessment of children: Cognitive applications . San Diego: Author.
28.
Stroop, J. (1935). Studies of interference in serial, verbal reactions . Journal of Experimental Psychology, 18, 643-661.
29.
Vacha-Haase, T., Henson, R.K., & Caruso, J.C. (2002). Reliability generalization: Moving toward improved understanding and use of score reliability. Educational and Psychological Measurement, 62, 562-569.
30.
Welsh, M.C. (1994). Executive function and the assessment of attention deficit hyperactivity disorder. In N. C. Jordan & J. Goldsmith-Phillips (Eds.), Learning disabilities: New directions of assessment and intervention (pp. 21-42). Boston: Allyn & Bacon.
