The aim of this study was to validate a computer-assisted screening battery for classifying patients into two groups, those with and without cognitive impairment. Participants were all patients referred to the neuropsychology clinics at four VA medical centers during a 1-year period. Patients meeting the study inclusionary criteria (N = 252) were administered the Neurobehavioral Evaluation System-3 (NES3) computer-assisted battery. A detailed neuropsychological examination was carried out by an experienced neuropsychologist, who diagnosed the patient as cognitively impaired or not impaired. The neuropsychologist's diagnosis was the gold standard. Recursive partitioning analyses yielded several classification procedures using the NES3 data to predict the gold standard. These procedures produced a set of six NES3 tasks that provide good sensitivity and specificity in predicting diagnosis. Sensitivity and specificity for the least random classification procedure were 0.87 and 0.67, respectively. The results suggest that computer-assisted screening methods are a promising means of triaging patients.
American Psychiatric Association . (1994). Diagnostic and statistical manual of mental disorders (4th ed.). Washington, DC: Author.
2.
Anger, W.K. , Rohlman, D.S., Sizemore, O.J., Kovera, C.A., Gibertini, M., & Ger, J. (1996). Human neurobehavioral assessment in neurotoxicology: Producing appropriate test performance with written and shaping instructions. Neurotoxicology and Teratology, 18, 365-370.
3.
Benton, A.L. , & Hamsher, K. (1973). Multilingual aphasia examination. Iowa City: AJA Associates.
4.
Benton, A.L. , & Hamsher, K. (1983). Multilingual aphasia examination (2nd ed.). Iowa City: AJA Associates.
5.
Bloch, D.A. , Moses, L.E., & Michel, B.A. (1990). Statistical approaches to classification. Arthritis and Rheumatism, 33, 1137-1144.
6.
Breiman, L. , Friedman, J., Olshen, R.A., & Stone, C.J. (1984). Classification and regression trees. Belmont, CA: Wadsworth.
7.
Delis, D. , Kramer, J.H., Kaplan, E., & Ober, B.A. (1987). California Verbal Learning Test manual. New York: Psychological Corporation.
8.
Delis, D.C. , Kramer, J.H., Kaplan, E., & Ober, B.A. (2000). California Verbal Learning Test (2nd ed.). San Antonio, TX: Psychological Corporation.
9.
Diamond, R. , White, R.F., Krengel, M., Lindem, K., Feldman, R.G., Palumbo, C., et al. (2000). Validation of the Neurobehavioral Evaluation System (NES) in patients with focal brain damage. In L.T. Connor & L.K. Obler (Eds.), Neurobehavior of language and cognition (pp. 327-346). Boston: Kluwer.
10.
Echeverria, D. , Heyer, N., Martin, M.D., Naleway, C.A., Woods, J.S., & Bittner, A.C. (1995). Behavioral effects of low-level exposure to Hg° among dentists. Neurotoxicology & Teratology, 17, 161-168.
11.
Folstein, M.F. , Folstein, S., & McHugh, P.R. (1975). Mini-mental state: A practical method for grading the cognitive state of patients for the clinician. Journal of Psychiatric Research, 12, 189-198.
Hooisma, J. , Emmen, H.H., Kulig, B.M., Muijser, H., Poortvliet, D., & Letz, R. (1990). Factor analysis of tests from the Neurobehavioral Evaluation System (NES) and the WHO Neurobehavioral Core Test Battery. In B. Johnson (Ed.), Advances in neurobehavioral toxicology (pp. 248-256). Chelsea, MI: Lewis.
16.
Hooper, H.E. (1958). The Hooper Visual Organization Test manual. Los Angeles: Western Psychological Services.
17.
Jastak Associates . (1993). The Wide Range Achievement Test–3 manual. Wilmington, DE: Jastak Associates.
18.
Kane, R.L. , & Kay, G.G. (1992). Computerized assessment in neuropsychology: A review of tests and test batteries. Neuropsychology Review, 3, 1-118.
19.
Kaplan, E. , Goodglass, H., & Weintraub, S. (1983). The Boston Naming Test. Philadelphia: Lea & Febiger.
20.
Kay, G.G. , & Horst, R.L. (1988). Evaluating cognitive function: A review of mental status tests, neuropsychological procedures, and performance-based approaches (DFTA-02-887-C-87069). Oklahoma City: Federal Aviation Administration.
21.
Klove, H. (1963). Clinical neuropsychology. In F.M. Forster (Ed.), The Medical Clinics of North America. Philadelphia: W.B. Saunders.
22.
Kraemer, H.C. (1992). Evaluating medical tests. Newbury Park, CA: Sage.
23.
Krengel, M. , White, R.F., Diamond, R., Letz, R., Cyrus, P., & Durso, R. (1996). A comparison of NES2 and traditional neuropsychological tests in a neurologic patient sample. Neurotoxicology and Teratology, 18, 434-440.
24.
Landis, J.R. , & Koch, G.G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33, 159-174.
25.
Laursen, P. (1990). A computer-aided technique for testing cognitive functions. Acta Neurologica Scandinavia: Supplementum, 82, 1-108.
26.
Letz, R. , & Baker, E. (1988). Neurobehavioral Evaluation System: NES user's manual. Winchester, MA: Neurobehavioral Systems.
27.
Letz, R. , Pieper, W.A., & Morris, R.D. (1996). NES test performance in a large U.S. Army veterans sample: Relationships with both demographic factors and traditional neuropsychological measures. Neurotoxicology and Teratology, 18, 381-390.
28.
Lezak, M.D. (1995). Neuropsychological assessment (3rd ed.). New York: Oxford University Press.
29.
Matthews, C.G. , & Klove, H. (1964). Instruction manual for the Adult Neuropsychology Test battery. Madison, WI: University of Wisconsin Medical School.
30.
McNair, D.M. , Lorr, M., & Droppleman, L.F. (1971). Profile of Mood States. San Diego: Educational and Industrial Testing Service.
31.
Osterreith, P. (1944). Le test de copie d'une figure complexe [A figure-copying test]. Archive de Psychologie, 31, 206-356.
32.
Powell, D.H. , Kaplan, E.F., Whitla, D., Weintraub, S., Catlin, R., & Funkenstein, H.H. (1993). MicroCog: Assessment of cognitive functioning. San Antonio, TX: Psychological Corporation.
33.
Proctor, S.P. , Letz, R., & White, R.F. (2000). Validity of a computer-assisted neurobehavioral test battery in toxicant encephalopathy. NeuroToxicology, 21, 707-714.
Reitan, R.M. , & Wolfson, D. (1985). The Halstead-Reitan Neuropsychological Test battery. Tucson, AZ: Neuropsychology Press.
36.
Rey, A. (1964). L'Examen Clinique en Psychologie [The clinical psychological examination]. Paris: Presses Universitaires de France.
37.
Ritchie, K. , Allard, M., Huppert, F.A., Nargeot, C., Pinek, B., & Ledesert, B. (1991). Computerized cognitive examination of the elderly (ECO): The development of a neuropsychological examination for clinic and population use. International Journal of Geriatric Psychiatry, 8, 899-914.
38.
Samet, M. , Geiselman, R.E., Zajaczkowski, F., & Marshall-Miles, J. (1986). Cognitive Assessment Battery (CCAB): Test description. Alexandria, VA: U.S. Army Research Institute.
39.
Spreen, O. , & Strauss, E. (1998). A compendium of neuropsychological tests (2nd ed.). New York: Oxford University Press.
40.
Steenland, K. , Jenkins, B., Ames, R.G., O'Malley, M., Chrislip, D., & Russo, J. (1994). Chronic neurologic sequelae to organophosphate pesticide poisoning. American Journal of Public Health, 84, 731-736.
41.
Stollery, B.T. (1996). The Automated Cognitive Test (ACT) system. Neurotoxicology and Teratology, 18, 493-498.
42.
Tombaugh, T.N. (1996). Test of memory malingering. North Tonawanda, NY: Multi-Health Systems.
43.
Turnage, J.J. , & Kennedy, R.S. (1992). The development and use of a computerized human performance test battery for repeated measures applications. Human Performance, 5, 268-301.
Veroff, A.E. , Cutler, N.R., Sramek, J.J., Prior, P.L., Mickelson, W., & Hartman, J.K. (1991). A new assessment tool for neuropsychopharmacologic research: The Computerized Neuropsychological Test Battery. Journal of Geriatric Psychiatry and Neurology, 4, 211-217.
46.
Wechsler, D. (1997). Wechsler Adult Intelligence Scale III. San Antonio, TX: Psychological Corporation.
47.
White, R.F. (1992). Clinical syndromes in adult neuropsychology: The practitioner's handbook. Amsterdam: Elsevier.
48.
White, R.F. , Diamond, R., Krengel, M., Feldman, R.G., Letz, R., Eisen, E., & Wegman, D. (1996). Validation of the NES2 in neurologic patients. Neurotoxicology and Teratology, 18, 435-439.
49.
White, R.F. , James, K.E., Vasterling, J.J., Marans, K., Delaney, R., Krengel, M., et al. (2002). Interrater reliability of neuropsychological diagnoses: A Department of Veterans Affairs cooperative study. Journal of the International Neuropsychological Society, 8, 555-565.
50.
White, R.F. , Proctor, S.P., Heeren, T., Wolfe, J., Krengel, M., Vasterling, J., et al. (2001). Neuropsychological function in Gulf War veterans: Relationships to self-reported exposures. American Journal of Industrial Medicine, 40, 42-54.
51.
White, R.F. , Robins, T.G., Proctor, S., Echeverria, D., & Rocksay, A.S. (1994). Neuropsychological effects of naphtha exposure among automotive workers. Occupational and Environmental Medicine, 51, 102-112.
52.
Winneke, G. , Altmann, L., Krämer, U., Turfeld, M., Behler, R., Gutsmuths, F.J., et al. (1994). Neurobehavioral and neurophysiological observations in six year old children with low lead levels in East and West Germany. NeuroToxicology, 15, 705-714.
