The Behavioral Evaluation for Epidemiology Studies test battery uses touch-screen technology and novel methodologies to enhance neurobehavioral assessment. Scores generally show differential stability from the first trial with individual test reliabilities at or above 80 when normalized to a 3-min. administration. Six highly reliable (r ≥.87) factors were identified that cover functions known to be sensitive to neurotoxicants and physical exposures. These results strongly support recommendation of the new test battery for use in repeated-measures epidemiologic studies where first trial stability is desired.
Get full access to this article
View all access options for this article.
References
1.
AckerW. (1982) A computerized approach to psychological testing: the Bexley-Maudsley Automated Psychological Screening and the Bexley-Maudsley Category Sorting Test. International Journal of Man-Machine Studies, 18, 361–369.
2.
Adult Environmental Neurobehavioral Test Battery. (1995) In AmlerR. W.AngerW. K.SizemoreO. J. (Eds.), Atlanta, GA: U.S. Department of Health and Human Services, Agency for Toxic Substances and Disease Registry. Pp. 31–56.
3.
AllenM. J.YkenW. M. (1979) Introduction to measurement theory. Monterey, CA: Brooks/Cole.
4.
AngerW. K.JohnsonB. L. (1985) Chemicals affecting behavior. In O'DonoghueJ. (Ed.), Neurotoxicology of industrial and commercial chemicals. Boca Raton, FL: CRC Press. Pp. 51–148.
5.
AngerW. K.RohlmanD. S.SizemoreO. J.KovbraC. A.GibertiniM.GerJ. (1996) Human behavioral assessment in neurotoxicology: producing appropriate test performance which written and shaping instructions. Neurotoxicology & Teratology, 18, 371–279.
6.
AngesW. K.SizemoreO. J. (1995) Variables affecting performance on the ATSDR Adult Environmental Neurobehavioral Test Battery: research needs. In AndrewsJ. S.FrumkinH.JohnsonB. L.MehlmanM. A.XintatasC.BucselaJ. A. (Eds.), Hazardous waste and public health: international congress on the health effects of hazardous waste, Atlanta, GA: U.S. Department of Health and Human Services, Agency for Toxic Substances and Disease Registry. Pp. 698–711.
7.
ArciaE.OttoD. A. (1990) Test-retest reliability of selected tests from the Neurobehavioral Evaluation System (NES). (Report 3) Research Triangle Park, NC: Health Effects Research Laboratory, U.S. Environmental Protection Agency.
8.
AhtiolaI.FortunyL.HeatonR. K. (1996) Standard versus computerized administration of the Wisconsin Card Sorting Test. Clinical Neuropsychologist, 10, 419–424.
9.
Army Individual Test Battery: manual and directions for scoring. (1944) Washington, DC; War Department, Adjutant General's Office.
10.
BakerE. L.LetzR. E.EisenE. A.PothierW.PlantamuraD. L.LarsonM.WolfordR. (1988) Neurobehavioral effects of solvents in construction painters. Journal of Occupational Medicine, 31, 116–123.
11.
BakerE. L.LetzR. E.FidlerA. T. (1985) A computer-administered neurobehavioral evaluation system for occupational and environmental epidemiology, Journal of Occupational Medicine, 27, 206–212.
12.
BakerE. L.LetzR. E.FidlerA. T.ShalatS.PlantamuraD. L.LyndonM. (1985) A computer-based neurobehavioral evaluation system for occupational and environmental epidemiology: methodology and validation studies. Neurobehavioral Toxicology Teratology, 7, 369–377.
13.
BentonA. L. (1977) Interactive effects of age and brain disease on reaction time. Archives of Neurology, 34, 369–370.
14.
BittnerA. C.Jr. (1982) Averaged correlations between parallel measures: reliability estimation. In Proceedings of the Eighth Symposium: Psychology in the DoD. Colorado Springs, CO: U.S.A.F. Academy, Pp. 321–327.
15.
BittnerA. C.Jr.CarterR. C.KennedyR. S.HarbesonM. M.KrauseM. (1986) Performance Evaluation Tests for Environmental Research (PETER): evaluation of 114 measures. Perceptual and Motor Skills, 63, 683–708.
16.
BittnerA. C.Jr.CarterR. C.KrauseM.KennedyR. S.HarbesonM. M. (1983) Performance Evaluation Tests for Environmental Research (PETER): Moran and computer batteries. Aviation, Space and Environmental Medicine, 54, 923–928.
17.
BittnerA. C.Jr.SmithM.KennedyR. S.StaleyC. F.HarbesonM. M. (1985) Automated Portable Test (APT) system: overview and prospects. Behavioral Research Methods, Instruments and Computers, 19, 217–221.
18.
BurkeJ. D.BurkeK. C.BakerJ. H.HillisA. (1995) Test-retest reliability in psychiatric patients of the SF-36 Health Survey, International Journal of Methods in Psychiatric Research, 5, 189–194.
19.
ButcherJ. N.DahlstromW. G.GrahamJ. R.TellegenA.KaemmerB. (1989) Minnesota Multiphasic Personality Inventory—2: manual for administration and scoring. Minneapolis, MN: Univer. of Minnesota Press.
20.
CampbellK. A.RohlmanD. S.StorzbachD.BinderL. M.AngerW. K.KoveraC. A.DavisK. J.GrossmannS. J. (1999) Test-retest reliability of physiological and neurobehavioral tests self-administered by computer. Assessment, 6, 21–32.
21.
CarrA. C.AncillR. J.GhoshA.MargoA. (1981) Direct assessment of depression by microcomputer: a feasibility study. Acta Psychiatrica Scandinavica, 64, 415–422.
22.
DavenportW. B.RootW. L. (1958) An introduction to the theory of random signals and noise. New York: McGraw-Hill.
23.
DuffyJ. C.WatertonJ. J. (1984) Under reporting of alcohol consumption in sample surveys: the effect of computer interviewing in fieldwork. British Journal of Addiction, 79, 303–308.
24.
DunlapW. P.KennedyR. S. (1995) Testing for statistical power. Ergonomics in Design, July 6–7, 31.
25.
DunlapW. P.SilverN. C.BittnerA. C.Jr. (1986) Estimating reliability with small samples: increased precision with averaged correlations. Human Factors, 28, 685–690.
26.
DunlapW. P.SilverN. C.HunterR. E.BittnerA. C.Jr. (1985) Averaged cross-correlations: a methodology for validity assessments in small samples. In EbertsR.EbertsC. G. (Eds.), Trends in ergonomics/human factors: II. New York: North-Holland. Pp. 13–21.
27.
DuthieB. (1984) A critical examination of computer administered psychological tests. In SchwartzM. D. (Ed.), Using computers in clinical practice: psychotherapy and mental health applications. New York: Haworth. Pp. 135–139.
28.
EcheverriaD.AposhianH. V.WoodsJ. S.HeyerN. J.AposhianM. M.BittnerA. C.Jr.MahurinR. K.CianciolaM. (1998) Neurobehavioral effects from exposure from dental amalgam Hg°: new distinctions between recent exposure and Hg body burden. The FASEB Journal, 12, 971–980.
29.
EcheverriaD.FineL. E.LangolfG.SchorkA.SampaioC. (1989) Acute behavioral effects of toluene. British Journal of Industrial Medicine, 46, 483–495.
30.
EcheverriaD.FineL. F.LangolfC.SchorkA.SampaioC. (1991) Acute behavioral comparisons of toluene and ethanol in human subjects. British Journal of Industrial Medicine, 48, 750–761.
31.
EcheverriaD.HeyerN. J.MartinM. D.NalewayC. A.WoodsJ. S.BittnerA. C.Jr. (1995) Behavioral effects of low-level exposure to Hg° among dentists. Neurotoxicology & Teratology, 17, 161–168.
32.
EcheverriaD.WhiteR.SampaioC. (1995) A neurobehavioral evaluation of PCE exposure: I. A possible relationship between clinical and pre-clinical effects, Journal of Occupational Medicine, 37, 667–680.
33.
EckermanD. A.CarolJ. B.ForeeD.GullionC. M.LansmanM.LongE. R.WallerW. B.WallstenT. S. (1985) An approach to brief field testing for neurotoxicity. Neurobehavioral Toxicology Teratology, 7, 387–393.
34.
GamberaleF. (1985) The use of behavioral performance tests in the assessment of solvent toxicity. Scandinavian Journal of Work Environmental Health, 11(Suppl. 1), 65–74.
35.
GellerI.StebbinsW. C.WaynerM. J. (Eds.) (1979) Test methods for definition of effects of toxic substances on behavior and neuromotor functions. Neurobehavioral Toxicology, 1 (Suppl. 1), 1–225.
36.
GrantC. D.NashM. R. (1995) The computer-assisted Hypnosis Scale: standardization and norming of a computer-administered measure of hypnotic ability. Psychological Assessment, 7, 49–58.
37.
HanninenH.EskilinenL.HusmanK.NuminenM. (1976) Behavioral effects of long-term exposure to a mixture of organic solvents. Scandinavian Journal of Work Environmental Health, 2, 240–255.
38.
HarmonH. (1975) Modern factor analysis. (2nd ed.) Chicago, IL: Univer. of Chicago Press.
39.
HeyerN. J.BittnerA. C.Jr.EcheverriaD. (1996) Analyzing multivariate neurobehavioral outcomes in occupational studies: a comparison of approaches. Neurotoxicology & Teratology, 18, 401–406.
40.
KimuraD. (1963) Right temporal lobe damage. Archives of Neurology, 8, 264–271.
41.
LetzR. (1990) The neurobehavioral evaluation system: an international effort. In JohnsonB. L. (Ed.), Advances in neurobehavioral toxicology: applications in environmental and occupational health. Chelsea, MI: Lewis. Pp. 189–201.
42.
LezakM. D. (1995) Neuropsychological assessment. (3rd ed.) Vol. 3. New York: Oxford Univer. Press.
43.
LuceR. D. (1986) Response times: their role in inferring elementary mental organization. New York: Oxford Univer. Press.
44.
MahoneyF. C.MooreP. A.BakerE. L.LetzR. (1988) Experimental nitrous oxide exposure as a model system for evaluating neurobehavioral tests. Toxicology, 49, 449–453.
45.
MaizlishN.SchenkerM.WeisskopfC.SeiberJ.SamuelsS. (1987) A behavioral evaluation of pest control workers with short-term, low-level exposure to the organophosphate diazinon. American Journal of Industrial Medicine, 12, 153–172.
46.
MalcomR.SturgisE. T.AntonR. R.WilliamsL. (1989) Computer-assisted diagnosis of alcoholism. Computers in Human Services, 5, 163–170.
47.
MeadA. D.DragowF. (1993) Equivalence of computerized and paper-and-pencil cognitive ability tests: a meta-analysis. Psychological Bulletin, 114, 449–458.
48.
Micro Touch Systems, Inc. (2000) Information sheet on Clear Tek 3000 Capacitive Touch-screens.®Methuen, MA: Micro Touch Systems, Inc.
49.
MillerG. (1956) The span of immediate memory. Psychological Review, 63, 81–97.
50.
MorelandK. L. (1985) Validation of computer-based test interpretations: problems and prospects. Journal of Consulting and Clinical Psychology, 53, 816–825.
51.
NealL. A.BusuttilW.HerapathR.StrikeP. W. (1994) Development and validation of the computerized Clinical Administered Post-traumatic Stress Disorder Scale-I-Revised. Psychological Medicine, 24, 701–706.
52.
NeillW. T. (1979) Switching attention within and between categories: evidence for intracategory inhibition. Memory & Cognition, 7, 283–290.
53.
PosnerM. I. (1987) Cognitive neuropsychology and the problem of selective attention. Electroencephalogy Clinical Neurophysiology, Suppl.39, 313–316.
54.
ProctorS. P.LetzR.WhiteR. F. (2000) Validity of a computer-assisted neurobehavioral test battery in toxicant encephalopathy. Neurotoxicology, 21, 703–714.
55.
ReitanR. M. (1986) Theoretical and methodological bases of the Halstead-Reitan Neuropsychological Test Battery. In GrantI.AdamsK. (Eds.), Neuropsychological assessment of neuropsychiatric disorders. New York: Oxford Univer. Press. Pp. 3–30.
56.
ReitanR. M.WolfsonD. (1993) The Halstead-Reitan Neuropsychological Test Battery: theory and clinical interpretation. Vol. 2. Tucson, AZ: Neuropsychology Press.
57.
RohlmanD. S.BaileyS. R.BrownM.BlanockM.AngerW. K.McCauleyL. (2000) Establishing stable test performance in tests from the Behavioral Assessment and Research System (BARS). Neurotoxicology, 21, 715–724.
58.
RohlmanD. S.SizemoreO. J.AngerW. K.KoveraC. A. (1996) Computerized neurobehavioral testing: techniques for improving test instructions. Neurotoxicology & Teratology, 18, 407–412.
59.
RosvoldH. E.MirskyA. F. (1956) A continuous performance test of brain damage. Journal of Consulting and Clinical Psychology. 20, 343–350.
60.
SchuldbergD. (1988) The MMPI is less sensitive to the automated testing format that it is to repeated testing: item and scale effects. Computers in Human Behavior, 4, 285–298.
61.
SchuldbergD. (1990) Varieties of inconsistency across test occasions: effects of computerized test administration and repeated testing. Journal of Personality Assessment, 55, 168–182.
62.
SegalowitzS. J.UnsalA.DywanJ. (1992) CNV evidence for the distinctiveness of frontal and posterior neural processes in a traumatic brain injured population. Journal of Clinical and Experimental Neuropsychology, 14, 545–565.
63.
SheridanT. G.TerrelN. R. (1974) Man machine systems: information, control, and decision models of human performance. Cambridge, MA: MIT Press.
64.
ShipleyW. C. (1946) Institute of Living Scale. Los Angeles, CA: Western Psychological Services.
65.
SimolaS. K.HoldenR. R. (1992) Equivalence of computerized and standardized administration of the Piers-Harris Children's Self-concept Scale. Journal of Personality Assessment. 58, 287–294.
66.
SmithA. (1981) The Symbol Digit Modalities Test: a neutopsychologic test for economic screening of learning and other cerebral disorders. Learning Disorders, 3, 83–91.
67.
SpearmanC. (1930) “G” and after—a school to end schools. In MurchisonC. (Ed.), Psychologies of 1930. Worcester, MA: Clark Univer. Press, Chap. 18.
68.
SprayJ. A.AckermanT. A.ReckaseM. D.CarlsonJ. E. (1989) Effect of medium of item presentation on examinee performance and item characteristics, Journal of Educational Measurement, 26, 261–271.
69.
ToutonghiG.EcheverriaD.BittnerA. C.Jr.RonhovdeN. (1991) The use of switching ability to assess central nervous system function. In KumarS. (Ed.), Advances in ergonomics and safely: III. London: Taylor & Francis. Pp. 601–608.
70.
WalshW.BetzN. E. (1985) Test and assessment. Englewood Cliffs, NJ: Prentice-Hall.
71.
WarrringtonE. K.JamesM. (1967) Disorders of visual perception in patients with localized cerebral lesions. Neuropsychologia, 5, 253–266.
WelfordA. (1968) Fundamentals of skill. London: Methuen.
74.
WhiteR. R.FeldmanR. G.MossM. B.ProctorS. P. (1992) Magnetic resonance imaging (MRI), neurobehavioral testing and toxic encephalopathy: two cases. Environmental Research, 6, 117–123.
75.
WhiteR. F.ProctorS. P. (1992) Research and clinical criteria for development of neurobehavioral test batteries, Journal of Occupational Medicine, 34, 140–148.
76.
WhiteR. F.RobinsT. C.ProctorS.EcheverriaD.RocskayA. Z. (1994) Neuropsychological effects of exposure to naphtha among automotive workers. Occupational and Environmental Medicine, 51, 102–112.
77.
WienerB. J.BrownD. R.MichelsK. M. (1991) Statistical principles in experimental design. (3rd ed.) San Francisco, CA: McGraw Hill.
78.
WilkinsonG. S. (1993) Wide Range Achievement Test. (3rd ed.) Wilmington, DE: Jastak Associates.
79.
World Health Organization. (1986) Operational guide for the WHO Neurobehavioral Core Test Battery. Geneva, Switz.: Draft 25.5, Office of Occupational Health.
80.
YokeleyJ.M.ColemanD. J.YatesB. T. (1990) Cost effectiveness of three child mental health assessment methods: computer assisted assessment is effective and inexpensive. Journal of Mental Health Administration, 17, 99–107.
