Computerized neurocognitive testing has become a growing practice across medical populations, but particularly within sports medicine and the management of sports-related concussion. Although traditional neuropsychological measures are solely administered and interpreted by neuropsychologists, computerized cognitive tests are marketed to and utilized by a wide range of professionals involved in the management of sports-related concussions, many of whom lack specialized psychometric training. Although the benefits of computerized testing allow for many youth athletes to be evaluated quickly, professionals implementing their use should be aware of the potential pitfalls and the high potential for misuse. After briefly reviewing the recommended guidelines set forth by the American Academy of Clinical Neuropsychology and the National Academy of Neuropsychology, we review the benefits/limitations of computerized testing in the management of sports-related concussion and the basic psychometric properties of some of the more widely used computerized measures. Lastly, we discuss the practical application of these devices.
ThurmanDJBrancheCMSniezekJE. The epidemiology of sports-related traumatic brain injuries in the United States: recent developments. J Head Trauma Rehabil. 1998;13:1–8.
2.
CollinsMWFieldMLovellMR. Relationship between postconcussion headache and neuropsychological test performances in high school athletes. Am J Sports Med. 2003;31:168–173.
3.
GuskiewiczKMMcCreaMMarshallSW. Cumulative effects associated with recurrent concussion in collegiate football players. JAMA. 2003;290:2549–2555.
4.
McCreaMKellyJPRandolphCCislerRBergerL. Immediate neurocognitive effects of concussion. Neurosurgery. 2002;50:1032–1040.
5.
LangloisJARutland-BrownWWaldMM. The epidemiology and impact of traumatic brain injury: a brief overview. J Head Trauma Rehabil. 2006;21. 375–378.
6.
GilchristJThomasKEXuL. Nonfatal sports and recreation related traumatic brain injuries among children and adolescents treated in emergency departments in the United States, 2001-2009. MMWR Morb Mortal Wkly Rep. 2011;60:1337–1342.
7.
McCreaMHammekeTOlsenGLeoPGuskiewiczKM. Unreported concussion in high school football players: implications for prevention. Clin J Sport Med. 2004;14:13–17.
8.
TorresDMGalettaKMPhillipsW. Sports-related concussion: anonymous survey of a collegiate cohort. Neurol Clin Pract. 2013;3:279–287.
9.
GioiaGACollinsMIsquithPK. Improving identification and diagnosis of mild traumatic brain injury with evidence: psychometric support for the acute concussion evaluation. J Head Trauma Rehabil. 2008;23:230–242.
10.
BarthJTAlvesWMRyanTV. Mild head injury in sports: neuropsychological sequelae and recovery of function. In LevinHLEisenbergHMBentonAL, eds. Mild Head Injury. New York: Oxford University Press; 1989:257–276.
11.
BelangerHGVanderploegRD. The neuropsychological impact of sports-related concussion: a meta-analysis. J Int Neuropsychol Soc. 2005;11:345–357.
12.
KarrJEAreshenkoffCNGarcia-BarreraMA. The neuropsychological outcomes of concussion: a systematic review of the meta-analyses on the cognitive sequelae of mild traumatic brain injury. Neuropsychology. 2014;28:321–336.
13.
EchemendiaRJIversonGLMcCreaM. Advances in neuropsychological assessment of sport-related concussion. Br J Sports Med. 2013;47:294–298.
14.
McCroryPMeeuwisseWHAubryM. Consensus statement on concussion in sport: the 4th International Conference on Concussion in Sport held in Zurich, November 2012. Br J Sports Med. 2013;47:250–258.
15.
MeehanWPd’HemecourtPCollinsCLTaylorAMComstockRD. Computerized neurocognitive testing for the management of sport-related concussions. Pediatrics. 2012;129:38–44.
RomeHPSwensonWMMatayaP. Symposium on automation techniques in personality assessment. Proc Staff Meet Mayo Clin. 1962;37:61–82.
18.
Newman E. Proceedings of the American Psychological Association, Incorporated, for the year 1966: report of the Recording Secretary. Am Psychol. 1966;21:1151–1153.
19.
American Educational Research Association, American Psychological Association, & National Council on Measurement in Education. Standards for Educational and Psychological Testing. Washington, DC: American Psychological Association; 1974.
20.
American Educational Research Association, American Psychological Association, & National Council on Measurement in Education. Standards for Educational and Psychological Testing. Washington, DC: American Psychological Association; 1985.
21.
American Educational Research Association, American Psychological Association, & National Council on Measurement in Education. Standards for Educational and Psychological Testing. Washington, DC: American Educational Research Association; 1999.
22.
BauerRMIversonGLCernichANBinderLMRuffRMNaugleRI. Computerized neuropsychological assessment devices: joint position paper of the American Academy of Clinical Neuropsychology and the National Academy of Neuropsychology. Arch Clin Neuropsychol. 2012;27:362–373.
MayersLBRedickTS. Clinical utility of ImPACT assessment for postconcussion return-to-play counseling: psychometric issues. J Clin Exp Neuropsychol. 2012;34:235–242.
25.
RandolphCMcCreaMBarrWB. Is neuropsychological testing useful in the management of sport-related concussion?J Athl Train. 2005;40:139–152.
26.
BarrWBMcCreaMRandolphC. Neuropsychology of sports-related injuries. In MorganJERickerJH, eds. Textbook of Clinical Neuropsychology. New York: Taylor & Francis; 2008.
27.
CernichANBrennanaDMBarkerLMBleibergJ. Sources of error in computerized neuropsychological assessment. Arch Clin Neuropsychol. 2007;22S:S39–S48.
28.
MoserRSSchatzPNeidzwskiKOttSD. Group versus individual administration affects baseline neurocognitive test performance. Am J Sports Med. 2011;39:2325–2330.
29.
LichtensteinJDMoserRSSchatzP. Age and test setting affect the prevalence of invalid baseline scores on neurocognitive tests. Am J Sports Med. 2014;42:479–484.
30.
MoserRSSchatzPLichtensteinJD. The importance of proper administration and interpretation of neuropsychological baseline and postconcussion computerized testing. Appl Neuropsychol Child. 2013; doi:10.1080/21622965.2013.791825.
31.
VaughanCGGerstEHSadyMDNewmanJBGioiaGA. The relations between testing environment and baseline performance in child and adolescent concussion assessment. Am J Sports Med. 2014;42:1716–1723.
32.
ComperPHutchinsonMMagrysS. Evaluating the methodological quality of sports neuropsychology concussion research: a systematic review. Brain Inj. 2010;24:1257–1271.
SchatzPFerrisCS. One-month test-retest reliability of the ImPACT test battery. Arch Clin Neuropsychol. 2013;28:499–504.
35.
ElbinRJSchatzPCovassinT. One-year test-retest reliability of the online version of ImPACT in high school athletes. Am J Sports Med. 2011;39:2319–2324.
36.
SchatzP. Long-term test-retest reliability of baseline cognitive assessment using ImPACT. Am J Sports Med. 2010;38:47–53.
37.
ReschJEMacciocchiSFerraraMS. Preliminary evidence of equivalence of alternate forms of the ImPACT. Clin Neuropsychol. 2013;doi:10.1080/13854046.2013.845247.
38.
SchatzPPardiniJELovellMRCollinsMWPodellK. Sensitivity and specificity of the ImPACT test battery for concussion in athletes. Arch Clin Neuropsychol. 2006;21:91–99.
39.
SchatzPSandelN. Sensitivity and specificity of the online version of ImPACT in high school and collegiate athletes. Am J Sports Med. 2013;41:321–326.
40.
LauBCCollinsMWLovellMR. Sensitivity and specificity of subacute computerized neurocognitive testing and symptom evaluation in predicting outcomes after sports-related concussion. Am J Sports Med. 2011;39:1209–1216.
41.
GioiaGAVaughanCGIsquithPK. Professional manual for the Multimodal Assessment of Cognition & Symptoms (MACS) for Children. Unpublished.
CogState. Cogstate Research Manual (Version 6.0). New Haven, CT: CogState Ltd; 2011.
44.
CollieAMaruffPMakdissiMMcCroryPMcStephenMDarbyD. CogSport: reliability and correlation with conventional cognitive tests used in postconcussion medical evaluations. Clin J Sports Med. 2003;13:28–32.
45.
MakdissiMDarbyDMaruffPUgoniABruknerPMcCroryPR. Natural history of concussion in sport: markers of severity and implications for management. Am J Sports Med. 2010;38:464–471.
46.
LoueyAGMaruffPCromerJA. Detecting suboptimal effort in concussion management settings with the Axon Sports CCAT. Br J Sports Med. 2013;47(e1):15[Abstract]
47.
ReevesDLWinterKPBleibergJKaneR. ANAM genogram: historical perspectives, description and current endeavors. Arch Clin Neuropsychol. 2007;22(suppl 1):S15–S37.
48.
BleibergJCernichACameronK. Duration of cognitive impairment following sports concussion. Neurosurgery. 2004;54:1–6.
BleibergJGarmoeWSHalpernELReevesDLNadlerJD. Consistency of within-day and across-day performance after mild brain injury. Neuropsychiatry Neuropsychol Behav Neurol. 1997;10:247–253.
51.
BleibergJHalpernELReevesDDanielJC. Future directions for the neuropsychological assessment of sports concussion. J Head Trauma Rehabil. 1998;13:36–44.
52.
BleibergJKaneRLReevesDGarmoeWSHalpernEL. Factor analysis of computerized and traditional tests used in mild brain injury research. Clin Neuropsychol. 2000;14:287–294.
53.
SegalowitzSJMahaneyPSantessoDLMacGregorLDywanJWillerB. Retest reliability in adolescents of a computerized neuropsychological battery used to assess recovery from concussion. NeuroRehabilitation. 2007;22:243–251.
54.
WoodardJMarkerCTabanicoF. A validation study of the automated neuropsychological assessment metrics (ANAM) in non-concussed high school players [Abstract]. J Int Neuropsychol Soc. 2002;8:175.
55.
BleibergJWardenDL. Computerized neuropsychological concussion surveillance instruments: using reliable change index (RCI) as a basis for clinical decision-making. Poster presented at American Academy of Neurology, Denver, CO; 2002.
56.
SchatzPPutzBO. Cross-validation of measures used for computer-based assessment of concussion. Appl Neuropsychol. 2006;13:151–159.
57.
EchemendiaRJHerringSBailesJ. Who should conduct and interpret the neuropsychological assessment in sports-related concussion?Br J Sports Med. 2009;43(suppl 1):i32–i35.
58.
EchemendiaRJIversonGIMcCreaM. Role of neuropsychologists in the evaluation and management of sports-related concussion: an inter-organization position statement. Arch Clin Neuropsychol. 2012;27:119–122.
