The current study assessed the utility of eye-movements measures, gathered while participants performed a commercially available Continuous Performance Test (CPT), to detect feigned ADHD-associated cognitive impairment.
Method:
Healthy simulators (n = 37), ADHD patients (n = 33), and healthy controls (n = 36) performed an eye-tracker integrated MOXO-dCPT and a stand-alone validity indicator.
Results:
Simulators gazed significantly longer at regions that were irrelevant for successful MOXO-dCPT performance compared to ADHD patients and healthy controls. This eye-movement measure, however, had lower sensitivity than traditional MOXO-dCPT indices.
Discussion:
Gaze direction measures, gathered while performing a CPT, show initial promise as validity indicators. Traditional CPT measures, however, are more sensitive and therefore offer a more promising path for the establishment of CPT-based validity indicators. The current study is an initial exploration of the issue and further evaluation of both theoretical and practical aspects is mandated.
American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). Author.
2.
Armistead-JehleP.DenneyR. L.ShuraR. D. (2021). Use of the word memory test (WMT), medical symptom validity test (MSVT) and nonverbal medical symptom validity test (NV-MSVT) in assessment following head injury (chapter 5). In HortonA. M. J.ReynoldsC. R. (Eds.), Detection of malingering during head injury litigation (3rd ed., pp. 223–243). Springer.
3.
ArnoldL. E.HodgkinsP.KahleJ.MadhooM.KewleyG. (2020). Long-Term outcomes of ADHD: Academic achievement and performance. Journal of Attention Disorders, 24(1), 73–85. https://doi.org/10.1177/1087054714566076
4.
BarryD. M.EttenhoferM. L. (2016). Assessment of performance validity using embedded saccadic and manual indices on a continuous performance test. Archives of Clinical Neuropsychology: The Official Journal of the National Academy of Neuropsychologists, 31(8), 963–975. https://doi.org/10.1093/arclin/acw070
5.
Ben-SheetritJ.TaskerH.AvnatL.GolubchikP.WeizmanA.ManorI. (2021). Possible age-related progression of attentional impairment in ADHD and its attenuation by past diagnosis and treatment. Journal of Attention Disorders, 25(1), 14–21. https://doi.org/10.1177/1087054717743328
6.
BergerC.LevA.BrawY.ElbaumT.WagnerM.RassovskyY. (2021). Detection of feigned ADHD using the MOXO-d-CPT. Journal of Attention Disorders, 25(7), 1032–1047.
7.
BooneK. B. (2013). Clinical practice of forensic psychology: An evidence-based approach. Guilford Press.
8.
BordoffB. (2017). The challenges and limitations of diagnosing and pharmacologically treating ADHD in university students. Psychological Injury and Law, 10(2), 114–120.
9.
CohenJ. (1992). A power primer. Psychological Bulletin, 112(1), 155–159.
10.
Dandachi-FitzGeraldB.MerckelbachH.PondsR. W. (2017). Neuropsychologists’ ability to predict distorted symptom presentation. Journal of Clinical and Experimental Neuropsychology, 39(3), 257–264. https://doi.org/10.1080/13803395.2016.1223278
11.
DavisJ. J. (2021). Interpretation of data from multiple performance validity tests (chapter 14). In BooneK. B. (Ed.), Assessment of feigned cognitive impairment: A neuropsychological perspective (2nd ed., pp. 283–306). Guilford Press.
12.
DobrakowskiP.ŁebeckaG. (2020). Individualized neurofeedback training may help achieve long-term improvement of working memory in children with ADHD. Clinical EEG and Neuroscience, 51(2), 94–101. https://doi.org/10.1177/1550059419879020
13.
DuchowskiA. T. (2017). Eye tracking methodology: Theory and practice (3rd ed.). Springer.
14.
EcksteinM. K.Guerra-CarrilloB.Miller SingleyA. T.BungeS. A. (2017). Beyond eye gaze: What else can eyetracking reveal about cognition and cognitive development?Developmental Cognitive Neuroscience, 25, 69–91.
15.
ElbaumT.BrawY.LevA.RassovskyY. (2020). Attention-deficit/hyperactivity disorder (ADHD): Integrating the MOXO-dCPT with an eye tracker enhances diagnostic precision. Sensors, 20(21), https://www.mdpi.com/about/announcements/784
16.
FaraoneS. V.BanaschewskiT.CoghillD.ZhengY.BiedermanJ.BellgroveM. A.NewcornJ. H.GignacM.Al SaudN. M.ManorI.RohdeL. A.YangL.CorteseS.AlmagorD.SteinM. A.AlbattiT. H.AljoudiH. F.AlqahtaniM. M. J.AshersonP. . . .WangY. (2021). The World Federation of ADHD international consensus statement: 208 evidence-based conclusions about the disorder. Neuroscience and Biobehavioral Reviews, 128, 789–818. https://doi.org/10.1016/j.neubiorev.2021.01.022
17.
FaraoneS. V.RostainA. L.MontanoC. B.MasonO.AntshelK. M.NewcornJ. H. (2020). Systematic review: Nonmedical use of prescription stimulants: Risk factors, outcomes, and risk reduction strategies. Journal of the American Academy of Child and Adolescent Psychiatry, 59(1), 100–112. https://doi.org/10.1016/j.jaac.2019.06.012
18.
FirstM. B.WilliamsJ. B. W.KargR. S.SpitzerR. L. (2015). Structured clinical interview for DSM-5- research Version (SCID-5 for DSM-5, research Version; SCID-5-RV). American Psychiatric Association.
19.
GamerM.PertzovY. (2018). Detecting concealed knowledge from ocular responses (ch. 8). In RosenfeldJ. P. (Ed.), Detecting concealed information and deception: Recent developments (pp. 169–186). Elsevier.
20.
GiollaE. M.LukeT. J. (2021). Does the cognitive approach to lie detection improve the accuracy of human observers?Applied Cognitive Psychology, 35(2), 385–392.
21.
GoebelR. A. (1983). Detection of faking on the Halstead-Reitan neuropsychological test battery. Journal of Clinical Psychology, 39(5), 731–742.
22.
GreenP. (2005). Green’s word memory test for Windows: User’s manual (revised june 2005). Green’s Publications.
23.
GreenP.AllenL.AstnerK. (1996). The word memory test: A user’s guide to the oral and computer-administered forms, US version 1.1. CogniSyst.
24.
GreenP.AstnerK. (1994). Manual for the oral word memory test. Cognisyst.
25.
GuilmetteT. J. (2013). The role of clinical judgment in symptom validity assessment (chapter 2). In CaroneD. A.BushS. S. (Eds.), Mild traumatic brain injury: Symptom validity assessment and malingering (pp. 31–43). Springer.
26.
HallC. L.ValentineA. Z.GroomM. J.WalkerG. M.SayalK.DaleyD.HollisC. (2016). The clinical utility of the continuous performance test and objective measures of activity for diagnosing and monitoring ADHD in children: A systematic review. European Child & Adolescent Psychiatry, 25(7), 677–699. https://doi.org/10.1007/s00787-015-0798-x
27.
HarrisonA. G.LeeG. J.SuhrJ. A. (2021). Use of performance validity tests and symptom validity tests in assessment of specific learning disorders and attention-deficit/hyperactivity disorder (chapter 24). In BooneK. B. (Ed.), Assessment of feigned cognitive impairment: A neuropsychological perspective (2nd ed., pp. 525–558). Guilford Press.
28.
HolmqvistK.AnderssonR. (2017). Eye tracking: A comprehensive guide to methods, paradigms and measures (2nd ed.). Lund Eye-Tracking Research Institute.
IvanchenkoD.RifaiK.HafedZ. M.SchaeffelF. (2021). A low-cost, high-performance video-based binocular eye tracker for psychophysical research. Journal of Eye Movement Research, 14(3). Advance online publication. https://doi.org/10.16910/jemr.14.3.3
31.
JonesS. M. (2017). Dissimulation strategies on standard neuropsychological tests: A qualitative investigation. Brain Injury, 31(8), 1131–1141. https://doi.org/10.1080/02699052.2017.1283444
32.
JosephA.KosmasC. E.PatelC.DollH.AshersonP. (2019). Health-Related quality of life and work productivity of adults with ADHD: A U.K. web-based cross-sectional survey. Journal of Attention Disorders, 23(13), 1610–1623. https://doi.org/10.1177/1087054718799367
33.
KanserR. J.BashemJ. R.PatrickS. D.HanksR. A.RapportL. J. (2020). Detecting feigned traumatic brain injury with eye tracking during a test of performance validity. Neuropsychology, 34(3), 308–320. https://doi.org/10.1037/neu0000613
34.
KanserR. J.RapportL. J.BashemJ. R.BillingsN. M.HanksR. A.AxelrodB. N.MillerJ. B. (2017). Strategies of successful and unsuccessful simulators coached to feign traumatic brain injury. Clinical Neuropsychologist, 31(3), 644–653. https://doi.org/10.1080/13854046.2016.1278040
35.
KesslerR. C.AdlerL. A.GruberM. J.SarawateC. A.SpencerT.Van BruntD. L. (2007). Validity of the World Health Organization adult ADHD self-report scale (ASRS) screener in a representative sample of health plan members. International Journal of Methods in Psychiatric Research, 16(2), 52–65. https://doi.org/10.1002/mpr.208
36.
KleinC.EttingerU. (Eds.). (2019). Eye movement research: An introduction to its scientific foundations and applications. Springer.
37.
LarrabeeG. J. (2012). Performance validity and symptom validity in neuropsychological assessment. Journal of the International Neuropsychological Society, 18(4), 625–630.
38.
LevA.BrawY.ElbaumT.WagnerM.RassovskyY. (2020). Eye tracking during a continuous performance test: utility for assessing ADHD patients. Journal of Attention Disorders. Advance online publication. https://doi.org/10.1177/1087054720972786
39.
MahoneyE. J.KapurN.OsmonD. C.HannulaD. E. (2018). Eye tracking as a tool for the detection of simulated memory impairment. Journal of Applied Research in Memory and Cognition, 7(3), 441–453. https://doi.org/10.1016/j.jarmac.2018.05.004
40.
MarshallP.HoelzleJ.NikolasM. (2021). Diagnosing attention-deficit/hyperactivity disorder (ADHD)in young adults: A qualitative review of the utility of assessment measures and recommendations for improving the diagnostic process. Clinical Neuropsychologist, 35(1), 165–198. https://doi.org/10.1080/13854046.2019.1696409
41.
NichollsC. J.WinstoneL. K.DiVirgilioE. K.FoleyM. B. (2020). Test of variables of attention performance among ADHD children with credible vs. Non-credible PVT performance. Applied Neuropsychology. Child, 9(4), 307–313. https://doi.org/10.1080/21622965.2020.1751787
42.
PatrickS. D.RapportL. J.KanserR. J.HanksR. A.BashemJ. R. (2021). Detecting simulated versus bona fide traumatic brain injury using pupillometry. Neuropsychology, 35, 472–485. https://doi.org/10.1037/neu0000747
43.
PeledJ.CassutoH.BergerI. (2020). Processing speed as a marker to stimulant effect in clinical sample of children with high functioning autism spectrum disorder. Nordic Journal of Psychiatry, 74(3), 163–167. https://doi.org/10.1080/08039488.2019.1686063
44.
RickardsT. A.CranstonC. C.TouradjiP.BechtoldK. T. (2018). Embedded performance validity testing in neuropsychological assessment: Potential clinical tools. Applied Neuropsychology. Adult, 25(3), 219–230.
45.
RogersR. (2018). Researching response styles (chapter 30). In RogersR.BenderS. D. (Eds.), Clinical assessment of malingering and deception (4th ed., pp. 592–614). Guilford Press.
46.
SagarS.MillerC. J.ErdodiL. A. (2017). Detecting feigned attention-deficit/hyperactivity disorder (ADHD): Current methods and future directions. Psychological Injury and Law, 10, 105–113.
47.
SchroederR. W.BooneK. B.LarrabeeG. J. (2021). Design methods in neuropsychological performance validity, symptom validity, and malingering research (chapter 2). In BooneK. B.Armistead-JehleP.ArnoldG.AxelrodB. N.BabikianT. (Eds.), Assessment of feigned cognitive impairment: A neuropsychological perspective (pp. 11–33). The Guilford Press.
48.
SchroederR. W.MartinP. K. (2021). Forced-choice performance validity tests (chapter 3). In BooneK. B. (Ed.), Assessment of feigned cognitive impairment: A neuropsychological perspective (2nd ed., pp. 34–63). Guilford Press.
49.
ScimecaL. M.HolbrookL.RhoadsT.CernyB. M.JennetteK. J.ReschZ. J.ObolskyM. A.OvsiewG. P.SobleJ. R. (2021). Examining conners continuous performance test-3 (CPT-3) embedded performance validity indicators in an adult clinical sample referred for ADHD evaluation. Developmental Neuropsychology, 46, 347–359. https://doi.org/10.1080/87565641.2021.1951270
50.
ShermanE. M. S.SlickD. J.IversonG. L. (2020). Multidimensional malingering criteria for neuropsychological assessment: A 20-year update of the malingered neuropsychological dysfunction criteria. Archives of Clinical Neuropsychology: The Official Journal of the National Academy of Neuropsychologists, 35, 735–764. https://doi.org/10.1093/arclin/acaa019
51.
ShumakerB. E. S.HoytT. (2020). A place for psychological testing in the assessment of adult ADHD. Journal of Health Service Psychology, 46(3), 119–131.
52.
SibleyM. H.CoxeS.MolinaB. S. (2017). Refining diagnostic procedures for adults with symptoms of ADHD. Assessment, 24(3), 290–296. https://doi.org/10.1177/1073191116676890
53.
SkaramagkasV.GiannakakisG.KtistakisE.ManousosD.KaratzanisI.TachosN.TripolitiE. E.MariasK.FotiadisD. I.TsiknakisM. (2021). Review of eye tracking metrics involved in emotional and cognitive processes. IEEE Reviews in Biomedical Engineering. Advance online publication. https://doi.org/10.1109/RBME.2021.3066072
54.
SlobodinO.BlankersM.Kapitány-FövényM.KayeS.BergerI.JohnsonB.DemetrovicsZ.van Den BrinkW.van de GlindG. (2020). Differential diagnosis in patients with substance use disorder and/or attention-deficit/hyperactivity disorder using continuous performance test. European Addiction Research, 26(3), 151–162. https://doi.org/10.1159/000506334
55.
SlobodinO.DavidovitchM. (2019). Gender differences in objective and subjective measures of ADHD among clinic-referred children. Frontiers in Human Neuroscience, 13, 441. https://doi.org/10.3389/fnhum.2019.00441
56.
SmyrnisN.AmadoI.KrebsM.SweeneyJ. A. (2019). Eye movements in psychiatry (ch. 16). In KleinC.EttingerU. (Eds.), Eye movement research: An introduction to its scientific foundations and applications (pp. 703–748). Springer.
57.
StevensA.LichaC. (2019). The word memory test in medicolegal assessment: A measure of effort and malingering?The Journal of Forensic Psychiatry & Psychology, 30(2), 220–249.
58.
SweetJ. J.HeilbronnerR. L.MorganJ. E.LarrabeeG. J.RohlingM. L.BooneK. B.KirkwoodM. W.SchroederR. W.SuhrJ. A.; Conference Participants. (2021). American Academy of Clinical Neuropsychology (AACN) 2021 consensus statement on validity assessment: Update of the 2009 AACN consensus conference statement on neuropsychological assessment of effort, response bias, and malingering. Clinical Neuropsychologist, 35(6), 1053–1106. https://doi.org/10.1080/13854046.2021.1896036
59.
TaoL.WangQ.LiuD.WangJ.ZhuZ.FengL. (2020). Eye tracking metrics to screen and assess cognitive impairment in patients with neurological disorders. Neurological Sciences, 41(7), 1697–1704. https://doi.org/10.1007/s10072-020-04310-y
60.
TheeuwesJ.KramerA. F.HahnS.IrwinD. E. (1998). Our eyes do not always go where we want them to go: Capture of the eyes by new objects. Psychological Science, 9(5), 379–385. https://doi.org/10.1111/1467-9280.00071
61.
TomerE.LupuT.GolanL.WagnerM.BrawY. (2020). Eye tracking as a Mean to detect feigned cognitive impairment in the word memory test. Applied Neuropsychology. Adult, 27(1), 49–61.
62.
van GogT.KesterL.NievelsteinF.GiesbersB.PaasF. (2009). Uncovering cognitive processes: Different techniques that can contribute to cognitive load research and instruction. Computers in Human Behavior, 25(2), 325–331. https://doi.org/10.1016/j.chb.2008.12.021
63.
VrijA.FisherR. P.BlankH. (2017). A cognitive approach to lie detection: A meta-analysis. Legal and Criminological Psychology, 22(1), 1–21.
64.
WalczykJ. J.SewellN.DiBenedettoM. B. (2018). A review of approaches to detecting malingering in forensic contexts and promising cognitive load-inducing lie detection techniques. Frontiers in Psychiatry, 9, 700. https://doi.org/10.3389/fpsyt.2018.00700
65.
WardM. F.WenderP. H.ReimherrF. W. (1993). The Wender Utah Rating Scale: An aid in the retrospective diagnosis of childhood attention-deficit hyperactivity disorder. American Journal of Psychiatry, 150(6), 885–890.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
