Restricted accessBrief reportFirst published online 2024-10
An Examination of WAIS-IV Digit Span Performance Inconsistency as a Novel Embedded Performance Validity Test Among Adults Clinically Referred for Attention-Deficit/Hyperactivity Disorder
Embedded performance validity tests (PVTs), like Digit Span PVTs from Wechsler Adult Intelligence Scale-Fourth Edition (WAIS-IV), offer a valuable means of evaluating validity without extending administration time. This study investigated the utility of novel indices of performance inconsistency for WAIS-IV Digit Span (DS IRs) in the detection of invalid performance among 705 adults referred for ADHD evaluation. Results showed DS IR indices were inadequate in classifying overall validity status (areas under the curve = 0.52–0.59). Predictably, four established Digit Span PVTs effectively distinguished between valid and invalid performance score groups (areas under the curve = 0.74–0.78) with 32–49% sensitivity and 86–93% specificity at optimal cut-scores. Overall, individuals with noncredible performance scores did not differ significantly from those with valid scores regarding performance inconsistency on WAIS-IV Digit Span.
AbramsonD. A.WhiteD. J.RhoadsT.CarterD. A.HansenN. D.ReschZ. J.JennetteK. J.OvsiewG. P.SobleJ. R. (2023). Cross-validating the Dot Counting Test among an adult ADHD clinical sample and analyzing the effect of ADHD subtype and comorbid psychopathology. Assessment, 30(2), 264–273. https://doi.org/10.1177/10731911211050895
2.
AshendorfL.ClarkE. L.HumphreysC. T. (2021). The Rey 15-item memory test in US Veterans. Journal of Clinical and Experimental Neuropsychology, 43(3), 324–331. https://doi.org/10.1080/13803395.2021.1932761
3.
AshendorfL.ClarkE. L.SugarmanM. A. (2017). Performance validity and processing speed in a VA polytrauma sample. The Clinical Neuropsychologist, 31(5), 857–866. https://doi.org/10.1080/13854046.2017.1285961
4.
BabikianT.BooneK. B.LuP.ArnoldG. (2006). Sensitivity and specificity of various digit span scores in the detection of suspect effort. The Clinical Neuropsychologist, 20(1), 145–159. https://doi.org/10.1080/13854040590947362
5.
BenjaminiY.HochbergY. (1995). Controlling the false discovery rate: A practical and powerful approach to multiple testing. Journal of the Royal Statistical Society: Series B, 57(1), 289–300. https://doi.org/10.1111/j.2517-6161.1995.tb02031.x
6.
Bing-CanarH.PhillipsM. S.ShieldsA. N.Ogram BuckleyC. M.ChangF.KhanH.SkymbaH.OvsiewG.ReschZ.JennetteK.SobleJ. R. (2022). Cross-validation of multiple WAIS-IV digit span embedded performance validity indices among a large sample of adult attention deficit/hyperactivity disorder clinical referrals. Journal of Psychoeducational Assessment, 40(5), 678–688. https://doi.org/10.1177/07342829221081921
7.
BooneK. B. (2009). The need for continuous and comprehensive sampling of effort/response bias during neuropsychological examinations. The Clinical Neuropsychologist, 23(4), 729–741. https://doi.org/10.1080/13854040802427803
8.
BooneK. B. (2013). Clinical practice of forensic neuropsychology. Guilford Press.
9.
ErdodiL. A.LichtensteinJ. D. (2017). Invalid before impaired: An emerging paradox of embedded validity indicators. The Clinical Neuropsychologist, 31(6-7), 1029–1046. https://doi.org/10.1080/13854046.2017.1323119
10.
FriedmanL. M.RapportM. D.Fabrikant-AbzugG. (2022). Consistently inconsistent working memory performance among children with ADHD: Evidence of Response Accuracy Variability (RAV). Journal of Psychopathology and Behavioral Assessment, 44(3), 787–799. https://doi.org/10.1007/s10862-022-09967-7
11.
GreiffensteinM. F.BakerW. J.GolaT. (1994). Validation of malingered amnesia measures with a large clinical sample. Psychological Assessment, 6(3), 218–224. https://doi.org/10.1037/1040-3590.6.3.218
12.
HirschO.ChristiansenH. (2018). Faking ADHD? Symptom validity testing and its relation to self-reported, observer-reported symptoms, and neuropsychological measures of attention in adults with ADHD. Journal of Attention Disorders, 22(3), 269–280. https://doi.org/10.1177/1087054715596577
JasinskiL. J.HarpJ. P.BerryD. T.Shandera-OchsnerA. L.MasonL. H.RanseenJ. D. (2011). Using symptom validity tests to detect malingered ADHD in college students. The Clinical Neuropsychologist, 25(8), 1415–1428. https://doi.org/10.1080/13854046.2011.630024
15.
JennetteK. J.WilliamsC. P.ReschZ. J.OvsiewG. P.DurkinN. M.O’RourkeJ. J.MarceauxJ. C.CritchfieldE. A.SobleJ. R. (2022). Assessment of differential neurocognitive performance based on the number of performance validity tests failures: A cross-validation study across multiple mixed clinical samples. The Clinical Neuropsychologist, 36(7), 1915–1932. https://doi.org/10.1080/13854046.2021.1900398
16.
KhanH.RauchA. A.ObolskyM. A.SkymbaH.BarwegenK. C.WisingerA. M.OvsiewG. P.JennetteK. J.SobleJ. R.ReschZ. J. (2022). A comparison of embedded validity indicators from the Stroop Color and Word Test among adults referred for clinical evaluation of suspected or confirmed attention-deficit/hyperactivity disorder. Psychological Assessment, 34(7), 697–703. https://doi.org/10.1037/pas0001137
17.
LaBelleD. R.LeeB. G.MillerJ. B. (2019). Dissociation of executive and attentional elements of the digit span task in a population of older adults: A latent class analysis. Assessment, 26(7), 1386–1398. https://doi.org/10.1177/1073191117714556
18.
LarrabeeG. J. (2003). Detection of malingering using atypical performance patterns on standard neuropsychological tests. The Clinical Neuropsychologist, 17(3), 410–425. https://doi.org/10.1076/clin.17.3.410.18089
19.
LarrabeeG. J. (2008). Aggregation across multiple indicators improves the detection of malingering: Relationship to likelihood ratios. The Clinical Neuropsychologist, 22(4), 666–679. https://doi.org/10.1080/13854040701494987
20.
LongridgeR.NormanS.HenleyW.Newlove DelgadoT.FordT. (2019). Investigating the agreement between the clinician and research diagnosis of attention deficit hyperactivity disorder and how it changes over time; a clinical cohort study. Child and Adolescent Mental Health, 24(2), 133–141. https://doi.org/10.1111/camh.12285
21.
MarshallP.HoelzleJ.NikolasM. (2021). Diagnosing attention-deficit/hyperactivity disorder (ADHD) in young adults: A qualitative review of the utility of assessment measures and recommendations for improving the diagnostic process. The Clinical Neuropsychologist, 35(1), 165–198. https://doi.org/10.1080/13854046.2019.1696409
22.
MartinP. K.SchroederR. W. (2020). Base rates of invalid test performance across clinical non-forensic contexts and settings. Archives of Clinical Neuropsychology, 35(6), 717–725. https://doi.org/10.1093/arclin/acaa017
23.
McIntoshD.KutcherS.BinderC.LevittA.FalluA.RosenbluthM. (2009). Adult ADHD and comorbid depression: A consensus-derived diagnostic algorithm for ADHD. Neuropsychiatric Disease and Treatment, 5, 137–150. https://doi.org/10.2147/NDT.S4720
24.
OvsiewG. P.CernyB. M.BoerA. B. D.PetryL. G.ReschZ. J.DurkinN. M.SobleJ. R. (2023). Performance and symptom validity assessment in attention deficit/hyperactivity disorder: Base rates of invalidity, concordance, and relative impact on cognitive performance. The Clinical Neuropsychologist, 37(7), 1498–1515. https://doi.org/10.1080/13854046.2022.2162440
25.
PhillipsM. S.WisingerA. M.Lapitan-MooreF. T.Ausloos-LozanoJ. E.Bing-CanarH.DurkinN. M.OvsiewG. P.ReschZ. J.JennetteK. J.SobleJ. R. (2023). Cross-validation of multiple embedded performance validity indices in the Rey Auditory Verbal Learning Test and Brief Visuospatial Memory Test-Revised in an adult attention deficit/hyperactivity disorder clinical sample. Psychological Injury and Law, 16(1), 27–35. https://doi.org/10.1007/s12207-022-09443-3
26.
RabinL. A.PaolilloE.BarrW. B. (2016). Stability in test usage practices of clinical neuropsychologists in the United States and Canada over a 10-year period: A follow-up survey of INS and NAN members. Archives of Clinical Neuropsychology, 31(3), 206–230. https://doi.org/10.1093/arclin/acw007
27.
ReschZ. J.CernyB. M.OvsiewG. P.JennetteK. J.Bing-CanarH.RhoadsT.SobleJ. R. (2023). A direct comparison of 10 WAIS-IV Digit Span embedded validity indicators among a mixed neuropsychiatric sample with varying degrees of cognitive impairment. Archives of Clinical Neuropsychology, 38(4), 619–632. https://doi.org/10.1093/arclin/acac082
28.
SchroederR. W.Twumasi-AnkrahP.BaadeL. E.MarshallP. S. (2012). Reliable digit span: A systematic review and cross-validation study. Assessment, 19(1), 21–30. https://doi.org/10.1177/1073191111428764
29.
ScimecaL. M.HolbrookL.RhoadsT.CernyB. M.JennetteK. J.ReschZ. J.ObolskyM. A.OvsiewG. P.SobleJ. R. (2021). Examining Conners Continuous Performance Test-3 (CPT-3) embedded performance validity indicators in an adult clinical sample referred for ADHD evaluation. Developmental Neuropsychology, 46(5), 347–359. https://doi.org/10.1080/87565641.2021.1951270
30.
SweetJ. J.HeilbronnerR. L.MorganJ. E.LarrabeeG. J.RohlingM. L.BooneK. B.KirkwoodM. W.SchroederR. W.SuhrJ. A.Conference Participants. (2021). American Academy of Clinical Neuropsychology (AACN) 2021 consensus statement on validity assessment: Update of the 2009 AACN consensus conference statement on neuropsychological assessment of effort, response bias, and malingering. The Clinical Neuropsychologist, 35, 1053–1106. https://doi.org/10.1080/13854046.2021.1896036
31.
WarschauskyS.KewmanD. G.SelimA. (1996). Attentional performance of children with traumatic brain injury: A quantitative and qualitative analysis of digit span. Archives of Clinical Neuropsychology, 11(2), 147–153. https://doi.org/10.1016/0887-6177(95)00004-6
32.
WebberT. A.SobleJ. R. (2018). Utility of various WAIS-IV Digit Span indices for identifying noncredible performance validity among cognitively impaired and unimpaired examinees. The Clinical Neuropsychologist, 32, 657–670. https://doi.org/10.1080/13854046.2017.1415374
