Methods of identifying poor test-related motivation using the Wechsler Adult Intelligence Scale Digit Span subtest are based on identification of performance patterns that are implausible if the test taker is investing full effort. No studies to date, however, have examined the specificity of such measures, particularly when evaluating persons with either known or suspected learning or attention disorders. This study investigated performance of academically challenged students on three measures embedded in the Wechsler Adult Intelligence Scale—III, namely, low Digit Span, high Vocabulary-Digit span (Voc-DS), and low Reliable Digit Span scores. Evaluating subjects believed to be investing full effort in testing, it was found that both Digit Span and Reliable Digit Span had high specificity, although both showed relatively lower sensitivity. In contrast, VOC-DS was especially weak in both sensitivity and specificity, with an apparent false positive rate of 28%. Use of VOC-DS is therefore not appropriate for those with a history of learning or attention problems.
Alfano, K., & Boone, K.B. ( 2007). The use of effort tests in the context of actual versus feigned attention-deficit/hyperactivity disorder and learning disability. In K.B. Boone (Ed.), Assessment of feigned cognitive impairment: A neuropsychological perspective (pp. 366-383). New York: Guilford Press.
2.
Allen, L., & Green, P. ( 1999). CARB and WMT effort test scores in 57 patients with severe traumatic brain injury. Archives of Clinical Neuropsychology , 14, 789.
3.
American Psychiatric Association. (1994). Diagnostics and statistical manual of mental disorders (4th ed.). Washington, DC: Author .
4.
Baddeley, A.D., & Warrington, E.K. (1970). Amnesia and the distinction between long- and short-term memory. Journal of Verbal Learning and Verbal Behavior, 9, 176-189.
5.
Barkley, R.A. ( 2004). Driving impairments in teens and young adults with ADHD . Psychiatric Clinics of North America, 27, 233-260.
6.
Bauer, L., O’Bryant, S.E., Lynch, J.K., McCaffrey, R.J., & Fisher, J.M. ( 2007). Examining the Test of Memory Malingering Trial 1 and Word Memory Test Immediate Recognition as screening tools for insufficient effort. Assessment, 14, 215-222.
7.
Bianchini, K.J., Mathias, C.W., & Greve, K.W. ( 2001). Symptom validity testing: A critical review. The Clinical Neuropsychologist, 15, 19-45.
8.
Bowie, C.R., Reichenberg, A., Patterson, T.L., Heaton, R.K., & Harvey, P.D. ( 2003). Determinants of real world functional performance in schizophrenia: correlations with cognition, functional capacity, and symptoms . American Journal of Psychiatry, 11, 610-619.
9.
Butcher, J.N., Dahlstrom, W.G., Graham, J.R., Tellegen, A., & Kaemmer, B. ( 1989). Manual for the restandardized Minnesota Multiphasic Personality Inventory: MMPI-2. Minneapolis: University of Minnesota Press.
10.
Cermak, L.S., & Butters, N. ( 1972). The role of interference and encoding in the short-term memory deficits of Korsakoff patients. Neuropsychologia, 10, 89-96.
11.
Cermak, L.S., & Butters, N. ( 1973). Information processing deficits of alcoholic Korsakoff patients. Quarterly Journal of Studies on Alcohol, 34, 1110-1132.
12.
DiScala C., Lescohier, I., Barthel, M., & Li, G. ( 1998). Injuries to children with attention deficit hyperactivity disorder. Pediatrics, 102, 1415-1421.
13.
Drachman, D.A., & Arbit, J. ( 1966). Memory and the hippocampal complex, II. Archives of Neurology, 15, 52-61.
14.
Dumont, R., & Willis, J. ( 2001a). Using the DWI or GIA. Retrieved July 25, 2005, from http://alpha.fdu.edu/psychology/using_the_dwi_or_gia.htm
15.
Dumont, R., & Willis, J. ( 2001b). Use of the Tellegen and Briggs formula to determine the Dumont-Willis indexes (DWI-1 and DWI-2) for the WISC-IV. Retrieved July 25, 2005, from http://alpha.fdu.edu/psychology/WISCIV_DWI.htm
16.
Dunn, T.M., Shear, P.K., Howe, S., & Ris, M.D. ( 2002). Detecting neuropsychological malingering: Effects of coaching and information. Archives of Clinical Neuropsychology , 18, 121-134.
17.
Etherton, J., Bianchini, K., Greve, K., & Heinly, M. ( 2005). Sensitivity and specificity of Reliable Digit Span in malingered pain-related disorders. Assessment, 12, 130-136.
18.
Flaro, L., Green, P., & Robertson, E. ( 2007). Word Memory Test failure 23 times higher in mild brain injury than in parents seeking custody: The power of external incentives. Brain Injury, 21, 373-383.
19.
Flanagan, D., Keiser, S., Bernier, J.E., & Ortiz, S.O. ( 2003). Diagnosis of learning disability in adulthood. Boston: Allyn & Bacon.
20.
Frazier, T.W., Frazier, A.R., Busch, R.M., Kerwood, M.A., & Demaree, H.A. ( 2008). Detection of simulated ADHD and Reading Disorder using symptom validity measures. Archives of Clinical Neuropsychology , 23, 501-509.
Green, P. ( 2003). Green’s Word Memory Test for Windows: User’s manual. Edmonton, Alberta, Canada: Green’s Publishing.
23.
Greiffenstein, M.F., Gola, T., & Baker, W.J. ( 1995). Validation of malingered amnesic measures with a large clinical sample. Psychological Assessment, 6, 218-224.
24.
Greve, K.W., Springer, S., Bianchini, K.J., Black, F.W., Heinly, M.T., Love, J.M., et al. (2007). Malingering in toxic exposure: Classification accuracy of Reliable Digit Span and WAIS-III Digit Span scaled scores. Assessment, 14, 12-21.
25.
Harrison, A.G. ( 2006). Adults faking ADHD: You must be kidding!ADHD Report, 14, 1-7.
26.
Harrison, A.G., Edwards, M.E., & Parker, K.P. ( 2007). Identifying students faking ADHD: Preliminary findings and strategies for detection. Archives of Clinical Neuropsychology , 22, 577-588.
27.
Harrison, A.G., Edwards, M.E., & Parker, K.P. ( 2008). Identifying students feigning dyslexia: Preliminary findings and strategies for detection. Dyslexia, 14, 228-246.
28.
Heinly, M., Greve, K., Bianchini, K., Love, J., & Brennan, A. ( 2004). WAIS Digit Span-based indicators of malingered neurocognitive dysfunction: Classification accuracy in traumatic brain injury. Assessment, 12, 429-444.
29.
Iverson, G.L., & Franzen, M.D. ( 1994). The Recognition Memory Test, Digit Span, and Knox Cube Test as markers of malingered memory impairment. Assessment , 1, 323-334.
30.
Iverson, G.L., & Franzen, M.D. ( 1996). Using multiple objective measures to detect simulated malingering. Journal of Clinical and Experimental Neuropsychology , 18, 38-51.
31.
Iverson, G., Green, P., & Gervais, R. ( 1999). Using the word memory test to detect biased responding in head injury litigation. Journal of Cognitive Rehabilitation , 17, 4-8.
32.
Iverson, G.L., Slick, D.J., & Franzen, M.D. ( 2000). Evaluation of a WMS-R malingering index in a non-litigating clinical sample. Journal of Clinical and Experimental Neuropsychology , 22, 191-197.
33.
Iverson, G.L., & Tulsky, D.S. ( 2003). Detecting malingering on the WAIS-III unusual digit span performance patterns in the normal population and in clinical groups. Archives of Clinical Neuropsychology, 18, 1-9.
34.
Jachimowicz, G., & Geiselman, R.E. (2004). Comparison of ease of falsification of attention deficit hyperactivity disorder diagnosis using standard behavioural rating scales. Cognitive Science Online, 2, 6-20.
35.
Lacene, K. ( 2004). WAIS-III working memory and processing speed indexes in adults with attention deficit/hyperactivity disorder. Unpublished thesis dissertation, University of Alberta, Canada.
36.
Learning Disabilities Association of Canada. ( 2002). LD defined: Official definition of learning disabilities . Retrieved February 12, 2007, from http://www.ldac-taac.ca/Defined/defined_new-e.asp
37.
Mathias, C.W., Greve, K.W., Bianchini, K.J., Houston, R.J., & Crouch, J.A. ( 2002). Detecting malingered neurocognitive dysfunction using the reliable digit span in traumatic brain injury. Assessment , 9, 302-308.
38.
McCallum, R.S., Bell, S., Wood, M., Below, J., Choate, S., & McCane, S. (2006). What is the role of working memory in reading relative to the big three processing variables (orthography, phonology, and rapid naming)?Journal of Psychoeducational Assessment, 24, 243-259.
39.
Miller, L.J., Ryan, J.J., Carruthers, C.A., & Cluff, R.B. ( 2004). Brief screening indexes for malingering: A confirmation of vocabulary minus digit span from the WAIS-III and the rarely missed index from the WMS-III. The Clinical Neuropsychologist, 18, 327-333.
40.
Millis, S.R., Ross, S.R., & Ricker, J.H. ( 1998). Detection of incomplete effort on the Wechsler Adult Intelligence Scale- Revised: A cross-validation. Journal of Clinical and Experimental Neuropsychology, 20, 167-173.
41.
Mittenberg, W., Theroux-Fichera, S., Zielinski., R., & Heilbronner, R.L. (1995). Identification of mailgered head injury on the Wechsler Adult Intelligence Scale-Revised. Professional Psychology: Research and Practice, 26, 491-498.
42.
Morey, L. ( 1991). Personality Assessment Inventory professional manual . Odessa, FL: Psychological Assessment Resources.
43.
Mullis, C. ( 2003). Trouble on the SAT. Psychology Today. Retrieved September 16, 2009, from https://www.psychologytoday.com/articles/200303/trouble-the-sat
44.
Nelson, N.W., Boone, K., Dueck, A., Wagener, L., Lu, P., & Grills, C. ( 2003). Relationships between eight measures of suspect effort . Clinical Neuropsychology, 17, 263-272.
45.
O’Bryant, S., & Lucas, J. ( 2006). Estimating the predictive value of the Test of Memory Malingering: An illustrative example for clinicians. The Clinical Neuropsychologist, 20, 533-40.
46.
Osmon, D., Plambeck, E., Klein, L., & Mano, Q. ( 2006). The Word Reading Test of Effort in adult learning disability . The Clinical Neuropsychologist, 20, 315-324.
47.
Prifitera, A., Weiss, L.G., & Saklofske, D.H. (1998). The WISC-III in context . In A. Prifitera & D. H. Saklofske (Eds.), WISC-III: Clinical use and interpretation (pp. 1-38). New York: Academic Press.
Quinn, C.A. ( 2003). Detection of malingering in assessment of adult ADHD . Archives of Clinical Neuropsychology, 18, 379-395.
50.
Rogers, R. ( 2008). Detection strategies for malingering and defensiveness . In R. Rogers (Ed.), Clinical assessment of malingering & deception (3rd ed., pp. 14-38). New York: Guilford Press.
51.
Schacter, D.L., Chiu, C.Y., & Ochsner, K.N. ( 1993). Implicit memory: A selective review. Annual Review of Neuroscience, 16, 159-182.
52.
Sigmundsson, H. ( 2005). Do visual processing deficits cause problem on response time task for dyslexics? Brain and Cognition, 58, 213-216.
53.
Slick, D.J., Hopp, G., & Strauss, E. ( 1998). Victoria Symptom Validity Test. Odessa, FL: Psychological Assessment Resources.
54.
Slick, D.J., Sherman, E.M.S., & Iverson, G.L. ( 1999). Diagnostic criteria for malingering neurocognitive dysfunction: Proposed standards for clinical practice and research. The Clinical Neuropsychologist, 13, 545-561.
55.
Stormont, M.A. ( 2008). Increase academic success for children with ADHD using sticky notes and highlighters. Intervention in School and Clinic, 43, 305-308.
56.
Sullivan, B., May, K., & Galbally, L. ( 2007). Symptom exaggeration by college adults in ADHD and learning disorders assessments. Applied Neuropsychology, 14, 189-207.
57.
Tan, J.E., Slick, D.J., Strauss, E., & Hultsch, D.F. ( 2002). How’d they do it? Malingering strategies on symptom validity tests. The Clinical Neuropsychologist, 16, 496-505.
58.
Taylor, M.J., & Heaton, R.K. ( 2001). Sensitivity and specificity of WAIS-III/WMS-III demographically corrected factor scores in neuropsychological assessment. Journal of the International Neuropsychological Society, 7, 867-874.
59.
Trueblood, W. ( 1994). Qualitative and quantitative characteristics of malingered and other invalid WAIS-R and clinical memory data. Journal of Clinical and Experimental Neuropsychology, 16, 597-607.
60.
Trueblood, W., & Schmidt, M. ( 1993). Malingering and other validity considerations in the neuropsychological evaluation of mild head injury. Journal of Clinical and Experimental Neuropsychology, 15, 578-590.
61.
Uzi, B., & Mona, B. ( 2006). Adolescents with attention deficit and hyperactivity disorder/learning disability and their proneness to accidents. Indian Journal of Pediatrics, 73, 299-303.
