Continuous performance tests are widely used to aid diagnostic decision making and measure symptom reduction in adult ADHD clinical populations. The diagnostic accuracy of the Quantified Behavior Test plus (QbTest+), developed to identify ADHD populations as an objective measure of ADHD symptoms, was explored.
Methods:
The utility of the QbTest+ was investigated in a clinical cohort of 69 adult patients referred to a specialist ADHD clinic in the UK.
Results:
Scores from the QbTest+ failed to differentiate between patients diagnosed with ADHD and those who did not receive a diagnosis after full clinical assessment.
Conclusions:
Based on our findings, we recommend clinicians are cautious when interpreting results of the QbTest+ in clinical populations. This study highlights the need for investigation into the lack of validation of commonly used objective measures in ADHD populations.
Agnew-BlaisJ. C.PolanczykG. V.DaneseA.WertzJ.MoffittT. E.ArseneaultL. (2016). Evaluation of the persistence, remission, and emergence of attention-deficit/hyperactivity disorder in young adulthood. JAMA Psychiatry, 73(7), 713–720. https://doi.org/10.1001/jamapsychiatry.2016.0465
2.
American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorder (5th ed.). American Psychiatric Press.
3.
BaaderA.KianiB.Brunkhorst-KanaanN.Kittel-SchneiderS.ReifA.GrimmO. (2020). A within-sample comparison of two innovative neuropsychological tests for assessing ADHD. Brain Sciences, 11(1), 36. https://doi.org/10.3390/brainsci11010036
4.
BaggioS.HaslerR.GiacominiV.El-MasriH.WeibelS.PerroudN.DeiberM. P. (2020). Does the continuous performance test predict ADHD symptoms severity and ADHD presentation in adults?Journal of Attention Disorders, 24(6), 840–848. https://doi.org/10.1177/1087054718822060
5.
BarkleyR. A. (1991). The ecological validity of laboratory and analogue assessment methods of ADHD symptoms. Journal of Abnormal Child Psychology, 19(2), 149–178. https://doi.org/10.1007/bf00909976
6.
BarkleyR. A.MurphyK. R. (2010). Impairment in occupational functioning and adult ADHD: The predictive utility of executive function (EF) ratings versus EF tests. Archives of Clinical Neuropsychology: The Official Journal of the National Academy of Neuropsychologists, 25(3), 157–173. https://doi.org/10.1093/arclin/acq014
7.
BergerI.CassutoH. (2014). The effect of environmental distractors incorporation into a CPT on sustained attention and ADHD diagnosis among adolescents. Journal of Neuroscience Methods, 222, 62–68. https://doi.org/10.1016/j.jneumeth.2013.10.012
8.
BergerI.SlobodinO.CassutoH. (2017). Usefulness and validity of continuous performance tests in the diagnosis of attention-deficit hyperactivity disorder children. Archives of Clinical Neuropsychology, 32(1), 81–93. https://doi.org/10.1093/arclin/acw101
9.
BiedermanJ.PettyC. R.EvansM.SmallJ.FaraoneS. V. (2010). How persistent is ADHD? A controlled 10-year follow-up study of boys with ADHD. Psychiatry Research, 177(3), 299–304. https://doi.org/10.1016/j.psychres.2009.12.010
10.
Brunkhorst-KanaanN.VerdenhalvenM.Kittel-SchneiderS.VainieriI.ReifA.GrimmO. (2020). The quantified behavioral Test-A confirmatory test in the diagnostic process of adult ADHD?Frontiers in Psychiatry, 11, 216. https://doi.org/10.3389/fpsyt.2020.00216
11.
ConnersC. K. (2014). Conners continuous performance test (Conners CPT 3) and Conners Continuous Auditory Test of attention (Conners CATA): Technical manual. Multi-Health Systems.
12.
Díaz-OruetaU.Garcia-LópezC.Crespo-EguílazN.Sánchez-CarpinteroR.ClimentG.NarbonaJ. (2014). AULA virtual reality test as an attention measure: Convergent validity with conners’ continuous performance test. Child Neuropsychology, 20(3), 328–342. https://doi.org/10.1080/09297049.2013.792332
13.
EdebolH.HelldinL.NorlanderT. (2012). Objective measures of behavior manifestations in adult ADHD and differentiation from participants with bipolar II disorder, borderline personality disorder, participants with disconfirmed ADHD as well as normative participants. Clinical Practice and Epidemiology in Mental Health, 8, 134–143. https://doi.org/10.2174/1745017901208010134
14.
EdebolH.HelldinL.NorlanderT. (2013). Measuring adult attention deficit hyperactivity disorder using the quantified behavior test plus. PsyCh Journal, 2(1), 48–62. https://doi.org/10.1002/pchj.17
15.
EdwardsM. C.GardnerE. S.ChelonisJ. J.SchulzE. G.FlakeR. A.DiazP. F. (2007). Estimates of the validity and utility of the conners’ continuous performance test in the assessment of inattentive and/or hyperactive-impulsive behaviors in children. Journal of Abnormal Child Psychology, 35(3), 393–404. https://doi.org/10.1007/s10802-007-9098-3
16.
EmserT. S.JohnstonB. A.SteeleJ. D.KooijS.ThorellL.ChristiansenH. (2018). Assessing ADHD symptoms in children and adults: Evaluating the role of objective measures. Behavioral and Brain Functions, 14(1), 11. https://doi.org/10.1186/s12993-018-0143-x
17.
EpsteinJ. N.ErkanliA.ConnersC. K.KlaricJ.CostelloJ. E.AngoldA. (2003). Relations between continuous performance test performance measures and ADHD behaviors. Journal of Abnormal Child Psychology, 31(5), 543–554. https://doi.org/10.1023/a:1025405216339
18.
FaraoneS. V.BiedermanJ.SpencerT.MickE.MurrayK.PettyC.AdamsonJ. J.MonuteauxM. C. (2006). Diagnosing adult attention deficit hyperactivity disorder: Are late onset and subthreshold diagnoses valid?American Journal of Psychiatry, 163(10), 1720–1729. https://doi.org/10.1176/ajp.2006.163.10.1720
19.
ForbesG. B. (1998). Clinical utility of the test of variables of attention (TOVA) in the diagnosis of attention-deficit/hyperactivity disorder. Journal of Clinical Psychology, 54(4), 461–476. https://doi.org/10.1002/(sici)1097-4679(199806)54:4<461::aid-jclp8>3.0.co;2-q
20.
González-CastroP.RodríguezC.LópezÁ.CueliM.ÁlvarezL. (2013). Attention deficit hyperactivity disorder, differential diagnosis with blood oxygenation, beta/theta ratio, and attention measures. International Journal of Clinical and Health Psychology, 13(2), 101–109. https://doi.org/10.1016/S1697-2600(13)70013-9
21.
GroomM. J.YoungZ.HallC. L.GillottA.HollisC. (2016). The incremental validity of a computerised assessment added to clinical rating scales to differentiate adult ADHD from autism spectrum disorder. Psychiatry Research, 243, 168–173. https://doi.org/10.1016/j.psychres.2016.06.042
22.
GualtieriC. T.JohnsonL. G. (2005). ADHD: Is objective diagnosis possible?Psychiatry, 2(11), 44–53.
23.
HallC. L.ValentineA. Z.GroomM. J.WalkerG. M.SayalK.DaleyD.HollisC. (2016). The clinical utility of the continuous performance test and objective measures of activity for diagnosing and monitoring ADHD in children: A systematic review. European Child & Adolescent Psychiatry, 25(7), 677–699. https://doi.org/10.1007/s00787-015-0798-x
24.
HassonR.FineJ. G. (2012). Gender differences among children with ADHD on continuous performance tests: A meta-analytic review. Journal of Attention Disorders, 16(3), 190–198. https://doi.org/10.1177/1087054711427398
25.
HerveyA. S.EpsteinJ. N.CurryJ. F. (2004). Neuropsychology of adults with attention-deficit/hyperactivity disorder: A meta-analytic review. Neuropsychology, 18(3), 485–503. https://doi.org/10.1037/0894-4105.18.3.485
26.
HirschO.ChavanonM.RiechmannE.ChristiansenH. (2018). Emotional dysregulation is a primary symptom in adult attention-deficit/hyperactivity disorder (ADHD). Journal of Affective Disorders, 232, 41–47. https://doi.org/10.1016/j.jad.2018.02.007
27.
HirschO.ChristiansenH. (2017). Factorial structure and validity of the quantified behavior test plus (Qb+(c)). Assessment, 24(8), 1037–1049. https://doi.org/10.1177/1073191116638426
28.
HultN.KadesjöJ.KadesjöB.GillbergC.BillstedtE. (2018). ADHD and the QbTest: Diagnostic validity of QbTest. Journal of Attention Disorders, 22(11), 1074–1080. https://doi.org/10.1177/1087054715595697
29.
JohanssonV.Norén SelinusE.Kuja-HalkolaR.LundströmS.DurbeejN.AnckarsäterH.LichtensteinP.HellnerC. (2021). The quantified behavioral test failed to differentiate ADHD in adolescents with neurodevelopmental problems. Journal of Attention Disorders, 25(3), 312–321. https://doi.org/10.1177/1087054718787034
30.
KooijJ. J.BijlengaD.SalernoL.JaeschkeR.BitterI.BalázsJ.ThomeJ.DomG.KasperS.Nunes FilipeC.StesS.MohrP.LeppämäkiS.CasasM.BobesJ.MccarthyJ. M.RicharteV.Kjems PhilipsenA.PehlivanidisA.. . . AshersonP. (2019). Updated European consensus statement on diagnosis and treatment of adult ADHD. European Psychiatry, 56, 14–34. https://doi.org/10.1016/j.eurpsy.2018.11.001
31.
KooijJ. J. S.FranckenM. H. (2010). Diagnostic interview for ADHD in adults (DIVA). DIVA Foundation.
32.
LisS.BaerN.Stein-en-NosseC.GallhoferB.SammerG.KirschP. (2010). Objective measurement of motor activity during cognitive performance in adults with attention-deficit/hyperactivity disorder. Acta Psychiatrica Scandinavica, 122(4), 285–294. https://doi.org/10.1111/j.1600-0447.2010.01549.x
33.
LosierB. J.McGrathP. J.KleinR. M. (1996). Error patterns on the continuous performance test in non-medicated and medicated samples of children with and without ADHD: A meta-analytic review. Journal of Child Psychology and Psychiatry, 37(8), 971–987. https://doi.org/10.1111/j.1469-7610.1996.tb01494.x
34.
McGeeR. A.ClarkS. E.SymonsD. K. (2000). Does the conners' continuous performance test aid in ADHD diagnosis?Journal of Abnormal Child Psychology, 28(5), 415–424. https://doi.org/10.1023/A:1005127504982
35.
NicholsS. L.WaschbuschD. A. (2004). A review of the validity of laboratory cognitive tasks used to assess symptoms of ADHD. Child Psychiatry and Human Development, 34(4), 297–315. https://doi.org/10.1023/b:Chud.0000020681.06865.97
36.
OgrimG.KropotovJ.HestadK. (2012). The quantitative EEG theta/beta ratio in attention deficit/hyperactivity disorder and normal controls: Sensitivity, specificity, and behavioral correlates. Psychiatry Research, 198(3), 482–488. https://doi.org/10.1016/j.psychres.2011.12.041
37.
OieM.SundetK.UelandT. (2011). Neurocognition and functional outcome in early-onset schizophrenia and attention-deficit/hyperactivity disorder: A 13-year follow-up. Neuropsychology, 25(1), 25–35. https://doi.org/10.1037/a0020855
38.
ParsonsT. D.DuffieldT.AsbeeJ. (2019). A comparison of virtual reality classroom continuous performance tests to traditional continuous performance tests in delineating ADHD: A meta-analysis. Neuropsychology Review, 29(3), 338–356. https://doi.org/10.1007/s11065-019-09407-6
39.
PolanczykG. V.WillcuttE. G.SalumG. A.KielingC.RohdeL. A. (2014). ADHD prevalence estimates across three decades: An updated systematic review and meta-regression analysis. International Journal of Epidemiology, 43(2), 434–442. https://doi.org/10.1093/ije/dyt261
40.
PollakY.ShomalyH. B.WeissP. L.RizzoA. A.Gross-TsurV. (2010). Methylphenidate effect in children with ADHD Can Be measured by an ecologically valid continuous performance test embedded in virtual reality. CNS Spectrums, 15(2), 125–130. https://doi.org/10.1017/S109285290002736X
41.
RapportM. D.ChungK.-M.ShoreG.DenneyC. B.IsaacsP. (2000). Upgrading the science and technology of assessment and diagnosis: Laboratory and clinic-based assessment of children with ADHD. Journal of Clinical Child Psychology, 29(4), 555–568. https://doi.org/10.1207/S15374424JCCP2904_8
42.
RehV.SchmidtM.LamL.SchimmelmannB. G.HebebrandJ.RiefW.ChristiansenH. (2015). Behavioral assessment of core ADHD symptoms using the QbTest. Journal of Attention Disorders, 19(12), 1034–1045. https://doi.org/10.1177/1087054712472981
43.
RiccioC. A.ReynoldsC. R. (2001). Continuous performance tests are sensitive to ADHD in adults but lack specificity. A review and critique for differential diagnosis. Annals of the New York Academy of Sciences, 931, 113–139. https://doi.org/10.1111/j.1749-6632.2001.tb05776.x
44.
RizzoA. A.BuckwalterJ. G.BowerlyT.Van Der ZaagC.HumphreyL.NeumannU.ChuaC.KyriakakisC.Van RooyenA.SisemoreD. (2000). The virtual classroom: A virtual reality environment for the assessment and rehabilitation of attention deficits. CyberPsychology & Behavior, 3(3), 483–499. https://doi.org/10.1089/10949310050078940
45.
RodríguezC.ArecesD.GarcíaT.CueliM.González-CastroP. (2018). Comparison between two continuous performance tests for identifying ADHD: Traditional vs. virtual reality. International Journal of Clinical and Health Psychology, 18(3), 254–263. https://doi.org/10.1016/j.ijchp.2018.06.003
46.
RodríguezC.González-CastroP.CueliM.ArecesD.González-PiendaJ. A. (2016). Attention deficit/hyperactivity disorder (ADHD) diagnosis: An activation-executive model. Frontiers in Psychology, 7, 1406. https://doi.org/10.3389/fpsyg.2016.01406
47.
SchoechlinC.EngelR. R. (2005). Neuropsychological performance in adult attention-deficit hyperactivity disorder: Meta-analysis of empirical data. Archives of Clinical Neuropsychology: The Official Journal of the National Academy of Neuropsychologists, 20(6), 727–744. https://doi.org/10.1016/j.acn.2005.04.005
48.
ShakedD.FaulknerL. M. D.TolleK.WendellC. R.WaldsteinS. R.SpencerR. J. (2020). Reliability and validity of the conners’ continuous performance test. Applied Neuropsychology. Adult, 27(5), 478–487. https://doi.org/10.1080/23279095.2019.1570199
49.
SibleyM. H.ArnoldL. E.SwansonJ. M.HechtmanL. T.KennedyT. M.OwensE.MolinaB. S. G.JensenP. S.HinshawS. P.RoyA.Chronis-TuscanoA.NewcornJ. H.RohdeL. A. (2022). Variable patterns of remission from ADHD in the multimodal treatment study of ADHD. American Journal of Psychiatry, 179(2), 142–151. https://doi.org/10.1176/appi.ajp.2021.21010032
50.
SimonV.CzoborP.BálintS.Mészáros BitterI. (2009). Prevalence and correlates of adult attention-deficit hyperactivity disorder: Meta-analysis. The British Journal of Psychiatry, 194(3), 204–211. https://doi.org/10.1192/bjp.bp.107.048827
51.
SöderströmS.PetterssonR.NilssonK. W. (2014). Quantitative and subjective behavioural aspects in the assessment of attention-deficit hyperactivity disorder (ADHD) in adults. Nordic Journal of Psychiatry, 68(1), 30–37. https://doi.org/10.3109/08039488.2012.762940
52.
SolantoM. V.EtefiaK.MarksD. J. (2004). The utility of self-report measures and the continuous performance test in the diagnosis of ADHD in adults. CNS Spectrums, 9(9), 649–659. https://doi.org/10.1017/S1092852900001929
53.
SoreniN.CrosbieJ.IckowiczA.SchacharR. (2009). Stop signal and conners’ continuous performance tasks: Test–retest reliability of two inhibition measures in ADHD children. Journal of Attention Disorders, 13(2), 137–143. https://doi.org/10.1177/1087054708326110
54.
TallbergP.RåstamM.WenhovL.EliassonG.GustafssonP. (2019). Incremental clinical utility of continuous performance tests in childhood ADHD: An evidence-based assessment approach. Scandinavian Journal of Psychology, 60(1), 26–35. https://doi.org/10.1111/sjop.12499
55.
TeicherM. H.PolcariA.FourligasN.VitalianoG.NavaltaC. P. (2012). Hyperactivity persists in male and female adults with ADHD and remains a highly discriminative feature of the disorder: A case-control study. BMC Psychiatry, 12, 190. https://doi.org/10.1186/1471-244X-12-190
56.
UlberstadF. (2012). QbTest technical manual. Qbtech AB.
57.
UnoM.AbeJ.SawaiC.SakaueY.NishitaniA.YasudaY.TsuzukiK.TakanoT.OhnoM.MaruyamaT.TakeuchiY. (2006). Effect of additional auditory and visual stimuli on continuous performance test (noise-generated CPT) in AD/HD children – usefulness of noise-generated CPT. Brain & Development, 28(3), 162–169. https://doi.org/10.1016/j.braindev.2005.06.007
58.
VogtC.ShameliA. (2011). Assessments for attention-deficit hyperactivity disorder: Use of objective measurements. The Psychiatrist, 35(10), 380–383. https://doi.org/10.1192/pb.bp.110.032144
59.
WehmeierP. M.DittmannR. W.BanaschewskiT.SchachtA. (2014). Does stimulant pretreatment modify atomoxetine effects on core symptoms of ADHD in children assessed by quantitative measurement technology?Journal of Attention Disorders, 18(2), 105–116. https://doi.org/10.1177/1087054712445184
60.
WillcuttE. G.DoyleA. E.NiggJ. T.FaraoneS. V.PenningtonB. F. (2005). Validity of the executive function theory of attention-deficit/hyperactivity disorder: A meta-analytic review. Biological Psychiatry, 57(11), 1336–1346. https://doi.org/10.1016/j.biopsych.2005.02.006
61.
WilliamsL.HallC. L.BrownS.GuoB.JamesM.FranceschiniM.ClarkeJ.SelbyK.VijayanH.KulkarniN.BrownN.SayalK.HollisC.GroomM. J. (2021). Optimising medication management in children and young people with ADHD using a computerised test (QbTest): A feasibility randomised controlled trial. Pilot and Feasibility Studies, 7(1), 68. https://doi.org/10.1186/s40814-021-00788-1
62.
ZelnikN.Bennett-BackO.MiariW.GoezH. R.Fattal-ValevskiA. (2012). Is the test of variables of attention reliable for the diagnosis of attention-deficit hyperactivity disorder (ADHD)?Journal of Child Neurology, 27(6), 703–707. https://doi.org/10.1177/0883073811423821
