The Behavior Rating Inventory of Executive Function–Adult Version (BRIEF-A) is a standardized rating scale of subjective executive functioning. We provide univariate and multivariate base rates (BRs) for scale/index scores in the clinical range (T scores ≥65), reliable change, and inter-rater information not included in the Professional Manual. Participants were adults (ages = 18–90 years) from the BRIEF-A self-report (N = 1,050) and informant report (N = 1,200) standardization samples, as well as test–retest (n = 50 for self, n = 44 for informant) and inter-rater (n = 180) samples. Univariate BRs of elevated T scores were low (self-report = 3.3%–15.4%, informant report = 4.5%–16.3%). Multivariate BRs revealed the common occurrence of obtaining at least one elevated T-score across scales (self-report = 26.5%–37.3%, informant report = 22.7%–30.3%), whereas virtually none had elevated scores on all scales. Test–retest scores were highly correlated (self = .82–.94; informant = .91–.96). Inter-rater correlations ranged from .44 to .68. Significant (p < .05) test–retest T-score differences ranged from 7 to 12 for self-report, from 6 to 8 for informant report, and from 16 to 21 points for inter-rater T-score differences. Applications of these findings are discussed.
AchenbachT.McConaughyS.HowellC. (1987). Child/adolescent behavioral and emotional problems: Implications of cross-informant correlations for situational specificity. Psychological Bulletin, 101, 213–232. https://doi.org/10.1037/0033-2909.101.2.213
2.
AitaS. L.HillB. D.MussoM. W.Gouvier WmD. (2018). Can we identify bad cops based on history? Base rates of historical markers in law enforcement pre-employment evaluations. Journal of Police and Criminal Psychology, 33, 201–208. https://doi.org/10.1007/s11896-018-9258-0
BinderL. M.IversonG. L.BrooksB. L. (2009). To err is human: “Abnormal” neuropsychological scores and variability are common in healthy adults. Archives of Clinical Neuropsychology, 24, 31–46. https://doi.org/10.1093/arclin/acn001
5.
BrooksB. L.IversonG. L.HoldnackJ. A. (2013). Understanding and using multivariate base rates with the WAIS-IV/WMS-IV. In HoldnackJ. A.DrozdickL. W.WeissL. G.IversonG. L. (Eds.), WAIS-IV, WMS-IV, and ACS: Advanced clinical interpretation (pp. 75–102). Academic Press. https://doi.org/10.1016/B978-0-12-386934-0.00002-X
6.
BrooksB. L.IversonG. L.LantingS. C.HortonA. M.ReynoldsC. R. (2012). Improving test interpretation for detecting executive dysfunction in adults and older adults: Prevalence of low scores on the test of verbal conceptualization and fluency. Applied Neuropsychology: Adult, 19, 61–70. https://doi.org/10.1080/09084282.2012.651951
7.
BrooksB. L.IversonG. L.WhiteT. (2009). Advanced interpretation of the neuropsychological assessment battery with older adults: Base rate analyses, discrepancy scores, and interpreting change. Archives of Clinical Neuropsychology, 24, 647–657. https://doi.org/10.1093/arclin/acp061
8.
BrooksB. L.StraussE.ShermanE. M. S.IversonG. L. (2009). Developments in neuropsychological assessment: Refining psychometric and clinical interpretive methods. Canadian Psychology, 50, 196–209. https://doi.org/10.1037/a0016066
9.
BurgessP. W.AldermanN.EvansJ.EmslieH.WilsonB. A. (1998). The ecological validity of tests of executive function. Journal of the International Neuropsychological Society, 4, 547–558. https://doi.org/10.1017/s1355617798466037
10.
CiszewskiS.FrancisK.MendellaP.BissadaH.TascaG. A. (2014). Validity and reliability of the Behavior Inventory Rating of Executive Function–Adult version in a clinical sample with eating disorders. Eating Behaviors, 15(2), 175–181. https://doi.org/10.1016/j.eatbeh.2014.01.004
11.
CrawfordJ. R.GarthwaiteP. H.SutherlandD.BorlandN. (2011). Some supplementary methods for the analysis of the Delis-Kaplan Executive Function System. Psychological Assessment, 23, 888–898. https://doi.org/10.1037/a0023712
12.
DelisD. C.KaplanE.KramerJ. H. (2001). Delis-Kaplan Executive Function System. Pearson.
13.
DondersJ.OhY. I.GableJ. (2015). Self- and informant ratings of executive functioning after mild traumatic brain injury. Journal of Head Trauma Rehabilitation, 30, E30–E39. https://doi.org/10.1097/htr.0000000000000120
14.
FergusonC. K. (2009). An effect size primer: A guide for clinicians and researchers. Professional Psychology: Research and Practice, 40, 532–538. https://doi.org/10.1037/a0015808
15.
GioiaG. A.IsquithP. K. (2004). Ecological assessment of executive function in traumatic brain injury. Developmental Neuropsychology, 25(1/2), 135–158. https://doi.org/10.1080/87565641.2004.9651925
16.
GoodglassH.KaplanE. (1979). Assessment of cognitive deficit in the brain-injured patient. In GazzanigaM. S. (Ed.), Handbook of behavioral neurobiology: Vol. 2. Neuropsychology (pp. 3–22). Plenum Press.
17.
GouvierW. D. (1999). Base rates and clinical decision making in neuropsychology. In SweetJ. J. (Ed.), Forensic neuropsychology: Fundamentals and practice (pp. 27–38). Taylor & Francis. https://doi.org/10.1176/appi.ajp.158.11.1951-a
18.
GuilmetteT. J.SweetJ. J.HebbenN.KoltaiD.MahoneE. M.SpieglerB. J.StuckyK.WesterveldM.Conference Participants. (2020). American Academy of Clinical Neuropsychology consensus conference statement on uniform labeling of performance test scores. The Clinical Neuropsychologist, 34, 437–453. https://doi.org/10.1080/13854046.2020.1722244
19.
GunnerJ. H.MieleA. S.LynchJ. K.McCaffreyR. J. (2012). Performance on non-neurological older adults on the Wisconsin Card Sorting Test and the Stroop Color-Word Test: Normal variability or cognitive impairment?Archives of Clinical Neuropsychology, 27, 398–405. https://doi.org/10.1093/arclin/acs047
20.
HeatonR. K.CheluneG. J.TalleyJ. L.KayG. G.CurtissG. (1993). Wisconsin card sorting test manual: Revised and expanded. Psychological Assessment Resources.
21.
IsquithP. K.RothR. M.GioiaG. (2013). Contribution of rating scales to the assessment of executive functions. Applied Neuropsychology: Child, 2, 125–132. https://doi.org/10.1080/21622965.2013.748389
22.
IsquithP. K.RothR. M.KenworthL.GioiaG. (2014). Contribution of rating scales to intervention for executive functions. Applied Neuropsychology: Child, 3, 197–204. https://doi.org/10.1080/21622965.2013.870014
23.
IversonG. L. (2018). Reliable change index. In KreutzerJ. S.DeLucaJ.CaplanB. (Eds.), Encyclopedia of clinical neuropsychology (pp. 2984–2987). Springer. https://doi.org/10.1007/978-3-319-57111-9_1242
24.
JacobsonN. S.TrauxP. (1991). Clinical significance: A statistical approach to defining meaningful change in psychotherapy research. Journal of Consulting and Clinical Psychology, 59, 12–19. https://doi.org/10.1037/0022-006X.59.1.12
25.
KarrJ. E.Garcia-BarreraM. A.HoldnackJ. A.IversonG. L. (2017). Using multivariate base rates to interpret low scores on an abbreviated battery of the Delis-Kaplan Executive Function System. Archives of Clinical Neuropsychology, 32, 297–305. https://doi.org/10.1093/arclin/acw105
26.
KarrJ. E.Garcia-BarreraM. A.HoldnackJ. A.IversonG. L. (2018). Advanced clinical interpretation of the Delis-Kaplan Executive Function System: Multivariate base rates of low scores. The Clinical Neuropsychologist, 32, 42–53. https://doi.org/10.1080/13854046.2017.1334828
27.
LabargeA. S.McCaffreyR. J.BrownT. A. (2003). Neuropsychologists’ abilities to determine the predictive value of diagnostic tests. Archives of Clinical Neuropsychology, 18, 165–175. https://doi.org/10.1016/S0887-6177(01)00193-7
28.
LangeR. T. (2018). Inter-rater reliability. In KreutzerJ. S.DeLucaJ.CaplanB. (Eds.), Encyclopedia of clinical neuropsychology (p. 1844). Springer. https://doi.org/10.1007/978-3-319-57111-9_1203
29.
LezakM. D.HowiesonD. B.BiglerE. D.TranelD. (2012). Neuropsychological assessment. Oxford University Press.
30.
MeehlP. E.RosenA. (1955). Antecedent probability and the efficiency of psychometric signs, patterns, or cutting scores. Psychological Bulletin, 52, 194–216. https://doi.org/10.1037/h0048070
31.
Oltra-CucarellaJ.Sánchez-SanSegundoM.Rubio-AparicioM.Arango-LasprillaJ. C.Ferrer-CascalesR. (2021). The association between the number of neuropsychological measures and the base rate of low scores. Assessment, 28(3), 955–963. https://doi.org/10.1177/1073191119864646
32.
PalmerB. W.BooneK. B.LesserI. M.WohlM. A. (1998). Base rates of “impaired” neuropsychological test performance among healthy older adults. Archives of Clinical Neuropsychology, 13, 503–511. https://doi.org/10.1016/S0887-6177(97)00037-1
33.
PardejS. K.NittaM. E.HoelzleJ. B. (2018). Rates of executive dysfunction in undergraduate research participants. Modern Psychological Studies, 24, 1–18. https://scholar.utc.edu/mps/vol24/iss1/6
34.
PodellK.DefinaP. A.BarrettP.McCullenA.GoldbergE. (2003). Assessment of neuropsychological functioning. In WeinerI. B.FreedheimD. K.SchinkaJ. A.VelicerW. F. (Eds.), Handbook of psychology (pp. 443–466). Wiley.
35.
RabinL. A.RothR. M.IsquithP. K.WishartH. A.Nutter-UphamK. E.PareN.FlashmanL. A.SaykinA. J. (2006). Self- and informant reports of executive function on the BRIEF-A in MCI and older adults with cognitive complaints. Archives of Clinical Neuropsychology, 21, 721–732. https://doi.10/1016/j.acn.2006.08.004
36.
ReynoldsC. R.KamphausR. W. (2015). Behavior assessment system for children (3rd ed.). Pearson.
37.
RothR. M.IsquithP. K.GioiaG. A. (2005). BRIEF-A: Behavior Rating Inventory of Executive Function–Adult version. Psychological Assessment Resources.
38.
RothR. M.LanceC. E.IsquithP. K.FischerA. S.GiancolaP. R. (2013). Confirmatory factor analysis of the Behavior Rating Inventory of Executive Function–Adult version in healthy adults and application to attention-deficit/hyperactivity disorder. Archives of Clinical Neuropsychology, 28, 425–434. https://doi.org/10.1093/arclin/act031
39.
SchretlenD. J.MunroC. A.AnthonyJ. C.PearlsonG. D. (2003). Examining the range of normal intraindividual variability in neuropsychological test performance. Journal of the International Neuropsychological Society, 9, 864–870. https://doi.org/10.10170S1355617703960061
40.
Tanner-EggenC.BalzerC.PerrigW. J.GutbrodK. (2015). The neuropsychological assessment of cognitive deficits considering measures of performance variability. Archives of Clinical Neuropsychology, 30, 217–227. https://doi.org/10.1093/arclin/acv008
41.
ToplakM. E.WestR. F.StanovichK. E. (2013). Practitioner review: Do performance-based measures and ratings of executive function assess the same construct?Journal of Child Psychology and Psychiatry, 54, 131–143. https://doi.org/10.1111/jcpp.12001
42.
U.S. Bureau of the Census. (2002). Current population survey, March 2002 [Data file]. U.S. Department of Commerce.
43.
ZimmermanM. E. (2018). Base rate (population). In KreutzerJ. S.DeLucaJ.CaplanB. (Eds.), Encyclopedia of clinical neuropsychology (p. 493). Springer. https://doi.org/10.1007/978-3-319-57111-9_1174
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
