Children use executive function (EF) skills within everyday occupations; however, EF poses a difficult and complex construct to measure. Currently, many measures of EF lack applicability to daily life, or ecological validity. The aim of this scoping review was to examine two aspects of ecological validity across measures, assessments, and tasks of EF in children. A scoping review of 355 peer-reviewed articles published between 1996 and 2016 was performed. Searching revealed 43 articles addressing the ecological validity of EF measures for children and 40 measures addressing ecological validity. An increasing number of articles address ecological validity of EF measures. Future research should address the interplay between context and EF performance. In addition, research should begin recognizing the importance of parental involvement in assessments, as well as ways to capture the EF strengths of children.
AchenbachT. M.McConaughyS. H.HowellC. T. (1987). Child/adolescent behavioral and emotional problems: Implications of cross-informant correlations for situational specificity. Psychological Bulletin, 101, 213-232. doi:10.1037/0033-2909.101.2.213
2.
AndersonP. (2002). Assessment and development of executive function (EF) during childhood. Child Neuropsychology : A Journal on Normal and Abnormal Development in Childhood and Adolescence, 8, 71-82. doi:10.1076/chin.8.2.71.8724
3.
ArkseyH.O’MalleyL. (2005). Scoping studies: Towards a methodological framework. International Journal of Social Research Methodology, 8, 19-32. doi:10.1080/1364557032000119616
4.
BaronI. S. (2007). Review of Behavioural Assessment of the Dysexecutive Syndrome for Children (BADS-C). Child Neuropsychology, 13, 539-542. doi:10.1080/09297040601112781
5.
BurgessP. W.AldermanN.EvansJ.EmslieH.WilsonB. A. (1998). The ecological validity of tests of executive function. Journal of the International Neuropsychological Society, 4, 547-558.
6.
BurgessP. W.AldermanN.ForbesC.CostelloA.CoatesL. M.DawsonD. R.. . . ChannonS. (2006). The case for the development and use of “ecologically valid” measures of executive function in experimental and clinical neuropsychology. Journal of the International Neuropsychological Society, 12(2), 194-209. doi:10.1017/S1355617706060310
7.
ChaytorN.Schmitter-EdgecombeM. (2003). The ecological validity of neuropsychological tests: A review of the literature on everyday cognitive skills. Neuropsychology Review, 13, 181-197. doi:10.1023/B:NERV.0000009483.91468.fb
8.
ChenI.-C.TsaiP.-L.HsuY.-W.MaH.-I.LaiH.-A. (2013). Everyday memory in children with developmental coordination disorder. Research in Developmental Disabilities, 34(1), 687-694. Retrieved from https://doi.org/10.1016/j.ridd.2012.09.012
9.
ChevignardM. P.CatroppaC.GalvinJ.AndersonV. (2010). Development and evaluation of an ecological task to assess executive functioning post childhood TBI: The Children’s Cooking Task. Brain Impairment, 11(2), 125-143. Retrieved from https://doi.org/10.1375/brim.11.2.125
10.
ChevignardM. P.SooC.GalvinJ.CatroppaC.ErenS. (2012). Ecological assessment of cognitive functions in children with acquired brain injury: A systematic review. Brain Injury, 26, 1033-1057. doi:10.3109/02699052.2012.666366
11.
CosterW.KhetaniM. A. (2008). Measuring participation of children with disabilities: Issues and challenges. Disability and Rehabilitation, 30, 639-648. doi:10.1080/09638280701400375
12.
CroneE. A.van der MolenM. W. (2004). Developmental changes in real life decision making: performance on a gambling task previously shown to depend on the ventromedial prefrontal cortex. Developmental Neuropsychology, 25(3), 251-279. Retrieved from https://doi.org/10.1207/s15326942dn2503_2
13.
DaviesS. R.FieldA. R. J.AndersenT.PestellC. (2011). The ecological validity of the Rey-Osterrieth complex figure: Predicting everyday problems in children with neuropsychological disorders. Journal of Clinical and Experimental Neuropsychology, 33, 820-831. doi:10.1080/13803395.2011.574608
de VriesM.GeurtsH. M. (2012). Cognitive flexibility in ASD; Task switching with emotional faces. Journal of Autism and Developmental Disorders, 42, 2558-2568. doi:10.1007/s10803-012-1512-1
16.
Díaz-OruetaU.Garcia-LópezC.Crespo-EguílazN.Sánchez-CarpinteroR.ClimentG.NarbonaJ. (2014). AULA virtual reality test as an attention measure: Convergent validity with Conners’ Continuous Performance Test. Child Neuropsychology : A Journal on Normal and Abnormal Development in Childhood and Adolescence, 20, 328-342. doi:10.1080/09297049.2013.792332
17.
DiBartoloP. M.GrillsA. E. (2006). Who is best at predicting children’s anxiety in response to a social evaluative task?Journal of Anxiety Disorders, 20, 630-645. doi:10.1016/j.janxdis.2005.06.003
18.
FloydR. G.KirbyE. A. (2001). Psychometric properties of measures of behavioral inhibition with preschool-age children: Implications for assessment of children at risk for ADHD. Journal of Attention Disorders, 5(2), 79-91. doi:10.1177/108705470100500202
19.
FournetN.RoulinJ.-L.MonnierC.AtzeniT.CosnefroyO.Le GallD.. . . RoyA. (2015). Multigroup confirmatory factor analysis and structural invariance with age of the Behavior Rating Inventory of Executive Function (BRIEF)–French version. Child Neuropsychology : A Journal on Normal and Abnormal Development in Childhood and Adolescence, 21(3), 379-398. Retrieved from https://doi.org/10.1080/09297049.2014.906569
20.
GerstleM.BeebeD. W.DrotarD.CassedyA.MarinoB. S. (2016). Executive Functioning and School Performance among Pediatric Survivors of Complex Congenital Heart Disease. The Journal of Pediatrics, 173, 154-159. Retrieved from https://doi.org/10.1016/j.jpeds.2016.01.028
21.
GilboaY.RosenblumS.Fattal-ValevskiA.Toledano-AlhadefH.JosmanN. (2014). Is there a relationship between executive functions and academic success in children with neurofibromatosis type 1?Neuropsychological Rehabilitation, 24(6), 918-935. Retrieved from https://doi.org/10.1080/09602011.2014.920262
22.
GouldenL. G.SilverC. H. (2009). Concordance of the Children’s Executive Functions Scale with established tests and parent rating scales. Journal of Psychoeducational Assessment, 27(6), 439-451. Retrieved from https://doi.org/10.1177/0734282909335574
23.
IsquithP. K.GioiaG. A.EspyK. A. (2004). Executive function in preschool children: examination through everyday behavior. Developmental Neuropsychology, 26(1), 403-422. Retrieved from https://doi.org/10.1207/s15326942dn2601_3
24.
JaroslawskaA. J.GathercoleS. E.LogieM. R.HolmesJ. (2016). Following instructions in a virtual school: Does working memory play a role?Memory & Cognition, 44, 580-589. doi:10.3758/s13421-015-0579-2
25.
KenworthyL.YerysB. E.AnthonyL. G.WallaceG. L. (2008). Understanding executive control in autism spectrum disorders in the lab and in the real world. Neuropsychology Review, 18, 320-338. doi:10.1007/s11065-008-9077-7
26.
KronenbergerW. G.CastellanosI.PisoniD. B. (2016). Questionnaire-based assessment of executive functioning: Case studies. Applied Neuropsychology. Child, 1-11. Retrieved from https://doi.org/10.1080/21622965.2016.1200976
27.
KvavilashviliL.EllisJ. (2004). Ecological validity and the real-life / laboratory controversy in memory research: A critical and historical review. History & Philosophy of Psychology, 6, 59-80.
28.
LawrenceV.HoughtonS.DouglasG.DurkinK.WhitingK.TannockR. (2004). Executive function and ADHD: A comparison of children’s performance during neuropsychological testing and real-world activities. Journal of Attention Disorders, 7(3), 137-149. Retrieved from http://www.ncbi.nlm.nih.gov/pubmed/15260171
29.
LawrenceV.HoughtonS.TannockR.DouglasG.DurkinK.WhitingK. (2002). ADHD outside the laboratory: boys’ executive function performance on tasks in videogame play and on a visit to the zoo. Journal of Abnormal Child Psychology, 30(5), 447-462. Retrieved from http://www.ncbi.nlm.nih.gov/pubmed/12403149
30.
LevacD.ColquhounH.O’BrienK. K. (2010). Scoping studies: Advancing the methodology. Implementation Science, 5 (69). doi:10.1186/1748-5908-5-69
31.
LiY.CaoF.ShaoD.XueJ. (2014). Ecological assessment of executive functions in adolescents genetically at high risk for schizophrenia. Comprehensive Psychiatry, 55(6), 1350-1357. Retrieved from https://doi.org/10.1016/j.comppsych.2014.04.009
32.
LuiM.TannockR. (2007). Working memory and inattentive behaviour in a community sample of children. Behavioral and Brain Functions: BBF, 3(12). Retrieved from https://doi.org/10.1186/1744-9081-3-12
33.
MacAllisterW. S.VassermanM.CoulehanK.HallA. F.BenderH. A. (2016). Cognitive estimations as a measure of executive dysfunction in childhood epilepsy. Child Neuropsychology : A Journal on Normal and Abnormal Development in Childhood and Adolescence, 22, 65-80. doi:10.1080/09297049.2014.967670
34.
MackinlayR.CharmanT.Karmiloff-SmithA. (2006). High functioning children with autism spectrum disorder: a novel test of multitasking. Brain and Cognition, 61(1), 14-24. Retrieved from https://doi.org/10.1016/j.bandc.2005.12.006
35.
McAuleyT.ChenS.GoosL.SchacharR.CrosbieJ. (2010). Is the behavior rating inventory of executive function more strongly associated with measures of impairment or executive function?Journal of the International Neuropsychological Society, 16, 495-505. doi:10.1017/S1355617710000093
36.
NolinP.MartinC.BouchardS. (2009). Assessment of inhibition deficits with the virtual classroom in children with traumatic brain injury: A pilot-study. Studies in Health Technology and Informatics, 144, 240-242. Retrieved from http://www.ncbi.nlm.nih.gov/pubmed/19592772
37.
OlsonK.JacobsonK. K.Van OotP. (2013). Ecological validity of pediatric neuropsychological measures: Current state and future directions. Applied Neuropsychology: Child, 2, 17-23. doi:10.1080/21622965.2012.686330
38.
PayneJ. M.HymanS. L.ShoresE. A.NorthK. N. (2011). Assessment of executive function and attention in children with neurofibromatosis type 1: Relationships between cognitive measures and real-world behavior. Child Neuropsychology : A Journal on Normal and Abnormal Development in Childhood and Adolescence, 17, 313-329. doi:10.1080/09297049.2010.542746
39.
PnevmatikosD.TrikkaliotisI. (2013). Intraindividual differences in executive functions during childhood: The role of emotions. Journal of Experimental Child Psychology, 115, 245-261. doi:10.1016/j.jecp.2013.01.010
40.
PortneyL. G.WatkinsM. P. (2009). Foundations of clinical research: Applications to practice (3rd ed.). Philadelphia, PA: F. A. Davis.
41.
PritchardA. E.KalbackS.McCurdyM.CaponeG. T. (2015). Executive functions among youth with Down Syndrome and co-existing neurobehavioural disorders. Journal of Intellectual Disability Research : JIDR, 59(12), 1130-1141. Retrieved from https://doi.org/10.1111/jir.12217
42.
RosenblumS.FrischC.Deutsh-CastelT.JosmanN. (2015). Daily functioning profile of children with attention deficit hyperactive disorder: A pilot study using an ecological assessment. Neuropsychological Rehabilitation, 25(3), 402-418. Retrieved from https://doi.org/10.1080/09602011.2014.940980
43.
RosenthalM.WallaceG. L.LawsonR.WillsM. C.DixonE.YerysB. E.. . . KenworthyL. (2013). Impairments in real-world executive function increase from childhood to adolescence in autism spectrum disorders. Neuropsychology, 27(1), 13-18. Retrieved from https://doi.org/10.1037/a0031299
44.
RosettiM. F.UlloaR. E.Vargas-VargasI. L.Reyes-ZamoranoE.Palacios-CruzL.de la PeñaF.. . . HudsonR. (2016). Evaluation of children with ADHD on the Ball-Search Field Task. Scientific Reports, 6, 19664. Retrieved from https://doi.org/10.1038/srep19664
45.
RoyA.AllainP.RoulinJ.-L.FournetN.Le GallD. (2015). Ecological approach of executive functions using the Behavioural Assessment of the Dysexecutive Syndrome for Children (BADS-C): Developmental and validity study. Journal of Clinical and Experimental Neuropsychology, 37(9), 956-971. Retrieved from https://doi.org/10.1080/13803395.2015.1072138
46.
SiuA. F. Y.ZhouY. (2014). Behavioral Assessment of the Dysexecutive Syndrome for Children: An examination of clinical utility for children with attention-deficit hyperactivity disorder (ADHD). Journal of Child Neurology, 29(5), 608-616. Retrieved from https://doi.org/10.1177/0883073813516191
47.
SmithsonP. E.KenworthyL.WillsM. C.JarrettM.AtmoreK.YerysB. E. (2013). Real world executive control impairments in preschoolers with autism spectrum disorders. Journal of Autism and Developmental Disorders, 43(8), 1967-1975. Retrieved from https://doi.org/10.1007/s10803-012-1747-x
48.
SolantoM. V.AbikoffH.Sonuga-BarkeE.SchacharR.LoganG. D.WigalT.. . . TurkelE. (2001). The ecological validity of delay aversion and response inhibition as measures of impulsivity in AD/HD: A supplement to the NIMH multimodal treatment study of AD/HD. Journal of Abnormal Child Psychology, 29(3), 215-228. Retrieved from http://www.ncbi.nlm.nih.gov/pubmed/11411784
49.
TammL.BrennerS. B.BambergerM. E.BeckerS. P. (2016). Are sluggish cognitive tempo symptoms associated with executive functioning in preschoolers?Child Neuropsychology. Advance online publication. doi:10.1080/09297049.2016.1225707
50.
van den BerghS. F. W. M.ScheerenA. M.BegeerS.KootH. M.GeurtsH. M. (2014). Age related differences of executive functioning problems in everyday life of children and adolescents in the autism spectrum. Journal of Autism and Developmental Disorders, 44(8), 1959-1971. Retrieved from https://doi.org/10.1007/s10803-014-2071-4
51.
Van LiefferingeD.Sonuga-BarkeE.Van BroeckN.Van Der OordS.LemiereJ.DanckaertsM. (2016). A rating measure of ADHD-related neuropsychological impairment in children and adolescents: Data from the Cognition and Motivation in Everyday Life (CAMEL) Scale from population and clinical samples. Child Neuropsychology : A Journal on Normal and Abnormal Development in Childhood and Adolescence, 1-19. Retrieved from https://doi.org/10.1080/09297049.2016.1170798
52.
VriezenE. R.PigottS. E. (2002). The relationship between parental report on the BRIEF and performance-based measures of executive function in children with moderate to severe traumatic brain injury. Child Neuropsychology : A Journal on Normal and Abnormal Development in Childhood and Adolescence, 8, 296-303. doi:10.1076/chin.8.4.296.13505
53.
WehrleF. M.KaufmannL.BenzL. D.HuberR.O’GormanR. L.LatalB.. . . HagmannC. F. (2016). Very preterm adolescents show impaired performance with increasing demands in executive function tasks. Early Human Development, 92, 37-43. Retrieved from https://doi.org/10.1016/j.earlhumdev.2015.10.021
54.
WeisR.TottenS. J. (2004). Ecological validity of the Conners’ Continuous Performance Test II in a school-based sample. Journal of Psychoeducational Assessment, 22, 47-61. doi:10.1177/073428290402200104
55.
WhiteS. J.BurgessP. W.HillE. L. (2009). Impairments on “open-ended” executive function tests in autism. Autism Research: Official Journal of the International Society for Autism Research, 2(3), 138-147. Retrieved from https://doi.org/10.1002/aur.78
56.
WhittinghamK.BodimeadeH. L.LloydO.BoydR. N. (2014). Everyday psychological functioning in children with unilateral cerebral palsy: does executive functioning play a role?Developmental Medicine and Child Neurology, 56(6), 572-579. Retrieved from https://doi.org/10.1111/dmcn.12374
57.
WilliamsD. L.MazefskyC. A.WalkerJ. D.MinshewN. J.GoldsteinG. (2014). Associations between conceptual reasoning, problem solving, and adaptive ability in high-functioning autism. Journal of Autism and Developmental Disorders, 44(11), 2908-2920. Retrieved from https://doi.org/10.1007/s10803-014-2190-y
58.
WolfeK. R.WalshK. S.ReynoldsN. C.MitchellF.ReddyA. T.PaltinI.. . . Madan-SwainA. (2013). Executive functions and social skills in survivors of pediatric brain tumor. Child Neuropsychology: A Journal on Normal and Abnormal Development in Childhood and Adolescence, 19(4), 370-384. Retrieved from https://doi.org/10.1080/09297049.2012.669470
