Executive functions (EFs) are essential for daily living activities but decline with age. Convenient assessment and timely intervention have particular significance for older adults. However, the traditional laboratory tasks of EFs are typically monotonous and inconvenient. The current study aimed to develop an interesting and convenient supplementary tool to assess EFs for older adults. According to the theory of EFs, we developed a serious game, FISHERMAN, to assess EFs. The game includes three subgames, Cautious Fisherman, Agile Fisherman, and Wise Fisherman, targeting core components of inhibition, shifting, and working memory, respectively. The current study aims to verify the reliability and validity of the game. One hundred and eight healthy older adults participated in this study and were tested through the FISHERMAN game and a battery of cognitive tests. The results show that the FISHERMAN game has high internal consistency reliability and good construct validity as well as criterion-related validity, suggesting that the game design is valid and can be used in EFs assessment for older adults. Future studies are warranted to establish the norm of the FISHERMAN game in older adults and investigate whether the FISHERMAN game can be generalized to other populations.
AalbersT.BaarsM. A. E.RikkertM. G. M. O.KesselsR. P. C. (2013). Puzzling with online games (BAM-COG): Reliability, validity, and feasibility of an online self-monitor for cognitive performance in aging adults. Journal of Medical Internet Research, 15(12), Article e270. https://doi.org/10.2196/jmir.2860
2.
AndersonP. (2002). Assessment and development of executive function (EF) during childhood. Child Neuropsychology, 8(2), 71–82. https://doi.org/10.1076/chin.8.2.71.8724
3.
AndreasenN. C.OlearyD. S.CizadloT.ArndtS.RezaiK.WatkinsG. L.. . . HichwaR. D. (1995). II. PET studies of memory: Novel versus practiced free recall of word lists. Neuroimage, 2(4), 296–305. https://doi.org/10.1006/nimg.1995.1037
4.
AngueraJ. A.BoccanfusoJ.RintoulJ. L.Al-HashimiO.FarajiF.JanowichJ.. . . GazzaleyA. (2013). Video game training enhances cognitive control in older adults. Nature, 501(7465), 97–101. https://doi.org/10.1038/nature12486
5.
ArmitageS. G. (1946). An analysis of certain psychological tests used for the evaluation of brain injury. Psychological Monographs, 60(1), 1–48. https://doi.org/10.1037/h0093567
6.
AtkinsS. M.SprengerA. M.ColfleshG. J.BrinerT. L.BuchananJ. B.ChavisS. E.. . . DoughertyM. R. (2014). Measuring working memory is all fun and games: A four-dimensional spatial game predicts cognitive task performance. Experimental Psychology, 61(6), 417–438. https://doi.org/10.1027/1618-3169/a000262
7.
AuJ.SheehanE.TsaiN.DuncanG. J.BuschkuehlM.JaeggiS. M. (2015). Improving fluid intelligence with training on working memory: A meta-analysis. Psychonomicbulletin & Review, 22(2), 366–377. https://doi.org/10.3758/s13423-014-0699-x
BaggettaP.AlexanderP. A. (2016). Conceptualization and operationalization of executive function. Mind, Brain, and Education, 10(1), 10–33. https://doi.org/10.1111/mbe.12100
11.
BarkleyR. A. (2012). Executive functions: What they are, how they work, and why they evolved. Guilford Press.
12.
BoendermakerW. J.BoffoM.WiersR. W. (2015). Exploring elements of fun to motivate youth to do cognitive bias modification. Games for Health Journal, 4(6), 434–443. https://doi.org/10.1089/g4h.2015.0053
13.
ByrneB. M.ShavelsonR. J.MuthénB. (1989). Testing for the equivalence of factor covariance and mean structures: The issue of partial measurement invariance. Psychological Bulletin, 105(3), 456–466. https://doi.org/10.1037/0033-2909.105.3.456
ChristB. U.CombrinckM. I.ThomasK. G. F. (2018). Both reaction time and accuracy measures of intraindividual variability predict cognitive performance in Alzheimer’s disease. Frontiers in Human Neuroscience, 12, Article 124. https://doi.org/10.3389/fnhum.2018.00124
16.
ClarkL. R.SchiehserD. M.WeissbergerG. H.SalmonD. P.DelisD. C.BondiM. W. (2012). Specific measures of executive function predict cognitive decline in older adults. Journal of the International Neuropsychological Society, 18(1), 118–127. https://doi.org/10.1017/s1355617711001524
17.
DavidsonM. C.AmsoD.AndersonL. C.DiamondA. (2006). Development of cognitive control and executive functions from 4 to 13 years: Evidence from manipulations of memory, inhibition, and task switching. Neuropsychologia, 44(11), 2037–2078. https://doi.org/10.1016/j.neuropsychologia.2006.02.006
18.
De Luca CinziaR.Leventer RichardJ. (2008). Developmental trajectories of executive functions across the lifespan. In AndersonP.AndersonV.JacobsR. (Eds.), Executive functions and the frontal lobes: A lifespan pperspective (pp. 24–47). Taylor & Francis.
19.
DeRightJ.JorgensenR. S. (2015). I just want my research credit: Frequency of suboptimal effort in a non-clinical healthy undergraduate sample. The Clinical Neuropsychologist, 29(1), 101–117. https://doi.org/10.1080/13854046.2014.989267
DietrichJ. F.HuberS.KleinE.WillmesK.PixnerS.MoellerK. (2016). A systematic investigation of accuracy and response time based measures used to index ANS acuity. PLOS ONE, 11(9), Article e0163076. https://doi.org/10.1371/journal.pone.01630
22.
DovisS.Van der OordS.WiersR. W.PrinsP. J. M. (2015). Improving executive functioning in children with ADHD: Training multiple executive functions within the context of a computer game. A randomized double-blind placebo controlled trial. PLOS ONE, 10(4), Article e0121651. https://doi.org/10.1371/journal.pone.0121651
23.
DziubanC. D.ShirkeyE. C. (1974). What is correlation matrix appropriate for factor analysis: Decision rules. Psychological Bulletin, 81(6), 358–361. https://doi.org/10.1037/h0036316
24.
EvansK. L.HampsonE. (2015). Sex-dependent effects on tasks assessing reinforcement learning and interference inhibition. Frontiers in Psychology, 6, Article 1044. https://doi.org/10.3389/fpsyg.2015.01044
25.
FaulF.ErdfelderE.LangA.-G.BuchnerA. (2007). G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behavior Research Methods, 39(2), 175–191. https://doi.org/10.3758/bf03193146
26.
FergusonH. J.BrunsdonV. E. A.BradfordE. E. F. (2021). The developmental trajectories of executive function from adolescence to old age. Scientific Reports, 11(1), Article 1382. https://doi.org/10.1038/s41598-020-80866-1
27.
FisslerP.KuesterO.SchleeW.KolassaI.-T. (2013). Novelty interventions to enhance broad cognitive abilities and prevent dementia: Synergistic approaches for the facilitation of positive plastic change. In MerzenichM. M.NahumM.VanVleetT. M. (Eds.), Changing brains applying brain plasticity to advance and recover human ability (vol. 207, pp. 403–434). Elsevier.
28.
FlemingT. M.BavinL.StasiakK.Hermansson-WebbE.MerryS. N.CheekC.. . . HetrickS. (2017). Serious games and gamification for mental health: Current status and promising directions. Frontiers in Psychiatry, 7, Article 215. https://doi.org/10.3389/fpsyt.2016.00215
29.
FriehsM. A.DechantM.VedressS.FringsC.MandrykR. L. (2020). Effective gamification of the stop-signal task: Two controlled laboratory experiments. JMIR Serious Games, 8(4), 257–277. https://doi.org/10.2196/17810
30.
GerlingK. M.SchulteF. P.SmeddinckJ.MasuchM. (2012). Game design for older adults: Effects of age-related changes on structural elements of digital games. In HerrlichM.MalakaR.MasuchM. (Eds.), Entertainment computing—International Conference on Entertainment Computing, 2012 (pp. 235–242). Springer. https://doi.org/10.1007/978-3-642-33542-6_20
31.
GreenbergL. M.WaldmanI. D. (1993). Developmental normative data on the test of variables of attention (T.O.V.A.). Journal of Child Psychology and Psychiatry, and Allied Disciplines, 34(6), 1019–1030. https://doi.org/10.1111/j.1469-7610.1993.tb01105.x
32.
HaagsmaM. C.PieterseM. E.PetersO. (2012). The prevalence of problematic video gamers in the Netherlands. Cyberpsychology, Behavior, and Social Networking, 15(3), 162–168. https://doi.org/10.1089/cyber.2011.0248
33.
HartshorneJ. K.GermineL. T. (2015). When does cognitive functioning peak? The asynchronous rise and fall of different cognitive abilities across the life span. Psychological Science, 26(4), 433–443. https://doi.org/10.1177/0956797614567339
HuL.BentlerP. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6(1), 1–55. https://doi.org/10.1080/10705519909540118
KarrJ. E.AreshenkoffC. N.RastP.HoferS. M.IversonG. L.Garcia-BarreraM. A. (2018). The unity and diversity of executive functions: A systematic review and re-analysis of latent variable studies. Psychological Bulletin, 144(11), 1147–1185.
38.
KaufmanD.SuaveL.IrelandA. (2020). Playful aging: Digital games for older adults. Age Well.
39.
KesselsR. P. C. (2019). Improving precision in neuropsychological assessment: Bridging the gap between classic paper-and-pencil tests and paradigms from cognitive neuroscience. The Clinical Neuropsychologist, 33, 257–368. https://doi.org/10.1080/13854046.2018.1518
40.
KesselsR. P. C.van ZandvoortM. J.PostmaA.KappelleL. J.de HaanE. H. (2000). The Corsi Block-Tapping Task: Standardization and normative data. Applied Neuropsychology, 7(4), 252–258. https://doi.org/10.1207/s15324826an0704_8
41.
KooT. K.LiM. Y. (2016). A guideline of selecting and reporting intraclass correlation coefficients for reliability research. Journal of Chiropractic Medicine, 15(2), 155–163. https://doi.org/10.1016/j.jcm.2016.02.012
42.
LanceC. E.ButtsM. M.MichelsL. C. (2006). The sources of four commonly reported cutoff criteria—What did they really say?Organizational Research Methods, 9(2), 202–220. https://doi.org/10.1177/1094428105284919
43.
LezakM. D. (1995). Neuropsychological assessment. Oxford University Press.
44.
LiebelS. W.JonesE. C.OshriA.HallowellE. S.JerskeyB. A.GunstadJ.SweetL. H. (2017). Cognitive processing speed mediates the effects of cardiovascular disease on executive functioning. Neuropsychology, 31(1), 44–51. https://doi.org/10.1037/neu0000324
45.
LoganG. D.CowanW. B. (1984). On the ability to inhibit thought and action: A theory of an act of control. Psychological Review, 91(3), 295–327. https://doi.org/10.1037/0033-295x.91.3.295
46.
LumsdenJ.EdwardsE. A.LawrenceN. S.CoyleD.MunafoM. R. (2016a). Gamification of cognitive assessment and cognitive training: A systematic review of applications and efficacy. JMIR Serious Games, 4(2), Article e11. https://doi.org/10.2196/games.5888
47.
LumsdenJ.SkinnerA.WoodsA. T.LawrenceN. S.MunafòM. (2016b). The effects of gamelike features and test location on cognitive test performance and participant enjoyment. PeerJ, 4(3), Article e2184. https://doi.org/10.7717/peerj.2184
48.
LustigC.ShahP.SeidlerR.Reuter-LorenzP. A. (2009). Aging, training, and the brain: A review and future directions. Neuropsychology Review, 19(4), 504–522. https://doi.org/10.1007/s11065-009-9119-9
49.
LyonsI. M.PriceG. R.VaessenA.BlomertL.AnsariD. (2014). Numerical predictors of arithmetic success in grades 1-6. Developmental Science, 17(5), 714–726. https://doi.org/10.1111/desc.12152
50.
MagnusB. E.WilloughbyM. T.BlairC. B.KuhnL. J. (2017). Integrating item accuracy and reaction time to improve the measurement of inhibitory control abilities in early childhood. Assessment, 26(7), 1296–1306. https://doi.org/10.1177/1073191117740953
51.
ManeraV.PetitP. D.DerreumauxA.OrvietoI.RobertP. H. (2015). “Kitchen and cooking,” a serious game for mild cognitive impairment and Alzheimer’s disease: A pilot study. Frontiers in Aging Neuroscience, 7, Article 24. https://doi.org/10.3389/fnagi.2015.00024
52.
MarshH. W.DowsonM.PietschJ.WalkerR. (2004). Why multicollinearity matters: A reexamination of relations between self-efficacy, self-concept, and achievement. Journal of Educational Psychology, 96(3), 518–522. https://doi.org/10.1037/0022-0663.96.3.518
53.
McAlisterC.Schmitter-EdgecombeM. (2016). Executive function subcomponents and their relations to everyday functioning in healthy older adults. Journal of Clinical and Experimental Neuropsychology, 38(8), 925–940. https://doi.org/10.1080/13803395.2016.1177490
54.
McPhersonJ.BurnsN. R. (2008). Assessing the validity of computer-game-like tests of processing speed and working memory. Behavior Research Methods, 40(4), 969–981. https://doi.org/10.3758/brm.40.4.969
55.
MirandaA. T.PalmerE. M. (2013). Intrinsic motivation and attentional capture from gamelike features in a visual search task. Behavior Research Methods, 46(1), 159–172. https://doi.org/10.3758/s13428-013-0357-7
56.
MiyakeA.FriedmanN. P. (2012). The nature and organization of individual differences in executive functions. Current Directions in Psychological Science, 21(1), 8–14. https://doi.org/10.1177/0963721411429458
57.
MiyakeA.FriedmanN. P.EmersonM. J.WitzkiA. H.HowerterA.WagerT. D. (2000). The unity and diversity of executive functions and their contributions to complex “frontal lobe” tasks: A latent variable analysis. Cognitive Psychology, 41(1), 49–100. https://doi.org/10.1006/cogp.1999.0734
58.
MorsanyiK.O’MahonyE.McCormackT. (2017). Number comparison and number ordering as predictors of arithmetic performance in adults: Exploring the link between the two skills, and investigating the question of domain-specificity. Quarterly Journal of Experimental Psychology, 70(12), 2497–2517. https://doi.org/10.1080/17470218.2016.1246
59.
MurreJ. M. J.JanssenS. M. J.RouwR.MeeterM. (2013). The rise and fall of immediate and delayed memory for verbal and visuospatial information from late childhood to late adulthood. Acta Psychologica, 142(1), 96–107. https://doi.org/10.1016/j.actpsy.2012.10.0
60.
MvududuN. H.SinkC. A. (2013). Factor analysis in counseling research and practice. Counseling Outcome Research and Evaluation, 4(2), 75–98. https://doi.org/10.1177/2150137813494766
61.
NguyenC. M.CopelandC. T.LoweD. A.HeyankaD. J.LinckJ. F. (2020). Contribution of executive functioning to instrumental activities of daily living in older adults. Applied Neuropsychology-Adult, 27(4), 326–333. https://doi.org/10.1080/23279095.2018.1550408
62.
NormanD. A.ShalliceT. (1986). Attention to action: Willed and automatic control of behaviour. In DavidsonR. J.SchwartzG. E.ShapiroD. (Eds.), Consciousness and self-regulation (pp. 1–14). Plenum Press.
Reuter-LorenzP. A.CookeK. A. (2016). Neuropsychology of aging, past, present and future: Contributions of Morris Moscovitch. Neuropsychologia, 90, 117–124. https://doi.org/10.1016/j.neuropsychologia
65.
Rosado-ArtalejoC.CarniceroJ. A.Losa-ReynaJ.CastilloC.Cobos-AntoranzB.Alfaro-AchaA.. . . Garcia-GarciaF. J. (2017). Global performance of executive function is predictor of risk of frailty and disability in older adults. The Journal of Nutrition Health and Aging, 21(9), 980–987. https://doi.org/10.1007/s12603-017-0895-2
66.
SalmonJ. P.DolanS. M.DrakeR. S.WilsonG. C.KleinR. M.EskesG. A. (2017). A survey of video game preferences in adults: Building better games for older adults. Entertainment Computing, 21, 45–64. https://doi.org/10.1016/j.entcom.2017.04.006
67.
SchmittL. M.AnkenyL. D.SweeneyJ. A.MosconiM. W. (2016). Inhibitory control processes and the strategies that support them during hand and eye movements. Frontiers in Psychology, 7, Article 1927. https://doi.org/10.3389/fpsyg.2016.01927
68.
SchuchS.KochI. (2003). The role of response selection for inhibition of task sets in task shifting. Journal of Experimental Psychology-Human Perception and Performance, 29(1), 92–105. https://doi.org/10.1037/0096-1523.29.1.92
69.
SiegelA.EichT. S. (2021). Age, sex, and inhibitory control: Identifying a specific impairment in memorial, but not perceptual, inhibition in older women. The Journals of Gerontology: Series B, 76(10), 2013–2022. https://doi.org/10.1093/geronb/gbab124
70.
ThuaireF.RondepierreF.ValletG. T.JalenquesI.IzauteM. (2020). Executive deficits in schizophrenia: Mediation by processing speed and its relationships with aging. Psychological Medicine, 52(6), 1126–1134. https://doi.org/10.1017/s0033291720002871
71.
TongT.ChignellM. (2014, April). Developing a serious game for cognitive assessment. In Proceedings of the Second International Symposium of Chinese CHI on—Chinese CHI,’ 14 (pp. 70–79). https://doi.org/10.1145/2592235.2592246
72.
TongT.ChignellM.DeGuzmanC. A. (2019). Using a serious game to measure executive functioning: Response inhibition ability. Applied Neuropsychology-Adult, 28(6), 673–684. https://doi.org/10.1080/23279095.2019.1683561
73.
TongT.ChignellM.TierneyM. C.LeeJ. (2016). A serious game for clinical assessment of cognitive status: Validation study. JMIR Serious Games, 4(1), Article e7. https://doi.org/10.2196/games.5006
74.
VallejoV.WyssP.CheshamA.MitacheA. V.MueriR. M.MosimannU. P.NefT. (2017). Evaluation of a new serious game based multitasking assessment tool for cognition and activities of daily living: Comparison with a real cooking task. Computers in Human Behavior, 70, 500–506. https://doi.org/10.1016/j.chb.2017.01.021
75.
van de WeijerS. C. F.KuijfM. L.de VriesN. M.BloemB. R.DuitsA. A. (2019). Do-it-yourself gamified cognitive training: Viewpoint. JMIR Serious Games, 7(2), Article e12130. https://doi.org/10.2196/12130
76.
VermeirJ. F.WhiteM. J.JohnsonD.CrombezG.Van RyckeghemD. M. L. (2020). The effects of gamification on computerized cognitive training: Systematic review and meta-analysis. JMIR Serious Games, 8(3), Article e18644. https://doi.org/10.2196/18644
77.
WechslerD. (1981). Wechsler Adult Intelligence Scales—Revised. The Psychological Corporation.
78.
WiemeyerJ.KliemA. (2012). Serious games in prevention and rehabilitation-a new panacea for elderly people?European Review of Aging and Physical Activity, 9(1), 41–50. https://doi.org/10.1007/s11556-011-0093-x
79.
WilckensK. A.HallM. H.EricksonK. I.GermainA.NimgaonkarV. L.MonkT. H.BuysseD. J. (2017). Task switching in older adults with and without insomnia. Sleep Medicine, 30, 113–120. https://doi.org/10.1016/j.sleep.2016.09.002
80.
WildK.HowiesonD.WebbeF.SeelyeA.KayeJ. (2008). Status of computerized cognitive testing in aging: A systematic review. Alzheimer’s & Dementia, 46(6), 428–437. https://doi.org/10.1016/j.jalz.2008.07.003
81.
WileyK.VedressS.MandrykR. L. (2020). How points and theme affect performance and experience in a gamified cognitive task. In Proceedings of the 2020 CHI conference on human factors in computing systems (pp. 1–15). https://doi.org/10.1145/3313831.3376697
82.
WylieG.AllportA. (2000). Task switching and the measurement of “switch costs.”Psychological Research, 63(3–4), 212–233. https://doi.org/10.1007/s004269900003
83.
ZelazoP. D.AndersonJ. E.RichlerJ.Wallner-AllenK.BeaumontJ. L.ConwayK. P.GershonR.WeintraubS. (2014). NIH Toolbox Cognition Battery (CB): Validation of executive function measures in adults. Journal of the International Neuropsychological Society, 20(06), 620–629. https://doi.org/10.1017/s1355617714000472
84.
ZelazoP. D.CarterA.ReznickJ. S.FryeD. (1997). Early development of executive function: A problem-solving framework. Review of General Psychology, 1(2), 198–226. https://doi.org/10.1037/1089-2680.1.2.198
85.
ZelazoP. D.MüllerU.FryeD.MarcovitchS.ArgitisG.BoseovskiJ.ChiangJ. K.HongwanishkulD.SchusterB. V.SutherlandA. (2003). The development of executive function in early childhood. Monographs of the Society for Research in Child Development, 68(3), vii–137. https://doi.org/10.1111/j.1540-5834.2003.06803001.x
