The psychometric properties of the English-language NIH Toolbox for Assessment of Neurological and Behavioral Function (NIH Toolbox) have been examined in numerous populations. This study evaluated the reliability and validity of the Spanish-language NIH Toolbox. Participants were children aged 3 to 7 years and adults aged 18 to 85 years who took part in the NIH Toolbox norming study in Spanish. Results supported the internal consistency reliability of included measures. Test–retest reliability was strong for most tests, though it was weaker for the test of olfaction among children and the test of locomotion among adults. Spearman’s correlations and general linear models showed Spanish tests were often associated with age, sex, and education. Convergent validity for the two language measures that underwent more intensive development, evaluated via Spearman’s correlations with legacy measures, was strong. Results support using the Spanish-language NIH Toolbox to measure neurological and behavioral functioning among Spanish-speaking individuals in the United States.
AkshoomoffN.BeaumontJ. L.BauerP. J.DikmenS. S.GershonR. C.MungasD.SlotkinJ.TulskyD.WeintraubS.ZelazoP. D.HeatonR. K. (2013). VIII. NIH Toolbox Cognition Battery (CB): Composite scores of crystallized, fluid, and overall cognition. Monographs of the Society for Research in Child Development, 78(4), 119-132. https://doi.org/10.1111/mono.12038
2.
BabakhanyanI.McKennaB. S.CasalettoK. B.NowinskiC. J.HeatonR. K. (2018). National Institutes of Health Toolbox Emotion Battery for English- and Spanish-speaking adults: Normative data and factor-based summary scores. Patient Related Outcome Measures, 2018(9), 115-127. https://doi.org/10.2147/prom.S151658
3.
BauerP. J.ZelazoP. D. (2013). IX. NIH Toolbox Cognition Battery (CB): Summary, conclusions, and implications for cognitive development. Monographs of the Society for Research in Child Development, 78(4), 133-146. https://doi.org/10.1111/mono.12039
4.
BeaumontJ. L.HavlikR.CookK. F.HaysR. D.Wallner-AllenK.KorperS. P.LaiJ.-S.NordC.ZillN.ChoiS.YostK. J.UstsinovichV.BrouwersP.HoffmanH. J.GershonR. (2013). Norming plans for the NIH Toolbox. Neurology, 80(11Suppl. 3), S87-S92. https://doi.org/10.1212/WNL.0b013e3182872e70
5.
BohannonR. W.WangY. C. (2019). Four-meter gait speed: Normative values and reliability determined for adults participating in the NIH Toolbox study. Archives of Physical Medicine and Rehabilitation, 100(3), 509-513. https://doi.org/10.1016/j.apmr.2018.06.031
6.
BohannonR. W.WangY. C.BubelaD.GershonR. C. (2018). Normative two-minute walk test distances for boys and girls 3 to 17 years of age. Physical & Occupational Therapy in Pediatrics, 38(1), 39-45. https://doi.org/10.1080/01942638.2016.1261981
7.
BonomiA. E.CellaD. F.HahnE. A.BjordalK.Sperner-UnterwegerB.GangeriL.BergmanB.Willems-GrootJ.HanquetP.ZittounR. (1996). Multilingual translation of the Functional Assessment of Cancer Therapy (FACT) quality of life measurement system. Quality of Life Research, 5(3), 309-320. https://doi.org/10.1007/BF00433915
8.
BroderickJ. E.SchneiderS.JunghaenelD. U.SchwartzJ. E.StoneA. A. (2013). Validity and reliability of Patient-Reported Outcomes Measurement Information System instruments in osteoarthritis. Arthritis Care & Research, 65(10), 1625-1633. https://doi.org/10.1002/acr.22025
9.
ButzS. M.SweeneyJ. K.RobertsP. L.RauhM. J. (2015). Relationships among age, gender, anthropometric characteristics, and dynamic balance in children 5 to 12 years old. Pediatric Physical Therapy, 27(2), 126-133. https://doi.org/10.1097/PEP.0000000000000128
10.
CasalettoK. B.UmlaufA.MarquineM.BeaumontJ. L.MungasD.GershonR.SlotkinJ.AkshoomoffN.HeatonR. K. (2016). Demographically corrected normative standards for the Spanish language version of the NIH Toolbox Cognition Battery. Journal of the International Neuropsychological Society, 22(3), 364-374. https://doi.org/10.1017/s135561771500137x
11.
CellaD.HernandezL.BonomiA. E.CoronaM.VaqueroM.ShiomotoG.BaezL. (1998). Spanish language translation and initial validation of the Functional Assessment of Cancer Therapy quality-of-life instrument. Medical Care, 36(9), 1407-1418. https://doi.org/10.1097/00005650-199809000-00012
ColdwellS. E.MennellaJ. A.DuffyV. B.PelchatM. L.GriffithJ. W.SmutzerG.CowartB. J.BreslinP. A. S.BartoshukL. M.HastingsL.VictorsonD.HoffmanH. J. (2013). Gustation assessment using the NIH Toolbox. Neurology, 80(11Suppl. 3), S20-S24. https://doi.org/10.1212/WNL.0b013e3182872e38
14.
CookK. F.DunnW.GriffithJ. W.MorrisonM. T.TanquaryJ.SabataD.VictorsonD.CareyL. M.MacDermidJ. C.DudgeonB. J.GershonR. C. (2013). Pain assessment using the NIH Toolbox. Neurology, 80(11Suppl. 3), S49-S53. https://doi.org/10.1212/WNL.0b013e3182872e80
15.
DaltonP.DotyR. L.MurphyC.FrankR.HoffmanH. J.MauteC.KallenM. A.SlotkinJ. (2013). Olfactory assessment using the NIH Toolbox. Neurology, 80(11Suppl. 3), S32-S36. https://doi.org/10.1212/WNL.0b013e3182872eb4
16.
Del SerT.Gonzalez-MontalvoJ. I.Martinez-EspinosaS.Delgado-VillapalosC.BermejoF. (1997). Estimation of premorbid intelligence in Spanish people with the Word Accentuation Test and its application to the diagnosis of dementia. Brain and Cognition, 33(3), 343-356. https://doi.org/10.1006/brcg.1997.0877
17.
EremencoS. L.CellaD.ArnoldB. J. (2005). A comprehensive method for the translation and cross-cultural validation of health status questionnaires. Evaluation & the Health Professions, 28(2), 212-232. https://doi.org/10.1177/0163278705275342
18.
ErvinR. B.FryarC. D.WangC.-Y.MillerI. M.OgdenC. L. (2014). Strength and body weight in US children and adolescents. Pediatrics, 134(3), e782-e789. https://doi.org/10.1542/peds.2014-0794
19.
FriedmanD. S.O’ColmainB. J.MunozB.TomanyS. C.McCartyC.de JongP.NemesureB.MitchellP.KempenJ.CongdonN. (2004). Prevalence of age-related macular degeneration in the United States. Archives of Ophthalmology, 122(4), 564-572. https://doi.org/10.1001/archopht.122.4.564
20.
GershonR. C.FoxR. S.ManlyJ. J.MungasD. M.NowinskiC. J.RoneyE. M.SlotkinJ. (2020). The NIH Toolbox: Overview, development, and use with Hispanics. Journal of the International Neuropsychological Society, 26(6), 567. https://doi.org/10.1017/S1355617720000028
21.
GershonR. C.WagsterM. V.HendrieH. C.FoxN. A.CookK. F.NowinskiC. J. (2013). NIH Toolbox for assessment of neurological and behavioral function. Neurology, 80(11Suppl. 3), S2-S6. https://doi.org/10.1212/WNL.0b013e3182872e5f
22.
GibbonsW. J.FruchterN.SloanS.LevyR. D. (2001). Reference values for a multiple repetition 6-minute walk test in healthy adults older than 20 years. Journal of Cardiopulmonary Rehabilitation and Prevention, 21(2), 87-93. https://doi.org/10.1097/00008483-200103000-00005
23.
HeatonR. K.AkshoomoffN.TulskyD.MungasD.WeintraubS.DikmenS.Jennifer BeaumontJ.CasalettoK. B.ConwayK.SlotkinJ.GershonR. (2014). Reliability and validity of composite scores from the NIH Toolbox Cognition Battery in adults. Journal of the International Neuropsychological Society, 20(6), 588-598. https://doi.org/10.1017/s1355617714000241
24.
HumesK. R.JonesN. A.RamirezR. R. (2011). Overview of race and Hispanic origin: 2010. U.S. Census Bureau.
25.
JohannesC. B.LeT. K.ZhouX.JohnstonJ. A.DworkinR. H. (2010). The prevalence of chronic pain in United States adults: Results of an Internet-based survey. Journal of Pain, 11(11), 1230-1239. https://doi.org/10.1016/j.jpain.2010.07.002
26.
KalischT.KattenstrothJ.-C.NothS.TegenthoffM.DinseH. R. (2011). Rapid assessment of age-related differences in standing balance. Journal of Aging Research, 2011, Article 160490. https://doi.org/10.4061/2011/160490
27.
KanedaH.MaeshimaK.GotoN.KobayakawaT.Ayabe-KanamuraS.SaitoS. (2000). Decline in taste and odor discrimination abilities with age, and relationship between gustation and olfaction. Chemical Senses, 25(3), 331-337. https://doi.org/10.1093/chemse/25.3.331
28.
KruegerK. R.LamC. S.WilsonR. S. (2006). The Word Accentuation Test–Chicago. Journal of Clinical and Experimental Neuropsychology, 28(7), 1201-1207. https://doi.org/10.1080/13803390500346603
29.
LentL.HahnE.EremencoS.WebsterK.CellaD. (1999). Using cross-cultural input to adapt the Functional Assessment of Chronic Illness Therapy (FACIT) scales. Acta Oncologica, 38(6), 695-702. https://doi.org/10.1080/028418699432842
MojetJ.Christ-HazelhofE.HeidemaJ. (2001). Taste perception with age: Generic or specific losses in threshold sensitivity to the five basic tastes?Chemical Senses, 26(7), 845-860. https://doi.org/10.1093/chemse/26.7.845
32.
Muñoz-SandovalA. F.WoodcockR. W.McGrewK. S.MatherN. (2005). Batería III Woodcock-Muñoz. Riverside.
OmarM. T.AlghadirA. H.ZafarH.Al BakerS. (2018). Hand grip strength and dexterity function in children aged 6-12 years: A cross-sectional study. Journal of Hand Therapy, 31(1), 93-101. https://doi.org/10.1016/j.jht.2017.02.004
35.
PaolilloE. W.McKennaB. S.NowinskiC. J.ThomasM. L.MalcarneV. L.HeatonR. K. (2018). NIH Toolbox® emotion batteries for children: Factor-based composites and norms. Assessment, 27(3), 607-620. https://doi.org/10.1177/1073191118766396
RawalS.HoffmanH. J.HondaM.Huedo-MedinaT. B.DuffyV. B. (2015). The taste and smell protocol in the 2011–2014 US National Health and Nutrition Examination Survey (NHANES): Test–retest reliability and validity testing. Chemosensory Perception, 8(3), 138-148. https://doi.org/10.1007/s12078-015-9194-7
38.
ReubenD. B.MagasiS.McCreathH. E.BohannonR. W.WangY. C.BubelaD. J.RymerW. Z.BeaumontJ.RineR. M.LaiJ.-S.GershonR. C. (2013). Motor assessment using the NIH Toolbox. Neurology, 80(11Suppl. 3), S65-S75. https://doi.org/10.1212/WNL.0b013e3182872e01
39.
RineR. M.SchubertM. C.WhitneyS. L.RobertsD.RedfernM. S.MusolinoM. C.RocheJ. L.SteedD. P.CorbinB.LinC.-C.MarchettiG. F.BeaumontJ.CareyJ. P.ShepardN. P.JacobsonG. P.WrisleyD. M.HoffmanH. J.FurmanG.SlotkinJ. (2013). Vestibular function assessment using the NIH Toolbox. Neurology, 80(11Suppl. 3), S25-S31. https://doi.org/10.1212/WNL.0b013e3182872c6a
40.
RuffR. M.ParkerS. B. (1993). Gender-and age-specific changes in motor speed and eye-hand coordination in adults: Normative values for the Finger Tapping and Grooved Pegboard Tests. Perceptual and Motor Skills, 76(3 Suppl.), 1219-1230. https://doi.org/10.2466/pms.1993.76.3c.1219
SalsmanJ. M.ButtZ.PilkonisP. A.CyranowskiJ. M.ZillN.HendrieH. C.KupstM. J.KellyM. A. R.BodeR. K.ChoiS. W.LaiJ.-S.GriffithJ. W.StoneyC. M.BrouwersP.KnoxS. S.CellaD. (2013). Emotion assessment using the NIH Toolbox. Neurology, 80(11Suppl. 3), S76-86. https://doi.org/10.1212/WNL.0b013e3182872e11
43.
SinhaP.WongA. W. K.KallogjeriD.PiccirilloJ. F. (2018). Baseline cognition assessment among patients with oropharyngeal cancer using PROMIS and NIH Toolbox. JAMA Otolaryngology—Head & Neck Surgery, 144(11), 978-987. https://doi.org/10.1001/jamaoto.2018.0283
44.
Troller-RenfreeS. V.BarkerT. V.PineD. S.FoxN. A. (2015). Cognitive functioning in socially anxious adults: Insights from the NIH Toolbox Cognition Battery. Frontiers in Psychology, 6, Article 764. https://doi.org/10.3389/fpsyg.2015.00764
45.
TulskyD. S.HeinemannA. W. (2017). The clinical utility and construct validity of the NIH Toolbox Cognition Battery (NIHTB-CB) in individuals with disabilities. Rehabilitation Psychology, 62(4), 409-412. https://doi.org/10.1037/rep0000201
VarmaR.McKean-CowdinR.VitaleS.SlotkinJ.HaysR. D. (2013). Vision assessment using the NIH Toolbox. Neurology, 80(11Suppl. 3), S37-S40. https://doi.org/10.1212/WNL.0b013e3182876e0a
49.
WeintraubS.DikmenS. S.HeatonR. K.TulskyD. S.ZelazoP. D.BauerP. J.CarlozziN. E.lotkinJ.BlitzD.Wallner-AllenK.FoxN. A.BeaumontJ. L.MungasD.NowinskiC. J.RichlerJ.DeocampoJ. A.AndersonJ. E.ManlyJ. J.BoroshB.. . . GershonR. C. (2013). Cognition assessment using the NIH Toolbox. Neurology, 80(11Suppl. 3), S54-S64. https://doi.org/10.1212/WNL.0b013e3182872ded
50.
WilsonR. H. (2011). Clinical experience with the words-in-noise test on 3430 veterans: Comparisons with pure-tone thresholds and word recognition in quiet. Journal of the American Academy of Audiology, 22(7), 405-423. https://doi.org/10.3766/jaaa.22.7.3
51.
WilsonR. H.BurksC. A. (2005). Use of 35 words for evaluation of hearing loss in signal-to-babble ratio: A clinic protocol. Journal of Rehabilitation Research and Development, 42(6), 839-852. https://doi.org/10.1682/JRRD.2005.01.0009
52.
WolfsonL.WhippleR.DerbyC. A.AmermanP.NashnerL. (1994). Gender differences in the balance of healthy elderly as demonstrated by dynamic posturography. Journal of Gerontology, 49(4), M160-M167. https://doi.org/10.1093/geronj/49.4.M160
53.
WoodcockR. W.McGrewK. S.MatherN. (2001). Woodcock-Johnson III. Riverside.
54.
YorkeA. M.CurtisA. B.ShoemakerM.VangsnesE. (2015). Grip strength values stratified by age, gender, and chronic disease status in adults aged 50 years and older. Journal of Geriatric Physical Therapy, 38(3), 115-121. https://doi.org/10.1519/jpt.0000000000000037
55.
ZeckerS. G.HoffmanH. J.FrisinaR.DubnoJ. R.DharS.WallhagenM.KrausN.GriffithJ. W.WaltonJ. P.EddinsD. A.NewmanC.VictorsonD.WarrierC. M.WilsonR. H. (2013). Audition assessment using the NIH Toolbox. Neurology, 80(11Suppl. 3), S45-S48. https://doi.org/10.1212/WNL.0b013e3182872dd2
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
