The U.S. Department of Agriculture Final Rule on School Wellness Policy requires schools to self-evaluate wellness policies and environments. To understand the utility of this information, this study evaluates the validity of school-reported wellness information against directly observed data. Wellness leaders at 10 Midwestern elementary schools completed a questionnaire spanning nine school wellness settings. School-reported information was compared against a direct observation protocol. Percent agreement and κ statistics were used to assess agreement between school reporters and direct observation. Overall percent agreement between reporters and direct observation was 77.1%. Agreement ranged from 67.3% (Lunchroom Environment) to 92.0% (School Wellness Policies) across the nine categories. κ results showed that 65.7% of the items demonstrated fair or better reporter agreement. The results provide preliminary support for the utility of schools’ self-reported wellness information. Facilitation of independent reporting on wellness environments by school leaders will contribute to broader applications for school wellness programming.
AlaimoK.OleksykS. C.DrzalN. B.GolzynskiD. L.LucarelliJ. F.WenY.VelieE. M. (2013). Effects of changes in lunch-time competitive foods, nutrition practices, and nutrition policies on low-income middle-school children’s diets. Childhood Obesity (Print), 9(6), 509–523. https://doi.org/10.1089/chi.2013.0052
2.
AlaimoK.OleksykS. C.GolzynskiD.DrzalN.LucarelliJ.ReznarM.WenY.Krabill YoderK. (2015). The Michigan healthy school action tools process generates improvements in school nutrition policies and practices, and student dietary intake. Health Promotion Practice, 16(3), 401–410. https://doi.org/10.1177/1524839915573923
3.
BanfieldE. C.LiuY.DavisJ. S.ChangS.Frazier-WoodA. C. (2016). Poor adherence to US dietary guidelines for children and adolescents in the national health and nutrition examination survey population. Journal of the Academy of Nutrition and Dietetics, 116(1), 21–27. https://doi.org/10.1016/j.jand.2015.08.010
4.
BlaineR. E.FranckleR. L.GanterC.FalbeJ.GilesC.CrissS.KwassJ.-A.LandT.GortmakerS. L.ChuangE.DavisonK. K. (2017). Using school staff members to implement a childhood obesity prevention intervention in low-income school districts: The Massachusetts childhood obesity research demonstration (MA-CORD Project), 2012–2014. Preventing Chronic Disease, 14(E03). https://doi.org/10.5888/pcd14.160381
5.
BuscemiJ.KongA.FitzgibbonM. L.BustamanteE. E.DavisC. L.PateR. R.WilsonD. K. (2014). Society of behavioral medicine position statement: Elementary school-based physical activity supports academic achievement. Translational Behavioral Medicine, 4(4), 436–438. https://doi.org/10.1007/s13142-014-0279-7
ChenS.DzewaltowskiD. A.RosenkranzR. R.Lanningham-FosterL.VazouS.GentileD. A.LeeJ. A.BraunK. J.WolffM. M.WelkG. J. (2018). Feasibility study of the SWITCH implementation process for enhancing school wellness. BMC Public Health, 18(1), 1119. https://doi.org/10.1186/s12889-018-6024-2
8.
Council on School Health. (2016). Role of the school nurse in providing school health services. Pediatrics, 137(6), 269–274. https://doi.org/10.1542/peds.2016-0852
9.
CunninghamM. (2009). More than just the Kappa coefficient: A program to fully characterize inter-rater reliability between two raters. SAS Global Forum (Paper No. 242–2009). 1–7. SAS Institute Inc. http://support.sas.com/resources/papers/proceedings09/242-2009.pdf
10.
CyganH.TribbiaC.TullyJ. (2019). School health policy implementation: Facilitators and challenges. The Journal of School Nursing. https://doi.org/10.1177/1059840519846089
11.
FakhouriT. H. I.HughesJ. P.BrodyD. J.KitB. K.OgdenC. L. (2013). Physical activity and screen-time viewing among elementary school-aged children in the United States from 2009 to 2010. JAMA Pediatrics, 167(3), 223–229. https://doi.org/10.1001/2013.jamapediatrics.122
12.
FaulknerG.ZeglenL.LeatherdaleS.ManskeS.StoneM. (2014). The relationship between school physical activity policy and objectively measured physical activity of elementary school students: A multilevel model analysis. Archives of Public Health, 72(1), 20. https://doi.org/10.1186/2049-3258-72-20
13.
HillsA. P.DengelD. R.LubansD. R. (2015). Supporting public health priorities: Recommendations for physical education and physical activity promotion in schools. Progress in Cardiovascular Diseases, 57(4), 368–374. https://doi.org/10.1016/j.pcad.2014.09.010
14.
IpP.HoF. K.-W.LouieL. H.-T.ChungT. W.-H.CheungY.-F.LeeS.-L.HuiS. S.-C.HoW. K.-Y.HoD. S.-Y.WongW. H.-S.JiangF. (2017). Childhood obesity and physical activity-friendly school environments. The Journal of Pediatrics, 191, 110–116. https://doi.org/10.1016/j.jpeds.2017.08.017
15.
JonesN. R.JonesA.van SluijsE. M.PanterJ.HarrisonF.GriffinS. J. (2010). School environments and physical activity: The development and testing of an audit tool. Health & Place, 16(5), 776–783. https://doi.org/10.1016/j.healthplace.2010.04.002
16.
KenneyE. L.RedmanM. T.CrissS.SonnevilleK. R.AustinS. B. (2017). Are K-12 school environments harming students with obesity? A qualitative study of classroom teachers. Eating and Weight Disorders: EWD, 22(1), 141–152. https://doi.org/10.1007/s40519-016-0268-6
17.
LandisJ. R.KochG. G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33(1), 159–174.
18.
Lanningham-FosterL.FosterR. C.McCradyS. K.ManoharC.JensenT. B.MitreN. G.HillJ. O.LevineJ. A. (2008). Changing the school environment to increase physical activity in children. Obesity (Silver Spring, Md.), 16(8), 1849–1853. https://doi.org/10.1038/oby.2008.282
19.
LarsenK.GillilandJ.HessP.TuckerP.IrwinJ.HeM. (2009). The influence of the physical environment and sociodemographic characteristics on children’s mode of travel to and from school. American Journal of Public Health, 99(3), 520–526. https://doi.org/10.2105/AJPH.2008.135319
20.
LucarelliJ. F.AlaimoK.BelanskyE. S.MangE.MilesR.KelleherD. K.BaileyD.DrzalN. B.LiuH. (2015). Little association between wellness policies and school-reported nutrition practices. Health Promotion Practice, 16(2), 193–201. https://doi.org/10.1177/1524839914550245
21.
MerloC. L.OlsenE. O.GalicM.BrenerN. D. (2014). The relationship between state policies for competitive foods and school nutrition practices in the United States. Preventing Chronic Disease, 11, E66. https://doi.org/10.5888/pcd11.130216
22.
MortonK. L.AtkinA. J.CorderK.SuhrckeM.van SluijsE. M. F. (2016). The school environment and adolescent physical activity and sedentary behaviour: A mixed-studies systematic review. Obesity Reviews, 17(2), 142–158. https://doi.org/10.1111/obr.12352
23.
NathanN.WolfendenL.MorganP. J.BellA. C.BarkerD.WiggersJ. (2013). Validity of a self-report survey tool measuring the nutrition and physical activity environment of primary schools. The International Journal of Behavioral Nutrition and Physical Activity, 10, 75. https://doi.org/10.1186/1479-5868-10-75
24.
NielsenS. J.RossenL. M.HarrisD. M.OdgenC. L. (2014). Fruit and vegetable consumption of U.S. Youth, 2009–2010. NCHS Data Brief, 156, 1–8.
25.
OgdenC. L.CarrollM. D.KitB. K.FlegalK. M. (2012). Prevalence of obesity and trends in body mass index among US children and adolescents, 1999–2010. JAMA: The Journal of the American Medical Association, 307(5), 483–490. https://doi.org/10.1001/jama.2012.40
26.
OgdenC. L.CarrollM. D.KitB. K.FlegalK. M. (2014). Prevalence of childhood and adult obesity in the United States, 2011–2012. JAMA, 311(8), 806–814. https://doi.org/10.1001/jama.2014.732
27.
PikoraT. J.BullF. C. L.JamrozikK.KnuimanM.Giles-CortiB.DonovanR. J. (2002). Developing a reliable audit instrument to measure the physical environment for physical activity. American Journal of Preventive Medicine, 23(3), 187–194. https://doi.org/10.1016/S0749-3797(02)00498-1
28.
PittmanA. F. (2018). Effect of a school-based activity tracker, companion social website, and text messaging intervention on exercise, fitness, and physical activity self-efficacy of middle school students. The Journal of School Nursing. https://doi.org/10.1177/1059840518791223
VineM. M.HarringtonD. W.ButlerA.PatteK.GodinK.LeatherdaleS. T. (2017). Compliance with school nutrition policies in Ontario and Alberta: An assessment of secondary school vending machine data from the COMPASS study. Canadian Journal of Public Health = Revue Canadienne De Sante Publique, 108(1), e43–e48.
WebsterC. A.BeetsM.WeaverR. G.VazouS.RussL. (2015). Rethinking recommendations for implementing comprehensive school physical activity programs: A partnership model. Quest, 67(2), 185–202. https://doi.org/10.1080/00336297.2015.1017588
33.
WoodJ.HugginsA.ClausenL.LailariS. (2019). Finding fit: School nurses lead the way in the development of employee wellness program. NASN School Nurse, 34(4), 205–209. https://doi.org/10.1177/1942602X18811550
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
