Intraclass Correlation Coefficients for Obesity Indicators and Energy Balance–Related Behaviors Among New York City Public Elementary Schools

Abstract

Objective. Sample size and statistical power calculation should consider clustering effects when schools are the unit of randomization in intervention studies. The objective of the current study was to investigate how student outcomes are clustered within schools in an obesity prevention trial. Method. Baseline data from the Food, Health & Choices project were used. Participants were 9- to 13-year-old students enrolled in 20 New York City public schools (n = 1,387). Body mass index (BMI) was calculated based on measures of height and weight, and body fat percentage was measured with a Tanita® body composition analyzer (Model SC-331s). Energy balance–related behaviors were self-reported with a frequency questionnaire. To examine the cluster effects, intraclass correlation coefficients (ICCs) were calculated as school variance over total variance for outcome variables. School-level covariates, percentage students eligible for free and reduced-price lunch, percentage Black or Hispanic, and English language learners were added in the model to examine ICC changes. Results. The ICCs for obesity indicators are: .026 for BMI-percentile, .031 for BMI z-score, .035 for percentage of overweight students, .037 for body fat percentage, and .041 for absolute BMI. The ICC range for the six energy balance–related behaviors are .008 to .044 for fruit and vegetables, .013 to .055 for physical activity, .031 to .052 for recreational screen time, .013 to .091 for sweetened beverages, .033 to .121 for processed packaged snacks, and .020 to .083 for fast food. When school-level covariates were included in the model, ICC changes varied from −95% to 85%. Conclusions. This is the first study reporting ICCs for obesity-related anthropometric and behavioral outcomes among New York City public schools. The results of the study may aid sample size estimation for future school-based cluster randomized controlled trials in similar urban setting and population. Additionally, identifying school-level covariates that can reduce cluster effects is important when analyzing data.

Keywords

child health diet health promotion obesity research design school-based

Get full access to this article

View all access options for this article.

References

Amorim

L. D.

Bangdiwala

S. I.

McMurray

R. G.

Creighton

Harrell

(2007). Intraclass correlations among physiologic measures in children and adolescents. Nursing Research, 56, 355-360.

Baranowski

Smith

Hearn

M. D.

Lin

L. S.

Baranowski

Doyle

. . .Wang

D. T.

(1997). Patterns in children’s fruit and vegetable consumption by meal and day of the week. Journal of the American College of Nutrition, 16, 216-223.

Boneva-Asiova

Boyanov

(2011). Age-related changes of body composition and abdominal adipose tissue assessed by bio-electrical impedance analysis and computed tomography. Endocrinologia y Nutricion, 58, 472-477.

Campbell

M. K.

Fayers

P. M.

Grimshaw

J. M.

(2005). Determinants of the intracluster correlation coefficient in cluster randomized trials: The case of implementation research. Clinical Trials, 2, 99-107.

Campbell

M. K.

Grimshaw

J. M.

Elbourne

D. R.

(2004). Intracluster correlation coefficients in cluster randomized trials: Empirical insights into how should they be reported. BMC Medical Research Methodology, 4, 9.

Chouinard

L. E.

Schoeller

D. A.

Watras

A. C.

Clark

R. R.

R. N.

Buchholz

A. C.

(2007). Bioelectrical impedance vs. four-compartment model to assess body fat change in overweight adults. Obesity, 15, 85-92.

Donner

Wells

(1986). A comparison of confidence interval methods for the intraclass correlation coefficient. Biometrics, 42, 401-412.

Drewnowski

Specter

S. E.

(2004). Poverty and obesity: The role of energy density and energy costs. American Journal of Clinical Nutrition, 79, 6-16.

Gordon

Purciel-Hill

Ghai

N. R.

Kaufman

Graham

Van Wye

(2011). Measuring food deserts in New York City’s low-income neighborhoods. Health & Place, 17, 696-700.

10.

Hedges

L. V.

Hedberg

E. C.

(2007). Intraclass correlation values for planning group-randomized trials in education. Educational Evaluation and Policy Analysis, 29, 60-87.

11.

Janega

J. B.

Murray

D. M.

Varnell

S. P.

Blitstein

J. L.

Birnbaum

A. S.

Lytle

L. A.

(2004). Assessing intervention effects in a school-based nutrition intervention trial: Which analytic model is most powerful? Health Education & Behavior, 31, 756-774.

12.

Karpati

Kerker

Mostashari

Singh

Hajat

Thorpe

. . .Frieden

(2004). Health disparities in New York City. New York: New York City Department of Health and Mental Hygiene.

13.

Krolner

Due

Rasmussen

Damsgaard

M. T.

Holstein

B. E.

Klepp

K. I.

Lynch

(2009). Does school environment affect 11-year-olds’ fruit and vegetable intake in Denmark? Social Science & Medicine, 68, 1416-1424.

14.

Kuczmarski

R. J.

Ogden

C. L.

Grummer-Strawn

L. M.

Flegal

K. M.

Guo

S. S.

Wei

. . .Johnson

C. L.

(2000). CDC growth charts: United States. (Advance Data No. 314). Retrieved from http://www.cdc.gov/nchs/data/ad/ad314.pdf

15.

Kuczmarski

R. J.

Ogden

C. L.

Guo

S. S.

Grummer-Strawn

L. M.

Flegal

K. M.

Mei

. . .Johnson

C. L.

(2002). 2000 CDC growth charts for the United States: Methods and development (Vital and Health Statistics Series 11, No. 246). Retrieved fromhttp://www.cdc.gov/nchs/data/series/sr_11/sr11_246.pdf

16.

Lee

Koch

Contento

I. R.

DiNoia

Mull

Abrams

(2013). Food, Health & Choices: Validation of an audience response system (ARS)-delivered food and activity questionnaire for youth. Journal of Nutrition Education and Behavior, 45(4 Suppl.), S59.

17.

Little

R. J. A.

(1988). A test of missing completely at random for multivariate data with missing values. Journal of the American Statistical Association, 83, 1198-1202.

18.

Moore

J. B.

Hanes

J. C.

Jr. Barbeau

Gutin

Trevino

R. P.

Yin

(2007). Validation of the Physical Activity Questionnaire for Older Children in children of different races. Pediatric Exercise Science, 19(1), 6-19.

19.

Murray

D. M.

Blistein

J. L.

(2003). Methods to reduce the impact of intraclass correlation in group-randomized trials. Evaluation Review, 27, 79-103.

20.

Murray

D. M.

Catellier

D. J.

Hannan

P. J.

Treuth

M. S.

Stevens

Schmitz

K. H.

. . .Conway

T. L.

(2004). School-level intraclass correlation for physical activity in adolescent girls. Medicine & Science in Sports & Exercise, 36, 876-882.

21.

Murray

D. M.

Phillips

G. A.

Bimbaum

A. S.

Lytle

L. A.

(2001). Intraclass correlation for measures from a middle school nutrition intervention study: Estimates, correlates, and applications. Health Education & Behavior, 28, 666-679.

22.

Murray

D. M.

Varnell

S. P.

Blitstein

J. L.

(2004). Design and analysis of group-randomized trials: A review of recent methodological developments. American Journal of Public Health, 94, 423-432.

23.

Neuhouser

M. L.

Lilley

Lund

Johnson

D. B.

(2009). Development and validation of a beverage and snack questionnaire for use in evaluation of school nutrition policies. Journal of the American Dietetic Association, 109, 1587-1592.

24.

O’Malley

P. M.

Johnston

L. D.

Delva

Bachman

J. G.

Schulenberg

J. E.

(2007). Variation in obesity among American secondary school students by school and school characteristics. American Journal of Preventive Medicine, 33(4 Suppl.), S187-S194.

25.

Raudenbush

S. W.

. (2011). Optimal design software for multi-level and longitudinal research (Version 3.01) [Software]. Available from www.wtgrantfoundation.org

26.

Resnicow

Zhang

Vaughan

R. D.

Reddy

S. P.

James

Murray

D. M.

(2010). When intraclass correlation coefficients go awry: A case study from a school-based smoking prevention study in South Africa. American Journal of Public Health, 100, 1714-1718.

27.

Richmond

T. K.

Subramanian

S. V.

(2008). School level contextual factors are associated with the weight status of adolescent males and females. Obesity, 16, 1324-1330.

28.

Rovner

A. J.

Nansel

T. R.

Wang

Iannotti

R. J.

(2011). Food sold in school vending machines is associated with overall student dietary intake. Journal of Adolescent Health, 48, 13-19.

29.

Schuster

M. A.

Elliott

M. N.

Kanouse

D. E.

Wallander

J. L.

Tortolero

S. R.

Ratner

J. A.

. . .Banspach

S. W.

(2012). Racial and ethnic health disparities among fifth-graders in three cities. New England Journal of Medicine, 367, 735-745.

30.

Snijders

T. A. B.

Bosker

R. J.

(2012). Multilevel analysis: An introduction to basic and advanced multilevel modeling (2nd ed.). London, England: Sage.

31.

Thiagarajah

Fly

A. D.

Hoelscher

D. M.

Bai

Leone

Shertzer

J. A.

(2008). Validating the food behavior questions from the elementary school SPAN questionnaire. Journal of Nutrition Education and Behavior, 40, 305-310.

32.

Wang

J. G.

Zhang

Chen

H. E.

Cheng

X. G.

. . . .Li

(2013). Comparison of two bioelectrical impedance analysis devices with dual energy X-ray absorptiometry and magnetic resonance imaging in the estimation of body composition. Journal of Strength and Conditioning Research, 27(1), 236-243.

33.

Wang

Xue

Chen

H. J.

Igusa

(2014). Examining social norm impacts on obesity and eating behaviors among US school children based on agent-based model. BMC Public Health, 14, 923.