Assessing the Performance of a Nutrition Knowledge Questionnaire With a Low Socioeconomic Status Population Using Rasch Analysis

Abstract

Parents and preschool teachers play a key role in shaping children’s dietary behaviors. Knowledge of nutrition and healthy dietary choices is a key component to improve dietary habits and reduce the prevalence of obesity and associated co-morbidities. Using valid and reliable instruments is necessary for accurate assessment of knowledge to tailor interventions and measure effectiveness specific to the population of interest. The objectives of this paper are to (1) identify potential gaps in the baseline nutrition knowledge among parents and teachers using a previously validated questionnaire prior to a preschool obesity prevention intervention; and (2) assess the instrument’s reliability and construct validity for a low socioeconomic status population using a post hoc Rasch analysis. Participants included 177 parents and 75 teachers who participated in a Head Start intervention study. Knowledge scores, instrument reliability, and item fit and difficulty were assessed using a Rasch analysis; t-tests were used to determine differences in scores between parents and teachers. Parents answered 38% of questions correctly while teachers correctly answered 46% of the questions. Adequate item fit and reliability were indicated for Sections 1 and 2 of the Nutrition Knowledge Questionnaire (NKQ). Section 3 demonstrated less adequate reliability. The items were found to adequately and reliably define the unidimensional measures of the three components of knowledge represented in this instrument, providing evidence of construct validity. However, Rasch measures indicated the NKQ overall was difficult for participants. Recommendations for improving the instrument for nutrition education/intervention and research practice areas related to obesity and obesity-related conditions are addressed.

Keywords

Nutrition Knowledge Questionnaire Head Start item analysis Rasch analysis

Get full access to this article

View all access options for this article.

References

Aryadoust

L. Y.

Sayama

(2021). A comprehensive review of Rasch measurement in language assessment: Recommendations and guidelines for research. Language Testing, 38(1), 6–40.

Baghaei

(2008). The Rasch model as a construct validation tool. Rasch Measurement Transactions, 22(1), 1145–1146.

Bock

R. D

. (1997). A brief history of item response theory. Educational Measurement: Issues and Practice, 16(4), 21–33. https://doi.org/10.1111/j.1745-3992.1997.tb00605.x

Bond

T. G.

Fox

C. M.

(2015). Applying the Rasch model: Fundamental measurement in the human sciences (3rd ed.). Routledge.

Boone

W. J.

(2016). Rasch analysis for instrument development: Why, when, and how? CBE Life Science Education, 15(4), 1–7. https://doi.org/10.1187/cbe.16-04-0148

Botchlett

(2018). Diet composition for the management of obesity and obesity-related disorders. Journal of Diabetes Mellitus and Metabolic Syndrome, 3, 10–25. https://doi.org/10.28967/jdmms.2018.01.18002

Bronfenbrenner

(2005). Ecological models of human development. In Gauvain

Cole

(Eds.), Readings on the development of children (4th ed., pp. 3–8). Worth Publishers.

Centers of Disease Control and Prevention. (2022, July). Health equity. https://www.cdc.gov/healthequity/whatis/index.html#:~:text=Health%20equity%20is%20the%20state,health%20and%20health%20care%3B%20and

Davison

K. K.

Birch

L. L.

(2001). Childhood overweight: A contextual model and recommendations for future research. Obesity Reviews, 2(3), 159–171. https://doi.org/10.1046/j.1467-789x.2001.00036.x

10.

de Ayala

R. J.

(2009). The theory and practice of item response theory. Guilford Press.

11.

Derscheid

L. E.

Umoren

Kim

S.-Y.

Henry

B. W.

Zittel

L. L.

(2010). Early childhood teachers’ and staff members’ perceptions of nutrition and physical activity practices for preschoolers. Journal of Research in Childhood Education, 24(3), 248–265. https://doi.org/10.1080/02568543.2010.487405

12.

DeVellis

R. F

. (2012). Scale development: Theory and applications (3rd ed.). SAGE.

13.

Engelhard

Jr. (2013). Invariant measurement: Using Rasch models in the social, behavioral, and health sciences. Routledge.

14.

Fink

(2002). How to ask survey questions. SAGE.

15.

Fisher

W. P.

(1992). Reliability, separation, strata statistics. Rasch Measurement Transactions, 6(3), Article 238.

16.

Haladyna

T. M.

Downing

S. M.

(1989). Validity of a taxonomy of multiple-choice item-writing rules. Applied Measurement Education, 2(1), 51–78. https://doi.org/10.1207/s15324818ame0201_4

17.

Huye

H. F.

Connell

C. L.

Dufrene

B. A.

Mohn

R. S.

Newkirk

Tannehill

Sutton

(2020). Development of the impact of a preschool obesity prevention intervention enhanced with positive behavioral supports for Mississippi Head Start centers. Journal of Nutrition Education and Behavior, 52(12), 1148–1159. https://doi.org/10.1016/j.jneb.2020.09.010

18.

Jones

Lamp

Neelon

Nicholson

Schneider

Swanson

P. W.

(2015). Reliability and validity of nutrition knowledge questionnaire for adults. Journal of Nutrition Education and Behavior, 47(1), 69–71. https://doi.org/10.1016/j.jneb.2014.08.003

19.

Linacre

J. M.

(2009). Unidimensional models in multidimensional world. Rasch Measurement Transactions, 23(2), Article 1209.

20.

López-Hernández

Martínez-Arnau

F. M.

Pérez-Ros

Drehmer

Pablos

(2020). Improved nutritional knowledge in the obese adult population modifies eating habits and serum and anthropometric markers. Nutrients, 12(11), Article 3355. https://doi.org/10.3390/nu12113355

21.

Masters

G. N.

(1982). A Rasch model for partial credit scoring. Psychometrika, 47(2), 149–174.

22.

Messick

(1975). The standard problem: Meaning and values in measurement and evaluation. American Psychologist, 30(10), 955–965.

23.

Messick

(1980). Test validity and the ethics of assessment. American Psychologist, 35(11), 1012–1027.

24.

Messick

(1995). Validity of psychological assessment: Validation of inferences from persons’ responses and performances as scientific inquiry into score meaning. American Psychologist, 50(9), 741–749.

25.

Mötteli

Barbey

Keller

Bucher

Siegrist

(2016). Measuring practical knowledge about balanced meals: Development and validation of the brief PKB-7 scale. European Journal of Clinical Nutrition, 70(4), 505–510. https://doi.org/10.1038/ejcn.2015.173

26.

Mötteli

Barbey

Keller

Bucher

Siegrist

(2017). Development and validation of a brief instrument to measure knowledge about the energy content of meals. Journal of Nutrition Education and Behavior, 49(3), 257–263. https://doi.org/10.1016/j.jneb.2016.12.002

27.

Ostini

Nering

M. L.

(2006). Polytomous item response theory models. SAGE.

28.

Parmenter

Wardle

(1999). Development of a general nutrition knowledge questionnaire for adults. European Journal of Clinical Nutrition, 53, 298–308. https://doi.org/10.1038/sj.ejcn.1600726

29.

Parmenter

Wardle

(2000). Evaluation and design of nutrition knowledge measures. Journal of Nutrition Education, 32(5), 269–277. https://doi.org/10.1016/S0022-3182(00)70575-9

30.

Rasch

(1960). Probabilistic models for some intelligence and attainment tests. Danish Institute for Educational Research.

31.

Rasch

(1980). Probabilistic models for some intelligence and attainment tests (Expanded ed.). University of Chicago Press.

32.

Rattray

Jones

M. C.

(2007). Essential elements of questionnaire design and development. Journal of Clinical Nursing, 16(2), 234–243. https://doi.org/10.1111/j.1365-2702.2006.01573.x

33.

Reynolds

C. R.

Livingston

R. B.

Willson

(2009). Measurement and assessment in education (2nd ed.). Pearson.

34.

Stierman

Afful

Carroll

M. D.

Chen

T.-C.

Davy

Fink

Fryar

C. D.

Hales

C. M.

Hughes

J. P.

Ostchega

Storandt

R. J.

Akinbami

L. J.

, & National Center for Health Statistics. (2021). National Health and Nutrition Examination Survey 2017–March 2020 prepandemic data files: Development of files and prevalence estimates for selected health outcomes (National Health Statistics report NHSR no 158121). https://stacks.cdc.gov/view/cdc/106273

35.

Tennant

Pallant

J. F.

(2006). Unidimensionality matters! (A tale of two Smiths?). Rasch Measurement Transactions, 20(1), 1048–1051.

36.

Thissen

Steinberg

(2009). Item response theory. In Millsap

R. E.

Maydeu-Olivares

(Eds.), The Sage handbook of quantitative methods in psychology (pp. 148–177). SAGE.

37.

Trakman

Forsyth

Hoye

Belski

(2017). Developing and validating a nutrition knowledge questionnaire: Key methods and considerations. Public Health Nutrition, 20(15), 2670–2679. https://doi.org/10.1017/S1368980017001471

38.

U.S. Bureau of Labor Statistics. (2021, April). Occupational employment and wages, May 2022: 25–2011 preschool teachers, except special education. United States Department of Labor. https://www.bls.gov/oes/current/oes252011.htm#st

39.

U.S. Department of Agriculture. (2020). Dietary guidelines for Americans, 2020–2025 (9th ed.). www.dietaryguidelines.gov

40.

Vázquez-Espino

Fernández-Tena

Lizarraga-Dallo

M. A.

Farran-Codina

(2020). Development and validation of a short sport nutrition knowledge questionnaire for athletes. Nutrients, 12(11), Article 3561. https://doi.org/10.3390/nu12113561

41.

Wright

B. D.

(1996). Comparing Rasch measurement and factor analysis. Structural Equation Modeling, 3(1), 3–24.

42.

Wright

B. D.

Douglas

G. A.

(1986). The rating scale model for objective measurement (Memorandum no. 35). MESA Psychometric Laboratory.

43.

Wright

B. D.

Linacre

J. M.

(1994). Reasonable mean-square fit values. Rasch Measurement Transactions, 8(3), Article 370.

44.

Wright

B. D.

Masters

G. N.

(1982). Rating scale analysis. MESA Press.

45.

Wright

B. D.

Stone

M. H.

(1979). Best test design. MESA Press.

46.

Zwick

Thayer

D. T.

Lewis

(1999). An empirical Bayes approach to Mantel-Haenszel DIF analysis. Journal of Educational Measurement, 36(1), 1–28. https://www.jstor.org/stable/1435320

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.17 MB