Reliability of the 2021 National Youth Risk Behavior Survey Questionnaire

Abstract

Purpose

The Youth Risk Behavior Survey (YRBS) monitors behaviors, experiences, and conditions affecting the health of high school students nationwide. This study examined the test-retest reliability of the 2021 national YRBS questionnaire.

Design

Respondents completed a Time 1 and Time 2 paper-and-pencil questionnaire approximately 2 weeks apart during February to May 2022. Data were linked in such a way as to preserve anonymity.

Setting

Convenience sample of high schools.

Subjects

High school students (N = 588).

Measures

Health risk behaviors and experiences assessed on the 2021 national YRBS questionnaire.

Analysis

Time 1 and Time 2 responses were compared for each questionnaire item using the McNemar’s test. Then, Cohen’s kappa coefficients tested the agreement between Time 1 and Time 2 responses overall, and by sex, grade, and Black, White, and Hispanic race and ethnicity.

Results

Among the 74 items analyzed, 96% had at least moderate reliability, and 73% had substantial or almost perfect reliability. The mean Cohen’s kappa was .68. McNemar’s test findings showed Time 1 and Time 2 data significantly differed (P < .01) for 9 items (12%).

Conclusion

Reliable health behavior measures are important in the development of youth-focused public health programs and policies. Findings suggest the national YRBS questionnaire is a reliable instrument. Such findings lend support to relying on adolescent self-reported data when monitoring health behaviors using the YRBS.