Design and Reliability of Pediatic HealthQuiz®: Preliminary Report of a Comprehensive,Computerized,Self-Administered Child Health Assessment

Abstract

The time available for pediatric ambulatory visits is rarely sufficient to permit a truly comprehensive health assessment. We hypothesized that a reliable, computerized, self-administered questionnaire could be designed to screen for a full range of pediatric health issues and provide a comprehensive health database for pediatric patients. An age and gender-specific pediatric questionnaire of 478 questions was formatted to elicit only a 'Yes," "No," or "Not Sure" response and structured in a branched, decision-tree format. The initial draft was reviewed for content by pediatric experts in Canada and the United States and revised in accordance with their suggestions. The questionnaire was divided into two modules, Medical Peds, covering biomedical issues and Prevent Peds, covering prevention, psychosocial, educational, and safety topics. Cognitive interviews were carried out with 132 parents in pediatric ambulatory care centers in Chicago and Halifax, with use of scripted and nonscripted probe questions, to ensure comprehensibility among patients with widely varying educational levels and health knowledge. Reliability was tested in 100 parents of children aged 1 month to 12 years, through use of five different test-retest sequences. Respondents' impressions were surveyed on completion of the procedure. Following content reviews, and cognitive and reliability testing, the total bank of questions was reduced to 375. As a result of the use of branching logic, individual parents answered an average of 111 Prevent Peds and 144 Medical Peds questions. Average time required to complete the entire questionnaire was 13 minutes for Prevent Peds and 19 minutes for Med Peds. Retesting within 36 hours showed an overall 97% concordance of response pairs in the Medical Peds and Prevent Peds questionnaires. There were no statistically significant differences in test-retest reliability between different sequence formats used, (e.g., HealthQuiz followed by personal interview, or HealthQuiz vs. HealthQuiz). A few questions that frequently elicited "Not Sure" responses were eliminated. As a result, the majority of questions elicited either a 'Yes" or "No" response. Pediatric HealthQuiz identified a wide spectrum of child health problems that are often overlooked in routine health visits. Parents completing Pediatric HealthQuiz indicated a high degree of satisfaction with the procedure. Most reported that they believed the information would improve their child's health care.

Get full access to this article

View all access options for this article.

References

1. Blum RW , Beuhring T , Wunderlich M , Resnick MD . Don't ask, they won't tell. The quality of adolescent health screening in five practice settings. Am JPublic Health. 1996;86:1767-1772.

2. Roizen MF , Coalson D , Hayward RS , et al. Can patients use an automated questionnaire to define their current health status? Med Care. 1992;30: MS74-MS84.

3. Jobe JB , Mingay DJ . Cognitive research improves questionnaires. AmJ Public Health. 1989;79:1053-1055.

4. Flesch RF . How to Test Readability. New York: Harper & Row; 1974.

5. Fleiss JL . Statistical Methods for Rates and Proportions. New York: John Wiley & Sons; 1981:126-137.

6. Cohen JA . A coefficient of agreement for nominal scales. Educ Psychol Measure. 1960;20:37-46.

7. Lutner RE , Roizen MF , Stocking CB , et al. The automated interview versus the personal interview. Anesthesiology. 1991;75:394-400.

8. Kobak KA , Taylor LVH , Dottl SL , et al. A computer-administered telephone interview to identify mental disorders. JAAM. 1997;278:905-910.

9. Hasley S. A comparison of computerbased and personal interviews for the gynecological history update. Obstet Gynecol. 1995;85:494-498.

10.

10. Paperny DM , Aono JY , Lehman RM , et al. Computer-assisted detection and intervention in adolescent high-risk health behaviors. J Pediatr. 1990;116: 456-462.

11.

11. Lapham SC , Kring MK , Skipper B. Prenatal behavioral risk screening by computer in a health maintenance organization-based prenatal care clinic. Amf Obstet Gynecol. 1991;165:506-514.

12.

12. Millstein SG , Irwin CE Jr . Acceptability of computer-acquired sexual histories in adolescent girls. J Pediatr. 1983;103:815-819.

13.

13. Kemper KJ . Self-administered questionnaire for structured psychosocial screening in pediatrics. Pediatrics. 1992;89:433-436.

14.

14. Erdman H , Klein MH , Greist JH . The reliability of a computer interview for drug use/abuse information. Behav Res Methods Instrumentation. 1983; 15:66-68.