Cognitive interviewing techniques were used to adapt existing measures for use with a population of low-literate Spanish-speaking people with diabetes.
METHODS
Five individuals of Caribbean origin with diabetes participated in cognitive interviews for 4 instruments (measuring diabetes knowledge, quality of life, self-management, and depression) adapted for oral administration to low-literate individuals. Audiotaped interviews and handwritten notes were subjected to content analysis to identify problems across the 4 instruments as well as specific to a given instrument.
RESULTS
The following key problems were identified: general instructions were not helpful, items that were not specific enough generated a variety of interpretations, some wording was confusing, abstract concepts were difficult to understand, some terminology was unfamiliar, and interpretation of certain words was incorrect.
CONCLUSIONS
The data illustrate the usefulness of cognitive interviewing as a first step in the process of adapting measurement instruments.
Get full access to this article
View all access options for this article.
References
1.
1. Centers for Disease Control and Prevention. National Diabetes Fact Sheet: General Information and National Estimates on Diabetes in the United States, 2000. Atlanta, Ga: US Dept of Health and Human Services; 2002.
2.
2. Kenny SJ, Aubert RE, Geiss LS. Prevalence and incidence of non-insulindependent diabetes. In: National Diabetes Data Group, ed. Diabetes in America. 2nd ed.Bethesda, Md: National Institutes of Health; 1995. NIH publication 951468:47-67.
3.
3. Mokdad AH, Ford ES, Bowman BA, et al. Diabetes trends in the U.S.: 1990-1998. Diabetes Care. 2000; 23:1278-1283.
4.
4. Harris Ml, Flegal KM, Cowie CC, et al. Prevalence of diabetes, impaired fasting glucose, and impaired glucose tolerance in U.S. adults. The Third National Health and Nutrition Examination Survey, 1988-1994. Diabetes Care. 1998;21: 518-524.
5.
5. Black SA, Ray LA, Markides KS. The prevalence and health burden of self-reported diabetes in older Mexican Americans: findings from the Hispanic established populations for epidemiologic studies of the elderly. Am J Public Health. 1999;89:546-552.
6.
6. Cowie CC, Eberhardt MS. Sociodemographic characteristics of persons with diabetes. In: National Diabetes Data Group, ed. Diabetes in America. 2nd ed.Bethesda, Md: National Institutes of Health; 1995. NIH publication 95-1468:85-116.
7.
7. Centers for Disease Control and Prevention. Socioeconomic status of women with diabetes United States, 2000. JAMA. 2002;287: 2496-2497.
8.
8. Evans JM, Newton RW, Ruta DA, MacDonald TM, Morris AD. Socio-economic status, obesity and prevalence of type 1 and type 2 diabetes mellitus. Diabetic Med.2000;17:478-480.
9.
9. Flegal KM, Ezzati TM, Harris Ml, et al. Prevalence of diabetes in Mexican Americans, Cubans, and Puerto Ricans from the Hispanic Health and Nutrition Examination Survey, 1982-1984. Diabetes Care. 1991; 14(suppl 7):528-538.
10.
10. Carter JS, Wiggins CL, Becker TM, Key CR, Samet JM. Diabetes mortality among New Mexico's American, Indian, Hispanic, and non-Hispanic white populations, 1958-1987. Diabetes Care. 1993;16:306-309.
11.
11. Lindeman RD, Romero UJ, Hundley R, et al. Prevelances of type 2 diabetes, the insulin resistance syndrome, and coronary heart disease in an elderly, biethnic population. Diabetes Care. 1998;21:959-966.
12.
12. Ralb MG, Gagliano DA, Sweeney HE. Diabetic retinopathy in blacks. Diabetes Care. 1990;13: 1202-1206.
13.
13. Wetterhall SF, Olson DR, DeStefano F, et al. Trends in diabetes and diabetic complications, 1980-1987. Diabetes Care. 1992; 15:960-967.
14.
14. Diehl AK, Stern MPSpecial health problems of Mexican Americans: obesity, gallbladder disease, diabetes mellitus and cardiovascular disease. Adv Intern Med.1989;34:79-96.
15.
15. Haffner SM, Fong D, Stern MP, et al. Diabetic retinopathy in Mexican Americans and non-Hispanic whites. Diabetes. 1988; 37:878-884.
16.
16. Tucker KL, Bermudez 0I, Castaneda C.Type 2 diabetes is prevalent and poorly controlled among Hispanic elders of Caribbean origin. Am J Public Health. 2000;90: 1288-1293.
17.
17. US Department of Health and Human Services. Behavioral Risk Factor Surveillance System Data. Atlanta, Ga: US Dept of Health and Human Services, Centers for Disease Control and Prevention; 2000.
18.
18. Therrien M, Ramirez RR. The Hispanic population in the United States: March 2000. In: Current Population Reports. Washington, DC: US Bureau of the Census, Government Printing Office; 2000.
19.
19. Campbell PPopulation projections for states by age, race and sex: 1993-2020. In: Current Populations Reports. Washington, DC: US Bureau of the Census, Government Printing Office; 1994.
20.
20. US Department of Health and Human Services. The initiative to eliminate racial and ethnic disparities in health. Available at: http://raceandhealth.hhs.gov. Accessed December 9, 2002.
21.
21. US Department of Health and Human Services. Healthy People 2010: Understanding and Improving Health. 2nd ed.Washington, DC: US Government Printing Office; November 2000.
22.
22. Stern MP, Mitchell BD. Diabetes in Hispanic Americans. In: National Diabetes Data Group, ed. Diabetes in America. 2nd ed.Bethesda, Md: National Institutes of Health; 1995. NIH publication 95-1468:631-654.
23.
23. Deardorff KE, Hollmann FW, Montgomery P U.S. population estimates by age, sex, race and Hispanic origin: 1990-1995. Washington, DC: Bureau of the Census; 1996. Publication PPL-41.
24.
24. Montgomery PA. The Hispanic population in the United States. In: Current Population Reports, Series 20-475. Washington, DC: US Bureau of the Census, Government Printing Office; 1994.
25.
25. Greenberg E, Macia R, Rhodes D, Chan I.Language background and literacy proficiency. Available at: http://nces.ed.gov. Accessed December 9, 2002.
26.
26. Centers for Disease Control and Prevention. Self-reported prevalence of diabetes among Hispanics-United States, 1994-1997. MMWR Morb Mortal Wkly Rep.1999;48:8-12.
27.
27. Hayes RP, Bernard AM, Slocum W, et al. Diabetes in urban African Americans: assessment of diabetes-specific locus of control in patients with type 2 diabetes. Diabetes Educ. 2000; 26:121-128.
28.
28. Frayne SM, Burns RB, Hardt EJ, Rosen AK, Moskowitz MA. The exclusion of non-English-speaking persons from research. J Gen Intern Med.1996;11: 39-43.
29.
29. Ad Hoc Committee on Health Literacy for the Council on Scientific Affairs. Health literacy: report of the Council on Scientific Affairs. JAMA. 1999;281:552-557.
30.
30. Schillinger D, Grumbach K, Piette-J, et al. Association of health literacy with diabetes outcomes. JAMA. 2002;288:475-482.
31.
31. Marin G, Marin BVO. Research with Hispanic populations. In: Applied Social Research Methods Series. Vol 23. Newberry Park, Calif: Sage Publications; 1991.
32.
32. Cella D, Hernandez L, Bonomi AE, et al. Spanish language translation and initial validation of the Functional Assessment of Cancer Therapy Quality-of-Life Instrument. Med Care. 1998; 36:1407-1418.
33.
33. Stewart AL, Napoles-Springer A.Health-related quality-of-life assessments in diverse population groups in the United States. Med Care. 2000;38(suppl 9): 11102-11124.
34.
34. Guillemin F, Bombardier C, Beaton D.Crosscultural adaptation of health-related quality of life measures: literature review and proposed guidelines. J Clin Epidemiol. 1993;46: 1417-1432.
35.
35. Berkanovic E.The effect of inadequate language translation on Hispanics' responses to health surveys. Am J Public Health. 1980; 70:1273-1276.
36.
36. Jobe JB, Mingay DJ. Cognitive research improves questionnaires. Am J Public Health. 1989;79: 1053-1055.
37.
37. Alaimo K, Olson CM, Frongillo EA. Importance of cognitive testing for survey items: an example from food security questionnaires. J Nutr Educ. 1999; 31:269-275.
38.
38. Willis GB. Cognitive Interviewing and Questionnaire Design: A Training Manual. Working Paper Series, No.7. Hyattsville, Md: Office of Research and Methodology, National Center for Health Statistics; March 1994.
39.
39. Sudman S, Bradbum NM, Schwartz N.Thinking About Answers: The Application of Cognitive Processes to Survey Methodology. San Francisco: Jossey-Bass; 1996.
40.
40. Shepherd SK, Sims LS, Cronin FJ, Shaw A, Davis CA. Use of focus groups to explore consumers' preferences for content and graphic design of nutrition publications. J Am Diet Assoc. 1989;89: 1612-1614.
41.
41. Carbone ET. LEARN-SMART: the application of adult learning theories to nutrition education [disser-tation]. Chapel Hill, NC: University of North Carolina; 1999.
42.
42. Carbone ET, Campbell MK, Honess-Morreale L.Use of cognitive interview techniques in the development of nutrition surveys and interactive nutrition messages for low-income populations. J Am Diet Assoc. 2002;102:690-696.
43.
43. Keyserling TC, Ammerman AS, Samuel-Hodge CD, et al. A diabetes management program for African American women with type 2 diabetes. Diabetes Educ. 2000;26: 796-805.
44.
44. Patton MQ. Qualitative Research and Evaluation Methods. 3rd ed.Thousand Oaks, Calif: Sage Publications; 2002.
46. Bradley C, Speight J.Patient perceptions of diabetes and diabetes therapy: assessing quality of life. Diabetes Metab Res Rev.2002;18(suppl 3):S64-S69.
47.
47. Hurley AC, Shea CA. Self-efficacy: strategy for enhancing diabetes selfcare. Diabetes Educ. 1992; 18:146-150.
48.
48. Hurley AC. The Health Belief Model: evaluation of a diabetes scale. Diabetes Educ. 1990;16:44-48.
49.
49. Devins GM, Orme CM. Center for Epidemiologic Studies Depression Scale. In: Sweetland RC, ed. Test Critiques. Kansas City, Mo: Test Corp of America (subsidiary of Westport Publishers, Inc); 1985:144-160.
50.
50. Sawyer-Radloff L.The CES-D Scale: a self-report depression scale for research in the general population. Appl Psychol Meas. 1977;1:385-401.
51.
51. Waltz CF, Strickland OL, Lenz ER. Measurement in Nursing Research. Philadelphia: FA Davis; 1991.
52.
52. Fitzgerald JT, Funnell MM, Hess GE, et al. The reliability and validity of a brief diabetes knowledge test. Diabetes Care. 1998; 21:706-710.
53.
53. Garcia AA, Villagomez ET, Brown SA, Kouzekanani K, Hanis CL. The Starr County Diabetes Education Study: development of the Spanish-language diabetes knowledge questionnaire. Diabetes Care. 2001;24: 16-21.
54.
54. Bernal H, Wooley S, Schensul JJ. The challenge of using Likert-type scales with low-literate ethnic populations. Nurs Res.1997; 46:179-181.
55.
55. Bradley C, Todd C, Gorton T.Symonds E, Martin A, Plowright R.The development of an individualized questionnaire measure of perceived impact of diabetes on quality of life: the ADDQoL. Quality Life Res.1999;8:79-91.
56.
56. Von Goeler DS, Rosal MC, Ockene JK, Scavron J, de Torrijos F.Self-management of type 2 diabetes: a survey of low income, urban Puerto Ricans. Diabetes Educ. 2003;29:
57.
57. Bernal H, Woolley S, Schensul JJ, Dickinson JK. Correlates of self-efficacy in diabetes self-care among Hispanic adults with diabetes. Diabetes Educ. 2000; 26:673-680.
