The aim of this article is to identify the measurement challenges involved in obtaining sensitive health outcomes from Mexican women in both settled and unsettled segments of the United States population and to suggest how cognitive assessment techniques might be better employed to construct culturally and linguistically appropriate survey instruments. These objectives will be illustrated through a project with recent Mexican immigrants in North Carolina that constructs items to measure last menstrual period—an important indicator in gauging the gestational age of a fetus. Guidelines for conducting focus groups and cognitive interviews with this population are emphasized.
Aday, L., Chiu, G. Y., & Andersen, R. (1980). Methodological issues in health care surveys of the Spanish heritage population. American Journal of Public Health, 70(4), 367-374.
2.
Anderson, R. M., Goddard, C. E., Garcia, R., Guzman, J. R., & Vazquez, F. (1998). Using focus groups to identify diabetes care and education issues for Latinos with diabetes. The Diabetes Educator, 24(5), 618-625.
3.
Aneshensel, C. S., Bercerra, R. M., Fielder, E. P., & Schuler, R. H. (1989). Participation of Mexican American female adolescents in a longitudinal panel survey. Public Opinion Quarterly, 53, 548-562.
4.
Angel, R., & Thoits, P. (1987). The impact of culture on the cognitive structure of illness. Culture, Medicine and Psychiatry, 11(4), 465-494.
5.
Banville, D., Desrosiers, P., & Genet-Volet, Y. (2000). Translating questionnaires and inventories using a cross-cultural translation technique. Journal of Teaching in Physical Education, 19, 373-387.
6.
Berkanovic, E. (1980). The effect of inadequate language translation on Hispanics’ responses to health surveys. American Journal of Public Health, 70(12), 1273-1276.
7.
Bernal, H., Wooley, S., & Schensul, J. J. (1997). The challenge of using Likert-type scales with low-literate ethnic populations. Nursing Research, 46(3), 179-181.
8.
Berry, J. (1969). On cross-cultural comparability. International Journal of Psychology, 4(2), 119-128.
9.
Bontempo, R. (1993). Translation fidelity of psychological scales—an item response theory analysis of an individualism-collectivism scale. Journal of Cross-Cultural Psychology, 24(2), 149-166.
10.
Buekens, P., Delvoye, P., Wollast, E., & Robyn, C. (1984). Epidemiology of pregnancies with unknown last menstrual period. Journal of Epidemiology and Community Health, 38(1), 79-80.
11.
Buekens, P., Notzon, F., Kotelchuck, N., & Wilcox, A. (2000). Why do Mexican Americans give birth to few low birth weight infants?American Journal of Epidemiology, 152, 347-351.
12.
Campanelli, P., Martin, E., & Rothgeb, J. M. (1991). The use of respondent and interviewer debriefing studies as a way to study response error in survey data. The Statistician, 40, 253-264.
13.
Capitulo, K. L., Cornelio, M. A., & Lenz, E. R. (2001). Translating the short version of the Perinatal Grief Scale: Process and challenges. Applied Nursing Research, 14(3), 165-170.
14.
Carey, J. W., Morgan, M., & Oxtoby, M. J. (1996). Intercoder agreement in analysis of responses to open-ended interview questions: Examples from tuberculosis research. Cultural Anthropology Methods, 8(3), 1-5.
15.
Carlson, E. D. (2000). A case study in translation methodology using the Health-Promotion Life-style Profile II. Public Health Nursing, 17(1), 61-70.
16.
Chang, A. M., Chau, J. P., & Holroyd, E. (1999). Translation of questionnaires and issues of equivalence. Journal of Advanced Nursing, 29(2), 316-322.
17.
Côté-Arsenault, D., & Morrison-Beedy, D. (1999). Practical advice for planning and conducting focus groups. Nursing Research, 48(5), 280-283.
18.
David, R. (1980). The quality and completeness of birthweight and gestational age data in computerized birth files. American Journal of Public Health, 70, 964-973.
19.
Deeb-Sossa, N., Agans, R. P., Butron-Riveros, B. C., Balcazar, H., Kalsbeek, W. D., & Buekens, P. (2004). Development and testing of interview questions to determine last menstrual period in Mexican immigrant populations. Journal of Immigrant Health, 6(3), 127-136.
20.
DeMaio, T. J., & Rothgeb, J. M. (1996). Cognitive interviewing techniques: In the lab and in the field. In N. Schwarz & S. Sudman (Eds.), Answering questions: Methodology for determining cognitive and communicative processes in survey research (pp. 177-195). San Francisco: Jossey-Bass.
21.
Elias-Olivares, L., & Farr, M. (1991). Sociolinguist analysis of Mexican American patterns of non-response to census questions (No. 16). Washington, DC: U.S. Bureau of the Census.
22.
Flaskerud, J. H. (1988). Is the likert scale format culturally biased?Nursing Research, 37(3), 185-186.
23.
Forsyth, B., & Lessler, J. T. (1991). Cognitive laboratory methods: A taxonomy. In P. Biemer, R. Groves, L. Lyberg, N. Mathiowetz, & S. Sudman (Eds.), Measurement errors in surveys (pp. 398-418). New York: John Wiley & Sons.
24.
Gibbons, J. L., Zellner, J. A., & Rudek, D. J. (1999). Effects of language and meaningfulness on the use of extreme response style by Spanish English bilinguals. Cross-Cultural Research, 33(4), 369-381.
25.
Guendelman, S. (1998). Health and disease among hispanics. In S. Loue (Ed.), Handbook of immigrant health (pp. 277-301). New York: Plenum.
26.
Harkness, J., Pennell, B. E., & Schaua-Glusberg, A. (2004). Survey questionnaire translation and assessment. In S. Presser, J. M. Rothgeb, M. P. Cooper, J. T. Lessler, E. Martin, J. Martin, & E. Singer (Eds.), Methods for testing and evaluating survey questionnaires (pp. 453-473). Hoboken, NJ: John Wiley & Sons.
27.
Hendricson, W. D., Russell, I. J., Prihoda, T. J., Jacobson, J. M., Rogan, A., & Bishop, G. D. (1989). An approach to developing a valid Spanish language translation of a health-status questionnaire. Medical Care, 27(10), 959-966.
28.
Hilton, A., & Skrutkowski, M. (2002). Translating instruments into other languages: Development and testing processes. Cancer Nursing, 25(1), 1-7.
29.
Hines, A. M. (1993). Linking qualitative and quantitative methods in cross-cultural survey research: Techniques from cognitive science. American Journal of Community Psychology, 21(6), 729-746.
30.
Hughes, D., & DuMont, K. (1993). Using focus groups to facilitate culturally anchored research. American Journal of Community Psychology, 21(6), 775-806.
31.
Hui, C. H., & Triandis, H. C. (1989). Effects of culture and response format on extreme response style. Journal of Cross-Cultural Psychology, 20(3), 296-309.
32.
Johnson, T. P., O’Rourke, D., Chavez, N., Sudman, S., Warnecke, R. B., Lacey, L., et al. (1996). Cultural variations in the interpretation of health survey questions. In R. Warnecke (Ed.), Health Survey Research Methods Conference proceedings (Department of Health and Human Services Publication No. PHS96-1013; pp. 57-62). Hyattsville, MD: National Center for Health Statistics.
33.
Johnson, T. P., O’Rourke, D., Chavez, N., Sudman, S., Warnecke, R. B., Lacey, L., et al. (1997). Social cognition and responses to survey questions among culturally diverse populations. In L. Lyberg, P. Biemer, M. Collins, L. Decker, E. DeLeuw, N. Schwarz, et al. (Eds.), Survey measurement and process quality (pp. 87-113). New York: John Wiley.
34.
Jones, M., Peñas, P. F., García-Díez, A., Badía, X., & Chren, M. M. (2000). The Spanish version of Skindex-29. International Journal of Dermatology, 39, 907-912.
35.
Kalsbeek, W. D. (2003). Sampling minority groups in health surveys. Statistics in Medicine, 22, 1527-1549.
36.
Kinzie, J. D., Manson, S. M., Vihn, D. T., Nguyen, T. T., Anh, B., & Pho, T. N. (1982). Development and validation of a Vietnamese-language depression rating scale. American Journal of Psychiatry, 139, 1276-1281.
37.
Marín, G., Gamba, R. J., & Marín, B. V. (1992). Extreme response style and acquiescence among Hispanics: The role of acculturation and education. Journal of Cross-Cultural Psychology, 23(4), 498-509.
38.
Marín, G., & Marín, B. (1991). Research with Hispanic populations. Newbury Park, CA: Sage.
39.
Marín, G., Sabogal, F., Marín, B. V., Otero-Sabogal, R., & Perez-Stable, E. J. (1987). Development of a short acculturation scale for Hispanics. Hispanic Journal of Behavioral Sciences, 9, 183-205.
40.
McKay, R. B., & Aguirre, A. (1994, May). The Spanish translation of the redesigned current population survey: Lessons learned. Paper presented at the American Association for Public Opinion Research, Danvers, MA.
41.
McQuiston, C., Larson, K., Parrado, E. A., & Flaskerud, J. H. (2002). AIDS knowledge and measurement considerations with unacculturated Latinos. Western Journal of Nursing Research, 24(4), 354-372.
42.
NUD*IST Vivo. (1999). NUD*IST for qualitative research. Melbourne, Australia: Qualitative Solutions and Research.
43.
Oksenberg, L., Cannell, C., & Kalton, G. (1991). New strategies for pretesting survey questions. Journal of Official Statistics, 7, 349-365.
44.
Overpeck, M. D., Hediger, M. L., Zhang, J., Trumble, A. C., & Klebanoff, M. A. (1999). Birth weight for gestational age of Mexican American infants born in the United States. Obstetrics and Gynecology, 93(6), 943-947.
45.
Ponce, N. A., Lavarreda, S. A., Yen, W., Brown, E. R., DiSogra, C., & Satter, D. E. (2004). The California health interview survey 2001: Translation of a major survey for California’s multiethnic population. Public Health Reports, 119(4), 388-395.
46.
Potaka, L., & Cochrane, S. (2004). Developing bilingual questionnaires: Experiences from New Zealand in the development of the 2001 Maori language survey. Journal of Official Statistics, 20(2), 289-300.
47.
Quittner, A. L., Sweeny, S., Watrous, M., Munzenberger, P., Bearss, K., Nitza, A. G., et al. (2000). Translation and linguistic validation of a disease-specific quality of life measure for cystic fibrosis. Journal of Pediatric Psychology, 25(6), 403-414.
48.
Schwarz, N. (1999). Cognitive research into survey measurement: Its influence on survey methodology and cognitive theory. In M. G. Sirken, D. J. Herrmann, S. Schechter, N. Schwarz, J. Tanur, & R. Tourangeau (Eds.), Cognition and survey research (pp. 65-75). New York: John Wiley & Sons.
49.
Schwarz, N., & Sudman, S. (Eds.). (1992). Context effects in social and psychological research. New York: Springer-Verlag.
50.
Schwarz, N., & Sudman, S. (1994). Autobiographical memory and the validity of retrospective reports. New York: Springer-Verlag.
51.
Schwarz, N., & Sudman, S. (Eds.). (1996). Answering questions: Methods for determining cognitive and communication processes in survey research. San Francisco: Jossey-Bass.
52.
Shetterly, S. M., Baxter, J., Mason, L. D., & Hamman, R. F. (1996). Self-rated health among Hispanic vs. non-Hispanic White adults: The San Luis Valley health and aging study. American Journal of Public Health, 86(12), 1798-1801.
53.
Singleton, R. A., & Straits, B. C. (1999). Approaches to social research. New York: Oxford University Press.
54.
Sirken, M. G., Herrmann, D. J., Schechter, S., Schwarz, N., Tanur, J. M., & Tourangeau, R. (Eds.). (1999). Cognition and survey research. New York: John Wiley & Sons.
55.
Sudman, S., Bradburn, N., & Schwarz, N. (1996). Thinking about answers: The application of cognitive processes to survey methodology. San Francisco: Jossey-Bass.
56.
Tanur, J. M. (Ed.). (1992). Questions about questions: Inquiries into the cognitive bases of surveys. New York: Russell Sage.
57.
Tourangeau, R. (1984). Cognitive science and survey methods: a cognitive perspective. In T. Jabine, M. Straf, J. Tanur, & R. Tourangeau (Eds.), Cognitive aspects of survey methodology: Building a bridge between disciplines (pp. 73-100). Washington, DC: National Academy Press.
58.
Triandis, H. C., Bontempo, R., Betancourt, H., Bond, M., Leung, K., Brenes, A., et al. (1986). The measurement of the etic aspects of individualism and collectivism across cultures. Australian Journal of Psychology, 38(3), 257-267.
59.
Warnecke, R. B., Ferrans, C. E., Johnson, T. P., Chapa-Resendez, G., O’Rourke, D. P., Chavez, N., et al. (1996). Measuring quality of life in culturally diverse populations. Journal of the National Cancer Institute Monograph, 20, 29-38.
60.
Warnecke, R. B., Johnson, T. P., Chavez, N., Sudman, S., O’Rourke, D. P., Lacey, L., et al. (1997). Improving question wording in surveys of culturally diverse populations. Annals of Epidemiology, 7(5), 334-342.
61.
Weidmer, B., Brown, J., & Garcia, L. (1999). Translating the CAHPS 1.0 survey instrument into Spanish. Medical Care, 37(3), MS89-MS96.
62.
Wilkinson, S. (1998). Focus groups in health research: Exploring the meanings of health and illness. Journal of Health Psychology, 3(3), 329-348.
63.
Willis, G. (1994). Cognitive interviewing and questionnaire design: A training manual (No. 7). Hyattsville, MD: National Center for Health Statistics.
64.
Willis, G. B., Royston, P., & Bercini, D. (1991). The use of verbal report methods in the development and testing of survey questionnaires. Applied Cognitive Psychology, 5, 251-267.
65.
Willis, G. D., DeMaio, T. J., & Harris-Kojetin, B. (1999). Is the bandwagon headed to the methodological promised land? Evaluating the validity of cognitive interviewing techniques. In M. G. Sirken, D. J. Herrmann, S. Schechter, N. Schwarz, J. M. Tanur, & R. Tourangeau (Eds.), Cognition and survey research (pp. 133-153). New York: John Wiley & Sons.
