There has been growing interest in nonmainstream approaches to assessing health programs, but methodological strategies have not been a concern. In this article, we review methodological strategies used in emergent evaluations of health policies and programs in Iberoamerica, focusing on participatory, qualitative, critical, hermeneutical, bottom-up, collaborative, and transdisciplinary approaches. A literature search was performed combining strategies: database review, consultation of bibliography, expert interviews, and search engines. The review took place from 2003 to 2006. Research published in the past two decades was included. Nearly 70 articles were found on emergent research and evaluation of health programs in the region. Participatory and qualitative approaches were the most used. Theoretical issues are more emphasized than are methodological ones. Data gathering also was more explored than were design, participant selection, or analysis. The frequently used methodological strategies contradict some basic assumptions of the emergent evaluative research, such as its participatory and collaborative nature.
Abma, T.A. (2001). Reflexive dialogues: A story about the development of injury prevention in 2 performing arts schools. Evaluation , 7(2), 238-252.
2.
Abma, T.A. (2005). Responsive evaluation: Its meaning and special contribution to health promotion. Evaluation and Program Planning , 28, 279-289.
3.
Abma, T.A. (2006). The praxis and politics of responsive evaluation . American Journal of Evaluation, 27(1), 31-43.
4.
Akerman, M., Mendes, R., Bógus, C.M., Westphal, M.F., Bichir, A., & Pedroso, M.L. (2002). Avaliação em promoção da saúde: Foco no "município saudável" [Evaluation in health promotion: Focus on "health municipality"] . Revista Saúde Pública, 36(5), 638-646.
5.
Akerman, M., & Nadanovsky, P. (1992). Avaliação dos serviços de saúde-Avaliar o quê? [Evaluation of health services- What to evaluate?] . Cadernos de Saúde Pública, 8(4), 361-365.
6.
Almeida, P., & Escorel, S. (2001). Da avaliação em saúde mental: Gênese, aproximações teóricas e questões atuais [The evaluation in mental health: Genesis, theoretical approaches and current issues]. Saúde em Debate, 25(58), 25-45.
7.
Aubel, C. (2004). Participatory monitoring & evaluation for hygiene improvement. Washington, DC: Environmental Health Project.
8.
Ayres, J.L., Freitas, A.C., Santos, M.A., Filho, H.C., & Junior, I.F. (2003). Adolescência e AIDS: Avaliação de uma experiência de educação preventiva entre pares [Adolescents and AIDS: Evaluation of an experience of preventive education among peers]. Interface-Comunicação, Saúde, Educação, 7(12), 123-138.
9.
Bradley, J.E., Mayfield, M.V., Mehta, M.P., & Rukonge, A. (2002). Participatory evaluation of reproductive health care quality in developing countries. Social Science & Medicine, 55(2), 269-287.
10.
Calvo, T. (1996). Iberoamerica. De 1570 a 1910 [Iberoamerica. From 1570 to 1910]. Barcelona, Spain: Península.
11.
Canals, R., Iñiguez, L., Monreal, P., Sánchez, M., & Toca, J. (1999). Evaluación de la calidad de los establecimientos de atención a la gente mayor [Evaluation of the quality of health care establishments for the elderly]. Retrieved June 21, 2005, from http://antalya.uab.es/liniguez/Materiales/gente_mayor.pdf
12.
Capeling, S., Lopes, C., Benbouali, A., & Diallo, D. (1997). Who are the question makers? A participatory evaluation handbook. New York: OESP.
13.
Carvalho, A.I., Bodstein, R.C., Hartz, Z., & Matida, A.H. (2004). Concepts and approaches in the evaluation of health promotion. Ciência y Saúde Coletiva, 9(3), 521-529.
14.
Castanheira, E.R.L., Battistella, M.I., Melchior, R., Donini, A.A., Basso, C.R., Tunala, L.G., et al. (2002). Quality of care in STD/AIDS health services in Sao Paulo, Brazil: A qualitative framework. Retrieved February 14, 2004, from http://www.iasociety.org/
15.
Cheek, J. (2004). At the margins? Discourse analysis and qualitative research. Qualitative Health Research, 14, 1040-1050.
16.
Cook, T. (2006). Collaborative action research within development evaluation: Learning to see or road to myopia? Evaluation , 12(4), 418-436.
17.
Cousins, J.B., & Withmore, E. (1998). Framing participatory evaluation. In E. Withmore (Eds.), Understanding and practicing participatory evaluation (pp. 5-24). San Francisco: Jossey-Bass.
18.
Diaz, D., & Hofbauer, H. (2004). The public budget and maternal mortality in México: An overview of the experience. Retrieved May 23, 2004, from http://www.siyanda.org/search/summary.cfm?NN=1654&ST=SS&Keywords=security05&Subject=0&donor=0&langu=E&StartRow=1&Ref=Adv
19.
Engelkes, E. (1990). Process evaluation in a Colombian primary health care programme. Health Policy and Planning, 5(4), 327-335.
20.
Escobar, A., & González, M. (2002). Evaluación cualitativa del Programa de Desarrollo Humano Oportunidades [Qualitative evaluation of the Human Development Program Oportunidades]. Retrieved September 15, 2004, from http://www.progresa.gob.mx/e_oportunidades/evaluacion_impacto/2002/Evaluaci%F3n%20Cualitativa%20Final%20-%20dic02.pdf
21.
Estrella, M. (2000). Learning from change. In M. Estrella, I. Blauert, D. Compilan, J. Gaventa, J. Gonsalves, I. Guijt , et al. (Eds.), Learning from change: Issues and experiences in participatory monitoring and evaluation (pp. 1-14). London: ITP.
22.
Estrella, M., & Gaventa, J. (2001). Quien da cuenta de la realidad? Monitoreo y evaluación participativa: Revisión bibliográfica [Who counts reality? Participatory monitoring and evaluation: A literature review]. Brighton, UK: IDS.
23.
Everitt, A., & Hardiker, P. (1997). Towards a critical approach to evaluation. In M. Sidell, L. Jones, J. Katz, & A. Peberdy (Eds.), Debates and dilemmas in promoting health. A reader (pp. 194-200). Hampshire, UK: Open University Press.
24.
Fernandez, J., & Santos, M.A. (1992). Evaluación cualitativa de programas de educación para la salud. Una experiencia hospitalaria [Qualitative evaluation of programs for health education. A hospital experience]. Málaga, Spain: Ediciones Aljibe.
25.
Fetterman, D.M. (2001). Foundations of empowerment evaluation. London: Sage.
26.
Figueiredo, R., & Ayres, J.R. (2002). Intervenção comunitária e redução da vulnerabilidade de mulheres ás DST/Aids em São Paulo [Community intervention and reducing the vulnerability of women with STDs/AIDS in Sao Paulo]. Revista Saúde Pública, 36(4), 96-107.
27.
Filgueiras, S., & Deslandes, S. (1999). Avaliação das ações de aconselhamento. Análise de uma perspectiva de prevenção centrada na pessoa [Evaluation of the actions of advice. Analysis of the perspective of prevention focused on the person] . Cadernos de Saúde Pública, 15(2), 121-131.
28.
Furtado, J.P. (2001). Um método construtivista para a avaliação em saúde [A constructivist approach to health evaluation]. Ciência & Saúde Coletiva, 6(1), 165-181.
29.
Garay, A., Iñiguez, L., Martínez, M., Muñoz, J., Pallares, S., & Vázquez, F. (2002). Evaluación cualitativa del sistema de recogida de sangre en Cataluña [Qualitative evaluation of the collecting blood system in Catalonia]. Revista Española de Salud Pública, 76(5), 437-450.
30.
Gastaldo, D., Mercado, F.J., Ramasco, M., Lizardi, A., & Gil, M. (2002). Qualitative health research in Ibero América: The current state of the science. Journal of Transcultural Nursing, 13(2), 90-108.
31.
Gendron, S. (2001). Transformative alliance between quantitative and qualitative approaches to health promotion research. In I. Rootman, M. Goodstadt , B. Hyndman, D. V. McQueen, L. Potvin, J. Springett, et al. (Eds.), Evaluation in health promotion: Principles and practice (pp. 107-122). Geneva, Switzerland: World Health Organization.
32.
Guba, E., & Lincoln, Y. (1989). Fourth generation evaluation. Newbury Park, CA: Sage.
33.
Haynes, R., Mulrov, C., Huth, E.J., Altman, D., & Gardner, M. (1990). More informative abstract revisited. Annals of Internal Medicine, 113(1), 69-76.
34.
Hesse-Biber, S., & Leavy, P. (2006). Emergent methods in social research. Thousand Oaks, CA: Sage.
35.
Hoyos, L.M. (2002). Estrategia de intervención en hogares comunitarios de bienestar: Una experiencia local participativa en varios municipios de Colombia [Strategy intervention in welfare community homes: A participative local experience in several municipalities of Colombia]. Retrieved November 16, 2004, from http://unpan1.un.org/intradoc/groups/public/documents/CLAD/clad0044538.pdf
36.
Jackson, E.T., & Kassam, Y. (1998). Knowledge shared. Participatory evaluation in development cooperation. Ottawa, Ontario, Canada: Kumarian Press.
37.
Kazi, M. (2000). Contemporary perspectives in the evaluations of practice. British Journal of Social Work, 30, 755-768.
38.
Krippendorff, K. (1990). Metodología de análisis de contenido. Teoría y práctica [Methodology of content analysis. Theory and practice]. Barcelona, Spain: Paidos.
39.
McKie, L. (2003). Rhetorical space: Participation and pragmatism in the evaluation of community health work. Evaluation, 9(2), 307-324.
40.
Mercado, F.J. (2002). Qualitative research in Latin America: Critical perspective on health. International Journal of Qualitative Methods. Retrieved April 23, 2005, from http://www.ualberta.ca/~iiqm/backissues/1_1Final/pdf/mercadoeng.pdf
41.
Mercado, F.J., Alcántara, E., Tejada, L.M., Lara, N., & Sanchez, A. (2004). O atendimento médico aos doentes crônicos no México. Quais as diferenças entre a perspectiva dos médicos, das enfermeiras e das pessoas doentes? [Health care to chronically ill patients in Mexico. What are the differences between the perspectives of doctors, nurses and chronic patients?]. In M. L. Bosi & F. J. Mercado (Eds.), Pesquisa qualitativa de serviços de saúde (pp. 363-400). Petrópolis, Brazil: Vozes.
42.
Mercado, F.J., Bosi, M.L., Robles, L., Wiessenfeld, E., & Pla, M. (2005). La enseñanza de la investigación cualitativa en Ibero América [Teaching qualitative research in Iberoamerica]. Salud Colectiva, 1, 97-116.
43.
Mercado, F.J., & Hernández, E. (2007). Las enfermedades crónicas desde la mirada de los enfermos y los profesionales de la salud: Un estudio cualitativo en México. [Chronic illness from the perspective of patients and health professionals: A qualitative study in Mexico]. Cadernos Saude Publica, 23(9), 2178-2186.
44.
Mercado, F.J., Hernández, N., Tejada, L.M., Springett, J., & Calvo, A. (2006). Avaliação de políticas e programas de saúde: Enfoques emergentes na Ibero América no inicio do século XXI [Evaluation of policies and programs of health: Emerging approaches in Ibero America at the beginning of the twenty-first century]. In M. L. Bosi & F. J. Mercado (Eds.), Avaliação qualitativa de programas de saúde. Enfoques emergentes (pp. 22-64). Petrópolis , Brazil: Vozes.
45.
Mercer, H., & Ruiz, V.A. (2004). Participación de organizaciones comunitarias en la gestión de salud: Una evaluación de la experiencia del programa UNI [Participation of community-based organizations in the management of health: An assessment of the experience of the program]. Interface-Comunicación, Saúde, Educ, 8(15), 289-302.
46.
Minayo, M., Souza, E., Assis, S., Neto, O., Deslandes, S., & Silva, C. (1999). Avaliação dos Centros de Orientação e Apoio Serológico/CTA/Coas da Regiáo Nordeste do Brasil [Evaluation of the serological support and orientation centres/CTA/Coas of Brazil northeastern region]. Cadernos de Saúde Pública, 15(2), 355-367.
47.
Minayo, M. C., Assis, S., & Souza, E. (Eds.). (2005). Avaliação por triangulação de métodos. Abordagem de programas sociais [Evaluation by triangulation methods. Approach to social programs]. Rio de Janeiro, Brazil: Editora Fiocruz.
48.
Minayo, M.C., & Neto, O. (1999). Triangulación de métodos en la evaluación de programas y servicios de salud [Triangulation methods for the evaluation of health programs and services]. In J. Bronfman & R. Castro (Eds.), Salud, cambio social y política. Perspectivas desde América Latina (pp. 65-80). México City, México: INSP-EDAMEX.
49.
Nieremberg, O., Brawerman, J., & Ruiz, V. (2000). Evaluar para la transformación: Innovaciones en la evaluación de programas y proyectos sociales [Assess for the transformation: Innovations in evaluating social programs and projects]. Barcelona, Spain: Paidós.
50.
Ortiz, Z., Perel, P., & Pardo, J. (2005). Evidence-based medicine in Iberoamerica: Problems and possible solutions. PLoS Medicine, 2(8), 277. Retrieved January 6, 2006, from http://www.pubmedcentral.nih.gov/picrender.fcgi?artid=1196490&blobtype=pdf
51.
O'Sullivan, R. (2004). Practising evaluation: A collaborative approach . London: Sage.
52.
Pasteur, K., & Blauert, J. (2000). Participatory monitoring and evaluation in Latin America: Overview of the literature with annotated bibliography. Retrieved December 15, 2005, from http://www.eldis.org/static/DOC8569.htm
Platt, I. (1996). Review of participatory monitoring and evaluation . London: Concern.
55.
Said, E. (1995). Orientalism. Western conceptions of the Orient . London: Penguin.
56.
Sandelowski, M. (2004). Using qualitative research. Qualitative Health Research, 14, 1366-1386.
57.
Scriven, M. (1994). Evaluation as a discipline. Studies in Educational Evaluation, 20(1), 147-166.
58.
Segone, M. (1998). Evaluación democrática [Democratic evaluation] . Bogotá, Colombia: Fondo de las Naciones Unidas para la Infancia.
59.
Silver, L. (1992). Aspectos metodológicos em avaliação dos serviços de saúde [Methodological issues in the evaluation of health services]. In E. Gallo, F. J. Uribe, & M. H. Machado (Eds.), Planejamento creativo. Novos desafios em políticas de saúde (pp. 195-209). Rio de Janeiro, Brazil: Relume Dumará.
60.
Simons, H. (1999). Evaluación democrática de instituciones escolares [Democratic evaluation of educational institutions]. Madrid , Spain: Ediciones Morata.
61.
Smith, L.T. (2004). Decolonizing methodologies. Research and indigenous people. London: Zed Books.
62.
Springett, J. (1998). Practical guidance on evaluating health promotion . Copenhagen, Denmark: WHO/ Euro.
63.
Springett, J. (2001). Appropriate approaches to the evaluation of health promotion. Critical Public Health, 11(2), 139-151.
64.
Springett, J. (2003). Issues in participatory evaluation. In M. Minkler & N. Wallerstein (Eds.), Community based participatory research for health (pp. 263-286). New York: Jossey-Bass.
65.
Stufflebeam, D. (2001). Evaluation models. New Directions for Evaluation, 89, 7-98.
66.
Sulbrandt, J. (1997). La evaluación de los programas sociales: Una perspectiva crítica de los modelos usuales [Evaluation of social programs: A critical perspective of usual models]. In B. Kliksberg (Ed.), Pobreza: Un tema impostergable (pp. 188-196). México City, México: FCE/PNUD .
67.
Uchimura, K., & Bosi, M.L. (2002). Qualidade e subjetividade na avaliação de programas e serviços em saúde [Quality and subjectivity in the evaluation of health programs and services]. Cadernos de Saúde Pública, 18(6), 1561-1569.
68.
Uchimura, K., & Bosi, M.L. (2004). A polissemia da qualidade na avaliação de programas e serviços de saúde-Resgatando a subjetividade [The polissemia of quality in the evaluation of health programs and services-Rescuing the subjectivity] . In M. L. Bosi & F. J. Mercado (Eds.), Pesquisa qualitativa de serviços de saúde (pp. 75-98). Petrópolis, Brazil: Vozes.
69.
Weiss, C. (1990). Investigación evaluativa. Métodos para determinar la eficiencia de los programas de acción [Evaluative research. Methods for determining the efficiency of action programs]. México City, México: Trillas.
