An Approach To Naturalistic Evaluation

Abstract

A naturalistic approach was used for the evaluation of a small-scale agricultural project in a village in Mali, West Africa. The illuminative evaluation strategy was tested for its ability to take into account those human aspects so often left out in the evaluation of development projects. Villager perceptions of the project form the basis of the evaluation. The evaluation consisted in (a) a period of observation, (b) discussion-interviews with informants according to age and gender (the comments from each group were compiled by themes into verbal images), (c) summarization and presentation of the images to relevant project and Malian administrators for their reactions, and (d) modified triangulation of the information through participant observa tion and secondary data. Conclusions concern villager participation and the management techniques used in the project. Conclusions about the illuminative strategy in the context of an international development project include its flexibility, which allows for progressive adaptation to the ever-changing situation of the project; the ability to represent different ideologies, beliefs, and opinions present in the project; the quality and richness of information about the reality of the project; and the absence of preordinate answer categories.

Get full access to this article

View all access options for this article.

References

Cronbach, Lee J. , and Associates. 1983. Ninety-five theses for reforming program evaluation. In Evaluation models: Viewpoints on educational and human services evaluation, edited by George F. Madaus , Michael S. Scriven , and Daniel L. Stufflebeam , 405-12. Boston : Kluwer-Nijhoff.

Richards, H.C. 1985. The evaluation of cultural action. Toronto: Macmillan and IDRC.

Shapiro, Joan P. 1981. The development of transportable leadership and management program in higher education. Paper presented at the annual meeting of the American Educational Research Association, Los Angeles, California, April. ERIC Document Reproduction Service no. ED 201 281.

Shapiro, Joan P. , and Beth Reed. 1982. Illuminative evaluation: Meeting the special needs of feminist projects. Paper presented at the annual meeting of the American Educational Research Association, New York, March. ERIC Document Reproduction Service no. ED 224 828.

Sherman, Ann L. , and Yvonna S. Lincoln. 1982. The potential of naturalistic methods for evaluating visual arts programs. Paper submitted to the Institute for Visual Arts Administration, University of Missouri, Columbia, June. ERIC Document Reproduction Service no. ED 216 017.

Singleton, Royce, Jr. , Bruce C. Straits , Margaret M. Straits , and Ronald J. McAllister. 1988 . Approaches to social research. New York : Oxford University Press.

Parlett, Malcolm , and David Hamilton. 1976. Evaluation as illumination: Anew approach to the study of innovatory programs. In Evaluation studies review annualI, edited by Gene V Glass , 140-57. Beverly Hills, CA: Sage.

Wall, Terry Cobb. 1984. The illusion of independence in evaluation. North Carolina State University at Raleigh. ERIC Document Reproduction Service no. ED 292 831.