Sage Journals: Discover world-class research

Abstract

The purpose of this article is to introduce a new outcome-oriented, utilization-focused, and practical approach to program evaluation: Charting the Outcomes of Educational and Clinical Approaches (COECA) model. It provides a framework that encourages stakeholders to consider academic dissemination, product development, and implementation as three primary outcomes when evaluating educational and clinical approaches. The model then identifies measurements of the impact of each of these primary outcomes. Finally, it outlines three secondary outcomes that focus on education, clinical service, and administration. As an example, this article discusses the application of the model to an educational intervention in residency training. This intervention has been implemented at two sites. Secondary outcomes include increased competency of residents and a change in responsibilities among health care team members. The COECA modelprovides an easy-to-apply and efficient method for documenting actual progress and determining potentialforfurther development.

Get full access to this article

View all access options for this article.

References

Backer, T. E. (1991). Knowledge utilization: The third wave. Knowledge: Creation, Diffusion, Utilization, 12(3), 225-240.

Blumberg, P. , Daly, S. , Dodd, P. , & Ploegg, J. (1991, October). Teaching the use of community resources. Workshop presented at the Annual Scientific and Educational Meeting of the Canadian Association on Gerontology, Toronto, Ontario.

Blumberg, P. , & Deveau, E. J. (1993, October). An easy approach to evaluating clinical and educational programs. Workshop presented at the annual meeting of the Canadian Association on Gerontology, Montreal, Quebec.

Blumberg, P. , Karuza, J. , & Deveau, E. J. (1992, November). Using evaluations to manage educational programs. Workshop presented at the annual meeting of the Association of American Medical Colleges, New Orleans, LA.

Blumberg, P. , & Macpherson, A. S. (1992). An exploratory study of the adequacy of residency education in geriatrics: A methodological description. Family Medicine, 24, 123-127.

Blumberg, P. , & Macpherson, A. S. (1993). Increasing geriatrics in a family medicine residency program. Gerontology and Geriatrics Education, 14, 57-69.

Campbell, D. T. (1979). Assessing the impactof planned social change. Evaluation and Program Planning, 2, 67-90.

Campbell, D. T. , & Stanley, J. C. (1963). Experimental and quasi-experimental designs for research. Chicago: Rand McNally.

Cronbach, L. J. , Ambron, S. R. , Dornbusch, S. M. , Hess, R. D. , & Hornik, R. C. (1980). Towards reform of program evaluation. San Francisco: Jossey-Bass.

10.

Davis, D. A. , Thompson, M. A. , Oxman, A. D. , & Haynes, B. (1992). Evidence for the effectiveness of CME: Areview of 50 randomized controlled trials. Journal of the American Medical Association, 268, 1111-1117.

11.

Dunn, W. N. , & Holzner, B. (1988). Anatomy of an emergent field. Knowledge in Society, 1 (1), 3-26.

12.

Field, M. J. , & Lohr, K. N. (1992). Guidelines for clinical practice: From development to use. Oxford: Oxford University Press.

13.

Glaser, E. M. , Abelson, H. H. , & Garrison, K. N. (1983). Putting knowledge to use: Facilitating the diffusion of knowledge and the implementing of planned change. San Francisco: JosseyBass.

14.

Guba, E. G. , & Lincoln, Y. S. (1989). Fourth generation evaluation. Newbury Park, CA: Sage.

15.

Haynes, R. B. , Davis, D. A. , & McKibbon, A. (1984). A critical appraisal of the efficacy of continuing medical education. Journal of the American Medical Association, 251, 61-64.

16.

Klein, S. S. , & Gwualtney, M. K. (1991). Charting the education dissemination system: Where we are and where we go from here. Knowledge: Creation, Diffusion, Utilization, 12(3), 241-265.

17.

Patton, M. Q. (1982). Practical evaluation. Newbury Park, CA: Sage.

18.

Patton, M. Q. (1986). Utilization-focused evaluation (2nd ed.). Newbury Park, CA: Sage.

19.

Popham, W. J. (1991). A slice of advice. Educational Researcher, 20(9), 18-18, 35-35.

20.

Price, R. (1993). Evaluation of a workshop given on the use of community resources to family practice residents. Unpublished report, McMaster University, Hamilton, Ontario.

21.

Scriven, M. S. (1983). Evaluation ideologies. In G. F. Madaus , M. Scriven , & D. L. Stufflebeam (Eds.), Evaluation models: Viewpoint on educational and human services evaluation (pp. 229-260). Boston: Kluwer-Nijhoff.

22.

Shadish, W. R., Jr. , Cook, T. D. , & Leviton, L. C. (1991). Foundations of program evaluation. Newbury Park, CA: Sage.

23.

Stake, R. E. (1986). An evolutionary view of education improvement. In E. House (Ed.), New directions in educational evaluation (pp. 89-102). London: Farmer.

24.

Streiner, D. L. , & Norman, G. R. (1989). Health measurement scale: A practical guide to their development and use. Oxford: Oxford University Press.

25.

Weiss, C. H. (1988). Evaluations for decisions: Is anybody there? Does anybody care? Evaluation Practice, 9, 5-20.

26.

Weiss, C. H. , & Bucuvalas, M. J. (1980). Social science research and decision-making. New York: Columbia University Press.

Using a New Program Evaluation Model to Chart the Outcomes of an Educational Intervention in Residency Training

Abstract

Get full access to this article

References