A Mentoring Approach to the One-Year Evaluation Course

Abstract

This article presents the conceptual scheme for a one-year evaluation course. The scheme is based on the experience of the authors in developing a single-year evaluation course over a period of four years. The task of the evaluation course is to teach the competencies required to conduct evaluations that provide the sense-making needed for informed decision-making. Such competencies include eliciting, conceptualizing, and providing information, as well as interactions, processes, and experiences required to conduct evaluations that provide the sense-making needed for informed decision-making. The authors have found that these competencies are based on four kinds of knowledge: theoretical, methodological, conceptualization of practice (including converting tacit to explicit knowledge) and practical personal knowledge. These knowledge categories entail a dialog between theory and practice. Hence, the authors have constructed a conceptual setting for teaching evaluation against the background of mentoring, a system that combines theory and practice. The article presents each kind of knowledge, explaining its role in evaluation, the type of learning needed to master it, and the format adopted in the course for teaching it, including the dilemmas that arose in the course of study and practice. Solutions for such dilemmas are offered and discussed. The article ends with a discussion of student feedback on the course.

Get full access to this article

View all access options for this article.

References

Adams, H. G. (1992). Mentoring: An essential factor in the doctoral process for minority students. Notre Dame, IN: The GEM Program.

Ball, D. , & Cohen, D. (1999). Developing practice, developing practitioners: Toward a practice based theory of professional education. In G. Sykes & L. Darling-Hammond (Eds.), Teaching as the learning profession: Handbook of policy and practice (pp. 3-32). San Francisco, CA: Jossey-Bass.

Brisolara, S. (1998). The history of participatory evaluation and current debates in the field. In E. Whitmore (Ed.), Understanding and practicing participatory evaluation, new directions for evaluation (Vol. 80, pp. 25-41). San Francisco, CA: Jossey-Bass.

Committee on Science, Engineering, and Public Policy . (1995). On being a scientist: Responsible conduct in research. Washington, D.C.: National Academy Press.

Committee on Science, Engineering, and Public Policy . (1997). Committee on science, engineering, and public policy. Washington, DC: National Academy Press. Available at: http://www.rackham.umich.edu/StudentInfo/Publications/FacultyMentoring/Fmentor.pdf.

Cousins, J. B. , & Whitmore, E. (1998). Framing participatory evaluation. In E. Whitmore (Ed.), Understanding and practicing participatory evaluation, new directions for evaluation (Vol. 80, pp. 5-23). San Francisco, CA: Jossey-Bass.

Darabi, A. (2002). Teaching program evaluation: Using a systems approach. American Journal of Evaluation, 23, 219-228.

Dewey, J. (1933). How we think: a restatement of the relation of reflective thinking to the educative process. Boston, MA: Heath.

Feiman-Nemser, S. (1998). Teachers as teacher educators. European Journal of Teacher Education, 21, 63-74.

10.

Feiman-Nemser, S. (2001). Helping novices learn to teach: Lessons from an exemplary support teacher. Journal of Teacher Education, 52, 17-30.

11.

Feiman-Nemser, S. , & Parker, M. (1993). Mentoring in context: A comparison of two U.S. programs for beginning teachers. International Journal of Educational Research, 19, 699-718.

12.

Fetterman, D. M. , Kaftarian, A. J. , & Wandersman, A. (Eds.). (1996). Empowerment evaluation: Knowledge and tools for self-assessment and accountability. Thousand Oaks, CA: Sage.

13.

Gredler, M. E. , & Johnson, R. L. (2001). Lessons learned from the directed evaluation experience. American Journal of Evaluation, 22, 97-104.

14.

Green, S. G. , & Bauer, T. N. (1995). Supervisory mentoring by advisor: Relationships with doctoral students potential, productivity and commitment. Personnel Psychology, 48, 537-561.

15.

King, J. A. , Stevahn, L. , Ghere, G. , & Minnema, J. (2001). Toward a taxonomy of essential evaluator competencies. American Journal of Evaluation, 22, 229-247.

16.

Lave, J. , & Wenger, E. (1991). Situated learning legitimate peripheral participation. New York, NY: Cambridge University Press.

17.

Levin-Rozalis, M. (1998). Evaluation and research: Are they the same? Megamot, Behavioral Sciences Quarterly, 39, 303-319 (Hebrew).

18.

Levin-Rozalis, M. (2000). Abduction, a logical criterion for program evaluation. Evaluation, the International Journal of Theory, Research and Practice, 6, 411-428.

19.

London, J. (2001). How to mentor graduate students: A guide for faculty in a diverse university. University of Michigan, Ann Arbor, MI: Rackham School of Graduate Studies. Retrieved from: www.rackham.umich.edu/StudentInfo/Publications/FacultyMentoring.

20.

Mertens, D. M. (1994). Training evaluators: Unique skills and knowledge. In J. W. Altschuld & M. Engle (Eds.), The preparation of professional evaluators: Issues, perspectives, and programs, new directions for program evaluation (Vol. 62, pp. 17-27). San Francisco, CA: Jossey-Bass.

21.

Mezirow, J. (1991). Making meaning through reflection. In J. Mezirow (Ed.), Transformative dimensions of adult learning (pp. 99-117). San Francsco, CA: Jossey-Bass.

22.

Morris, M. (1994). The role of single evaluation courses in evaluation training. In J. W. Altschuld & M. Engle (Eds.), The preparation of professional evaluators: Issues, perspectives, and programs, new directions for program evaluation (Vol. 62, pp. 51-59). San Francico, CA: Jossey-Bass.

23.

Morris, M. (1999). Research on evaluation ethics: What have we learned and why is it important? In J. L. Fitzpatrick & M. Morris (Eds.), Current and emerging ethical challenges in evaluation, new directions for evaluation (Vol. 82, pp. 15-24). San Francico, CA: Jossey-Bass.

24.

Polanyi, M. (1958). Personal knowledge. Chicago, IL: University of Chicago Press.

25.

Preskill, H. , & Torres, R. T. (1999). Building capacity for organizational learning through evaluation inquiry. Evaluation, The International Journal of Theory, Research and Practice, 5, 42-60.

26.

Rosenstein, B. (2002). The sorcerer’s apprentice and the reflective practitioner. Reflective Practice, 3, 255-261.

27.

Schön, D. A. (1983). The reflective practitioner: How professionals think in action. New York, NY: Basic Books.

28.

Schön, D. A. (1987). Educating the reflective practitioner: Toward a new design for teaching and learning in the professions. San Francisco, CA: Jossey-Bass.

29.

Shulman, L. (1987). Knowledge and teaching: Foundations of the new reform. Harvard Educational Review, 57, 1-22.

30.

Trevisan, M. S. (2002). Enhancing practical evaluation training through long-term evaluation projects. The American Journal of Evaluation, 23, 81-92.

31.

Wayne State University Graduate School . (1992). Handbook for Advising doctoral students.

32.

Zelditch, M. (1990). Mentor roles. Proceedings of the 32nd Annual Meeting of the Western Association of Graduate Schools, Tempe, Arizona, March 1990.