This article discusses an exploratory study designed to determine the extent to which evaluation professionals, representing diverse backgrounds and approaches, could reach agreement on a proposed taxonomy of essential evaluator competencies. Participants were 31 diverse individuals in the field of program evaluation in the greater Minneapolis-St. Paul, Minnesota area who systematically engaged in a Multi-Attribute Consensus Reaching process. Both quantitative and qualitative results predominantly indicated consensus on more than three-fourths of the proposed competencies. Areas of disagreement reflected the role- and context-specific nature of evaluation practice.
Get full access to this article
View all access options for this article.
References
1.
Altschuld, J. W. (1995). Developing an evaluation program: Challenges in the teaching of evaluation. Evaluation and Program Planning, 18, 259-265.
2.
Altschuld, J. W. (1999). The certification of evaluators: Highlights from a report submitted to the Board of Directors of the American Evaluation Association. American Journal of Evaluation, 20, 481-493.
3.
Altschuld, J. W., & Bickman, L. (1998). Be it resolved that evaluators should be certified (credentialed): The pro side of the issue. Paper presented at the annual meeting of the American Evaluation Association, Chicago, IL.
4.
American Evaluation Association, Task Force on Guiding Principles for Evaluators. (1995). Guiding principles for evaluators. In W. R. Shadish, D. L. Newman, M. A. Scheirer, & C. Wye (Eds.), Guiding Principles for Evaluators. New Directions for Program Evaluation, 66 (pp. 19-26). San Francisco: Jossey-Bass.
5.
Anderson, S. B., & Ball, S. (1978). The profession and practice of program evaluators. San Francisco: Jossey-Bass.
6.
Covert, R. W. (1992). Successful competencies in preparing professional evaluators. Paper presented at the annual meeting of the American Evaluation Association, Seattle, WA.
7.
Ingle, M. D., & Klauss, R. (1980). Competency-based program evaluation: A contingency approach. Evaluation and Program Planning, 3, 277-287.
8.
Joint Committee on Standards for Educational Evaluation. (1994). The program evaluation standards (2nd ed.). Thousand Oaks, CA: Sage.
9.
Jones, S., & Worthen, B. R. (1999). AEA members’ opinions concerning evaluator certification. American Journal of Evaluation, 20, 495-506.
10.
Joyce, B., & Weil, M. (1996). Models of teaching (5th ed.). Boston, MA: Allyn and Bacon.
11.
King, J. A., Minnema, J., Ghere, G., & Stevahn, L. (1998). Evaluator competencies. Paper presented at the annual meeting of the American Evaluation Association, Chicago, IL.
12.
King, J. A., Minnema, J. E., Ghere, G., & Stevahn, L. (1999). Essential evaluator competencies. Minneapolis, MN: University of Minnesota, Program Evaluation Studies.
13.
Mertens, D. M. (1994). Training evaluators: Unique skills and knowledge. In J. W. Altschuld & M. Engle (Eds.), The preparation of professional evaluators: Issues, perspectives, and programs. New Directions for Program Evaluation, 62 (pp. 17-27). San Francisco: Jossey-Bass.
14.
Merwin, J. C., & Weiner, P. H. (1985). Evaluation: A profession?Educational Evaluation and Policy Analysis, 7, 253-259.
15.
Patton, M. Q. (1990). The challenge of being a profession. Evaluation Practice, 11, 45-51.
16.
Sanders, J. R. (1979). The technology and art of evaluation. A review of seven evaluation primers. Evaluation News, 12, 2-7.
17.
Sanders, J. R. (1986). The teaching of evaluation in education. In B. G. Davis (Ed.), Teaching evaluation across the disciplines. New Directions for Program Evaluation, 29 (pp. 15-27). San Francisco: Jossey-Bass.
18.
Smith, M. F. (1998). Should AEA begin a process for restricting membership into the profession of evaluation? Paper presented at the meeting of the annual American Evaluation Association, Chicago, IL.
19.
Smith, M. F. (1999). Should AEA begin a process for restricting membership in the profession of evaluation?American Journal of Evaluation, 20, 521-531.
20.
Vanderwood, M. L., & Erickson, R. (1994). Consensus building. Special Services in the Schools, 9, 99-113.
21.
Worthen, B. R. (1975). Some observations about the institutionalization of evaluation. Evaluation Practice, 16, 29-36.
22.
Worthen, B. R. (1999). Critical challenges confronting certification of evaluators. American Journal of Evaluation, 20, 533-555.
23.
Worthen, B. R., & Sanders, J. R. (1991). The changing face of educational evaluation. Theory into Practice, 30, 3-12.
