Should AEA Begin a Process for Restricting Membership in the Profession of Evaluation?

Abstract

In this paper I present an argument supporting the position that AEA should not undertake a certification or similar process at the present time, even though I believe the public needs some type of protection from unscrupulous and incompetent evaluators. The problems a certification process would solve have not been substantiated; the public may not support such an endeavor; “evaluation” is not clearly defined, which means the knowledge and skills (K/S) unique to its practice and performance criteria are not agreed upon; and the process for putting a certification system into place is a very complex and costly undertaking (e.g., ensuring the accuracy and integrity of determining who does and does not have the requisite K/S and who is applying them in an effective manner). In addition, certification would require establishing some way to decertify incompetent practitioners, and being able to defend all of these actions when there is disagreement and even litigation. I believe that AEA is not likely to be able to do these things in an effective manner, in the near future.

Get full access to this article

View all access options for this article.

References

American Evaluation Association , Task Force on Guiding Principles for Evaluation . (1995). In W.R. Shadish , D.L. Newman , M.A. Scheirer , & C. Wye , (Eds.) Guiding principles for evaluation. New Directions for Program Evaluation, 66, 19-26. San Francisco: Jossey-Bass.

Boothe, B. (1984). Certification-beyond reason. Performance and Instruction Journal, 23, 19-20.

Bogue, E. G. , & Saunders, R. (1992). The evidence for quality. San Francisco: Jossey-Bass.

Dawes, R. (1994). House of cards. New York: The Free Press.

Fortune, J. (1985). Understanding testing in occupational licensing. San Francisco: Jossey-Bass.

Freidson, E. (1983). The reorganization of the profession by regulation. Law and Human Behavior, 7, 279-289.

Hogan, D. B. (1983). The effectiveness of licensing. Law and Human Behavior, 7, 117-138.

Lincoln, Y. S. (1985). The ERS standards for program evaluation. Evaluation and Program Planning, 8, 151-253.

Mertens, D. M. (1994). Training evaluators: Unique skills and knowledge. In J. W. Altschuld & M. Engle (Eds.), The preparation of professional evaluation: Issues, perspectives and programs. New Directions for Program Evaluation, 62, 17-28. San Francisco: Jossey-Bass.

10.

Morell, J. A. , & Flaherty, E. W. (1978). The development of evaluation as a profession: Current status and some predictions. Evaluation and Program Planning, 1, 11-17.

11.

Morris, M. , & Cohn, R. (1993). Program evaluators and ethical challenges: A national survey. Evaluation Review, 17, 621-642.

12.

Newman, D. L. (1995). The future of ethics in evaluation: Developing the dialogue. In W. R. Shadish , D.L. Newman , M.A. Scheirer , & C. Wye (Eds.), Guiding principles for evaluators. New Directions for Program Evaluation, 66, 99-110. San Francisco: Jossey-Bass.

13.

Patton, M. Q. (1990). The challenge of being a profession. Evaluation Practice, 11, 45-51.

14.

Raven, J. (1984). Some limitations of the standards. Evaluation and Program Planning, 7, 363-370.

15.

Rossi, P. H. (1995). Doing good and getting it right. In W. R. Shadish , D.L. Newman , M.A. Scheirer , & C. Wye (Eds.), Guiding principles for evaluators. New Directions for Program Evaluation, 66, 55-59. San Francisco: Jossey-Bass.

16.

Rossi, P. H. (1998). Personal communication.

17.

Sanders, J. (1995). Correspondence on EvalTalk, a Listserve of the American Evaluation Association.

18.

Scriven, M. (1996). Types of evaluation and types of evaluator. Evaluation Practice, 17, 151-161.

19.

Scriven, M. (1998). Correspondence on EvalTalk, a Listserve of the American Evaluation Association.

20.

Walsh, K. (1994). Quality, surveillance and performance measurement. In K. A. Riley & D. L. Nuttall (Eds.), Measuring quality: Education indicators—United Kingdom and international perspectives (pp. 49-68). Bristol, PA: The Falmer Press.

21.

Worthen, B. R. (1994). Is evaluation a mature profession that warrants the preparation of evaluation professionals? In J. W. Altschuld & M. Engle (Eds.), The preparation of professional evaluators: Issues, perspectives and programs. New Directions for Program Evaluation, 62, 3-15. San Francisco: Jossey-Bass.