Excessive evaluation anxiety (XEA) can be a destructive phenomenon in modern program evaluation. Some of the negative consequences include: Lack of access to important information and data; compliance and cooperation problems; false reporting; effects on bias and validity; and reduced utilization of evaluation findings. If left alone, XEA can lead stakeholders to behave in ways that destroy the credibility of evaluation findings and evaluators. The purpose of this paper is to examine the sources and signs of XEA in program evaluation, and to provide practicing evaluators with strategies to prevent and manage this common problem. This example of how more than technical skills are required to conduct high quality program evaluations illustrates the need for and begins a broader discussion of the psychology of evaluation.
Get full access to this article
View all access options for this article.
References
1.
Arnkoff, D. B., Glass, C. R., & Robinson, A. S. (1992). Cognitive processes, anxiety, and performance of doctoral dissertation oral examinations. Journal of Counseling Psychology, 39, 382-388.
2.
Beck, A. T. (1989). Evaluation anxieties. In C. Lindemann (Ed.), Handbook of phobia therapy (pp. 89-112). Northvale, NJ: Aronson.
3.
Donaldson, S. I. (2001). Overcoming our negative reputation: Evaluation becomes known as a helping profession. American Journal of Evaluation, 22, 355-361.
4.
Donaldson, S. I. (2002). Theory-driven program evaluation in the new millennium. In S. I. Donaldson & M. Scriven (Eds.), Evaluating social programs and problems: Visions for the new millennium (pp. 109-141). Mahwah, NJ: Erlbaum.
5.
Donaldson, S. I., & Gooler, L. E. (2002a). Theory-driven evaluation of the work and health initiative: A focus on winning new jobs. American Journal of Evaluation.
6.
Donaldson, S. I., & Gooler. L. E. (2002b). Theory-driven evaluation in action: Lessons from a $20 million statewide work and health initiative. Manuscript under review.
7.
Donaldson, S. I., & Scriven, M. (2002a). Diverse visions for program evaluation: Should we integrate or embrace diversity? In S. I. Donaldson & M. Scriven (Eds.), Evaluating social programs and problems: Visions for the new millennium (pp. 3-16). Mahwah, NJ: Erlbaum.
8.
Donaldson, S. I., & Scriven, M. (Eds.) (2002b). Evaluating social programs and problems: Visions for the new millennium. Mahwah, NJ: Erlbaum.
9.
Fitzpatrick, J. (in press). Dialog with Stewart Donaldson. American Journal of Evaluation.
10.
Hope, D. A. & Heimberg, R. G. (1990). Dating anxiety. In H. Leitenberg (Ed.), Handbook of social and evaluation anxiety (pp. 217-246). New York: Plenum Press.
11.
Joint Committee on Standards for Educational Evaluation. (1994). The program evaluation standards (2nd ed.). Thousand Oaks, CA: Sage.
12.
Kean, D. K., Glynn, S. M., & Britton, B. K. (1987). Writing persuasive documents: The role of students’ verbal aptitude and evaluation anxiety. Journal of Experimental Education, 40, 95-102.
13.
Klass, E. T. (1990). Guilt, shame, and embarrassment: Cognitive-behavioral approaches. In H. Leitenberg (Ed.), Handbook of social and evaluation anxiety (pp. 385-416). New York: Plenum Press.
14.
Leitenberg, H. (1990). Handbook of social and evaluation anxiety. New York: Plenum Press.
15.
Mark, M. M. (2002). Toward an integrative view of the theory and practice of program and policy evaluation. In S. I. Donaldson & M. Scriven (Eds.), Evaluating social programs and problems: Visions for the new millennium (pp. 183-204). Mahwah, NJ: Erlbaum.
16.
Mark, M. M., Henry, G. T., & Julnes, G. (2000). Evaluation: An integrated framework for understanding, guiding, and improving policies and programs. San Francisco: Jossey-Bass.
17.
Marshall, L. L., & Smith, A. (1986). The effects of demand characteristics, evaluation anxiety, and expectancy on juror honesty during voir dire. The Journal of Psychology, 120(3), 205-217.
18.
Rose, T. F., & Jason, L. A. (1988). The effects of program evaluation feedback on staff attitudes. Community Mental Health Journal, 24, 236-239.
19.
Rossi, P. H., Freeman, H. E., & Lipsey, M. W. (1999). Evaluation: A systematic approach (6th ed.). Thousand Oaks, CA: Sage.
20.
Sanders, J. R. (2001). A vision for evaluation. American Journal of Evaluation, 22, 363-366.
21.
Sanders, J. R. (in press). Presidential address: On mainstreaming evaluation. American Journal of Evaluation, 23.
22.
Sarason, I. G., & Sarason, B. R. (1990). Test anxiety. In H. Leitenberg (Ed.), Handbook of social and evaluation anxiety (pp. 475-496). New York: Plenum Press.
23.
Scriven, M. (1991). Evaluation thesaurus (4th ed.). Newbury Park, CA: Sage.
24.
Scriven, M. (2001). Index of cooperation in evaluation. Technical report, Claremont Graduate University.
25.
Scriven, M. (2002). Evaluation in the new millennium: The transdisciplinary vision. In S. I. Donaldson & M. Scriven (Eds.), Evaluating social programs and problems: Visions for the new millennium (pp. 19-42). Mahwah, NJ: Erlbaum.
26.
Shadish, W. R., Cook, T. D., & Campbell, D. T. (2001). Experimental and quasi-experimental designs for generalized causal inference. Boston, MA: Houghton-Mifflin.
27.
Shadish, W. R., Cook, T. D., & Leviton, L. C. (1991). Foundations of program evaluation: Theories of practice. Newbury Park, CA: Sage.
28.
Shadish, W. R., Newman, D. L., Scheirer, M. A., & Wye, C. (Eds.) (1995). Guiding Principles for Evaluators, New Directions for Program Evaluation, No. 66. San Francisco: Jossey-Bass.
29.
Shauer, A. H., Seymour, W. R., & Geen, R. G. (1985). Effects of observation and evaluation on anxiety in beginning counselors: A social facilitation analysis. Journal of Counseling and Development, 63, 279-285.
30.
Shermis, M. D., & Lombard, D. (1998). Effects of computer-based test administrations on test anxiety and performance. Computers in Human Behavior, 14(1), 111-123.
31.
Smith, R. E., & Smoll, F. (1990). Sport performance anxiety. In H. Leitenberg (Ed.), Handbook of social and evaluation anxiety (pp. 417-454). New York: Plenum Press.
32.
Stufflebeam, D. L. (2001). Evaluation models. New Directions for Evaluation, No. 89. San Francisco: Jossey-Bass.
33.
Weiss, C. H. (1988). Evaluation for decisions: Is there anybody there? Does anybody care?Evaluation Practice, 9, 5-19.
34.
Weiss, C. H. (1998). Evaluation: Methods for studying programs and policies (2nd ed.). Upper Saddle River, NJ: Prentice Hall.
