Using stratified random sampling of the membership directories of the Evaluation
Network and the Evaluation Research Society, we surveyed the practices of program
evaluators. Those practices factored into four patterns—academic evaluation, stakeholder
service evaluation, decision-driven evaluation, and outcome evaluation. The patterns
were differentially related to such factors as disciplinary background, organizational
setting, and evaluation theory.
Get full access to this article
View all access options for this article.
References
1.
Aaronson, N.K. and D.M. Wilner (1983) "Evaluation and outcome research in community mental health centers." Evaluation Rev.7: 303-320.
2.
American Evaluation Association (1986) Membership Directory. Charlottesville: Evaluation Research Center, Curry School of Education , University of Virginia.
3.
Baker, F. (1982) "Program evaluators in community mental health centers: results of a national survey." J. of Community Psychology10: 151-156.
4.
Bank, A. and R. C. Williams [eds.] (1981) "Evaluation in school districts: organizational perspectives." Los Angeles: Center for the Study of Evaluation, University of California.
5.
Boruch, R.F. and D.S. Cordray (1980) "An appraisal of educational program evaluations: federal, state and local agencies." Report submitted to Department of Education under Contract 300-79-0467. Evanston, IL: Northwestern University.
6.
Campbell, D.T. (1971) "Methods for the experimenting society." Presented at the meetings of the Eastern Psychological Assn, New York, and the Amer. Psych. Assn., Washington, DC.
7.
Campbell, D.T. and J.C. Stanley (1963) Experimental and Quasi-Experimental Designs for Research. Chicago: Rand McNally .
8.
Caulley, D.N. and N.L. Smith (1978) Field Assessment Survey (Research on Evaluation Program Paper and Report Series, No. 10). Portland, OR : Northwest Regional Educ. Laboratory.
9.
Caulley, D.N. and N.L. Smith (1980) "Program evaluation in State Department of Education ." Evaluation News (Winter): 37-38.
10.
Cook, T.D. and W.R. Shadish (1982) "Metaevaluation: an assessment of the congressionally mandated evaluation system for community mental health centers," pp. 221-253 in G. Stahler and W. R. Tash (eds.) Innovative Approaches to Mental Health Evaluation. New York: Academic Press.
11.
Cook, T.D. and W.R. Shadish (1986) "Program evaluation: the worldly science." Annual Rev. of Psychology37: 193-232.
12.
Cordray, D. S. and M. L. Lipsey [eds.] (1987) Evaluation Studies Review Annual, Vol. 11. Newbury Park, CA: Sage.
13.
Cronbach, L.J. (1982) Designing Evaluations of Educational and Social Programs. San Francisco: Jossey-Bass.
14.
Flaherty, E.W. and C. Windle (1981) "Mandated evaluation in community mental health centers: framework for a new policy." Evaluation Rev.5: 620-630.
15.
Guba, E.G. and Y.S. Lincoln (1981) Effective Evaluation: Improving the Usefulness of Evaluation Results Through Responsive and Naturalistic Approaches. San Francisco: Jossey-Bass.
16.
Hendricks, M. (1986) "A conversation with Michael Wargo." Evaluation Practice7: 23-24.
17.
Jones, T.W. and R.L. Cole (1984) "A survey of program evaluators in community mental health centers in Tennessee." Evaluation News5: 45-49.
18.
Kennedy, M.M. ( 1983) "The role of the in-house evaluator." Evaluation Rev.7: 519-541.
19.
Lyon, C., L. Doscher, P. McGranahan, and R. Williams (1978) "Evaluation and school districts." Los Angeles: Center for the Study of Evaluation, University of California.
20.
Majchrzak, A. and C. Windle (1980) "Patterns of program evaluation in community mental health centers." Evaluation Rev.4: 677-691.
21.
Nagel, S. (1985) "Evaluation research and policy studies." Evaluation News6: 59-65.
22.
Peck, D.L. and H.J. Rubin (1983) "Bureaucratic needs and evaluation research: a case study of the Department of Housing and Urban Development." Evaluation Rev.7: 685-703.
23.
Raizen, S. A. and P. H. Rossi [eds.] (1981) Program Evaluation in Education: When? How? To What Ends?" Washington, DC: National Academy Press.
24.
Rossi, P.H. and H.E. Freeman ( 1982) Evaluation: A Systematic Approach (2nd ed.). Newbury Park, CA: Sage.
25.
Scriven, M. (1980) The Logic of Evaluation. Inverness, CA: Edgepress.
26.
Shadish, W.R. (1984) "The political economy of social program evaluation ." Presented at the annual convention of the Evaluation Research Society, San Francisco, October.
Shadish, W.R. (1986b) "Sources of evaluation practice: needs, purposes, questions, and technology," pp. 149-183 in L. Bickman and D. L. Weatherford (eds.) Evaluating Early Intervention Programs for Severely Handicapped Children and Their Families . Austin, TX: Pro-Ed.
29.
Shadish, W.R., T.D. Cook, and A.C. Houts (1986) "Quasi-experimentation in a critical multiplist mode," pp. 29-46 in W.M.K. Trochim (ed.) Advances in Quasi-Experimental Design and Analysis. San Francisco: Jossey-Bass.
30.
Sheinfeld, S.N. and G.L. Lord (1981) "The ethics of evaluation research: an exploration of value choices." Evaluation Rev.5: 377-391.
31.
Smith, N.L. (1984) "Evaluation units in state departments of education: a five year update." Evaluation News5: 37-44.
32.
Smith, N. L. and D. N. Caulley [eds.] (1982) The Interaction of Evaluation and Policy: Case Reports from State Education Agencies. Portland, OR: Northwest Regional Educ. Laboratory.
33.
Stake, R.E. (1978) "The case study method in social inquiry." Educ. Researcher7: 5-8.
34.
U.S. General Accounting Office (1982) A Profile of Federal Program Evaluation Activities (Institute for Program Evaluation: Special Study 1). Washington, DC: Author.
35.
Weiss, C.H. (1972) Evaluation Research: Methods for Assessing Program Effectiveness. Englewood Cliffs, NJ: Prentice-Hall.
36.
Weiss, C.H. (1978) "Improving the linkage between social research and public policy," pp. 23-81 in L. L. Lynn (ed.) Knowledge and Policy: The Uncertain Connection. Washington, DC: National Academy of Sciences.
37.
Wholey, J.S. (1983) Evaluation and Effective Public Management. Boston: Little, Brown.
38.
Wholey, J.S. and B.F. White (1973) "Evaluation's impact on Title I elementary and secondary education program management." Evaluation1: 73-76.
39.
Zwick, W.R. and W.F. Velicer (1986) "Comparison of five rules for determining the number of components to retain." Psych. Bull.99: 432-442.
