Decision Makers' Judgments

Abstract

Evaluators often assume that outcome studies assessing agency effectiveness should pro vide the most relevant data for decision makers who must form judgments about treat ment in order to make policy, program, and clinical decisions. Yet evaluators have found that decision makers often fail to use results of evaluation studies. To shed light on the utilization problem, the research reported here was undertaken to learn about the criteria, information sources, and beliefs decision makers in the environment of nine drug treat ment agencies used to form judgments about treatment programs before evaluative data concerning outcomes became available. The results showed that decision makers in different occupations tended to use similar information sources (primarily informal verbal exchanges) yet used different evaluative criteria to judge treatment programs. The impli clations of these results for the design of evaluation studies and utilization of evaluation results are discussed.

Get full access to this article

View all access options for this article.

References

Bigelow, D.A. (1975) “The impact of therapeutic effectiveness data on community health center management: the systems evaluation project .” Community Mental Health J. 11 1: 64-73.

Cain, G.C. and H.W. Watts (1970) “Problems in making policy inferences from the Coleman Report.” Amer. Soc. Rev. 35, 2: 228-242

Campbell, D.T. (1969) “Reforms as experiments.” Amer Psychologist 24, 4: 409-429.

Cohen, D.K. and M.S. Garet (1975) “Reforming educational policy with applied social research.” Harvard Educational Rev. 45, 1: 17-41.

Cox, G. ( 1977) “Managerial style: implications for the utilization of program evaluation information.” Evaluation Q. 1,3: 499-507.

Davis, H.R. and S.E. Salashin (1975) “The utilization of evaluation,” pp. 621-666 in E. L. Struening and M. Guttentag (eds.) Handbook of Evaluation Research, Vol. 1. Beverly Hills: Sage.

Dill, W.R. (1959) “Environment as an influence on managerial autonomy.” Admin. Sci. Q. 2 (March): 409-443.

Edwards, W. , M. Guttentag ,and K. Snapper (1975) “A decision theoretic approach to evaluation research,” pp. 139-181 in E. L Struening and M Guttentag (eds.) Handbook of Evaluation Research, Vol. 1. Beverly Hills: Sage

Freeman, M.E. and C.C. Sherwood (1970) Social Research and Social Policy. Englewood Cliffs, NJ: Prentice-Hall.

10.

Glazer, E.M. and S.H. Taylor (1969) “Factors influencing the success of applied research.” Amer. Psychologist 28, 2 140-146

11.

Hawer, W.S. and M. Bawden ( 1972) “The use of experimentation in policy formulation and evaluation.” Urban Affairs Q 7, 4 419-430

12.

Horst, P. , B.W. Scanlon , and J.S. Wholey (1974) “Program management and the federal evaluator .” Public Admin. Rev 34, 4: 300-303

13.

Mintzberg, M. (1973) The Nature of Managerial Work. New York: Harper & Row.

14.

Nelson, C. and D.L. Morgan (1973) “The information system of a community mental health center.” Admin in Mental Health (Fall) 26-38

15.

Patton, M.Q. (1975) “In search of impact an analysis of the utilization of federal evaluation research.” Minneapolis. University of Minnesota Center for Social Research.

16.

Rosenblatt, A. (1968) “The practitioners use and evaluation of research.” Social Work 13, 1: 53-59.

17.

Rossi, P.H. (1975) “Policy shibboleths and the reality-testing for research are the poor always with us when we make sociology?*)“ pp. 15-24 in N. B. Demerath , O. Larson , and K. F. Scheussler (eds.) Social Policy and Sociology. New York: Academic Press.

18.

??? ( 1972) “Testing for success and failure in social action ,” pp. 11-49 in P H. Rossi and W. Williams (eds.) Evaluating Social Programs. Theory, Practice and Politics. New York: Seminar Press.

19.

Rothman, J. (1974) Planning and Organizing for Social Change. New York. Columbia Univ. Press.

20.

Rubenstein, H. (1972) “Behavioral factors influencing the adoption of an experimental information system by medical researchers and clinicians in six hospitals.” Catalog of Selected Documents in Psychology 2 (Summer) 101-102.

21.

Thompson, J. D (1967) Organizations in Action. New York: McGraw-Hill.

22.

Walker, W.L. (1972) “Utilizing research fundings for macro system intervention,” pp. 90-110 in E. J. Mullen and J. D. Dumpson (eds.) Evaluation of Social Intervention. San Francisco: Jossey-Bass.

23.

Weiss, C H. (1972) “ Utilization of evaluation: toward comparative study,” pp. 318-326 in C. H. Weiss (ed ) Evaluating Action Programs . Boston: Allyn & Bacon.

24.

——— (1970) “The politicization of evaluation research .” J. of Social Issues 26,4: 57-68.

25.

Williams, W. (1971) Social Policy Research and Analysis. New York: American Elsevier.

26.

??? and J.W. Evans (1969) “The politics of evaluation: the case of Head Start.” Annuals of the Amer. Academy of Pol. and Social Sci. 386 (September) 118-132.