Beyond the Technical and Bureaucratic Theories of Utilization

Abstract

Technical and bureaucratic considerations frame current theories of utilization. These theorees distract attention from the range of broad substantive knowledge evaluators have generated. Two proposals recognize that this knowledge reservoir can help promote use if its contents are properly organized; both, however, have limitations. Data synthesis assumes scores of statistically comparable studies. Social problem study groups are not well-designed for making the knowledge frontiers they define generally accessible. This article suggests supplementing these approaches to building knowledge with an increased emphasis on synthesizing reviews. Even though such reviews currently enjoy modest status at best, they serve to strengthen the profession and promote utilization.

Get full access to this article

View all access options for this article.

References

Armor, D.J. (1981) "White flight and the future of school desegregation ," pp. 212-251 in H. E Freeman and M. A. Solomon (eds.) Evaluation Studies Rev. Annual (Vol. 6). Beverly Hills, CA: Sage.

Banks, J. , and R.L. Rardin (1978) "Measurement practice in intensive and special adult probation." Evaluation Q. 2 (1): 127-140.

Boruch, R. F. , P. M. Wortman , D. S. Cordray , and Associates (eds.) (1981) Reanalyzing Program Evaluations: Policies and Practices for Secondary Analysis of Social and Educational Programs. San Francisco: Jossey-Bass.

Brier, S.S. and S.E. Fienberg (1980) "Recent econometric modeling of crime and punishment: support for the deterrence hypothesis?" Evaluation Rev. 4 (2): 147-191.

Campbell, D.T. (1972) "Reform as experiments," pp. 187-223 in C. Weiss (ed.) Evaluating Action Programs: Readings in Social Action and Education. Boston, MA: Allyn & Bacon.

Caplan, N. (1979) "The two-communities theory and knowledge utilization ." Amer. Behavioral Scientist 22 (3): 459-470.

Caro, F.G. (1980) "Leverage and evaluation effectiveness." Evaluation and Program Planning 3: 83-89.

Chen, H.T. and P.H. Rossi (1980) "The multi-goal, theory-driven approach to evaluation: a model linking basic and applied social science," pp. 38-54 in H. E. Freeman and M. A. Solomon (eds.) Evaluation Studies Review Annual (Vol. 6). Beverly Hills, CA: Sage.

Christoffel, T. and M. Loewenthal (1978) "Evaluating the quality of ambulatory health care: a review of emerging methods," pp. 306-326 in T. D. Cook and Associates (eds.) Evaluation Studies Review Annual (Vol. 3). Beverly Hills, CA: Sage.

10.

Conner, R.F. (1981) "Measuring evaluation utilization; a critique of different techniques," pp. 59-75 in J. A. Ciarlo (ed.) Utilizing Evaluation: Concepts and Measurement Techniques. Beverly Hills, CA: Sage.

11.

————( 1977) "Selecting a control group: an analysis of the randomization process in twelve social reform programs." Evaluation Q. 1 (2) 195-244.

12.

Cook, T.D. (1978) "Utilization, knowledge-building, and institutionalization: three criteria by which evaluation research can be evaluated," pp. 13-22 in Cook and Associates (eds.) Evaluation Studies Review Annual (Vol. 3). Beverly Hills, CA: Sage.

13.

———and Dobson, L.D. (1982) "Reaction to reexamination: more on type-III error in program evaluation." Evaluation and Program Planning 5: 119-121.

14.

Cronbach, L.J. and Associates (1980) Toward Reform of Program Evaluation: Aims, Methods, and Institutional Arrangements . San Francisco: Jossey-Bass.

15.

Denzin, N.L. (1970) The Research Act: A Theoretical Introduction to Sociological Methods. Chicago: Aldine.

16.

Dobson, D. and T.D. Cook (1980) "Avoiding type-III error in program evaluation ." Evaluation and Program Planning 4: 269-276.

17.

Dunn, W.N. , I.L. Mitroff , and S.J. Deutsch (1982) "The obsolescence of evaluation research." Evaluation and Program Planning 4: 207-218.

18.

Dunst, C.J. and R.M. Rheingrover (1981) "An analysis of the efficacy of infant intervention programs with organically handicapped children." Evaluation and Progam Planning 4: 287-323.

19.

Flaherty, E.W. and C. Windle (1981) "Mandated evaluation in community mental health centers." Evaluation Rev. 5, 5: 620-638.

20.

Freeman, H.E. and M.A. Solomon (1981) "Introduction: evaluatin and the uncertain '80's," in H. E. Freeman and M. A. Solomon (eds.) Evaluation Studies Review Annual (Vol. 6). Beverly Hills, CA: Sage.

21.

Fulcomer, M.C. , S.G. Pellegrini , and L.C. Lefebvre (1981) "Demographic and health-related predictors of sudden infant death." Evaluation and Program Planning 4: 43-56.

22.

Fuller, B. (1981) "Educational evaluation and shifting youth policy . Evaluation Rev. 5, 2: 167-188.

23.

Glass, G.V. (1976) "Primary, secondary, and meta-analysis of research ." Educational Researcher 10, 3: 3-8.

24.

Goodwin, L. (1978) "What has been learned from the work-incentive program and related experiences: a review of research with policy implications ," pp. 375-389 in T. D. Cook and Associates (eds.) Evaluation Studies Review Annual (Vol. 3). Beverly Hills, CA: Sage.

25.

Hanson, D.J. (1981) "Drug education: does it work?" pp. 572-603 in H. E. Freeman and M. A. Solomon (eds.) Evaluation Studies Review Annual (Vol. 6). Beverly Hills, CA. Sage.

26.

Hedrick, T.E. , R.F. Boruch , and J. Ross (1979) "On ensuring the availability of evaluative data for secondary analysis," pp. 385-406 in L. Sechrest and Associates (eds.) Evaluation Study Review Annual (Vol. 4). Beverly Hills, CA: Sage.

27.

Heilman, J.G. (1980) "Paradigmatic choices in evaluation methodology ." Evaluation Rev. 4, 5: 693-712.

28.

Heller, K. , R.H. Price , and K.S. Sher (1981) "Research and evaluation in primary prevention: issues and guidelines," pp. 527-555 in H. E. Freeman and M. A. Solomon (eds.) Evaluation Studies Review Annual (Vol. 6). Beverly Hills, CA: Sage.

29.

House, E.R. , G.V. Glass , L.D. McLean , and D.F. Walker (1978) "No simple answer: critique of the follow-through evaluation," pp. 611-640 in T. D. Cook and Associates (eds.) Evaluation Studies Review Annual (Vol. 3). Beverly Hills CA: Sage.

30.

Klein, R. (1982) "Evaluation and social policy: some reflections on ideas and institutions." Evaluation and Program Planning 5: 133-140.

31.

Knapp, M.S. (1979) "Tinkering with open systems: organizational theory pespectives on educational program evaluation," pp. 226-244 in L. E. Datta and R. Perloff (eds.) Improving Evaluations. Beverly Hills, CA: Sage.

32.

Kuhn, T.F. (1962) The Structure of Scientific Revolutions. Chicago: Univ. of Chicago Press.

33.

Larson, J.K. , and P.D. Werner (1981) "Measuring utilization of mental health program consultation," pp. 77-96 in J. A. Ciarlo (ed.) Utilizing Evaluation: Concepts and Measurement Techniques . Beverly Hills, CA: Sage.

34.

Levin, H.M. (1978) "A decade of policy developments in improving education and training for low-income populations," pp. 521-570 in T. D. Cook and Associates (eds.) Evaluation Studies Review Annual (Vol. 3). Beverly Hills, CA: Sage.

35.

Leviton, L.C. and E.F.X. Hughes (1981) "Research on the utilization of evaluations: a review and synthesis." Evaluation Rev. 5, 4: 525-548.

36.

Miller, T.C. (1977) "Conceptualizing inequality," pp. 334-350 in M. Guttentag (ed.) Evaluation Studies Review Annual (Vol. 2). Beverly Hills, CA: Sage.

37.

Mitroff, I. and T.V. Bonoma (1981) "Psychological assumptions, experimentation, and real-world problems: a critique and an alternate approach to evaluation." Evaluation Q. 2, 2: 241-259.

38.

Morrell, J.A. and E.W. Flaherty (1978) "The development of evaluation as a profession: current status and some predictions." Evaluation and Program Planning 1: 11-17.

39.

Patton, M.Q. (1978) Utilization-Focused Evaluation. Beverly Hills, CA: Sage.

40.

Pauley, P.A. , M.C. Choban , and J.W. Yarbrough (1982) " A systematic approach to increasing use of management-oriented program evaluation data." Evaluation and Program Planning 5: 123-131.

41.

Pillemer, D.B. and Light, R.J. (1981) "Synthesizing outcomes: how to use research evidence from many studies," pp. 707-726 in H. E. Freeman and M. A. Solomon (eds.) Evaluation Studies Review Annual (Vol. 6). Beverly Hills, CA: Sage.

42.

Radnor, M. and H.D. Hofler (1979) "Beyond measurement to appropriateness and learning: evaluating LEAA experimental programs," pp. 71-86 in R. F. Rich (ed.) Translating Evaluation into Policy. Beverly Hills, CA: Sage.

43.

Raskin, I.E. , R.M. Coffey , and P.J. Farley (1980) "Controlling health care costs: an evaluation of strategies." Evaluation and Program Planning 3: 1-14.

44.

Rezmovic, E.L. (1982) "Program implementation and evaluation results: a reexamination of type-III error in a field experiment." Evaluation and Program Planning 5: 111-118.

45.

Rich, R.F. (1979a) "Editor's introduction," pp. 7-20 in R. F. Rich (ed.) Translating Evaluation into Policy. Beverly Hills, CA: Sage.

46.

———( 1979b) "Problem-solving and evaluation research: unemployment insurance policy," pp. 87-110 in R. F. Rich (ed.) Translating Evaluation into Policy. Beverly Hills, CA: Sage.

47.

Riecken, H.W. and R.F. Boruch (1974) "Foreword," pp. 1-12 in Social Experimentation: A Method for Planning and Evaluating Social Intervention. New York: Academic Press.

48.

Rossi, P.H. and R.A. Berk (1981) "An overview of evaluation strategies and procedures ." Human Organization 40, 4: 287-299.

49.

Rossi, P.H. and K.C. Lyall (1978) "An overview evaluation of the NIT experiment," pp. 412-428 in T. D. Cook and Associates (eds.) Evaluation Studies Review Annual (Vol. 3). Beverly Hills, CA: Sage.

50.

Sproull, L. and P. Larkey (1979) "Managerial behavior and evaluator effectiveness ," pp. 89-104 in H. C. Schulberg and J. M. Jerrell (eds.) The Evaluator and Management. Beverly Hills, CA: Sage.

51.

Stevenson, J.F. (1981) "Assessing evaluation utilization in human service agencies," pp. 35-57 in J. A. Ciarlo (ed.) Utilizing Evaluation: Concepts and Measurement Techniques. Beverly Hills, CA: Sage.

52.

———and R.H. Longabaugh (1980) "The role of evaluation m mental health." Evaluation Review 4, 4: 461-480.

53.

Stromsdorfer, E.W. and G. Farkas (1980) "Introduction," pp. 13-31 in Evaluation Studies Review Annual (Vol. 5). Beverly Hills, CA: Sage.

54.

Suchman, E.A. (1967) Evaluative Research: Principles and Practice in Public Service and Social Action Programs. New York: Russell Sage Foundation.

55.

Tanner, B.A. (1981) "Factors influencing client satisfaction with mental health services: a review of quantitative research." Evaluation and Program Planning 4: 279-286.

56.

U.S. Department of Health, Education, and Welfare (1978) "The rural income maintenance experiment," pp. 429-436 in T. D. Cook and Associates (eds.) Evaluation Studies Review Annual (Vol. 3). Beverly Hills, CA; Sage.

57.

Webb, E.J. , D.T. Campbell , R.D. Schwartz , and L. Sechrest (1966) Nonreactive Measures in the Social Sciences. Boston, MA: Houghton-Mifflin.

58.

Weiss, C. (1981a) "Measuring the use of evaluation," pp. 17-33 in J. A. Ciarlo (ed.) Utilizing Evaluation: Concepts and Measurement Techniques. Beverly Hills, CA: Sage.

59.

———( 1981b) "Review of Toward Reform of Program Evaluation: Aims, Methods, and Institutional Arrangements." Evaluation and Program Planning 4: 397-402.

60.

Wholey, J.S. (1983) Evaluation and Effective Public Management. Boston, MA: Little, Brown.

61.

Woy, J.R. (1979) "Policy-making for mental health: the role of program evaluation," pp. 61-70 in R. F. Rich (ed.) Translating Evaluation into Policy. Beverly Hills, CA: Sage.

62.

Zantra, A.J. and J.W. Reich (1981) "Positive events and quality of life." Evaluation and Program Planning 4: 355-361.