Unfortunately, although increasing in quantity, research concerning the use of analytically-based information (ABI) in public sector organizations has not greatly enriched our knowledge of the use of ABI. In this article, we consider some prominent methodological problems involved in such studies that we believe have greatly inhibited progress in developing powerful knowledge concerning the use of ABI. In addition, some suggestions for avoiding these methodological problems or reducing their effects are offered.
Get full access to this article
View all access options for this article.
References
1.
BERG, W. E.
and R. THEADO (1981) “The utilization of evaluation research in social welfare programs.”Social Service Rev.55: 183-192.
2.
BEYER, J. M.
and H. M. TRICE (1982) “The utilization process: a conceptual framework and synthesis of empirical findings.”Admin. Sci. Q.27: 591-622.
3.
BOZEMAN, B.
and J. MASSEY (1982) “Investing in policy evaluation: Some guidelines for skeptical public managers.”Public Admin. Rev.42: 264-270.
4.
BROWN, R. D.
, L. A. BRASKAMP, and D. L. NEWMAN (1978) “Evaluator credibility as a function of report style: Do jargon and data make a difference?”Evaluation Q.2: 331-341.
5.
CAMPBELL, J. P.
(1977) “On the nature of organizational effectiveness,” pp. 13-55 in P. S. Goodman and J. M. Pennings (eds.) New Perspectives on Organizational Effectiveness. San Francisco: Jossey-Bass.
6.
CAPLAN, N.
, A. MORRISON, and R. J. STAMBAUGH (1975) The Use of Social Science Knowledge in Policy Decisions at the National Level: A Report to Respondents. Ann Arbor, MI: Center for Research on the Utilization of Scientific Knowledge, Institute for Social Research, University of Michigan.
7.
CHAIKEN, J. M.
(1977) Implementation of Emergency Service Deployment Models in Operating Agencies. Rand Paper P-5870. Santa Monica, CA: Rand Corporation.
8.
COOK, T. D.
(1978) “Introduction,” pp. 13-22 in T. D. Cooket al. (eds.) Evaluation Studies Rev. Annual 3. Beverly Hills, CA: Sage.
9.
COOK, T. D.
and D. T. CAMPBELL (1979) Quasi-Experimentation: Design and Analysis Issues for Field Settings. Chicago: Rand McNally.
10.
DICKEY, B.
(1980) “Utilization of evaluation of small-scale innovative educational projects.”Educ. Evaluation and Policy Analysis2(6): 65-77.
11.
DIMAGGIO, P.
and M. USEEM (1980) “Small-scale policy research in the arts.”Policy Analysis6: 187-210.
12.
DOWNS, G. W., Jr.
, and L. B. MOHR (1976) “Conceptual issues in the study of innovation.”Admin. Sci. Q.21: 700-714.
13.
DOWNS, G. W., Jr.
, and L. B. MOHR (1976) “Conceptual issues in the study of innovation.”Admin. Sci. Q.21: 700-714.
14.
DRYZEK, J.
(1982) “Policy analysis as a hermeneutic activity.”Policy Sciences14: 309-329.
15.
DUNN, W. N.
(1983) “Measuring knowledge use.”Knowledge5: 120-133.
16.
DUNN, W. N.
(1981) Public Policy Analysis: An Introduction. Englewood Cliffs, NJ: Prentice-Hall.
17.
DUNN, W. N.
(1980) “The two communities metaphor and models of knowledge use: An exploratory case survey.”Knowledge1: 515-536.
18.
FISCHOFF, B.
(1977) “Perceived informativeness of facts.”J. of Experimental Psychology: Human Perception and Performance3: 349-358.
19.
Institute of Medicine
(1979) Health Services Research: Report of Study. Washington, DC: National Academy of Sciences.
20.
LEHMAN, E. W.
and A. M. WATERS (1979) “Control in policy research institutes: some correlates.”Policy Analysis5: 201-221.
21.
LEVITAN, S. A.
and G. WURZBURG (1979) Evaluating Federal Social Programs: An Uncertain Art. Kalamazoo, MI: W. E. Upjohn Institute for Employment Research.
22.
LEVITON, L. C.
, and E.F.X. HUGHES (1981) “Research on the utilization of evaluation.”Evaluation Rev.5: 525-548.
23.
LINDBLOM, C. E.
and D. K. COHEN (1979) Usable Knowledge: Social Science and Social Problem Solving. New Haven, CT: Yale University Press.
24.
MANDELL, M. B.
(1984) “Strategies for improving the usefulness of analytical techniques for public sector decisionmaking,” pp. 289-310 in L. G. Nigro (ed.) Decision Making for Public Administrators in the Public Sector. New York: Marcel Dekker.
25.
MOHR, L. B.
(1982) Explaining Organizational Behavior. San Francisco: Jossey-Bass.
26.
NISBETT, R. E.
and T. D. WILSON (1977) “Telling more than we can know: Verbal reports of mental processes.”Psych. Rev.84: 231-259.
27.
PATTON, M. Q.
, P. S. GRIMES, K. M. GUTHRIE, N. J. BRENNAN, B. D. FRENCH, and D. A. BLYTH (1977) “In search of impact: An analysis of the utilization of federal health evaluation research,” pp. 141-163 in C. H. Weiss (ed.) Using Social Research in Public Policy Making. Lexington, MA: D. C. Heath.
28.
REIN, M.
and S. H. WHITE (1977) “Policy research: Belief and doubt.”Policy Analysis3: 239-271.
29.
RICH, R. F.
and N. M. GOLDSMITH (1983) “The utilization of policy research,” in S. S. Nagel (ed.) Encyclopedia of Policy Studies. New York: Marcel Dekker.
30.
RIEKER, P. P.
(1980) “Evaluation research: The design-to-use process.”Knowledge2: 215-235.
31.
ROTHMAN, J.
(1980) Using Research in Organizations: A guide to Successful Application. Beverly Hills, CA: Sage.
32.
SABATIER, P.
(1978) “The acquisition and utilization of technical information by administrative agencies.”Admin. Sci. Q.23: 396-417.
33.
STOKES, D. E.et al.
(1978) The Federal Investment in Knowledge of Social Programs. Washington, DC: National Academy of Sciences.
34.
USEEM, M.
and P. DIMAGGIO (1978) “An example of evaluation research as a cottage industry: The technical quality and impact of arts audience studies.”Soc. Methods and Research7: 55-84.
35.
VAN HOUTEN, D.
and P. GOLDMAN (1981) “Contract consulting's hidden agenda: The quest for legitimacy in government.”Pacific Soc. Rev.24: 461-493.
36.
WEBB, E. J.
, D. T. CAMPBELL, R. D. SCHWARTZ, L. SECHREST, and J. B. GROVE (1981) Nonreactive Measures in the Social Sciences. Boston: Houghton Mifflin.
37.
WEISS, C. H.
(1981) “Measuring the use of evaluation,” pp. 17-33 in J. A. Ciarlo (ed.) Utilizing Evaluation: Concepts and Measurement Techniques. Beverly Hills, CA: Sage.
38.
WEISS, C. H.
(1977) “Research for policy's sake: The enlightenment function of social research.”Policy Analysis3: 531-545.
39.
WEISS, C. H.
and M. J. BUCUVALAS (1980) Social Science Research and Decision-Making. New York: Columbia Univ. Press.
40.
WEISS, C. H.
and M. J. BUCUVALAS (1977) “The challenge of social research to decision-making,” pp. 213-233 in C. H. Weiss (ed.) Using Social Research in Public Policy Making. Lexington, MA: D. C. Heath.
41.
WEISS, J.
(1979) “Access to influence: Some effects of policy sector on the use of social science.”Amer. Behavioral Scientist22: 437-458.
42.
YIN, R. K.
and M. K. GWALTNEY (1981) “Knowledge utilization as a networking process.”Knowledge2: 555-580.