Evaluating the Impact of Federal Human Service Programs with Locally Differentiated Constituencies

Abstract

Evaluations of large-scale federal programs require innovative methodological approaches for several reasons: (1) funds are often allocated by jurisdiction as opposed to needs; (2) local interpretation of program goals may vary widely; (3) target populations are often locally differentiated; (4) administrative organization and strategies for service delivery vary at the local level. A study of federally subsidized small-farm programs revealed a broad diversification of strategies and a range of client attributes both within and between local target populations, suggesting the need for an analytical model which would address program variation.

Typical-client profiles were developed based on expectations that a given strategy would have differential effects dependent on client characteristics. Regression analysis was then used to assess the effect of program attributes on outcomes for each client group. Our results indicate that the strength of the relationship between program strategies and outcomes varies by group. The methodological approach used here should have broad application for the evaluation of large-scale human service programs.

Get full access to this article

View all access options for this article.

References

Kmenta, J. Elements of econometrics. New York: MacMillan Publishing Co., 1971.

Orden, D. , Buccola, S. T. , & Edwards, P. K. Cooperative extension small-farm programs in the South: An inventory and evaluation. Research Division Bulletin 153, Virginia Polytechnic Institute and State University, Blacksburg, Virginia, 1979.

Patton, M. Q. Utilization-focused evaluation. Beverly Hills: Sage Publications, 1978.

Rossi, P. Issues in the evaluation of human services delivery. Evaluation Quarterly, November 1978, 2, 573-599.

Rossi, P. H. , & Wright, S. R. Evaluation research: An assessment of theory, practice and politics. Evaluation Quarterly, February 1977, 1, 5-51.

Stufflebeam, D. L. Evaluation as enlightenment for decision making. Address delivered at Working Conference on Assessment Theory, Sarasota, Florida, 1968.

Suchman, E. A. Action for what? A critique of evaluation research. In Carol Weiss (Ed.), Evaluating action programs. Boston: Allyn and Bacon, Inc., 1972. Pp. 52-84.

Weiss, C. H. Utilization of evaluation: Toward comparative study. In U. S. House of Representatives, Committee on Governmental Operations, Research and Technical Programs Subcommittee, The use of social research in federal domestic programs, Vol. 3, Washington, D.C.: Government Printing Office, 1967. Pp. 432-462.

Wholey, J. S. , Scanlon, J. W. , Duffy, H. G. Fukumoto, J. , & Vogt, L. M. Federal evaluation policy. Washington, D.C.: The Urban Institute, 1976.