The Use of Formative Evaluation to Assess Integrated Services for Children

Abstract

This article describes the use of formative evaluation in assessing the feasibility of implementing a new service integration effort. The Child Health Initiative, a nine-site, national demonstration project funded in 1991 by the Robert Wood Johnson Foundation, sought to implement systemic change through the creation of new mechanisms for spending service dollars more flexibly at the local site. The Child Health Initiative calledfor developing local child health-monitoring systems, a care coordination mechanism, and a program for decategorizing the myriad of restrictive categorical public programs serving children. Most demonstration communities experienced some degree of success in achieving the first two components, but none was able to implement decategorization during the 3to 5-year funding period. Key lessons for evaluators include the need for (a) a flexible evaluation design that can sequentially adapt to changes in program implementation, (b) repeated longitudinal data collection measures to document changes over time, (c) avoidance of a premature focus on program outcomes, and (d) methods to establish attribution of outcomes.

Get full access to this article

View all access options for this article.

References

Connell, J. P. , Kubisch, A. C. , Schorr, L. B. , & Weiss, C. H. (1995). New approaches to evaluating community initiatives concepts: Methods and contexts, roundtable on comprehensive initiatives for children and families. Colorado: The Aspen Institute.

Falik, M. , Lipson, D. , Lewis-Idema, D. , Ulmer, C. , Kaplan, K. , Robinson, R. , Hickey, E. , & Veiga, R. (1993). Case management for special populations: Moving beyond categorical distinctions. Journal of Case Management, 2(2), 39-45.

Gardner, S. (1994). Reform options for the intergovernmentalfunding system. Washington, DC: The Finance Project.

Guthrie, G. P. , & Guthrie, L. F. (1991). Streamlining interagency collaboration for youth at risk. Educational Leadership, 17-22.

Melaville, A. I. , & Blank, M. J. (1991). What it takes: Structuring interagency partnerships to connect children andfamilies with comprehensive services. Washington, DC: Education and Human Services Consortium.

Moore, S. (1992). Case management and the integration of services: How service delivery systems shape case management. Social Work, 37(5), 418-423.

Morrill, W. A. (1993). Seeking better outcomes for children and families. National Centerfor Service Integration Newsletter, 2, 1-2.

Newacheck, P. W. , Hughes, D. C. , Brindis, C. D. , & Halfon, N. (1995, Fall). Decategorizing health services: Interim findings from the Robert Wood Johnson Foundation's Child Health Initiative. Health Affairs, pp. 232-242.

Schorr, L. B. (1988). Within our reach: Breaking the cycle of disadvantage. New York: Anchor Press/Doubleday.

10.

Wagner, M. , & Gomby, D. (1996). Evaluating a statewide school-linked services initiative: California's Healthy Start. In J. S. Marquart & E. Kennedy (Eds.), New directions in program evaluation: Evaluation of human services integration initiatives. San Francisco: JosseyBass.