Four Frames for Choosing Performance Metrics for Child and Family Service Programs: Strategic Planning,Decision Points,Logic Modeling,and Implementation Science

Abstract

This article provides guidance for child and family service organizations seeking to develop useful performance metrics for their programs. It describes four frames for this work, based on strategic planning, decision points, logic modeling, and implementation science. These four frameworks are applied to two cases, an afterschool program and a therapeutic foster care program. Additional considerations are provided for reducing potential metrics to a meaningful few.

Keywords

measurement administration/management evaluation/outcomes/accountability performance quality

Get full access to this article

View all access options for this article.

References

Aday

L. A.

Andersen

R. M.

(1981). Equity of access to medical care: A conceptual and empirical review. Medical Care, 19(12), 4–27.

American Academy of Child and Adolescent Psychiatrists. (1998). How decision makers can monitor quality of care. Position statement published June 1998. https://www.aacap.org/aacap/Member_Resources/Practice_Information/Best_Principles_for_Measuring_Outcomes_in_Managed_Care_Medicaid_Programs.aspx#appendixa

Barry

B. W.

(1997). Strategic planning workbook for nonprofit organizations. Amherst Wilder Foundation.

Collins-Camargo

McBeath

(2017). Child welfare practice within the context of public-private partnerships. Social Work, 62, 130–138. https://doi.org/10.1093/sw/swx004

DalleMule

Davenport

T. H.

(2017). What’s your data strategy? Harvard Business Review, 95, 112–121.

Eckerson

W. W.

(2010). Performance dashboards: Measuring, monitoring, and managing your business. Wiley

Glasgow

Vogt

Bowles

S. M.

(1999). Evaluating the impact of public health interventions. The REAIM framework. American Journal of Public Health, 89, 1323–1327.

Gugerty

M. K.

Karlan

(2018). The Goldilocks challenge: Right-fit evidence for the social sector. Oxford University Press.

Hatry

H. P.

(1997). Outcomes measurement and social services: Public and private sector perspectives. In Mullen

E. J.

Magnabasco

J. L.

(Eds.), Outcomes measurement in human services: Cross cutting issues and methods (pp. 3–19). NASW Press.

10.

Hogue

Henderson

C. E.

Dauber

Barajas

P. C.

Fried

Liddle

H. A.

(2008). Treatment adherence, competence, and outcome in individual and family therapy for adolescent behavior problems. Journal of Consulting and Clinical Psychology, 76, 544–555. https://doi.org/10.1037/0022-006X.76.4.544

11.

Horvath

Greenberg

(1994). The working alliance: Theory, research, and practice (Vol. 173). Wiley.

12.

Israel

(2014). Decision-points for system management: Achieving continuous improvement, adaptation, and sustainability. Union Point Group.

13.

Kettner

P. M.

Monroney

R. M.

Martin

L. L.

(2008). Designing and managing programs: An effectiveness based approach. SAGE.

14.

Littell

J. H.

Alexander

L. B.

Reynolds

W. W.

(2001). Client participation: Central and underinvestigated elements of intervention. Social Service Review, 75, 1–28.

15.

Lynch-Cerullo

Cooney

(2011). Moving from outputs to outcomes: A review of the evolution of performance measurement in the human service nonprofit sector. Administration in Social Work, 35, 364–388. https://doi.org/10.1080/03643107.2011.599305

16.

Lyons

J. S.

(2004). Redressing the emperor. Improving our children’s public mental health system. Praeger.

17.

Lyons

J. S.

(2015). The myths of outcomes management: Implications for residential treatment. Residential Treatment for Children & Youth, 32, 184–194. https://doi.org/10.1080/0886571X.2015.1102485

18.

Lyons

J. S.

Epstein

R. A.

Jordan

(2010). Evolving systems of care with total clinical outcomes management. Evaluation and Program Planning, 33, 53–55. https://doi.org/10.1016/j.evalprogplan.2009.05.015

19.

Martin

L. L.

Kettner

P. M.

(1996). Measuring the performance of human service programs. SAGE.

20.

Martin

L. L.

Kettner

P. M.

(2010). Measuring the performance of human service programs (2nd ed.). SAGE.

21.

McMillen

J. C.

Proctor

E. K.

Megivern

Striley

Cabassa

Munson

Dickey

(2005). Quality of care in the social services: Research agenda and methods. Social Work Research, 29, 181–191. https://doi.org/10.1093/swr/29.3.181

22.

Millar

Simeon

R. S.

Carnevale

J. T.

(2001). Logic models: a systems tool for performance management. Evaluation and Program Planning, 24, 73–81. https://doi.org/10.1016/S0149-7189(00)00048-3

23.

Perepletchikova

Kazdin

A. E.

(2005). Treatment integrity and therapeutic change: Issues and research recommendations. Clinical Psychology: Science and Practice, 12, 365–383. https://doi.org/10.1093/clipsy.bpi045

24.

Person

(2013). Balanced scorecards and operational dashboards with Microsoft Excel (2nd ed.). Wiley.

25.

Powell

B. J.

Waltz

T. J.

Chinman

M. J.

Damschroder

L. J.

Simith

J. L.

Mathieu

M. M.

Proctor

E. K.

Kirchner

J. E.

(2015). A refined compilation of implementation strategies: Results from the Expert Recommendations for Implementing Change (ERIC) project. Implementation Science, 10, 21. https://doi.org/10.1186/s13012-015-0209-1

26.

Proctor

E. K.

Landsverk

Aarons

Chambers

Glisson

Mittman

(2009). Implementation research in mental health services: An emerging science with conceptual, methodological, and training challenges. Administration and Policy in Mental Health and Mental Health Services Research, 36, 24–34. https://doi.org/10.1007/s10488-008-0197-4

27.

Yatchmenoff

D. K.

(2005). Measuring client engagement from the client’s perspective in nonvoluntary child protective services. Research on Social Work Practice, 15, 84–96. https://doi.org/10.1177/1049731504271605

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.03 MB