The Challenges of Evaluating Health Systems Networks: Lessons Learned from an Early Evaluation of the Child Health Network for the Greater Toronto Area

Abstract

French

This article describes the first system-wide evaluation of the Child Health Network (CHN) for the Greater Toronto Area (GTA), a partnership of 29 community and hospital care providers. The CHN performance evaluation sought to identify the impact of the network on the delivery of maternal, newborn and child health services in the GTA. CHN members identified seven criteria to be evaluated (appropriate care, accessibility, effectiveness, satisfaction, integrated and coordinated care, accountability and affordability) and then collaborated in selecting measurable indicators for each criterion. Data were compiled from administrative data sets, or collected as needed. This undertaking succeeded in providing a comprehensive assessment of the network's performance, identification of strategies to improve outcomes and network sustainability, as well as practical information that will inform the important new field of network evaluation.

Get full access to this article

View all access options for this article.

References

Provan

Milward

. Do networks really work? A framework for evaluating public sector organizational networks. Public Administration Review 2001; 61: 400–9.

Popp

L'Heureux

Dolinski

Adair

Tough

Casebeer

. How do you evaluate a network? A Canadian child and youth health network experience. The Canadian Journal of Program Evaluation 2005; 20(3): 123–150.

Hill

. Network literature review: Conceptualizing and evaluating networks. Prepared for the Southern Alberta Child and Youth Health Network. Calgary, AB: Alberta Children's Hospital Foundation and Calgary Health Region; 2002.

Lemieux-Charles

Chambers

Cockerill

Jaglal

Brazil

Cohen

. Evaluating the effectiveness of community-based dementia care networks: The dementia networks' study. The Gerontologist 2005; 45: 456–64.

Brass

Galaskiewicz

Greve

Tsai

. Taking stock of networks and organizations: A multilevel perspective. Academy of Management Journal 2004; 47(6): 795–817.

Birdsell

Matthias

. Networks and their role in enhancing research impact in Alberta: Report from a workshop held July 21–23, 2003. Edmonton, AB: Alberta Heritage Foundation for Medical Research.

Levin-Rozalis

. Evaluation and research: Differences and similarities. Canadian Journal of Program Evaluation 2003; 18(2): 1–31.

Child Health Network for the Greater Toronto Area. Taking a first step … Evaluating performance for mothers, newborns, children and youth. Toronto, ON: Author; 2003.

Health Canada. Program evaluation tool kit. [Accessed January 26, 2007]. Available from: http://www.phac-aspc.gc.ca/php-psp/pdf/toolkit/Introduction.pdf

10.

Lawson

Hadjistavropoulos

. The pitfalls and the potential of early evaluation efforts: Lessons learned from the health services sector. Canadian Journal of Program Evaluation 2002; 17(3): 39–56.

11.

Provan

Milward

. Health services delivery networks: What do we know and where should we be headed? HealthcarePapers 2006; 7(2): 32–36.

12.

Health Services Utilization and Research Commission (Saskatchewan). System performance indicators: Toward a goal-based health system. Issues and directions; August 2000.

13.

Wilson-Grau

Nuñez

. Evaluating international social change networks: A conceptual framework for a participatory approach. Development in Practice (in press).

14.

Lemieux-Charles

. Understanding the conditions that lead to effective health services delivery networks. HealthcarePapers 2006; 7(2): 40–45.

15.

Gilchrist

. Maintaining relationships is critical in network's success. HealthcarePapers 2006; 7(2): 28–31.