This contribution to the journal examines program clarification for evaluation purposes. It traces the development of this approach over the past three decades, during which the terms evaluability assessment, program theory and program logic have been applied in turn. This is followed by an extensive list of resources that either discuss one of the terms generally or describe applications to a range of program areas.
Get full access to this article
View all access options for this article.
References
1.
OwenJ.2006, ‘Clarificative evaluation’, in OwenJ.M., Program evaluation forms and approaches, 3rd edn, Allen and Unwin, Sydney.
2.
CiechalskiJ.C.1981, ‘Planning useful evaluations: evaluability assessment’, Measurement and Evaluation in Guidance, vol. 13, no. 4, pp. 237–238.
3.
GantwerkL.1985, An application and evaluation of evaluability assessment: a case study’, Dissertation Abstracts International, vol. 46, nos 6-8, p. 2049.
4.
HollowayW.H.1981, A critique of the evaluability assessment model in organizational analysis, ED208565.
5.
JungS.M., & SchubertJ.G.1983, ‘Evaluability assessment: a two-year retrospective’, Educational Evaluation and Policy Analysis, vol. 5, no. 4, pp. 435–444.
6.
LevitonL.C.1998, ‘Teaching evaluation using evaluability assessment, Evaluation, vol. 4, no. 4, pp. 389–409.
7.
NayJ.N., & KayP.1982, Government oversight and evaluability assessment, Lexington Books, Lexington, Massachusetts.
8.
PorteousN.L.2002, ‘Introducing program teams to logic models: facilitating the learning process’, Canadian Journal of Program Evaluation, vol. 17, no. 3, pp. 113–141.
9.
RogD.J., 1985, ‘A methodological analysis of evaluability assessment’, Dissertation Abstracts International, vol. 46, no. 8B, pp. 2872–2873.
10.
SchmidtR.E.1991, ‘Evaluability assessment: a practical approach’, Evaluation and Program Planning, vol. 14, no. 3, pp. 202–204.
11.
SchmidtR.E.1979, Evaluability assessment: making public programs work better, Human services monograph series no. 14, ED183614.
12.
SchubertJ.G.1982, Evaluability assessment: the promise in practice, ED217078.
13.
SmithM.1989, Evaluability assessment: a practical approach, Kluwer Academic, Boston.
14.
SmithM.F.1989, ‘Evaluability assessment’, in MathisonS (ed.), Encyclopaedia of evaluation, Sage, Thousand Oaks, California.
15.
SmithN.L.1981, ‘Evaluability assessment: a retrospective illustration and review’, Educational Evaluation and Policy Analysis, vol. 3, no. 1, pp. 77–82.
16.
ThurstonW.E., & PotvinL.2003, ‘Evaluability assessment: a tool for incorporating evaluation in social change programs, Evaluation, vol. 9, no. 4, pp. 453–469.
17.
ThurstonW.E.2003, ‘Evaluability assessment: a catalyst for program change and improvement’, Evaluation and the Health Professions, vol. 26, no. 2, pp. 206–221.
18.
TrevisanM.S.2007, ‘Evaluability assessment from 1986 to 2006, American Journal of Evaluation, vol. 28, no. 3, pp. 290–303.
19.
WholeyJ.S.1987, ‘Evaluability assessment: developing program theory’, in BickmanL (ed.), Using program theory in evaluation. New directions for program evaluation, no. 33, Jossey-Bass, San Francisco, pp. 77–92.
20.
WholeyJ.S.1994, ‘Evaluability assessment’, Evaluation News and Comment, vol. 3, no. 2, pp. 2–13.
21.
WorthingtonR.1982, ‘Evaluability assessment: making the effort worth the product’, QIER Journal, vol. 21, pp. 28–34.
22.
SmithM.F.1990, ‘Evaluability assessment: reflections on the process’, Evaluation and Program Planning, vol. 13, no. 4, pp. 359–364.
23.
GolumR.H.2004, ‘An evaluability assessment of a school-based group counselling program for African-American female students living in an urban area of predominantly low-income status families’, Dissertation Abstracts International: Section 8: The Sciences and Engineering, vol. 64, nos 9-8, p. 4614.
24.
MeeresS.L.1995, ‘Evaluability assessment of a community-based program’, The Canadian Journal of Program Evaluation, vol. 10, no. 1, pp. 103–121.
25.
PiqueroA.1998, ‘Applying an evaluability assessment tool to community-based programs in Pittsburgh’, The Prison Journal, vol. 78, no. 1, p. 74.
26.
ThurstonW.E., & RamaliuA.2005, Evaluability assessment of a survivors of torture program: lessons learned, Canadian Journal of Program Evaluation, vol. 20, no. 2, pp. 1–25.
27.
BasileK.C.2005, Evaluability assessment of the rape prevention and education program, Journal of Women's Health, vol. 14, no. 3, pp. 201–207.
28.
FinckenauerJ.O.2005, ‘Evaluability assessment in juvenile justice: a case example, Youth Violence and Juvenile Justice, vol. 3, no. 3, pp. 265–275.
29.
MatthewsB.2001, ‘Making the next step: evaluability assessment to improve correctional programming, Prison Journal, vol. 81, no. 4, pp. 454–472.
30.
KraetzerA.V., & SchofieldR.G.1982, School social work services evaluability assessment, ED221798.
31.
QuintJ.2001, An evaluability assessment of the Toyota Families in Schools Program, ED465034.
32.
RoscoeF.P.1987, ‘An evaluability assessment of an alternative education program, Dissertation Abstracts International, vol. 48, no. 1B, p. 253.
33.
Russ-EftD.1986, ‘Evaluability assessment of the adult education program: the results and their use’, Evaluation and Program Planning, vol. 9, no. 1, pp. 39–47.
34.
ScherzerM.2008, ‘An evaluability assesment of a preschool program in a public school for children on the autistic spectrum’, Dissertation Abstracts International: Section A: Humanities and Social Sciences, vol. 68, no. 9A, p. 3735.
35.
SchofieldR.G., & KraetzerA.V.1988, ‘An evaluability assessment of school social work services: a tool for social workers and program managers’, Journal of School Social Work, vol. 2, no. 2, pp. 15–30.
36.
ScottA.C., & BourexisP.S.1982, Evaluability assessment of the Title 11 Basic Skills Improvement Program: implications for state-level programs, ED217082.
37.
SpielbergerJ., & GovetteP.2006, The Early Childhood Cluster Initiative of Palm Beach County, Florida: early implementation study and evaluability assessment, final report Florida, Chapin Hall Working Paper.
38.
VermaS., & MarveskeG., Using evaluability assessment to improve programs in the cooperative extension system, ED329699.
39.
YampolskyP.H.1984, ‘An evaluability assessment of a special educational-vocational program for handicapped high school pupils’, Dissertation Abstracts International, vol. 45, nos 2-8, p. 659.
40.
BarnowB.S., & StapetonD.C.1997, An evaluability assessment of responsible fatherhood programs, ED463838.
41.
LeeW.G.2007, ‘An evaluability assessment of a homeless program for families’, Dissertation Abstracts International: Section 8: The Sciences and Engineering, vol. 67, nos 7-8, p. 4159.
42.
MillerE.N., 2001, ‘An evaluability assessment of a community living program serving single parents with histories of homelessness, mental illness and often co-occurring substance abuse and who are living with and parenting their children, Dissertation Abstracts International: Section 8: The Sciences and Engineering, vol. 62, nos 7-8, p. 3385.
43.
CasebeerA., & ThurstonW.E.1995, ‘Evaluability assessment in health care: an example of the patient care and outcome process’, The Canadian Journal of Program Evaluation, vol. 10, no. 1, pp. 89–102.
44.
DurhamJ.2007, ‘An evaluability assessment of a nutrition promotion project for newly arrived refugees’, Health Promotion Journal of Australia, vol. 18, no. 1, pp. 43–49.
45.
DwyerJ.2003, ‘Maximising children's physical activity: an evaluability assessment to plan a community-based, multi-strategy approach, Health Promotion International, vol. 18, no. 3, pp. 199–208.
46.
MacaskillL.2000, ‘An evaluability assessment to develop a restaurant health promotion program in Canada, Health Promotion International, vol. 15, no. 1, pp. 57–69.
47.
StrosbergM.A.1983, ‘Evaluability assessment: from theory to practice in the Department of Health and Human Services, Public Administration Review, vol. 43, no. 1, pp. 66–71.
48.
FisherE.J., & PetersL.1985, ‘The role of evaluability assessment in mental health program evaluation’, Canadian Journal of Community Mental Health, vol. 4, no. 2, pp. 25–34.
49.
JohncoxV.2000, ‘Evaluability assessment of staff training in special care units or persons with dementia: strategic issues’, Canadian Journal of Program Evaluation, Special issue, pp. 53–66.
50.
YoutieJ.1999, ‘Using an evaluability assessment to select methods for evaluating state technology development programs’, Evaluation and Program Planning, vol. 22, no. 1, pp. 55–64.
51.
BickmanL. (ed.) 1987, Using program theory in evaluation. New directions for program evaluation, no. 33, Jossey Bass, San Francisco.
52.
BirckmayerJ., & WeissC.2000, ‘Theory-based evaluation in practice: what do we learn?’, Evaluation Review, vol. 24, no. 4, pp. 407–431.
53.
ChenH.T.1989, ‘The conceptual framework of the theory-driven perspective’, Evaluation and Program Planning, vol. 12, no. 4, pp. 391–316.
54.
ChenH.T.1990, Theory-driven evaluations, Sage, Newbury Park, California.
55.
ChenH.T., & RossiP.1983, ‘Evaluating with sense: the theory-driven approach’, Evaluation Review, vol. 7, no. 3, pp. 283–302.
56.
CookT.D.2000, ‘The false choice between theory-based evaluation and experimentation’, in RogersP.J. (Eds), Program theory in evaluation: challenges and opportunities. New directions for evaluation, no. 87, Jossey-Bass, San Francisco, pp. 27–34.
57.
CorynC.L.S.2008, ‘Program theory-driven evaluation science: strategies and applications, American Journal of Evaluation, vol. 29, no. 2, pp. 215–217.
58.
DavidsonE.J.2000, ‘Ascertaining causality in theory-based evaluation’, in RogersP.J. (Eds), Program theory in evaluation: challenges and opportunities. New directions for evaluation, no. 87, Jossey-Bass, San Francisco, pp. 17–26.
59.
DonaldsonS.I.2005, ‘Using program-theory-driven evaluation science to crack the Da Vinci code’, in AlkinM.C., & ChristieC.A. (Eds), Theorists’ models in action. New directions for evaluation, no. 106, Jossey-Bass, San Francisco, pp. 65–84.
60.
FearW.2007, ‘Programme evaluation theory: the next step toward a synthesis of logic models and organisational theory.Journal of MultiDisciplinary Evaluation, vol. 4, no. 7, pp. 13–15.
61.
FunnellS.C.2000, ‘Developing and using a program theory matrix for program evaluation and performance monitoring’, in RogersP.J. (Eds), Program theory in evaluation: challenges and opportunities. New directions for evaluation, no. 87, Jossey-Bass, San Francisco, pp. 91–101.
62.
LeewF.L.2003, ‘Reconstructing program theories: methods available and problems to be solved’, American Journal of Evaluation, vol. 24, no. 1, pp. 5–20.
63.
PattonM.Q.1997, ‘Developing program theory’, Evaluation News and Comment, vol. 6, no. 1, pp. 18–20.
64.
RogersP.J.2000, ‘Causal models in program theory evaluation’, in RogersP.J. (Eds), Program theory in evaluation: challenges and opportunities. New directions for evaluation, no. 87, Jossey-Bass, San Francisco, pp. 47–55.
65.
RogersP.J..,2000, ‘Program theory evaluation: practice, promise, and problems’, in RogersP.J. (Eds), Program theory in evaluation: challenges and opportunities. New directions for evaluation, no. 87, Jossey-Bass, San Francisco, pp. 5–13.
66.
RogersP.J., & WeissC.H.2007, ‘Theory-based evaluation: reflections ten years on’ and ‘Theory based evaluation: past, present and future’, in MathisonS (ed.), Enduring issues in evaluation: the 20th anniversary of the collaboration between NDE and AEA. New directions for evaluation, no. 114, Jossey-Bass, San Francisco, pp. 63–81.
67.
WeissC.H.1997a, ‘Theory-based evaluation: past, present, and future’, in RogD.J., & FournierD (Eds), Progress and future directions in evaluation: perspectives on theory, practice, and methods. New directions for evaluation, no. 76, Jossey-Bass, San Francisco, pp. 41–55.
68.
WeissC.H.1997b, ‘How can theory-based evaluation make greater headway?, Evaluation Review, vol. 21, no. 4, pp. 501–524.
69.
CarvalhoS., & WhiteH.2004, ‘Theory-based evaluation: the case of social funds’, American Journal of Evaluation, vol. 25, no. 2, pp. 141–160.
70.
MercierC.2000, ‘An application of theory-driven evaluation to a drop-in youth center’, Evaluation Review, vol. 24, no. 1, pp. 73–91.
71.
SolomonB.2002, ‘Accountability in public child welfare: linking program theory, program specification and program evaluation’, Child and Youth Services Review, vol. 24, nos 6-7, pp. 385–407.
72.
TilleyN.2004, ‘Applying theory-driven evaluation to the British Crime Re-education Programme’, Criminal Justice, vol. 4, no. 3, pp. 255–276.
73.
Education
74.
CrewR.E.Jr, & AndersonM.R.2003, ‘Accountability and performance in charter schools in Florida: a theory-based evaluation’, American Journal of Evaluation, vol. 24, no. 2, pp. 189–212.
75.
CummingsR., StephensonK., & HaleL.2001, ‘Using program theory in an educational setting’, Evaluation Journal of Australasia, vol. 1, no. 1 (new series), pp. 29–39.
76.
HeubnerT.A.2000, ‘Theory-based evaluation: gaining a shared understanding between school staff and educators’, in RogersP.J. (Eds), Program theory in evaluation: challenges and opportunities. New directions for evaluation, no. 87, Jossey-Bass, San Francisco, pp. 79–89.
77.
TurnbullB.2002, ‘Program theory building: a strategy for deriving cumulative evaluation knowledge’, American Journal of Evaluation, vol. 23, no. 3, pp. 275–290.
78.
BayC.2005, ‘Theory-driven evaluation of nursing care’, Journal of Nursing Scholarship, vol. 37, no. 1, p. 3.
79.
FroschD.2008, ‘Using decision aids in community-based primary care: a theory-driven evaluation with ethnically diverse patients’, Journal of General Internal Medicine, vol. 23, Supplement 2, p. 434.
80.
WalsheK.2007, ‘Understanding what works and why in quality improvement: the need for theory-driven evaluation’, International Journal for Quality in Health Care, vol. 19, no. 2, pp. 57–59.
81.
TorvatnH.1999, ‘Using program theory models in evaluation of industrial modernization programs: three case studies’, Evaluation and Program Planning, vol. 22, no. 1, pp. 73–82.
82.
AlterC., & MurtyS.1997, ‘Logic modelling: a tool for teaching practice evaluation’, Journal of Social Work Education, vol. 33, no. 1, pp. 103–108.
83.
BottT.F., & EisenhawerS.W.1989, ‘Programme planning with logic trees’, International Journal of Quality and Reliability Management, vol. 6, no. 2, pp. 15–24.
CooksyL., GillP., & KellyP.2001, ‘The program logic model as an integrative framework for a multimethod evaluation’, Evaluation and Program Planning, vol. 24, no. 2, pp. 119–128.
86.
Den HeyerM.2002, ‘The temporal logic model concept’, The Canadian Journal of Program Evaluation, vol. 17, no. 2, pp. 27–48.
87.
EnglishB., & KaleveldL.2003, ‘The politics of program logic’, Evaluation Journal of Australasia, vol. 3, no. 1, pp. 35–42.
88.
FasholaO.2001, ‘Logic model basics’, Harvard Family Research Project, vol. 7, no. 2, pp. 14–15.
89.
FraserD.2001, ‘Visualising program logic: two new graphic conventions’, Evaluation Journal of Australasia, vol. 1, no. 2, pp. 54–60.
90.
FrechtlingJ.A.2007, Logic modelling methods in program evaluation, Jossey Bass, San Francisco.
91.
FunnellS.1997, ‘Program logic: an adaptable tool for designing and evaluating programs’, Evaluation News and Comment, vol. 6, no. 1, pp. 5–7.
92.
GanleyH.E., & WardM.2001, Program logic: a planning and evaluation method, Journal of Nursing Administration, vol. 31, no. 1, pp. 4, 39.
93.
GasperD.2000, Evaluating the ‘logical framework approach’ towards learning-oriented development evaluation’, Public Administration and Development, vol. 20, no. 1, pp. 17–28.
94.
GillJ.R.1998, ‘Program logic model: a tool for evaluating social change’, paper presented at the American Evaluation Association Annual Conference, Chicago.
95.
HernandezM.2000, ‘Using logic models and program theory to build outcome accountability’, Education and Treatment of Children, vol. 23, no. 1, pp. 24–40.
96.
InceR.1994, ‘DIY evaluation and program logic’, Evaluation Journal of Australasia, vol. 6, no. 8, pp. 56–60.
JulianD.1997, ‘The utilization of the logic model as a system level planning and evaluation device’, Evaluation and Program Planning, vol. 20, no. 3, pp. 251–257.
99.
JulianD.A., JonesA., & DeyoD.1995, ‘Open systems evaluation and the logic model: program planning and evaluation tools’, Evaluation and Program Planning, vol. 18, no. 4, pp. 333–341.
LenneB.1987, ‘Describing program logic’, Program Evaluation Bulletin of the NSW Public Service Board, Sydney.
102.
McLaughlinJ.A., & JordanG.B.1999, ‘Logic models: a tool for telling your program's performance story’, Evaluation and Program Planning, vol. 22, no. 1, pp. 65–72.
103.
RengerR., & TitcombA.2002, A three-step approach to teaching logic models’, American Journal of Evaluation, vol. 23, no. 4, pp. 493–503.
104.
RushB., & OgbourneA.1991, ‘Program logic models: expanding their role and structure for program planning and evaluation’, Canadian Journal of Program Evaluation, vol. 6, no. 2, pp. 95–106.
105.
SartoriusR.1991, ‘The logical framework approach to project design and management’, Evaluation Practice, vol. 12, no. 2, pp. 139–147.
106.
TautS.2008, ‘Logic modelling methods in program evaluation’, American Journal of Evaluation, vol. 29, no. 2, pp. 217–218.
107.
Taylor-PowellE.1998, The logic model: A program performance framework, University of Wisconsin—Extension, Madison, Wisconsin.
108.
TorgheleK.2007, ‘Logic model use in developing a survey instrument for program evaluation’, Public Health Nursing, vol. 24, no. 5, pp. 472–479.
109.
TorvatnH.2008, ‘Logic modeling methods in program evaluation’, book review, Evaluation and Program Planning, vol. 31, no. 2, pp. 219–221.
110.
WK Kellogg Foundation2004, Logic model development guide, WK Kellogg Foundation, Battle Creek, Michigan.
111.
Wyatt KnowltonL., & PhillipsC.C.2008, The logic model guidebook: better strategies for great results, Sage, Thousand Oaks, California.
112.
AndersonL.A.2006, ‘Using concept mapping to develop a logic model for the prevention research centre's program’, Preventing Chronic Disease, vol. 3, no. 1, p. A06.
113.
GuiguP.C., & Rodriguez-ComposL.2007, ‘Semi-structured interview protocol for constructing logic models’, Evaluation and Program Planning, vol. 30, no. 4, pp. 339–350.
114.
UnrauY.A.2001, ‘Using client exit interviews to illuminate outcomes in program logic models: a case example’, Evaluation and Program Planning, vol. 24, no. 4, pp. 353–361.
115.
YampolskayaS.2004, ‘Using concept mapping to develop a logic model and articulate a program theory: a case example’, American Journal of Evaluation, vol. 25, no. 2, pp. 191–207.
116.
FramstG.1995, ‘Application of program logic models to agricultural technology transfer programs’, Canadian Journal of Program Evaluation, vol. 10, no. 2, pp. 121–132.
117.
ChenW.W.1998-9, ‘Using a logic model to plan and evaluate a community intervention program: a case study’, International Quarterly of Community Health Education, vol. 18, no. 4, pp. 449–458.
118.
EdwardsD.E.1995, ‘A community approach for Native American drug and alcohol prevention programs: a logic model framework’, Alcoholism Treatment Quarterly, vol. 13, no. 2, pp. 43–62.
119.
IsaacsB., & PerlmanN., 2004, ‘Evaluation of a treatment foster care program: development of program logic’, paper submitted for symposium at International Association for the Scientific Study of Intellectual Disability World Congress, 14-19 June, Montpellier, France.
120.
KolasaK., & LackeyC.2006, ‘The logic model as a framework for community program evaluations: the Food Literacy Partners Program’, Family Medicine, vol. 38, no. 10, pp. 690–691.
121.
PathmanD.2003, ‘Use of program logic models in the Southern Rural Access Program’, Journal of Rural Health, vol. 19, no. 5, pp. 308–313.
122.
RawlR.2006, ‘The logic model as a framework for community program evaluations: the food literacy partners program’, Family Medicine, vol. 38, no. 10, pp. 690–691.
MarcinkowskiT.2004, Using a logic model to review and analyse an environmental education program, North American Association for Environmental Education, Washington DC.
126.
ArmstrongE.G., & BarsionS.J.2006, ‘Using an outcomes-logic-model approach to evaluate a faculty development program for medical education’, Academic Medicine, vol. 81, no. 5, pp. 483–488.
127.
CoxR.J.2000, ‘Using program logic models in evaluation: a review of the literature and the spinal outreach team experience’, Canadian Journal of Program Evaluation, vol. 8, no. 1, pp. 117–134.
128.
DwyerJ.1996, ‘Applying a program logic model in program planning and evaluation’, Public Health and Epidemiology Report Ontario, vol. 7, no. 2, pp. 38–46.
129.
DwyerJ.J., & MakinS.1997, ‘Using a program logic model that focuses on performance measurement to develop a program’, Canadian Journal of Public Health, vol. 88, no. 6, pp. 421–425.
130.
DykemanM.2003, ‘Development of a program logic model to measure the processes and outcomes of a nurse-managed community health clinic’, Journal of Professional Nursing, vol. 19, no. 4, pp. 197–203.
131.
FraserB., & HllettR.G.2003, ‘Use of a program logic model to guide the development of a strategic plan for Wellington County Hospitals Network’, Healthcare Management Forum, vol. 16, no. 3, pp. 12–17.
132.
HultonL.J.2007, ‘An evaluation of a school-based teenage pregnancy prevention program using a logic model framework’, The Journal of School Nursing, vol. 23, no. 2, pp. 104–110.
133.
LinneyJ.A., & WandersmanA.1991, Prevention Plus 111: assessing alcohol and other drug prevention programs: a four-step guide to useful program assessment, United States Department of Heath and Human Services, Rockville, Maryland.
134.
McEwanK.L., & BigelowD.A.1997, ‘Using a logic model to focus health services on population health goals’, Canadian Journal of Program Evaluation, vol. 12, no. 1, pp. 167–174.
135.
MoyerA., VerhovsekH.1997, ‘Facilitating the shift to population-based public health programs: innovation through the use of framework and logic model tools’, Canadian Journal of Public Health, vol. 88, no. 2, pp. 95–98.
136.
SitakerM.2008, ‘Adapting logic models over time: the Washington State Heart Disease and Stroke Prevention Program experience’, Preventing Chronic Disease, vol. 5, no. 2, p. A60.
137.
StinsonS., & WilkinsonC.2004, ‘Creating a successful clinical extern program using a program planning logic model’, Journal for Nurses in Staff Development, vol. 20, no. 3, pp. 140–144.
138.
CoughlinP.2008, ‘Program logic model: a valued tool for leaders and clinical team members in a multidisciplinary Canadian early intervention in psychosis program’, Early Intervention in Psychiatry, vol. 2, Supplement 1, p. A112.
139.
SharpC.A., & StockH.2005, ‘In search of a program logic for the evaluation of corporate governance and organisational performance’, Evaluation Journal of Australasia, vol. 5, no. 2, pp. 48–59.
140.
AlterC., & EganM.1997, ‘Logic modelling: a tool for teaching critical thinking in social work practice’, Journal of Social Work Education, vol. 33, no. 1, pp. 85–103.
141.
HermannJ.A.1996, ‘Using logic models to strengthen service program development: an example of antipoverty programs for at-risk youth’, paper presented at the Sociological Practice Association Annual Meeting, Arlington, Virginia.
142.
Jacobs-LoweryR.L.2002, ‘A formative evaluation of an adolescent development program: the logic model process’, Dissertation Abstracts International: Section 8: The Sciences and Engineering, vol. 62, nos 7-8, p. 3379.
