The move to build capacity for internal evaluation is a common organizational theme in social service delivery, and in many settings, the evaluator is also the practitioner who delivers the service. The goal of the present study was to extend our limited knowledge of practitioner evaluation. Specifically, the authors examined practitioner concerns about administering pretest and posttest evaluations within the context of a multisite 7-week family strengthening program and compared those concerns with self-reported attitudes of the parents who completed evaluations. The authors found that program participants (n = 105) were significantly less likely to find the evaluation process intrusive, and more likely to hold positive beliefs about the evaluation process, than practitioners (n = 140) expected. Results of the study may address a potential barrier to effective practitioner evaluation—the belief that having to administer evaluations interferes with establishing a good relationship with program participants.
CherinD. (2004). Collecting and using data for organizational learning. In AustinM. J.HopkinsK. M. (Eds.), Supervision as collaboration in the human services: Building a learning culture (pp. 240–251). Thousand Oaks, CA: Sage.
2.
CullenA.GilesT.RosenthalJ. (2006). Evaluating community-based child health promotion programs: A snapshot of strategies and methods. Portland, ME: National Academy for State Health Policy.
3.
DillmanD. A.SmythJ. D.ChristianL. M. (2009). Internet, mail, and mixed-mode surveys: The tailored design method. (3rd ed.). Hoboken, NJ: John Wiley.
4.
DonaldsonS. I.GoolerL. E.ScrivenM. (2002). Strategies for managing evaluation anxiety: Toward a psychology of program evaluation. American Journal of Evaluation, 23, 261–273. doi:10.1016/s1098-2140(02)00209-6
5.
FettermanD. M.WandersmanA. (2005). Empowerment evaluation principles in practice. New York, NY: Guilford Press.
6.
FookJ. (2002). Theorizing from practice: Towards an inclusive approach for social work research. Qualitative Social Work, 1, 79–95.
7.
FraboniM.CooperD. (1989). Further validation of three short forms of the Marlowe-Crowne scale of social desirability. Psychological Reports, 65, 595–600.
8.
HarveyJ.OliverM. (2002). Towards effective practitioner evaluation: An exploration of issues relating to skills, motivation and evidence. Educational Technology & Society, 5, 1–11.
9.
HillL. G.BetzD. L. (2005). Revisiting the retrospective pretest. American Journal of Evaluation, 26, 501–517.
10.
HillL. G.ParkerL. A. (2005). Extension as a delivery system for prevention programming: Capacity, barriers, and opportunities. Journal of Extension, 43. Retrieved fromhttp://www.joe.org/joe/2005february/a1.shtml
11.
KegelesS. M.RebchookG. M.TebbettsS. (2005). Challenges and facilitators to building program evaluation capacity among community-based organizations. AIDS Education and Prevention. Special Issue: Building HIV Prevention Capacity through Community Collaborative Research, 17, 284–299. doi:10.1521/aeap.2005.17.4.284
12.
KingJ. A. (2002). Building the evaluation capacity of a school district. New Directions for Evaluation, 93, 63–80.
13.
KinseyD. C. (1981). Participatory evaluation in adult and nonformal education. Adult Education Quarterly, 31, 155–168.
14.
LangN. (1994). Integrating the data processing of qualitative research and social work practice to advance the practitioner as knowledge builder: Tools for knowing and doing. In ShermanE.ReidW. (Eds.), Qualitative research in social work (pp. 265–270). New York, NY: Columbia University Press.
15.
LuntN.FouchéCYatesD. (2008). “Growing research in practice”: Report of an innovative partnership model. Wellington, Australia: Families Commission.
16.
MillsD. S. (2002). Examining the structural and philosophical positions of community-based organization practitioners. Dissertation Abstracts International, 62(9-B):4620.
17.
MorfordS.KozakR.SuvediM.InnesJ. (2006). Factors affecting program evaluation behaviours of natural resource extension practitioners: Motivation and capacity building. Journal of Extension,44. Retrieved fromhttp://www.joe.org/joe/2006june/a7.php
18.
Myers-WallsJ. A. (2000). An odd couple with promise: Researchers and practitioners in evaluation settings. Family Relations, 49, 341–347. doi:10.1111/j.1741-3729.2000.00341.x
PreskillH.TorresR. T. (1999). Building capacity for organizational learning through evaluative inquiry. Evaluation, 5, 42–60.
21.
RiemannG. (2005). Ethnographies of practice–Practicing ethnography. Journal of Social Work Practice, 19, 87–101.
22.
SchwandtT. A.Dahler-LarsenP. (2006). When evaluation meets the “rough ground” in communities. Evaluation, 12, 474–495.
23.
ShawI. (2005). Practitioner research: Evidence or critique?British Journal of Social Worsk, 35, 1231–1248.
24.
ShawI.FaulknerA. (2006). Practitioner evaluation at work. American Journal of Evaluation, 27, 44–63. doi: 10.1177/1098214005284968
25.
SpothR.TrudeauL.GuyllM.ShinC.RedmondC. (2009). Universal intervention effects on substance use among young adults mediated by delayed adolescent substance initiation. Journal of Consulting and Clinical Psychology, 77, 620–632.
26.
StrahanR.GerbasiK. C. (1972). Short, homogeneous versions of the Marlowe-Crowne social desirability scale. Journal of Clinical Psychology, 28, 191–193. doi:10.1002/1097-4679(197204)28:2<191: AID-JCLP2270280220>3.0.CO;2-G
27.
TautS. (2007). Studying self-evaluation capacity building in a large international development organization. American Journal of Evaluation, 28, 45.
28.
TautS. M.AlkinM. C. (2003). Program staff perceptions of barriers to evaluation implementation. American Journal of Evaluation, 24, 213–226. doi:10.1016/s1098-2140(03)00028-6
