Evaluation as work in progress: Stories of shared learning and development

Abstract

Culture change programs that attempt to identify, challenge, and change inequities and discrimination represent major challenges for evaluators: these are shifting sands, subject to many external factors that cannot be accounted for or measured using ‘objective’ measures. Yet, effective, methodologically coherent evaluation of such projects is essential for both ethical and pragmatic reasons. This article reports on the evaluation of two programs from Victoria, Australia, that use sport as a vehicle for building cultures of respect. The methodology that underpinned both evaluations is described and the authors discuss the challenges (and benefits) experienced during the evaluation process. These challenges and benefits can be summarized under two main headings: relationships and expectations. Effective relationships based on trust led to open and frank communication, and this was essential to manage the multiple and often contradictory expectations that often accompany large, complex evaluation projects.