Reflections on good practice in evaluating Violence Reduction Units: Experiences from across England and Wales

Abstract

Internationally, interpersonal violence places huge burdens on the health, wellbeing and prosperity of society. In response to a notable increase in serious knife crime, in 2019, the UK Government awarded £35 million for the establishment of 18 Violence Reduction Units (VRUs) across England and Wales. There has been limited evaluation of community-level approaches for violence, with almost no published literature on the impact of VRUs. The article presents the approaches and experiences of two interdisciplinary teams of researchers from public health, psychology, criminology, and systems change, working as evaluators of four VRUs in England and Wales. The article describes the value of adopting a whole-system approach to evaluations, outlines good practice in evaluating VRUs, and elicits challenges to developing and embedding evaluation within complex systems.

Keywords

evaluating complex systems prevention public health violence reduction whole system

Get full access to this article

View all access options for this article.

References

Adams-Quackenbush

Caulfield

(2021) The Project Level Evaluation: Commissioned Interventions and Place-based Pilots. Grant report for the West Midlands Violence Reduction Unit. Wolverhampton: Institute for Community Research and Development, University of Wolverhampton.

Adams-Quackenbush

Harewood

Sojka

, et al. (2022) Evaluation of WMVRU Expect Respect Project (St Giles). Grant report for the West Midlands Violence Reduction Unit. Wolverhampton: Institute for Community Research and Development, University of Wolverhampton.

Ammenwerth

Gräber

Herrmann

, et al (2003) Evaluation of health information systems – problems and challenges. International Journal of Medical Informatics 71(2–3): 125–35.

Arnot

Mackie

(2019) Scottish public health network violence prevention framework. ScotPHN Report, NHS Health Scotland, Glasgow, June.

Badger

Kaur

Wilkinson

, et al. (2023) Evaluation of the Step Together programme. Grant report for the West Midlands Violence Reduction Unit. Wolverhampton: Institute for Community Research and Development, University of Wolverhampton.

Badger

Wilkinson

Chopra

(2022) Tizz Time process review. Grant report for the West Midlands Violence Reduction Unit. Wolverhampton: Institute for Community Research and Development, University of Wolverhampton.

Butler

Bates

Quigg

(2021) Evaluation of the Mentors in Violence Prevention (MVP) Programme across Merseyside – Final Report. Liverpool. Public Health Institute, Liverpool John Moores University.

Caulfield

Wilson

Adams-Quackenbush

, et al. (2021) Evaluation of the West Midlands Violence Reduction Unit: Phase two report. Grant report for the West Midlands Violence Reduction Unit. Wolverhampton: Institute for Community Research and Development, University of Wolverhampton.

Caulfield

Wilson

Ellis Paine

, et al. (2020) Evaluation of the West Midlands Violence Reduction Unit: Phase one report. Grant report for the West Midlands Violence Reduction Unit. Wolverhampton: Institute for Community Research and Development, University of Wolverhampton.

10.

Caulfield

Brooks-Wilson

Booth

, et al. (2022) Serious Youth Violence pathfinder: final evaluation report. Grant report to the Youth Justice Board. Wolverhampton: Institute for Community Research and Development, University of Wolverhampton.

11.

Center for Theory of Change (2021) What is theory of change? Theory of change community. Available at: https://www.theoryofchange.org/what-is-theory-of-change/

12.

Coid

Zhang

Ullrich

, et al (2021) Interpersonal violence in a deprived Scottish urban area with aggregations of physical health risks and psychiatric morbidity: An ecological study. BMC Public Health 21(1): 1121.

13.

Craston

Balfour

Henley

, et al (2020) Home office process evaluation of the Violence Reduction Units: Research report 116, GOV.UK. Available at: https://www.gov.uk/government/publications/violence-reduction-unit-evaluation-2019-to-2020

14.

Cure Violence Global (2022) Cure violence global – effective violence prevention, cure violence. Available at: https://cvg.org/

15.

David-Ferson

Vivolo-Kantor

Dahlberg

, et al (2016) A comprehensive technical package for the prevention of youth violence and associated risk behaviors. Available at: https://stacks.cdc.gov/view/cdc/43085

16.

Egan

McGill

Penney

, et al (2019) NIHR SPHR Guidance on Systems Approaches to Local Public Health Evaluation. Part 2: What to Consider When Planning a Systems Evaluation. London: National Institute for Health Research, School for Public Health Research. Available at: https://sphr.nihr.ac.uk/wp-content/uploads/2018/08/NIHR-SPHR-SYSTEM-GUIDANCE-PART-2-v2-FINALSBnavy.pdf

17.

Florence

Shepherd

Brennan

, et al (2011) Effectiveness of anonymised information sharing and use in health service, police and local government partnership for preventing violence related injury: Experimental study and time series analysis. The BMJ 342: d3313.

18.

Florence

Shepherd

Brennan

, et al (2014) An economic evaluation of Anonymised Information Sharing in a partnership between health services, police and local government for preventing violence-related injury. Injury Prevention 20(2): 108–14.

19.

Fox

Ralph

Harrison

, et al. (2020) Evaluation of the Mentors in Violence Prevention (MVP) programme in the West Midlands. Keele University.

20.

French

Lowe

(2018) Place action inquiry: Our learning to date. Lankelly Chase. Available at: https://lankellychase.org.uk/wp-content/uploads/2019/01/Place-Action-Inquiry-Learning-to-Date-Jan19.pdf

21.

Ghate

Lewis

Welbourn

(2013) Systems leadership: Exceptional leadership for exceptional times: Synthesis paper, Cass business school, city university London, The Colebrooke centre for evidence and implementation. Available at: https://pure.strath.ac.uk/ws/portalfiles/portal/82716263/Van_Dyke_2013_Systems_leadership_exceptional_leadership_for_exceptional_times.pdf.

22.

Grint

(2008) Wicked problems and clumsy solutions clinical leader, volume 1, number 11, ISSN 1757-3424, BAMM Publications. Available at: http://leadershipforchange.org.uk/wp-content/uploads/Keith-Grint-Wicked-Problems-handout.pdf

23.

HM Government (2018) Serious violence strategy. Available at: https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/698009/serious-violence-strategy.pdf

24.

Home Office (2020) Violence reduction unit interim guidance. Available at: https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/876380/12VRU_Interim_Guidance_FINAL__003_2732020.pdf

25.

Hopkins

Floyd

(2022) How prepared are we for the serious violence duty? Crime Prevention Community Safety 24: 358–68.

26.

Jolly

Caulfield

Sojka

, et al (2021) Café Delphi: Hybridising ‘world café’ and ‘Delphi techniques’ for successful remote academic collaboration. Social Sciences & Humanities Open 3(1): 100095.

27.

Kazlowska

Thompson

Kerslake

, et al. (2021) The Place-Based Evaluation. Grant report for the West Midlands Violence Reduction Unit. Wolverhampton: Institute for Community Research and Development, University of Wolverhampton.

28.

Kessler

Tanburn

(2014) Why evaluations fail: The importance of good monitoring. Available at: https://www.enterprise-development.org/wp-content/uploads/Why_Evaluations_Fail_Aug2014.pdf

29.

Korpilahti

Kettunen

Nuotio

, et al (2020) Non–violent childhoods – action plan for the prevention of violence against children 2020–2025. Available at: https://julkaisut.valtioneuvosto.fi/handle/10024/162554

30.

Krug

Mercy

Dahlberg

, et al (2002) The world report on violence and health. The Lancet 360(9339): 1083–88.

31.

Lowe

Plimmer

(2019) Exploring the new world: Practical insights for funding, commissioning and managing in complexity. Available at: http://wordpress.collaboratei.com/wp-content/uploads/Exploring-the-New-World-Report_Main-report.pdf

32.

McGuire

(2006) Collaborative public management: Assessing what we know and how we know it. Public Administration Review 66(Suppl. 1): 33–43.

33.

MacLeod

Cutmore

Deoudes

, et al (2020) Home office Violence Reduction Units – impact evaluation feasibility study summary report for VRUs and wider stakeholders: Research Report 117. Available at: https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/910823/violence-reduction-units-impact-evaluation-feasibility-study-horr117.pdf

34.

Obolensky

(2010) Complex Adaptive Leadership: Embracing Paradox and Uncertainty. Farnham; Surry, VA: Gower Publishing Company.

35.

Our Watch (2021) Change the story: A shared framework for the primary prevention of violence against women in Australia (2nd Edition). Melbourne, Australia: Out Watch. Change the story | Tools and resources | Our Watch - Our Watch.

36.

Public Health England (PHE) (2018b) Outcome evaluation (Guidance). Available at: https://www.gov.uk/government/publications/evaluation-in-health-and-well-being-overview/outcome-evaluation

37.

Public Health England (PHE) (2019) A WHOLE-system multi-agency approach to serious violence prevention: A resource for local system leaders in England. Available at: https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/862794/multi-agency_approach_to_serious_violence_prevention.pdf

38.

Quigg

Timpson

Newbury

, et al. (2020) Violence Prevention Evaluation Toolkit. Liverpool/Cardiff; Public Health Institute, Liverpool John Moores University/Wales Violence Prevention Unit. Violence-Prevention-Evaluation-Toolkit.pdf (violencepreventionwales.co.uk)

39.

Quigg

Timpson

Millings

, et al. (2021) Merseyside Violence Reduction Partnership Whole Systems Evaluation Report: 2020-21. Liverpool. Public Health Institute, LJMU.

40.

Quigg

Milling

Timpson

(2022) Merseyside Violence Reduction Partnership Whole Systems Evaluation Report: 2021-22. Liverpool. Public Health Institute, LJMU.

41.

Rees

Caulfield

Booth

, et al. (2023) The opportunities, challenges and rewards of Community Peer research: a reflection on research practice. Wolverhampton: Institute for Community Research and Development, University of Wolverhampton.

42.

Timpson

Harrison

Bigland

, et al. (2020) Evaluation of the Wales Violence Prevention Unit. Liverpool. Public Health Institute, LJMU.

43.

United Nations (2019) Global study on homicide. United Nations. Available at: https://www.unodc.org/unodc/en/data-and-analysis/global-study-on-homicide.html

44.

Van der Loo

Van Gennip

EMSJ

Bakker

, et al (1995) Evaluation of automated information systems in health care: An approach to classifying evaluative studies. Computer Methods and Programs in Biomedicine 48(1–2): 45–52.

45.

Whitney

Cooperrider

Garrison

, et al (2001) Appreciative inquiry and culture change at GTE: Launching a positive revolution. In: Fry

Barrett

Seiling

, et al (eds) Appreciative Inquiry and Organizational Transformation: Report from the Field. Westport, CT: Praeger Publishers, 130–42.

46.

Wilkinson

Kerslake

Thompson

, et al. (2022) Evaluation of Three Estates Birmingham: Mixed Methods Network Analysis. Grant report for the West Midlands Violence Reduction Unit. Wolverhampton: Institute for Community Research and Development, University of Wolverhampton.

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.12 MB