Promoting Formative Evaluations and Evaluability Assessments in Research on Domestic Violence Intervention Programs: A Case Study of Seattle’s Domestic Violence Intervention Project (DVIP)

Abstract

We conducted a formative evaluation and evaluability assessment of a novel approach to domestic violence (DV) intervention in Seattle, Washington: The Domestic Violence Intervention Project (DVIP). The DVIP seeks to address DV through evidence-based DV intervention programming and a multi-agency response. Using document reviews, deidentified case file reviews, focus groups with DVIP team members, and a data review, we examined: (1) the extent to which the program theory aligns with the program implemented, (2) the likelihood the program will produce positive results as currently applied, and (3) the feasibility of outcome evaluations as currently designed. Findings suggest that the DVIP is ready for an outcome evaluation. We also discuss broader implications for the field of DV intervention research.

Keywords

domestic violence intervention batterers intervention programs evaluability assessment formative evaluation implementation science

Get full access to this article

View all access options for this article.

References

Babcock

J. C.

Gallagher

M. W.

Richardson

Godfrey

D. A.

Reeves

V. E.

D’Souza

(2024). Which battering interventions work? An updated meta-analytic review of intimate partner violence treatment outcome research. Clinical Psychology Review, 111, 102437. https://doi.org/10.1016/j.cpr.2024.102437

Baker

(2001). Crossing the quality chasm: A new health system for the 21st Century. National Academies Press. https://doi.org/10.1136/bmj.323.7322.1192

Boal

A. L.

Mankowski

E. S.

(2014). The impact of legislative standards on batterer intervention program practices and characteristics. American Journal of Community Psychology, 53(1-2), 218–230. https://doi.org/10.1007/s10464-014-9637-3

Bonta

Andrews

D. A.

(2023). The psychology of criminal conduct (7th ed.). Routledge. https://doi.org/10.4324/9781003292128

Bretschneider

P. J.

Cirilli

Jones

Lynch

Wilson

N. A.

(2017). Document review as a qualitative research data collection method for teacher research [Sage Research Methods Cases Part 2]. Sage. https://doi.org/10.4135/9781473957435

Cannon

Hamel

Buttell

Ferreira

R. J.

(2016). A survey of domestic violence perpetrator programs in the United States and Canada: Findings and implications for policy and intervention. Partner Abuse, 7(3), 226–276. https://doi.org/10.1891/1946-6560.7.3.226

Cheng

S. Y.

Davis

Jonson-Reid

Yaeger

(2021). Compared to what? A meta-analysis of batterer intervention studies using nontreated controls or comparisons. Trauma, Violence, & Abuse, 22(3), 496–511. https://doi.org/10.1177/1524838019865927

Cox

S. M.

Rivolta

P. M.

(2019). Evaluative outcomes of Connecticut’s batterer intervention for high risk offenders. Journal of Aggression, Maltreatment & Trauma, 30(7), 931–949. https://doi.org/10.1080/10926771.2019.1581862

Day

Chung

O’Leary

Justo

Moore

Carson

Gerace

(2010). Integrated responses to domestic violence: Legally mandated intervention programs for male perpetrators. Trends and Issues in Crime and Criminal Justice, 404, 1–8. https://doi.org/10.52922/ti279558

10.

Dunet

D. O.

Losby

J. L.

Tucker-Brown

(2013). Using evaluability assessment to support the development of practice-based evidence in public health. Journal of Public Health Management and Practice, 19(5), 479–482. https://doi.org/10.1097/PHH.0b013e318280014f

11.

Dusin

Melanson

Mische-Lawson

(2023). Evidence-based practice models and frameworks in the healthcare setting: A scoping review. BMJ Open, 13(5), Article e071188. https://doi.org/10.1136/bmjopen-2022-071188

12.

Fixsen

D. L.

Blase

K. A.

Naoom

S. F.

Duda

M. A.

(2013). Implementation drivers: Assessing best practices. National Implementation Research Network, University of North Carolina at Chapel Hill. https://www.iirp.edu/images/conf_downloads/WxsLfD_NIRN-Education-ImplementationDriversAssessingBestPractices.pdf

13.

Hilton

N. Z.

(2021). Domestic violence risk assessment: Tools for effective prediction and management (2nd ed.). American Psychological Association. https://doi.org/10.1037/0000223-000

14.

Hilton

N. Z.

Harris

G. T.

Rice

M. E.

Lang

Cormier

C. A.

Lines

K. J.

(2004). A brief actuarial assessment for the prediction of wife assault recidivism: The Ontario Domestic Assault Risk Assessment. Psychological Assessment, 16(3), 267–275. https://doi.org/10.1037/1040-3590.16.3.267

15.

Kidder

D. P.

Fierro

L. A.

Luna

Salvaggio

McWhorter

Bowen

S.-A.

Murphy-Hoefer

Thigpen

Alexander

Armstead

T. L.

August

Bruce

Clarke

S. N.

Davis

Downes

Gill

House

L. D.

Kerzner

Kun

Young

(2024). CDC Program Evaluation Framework, 2024. Morbidity and Mortality Weekly Report, 73(6), 1–37. https://doi.org/10.15585/mmwr.rr7306a1

16.

Ladd

G. W.

(2005). Children’s peer relations and social competence: A century of progress. Yale University Press.

17.

Leemis

R. W.

Friar

Khatiwada

Chen

M. S.

Kresnow

Smith

S. G.

Caslin

Basile

K. C.

(2022). The National Intimate Partner and Sexual Violence Survey: 2016/2017 Report on intimate partner violence. National Center for Injury Prevention and Control, Centers for Disease Control and Prevention.

18.

Leviton

L. C.

Khan

L. K.

Rog

Dawkins

Cotton

(2010). Evaluability assessment to improve public health policies, programs, and practices. Annual Review of Public Health, 31, 213–233. https://doi.org/10.1146/annurev.publhealth.012809.103625

19.

Murphy

C. M.

Richards

T. N.

Nitsch

L. J.

Green-Manning

Brokmeier

A. M.

Holliday

C. N.

(2021). Evaluation of a community-informed batterer intervention program in a high-stress low-income urban context. Psychology of Violence, 11(6), 509–518. https://doi.org/10.1037/vio0000387

20.

National Conference of State Legislatures. (2019). Domestic violence/domestic abuse definitions and relationships. https://www.ncsl.org/human-services/domestic-violence-domestic-abuse-definitions-and-relationships

21.

Posavac

E. J.

(2015). Program evaluation: Methods and case studies (8th ed.). Routledge. https://doi.org/10.4324/9781315664972

22.

Radatz

Richards

T. N.

Murphy

C. M.

Nitsch

L. J.

Green-Manning

Brokmeier

A. M.

Holliday

C. N.

(2021). Integrating “Principles of Effective Intervention” into domestic violence intervention programs: New opportunities for change & collaboration. American Journal of Criminal Justice, 46, 609–625. https://doi.org.10.1007/s12103-021-09627-8

23.

Radatz

D. L.

Wright

E. M.

(2016). Integrating the principles of effective intervention into batterer intervention programming: The case for moving toward more evidence-based programming. Trauma, Violence, & Abuse, 17(1), 72–87. https://doi.org/10.1177/1524838014566695

24.

Richards

T. N.

Tomsich

Gover

A. R.

Jennings

W. G.

(2016). The cycle of violence revisited: Distinguishing intimate partner violence offenders only, victims only, and victim-offenders. Violence and Victims, 31(4), 573–590. https://doi.org/10.1891/0886-6708.vv-d-15-00056

25.

Rog

(2020). Evaluability assessment. The Evaluator’s Institute.

26.

Taft

C. T.

Campbell

J. C.

(2024). Promoting the use of evidence-based practice for those who engage in intimate partner violence. American Journal of Preventive Medicine, 66(1), 189–192. https://doi.10.1016/j.amepre.2023.08.01

27.

Travers

Á.

McDonagh

Cunningham

Armour

Hansen

(2021). The effectiveness of interventions to prevent recidivism in perpetrators of intimate partner violence: A systematic review and meta-analysis. Clinical Psychology Review, 84. https://doi.org/10.1016/j.cpr.2021.101974

28.

Trevisan

M. S.

Walser

T. M.

(2015). Evaluability assessment: Improving evaluation quality and use. Sage. https://doi.org/10.4135/9781483384634

29.

Washington Administrative Code (WAC) 388-60B. Domestic violence intervention program standards. https://app.leg.wa.gov/wac/default.aspx?cite=388-60B

30.

Washington Association of Sheriffs & Chiefs of Police. (2023). Crime in Washington 2019 annual report. Crime in Washington 2023-compressed.pdf.

31.

Weisburd

Farrington

D. P.

Gill

Ajzenstadt

Bennett

Bowers

Caudy

M. S.

Holloway

Johnson

Lösel

Mallender

Perry

Tang

L. L.

Taxman

Telep

Tierney

Ttofi

M. M.

Watson

Wilson

D. B.

Wodditch

(2017). What works in crime prevention and rehabilitation. Criminology & Public Policy, 16(2), 415–449. https://doi.org/10.1111/1745-9133.12298

32.

Wong

J. S.

Bouchard

(2021). Examining changes in abusive attitudes and behaviors of intimate partner violence perpetrators through a community-based prevention program. Journal of Aggression, Maltreatment & Trauma, 30(9), 1220–1240. https://doi.org/10.1080/10926771.2020.1832172

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.07 MB