Effectiveness of a Trauma-Informed Care Initiative in a State Child Welfare System: A Randomized Study

Abstract

Trauma-informed care (TIC) initiatives in state child welfare agencies are receiving more attention, but little empirical evidence exists as to their efficacy. The purpose of this study was to assess changes in self-reported practices and perceptions of child welfare staff involved in a multifaceted, statewide TIC intervention. Ten child welfare offices were matched and randomized to an early or delayed cohort. Staff were surveyed at Time 1 prior to any intervention, Time 2 postintervention for Cohort 1, and Time 3 postintervention for Cohort 2. The survey covered six domains: trauma screening, case planning, mental health and family involvement, progress monitoring, collaboration, and perceptions of the state’s overall system performance. Linear mixed modeling assessed the effect of the intervention. Cohort by time interaction was significant for three intervention targets. We demonstrate, using a rigorous study design, the mixed results of a multimodal intervention to improve trauma-informed attitudes, practices, and system performance. TIC initiatives must account for complex, dynamic contextual factors.

Keywords

trauma informed child welfare services child PTSD/trauma dissemination/implementation program evaluation

Get full access to this article

View all access options for this article.

References

American Educational Research Association, American Psychological Association, National Council on Measurement in Education. (2014). Standards for Educational and Psychological Testing. Washington, DC: American Educational Research Association.

Bartlett

J. D.

Barto

Griffin

J. L.

Fraser

J. G.

Hodgdon

Bodian

(2016). Trauma-informed care in the Massachusetts child trauma project. Child Maltreatment, 21, 101–112. doi:10.1177/1077559515615700

Boyas

J. F.

Wind

L. H.

Ruiz

(2015). Exploring patterns of employee psychosocial outcomes among child welfare workers. Children and Youth Services Review, 52, 174–183. doi:10.1016/j.childyouth.2014.11.002

Burns

B. J.

Phillips

S. D.

Wagner

H. R.

Barth

R. P.

Kolko

D. J.

Campbell

Landsverk

(2004). Mental health need and access to mental health services by youths involved with child welfare: A national survey. Journal of the American Academy of Child & Adolescent Psychiatry, 43, 960–970. doi:10.1097/01.chi.0000127590.95585.65

Casanueva

C. W. E.

Smith

Dolan

Ringeisen

Horne

(2012). NSCAW II wave 2 report: Child well-being (2012-38). Retrieved from Washington, DC: U.S. Department of Health & Human Services.

Conners-Burrow

N. A.

Kramer

T. L.

Sigel

B. A.

Helpenstill

Sievers

McKelvey

(2013). Trauma-informed care training in a child welfare system: Moving it to the front line. Children and Youth Services Review, 35, 1830–1835. doi:10.1016/j.childyouth.2013.08.013

Dempster

A. P.

Laird

N. M.

Rubin

D. B.

(1977). Maximum likelihood from incomplete data via the EM Algorithm. Journal of the Royal Statistical Society. Series B (Methodological), 39, 1–38.

Department of Health and Human Services, Administration on Children, Youth and Families. (2012). Initiative to improve access to needs-driven, evidence-based/evidence-informed mental and behavioral health services in child welfare. HHS-2012-ACF-ACYF-CO-0279. Washington, DC: FOA from DHHS Administration for Children and Families.

Felitti

V. J.

Anda

R. F.

Nordenberg

Williamson

D. F.

Spitz

A. M.

Edwards

… Marks

J. S.

(1998). Relationship of childhood abuse and household dysfunction to many of the leading causes of death in adults. The Adverse Childhood Experiences (ACE) Study. The American Journal of Preventive Medicine, 14, 245–258.

10.

Fitzgerald

M. M.

Torres

M. M.

Shipman

Gorrono

Kerns

S. E.

Dorsey

(2015). Child welfare caseworkers as brokers of mental health services: A pilot evaluation of Project Focus Colorado. Child Maltreatment, 20, 37–49. doi:10.1177/1077559514562448

11.

Gittell

J. H.

(2002). Coordinating mechanisms in care provider groups: Relational coordination as a mediator and input uncertainty as a moderator of performance effects. Management Science, 48, 1408–1426. doi:10.1287/mnsc.48.11.1408.268

12.

Gittell

J. H.

Fairfield

K. M.

Bierbaum

Head

Jackson

Kelly

… Zuckerman

(2000). Impact of relational coordination on quality of care, postoperative pain and functioning, and length of stay: A nine-hospital study of surgical patients. Med Care, 38, 807–819.

13.

Gittell

J. H.

Seidner

Wimbush

(2010). A relational model of how high-performance work systems work. Organization Science, 21, 490–506. doi:10.1287/orsc.1090.0446

14.

Greenhalgh

Robert

MacFarlane

Bate

Kyriakidou

(2004). Diffusion of innovations in service organizations: Systematic review and recommendations. Milbank Quarterly, 82, 581–629.

15.

Hanson

R. F.

Lang

(2016). A critical look at trauma-informed care among agencies and systems serving maltreated youth and their families. Child Maltreatment. doi:10.1177/1077559516635274

16.

Harris

Fallot

R. D.

(2001). Envisioning a trauma-informed service system: A vital paradigm shift. New Directions for Mental Health Services, 2001, 3–22. doi:10.1002/yd.23320018903

17.

Havens

D. S.

Vasey

Gittell

J. H.

Lin

W. T.

(2010). Relational coordination among nurses and other providers: Impact on the quality of patient care. Journal of Nursing Management, 18, 926–937. doi:10.1111/j.1365-2834.2010.01138.x

18.

Holm

(1979). A Simple sequentially rejective multiple test procedure. Scandinavian Journal of Statistics, 6, 65–70.

19.

Horwitz

S. M.

Hurlburt

M. S.

Goldhaber-Fiebert

J. D.

Heneghan

A. M.

Zhang

Rolls-Reutz

… Stein

R. E. K.

(2012). Mental health services use by children investigated by child welfare agencies. Pediatrics, 130, 861–869. doi:10.1542/peds.2012-1330

20.

Johnco

Salloum

Olson

K. R.

Edwards

L. M.

(2014). Child welfare workers’ perspectives on contributing factors to retention and turnover: Recommendations for improvement. Children and Youth Services Review, 47, 397–407. doi:10.1016/j.childyouth.2014.10.016

21.

Kerns

S. E.

Pullmann

M. D.

Negrete

Uomoto

J. A.

Berliner

Shogren

… Putnam

(2016). Development and implementation of a child welfare workforce strategy to build a trauma-informed system of support for foster care. Child Maltreatment. doi:10.1177/1077559516633307

22.

Kim

Kao

(2014). A meta-analysis of turnover intention predictors among U.S. child welfare workers. Children and Youth Services Review, 47, 214–223. doi:10.1016/j.childyouth.2014.09.015

23.

Kolko

D. J.

Hurlburt

M. S.

Zhang

Barth

R. P.

Leslie

L. K.

Burns

B. J.

(2010). Posttraumatic stress symptoms in children and adolescents referred for child welfare investigation. A national sample of in-home and out-of-home care. Child Maltreatment, 15, 48–63. doi:10.1177/1077559509337892

24.

Kramer

T. L.

Sigel

B. A.

Conners-Burrow

N. A.

Savary

P. E.

Tempel

(2013). A statewide introduction of trauma-informed care in a child welfare system. Children and Youth Services Review, 35, 19–24. doi:10.1016/j.childyouth.2012.10.014

25.

Landsverk

Burns

Stambaugh

L. F.

Rolls-Reutz

(2006). Mental health care for children and adolescents in foster care: Review of research literature. Retrieved from http://www.casey.org/Resources/Publications/pdf/MentalHealthCareChildren.pdf

26.

Lang

J. M.

(2017). Trauma screening in child welfare: Lessons learned from five states. Journal of child & adolescent trauma, 10, 405–416. doi:10.1007/s40653-017-0155-y

27.

Lang

J. M.

Campbell

Shanley

Crusto

C. A.

Connell

C. M.

(2016). Building capacity for trauma-informed care in the child welfare system: Initial results of a statewide implementation. Child Maltreatment. doi:10.1177/1077559516635273

28.

McLaughlin

K. A.

Greif Green

Gruber

M. J.

Sampson

N. A.

Zaslavsky

A. M.

Kessler

R. C.

(2012). Childhood adversities and first onset of psychiatric disorders in a national sample of US adolescents. Archives of General Psychiatry, 69, 1151–1160. doi:10.1001/archgenpsychiatry.2011.2277

29.

Miller

E. A.

Green

A. E.

Fettes

D. L.

Aarons

G. A.

(2011). Prevalence of maltreatment among youths in public sectors of care. Child Maltreatment, 16, 196–204. doi:10.1177/1077559511415091

30.

The National Child Traumatic Stress Network. (2015). Creating trauma-informed systems. Retrieved from hhtp://www.nctsn.org/resources/topics/creating-trauma-informed-systems

31.

Nemeroff

C. B.

Bremner

J. D.

Foa

E. B.

Mayberg

H. S.

North

C. S.

Stein

M. B.

(2006). Posttraumatic stress disorder: A state-of-the-science review. Journal of Psychiatric Research, 40, 1–21. doi:10.1016/j.jpsychires.2005.07.005

32.

Pires

Grimes

Allen

Gilmer

Mahadevan

(2013, 12). Identifying opportunities to improve children's behavioral health care: An analysis of medicaid utilization and expenditures. Faces of Medicaid Data Brief. Retrieved from https://www.chcs.org/media/Identifying-Opportunities-to-Improve-Childrens-Behavioral-Health-Care2.pdf

33.

Rosenberg

H. J.

Vance

J. E.

Rosenberg

S. D.

Wolford

G. L.

Ashley

S. W.

Howard

M. L.

(2014). Trauma exposure, psychiatric disorders, and resiliency in juvenile-justice-involved youth. Psychological Trauma: Theory, Research, Practice, and Policy, 6, 430–437. doi:10.1037/a0033199

34.

Rubin

(1987). Multiple imputation for nonresponse in surveys. New York, NY: Wiley.

35.

SAS Institute Inc. (2013). SAS/STAT 13.1 User’s Guide. Cary, NC: Author.

36.

Schafer

J. L.

(1997). Analysis of Incomplete Data. London, England: Chapman and Hall.

37.

Shoenberg

(2009, 10 15). Layoffs cut into human services—Largest department hit the hardest. Concord Monitor. Retrieved from http://www.concordmonitor.com

38.

Shonkoff

J. P.

(2012). Leveraging the biology of adversity to address the roots of disparities in health and development. Proceedings of the National Academy of Sciences U S A, 109, 17302–17307. doi:10.1073/pnas.1121259109S

39.

Substance Abuse and Mental Health Services Administration. (2014). SAMHSA’s Concept of Trauma and Guidance for a Trauma-Informed Approach. HHS Publication No. (SMA) 14-4884. Rockville, MD: Substance Abuse and Mental Health Services Administration.