This pilot study integrated quantitative and qualitative data to examine the feasibility of implementing a modified version of a multiple family group behavioral parent training intervention (The 4Rs and 2Ss for Strengthening Families Program [4Rs and 2Ss]) in child welfare (CW) placement prevention services from the perspectives of participating caregivers (n = 12) and CW staff (n = 12; i.e., 6 caseworkers, 4 supervisors, and 2 administrators). Quantitative surveys were administered to caregivers and CW staff followed by semi-structured interviews to examine the feasibility of implementing the modified 4Rs and 2Ss program as well as factors impacting feasibility. Results indicated that quantitative benchmarks for high feasibility were met in all assessed areas (e.g., family recruitment, caseworker fidelity ratings, CW staff feasibility ratings) except for family attendance, which was markedly lower than desired. Factors facilitating feasibility included agency and research support, intervention ease-of-use, perceived benefits to existing CW practice, and logistical support (e.g., food, transportation, child care) promoting attendance. Factors hindering feasibility included conflicts between research-based eligibility criteria and existing client population demographics, research-related processes resulting in delays, CW staff role conflicts, added workload burden, complex family issues, and power differentials inherent to CW services which complicated families’ voluntary participation.
AaronsG. A.HurlburtM.HorwitzS. M. (2011). Advancing a conceptual model of evidence-based practice implementation in public service sectors. Administration and Policy in Mental Health and Mental Health Services Research, 38(1), 4–23. https://doi.org/10.1007/s10488-010-0327-7
2.
AaronsG. A.PalinkasL. (2007). Implementation of evidence-based practice in child welfare: Service provider perspectives. Administrative Policy & Mental Health, 34(4), 411–419. https://doi.org/10.1007/s10488-007-0121-3
3.
AaronsG. A.SommerfeldD. H. (2012). Leadership, innovation climate, and attitudes toward evidence-based practice during a statewide implementation. Journal of the American Academy of Child & Adolescent Psychiatry, 51(4), 1–15. https://doi.org/10.1016/j.jaac.2012.01.018
4.
AchenbachT. M.RescorlaL. A. (2001). Manual for the ASEBA school-age forms and profiles. Achenbach System of Empirically Based Assessment.
5.
AcriM. C.HamovitchE. K.LambertK.GallerM.ParchmentT. M.BornheimerL. A. (2019). Perceived benefits of a multiple family group for children with behavior problems and their families. Social Work with Groups, 42(3), 197–212. https://doi.org/10.1080/01609513.2019.1567437
6.
AcriM. C.HooleyC. D.HooleyC. D.RichardsonN.RichardsonN.MoabaL. B.MoabaL. B. (2017). Peer models in mental health for caregivers and families. Community Mental Health Journal, 53(2), 241–249. https://doi.org/10.1007/s10597-016-0040-4
7.
AkinB. A.BrookJ.LloydM. H.BhattaraiJ.Johnson-MotoyamaM.MosesM. (2016). A study in contrasts: Supports and barriers to successful implementation of two evidence-based parenting interventions in child welfare. Child Abuse & Neglect, 57, 30–40. https://doi.org/10.1016/j.chiabu.2016.06.002
8.
AkinB. A.MariscalS. E.BassL.McarthurV. B.BhattaraiJ.BrunsK. (2014). Implementation of an evidence-based intervention to reduce long-term foster care: Practitioner perceptions of key challenges and supports. Children and Youth Services Review, 46, 285–293. https://doi.org/10.1016/j.childyouth.2014.09.006
9.
AltmanJ. C. (2017). A study of engagement in neighborhood-based child welfare services. Research on Social Work Practice, 18(6), 555–564. https://doi.org/10.1177/1049731507309825
10.
BarthR. P. (2009). Preventing child abuse and neglect with parent training: Evidence and opportunities. The Future of Children, 2, 95–118. https://doi.org/10.1353/foc.0.0031
11.
CasanuevaC.RingeisenH.WilsonE.SmithK.DolanM. (2011). NSCAW II baseline report: Child well-being (OPRE Report #2011-27b). Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.
12.
ChackoA.GopalanG.FrancoL. M.Dean-AssaelK. M.JacksonJ. M.MarcusS.McKayM. M.HoagwoodK. E.McKayM. M. (2015). Multiple family group service model for children with disruptive behavior disorders: Child outcomes at post-treatment. Journal of Emotional and Behavioral Disorders, 23(2), 67–77. https://doi.org/10.1177/1063426614532690
13.
ChaffinM.SilovskyJ. F.FunderburkB.ValleL. A.BrestanE. V.BalachovaT.JacksonS.LensgrafJ.BonnerB. L. (2004). Parent-child interaction therapy with physically abusive parents: Efficacy for reducing future abuse reports. Journal of Consulting and Clinical Psychology, 72(3), 500–510. https://doi.org/10.1037/0022-006X.72.3.500
14.
ChamberlainP.FeldmanS. W.WulczynF.SaldanaL.ForgatchM. (2016). Implementation and evaluation of linked parenting models in a large urban child welfare system. Child Abuse & Neglect, 53, 27–39. https://doi.org/10.1016/j.chiabu.2015.09.013
15.
ChaudoirS. R.DuganA. G.BarrC. H. (2013). Measuring factors affecting implementation of health innovations: A systematic review of structural, organizational, provider, patient, and innovation level measures. Implementation Science, 8(1), Article 22. https://doi.org/10.1186/1748-5908-8-22
16.
ChorpitaB. F.DaleidenE. L. (2009). Mapping evidence-based treatments for children and adolescents: Application of the distillation and matching model to 615 treatments from 322 randomized trials. Journal of Consulting and Clinical Psychology, 77(3), 566–579. https://doi.org/10.1037/a0014565
17.
Collins-CamargoC.MillarK. (2012). Promoting supervisory practice change in public child welfare: Lessons from university/agency collaborative research in four states. Child Welfare, 91(1), 101–124. https://www.jstor.org/stable/48623313
18.
CreswellJ. W.FettersM. D.IvankovaN. V. (2004). Designing a mixed methods study in primary care. Annals of Family Medicine, 2(1), 7–12. https://doi.org/10.1370/afm.104
DorseyS.KernsS. E. U.TrupinE. W.ConoverK. L.BerlinerL. (2012). Child welfare caseworkers as service brokers for youth in foster care: Findings from project focus. Child Maltreatment, 17(1), 22–31. https://doi.org/10.1177/1077559511429593
21.
EybergS.NelsonM.BoggsS. (2008). Evidence-based psychosocial treatments for children and adolescents with disruptive behavior. Journal of Clinical Child and Adolescent Psychology, 37(1), 215–237. https://doi.org/10.1080/15374410701820117
22.
FeldsteinA. C.GlasgowR. E. (2008). A practical, robust implementation and sustainability model (PRISM) for integrating research findings into practice. The Joint Commission Journal on Quality and Patient Safety, 34(4), 228–243. https://doi.org/10.1016/s1553-7250(08)34030-6
23.
FitzgeraldM. M.TorresM. M.ShipmanK.GorronoJ.KernsS. E. U.DorseyS. (2015). Child welfare caseworkers as brokers of mental health services: A pilot evaluation of project focus Colorado. Child Maltreatment, 20(1), 37–49. https://doi.org/10.1177/1077559514562448
24.
FranksR. P.BoryC. T. (2015). Who supports the successful implementation and sustainability of evidence-based practices? Defining and understanding the roles of intermediary and purveyor organizations. New Directions for Child and Adolescent Development, 2015(149), 41–56. https://doi.org/10.1002/cad.20112
25.
GoodmanL. A.PugachM.SkolnikA.SmithL. (2013). Poverty and mental health practice: Within and beyond the 50-minute hour. Journal of Clinical Psychology, 69(2), 182–190. https://doi.org/10.1002/jclp.21957
26.
GopalanG. (2016). Feasibility of improving child behavioral health using task-shifting to implement the 4Rs and 2Ss program for strengthening families in child welfare. Pilot and Feasibility Studies, 2, Article 21. https://doi.org/10.1186/s40814-016-0062-2
27.
GopalanG.BannonW. M.Dean-AssaelK.FussA.GardnerL.LaBarberaB.McKayM. M. (2011). Multiple family groups: An engaging mental health intervention for child welfare involved families. Child Welfare, 90(4), 135–156.
28.
GopalanG.BornheimerL. A.AcriM.WintersA.O’BrienK. H.ChackoA. (2018). Multiple family group service delivery model for children with disruptive behavior disorders: Impact on caregiver stress and depressive symptoms. Journal of Emotional and Behavioral Disorders, 26(3), 182–192. https://doi.org/10.1177/1063426617717721
29.
GopalanG.ChackoA.FrancoL. M.RotkoL.MarcusS.McKayM. M. (2015). Multiple family groups service delivery model to reduce childhood disruptive behavioral disorders: Outcomes at 6-months follow-up. Journal of Child and Family Studies, 24(9), 2721–2733. https://doi.org/10.1007/s10826-014-0074-6
30.
GopalanG.FussA.WisdomJ. P. (2015). Multiple family groups to reduce child behavior difficulties: Influences on retention for child welfare-involved caregivers. Research on Social Work Practice, 25(5), 564–577. https://doi.org/10.1177/1049731514543526
31.
GopalanG.GoldsteinL.KlingensteinK.SicherC.BlakeC.MckayM. M. (2010). Engaging families into child mental health treatment: Updates and special considerations. Journal of the Canadian Academy of Child and Adolescent Psychiatry, 19(3), 182–196.
32.
GopalanG.HooleyC.WintersA.StephensT. (2019). Perceptions among child welfare staff when modifying a child mental health intervention to be implemented in child welfare services. American Journal of Community Psychology, 63(3–4), 366–377. https://doi.org/10.1002/ajcp.12309
33.
GopalanG.SmallL.FussA.BowmanM.JacksonJ.MarcusS.ChackoA. (2015). Multiple family groups to reduce child disruptive behavior difficulties: Moderating effects of child welfare status on child outcomes. Child Abuse & Neglect, 46, 207–219. https://doi.org/10.1016/j.chiabu.2015.06.006
34.
GreenhalghT.RobertG.MacfarlaneF.BateP.KyriakidouO. (2004). Diffusion of innovations in service organizations: Systematic review and recommendations. The Milbank Quarterly, 82(4), 581–629. https://doi.org/10.1111/j.0887-378X.2004.00325.x
35.
HinshawS. P.LeeS. S. (2002). Oppositional defiant and conduct disorder. In MashE. J.BarkleyR. A. (Eds.), Child psychopathology (2nd ed.) (Vol. 1–Book, Section, pp. 144–198). The Guilford Press.
36.
HooleyC.WintersA. M.PisciottaC.GopalanG. (2020). Caregiver-relevant perspectives from a multi-stakeholder collaborative advisory board on adapting a child mental health intervention to be delivered in child-welfare settings. Journal of Public Child Welfare, 15(3), 318–340. https://doi.org/10.1080/15548732.2020.1724238
37.
HsiehH. F.ShannonS. E. (2005). Three approaches to qualitative content analysis. Qualitative Health Research, 15(9), 1277–1288. https://doi.org/10.1177/1049732305276687
38.
HurlburtM. S.BarthR. P.LeslieL. K.LandsverkJ. A.McCraeJ. S. (2007). Building on strengths: Current status and opportunities for improvement of parent training for families in child welfare services. In HaskinsR.WulczynF. H.WebbM. B. (Eds.), Child protection: Using research to improve policy and practice (Vol. 1, pp. 81–106). Brookings.
39.
HurlburtM. S.LeslieL. K.LandsverkJ.BarthR. P.BurnsB. J.GibbonsR. D.SlymenD. J.ZhangJ. (2004). Contextual predictors of mental health service use among children open to child welfare. Archives of General Psychiatry, 61(12), 1217–1224. https://doi.org/10.1001/archpsyc.61.12.1217
40.
KayeS.DePanfilisD.BrightC.FisherC. (2012). Applying implementation drivers to child welfare systems change: Examples from the field. Journal of Public Child Welfare, 6(4), 512–530. https://doi.org/10.1080/1554872.2012.701841
41.
KazdinA. E.HollandL.CrowleyM.BretonS. (1997). Barriers to treatment participation scale: Evaluation and validation in the context of child outpatient treatment. Journal of Child Psychology and Psychiatry, 38(8), 1051–1062. https://doi.org/10.1111/j.1469-7610.1997.tb01621.x
42.
KolkoD. J.BaumannB. L.HerschellA. D.HartJ. A.HoldenE. A.WisniewskiS. R. (2012). Implementation of AF-CBT by community practitioners serving child welfare and mental health: A randomized trial. Child Maltreatment, 17(1), 32–46. https://doi.org/10.1177/1077559511427346
43.
LeeE.SamplesC. (2008). Evolving roles of public and private agencies in privatized child welfare systems (Topical Paper #3; p. 25). Planning and Learning Technologies, Inc., Office of the Assistant Secretary for Planning and Evaluation, U.S. Department of Health and Human Services.
44.
LyonsA. (n.d.). Lyons acceptability, feasibility, and appropriateness scale (LAFAS).
45.
MarcynyszynL. A.MaherE. J.CorwinT. W. (2011). Getting with the (evidence-based) program: An evaluation of the incredible years parenting training program in child welfare. Children and Youth Services Review, 33(5), 747–757. https://doi.org/10.1016/j.childyouth.2010.11.021
46.
MichalopoulosL.AhnH.ShawT. V.O’ConnorJ. (2012). Child welfare worker perception of the implementation of family-centered practice. Research on Social Work Practice, 22(6), 656–664. https://doi.org/10.1177/1049731512453344
47.
MilesM. B.HubermanA. M. (1994). Qualitative data analysis: An expanded sourcebook (2nd ed.). SAGE.
PalinkasL. A.AaronsG. A.ChorpitaB. F.HoagwoodK.LandsverkJ.WeiszJ. R. (2009). Cultural exchange and the implementation of evidence-based practices: Two case studies. Research on Social Work Practice, 19(5), 602–612. https://doi.org/10.1177/1049731509335529
50.
PatelV.ChowdharyN.RahmanA.VerdeliH. (2011). Improving access to psychological treatments: Lessons from developing countries. Behaviour Research and Therapy, 49(9), 523–528. https://doi.org/10.1016/j.brat.2011.06.012
51.
PelhamW. E.EvansS. W.GnagyE. M.GreensladeK. E. (1992). Teacher ratings of DSM-III--R symptoms for the disruptive behavior disorders: Prevalence, factor analyses, and conditional probabilities in a special education sample. School Psychology Review, 21(2), 285–299. https://doi.org/10.1097/00004583-199203000-00006
ProctorE.HooleyC.MorseA.McCraryS.KimH.KohlP. L. (2019). Intermediary/purveyor organizations for evidence-based interventions in the US child mental health: Characteristics and implementation strategies. Implementation Science, 14(1), Article 3. https://doi.org/10.1186/s13012-018-0845-3
54.
ReynoS. M.McGrathP. J. (2006). Predictors of parent training efficacy for child externalizing behavior problems—A meta-analytic review. Journal of Child Psychology and Psychiatry, 47(1), 99–111. https://doi.org/10.1111/j.1469-7610.2005.01544.x
55.
RingeisenH.CasanuevaC.SmithK.DolanM. (2011). NSCAW II baseline report: Caregiver health and services (OPRE Report #2011-27d). Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.
56.
SaldañaJ. (2015). The coding manual for qualitative researchers (3rd ed.). SAGE.
57.
Sociocultural Research Consultants (2016). Dedoose Version 7.0.23, web application for managing, analyzing, and presenting qualitative and mixed method research data. SocioCultural Research Consultants, LLC.
58.
StambaughL. F.LeslieL. K.RingeisenH.SmithK.HodgkinD. (2012). NSCAW child well-being spotlight: Children in out-of-home placements receive more psychotropic medication and other mental health services than children who remain in-home following a maltreatment investigation (OPRE Report #2012-43). Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.
WillgingC. E.TrottE. M.FettesD.GundersonL.GreenA. E.HurlburtM. S.AaronsG. A. (2017). Research-supported intervention and discretion among frontline workers implementing home visitation services. Research on Social Work Practice, 27(6), 664–675. https://doi.org/10.1177/1049731515601897
62.
World Health Organization. (2008). Task-shifting: Rational redistribution of tasks among health workforce teams: Global Recommendations and guidelines. WHO Document Production Services.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
