Program fidelity instruments are a key ingredient for clinical supervision and implementation as well as effectiveness studies. This study examines the factor structure of the Functional Family Parole services Global Rating Measure (FFP-GRM); the program fidelity instrument of Functional Family Parole services for case management in youth parole, child protection and child welfare services. Between October 2012 and February 2015, program fidelity was measured with the FFP-GRM by Functional Family Parole supervisors. Confirmatory factor analysis was performed on 380 cases and internal consistency reliability coefficients were calculated.
Findings
Confirmatory factor analyses showed that the 33-item and four-factor model of the FFP-GRM achieved a good fit to the data. Internal validity testing results showed that subscale Cronbach’s α ranged between .82 and .90.
Applications
Findings affirm a good fit to the data and a good-to-excellent internal consistency of the FFP-GRM, which is considered sufficient to justify its use. The results are discussed with regard to the use of fidelity instruments for both clinical and research purposes.
AlexanderJ. F.WaldronH. B.RobbinsM. S.NeebA. A. (2013). Functional family therapy for adolescent behavior problems.
Washington, DC:
American Psychological Association.
2.
Andrews, D. A., & Bonta, J. (2010). The psychology of criminal conduct. New Providence, NJ: Routledge.
3.
AndrewsD. A.ZingerI.HogeR. D.BontaJ.GendreauP.CullenF. T. (1990).
Does correctional treatment work? A clinically relevant and psychologically informed meta-analysis. Criminology,
28, 369–404.
4.
AsscherJ. J.Van derPutStamsG. J. J. M. (2015).
Gender differences in the association between child maltreatment and adolescent offending. Journal of Family Violence,
30, 215–225.
5.
BartonC.AlexanderJ. F.WaldronH.TurnerC. W.WarburtonJ. (1985).
Generalizing treatment effects of functional family therapy: Three replications. The American Journal of Family Therapy,
13(3), 16–26.
6.
BelskyJ. (1980).
Child maltreatment: An ecological integration. American Psychologist,
35(4), 320–335.
7.
BelskyJ. (1984).
The determinants of parenting: A process model.Child Development,
55(1), 83–96.
8.
Belsky, J. (1993). Etiology of child maltreatment: A developmental ecological analysis. Psychological Bulletin, 114(3), 413–434. doi: 10.1037/0033-2909.114.3.413
9.
BentlerP. M. (1992).
On the fit of models to covariances and methodology to the bulletin.Psychological Bulletin,
112(3), 400–404.
BronfenbrennerU. (1979). The ecology of human development: Experiments by nature and design.
Cambridge, MA:
Harvard University Press.
12.
BrownJ.CohenP.JohnsonJ. G.SalzingerS. (1998).
A longitudinal analysis of risk factors for child maltreatment: Findings of a 17-year prospective study of officially recorded and self-reported child abuse and neglect. Child Abuse & Neglect,
22(11), 1065–1078.
13.
BusschersI.BoendermakerL.DinkgreveM. A. H. M. (2016).
Validation and operationalization of intensive family case management: A Delphi study. Child and Adolescent Social Work Journal,
33(1), 69–78.
14.
CincchittiD.CarlsonV. (Eds). (1989). Child maltreatment.
Cambridge:
Cambridge University Press.
15.
CincchittiD.RizleyR. (1981).
Developmental perspectives on etiology, intergenerational transmission and sequelae of child maltreatment. New Directions for Child and Adolescent Development,
11, 31–56.
16.
CookD. A.BeckmanT. J. (2006).
Current concepts in validity and reliability for psychometric instruments: Theory and application. The American Journal of Medicine,
119(2), 166-e7–166-e16.
17.
CronbachL. J. (1951).
Coefficient alpha and the internal structure of tests.Psychometrika,
16(3), 297–334.
18.
EvansG. W.LiD.WhippleS. S. (2013).
Cumulative risk and child development. Psychological Bulletin,
139(6), 1342–1396.
19.
ForgatchM. S.PattersonG. R. (2010). Parent Management Training – Oregon Model: An intervention for antisocial behavior in children and adolescents. In WeiszJ. R.KazdinA. E. (Eds), Evidence-based psychotherapies for children and adolescents (pp. 159–177).
New York, NY:
Guilford Press.
20.
GoenseP. B.BoendermakerL.van YperenT. (2016).
Support systems for treatment integrity. Research on Social Work Practice,
26(1), 69–73.
21.
HenggelerS. W.SchoenwaldS. K.BorduinC. M.RowlandM.CunninghamP. B. (2009). Multisystemic therapy for antisocial behavior in children and adolescents.
New York, NY:
Guilford Press.
22.
Hoyle, R. H. (2008). Handbook of structural equation modeling. New York, NY: Guilford Press.
23.
HuL.BentlerP. M. (1999).
Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives.Structural Equation Modeling,
6(1), 1–55.
24.
Jaccard, J., & Wan, C. K. (1996). LISREL approaches to interaction effects in multiple regression (No. 114). Thousand Oaks, CA, US: Sage.
25.
KnutsonN. M.ForgatchM. S.RainsL. A.SigmarsdóttirM. (2009). Fidelity of Implementation Rating System (FIMP): The manual for PMTO (Revised ed.).
Eugene, OR:
Implementation Sciences International, Inc.
26.
LipseyW. M. (2009).
The primary factors that characterize effective interventions with juvenile offenders: A meta analytic overview.Victims and Offenders,
4, 124–147.
27.
LoeberR.SlotW.Stouthamer-LoeberM. (2008). A cumulative developmental model of risk and promotive factors. In LoeberR.KootH. M.SlotN. W.van der LaanP. H. HoeveM (Eds), Tomorrow’s criminals: The development of child delinquency and effective interventions (pp. 133–161).
Hampshire:
Ashgate Publishing Ltd.
28.
LöselF. (1993).
The effectiveness of treatment in institutional and community settings.Criminal Behaviour and Mental Health,
3(4), 416–437.
29.
LowenkampC. T.LatessaE. J. (2005).
Increasing the effectiveness of correctional programming through the risk principle: Identifying offenders for residential placement. Criminology and Public Policy,
4(2), 501–528.
MacKenzieM. J.KotchJ. B.LeeL. (2011).
Toward a cumulative ecological risk model for the etiology of child maltreatment. Children and Youth Services Review,
33(9), 1638–1647.
32.
Marsh, H. W., & Hau, K. (1996). Assessing Goodness of Fit. The Journal of Experimental Education, 64(4), 364–390, DOI: 10.1080/00220973.1996.10806604
33.
McLeodB. D.Southam‐GerowM. A.TullyC. B.RodríguezA.SmithM. M. (2013).
Making a case for treatment integrity as a psychosocial treatment quality indicator for youth mental health care. Clinical Psychology: Science and Practice,
20(1), 14–32.
34.
MartinezR. G.LewisC. C.WeinerB. J. (2014).
Instrumentation issues in implementation science. Implementation Science,
9(1), 118.
MuthénL. K.MuthénB. O. (2012). Mplus. The comprehensive modelling program for applied researchers: User’s guide (5th ed.).
Los Angeles, CA:
Muthén & Muthén.
37.
PerepletchikovaF.KazdinA. E. (2005).
Treatment integrity and therapeutic change: Issues and research recommendations. Clinical Psychology; Science and Practice,
12(4), 365–383.
38.
RistM. (2011). Yolo County (California) Probation Department, Report to County Commissioners.
39.
Robbins, M.S. & Rowlands, S. (2012). Using data to improve implementation outcomes and sustainability. Presented at the Annual Blueprints for Violence Prevention Conference. San Antonio, Texas.
40.
RowlandM. K. (2009). Family-based reintegration: Effective interventions for juveniles on parole. El Paso, TX:
LFB Scholarly Publishing LLC.
41.
RutterM.TizardJ.WhitmoreK. (1970). Education, health, and behavior.
New York, NY:
Wiley.
42.
SchaferJ. L.OlsenM. K. (1998).
Multiple imputation for multivariate missing-data problems: A data analyst's perspective. Multivariate Behavioral Research,
33, 545–571.
43.
SchoenwaldS. K.ChapmanJ. E.SheidowA. J.CarterR. E. (2009).
Long-term youth criminal outcomes in MST transport: The impact of therapist adherence and organizational climate and structure. Journal of Clinical Child & Adolescent Psychology,
38(1), 91–105.
44.
SchoenwaldS. K.GarlandA. F. (2013).
A review of treatment adherence measurement methods. Psychological Assessment,
25(1), 146–156.
SchumackerR. E.LomaxR. G. (2004). A beginner's guide to structural equation modeling (2nd ed.).
Mahwah, NJ:
Lawrence Erlbaum Associates.
47.
Sexton,T.L. & Alexander, J.F. (2003). Functional Family Therapy. A mature clinical model for working with at-risk adolescentsand their families. In T. Sexton, G. Weeks & M. Robbins (Eds.), Handbook of family therapy: The science and practiceof working with families and couples (pp. 323–348). New York, NY, US: Brunner-Routledge.
48.
SextonT. L.TurnerC. W. (2010).
The effectiveness of functional family therapy for youth with behavioral problems in a community practice setting. Journal of Family Psychology,
24(3), 339–348.
49.
Stouthamer-LoeberM.LoeberR.WeiE.FarringtonD. P.WikströmP.-O. H. (2002).
Risk and promotive effects in the explanation of persistent serious delinquency in boys. Journal of Consulting and Clinical Psychology,
70(1), 11–23.
50.
Tennyson, H. R. (2009). Reducing juvenile recidivism: A meta-analysis of treatment outcomes. Hillsboro, OR: Pacific University, School of Professional Psychology (PhD Thesis).
51.
ThorgersenD. (2012). Implementation of FFT in Norway. Presented at the annual blueprints for violence prevention conference. San Antonio.
52.
Tong SangM. N.De WitA. C.De BoerM. D.JongmanE. (2012). Functional Family Parole Services. Een onderzoek naar de effectiviteit van FFPS [Functional Family Parole Services. Study on the effectiveness of FFPS].
Amsterdam:
De Bascule.
53.
UllmanJ. B. (2001). Structural equation modeling. In TabachnickB.FidellL. (Eds), Using multivariate statistics (pp. 653–771).
Needham Heights, MA:
Allyn & Bacon.
WaltzC. F.StricklandO. L.LenzE. R. (2012). Content analysis. In: Measurement in nursing and health research (5th ed., pp. 279–286). New York, NY: Springer Publishing.
