Family support programs commonly use self-sufficiency matrices (SSMs) to measure family outcomes, however, validation research on SSMs is sparse. This study examined the reliability of the Colorado Family Support Assessment 2.0 (CFSA 2.0) to measure family self-reliance across 14 domains (e.g., employment).
Methods:
Ten written case studies were developed. Family advocates (n = 24) independently coded each case study on each domain of the CFSA 2.0. Intraclass correlation (ICC) coefficients were calculated to determine the level of agreement between participants. Rating accuracy was calculated by subtracting the correct score for each domain and case study from the score given by the raters.
Results:
ICCs ranged from .79 to .96. Across all domains and case studies, family advocates were 84.4% accurate. Allowing for minor deviations (off by 1 on the 5-point scale) shows 96% accuracy.
Discussion:
A well-constructed SSM can be used to collect reliable and objective data on family self-sufficiency.
BenedettiG. (2012). Innovations in the field of child abuse and neglect prevention: A review of the literature. Chicago, IL: Chapin Hall at the University of Chicago.
Chase-LansdaleL. P.Brooks-GunnJ. (2014). Two generation programs in the twenty first century. The Future of Children, 24, 13–40. Retrieved fromhttp://files.eric.ed.gov/fulltext/EJ1029028.pdf
CountsJ. M.BuffingtonE. S.Chang-RiosK.RasmussenH. N.PreacherK. J. (2010). The development and validation of the protective factors survey: A self-report measure of protective factors against child maltreatment. Child Abuse and Neglect, 34, 762–772. doi:10.1016/j.chiabu.2010.03.003
EndresJ.RichardsonB.ShermanJ. (1999). Testing the reliability/validity of the California matrix. Retrieved from Matrix Outcomes Model websitehttp://www.matrixoutcomesmodel.com
9.
FassaertT.LauriksS.van de WeerdS.TheunissenJ.KikkertM.DekkerJ.…de WitM. (2013). Psychometric properties of the Dutch version of the self-sufficiency matrix (SSM-D). Community Mental Health Journal, 50, 583–590. doi:10.1007/s10597-013-9683-6
10.
FernandezE. (2004). Effective interventions to promote child and family wellness: A study of outcomes of intervention through children’s family centres. Child and Family Social Work, 9, 91–104. doi:10.1111/j.1365-2206.2004.00315.x
11.
FernandezE. (2007). Supporting children and responding to their families: Capturing the evidence on family support. Children and Youth Services Review, 29, 1368–1394. doi:10.1016/j.childyouth.2007.05.012
12.
ForestC. (2003). Empowerment skills for family workers: A worker handbook, the comprehensive curriculum of the Cornell Family Development Credential. Ithaca, NY: Cornell Family Development Press.
13.
FRIENDS National Resource Center for Community Based Child Abuse Prevention. (2011). The Protective Factors Survey user’s manual. Retrieved from FRIENDS National Resource Center websitehttp://friendsnrc.org
14.
HallgrenK. A. (2012). Computing inter-rater reliability for observational data: An overview and tutorial. Tutorials for Quantitative Methods in Psychology, 8, 23–34. Retrieved fromhttp://www.tqmp.org/Content/vol08-1/p023/p023.pdf
15.
Harper BrowneC. (2014). The strengthening families approach and protective factors framework: Branching out and reaching deeper. Washington, DC: Center for the Study of Social Policy.
16.
HubbleC. (2010). Alabama Network of Family Resource Centers (ANFRC) impact study report. Retrieved from the Alabama Network of Family Resource Centers websitehttp://anfrconline.homestead.com/about.html
17.
HoutM.CumberworthE.DanzigerS.WimerC.JuskoK.WeisshaarK.…ReardonS. (2014). State of the Union: The Poverty and Inequality Report 2014. Retrieved from Stanford University, The Stanford Center on Poverty and Inequality websitehttp://web.stanford.edu/group/scspi/sotu/SOTU_2014_CPI.pdf
18.
ManningM.HomelR.SmithC. (2010). A meta-analysis of the effects of early developmental prevention programs in at-risk populations on non-health outcomes in adolescence. Children and Youth Services Review, 32, 506–519. doi:10.1016/j.childyouth.2009.11.003
19.
MillsG.AmickJ. (2010). Can savings help overcome income instability?(Brief #18). Washington, DC: The Urban Institute.
20.
O’Brien-StrainM.GuntherK.RosenbergerA.TheobaldN. (2012). San Francisco family resource center initiative: Year 2 evaluation: FY10/11. San Francisco, CA: Mission Analytics Group.
RichmondF.ValentinM. (2012). The accountable case manager: Principles and practices for effective case management, a guide for community action agencies and CSBG funded eligible entities (2nd ed.). Camp Hill, PA: The Center for Applied Management Practices.
24.
ShonkoffJ. P. (2010). Building a new biodevelopmental framework to guide the future of early childhood policy. Child Development, 81, 357–367. doi:10.1111/j.1467-8624.2009.01399.x
WalkerJ. (2008). How and why, does wraparound work: A theory of change. In BrunsE. J.WalkerJ. S. (Eds.), The resource guide to wraparound (pp. 1–12). Portland, OR: National Wraparound Initiative, Research and Training Center for Family Support and Children’s Mental Health.
