The decision to substantiate a case of maltreatment is pivotal to myriad stakeholders; however, the reliability (and therefore, accuracy) of substantiation determinations is suspect. The authors tested if (a) they could develop more reliable substantiation definitions and processes and (b) case workers would be comfortable with and accepting of a new approach. Determinations from five field sites were compared with those of master reviewers (made while listening to the field sites' case presentations). Agreement, sensitivity, specificity, positive predictive values, and negative predictive values were high overall (.87, .96, .97, .89, and .97, respectively) and for each form of maltreatment. Agreement was substantially improved. The definitions and the determination process were well liked by case workers and other stakeholders. Clearly, implementing standardized definitions in a typical child protective environment would pose myriad political challenges. However, our results suggest achieving reliable substantiation determinations may be a feasible goal.
Alter, C. F. (1985). Decision-making factors in cases of child neglect. Child Welfare, 64, 99-111.
2.
American Psychiatric Association. (1980). Diagnostic and statistical manual of mental disorders (3rd ed.). Washington, DC: Author.
3.
American Psychiatric Association. (2000). Diagnostic and statistical manual of mental disorders (4th ed., text rev.). Washington, DC: Author.
4.
Barnett, D., Manly, J. T., & Cicchetti, D. (1991). Continuing toward an operational definition of child maltreatment. Development and Psychopathology, 3, 19-29.
5.
Barnett, D., Manly, J. T., & Cicchetti, D. (1993). Defining child maltreatment: The interface between policy and research. In D. Cicchetti & S. L. Toth (Eds.), Advances in applied developmental psychology: Child abuse, child development, and social policy(pp. 7-73). Norwood, NJ: Ablex.
6.
Black, D. A., Heyman, R. E., & Slep, A. M. S. (2001). Risk factors for child physical abuse. Aggression and Violent Behavior, 6, 121-188.
7.
Dawes, R. M. (1994). House of cards: Psychology and psychotherapy built on myth. New York: Free Press.
8.
Defense Task Force on Domestic Violence. (2001). Initial report of the Defense Task Force on Domestic Violence. Retrieved January 11, 2005, from www.dtic.mil/domesticviolence/reports/dv_rpt1.pdf
9.
Drake, B. (1996). Predictors of preventative service provision among unsubstantiated cases. Child Maltreatment, 1, 168-175.
10.
Drake, B., Jonson-Reid, M., Way, I., & Chung, S. (2003). Substantiation and recidivism. Child Maltreatment, 8, 248-260.
11.
Eckenrode, J., Munsch, J., Powers, J., & Doris, J. (1988). The nature and substantiation of official sexual abuse reports. Child Abuse Neglect, 12, 311-319.
12.
English, D. J., Marshall, D. B., Coghlan, L., Brummel, S., & Orme, M. (2002). Causes and consequences of the substantiation decision in Washington State Child Protective Services. Children and Youth Services Review, 24, 817-851.
13.
Glaser, D. (2002). Emotional abuse and neglect (psychological maltreatment): A conceptual framework. Child Abuse and Neglect, 26, 697–714.
14.
Goldberg, L. R. (1968). Simple models or simples processes? Some research on clinical judgments. American Psychologist, 23, 483-496.
15.
Haynes, S. N., & O'Brien, W. H. (2000). Principles and practice of behavioral assessment. New York: Kluwer/Plenum.
16.
Haynes, S. N., Richard, D. C. S., & Kubany, E. S. (1995). Content validity in psychological assessment: A functional approach to concepts and methods. Psychological Assessment, 7, 238-247.
17.
Heyman, R. E., & Slep, A. M. S. (in press). Creating and field-testing diagnostic criteria for partner and child maltreatment. Journal of Family Psychology.
18.
King, G., Trocmé, N., & Thatte, N. (2003). Substantiation as a multitier process: The results of a NIS-3 analysis. Child Maltreatment, 8, 173-182.
19.
McCarroll, J. E., Ursano, R. J., & Fan, Z. (2004). Classification of the severity of U.S. Army and civilian reports of child maltreatment. Military Medicine, 169, 461-464.
20.
McGee, R. A., & Wolfe, D. A. (1991). Psychological maltreatment: Toward an operational definition. Development and Psychopathology, 3, 3-18.
21.
National Clearinghouse on Child Abuse and Neglect. (2003). Definitions of child abuse and neglect: Summary of state laws. Available at www.psychology.sunysb.edu/ftrlab-/
22.
National Clearinghouse on Child Abuse and Neglect. (2005). Definitions of child abuse and neglect: Summary of state laws. Retrieved July 15, 200, from http://nccanch.acf.hhs.gov/general/legal/statutes/defineall.pdf
23.
NGO Group for the Convention on the Rights of the Child, Focal Point on the Sexual Exploitation of Children. (2000). Available at www.psychology.sunysb.edu/ftrlab-/
24.
Office of the Under Secretary of Defense. (1997). DoD instruction 6400.2, 1-Aug-97. Washington, DC: Office of the Under Secretary of Defense for Personnel and Readiness.
25.
Ondersma, S. J., Chaffin, M., Berliner, L., Cordon, I., Goodman, G. S., & Barnett, D. (2001). Sex with children is abuse: Comment on Rind, Tromovitch, and Bauserman (1998). Psychological Bulletin, 127, 707-714.
26.
Rind, B., Tromovitch, P., & Bauserman, R. (1998). A meta-analytic examination of assumed properties of child sexual abuse using college samples. Psychological Bulletin, 124, 22-53.
27.
Saltzman, L. E., Fanslow, J. L., McMahon, P. M., & Shelley, G. A. (1999). Intimate partner violence surveillance: Uniform definitions and recommended data elements (Vers. 1.0). Atlanta, GA: Centers for Disease Control and Prevention, National Center for Injury Prevention and Control.
28.
Sedlak, A. J., & Broadhurst, D. D. (1996). Third National Incidence Study of Child Abuse and Neglect (Contract No. 105-91-1800). Washington, DC: National Center on Child Abuse and Neglect.
29.
Stith, S. M., Rosen, K. H., Middleton, K. A., Busch, A. L., Lundeberg, K., & Carlton, R. P. (2000). The intergenerational transmission of spouse abuse: A meta-analysis. Journal of Marriage and the Family, 62, 640-654.
30.
Widom, C. S., & Shepard, R. L. (1996). Accuracy of adult recollections of childhood victimization: Part 1. Childhood physical abuse. Psychological Assessment, 8, 412-421.
31.
Winefield, H. R., & Bradley, P. W. (1992). Substantiation of reported child abuse or neglect: Predictors and implications. Child Abuse and Neglect, 16, 661-671.
