This study examines the average reliability of Hare Psychopathy Checklists (PCLs) adapted for use in samples of youthful offenders (aged 12 to 21 years). Two forms of reli ability are examined: 18 α estimates of internal consistency and 18 intraclass correlation (two or more raters) estimates of interrater reliability. The results, an average internal consistency reliability estimate of .85 and an average interrater reliability estimate of .91, are both acceptable. The only study characteristic that accounts for a sizable amount of variance in both forms of reliability is the standard deviation of the PCL total score reported for a study. Total score variation and reliability estimate magnitudes are positively related.
References marked with an asterisk indicate studies included in the reliability generalization.
2.
Auslander, B. A. (1998). An exploratory study investigating variables in relation to juvenile sexual reoffending (Doctoral dissertation, Florida State University, 1998). Dissertation Abstracts International, 59(9-B), 5069.
3.
Beretvas, N. S., & Pastor, D. A. (2003). Using mixed-effects models in reliability generalization studies. Educational and Psychological Measurement, 63, 75-95.
4.
Brandt, J. R., Kennedy, W. A., Patrick, C. J., & Curtin, J. J. (1997). Assessment of psychopathy in a population of incarcerated adolescent offenders. Psychological Assessment, 9, 429-435.
5.
Bravo, G., & Potvin, L. (1991). Estimating the reliability of continuous measures with Cronbach’s alpha or the intraclass correlation coefficient: Toward the integration of two traditions. Journal of Clinical Epidemiology, 44, 381-390.
6.
Caruso, J. C. (2000). Reliability generalization of the NEO personality scales. Educational and Psychological Measurement, 60, 236-254.
7.
Chandler, M., & Moran, T. (1990). Psychopathy and moral development: A comparative study of delinquent and nondelinquent youth. Development and Psychopathology, 2, 227-246.
8.
Cooke, D., Forth, A., & Hare, R. (1998). Psychopathy: Theory, research and implications for society. Dordrecht, the Netherlands: Kluwer.
9.
Cronbach, J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16(3), 297-334.
10.
Dimitrov, D. M. (2002). Reliability: Arguments for multiple perspectives and potential problems with generalization across studies. Educational and Psychological Measurement, 62(5), 783-801.
11.
Dodds, L. D. (1999). Legislative exclusion statutes and psychopathy: Balancing rehabilitation ideals and retribution goals with juvenile offenders (Doctoral dissertation, Allegheny University of Health Sciences, 1999). Dissertation Abstracts International, 60(08), 4217.
12.
Edens, J. F., Petrila, J., & Buffington, J. K. (2002). Psychopathy and the death penalty: Can the Psychopathy Checklist-Revised identify offenders who represent “a continuing threat to society”?Journal of Psychiatry and Law, 29, 433-481.
13.
Edens, J. F., Skeem, J. L., Cruise, K. R., & Cauffman, E. (2001). Assessment of “juvenile psychopathy” and its association with violence: A critical review. Behavioral Sciences and the Law, 19, 53-80.
14.
Field, A. P. (2001). Meta-analysis of correlation coefficients: A Monte Carlo comparison of fixed-and random-effects methods. Psychological Methods, 6, 161-180.
15.
Forth, A., Hart, S., & Hare, R. (1990). Assessment of psychopathy in male young offenders. Psychological Assessment, 2, 342-344.
16.
Forth, A., Kosson, D., & Hare, R. (2003). Hare Psychopathy Checklist: Youth Version (PCL:YV). Toronto, Canada: Multi-Health Systems.
17.
Forth, A. E., & Burke, H. C. (1998). Psychopathy in adolescence: Assessment, violence, and developmental precursors. In D. J. Cooke, A. E. Forth, & R. D. Hare (Eds.), Psychopathy: Theory, research, and implications for society (pp. 161-187). Dordrecht, the Netherlands: Kluwer.
18.
Frick, P. J. (2002). Juvenile psychopathy from a developmental perspective: Implications for construct development and use inforensic assessments. Law and Human Behavior, 26, 247-253.
19.
Fulero, S. M. (1995). Review of the Hare Psychopathy Checklist-Revised. In J. C. Conoley & J. C. Impara (Eds.), Twelfth mental measurements yearbook (pp. 453-454). Lincoln, NE: Buros Institute.
20.
Gacono, C. B. (2000). The clinical and forensic assessment of psychopathy: A practitioner’s guide. Hillsdale, NJ: Lawrence Erlbaum.
21.
Gretton, H. M., McBride, M., Hare, R. D., O’Shaughnessy, R., & Kumka, G. (2001). Psychopathy and recidivism in adolescent sex offenders. Criminal Justice and Behavior, 28, 427-449.
22.
Hare, R. (1991). The Hare Psychopathy Checklist-Revised. Toronto, Canada: Multi-Health Systems.
23.
Hare, R. (1998). Psychopaths and their nature: Implications for the mental health and criminal justice systems. In T. Millon, E. Simonsen, M. Birket-Smith, & R. Davis (Eds.), Psychopathy: Antisocial, criminal, and violent behavior (pp. 188-214). New York: Guilford.
24.
Hare, R. (2003). Hare Psychopathy Checklist-Revised manual (2nd ed.). Toronto, Canada: Multi-Health Systems.
25.
Hare, R. D. (1980). A research scale for the assessment of psychopathy in criminal populations. Personality and Individual Differences, 1, 111-119.
26.
Hare, R. D. (1996). Psychopathy: A clinical construct whose time has come. Criminal Justice and Behavior, 23(1), 25-54.
27.
Hart, S. D., Cox, D. N., & Hare, R. D. (1995). The Hare Psychopathy Checklist: Screening Version (PCL:SV). Toronto: Multi-Health Systems.
28.
Hart, S. D., Watt, K. A., & Vincent, G. M. (2002). Commentary on Seagrave and Grisso: Impressions of the state of the art. Law and Human Behavior, 26, 241-245.
29.
Harvey, P. D., Stokes, J. L., Lord, J., & Pogge, D. L. (1996). Neurocognitive and personality assessment of adolescent substance abusers: A multidimensional approach. Assessment, 3, 241-253.
30.
Hedges, L. V., & Olkin, I. (1985). Statistical methods for meta-analysis. Orlando, FL: Academic Press.
31.
Hedges, L. V., & Vevea, J. L. (1998). Fixed- and random-effects models in meta-analysis. Psychological Methods, 3, 486-504.
32.
Hemphill, J. F., Hare, R. D., & Wong, S. (1998). Psychopathy and recidivism: A review. Legal and Criminological Psychology, 3, 139-170.
33.
Henson, R. K. (2001). Understanding internal consistency reliability estimates: A conceptual primer on coefficient alpha. Measurement and Evaluation in Counseling and Development, 34, 177-189.
34.
Henson, R. K., Kogan, L. R., & Vacha-Haase, T. (2001). A reliability generalization study of the Teacher Efficacy Scale and related instruments. Educational and Psychological Measurement, 61, 404-420.
35.
Henson, R. K., & Thompson, B. (2002). Characterizing measurement error in scores across studies: Some recommendations for conducting “reliability generalization” studies. Measurement and Evaluation in Counseling and Development, 35, 113-127.
36.
Hoyt, W. T., & Kerns, M. (1999). Magnitude and moderators of bias in observer ratings: A meta-analysis. Psychological Methods, 4, 403-424.
37.
Kosson, D. S. (1996). PCL:YV scores from a probation sample [Unpublished raw data]. Chicago: Finch University of Health Sciences.
38.
Kosson, D. S., Cyterski T. D., Steurwald, B. L., Neumann, C. S., & Walker-Mathews, S. (2002). The reliability and validity of the Psychopathy Checklist: Youth Version (PCL:YV) in nonincarcerated adolescent males. Psychological Assessment, 14(1), 97-109.
39.
Lane, G. G., White, A. E., & Henson, R. (2002). Expanding reliability generalization methods with KR-21 estimates: An RG study of the Coopersmith Self-Esteem Inventory. Educational and Psychological Measurement, 62, 685-711.
40.
McBride, M. L. (1998). Individual and familial risk factors for adolescent psychopathy (Doctoral dissertation, University of British Columbia, 1998). Dissertation Abstracts International, 59(12), 6507.
41.
McGraw, K. O., & Wong, S. P. (1996). Forming inferences about some correlation coefficients. Psychological Methods, 1, 30-46.
42.
Murrie, D. C., & Cornell, D. G. (2000). The Millon Adolescent Clinical Inventory and psychopathy. Journal of Personality Assessment, 75(1), 110-125.
43.
Murrie, D. C., & Cornell, D. G. (2002). Psychopathy screening of incarcerated juveniles: A comparison of measures. Psychological Assessment, 14, 390-396.
44.
Nunnally, J., & Bernstein, I. (1994). Psychometric theory. New York: McGraw-Hill.
45.
Orwin, R. G. (1983). A fail-safe N for effect size in meta-analysis. Journal of Educational Statistics, 8, 157-159.
46.
Petrila, J., & Skeem, J. (2003). An introduction to the special issues on juvenile psychopathy and some reflections on the current debate. Behavioral Sciences and the Law, 21, 689-694.
47.
Ponder, J. I. (1998). An investigation of psychopathy in a sample of violent juvenile offenders (Doctoral dissertation, University of Texas at Austin, 1998). Dissertation Abstracts International, 5(09), 5105.
48.
Poythress, N. G., Edens, J. F., & Lilienfeld, S. O. (1998). Criterion-related validity of the Psychopathic Personality Inventory in a prison sample. Psychological Assessment, 10(4), 426-430.
49.
Rexrode, S. L. (1998). An exploration of the Millon Adolescent Clinical Inventory and the Psychopathy Checklist-Revised: Classifying male juvenile offenders (Doctoral dissertation, Florida State University, 1998). Dissertation Abstracts International, 59(08), 4481.
50.
Ridenour, T. A., Marchant, G. J., & Dean, R. S. (2001). Is the revised Psychopathy Checklist clinically useful for adolescents?Journal of Psychoeducational Assessment, 19, 227-238.
51.
Rosenthal, R. (1991). Meta-analytic procedures for social research. Newbury Park, CA: Sage.
52.
Salekin, R., Rogers, R., & Sewell, K. (1996). A review and meta-analysis of the Psychopathy Checklist and Psychopathy Checklist-Revised: Predictive validity of dangerousness. Clinical Psychology: Science and Practice, 3, 203-215.
53.
Salekin, R., Trobst, K., & Krioukova, M. (2001). Construct validity of psychopathy in a community sample: A nomological net approach. Journal of Personality Disorders, 15, 425-441.
54.
Seagrave, D., & Grisso, T. (2002). Adolescent development and the measurement of juvenile psychopathy. Law & Human Behavior, 26, 219-239.
55.
Shrout, P. E., & Fleiss, J. L. (1979). Intraclass correlations: Uses in assessing rater reliability. Psychological Bulletin, 86, 420-428.
56.
Skilling, T. A., Quinsey, V. L., & Craig, W. M. (2001). Evidence of a taxon underlying serious antisocial behavior in boys. Criminal Justice and Behavior, 28(4), 450-470.
57.
Smith, A. M. (1994). Juvenile psychopathy: Rorschach assessment of narcissistic traits in conduct disordered adolescents (Doctoral dissertation, California School of Professional Psychology, Berkeley/Alameda, 1994). Dissertation Abstracts International, 55(11), 5088.
58.
Stafford, E., & Cornell, D. G. (2003). Psychopathy scores predict adolescent inpatient aggression. Assessment, 10, 102-112.
59.
Stanford, M. S. (1992). Multi-impulsivity within an adolescent psychiatric population (Doctoral dissertation, Baylor University, 1992). Dissertation Abstracts International, 54(01), 538.
60.
Thompson, B., & Vacha-Haase, T. (2000). Psychometrics is datametrics: The test is not reliable. Educational and Psychological Measurement, 60, 174-195.
61.
Vacha-Haase, T. (1998). Reliability generalization: Exploring variance in measurement error affecting score reliability across studies. Educational and Psychological Measurement, 58, 6-20.
62.
Vacha-Haase, T., Henson, R. K., & Caruso, J. (2002). Reliability generalization: Moving toward improved understanding and use of score reliability. Educational and Psychological Measurement, 62, 562-569.
63.
Vacha-Haase, T., Kogan, L., Tani, C. R., & Woodall, R. A. (2001). Reliability generalization: Exploring reliability coefficients of MMPI clinical scales scores. Educational and Psychological Measurement, 61, 45-59.
64.
Viswesvaran, C., & Ones, D. (2000). Measurement error in “Big Five Factors” personality assessment: Reliability generalization across studies and measures. Educational and Psychological Measurement, 60, 224-235.
65.
Whalen, J. P. (1999). Reliability and validity of the Psychopathy Checklist: Youth Version in predicting behavior of adjudicated adolescents in an institutional setting (Doctoral dissertation, University of Wisconsin-Madison, 1999). Dissertation Abstracts International, 60(06), 2968.
66.
Wong, S. (1988). Is Hare’s Psychopathy Checklist reliable without the interview?Psychological Reports, 62, 931-934.
