Tried and True? A Psychometric Evaluation of the Psychological Inventory of Criminal Thinking Styles-Short Form

Abstract

The Psychological Inventory of Criminal Thinking Styles-Short Form (PICTS-SF) is an abbreviated 35-item version of the PICTS, a measure of cognitions that support a criminal lifestyle. Despite use in research and clinical work, the PICTS-SF’s psychometric properties have not been tested. Using two archival datasets, we analyzed the PICTS-SF’s reliability and structural validity in multiply imputed data from adult males and females on probation in a residential treatment facility (n = 514). We also tested the PICTS-SF’s reliability and discriminant and postdictive validities among adult males in administrative segregation in prison (n = 95). We found evidence for the PICTS-SF’s internal consistency (α and ω ≥ .89), structural validity (CFI = .90, RMSEA = .05), discriminant validity (.22 ≤ r ≤ .39), and postdictive validity for receiving disciplinary infractions (incident rate ratio = 1.04). These results support the PICTS-SF’s use in research, and qualified use in clinical applications.

Keywords

Psychological Inventory of Criminal Thinking Styles criminal thinking short form psychometric evaluation criminal justice-involved adults

Get full access to this article

View all access options for this article.

References

Anderson

J. C.

Gerbing

D. W.

(1988). Structural equation modeling in practice: A review and recommended two-step approach. Psychological Bulletin, 103(3), 411–423. https://doi.org/10.1037/0033-2909.103.3.411

Batastini

A. B.

Lester

M. E.

Morgan

R. D.

Atterberry

(2020). Stepping up, stepping out: A program description and preliminary findings. Psychological Services, 18(4), 679–688. https://doi.org/10.1037/ser0000430

Batastini

A. B.

Leuty

M. E.

Davis

R. M.

Jones

A. C.

(2019). Individual and situational factors predicting employment status among revoked community-released offenders. Psychological Services, 18(4), 454–463. https://doi.org/10.1037/ser0000403

Bentler

P. M.

Bonett

D. G.

(1980). Significance tests and goodness of fit in the analysis of covariance structures. Psychological Bulletin, 88(3), 588–606.

Bonta

Andrews

D. A.

(2017). The psychology of criminal conduct. Taylor & Francis.

Borsboom

Mellenbergh

G. J.

van Heerden

(2004). The concept of validity. Psychological Review, 111(4), 1061–1071. https://doi.org/10.1037/0033-295X.111.4.1061

Brennan

Breitenbach

Dieterich

Salisbury

E. J.

Van Voorhis

(2012). Women’s pathways to serious and habitual crime: A person-centered analysis incorporating gender responsive factors. Criminal Justice and Behavior, 39(11), 1481–1508. https://doi.org/10.1177/0093854812456777

Browne

M. W.

Cudeck

(1993). Alternative ways of assessing model fit. In Bollen

K. A.

Long

J. S.

(Eds.), Testing structural equation models (pp. 136–162). SAGE.

Byrne

B. M.

(2005). Factor analytic models: Viewing the structure of an assessment instrument from three perspectives. Journal of Personality Assessment, 85(1), 17–32. https://doi.org/10.1207/s15327752jpa8501_02

10.

Clark

L. A.

Watson

(2019). Constructing validity: New developments in creating objective measuring instruments. Psychological Assessment, 31(12), 1412–1427. https://doi.org/10.1037/pas0000626

11.

Correia

K. M.

(2009) A handbook for correctional psychologists: Guidance for the prison practitioner (2nd ed.). Charles C. Thomas.

12.

Cortina

J. M.

(1993). What is coefficient alpha? An examination of theory and applications. Journal of Applied Psychology, 78(1), 98–104. https://doi.org//10.1037/0021-9010.78.1.98

13.

Covington

(2007). The relational theory of women’s psychological development: Implications for the criminal justice system. In Zaplin

R. T.

(Ed.), Female offenders: Critical perspectives and effective interventions (2nd ed., pp. 135–164). Jones and Bartlett.

14.

Cronbach

L. J.

(1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16(3), 297–334. https://doi.org/10.1007/bf02310555

15.

Cummings

(2013). Missing data and multiple imputation. JAMA Pediatrics, 167(7), 656–661.

16.

Deng

Chan

(2017). Testing the difference between reliability coefficients alpha and omega. Educational and Psychological Measurement, 77(2), 185–203. https://doi.org/10.1177%2F0013164416658325

17.

De Vet

H. C.

Terwee

C. B.

Mokkink

L. B.

Knol

D. L

. (2011). Measurement in medicine: A practical guide. Cambridge University Press.

18.

Dong

Peng

C. Y. J.

(2013). Principled missing data methods for researchers. SpringerPlus, 2(1), 1–17. https://doi.org/10.1186/2193-1801-2-222

19.

Field

(2013). Discovering statistics using IBM SPSS statistics. SAGE.

20.

Gaspar

Brown

Ramler

Scanlon

Gigax

Ridley

Morgan

R. D.

(2019). Therapeutic outcomes of changing lives and changing outcomes for male and female justice involved people with mental illness. Criminal Justice and Behavior, 46(12), 1678–1699. https://doi.org/10.1177%2F0093854819879743

21.

George

Mallery

(2010) SPSS for Windows step by step: A simple guide and reference, 17.0 update (10th ed.). Pearson.

22.

Gignac

G. E.

Palmer

B. R.

Manocha

Stough

(2005). An examination of the factor structure of the Schutte self-report emotional intelligence (SSREI) scale via confirmatory factor analysis. Personality and Individual Differences, 39(6), 1029–1042. https://doi.org/10.1016/j.paid.2005.03.014

23.

Gilliard

D. K.

Beck

A. J.

(1996, August). Prison and jail inmates,1995. U.S. Department of Justice, Office of Justice Programs, Bureau of Justice Statistics. https://www.ojp.gov/library/publications/prison-and-jail-inmates-1995

24.

Hubley

A. M.

Zumbo

B. D.

(2011). Validity and the consequences of test interpretation and use. Social Indicators Research, 103(2), 219–230. https://doi.org/10.1007/s11205-011-9843-4

25.

Liu

(2015). Multiple imputation by fully conditional specification for dealing with missing data in a large epidemiologic study. International Journal of Statistics in Medical Research, 4(3), 287–295.

26.

McDonald

R. P.

(1999). Test theory: A unified treatment. Lawrence Erlbaum. https://doi.org/10.4324/9781410601087

27.

Messick

(1995). Validity of psychological assessment: Validation of inferences from people' responses and performances as scientific inquiry into score meaning. American Psychologist, 50(9), 741–749. https://doi.org/10.1037/0003-066X.50.9.741

28.

Mills

J. F.

Kroner

D. G.

(2001). Measures of Criminal Attitudes and Associates (MCAA) user guide. Selby.

29.

Mills

J. F.

Kroner

D. G.

Forth

A. E.

(2002). Measures of Criminal Attitudes and Associates (MCAA) development, factor structure, reliability, and validity. Assessment, 9(3), 240–253. https://doi.org/10.1177%2F1073191102009003003

30.

Mills

J. F.

Kroner

D. G.

Hemmati

(2004). The Measures Of Criminal Attitudes And Associates (MCAA) the prediction of general and violent recidivism. Criminal Justice and Behavior, 31(6), 717–733. https://doi.org/10.1177%2F0093854804268755

31.

Mitchell

S. M.

Bartholomew

N. R.

Morgan

R. D.

Cukrowicz

K. C.

(2017). A preliminary investigation of the Psychological Inventory of Criminal Thinking Styles–Layperson Edition–Short Form. Criminal Justice and Behavior, 44(5), 756–769. https://doi.org/10.1177%2F0093854816685591

32.

Mokkink

L. B.

Terwee

C. B.

Patrick

D. L.

Alonso

Stratford

P. W.

Knol

D. L.

. . . de Vet

H. C.

(2010). The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes. Journal of Clinical Epidemiology, 63(7), 737–745. https://doi.org/10.1016/j.jclinepi.2010.02.006

33.

Morgan

R. D.

Fisher

W. H.

Duan

Mandracchia

J. T.

Murray

(2010). Prevalence of criminal thinking among state prison inmates with serious mental illness. Law and Human Behavior, 34(4), 324–336. https://doi.org/10.1007/s10979-009-9182-z

34.

Neal

T. M.

Slobogin

Saks

M. J.

Faigman

D. L.

Geisinger

K. F.

(2019). Psychological assessments in legal contexts: Are courts keeping “junk science” out of the courtroom? Psychological Science in the Public Interest, 20(3), 135–164. https://doi.org/10.1177%2F1529100619888860

35.

O’Keefe

M. L.

(2008). Administrative segregation from within: A corrections perspective. The Prison Journal, 88(1), 123–143. https://doi.org/10.1177/0032885507310999

36.

Peters

G.-J.

Verboon

Chan

Baggett

McNeish

Sabbe

Bonett

. . . Pat-El

(2018) Userfriendlyscience (UFS) (Version 0.7.1). R Foundation for Statistical Computing.

37.

Rhemtulla

Brosseau-Liard

P. É.

Savalei

(2012). When can categorical variables be treated as continuous? A comparison of robust continuous and categorical SEM estimation methods under suboptimal conditions. Psychological Methods, 17(3), 353–373. https://doi.org/10.1037/a0029315

38.

Rosseel

(2012). lavaan: An R package for structural equation modeling. Journal of Statistical Software, 48, 1–36.

39.

Scanlon

Hirsch

Morgan

R. D.

(2022). The relation between the working alliance on mental illness and criminal thinking among justice-involved people with co-occurring mental illness and substance use disorders. Journal of Consulting and Clinical Psychology, 90(3), 282.

40.

Shields

I. W.

Simourd

D. J.

(1991). Predicting predatory behavior in a population of incarcerated young offenders. Criminal Justice and Behavior, 18(2), 180–194. https://doi.org/10.1177%2F0093854891018002006

41.

Simourd

D. J.

(1997). The Criminal Sentiments Scale-Modified and Pride in Delinquency Scale: Psychometric properties and construct validity of two measures of criminal attitudes. Criminal Justice and Behavior, 24, 52–70. https://doi.org/10.1177%2F0093854897024001004

42.

Simourd

D. J.

(1999). Assessment of criminal attitudes: Criterion-related validity of the Criminal Sentiments Scale-Modified and Pride in Delinquency scale. Criminal Justice and Behavior, 26, 90–106.

43.

Simourd

D. J.

Olver

M. E.

(2002). The future of criminal attitudes research and practice. Criminal Justice and Behavior, 29, 427–446.

44.

Simourd

D. J.

Van de Ven

(1999). Assessment of criminal attitudes: Criterion-related validity of the Criminal Sentiments Scale-Modified and Pride in Delinquency Scale. Criminal Justice and Behavior, 26, 90–106. https://doi.org/10.1177%2F0093854899026001005

45.

Skilling

T. A.

Sorge

G. B.

(2014). Measuring antisocial values and attitudes in justice-involved male youth: Evaluating the psychometric properties of the Pride in Delinquency Scale and the Criminal Sentiments Scale–Modified. Criminal Justice and Behavior, 41, 992–1007. https://doi.org/10.1177%2F0093854814521415

46.

Smith

G. T.

McCarthy

D. M.

Anderson

K. G.

(2000). On the sins of short-form development. Psychological Assessment, 12(1), 102–111. https://doi.org/10.1037/1040-3590.12.1.102

47.

Van Buuren

. (2018). Flexible imputation of missing data. CRC Press.

48.

Van Buuren

Groothuis-Oudshoorn

. (2011). mice: Multivariate imputation by chained equations in R. Journal of Statistical Software, 45, 1–67.

49.

Varghese

F. P.

Anderson

K. M.

Cummings

D. L.

Fitzgerald

(2018). The Offender Job Search Self-Efficacy Scale: Development and initial validation. Psychological Services, 15(4), 477–485. https://doi.org/10.1037/ser0000170

50.

Walters

G. D.

(1995). The Psychological Inventory of Criminal Thinking Styles (PICTS). Part I: Reliability and preliminary validity. Criminal Justice and Behavior, 22, 307–325. https://doi.org/10.1177/0093854895022003008

51.

Walters

G. D.

(2002). The Psychological Inventory of Criminal Thinking Styles (PICTS) A review and meta-analysis. Assessment, 9(3), 278–291. https://doi.org/10.1177%2F1073191102009003007

52.

Walters

G. D.

(2003). Changes in criminal thinking and identity in novice and experienced inmates: Prisonization revisited. Criminal Justice and Behavior, 30(4), 399–421. https://doi.org/10.1177%2F0093854803253137

53.

Walters

G. D.

(2006). The Psychological Inventory of Criminal Thinking Styles (PICTS) professional manual. Center for Lifestyle Studies.

54.

Walters

G. D.

(2009). Anger management training in incarcerated male offenders: Differential impact on proactive and reactive criminal thinking. International Journal of Forensic Mental Health, 8(3), 214–217. https://doi.org/10.1080/14999010903358995

55.

Walters

G. D.

(2011). Predicting recidivism with the psychological inventory of criminal thinking styles and level of service inventory-revised: Screening version. Law and Human Behavior, 35(3), 211–220. https://doi.org/10.1007/s10979-010-9231-7

56.

Walters

G. D.

(2012). Criminal thinking and recidivism: Meta-analytic evidence on the predictive and incremental validity of the Psychological Inventory of Criminal Thinking Styles (PICTS). Aggression and Violent Behavior, 17(3), 272–278. https://doi.org/10.1016/j.avb.2012.02.010

57.

Walters

G. D.

(2013). The Psychological Inventory of Criminal Thinking Styles (PICTS) professional manual. Center for Lifestyle Studies.

58.

Walters

G. D.

Frederick

A. A.

Schlauch

(2007). Postdicting arrests for proactive and reactive aggression with the PICTS Proactive and Reactive composite scales. Journal of Interpersonal Violence, 22(11), 1415–1430. https://doi.org/10.1177%2F0886260507305556

59.

Walters

G. D.

Geyer

M. D.

(2005). Construct validity of the psychological inventory of criminal thinking styles in relationship to the PAI, disciplinary adjustment, and program completion. Journal of Personality Assessment, 84(3), 252–260. https://doi.org/10.1207/s15327752jpa8403_04

60.

Walters

G. D.

Hagman

B. T.

Cohn

A. M.

(2011). Toward a hierarchical model of criminal thinking: Evidence from item response theory and confirmatory factor analysis. Psychological Assessment, 23(4), 925–936. https://doi.org/10.1037/a0024017

61.

Walters

G. D.

Schlauch

(2008). The psychological inventory of criminal thinking styles and level of service inventory-revised: Screening version as predictors of official and self-reported disciplinary infractions. Law and Human Behavior, 32(5), 454–462. https://doi.org/10.1007/s10979-007-9117-5