Restricted accessResearch articleFirst published online 2023-2
Virtual Reality Job Interview Training for Adults Receiving Prison-Based Employment Services: A Randomized Controlled Feasibility and Initial Effectiveness Trial
Returning citizens struggle to obtain employment after release from prison and navigating job interviews is a critical barrier they encounter. Implementing evidence-based interview training is a major gap in prison-based vocational services. We conducted a randomized controlled trial (RCT) to evaluate the feasibility and initial effectiveness of Virtual Reality Job Interview Training (VR-JIT) within two prisons. Forty-four male returning citizens were randomized to receive service-as-usual (SAU) with VR-JIT (SAU + VR-JIT, n = 28) or SAU (n = 16). Participants reported VR-JIT was highly acceptable and usable. SAU + VR-JIT, compared with SAU, had significant improvements (with large effect sizes) in interview skills, interview training motivation, and interview anxiety (all p < .05; > .15), and greater employment by 6-month follow-up (odds ratio [OR] = 7.4, p = .045). VR-JIT can potentially help fill a major gap in prison-based services. Future research is needed to validate VR-JIT effectiveness and evaluate VR-JIT implementation strategies within prisons.
AlperM.DuroseM. R. (2018). 2018 update on prisoner recidivism: A 9-year follow-up period (2005-2014) (NCJ 250975). Office of Justice Programs, Bureau of Justice Statistics. https://www.bjs.gov/index.cfm?ty=pbdetail&iid=6266
2.
American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). American Psychiatric Publishing.
AragonS. R. (2003). Creating social presence in online environments. New Directions for Adult and Continuing Education, 100, 57–68. https://doi.org/10.1002/ace.119
5.
BrennanT.DietrichW.EhretB. (2009). Evaluating the predictive validity of the COMPAS risk and needs assessment system. Criminal Justice and Behavior, 36, 21–40. https://doi.org/10.1177/0093854808326545
6.
BrookeJ. (1996). System Usability Scale (SUS): A “quick and dirty” usability scale. In JordanP. W.ThomasB. A.WeerdmeesterA. L. (Eds.), Usability evaluation in industry (pp. 189–194). Taylor & Francis. https://doi.org/10.1201/9781498710411
7.
BurkeS. L.BresnahanT.LiT.EpnereK.RizzoA.PartinM.AhlnessR. M.TrimmerM. (2018). Using virtual interactive training agents (ViTA) with adults with autism and other developmental disabilities. Journal of Autism and Developmental Disorders, 48(3), 905–912. https://doi.org/10.1007/s10803-017-3374-z
8.
BushwayS.StollM. A.WeimanD. F. E. (2007). Barriers to reentry? The labor market for released prisoners in post-industrial America. Russell Sage Foundation.
9.
CookP. J.KangS.BragaA. A.LudwigJ.O’BrienM. E. (2015). An experimental evaluation of a comprehensive employment-oriented prisoner re-entry program. Journal of Quantitative Criminology, 31(3), 355–382. https://doi.org/10.1007/s10940-
10.
CorbiereM.ZaniboniS.LecomteT.BondG.GillesP. Y.LesageA.GoldnerE. (2011). Job acquisition for people with severe mental illness enrolled in supported employment programs: A theoretically grounded empirical study. Journal of Occupational Rehabilitation, 21(3), 342–354. https://doi.org/10.1007/s10926-011-9315-3
11.
CornetL. J. M.Van GelderJ. L. (2020). Virtual reality: A use case for criminal justice practice. Psychology, Crime & Law, 26(7), 631–647. https://doi.org/10.1080/1068316X.2019.1708357
12.
DamschroderL. J.AronD. C.KeithR. E.KirshS. R.AlexanderJ. A.LoweryJ. C. (2009). Fostering implementation of health services research findings into practice: A consolidated framework for advancing implementation science. Implementation Science, 4, 50. https://doi.org/10.1186/1748-5908-4-50
13.
DeckerS. H.OrtizN.SpohnC.HedbergE. (2015). Criminal stigma, race, and ethnicity: The consequences of imprisonment for employment. Journal of Criminal Justice, 43(2), 108–121. https://doi.org/10.1016/j.jcrimjus.2015.02.002
14.
DerogatisL. R.SavitzK. L. (1999). The SCL-90-R, Brief Symptom Inventory, and Matching Clinical Rating Scales. In MaruishM. E. (Eds.), The use of psychological testing for treatment planning and outcomes assessment (2nd ed., pp. 679–724). Lawrence Erlbaum.
15.
ElliottS. N. (2017). The social validity of “acceptability of behavioral interventions used in classrooms”: Inferences from longitudinal evidence. Behavioral Disorders, 43(1), 269–273. https://doi.org/10.1177/0198742917739021
16.
EllisonM.SzifrisK.HoranR.FoxC. (2017). A rapid evidence assessment of the effectiveness of prison education in reducing recidivism and increasing employment. Probation Journal, 64(2), 108–128. https://doi.org/10.1177/0264550517699290
17.
FlakeD. (2015). When any sentence is a life sentence: Employment discrimination against ex-offenders. Washington University Law Review, 93, 46–102. https://doi.org/10.2139/ssrn.2523179
18.
GhasemiA.ZahediaslS. (2012). Normality tests for statistical analysis: A guide for non-statisticians. International Journal of Endocrinology and Metabolism, 10(2), 486–489. https://doi.org/10.5812/ijem.3505
19.
HolzerH. J.RaphaelS.StollM. A. (2006). Perceived criminality, criminal background checks, and the racial hiring practices of employers. The Journal of Law & Economics, 49(2), 451–480. https://doi.org/10.1086/501089
20.
HuffcuttA. I. (2011). An empirical review of the employment interview construct literature. International Journal of Selection and Assessment, 19(1), 62–81. https://doi.org/10.1111/j.1468-2389.2010.00535.x
21.
HunterG.BoyceI. (2009). Preparing for employment: Prisoners’ experience of participating in a prison training programme. The Howard Journal of Criminal Justice, 48(2), 117–131. https://doi.org/10.1111/j.1468-2311.2008.00551.x
22.
HurtzG. M.DonovanJ. J. (2000). Personality and job performance: The big five revisited. Journal of Applied Psychology, 85(6), 869–879. https://doi.org/10.1037/0021-9010.85.6.869
23.
LeasureP.KaminskiR. J. (2020). The impact of a multiple conviction record on hiring outcomes. Crime & Delinquency, 67(6–7), 1022–1045. https://doi.org/10.1177/0011128720973150
24.
MacanT. (2009). The employment interview: A review of current studies and directions for future research. Personnel Psychology, 55(1), 1–81. https://doi.org/10.1016/j.hrmr.2009.03.006
25.
McAuleyE.DuncanT.TammenV. V. (1989). Psychometric properties of the Intrinsic Motivation Inventory in a competitive sport setting: A confirmatory factor analysis. Research Quarterly for Exercise and Sport, 60(1), 48–58. https://doi.org/10.1080/02701367.1989.10607413
MetcalfH.AndersonT.RolfeH. (2001). Barriers to employment for offenders and ex-offenders: Part one. National Institute of Economic and Social Research, Department for Work and Pensions.
29.
MotolaI.DevineL. A.ChungH. S.SullivanJ. E.IssenbergS. B. (2013). Simulation in healthcare education: A best evidence practical guide. AMEE Guide No. 82. Medical Teacher, 35(10), e1511–e1530. https://doi.org/10.3109/0142159X.2013.818632
30.
NewmanS. D.AndrewsJ. O.MagwoodG. S.JenkinsC.CoxM. J.WilliamsonD. C. (2011). Community advisory boards in community-based participatory research: A synthesis of best processes. Preventing Chronic Disease, 8(3), A70. http://www.cdc.gov/pcd/issues/2011/may/10_0045.htm
31.
NewtonD.DayA.GilesM.WodakJ.GraffamJ.BaldryE. (2018). The impact of vocational education and training programs on recidivism: A systematic review of current experimental evidence. International Journal of Offender Therapy and Comparative Criminology, 62(1), 187–207. https://doi.org/10.1177/0306624X16645083
32.
OwensJ. S.LyonA. R.BrandtN. E.WarnerC. M.NadeemE.SpielC.WagnerM. (2014). Implementation science in school mental health: Key constructs in a developing research agenda. School Mental Health, 6(2), 99–111. https://doi.org/10.1007/s12310-013-9115-3
33.
PaesD.ArantesE.IrizarryJ. (2017). Immersive environment for improving the understanding of architectural 3D models: Comparing user spatial perception between immersive and traditional virtual reality systems. Automation in Construction, 84, 292–303. https://doi.org/10.1016/j.autcon.2017.09.016
PetersiliaJ. (2005). When prisoners come home: Parole and prisoner reentry. Oxford University Press.
36.
PhamY. K.UnruhD. K.WaintrupM.SinclairJ.JohnsonM. D.AlversonC. Y. (2017). Taking responsibility: Preparing young offenders to handle disclosure on the job. Beyond Behavior, 26(1), 36–41. https://doi.org/10.1177/1074295617694409
37.
ProctorE.SilmereH.RaghavanR.HovmandP.AaronsG.BungerA.GriffeyR.HensleyM. (2011). Outcomes for implementation research: Conceptual distinctions, measurement challenges, and research agenda. Administration and Policy in Mental Health and Mental Health Services, 38(2), 65–76. https://doi.org/10.1007/s10488-010-0319-7
ReimersT. M.WackerD. P. (1988). Parents’ ratings of the acceptability of behavioral treatment recommendations made in an outpatient clinic: A preliminary analysis of the influence of treatment effectiveness. Behavioral Disorders, 14(1), 7–15. https://www.jstor.org/stable/23886135
RosenC. S.DrescherK. D.MoosR. H.FinneyJ. W.MurphyR. T.GusmanF. (2000). Six- and ten-item indexes of psychological distress based on the symptom checklist-90. Assessment, 7(2), 103–111. https://doi.org/10.1177/107319110000700201
42.
SeimJ.HardingD. J. (2020). Parolefare: Post-prison supervision and low-wage work. Journal of the Social Sciences, 6(1), 173–195. https://doi.org/10.7758/rsf.2020.6.1.08
43.
SmithM. J.BellM. D.WrightM. A.HummL.OlsenD.FlemingM. F. (2016). Virtual Reality Job Interview Training and 6-month employment outcomes for individuals with substance use disorders seeking employment. Journal of Vocational Rehabilitation, 44, 323–332. https://doi.org/10.3233/JVR-160802
44.
SmithM. J.FlemingM. F.WrightM. A.JordanN.HummL. B.OlsenD.BellM. D. (2015). Job offers to individuals with severe mental illness after participation in virtual reality job interview training. Psychiatric Services, 66(11), 1173–1179. https://doi.org/10.1176/appi.ps.201400504
45.
SmithM. J.FlemingM. F.WrightM. A.RobertsA. G.HummL. B.OlsenD.BellM. D. (2015). Virtual reality job interview training and 6-month employment outcomes for individuals with schizophrenia seeking employment. Schizophrenia Research, 166(1–3), 86–91. https://doi.org/10.1016/j.schres.2015.05.022
46.
SmithM. J.GingerE. J.WrightK.WrightM. A.HummL. B.OlsenD.BellM. B.FlemingM. F. (2014). Virtual reality job interview training in individuals with psychiatric disabilities. Journal of Nervous and Mental Disease, 202, 659–667. https://doi.org/10.1097/NMD.0000000000000187
47.
SmithM. J.GingerE. J.WrightK.WrightM. A.TaylorJ. L.HummL. B.OlsenD. E.BellM. D.FlemingM. F. (2014). Virtual reality job interview training in adults with autism spectrum disorder. Journal of Autism and Developmental Disorders, 44(10), 2450–2463. https://doi.org/10.1007/s10803-014-2113-y
48.
SmithM. J.HummL. B.FlemingM. F.JordanN.WrightM. A.GingerE. J.WrightK.OlsenD.BellM. D. (2015). Virtual reality job interview training in veterans with posttraumatic stress disorder. Journal of Vocational Rehabilitation, 42, 271–279. https://doi.org/10.3233/JVR-150748
49.
SmithM. J.SherwoodK.RossB.OulveyE. A.MonahanJ. A.SipovicJ. E.AtkinsM. S.DanielsonE. C.JordanN.SmithJ. D. (2022). Scaling out virtual interview training for transition age youth: A quasi-experimental hybrid effectiveness-implementation study. Career Development and Transition for Exceptional Individuals. https://doi.org/10.1177/21651434221081273
50.
SmithM. J.SherwoodK.RossB.SmithJ. D.DawaltL.BishopL.HummL.ElkinsJ.SteacyC. (2021). Virtual interview training for autistic transition age youth: A randomized controlled feasibility and effectiveness trial. Autism, 25(6), 1536–1552. https://doi.org/10.1177/1362361321989928
51.
SmithM. J.SmithJ. D.BlajeskiS.RossB.JordanN.BellM. D.McGurkS.MueserK. T.Burke-MillerJ.OulveyE. A.FlemingM. F.NelsonK.BrownA.PrestipinoJ.PashkaN.RazzanoL. A. (2022). An RCT of virtual reality job interview training for individuals with serious mental illness in IPS supported employment. Psychiatric Services. https://doi.org/10.1176/appi.ps.202100516
52.
SmithM. J.SmithJ. D.FlemingM. F.JordanN.BrownC. H.HummL. B.OlsenD.BellM. D. (2017). Mechanism of action for obtaining job offers after virtual reality job interview training. Psychiatric Services, 68(7), 747–750. https://doi.org/10.1176/appi.ps.201600217
53.
SmithM. J.SmithJ. D.JordanN.SherwoodK.McRobertE.RossB.OulveyE. A.AtkinsM. S. (2021). Virtual reality job interview training in transition services: Results of a single-arm, noncontrolled effectiveness-implementation hybrid trial. Journal of Special Education Technology, 36(1), 3–17. https://doi.org/10.1177/0162643420960093
54.
StephanJ. (2008). Census of state and federal correctional facilities (Report No. NCJ 222182). Bureau of Justice Statistics. U.S. Department of Justice. https://bjs.ojp.gov/content/pub/pdf/csfcf05.pdf
55.
StricklandD. C.ColesC. D.SouthernL. B. (2013). JobTIPS: A transition to employment program for individuals with autism spectrum disorders. Journal of Autism and Developmental Disorders, 43(10), 2472–2483. https://doi.org/10.1007/s10803-013-1800-4
56.
TicknorB. (2019). Virtual reality and correctional rehabilitation: A game changer. Criminal Justice and Behavior, 46(9), 1319–1336. https://doi.org/10.1177/0093854819842588
57.
TurneyK.LeeH.ComfortM. (2013). Discrimination and psychological distress among recently released male prisoners. American Journal of Men’s Health, 7(6), 482–493. https://doi.org/10.1177/1557988313484056
VisherC. A.Debus-SherrillS.YahnerJ. (2011). Employment after prison: A longitudinal study of former prisoners. Justice Quarterly, 28(5), 698–718. https://doi.org/10.1080/07418825.2010.535553
62.
VisherC. A.LattimoreP. K.BarrickK.TuellerS. (2017). Evaluating the long-term effects of prisoner reentry services on recidivism: What types of services matter?Justice Quarterly, 34(1), 136–165. https://doi.org/10.1080/07418825.2015.1115539
63.
WashingtonH. E. (2018). Creating offender success through education: The Michigan department of correction’s efforts to offer a comprehensive approach to prisoner education and employment. Advancing Corrections: Journal of the International Corrections and Prisons Association, 6, 130–142.
WilsonD. B.GallagherC.MacKenzieD. (2000). A meta-analysis of correctional-based education, vocation, and work programs for adult offenders. Journal of Research in Crime & Delinquency, 37, 347–368. https://doi.org/10.1177/0022427800037004001
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
