Virtual Interview Training for Transition-Age Youth and Virtual Reality Job Interview Training are job interview simulators with demonstrated effectiveness in randomized controlled trials. We evaluated their dose responses via secondary data analysis of 558 transition-age youth with disabilities in 47 schools where the simulators were implemented in quasi-experimental studies. Cut-point analyses determined dosing efficiency and efficacy to optimize competitive employment. The most efficient dose when accounting for the balance between dose and employment was completing nine virtual interviews. The most efficacious dose to maximize the likelihood of successful employment was 38, but it varied across race, IQ, Individuals with Disabilities Education Improvement Act (IDEA) categories, and employment history. This study provides a novel approach to inform implementation guidelines for virtual interview training in pre-employment transition services. Limitations and implications for research and practice are discussed.
ArterP.BrownT.LawM.BarnaJ.FruehanA.FidiamR. (2018). Virtual reality: Improving interviewing skills in individuals with autism spectrum disorder. In LangranE.BorupJ. (Eds.), Proceedings of society for information technology & teacher education international conference (pp. 1086–1088). Association for the Advancement of Computing in Education (AACE). https://www.learntechlib.org/primary/p/182660/
2.
BondG. (1998). Principles of the individual placement and support model: Empirical support. Psychiatric Rehabilitation Journal, 22(1), 11–23. https://doi.org/10.1037/h0095271
CobbR. B.LipscombS.WolgemuthJ.SchulteT.VeliquetteA.AlwellM.BatchelderK.BernardR.HernandezP.Holmquist-JohnsonH.OrsiR.Sample McMeekingL.WangJ.WeinbergA. (2013). Improving post-high school outcomes for transition-age students with disabilities: An evidence review (NCEE 2013-4011). Institute of Educational Science. https://ies.ed.gov/ncee/pubs/20134011/pdf/20134011.pdf
5.
FombonneE. (1991). The use of questionnaires in child psychiatry research: Measuring their performance and choosing an optimal cut-off. Journal of Child Psychology and Psychiatry, 32(4), 677–693. https://doi.org/10.1111/j.1469-7610.1991.tb00343.x
6.
GenovaH. M.LancasterK.MorecraftJ.HaasM.EdwardsA.DiBenedettoM.KrchD.DeLucaJ.SmithM. J. (2021). A pilot RCT of virtual reality job interview training in transition-age youth on the autism spectrum. Research in Autism Spectrum Disorders, 89, 101878. https://doi.org/10.1016/j.rasd.2021.101878
7.
GeverdtD. (2015). Education Demographic and Geographic Estimates Program (EDGE): Locale boundaries user’s manual (NCES 2016-012). National Center for Education Statistics, U.S. Department of Education. https://files.eric.ed.gov/fulltext/ED577162.pdf
8.
HayesG. R.CustodioV. E.HaimsonO. L.NguyenK.RinglandK. E.UlgadoR. R.WaterhouseA.WeinerR. (2015). Mobile video modeling for employment interviews for individuals with autism. Journal of Vocational Rehabilitation, 43, 275–287. https://doi.org/10.3233/JVR-150775
9.
HerrinJ. (2002). CLTEST: Stata modules for performing cluster-adjusted chi-square and t-tests (Statistical Software Components S424901). Boston College Department of Economics.
10.
HillL. G.CoieJ. D.LochmanJ. E.GreenbergM. T. (2004). Effectiveness of early screening for externalizing problems: Issues of screening accuracy and utility. Journal of Consulting and Clinical Psychology, 72(5), 809–820. https://doi.org/10.1037/0022-006X.72.5.809
Individuals with Disabilities Education Improvement Act IDEA, 20 U.S.C. § 1400, et seq. (2004).
13.
KarveS.ClevesM. A.HelmM.HudsonT. J.WestD. S.MartinB. C. (2009). Good and poor adherence: Optimal cut-point for adherence measures using administrative claims data. Current Medical Research and Opinion, 25(9), 2303–2310. https://doi.org/10.1185/03007990903126833
14.
McNeilB. J.HanleyJ. A. (1984). Statistical approaches to the analysis of receiver operating characteristic (ROC) curves. Medical Decision Making, 4(2), 137–150. https://doi.org/10.1177/0272989X8400400203
15.
R Core Team. (2013). R: A language and environment for statistical computing. R Foundation for Statistical Computing. http://www.R-project.org/
16.
RoweD. A.MazzottiV. L.FowlerC. H.TestD. W.MitchellV. J.ClarkK. A.HolzbergD.OwensT. L.RusherD.Seaman-TullisR. L.GushanasC. M.CastleH.ChangW.-H.VoggtA.KwiatekS.DeanC. (2021). Updating the secondary transition research base: Evidence- and research-based practices in functional skills. Career Development and Transition for Exceptional Individuals, 44(1), 28–46. https://doi.org/10.1177/2165143420958
17.
SchrankF. A.McGrewK. S.MatherN. (2014). Woodcock-Johnson IV. Riverside.
18.
SmithM. J.FlemingM. F.WrightM. A.JordanN.HummL. B.OlsenD.BellM. D. (2015). Job offers to individuals with severe mental illness after participation in virtual reality job interview training. Psychiatric Services, 66(11), 1173–1179. https://doi.org/10.1176/appi.ps.201400504
19.
SmithM. J.FlemingM. F.WrightM. A.LoshM.HummL. B.OlsenD.BellM. D. (2015). Brief report: Vocational outcomes for young adults with autism spectrum disorders at six months after virtual reality job interview training. Journal of Autism and Developmental Disorders, 45(10), 3364–3369. https://doi.org/10.1007/s10803-015-2470-1
20.
SmithM. J.FlemingM. F.WrightM. A.RobertsA. G.HummL. B.OlsenD.BellM. D. (2015). Virtual reality job interview training and 6-month employment outcomes for individuals with schizophrenia seeking employment. Schizophrenia Research, 166, 86–91. https://doi.org/10.1016/j.schres.2015.05.022
21.
SmithM. J.GingerE. J.WrightK.WrightM. A.TaylorJ. L.HummL. B.OlsenD. E.BellM. D.FlemingM. F. (2014). Virtual reality job interview training in adults with autism spectrum disorder. Journal of Autism and Developmental Disorders, 44(10), 2450–2463. https://doi.org/10.1007/s10803-014-2113-y
22.
SmithM. J.GingerE. J.WrightM. A.WrightK.HummL. B.OlsenD.BellM. D.FlemingM. F. (2014). Virtual reality job interview training for individuals with psychiatric disabilities. Journal of Nervous and Mental Disease, 202(9), 659–667. https://doi.org/10.1097/NMD.0000000000000187
23.
SmithM. J.PintoR. M.DawaltL.SmithJ. D.SherwoodK.MilesR.TaylorJ. L.HumeK. A.DawkinsT.Baker-EriczénM.FrazierT. W.HummL. B.SteacyC. (2020). Using community-engaged methods to adapt virtual reality job-interview training for transition-age youth on the autism spectrum. Research in Autism Spectrum Disorders, 71, 101498. https://doi.org/https://doi.org/10.1016/j.rasd.2019.101498
24.
SmithM. J.SherwoodK.BlajeskiS.RossB.SmithJ. D.JordanN.DawaltL.BishopL.AtkinsM. S. (2021). Job interview and vocational outcomes among transition-age youth receiving special education pre-employment transition services. Intellectual and Developmental Disabilities, 59(5), 405–421. https://doi.org/10.1352/1934-9556-59.5.405
25.
SmithM. J.SherwoodK.RossB.OulveyE. A.AtkinsM. S.DanielsonE. A.JordanN.SmithJ. D. (2022). Scaling out virtual interview training for transition age youth: A quasi-experimental hybrid effectiveness-implementation study. Career Development and Transition for Exceptional Individuals, 45(4), 213–227. https://doi.org/10.1177/21651434221081273
26.
SmithM. J.SherwoodK.RossB.SmithJ. D.DaWaltL.BishopL.HummL. B.ElkinsJ.SteacyC. (2021). Virtual interview training for autistic transition age youth: A randomized controlled feasibility and effectiveness trial. Autism, 25(6), 1536–1552. https://doi.org/10.1177/1362361321989928
27.
SmithM. J.SmithJ. D.BlajeskiS.RossB.JordanN.BellM. D.McGurkS.MueserK. T.Burke-MillerJ.OulveyE. A.FlemingM. F.NelsonK.BrownA.PrestipinoJ.PashkaN.RazzanoL. A. (2022). An RCT of virtual reality job interview training for individuals with serious mental illness in IPS supported employment. Psychiatric Services, 73(9), 1027–1038. https://doi.org/10.1176/appi.ps.202100516
28.
SmithM. J.SmithJ. D.JordanN.SherwoodK.McRobertE.RossB.OulveyE. A.AtkinsM. S. (2021). Virtual reality job interview training in transition services: Results of a single-arm, noncontrolled effectiveness-implementation hybrid trial. Journal of Special Education Technology, 36(1), 3–17. https://doi.org/10.1177/0162643420960093
29.
StataCorp. (2021). Stata Statistical Software: Release 17. StataCorp LLC.
WardD. M.EspositoM. C. K. (2019). Virtual reality in transition program for adults with autism: Self-efficacy, confidence, and interview skills. Contemporary School Psychology, 23, 423–431. https://doi.org/10.1007/s40688-018-0195-9
32.
WechslerD. (2014). Wechsler Intelligence Scale for children (5th ed.). Pearson.
33.
Workforce Innovation and Opportunity Act WIOA, 29 U.S.C. § 3164, Pub. L. No. PL 113-128 (2014).
34.
ZlobecI.SteeleR.TerraccianoL.JassJ. R.LugliA. (2007). Selecting immunohistochemical cut-off scores for novel biomarkers of progression and survival in colorectal cancer. Journal of Clinical Pathology, 60(10), 1112–1116. https://doi.org/10.1136/jcp.2006.044537
35.
ZweigM. H.CampbellG. (1993). Receiver-operating characteristic (ROC) plots: A fundamental evaluation tool in clinical medicine. Clinical Chemistry, 39(4), 561–577. https://doi.org/10.1093/clinchem/39.4.561
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
