In a previous randomized controlled trial (RCT), Virtual Interview Training for Transition Age Youth (VIT-TAY) enhanced employment for autistic youth receiving transition services. For this study, a nonrandomized hybrid effectiveness-implementation trial evaluated whether VIT-TAY maintained its core implementation and effectiveness functions when scaled out to students with disabilities in 32 schools. Also, we compared the implementation and effectiveness between VIT-TAY and Virtual Reality Job Interview Training (VR-JIT; developed for adults and previously evaluated in students with disabilities). Core implementation functions did not differ between VIT-TAY and VR-JIT. Greater engagement with either training was significantly associated with employment (both p < .05). Overall, VIT-TAY was feasibly implemented with high adherence and may be effective at enhancing employment for students with disabilities. Limitations and implications for research and practice are discussed.
AaronsG. A.SklarM.MustanskiB.BenbowN.BrownC. H. (2017). “Scaling-out” evidence-based interventions to new populations or new health care delivery systems. Implementation Science, 12, 111. http://doi.org/10.1186/s13012-017-0640-6
2.
BarbeeJ. R.KeilE. C. (1973). Experimental techniques of job interview training for the disadvantaged: Videotape feedback, behavior modification, and microcounseling. Journal of Applied Psychology, 58(2), 209–213. https://doi.org/10.1037/h0035655
BurkeS. L.BresnahanT.LiT.EpnereK.RizzoA.PartinM.AhinessR. M.TrimmerM. (2018). Using virtual interactive training agents (ViTA) with adults with autism and other developmental disabilities. Journal of Autism and Developmental Disorders, 48(3), 905–912. https://doi.org/10.1007/s10803-017-3374-z
5.
BurkeS. L.LiT.GrudzienA.GarciaS. (2021). Brief report: Improving employment interview self-efficacy among adults with autism and other developmental disabilities using virtual interactive training agents (ViTA). Journal of Autism and Developmental Disorders, 51(2), 741–748. https://doi.org/10.1007/s10803-020-04571-8
6.
ChambersD. A.GlasgowR. E.StangeK. C. (2013). The dynamic sustainability framework: Addressing the paradox of sustainment amid ongoing change. Implementation Science, 8, Article 117. https://doi.org/10.1186/1748-5908-8-117
7.
CurranG. M.BauerM.MittmanB.PyneJ. M.StetlerC. (2012). Effectiveness-implementation hybrid designs: Combining elements of clinical effectiveness and implementation research to enhance public health impact. Medical Care, 50(3), 217–226. https://doi.org/10.1097/MLR.0b013e3182408812
8.
GenovaH. M.LancasterK.MorecraftJ.HaasM.EdwardsA.DiBenedettoM.KrchD.DeLucaJ.SmithM. J. (2021). A pilot RCT of virtual reality job interview training in transition-age youth on the autism spectrum. Research in Autism Spectrum Disorders, 89, Article 101878. https://doi.org/10.1016/j.rasd.2021.101878
9.
GeverdtD. (2015). Education Demographic and Geographic Estimates Program (EDGE): Locale boundaries user’s manual (NCES 2016-012). U.S. Department of Education, National Center for Education Statistics. https://catalog.data.gov/dataset/locales-2018
10.
GlasgowR. E.HardenS. M.GaglioB.RabinB.SmithM. L.PorterG. C.OryM. G.EstabrooksP. A. (2019). RE-AIM planning and evaluation framework: Adapting to new science and practice with a 20-year review. Frontiers in Public Health, 7, 64. https://doi.org/10.3389/fpubh.2019.00064
11.
GrahamJ. W. (2012). Multiple imputation and analysis with SPSS 17-20. In GrahamJ. W. (Ed.), Missing data: Analysis and design (pp. 227–241). Springer. https://doi.org/10.1007/978-1-4614-4018-5_5
12.
GreggN.GalyardtA.WolfeG.MoonN.ToddR. (2017). Virtual mentoring and persistence in STEM for students with disabilities. Career Development and Transition for Exceptional Individuals, 40(4), 205–214. https://doi.org/10.1177/2165143416651717
13.
GreshamF. M.SugaiG.HornerR. H. (2001). Interpreting outcomes of social skills training for students with high-incidence disabilities. Exceptional Children, 67(3), 331–344. https://doi.org/10.1177/001440290106700303
14.
HarrisP. A.TaylorR.ThielkeR.PayneJ.GonzalezN.CondeJ. G. (2009). Research electronic data capture (REDCap)—A metadata-driven methodology and workflow process for providing translational research informatics support. Journal of Biomedical Informatics, 42(2), 377–381. https://doi.org/10.1016/j.jbi.2008.08.010
15.
HayesG. R.CustodioV. E.HaimsonO. L.NguyenK.RinglandK. E.UlgadoR. R.WaterhouseA.WeinerR. (2015). Mobile video modeling for employment interviews for individuals with autism. Journal of Vocational Rehabilitation, 43(3), 275–287. https://doi.org/10.3233/JVR-150775
16.
Individuals with Disabilities Education Improvement Act, Pub. L. No. PL 101-476, 20 U.S.C. § 1400 (2004).
17.
KellemsR. O.CacciatoreG.OsborneK. (2019). Using an augmented reality–based teaching strategy to teach mathematics to secondary students with disabilities. Career Development and Transition for Exceptional Individuals, 42(4), 253–258. https://doi.org/10.1177/2165143418822800
MuthenB. O.SatorraA. (1995). Complex sample data in structural equation modeling. Sociological Methodology, 25, 267–316. https://doi.org/10.2307/271070
20.
ParsonsL. D. (2006). Using video to teach social skills to secondary students with autism. Teaching Exceptional Children, 39(2), 32–38. https://doi.org/10.1177/004005990603900206
21.
PolitisY.RobbN.YakkundiA.DillenburgerK.HerbertsonN.CharlesworthB.GoodmanL. (2017). People with disabilities leading the design of serious games and virtual worlds. International Journal of Serious Games, 4(2), 63–73. https://doi.org/10.17083/ijsg.v4i2.160
22.
ProctorE.SilmereH.RaghavanR.HovmandP.AaronsG.BungerA.GriffeyR.HensleyM. (2011). Outcomes for implementation research: Conceptual distinctions, measurement challenges, and research agenda. Administration and Policy in Mental Health, 38(2), 65–76. https://doi.org/10.1007/s10488-010-0319-7
RosalesR.WhitlowH. (2019). A component analysis of job interview training for young adults with autism spectrum disorder. Behavioral Interventions, 34(2), 147–162. https://doi.org/10.1002/bin.1658
25.
RoweD. A.MazzottiV. L.FowlerC. H.TestD. W.MitchellV. J.ClarkK. A.HolzbergD.OwensT. L.RusherD.Seaman-TullisR. L.GushanasC. M.CastleH.ChangW.-H.VoggtA.KwiatekS.DeanC. (2021). Updating the secondary transition research base: Evidence- and research-based practices in functional skills. Career Development and Transition for Exceptional Individuals, 44(1), 28–46. https://doi.org/10.1177/2165143420958
26.
SchrankF. A.McGrewK. S.MatherN. (2014). Woodcock-Johnson IV. Riverside.
27.
SherwoodK.SmithM. J.RossB.JohnsonJ.HarringtonM.BlajeskiS.DawaltL.BishopL.SmithJ. D. (In Press). Mixed-methods implementation evaluation of virtual interview training for transition-age autistic youth in pre-employment transition services. Journal of Vocational Rehabilitation.
28.
SmithJ. D.BerkelC.JordanN.AtkinsD. C.NarayananS. S.GalloC.GrimmK. J.DishionT. J.MauricioA. M.Rudo-SternJ.MeachumM. K.WinslowE.BrueningM. M. (2018). An individually tailored family-centered intervention for pediatric obesity in primary care: Study protocol of a randomized type II hybrid effectiveness–implementation trial (Raising Healthy Children study). Implementation Science, 13, Article 11. https://doi.org/10.1186/s13012-017-0697-2
29.
SmithJ. D.BerkelC.Rudo-SternJ.MontañoZ.St GeorgeS. M.PradoG. (2018). The Family Check-Up 4 Health (FCU4Health): Applying implementation science frameworks to the process of adapting an evidence-based parenting program for prevention of pediatric obesity and excess weight gain in primary care. Frontiers in Public Health, 6, Article 293. https://doi.org/10.3389/fpubh.2018.00293
30.
SmithM. J.FlemingM. F.WrightM. A.JordanN.HummL. B.OlsenD.BellM. D. (2015). Job offers to individuals with severe mental illness after participation in virtual reality job interview training. Psychiatric Services, 66(11), 1173–1179. https://doi.org/10.1176/appi.ps.201400504
31.
SmithM. J.GingerE. J.WrightK.WrightM. A.HummL. B.OlsenD.BellM. B.FlemingM. F. (2014). Virtual reality job interview training in individuals with psychiatric disabilities. Journal of Nervous and Mental Disease, 202(9), 659–667. https://doi.org/10.1097/NMD.0000000000000187
32.
SmithM. J.GingerE. J.WrightK.WrightM. A.TaylorJ. L.HummL. B.OlsenD. E.BellM. D.FlemingM. F. (2014). Virtual reality job interview training in adults with autism spectrum disorder. Journal of Autism and Developmental Disorders, 44(10), 2450–2463. https://doi.org/10.1007/s10803-014-2113-y
33.
SmithM. J.PintoR. M.DawaltL.SmithJ. D.SherwoodK.MilesR.TaylorJ. L.HumeK.DawkinsT.Baker-EriczenM.FrazierT.HummL.SteacyC. (2020). Using community-engaged methods to adapt virtual reality job-interview training for transition-age youth on the autism spectrum. Research in Autism Spectrum Disorders, 71, Article 101498. https://doi.org/10.1016/j.rasd.2019.101498
34.
SmithM. J.SherwoodK.BlajeskiS.RossB.SmithJ. D.JordanN.DawaltL.BishopL.AtkinsM. S. (2021). Job interview and vocational outcomes among transition-age youth receiving special education pre-employment transition services. Intellectual and Developmental Disabilities, 59(5), 405–421. https://doi.org/10.1352/1934-9556-59.5.405
35.
SmithM. J.SherwoodK.RossB.SmithJ. D.DawaltL.BishopL.HummL.ElkinsJ.SteacyC. (2021). Virtual interview training for transition-age autistic youth: A randomized controlled feasibility and effectiveness trial. Autism, 25(6), 1536–1552. https://doi.org/10.1177/1362361321989928
36.
SmithM. J.SmithJ. D.JordanN.SherwoodK.McRobertE.RossB.OulveyE.AtkinsM. S. (2021). Virtual reality job interview training in transition services: Results of a single-arm, noncontrolled effectiveness-implementation hybrid trial. Journal of Special Education Technology, 36(1), 3–17. https://doi.org/10.1177%2F0162643420960093
37.
SouthwardJ. D.KyzarK. (2017). Predictors of competitive employment for students with intellectual and/or developmental disabilities. Education and Training in Developmental Disabilities, 52(1), 26–37. https://doi.org/10.2307/26420373
38.
SpencerS.DrescherT.SearsJ.ScruggsA. F.SchrefflerJ. (2019). Comparing the efficacy of virtual simulation to traditional classroom role-play. Journal of Educational Computing Research, 57(7), 1772–1785. https://doi.org/10.1177/0735633119855613
39.
StirmanS. W.GamarraJ.BartlettB.CallowayA.GutnerC. (2017). Empirical examinations of modifications and adaptations to evidence-based psychotherapies: Methodologies, impact, and future directions. Clinical Psychology, 24(4), 396–420. https://doi.org/10.1111/cpsp.12218
40.
ThorsteinssonG.ShavininaL. V. (2013). Developing an understanding of the pedagogy of using a virtual reality learning environment (VRLE) to support innovation education. Routledge.
WechslerD. (2014). Wechsler intelligence scale for children (5th ed.). Pearson.
43.
WehmanP.SchallC.McDonoughJ.SimaA.BrookeA.HamW.WhittenburgH.BrookeV.AvelloneL.RiehleE. (2019). Competitive employment for transition-aged youth with significant impact from autism: A multi-site randomized clinical trial. Journal of Autism and Developmental Disorders, 50(6), 1882–1897. https://doi.org/10.1007/s10803-019-03940-2
44.
Workforce Innovation and Opportunity Act, Pub. L. No. PL 113-128, 29 U.S.C. § 3164 (2014).
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
