Virtual Job Interview Training: A Dose Response to Improve Employment for Transition-Age Youth With Disabilities

Abstract

Virtual Interview Training for Transition-Age Youth and Virtual Reality Job Interview Training are job interview simulators with demonstrated effectiveness in randomized controlled trials. We evaluated their dose responses via secondary data analysis of 558 transition-age youth with disabilities in 47 schools where the simulators were implemented in quasi-experimental studies. Cut-point analyses determined dosing efficiency and efficacy to optimize competitive employment. The most efficient dose when accounting for the balance between dose and employment was completing nine virtual interviews. The most efficacious dose to maximize the likelihood of successful employment was 38, but it varied across race, IQ, Individuals with Disabilities Education Improvement Act (IDEA) categories, and employment history. This study provides a novel approach to inform implementation guidelines for virtual interview training in pre-employment transition services. Limitations and implications for research and practice are discussed.

Keywords

virtual reality job interview training employment transition services dosing efficiency and efficacy

Get full access to this article

View all access options for this article.

References

Arter

Brown

Law

Barna

Fruehan

Fidiam

(2018). Virtual reality: Improving interviewing skills in individuals with autism spectrum disorder. In Langran

Borup

(Eds.), Proceedings of society for information technology & teacher education international conference (pp. 1086–1088). Association for the Advancement of Computing in Education (AACE). https://www.learntechlib.org/primary/p/182660/

Bond

(1998). Principles of the individual placement and support model: Empirical support. Psychiatric Rehabilitation Journal, 22(1), 11–23. https://doi.org/10.1037/h0095271

Bureau of Labor Statistics. (2021). Persons with a disability: Labor force characteristics 2021 (USDL-22-0317). https://www.bls.gov/news.release/pdf/disabl.pdf

Cobb

R. B.

Lipscomb

Wolgemuth

Schulte

Veliquette

Alwell

Batchelder

Bernard

Hernandez

Holmquist-Johnson

Orsi

Sample McMeeking

Wang

Weinberg

(2013). Improving post-high school outcomes for transition-age students with disabilities: An evidence review (NCEE 2013-4011). Institute of Educational Science. https://ies.ed.gov/ncee/pubs/20134011/pdf/20134011.pdf

Fombonne

(1991). The use of questionnaires in child psychiatry research: Measuring their performance and choosing an optimal cut-off. Journal of Child Psychology and Psychiatry, 32(4), 677–693. https://doi.org/10.1111/j.1469-7610.1991.tb00343.x

Genova

H. M.

Lancaster

Morecraft

Haas

Edwards

DiBenedetto

Krch

DeLuca

Smith

M. J.

(2021). A pilot RCT of virtual reality job interview training in transition-age youth on the autism spectrum. Research in Autism Spectrum Disorders, 89, 101878. https://doi.org/10.1016/j.rasd.2021.101878

Geverdt

(2015). Education Demographic and Geographic Estimates Program (EDGE): Locale boundaries user’s manual (NCES 2016-012). National Center for Education Statistics, U.S. Department of Education. https://files.eric.ed.gov/fulltext/ED577162.pdf

Hayes

G. R.

Custodio

V. E.

Haimson

O. L.

Nguyen

Ringland

K. E.

Ulgado

R. R.

Waterhouse

Weiner

(2015). Mobile video modeling for employment interviews for individuals with autism. Journal of Vocational Rehabilitation, 43, 275–287. https://doi.org/10.3233/JVR-150775

Herrin

(2002). CLTEST: Stata modules for performing cluster-adjusted chi-square and t-tests (Statistical Software Components S424901). Boston College Department of Economics.

10.

Hill

L. G.

Coie

J. D.

Lochman

J. E.

Greenberg

M. T.

(2004). Effectiveness of early screening for externalizing problems: Issues of screening accuracy and utility. Journal of Consulting and Clinical Psychology, 72(5), 809–820. https://doi.org/10.1037/0022-006X.72.5.809

11.

Hosmer

D. W.

Lemeshow

Sturdivant

R. X.

(2013). Applied logistic regression (3rd ed.). Wiley.

12.

Individuals with Disabilities Education Improvement Act IDEA, 20 U.S.C. § 1400, et seq. (2004).

13.

Karve

Cleves

M. A.

Helm

Hudson

T. J.

West

D. S.

Martin

B. C.

(2009). Good and poor adherence: Optimal cut-point for adherence measures using administrative claims data. Current Medical Research and Opinion, 25(9), 2303–2310. https://doi.org/10.1185/03007990903126833

14.

McNeil

B. J.

Hanley

J. A.

(1984). Statistical approaches to the analysis of receiver operating characteristic (ROC) curves. Medical Decision Making, 4(2), 137–150. https://doi.org/10.1177/0272989X8400400203

15.

R Core Team. (2013). R: A language and environment for statistical computing. R Foundation for Statistical Computing. http://www.R-project.org/

16.

Rowe

D. A.

Mazzotti

V. L.

Fowler

C. H.

Test

D. W.

Mitchell

V. J.

Clark

K. A.

Holzberg

Owens

T. L.

Rusher

Seaman-Tullis

R. L.

Gushanas

C. M.

Castle

Chang

W.-H.

Voggt

Kwiatek

Dean

(2021). Updating the secondary transition research base: Evidence- and research-based practices in functional skills. Career Development and Transition for Exceptional Individuals, 44(1), 28–46. https://doi.org/10.1177/2165143420958

17.

Schrank

F. A.

McGrew

K. S.

Mather

(2014). Woodcock-Johnson IV. Riverside.

18.

Smith

M. J.

Fleming

M. F.

Wright

M. A.

Jordan

Humm

L. B.

Olsen

Bell

M. D.

(2015). Job offers to individuals with severe mental illness after participation in virtual reality job interview training. Psychiatric Services, 66(11), 1173–1179. https://doi.org/10.1176/appi.ps.201400504

19.

Smith

M. J.

Fleming

M. F.

Wright

M. A.

Losh

Humm

L. B.

Olsen

Bell

M. D.

(2015). Brief report: Vocational outcomes for young adults with autism spectrum disorders at six months after virtual reality job interview training. Journal of Autism and Developmental Disorders, 45(10), 3364–3369. https://doi.org/10.1007/s10803-015-2470-1

20.

Smith

M. J.

Fleming

M. F.

Wright

M. A.

Roberts

A. G.

Humm

L. B.

Olsen

Bell

M. D.

(2015). Virtual reality job interview training and 6-month employment outcomes for individuals with schizophrenia seeking employment. Schizophrenia Research, 166, 86–91. https://doi.org/10.1016/j.schres.2015.05.022

21.

Smith

M. J.

Ginger

E. J.

Wright

M. A.

Taylor

J. L.

Humm

L. B.

Olsen

D. E.

Bell

M. D.

Fleming

M. F.

(2014). Virtual reality job interview training in adults with autism spectrum disorder. Journal of Autism and Developmental Disorders, 44(10), 2450–2463. https://doi.org/10.1007/s10803-014-2113-y

22.

Smith

M. J.

Ginger

E. J.

Wright

M. A.

Wright

Humm

L. B.

Olsen

Bell

M. D.

Fleming

M. F.

(2014). Virtual reality job interview training for individuals with psychiatric disabilities. Journal of Nervous and Mental Disease, 202(9), 659–667. https://doi.org/10.1097/NMD.0000000000000187

23.

Smith

M. J.

Pinto

R. M.

Dawalt

Smith

J. D.

Sherwood

Miles

Taylor

J. L.

Hume

K. A.

Dawkins

Baker-Ericzén

Frazier

T. W.

Humm

L. B.

Steacy

(2020). Using community-engaged methods to adapt virtual reality job-interview training for transition-age youth on the autism spectrum. Research in Autism Spectrum Disorders, 71, 101498. https://doi.org/https://doi.org/10.1016/j.rasd.2019.101498

24.

Smith

M. J.

Sherwood

Blajeski

Ross

Smith

J. D.

Jordan

Dawalt

Bishop

Atkins

M. S.

(2021). Job interview and vocational outcomes among transition-age youth receiving special education pre-employment transition services. Intellectual and Developmental Disabilities, 59(5), 405–421. https://doi.org/10.1352/1934-9556-59.5.405

25.

Smith

M. J.

Sherwood

Ross

Oulvey

E. A.

Atkins

M. S.

Danielson

E. A.

Jordan

Smith

J. D.

(2022). Scaling out virtual interview training for transition age youth: A quasi-experimental hybrid effectiveness-implementation study. Career Development and Transition for Exceptional Individuals, 45(4), 213–227. https://doi.org/10.1177/21651434221081273

26.

Smith

M. J.

Sherwood

Ross

Smith

J. D.

DaWalt

Bishop

Humm

L. B.

Elkins

Steacy

(2021). Virtual interview training for autistic transition age youth: A randomized controlled feasibility and effectiveness trial. Autism, 25(6), 1536–1552. https://doi.org/10.1177/1362361321989928

27.

Smith

M. J.

Smith

J. D.

Blajeski

Ross

Jordan

Bell

M. D.

McGurk

Mueser

K. T.

Burke-Miller

Oulvey

E. A.

Fleming

M. F.

Nelson

Brown

Prestipino

Pashka

Razzano

L. A.

(2022). An RCT of virtual reality job interview training for individuals with serious mental illness in IPS supported employment. Psychiatric Services, 73(9), 1027–1038. https://doi.org/10.1176/appi.ps.202100516

28.

Smith

M. J.

Smith

J. D.

Jordan

Sherwood

McRobert

Ross

Oulvey

E. A.

Atkins

M. S.

(2021). Virtual reality job interview training in transition services: Results of a single-arm, noncontrolled effectiveness-implementation hybrid trial. Journal of Special Education Technology, 36(1), 3–17. https://doi.org/10.1177/0162643420960093

29.

StataCorp. (2021). Stata Statistical Software: Release 17. StataCorp LLC.

30.

U.S. Department of Education. (2017). A transition guide to postsecondary education and employment for students and youth with disabilities. Office of Special Education and Rehabilitation Services. https://sites.ed.gov/idea/files/postsecondary-transition-guide-may-2017.pdf

31.

Ward

D. M.

Esposito

M. C. K.

(2019). Virtual reality in transition program for adults with autism: Self-efficacy, confidence, and interview skills. Contemporary School Psychology, 23, 423–431. https://doi.org/10.1007/s40688-018-0195-9

32.

Wechsler

(2014). Wechsler Intelligence Scale for children (5th ed.). Pearson.

33.

Workforce Innovation and Opportunity Act WIOA, 29 U.S.C. § 3164, Pub. L. No. PL 113-128 (2014).

34.

Zlobec

Steele

Terracciano

Jass

J. R.

Lugli

(2007). Selecting immunohistochemical cut-off scores for novel biomarkers of progression and survival in colorectal cancer. Journal of Clinical Pathology, 60(10), 1112–1116. https://doi.org/10.1136/jcp.2006.044537

35.

Zweig

M. H.

Campbell

(1993). Receiver-operating characteristic (ROC) plots: A fundamental evaluation tool in clinical medicine. Clinical Chemistry, 39(4), 561–577. https://doi.org/10.1093/clinchem/39.4.561

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

1.88 MB

0.03 MB

0.01 MB