Admissions decisions are among the most consequential assessment points in educating occupational therapists. Suboptimal measures of academic achievement and personal characteristics are often used to select candidates. The purpose of the study is to investigate reliability and validity evidence supporting the use of the multiple mini interview for selecting candidates to an occupational therapy master’s level program.
Method
The study used a prospective cohort design. Data sources included both archival data and prospective candidate-generated data (multiple mini interview scores, applicant file review scores and academic performance), analyzed using psychometric and correlational approaches.
Results
Seventy-seven of 80 candidates participated in the prospective component of the study. Overall reliability of a 10-station multiple mini interview was .72. Inter-rater reliability was reasonable. Weak interrelationships were found between multiple mini interview scores and other application components.
Conclusion
Multiple mini interview scores may be probing different attributes than the other components of the application package. Our study findings support the use of the multiple mini interview for selecting applicants to a professional master’s program in occupational therapy; however, future work should continue to investigate the predictive validity of the multiple mini interview.
BossersAMillerLTPolatajkoHJet al. (2007) Competency Based Fieldwork Evaluation for Occupational Therapists CBFE-OT, Toronto: Nelson Education.
2.
BrennanLR (2001) Generalizability Theory, New York: Springer-Verlag.
3.
Canadian Association of Occupational Therapists (2012) Profile of practice of occupational therapists in Canada 2012. Available at: www.caot.ca/document/3653/2012otprofile.pdf (accessed 17 May 2017).
4.
Canadian Association of Occupational Therapists (2013) What is Occupational Therapy? Occupational Therapy Values and Beliefs.
5.
DionKBerscheidEWalsterE (1972) What is beautiful is good. Journal of Personality and Social Psychology24(3): 285–290.
6.
DowellJLynchBTillHet al. (2012) The multiple mini-interview in the UK context: 3 years of experience at Dundee. Medical Teacher34(4): 297–304.
7.
DurningSJDolmansDHClelandJet al. (2012) The AMEE research committee: Initiatives to stimulate research and practice. Medical Teacher34(6): 458–461.
8.
Elstein AS, Shulman LS and Sprafka SA (1978) High fidelity simulation: Research methods. In: Anonymous Medical Problem Solving: An Analysis of Clinical Reasoning. Harvard University Press, Cambridge, MA, pp.46–63.
9.
EvaKWReiterHIRosenfeldJet al. (2012) Association between a medical school admission process using the multiple mini-interview and national licensing examination scores. Journal of the American Medical Association308(21): 2233–2240.
10.
EvaKWRosenfeldJReiterHIet al. (2004a) An admissions OSCE: The multiple mini-interview. Medical Education38(3): 314–326.
11.
EvaKWReiterHIRosenfeldJet al. (2004b) The ability of the multiple mini-interview to predict preclerkship performance in medical school. Academic Medicine79(10): S40–S42.
12.
EvaKReiterHTrinhKet al. (2009) Predictive validity of the multiple mini-interview for selecting medical trainees. Medical Education43(8): 767–775.
13.
FoleyJHijaziK (2013) The admissions process in a graduate-entry dental school: Can we predict academic performance?British Dental Journal214(2): E4.
14.
GriceKO (2014) Use of multiple mini-interviews for occupational therapy admissions. Journal of Allied Health43(1): 57–61.
15.
HansonMDKulasegaramKMWoodsNNet al. (2012) Modified personal interviews: Resurrecting reliable personal interviews for admissions?Academic Medicine87(10): 1330–1334.
16.
HarasymPHWoloschukWMandinHet al. (1996) Reliability and validity of interviewers’ judgments of medical school candidates. Academic Medicine71(1): S40–S42.
17.
HeckerKDonnonTFuentealbaCet al. (2009) Assessment of applicants to the veterinary curriculum using a multiple mini-interview method. Journal of Veterinary Medical Education36(2): 166–173.
18.
HodgesBD (2009) The Objective Structured Clinical Examination: A Socio-History, LAP Lambert Academic Publishing.
19.
HolmesJDBossersAMPolatajkoHJet al. (2010) 1000 fieldwork hours: Analysis of multi-site evidence. Canadian Journal of Occupational Therapy77(3): 135–143.
20.
HusbandsADowellJ (2013) Predictive validity of the Dundee multiple mini-interview. Medical Education47(7): 717–725.
21.
KirchnerGLHolmMB (1997) Prediction of academic and clinical performance of occupational therapy students in an entry-level master’s program. American Journal of Occupational Therapy51(9): 775–779.
22.
LemayJLockyerJMCollinVTet al. (2007) Assessment of non-cognitive traits through the admissions multiple mini-interview. Medical Education41(6): 573–579.
23.
LysaghtRDonnellyCVilleneuveM (2009) Factors predicting applicant outcomes in occupational therapy education. Canadian Journal of Occupational Therapy76(1): 38–47.
24.
Medical Council of Canada (2017) Medical council of Canada qualifying examination Part II. Available at: http://mcc.ca/examinations/mccqe-part-ii/ (accessed 17 October 2016).
25.
NormanGRStreinerDL (2003) PDQ Statistics, Raleigh, NC: People’s Medical Publishing House-USA.
26.
OliverTHeckerKHausdorfPAet al. (2014) Validating MMI scores: Are we measuring multiple attributes?Advances in Health Sciences Education19(3): 379–392.
27.
PauAJeevaratnamKChenYet al. (2013) The multiple mini-interview (MMI) for student selection in health professions training – A systematic review. Medical Teacher35(12): 1027–1041.
28.
PosthumaBNohS (1990) Interview scores and academic grades as selection criteria for admission to an occupational therapy program. Canadian Journal of Occupational Therapy57(5): 285–291.
29.
RazackSFaremoSDroletFet al. (2009) Multiple mini-interviews versus traditional interviews: Stakeholder acceptability comparison. Medical Education43(10): 993–1000.
30.
ReiterHIEvaKWRosenfeldJet al. (2007) Multiple mini-interviews predict clerkship and licensing examination performance. Medical Education41(4): 378–384.
31.
ReiterHISalvatoriPRosenfeldJet al. (2006) The effect of defined violations of test security on admissions outcomes using multiple mini-interviews. Medical Education40(1): 36–42.
32.
RosenfeldJMReiterHITrinhKet al. (2008) A cost efficiency comparison between the multiple mini-interview and traditional admissions interviews. Advances in Health Sciences Education13(1): 43–58.
33.
SalvatoriP (2001) Reliability and validity of admissions tools used to select students for the health professions. Advances in Health Sciences Education6(2): 159–175.
34.
SullivanTBossersA (1998) Occupational therapy fieldwork levels. The National15(3): 7–9.
35.
ThomasAYoungMEMazerBLet al. (2015) Candidates’ and interviewers’ perceptions of multiple-mini interviews for admission to an occupational therapy professional program. Occupational Therapy in Health Care29(2): 186–200.
36.
UijtdehaageSDoyleLParkerN (2011) Enhancing the reliability of the multiple mini-interview for selecting prospective health care leaders. Academic Medicine86(8): 1032–1039.
37.
Van Der VleutenCDolmansDHScherpbierAJ (2000) The need for evidence in education. Medical Teacher22(3): 246–250.
