Health profession programs routinely utilize traditional interviews in admissions as a means of assessing important non-academic characteristics (e.g., critical thinking, interpersonal skills, judgment) of candidates. However, the reliability and validity of traditional interviews is highly questionable. Given this, multiple health profession programs (e.g., medicine, nursing, pharmacy, physical therapy) have implemented multiple mini-interviews as an alternative for assessing non-academic characteristics. This paper describes the development and implementation of multiple mini-interviews in the admissions process for a doctoral clinical psychology program, one of the health professions yet to use multiple mini-interviews. This paper also examines the feasibility and acceptability of the multiple mini-interviews in this program. Results of a mixed-method survey of all 120 candidates who participated in admissions days are presented along with discussion of factors associated with satisfaction and dissatisfaction. Recommendations for program refinement and application to other graduate psychology programs for improved admissions processes are discussed.
American Psychological Association. (2015). Commission on accreditation implementing regulations. Section C: IRs related to the Standards of Accreditation. Retrieved from https://www.apa.org/ed/accreditation/section-c-soa.pdf
2.
AxelsonR. D.FergusonK. J. (2012).
State of the art and science: Bias in assessment of noncognitive attributes. Virtual Mentor - American Medical Association Journal of Ethics,
14(12), 998–1002. doi:10.1001/virtualmentor.2012.14.12.stas2-1212.
3.
BarbourM. E.SandyJ. R. (2014).
Multiple mini interviews for selection of dental students: Influence of gender and starting station. Journal of Dental Education,
78(4), 589–596. Retrieved from http://www.jdentaled.org/content/78/4/589/tab-article-info
4.
BarnettR.WintertonA.FirthP.DavisonJ.WillisJ.O’BrienA. (2015).
Multiple mini interviews for undergraduate physiotherapy entry in the United Kingdom (UK). Physiotherapy,
101(1), 1649–1650. doi:10.1016/j.physio.2015.03.043
5.
BrownellK.LockyerJ.CollinT.LemayJ. F. (2007).
Introduction of the multiple mini interview into the admissions process at the University of Calgary: Acceptability and feasibility. Medical Teacher,
29, 394–396. doi:10.1080/01421590701311713
6.
CallwoodA.JeevaratnamK.KotronoulasG.SchneiderA.LewisL.NadarajahV. D. (2018).
Personal domains assessed in multiple mini interview (MMIs) for healthcare student selection: A narrative synthesis systemic review. Nurse Education Today,
64, 56–64. doi:10.1016/j.nedt.2018.01.016
7.
CameronA. J.MackeiganL. D. (2012).
Development and pilot testing of a multiple mini-interview for admission to a pharmacy degree program. American Journal of Pharmaceutical Education,
76(1), 1–9. doi:10.5688/ajpe76110
8.
Campagna-VaillancourtM.ManoukianJ.RazackS.NguyenL. H. (2014).
Acceptability and reliability of multiple mini-interviews for admission to otolaryngology residency. Laryngoscope,
124(1), 91–96. doi:10.1002/lary.24122
9.
ClarkeV.BraunV.HayfieldN. (2015). Thematic analysis. In SmithJ. (Ed.), Qualitative psychology: A practical guide to research methods (3rd ed., pp. 222–248).
London, England:
SAGE Publications.
10.
EvaK. W.MacalaC.FlemingB. (2018).
Twelve tips for constructing a multiple mini-interview. Medical Teacher,
26, 1–7. doi:10.1080/0142159X.2018.1429586
11.
EvaK. W.ReiterH. I.RosenfeldJ.NormanG. (2004a).
The ability of the multiple mini-interview to predict preclerkship performance in medical school. Academic Medicine,
79, 40–42. doi:10.1097/00001888-200410001-00012
12.
EvaK. W.ReiterH. I.RosenfeldJ.NormanG. R. (2004b).
The relationship between interviewer characteristics and ratings assigned during a multiple mini-interview. Academic Medicine,
79, 602–609. doi:10.1097/00001888-200406000-00021
13.
EvaK. W.ReiterH. I.RosenfeldJ.TrinhK.WoodT. J.NormanG. R. (2012).
Association between a medical school admission process using the multiple mini-interview and national licensing examination scores. Journal of the American Medical Association,
308(21), 2233–2240. doi:10.1001/jama.2012.36914
14.
EvaK. W.RosenfeldJ.ReiterH. I.NormanG. R. (2004).
An admissions OSCE: The multiple mini-interview. Medical Education,
38, 314–326. doi:10.1046/j.1365-2923.2004.01776.x
15.
FinlaysonH. C.TownsonA. F. (2011).
Resident selection for a physical medicine and rehabilitation program: Feasibility and reliability of the multiple mini-interview. American Journal of Physical Medicine & Rehabilitation,
90(4), 330–335. doi:10.1097/PHM.0b013e31820f9677
16.
FontesL. A. (2008). Interviewing clients across cultures: A practitioner’s guide.
New York, NY:
Guilford Press.
GlazerG.StartsmanL. F.BankstonK.MichaelsJ.DanekJ. C.FairM. (2016).
How many schools adopt interviews during the student admission process across the health professions in the United States of America?Journal of Educational Evaluation for Health Professions,
13, 12. doi:10.3352/jeehp.2016.13.12
19.
GriceK. O. (2014).
Use of multiple mini-interviews for occupational therapy admissions. Journal of Allied Health,
43(1), 57–61. doi:10.1177/0308022617713980
20.
HadadA.GafniN.MoshinskyA.TurvallE.ZivA.IsrealiA. (2016).
The multiple mini-interviews as a predictor of peer evaluations during clinical training in medical school. Medical Teacher,
38, 1172–1179. doi:10.1080/0142159x.2016.1181730
21.
HeckerK.DonnonT.FuentealbaC.HallD.IllanesO.MorckD. W.MuellingC. (2009).
Assessment of applicants to the veterinary curriculum using a multiple mini-interview method. Journal of Veterinary Medical Education,
36(2), 166–173. doi:10.3138/jvme.36.2.166
22.
HofmeisterM.LockyerJ.CrutcherR. (2008).
The acceptability of the multiple mini interview for resident selection. Family Medicine,
40(10), 734–740. Retrieved from https://journals.stfm.org/familymedicine/
23.
HumphreyS.DowsonS.WallD.DiwakerV.GoodyearH. M. (2008).
Multiple mini-interviews: Opinions of candidates and interviewers. Medical Education,
42(2), 2017–2213. doi:10.1111/j.1365-2923.2007.02972.x
24.
JerantA.HendersonM. C.GriffinE.RainwaterJ. A.HallT. R.KellyC. J., … FranksP. (2017).
Reliability of multiple mini-interviews and traditional interviews within and between institutions: A study of five California medical schools. BMC Medical Education,
17, 190. doi:10.1186/s12909-017-1030-0
25.
KnorrM.SchwibbeA.EhrhardtM.LackampJ.ZimmermanS.HampeW. (2018).
Validity evidence for the Hamburg multiple mini-interview. BMC Medical Education,
18, 106. doi:10.1186/s12909-018-1208-0
26.
KumarK.RobertsC.RothnieI.Du FresneC.WaltonM. (2009).
Experiences of the multiple mini-interview: A qualitative analysis. Medical Education,
43, 360–367. doi:10.1111/j.1365-2923.2009.03291.x
27.
OylerD. R.SmithK. M.ElsonE. C.BushH.CookA. (2014).
Incorporating multiple mini-interviews in the postgraduate year 1 pharmacy residency program selection process. American Journal of Health-System Pharmacy,
71(4), 297–304. doi:10.2146/ajhp130315
28.
PattersonF.KnightA.DowellJ.NicholsonS.CousansF.ClelandJ. (2016).
How effective are selection methods in medical education? A systematic review. Medical Education,
50, 36–60. doi:10.1111/medu.12817
29.
PauA.JeevaratnamK.ChenY. S.FallA. A.KhooC.NadarajahV. D. (2013).
The Multiple Mini-Interview (MMI) for student selection in health professions training—A systematic review. Medical Teacher,
35(12), 1027–1041. doi:10.3109/0142159X.2013.829912
30.
RazackS.FaremoS.DroletF.SnellL.WisemanJ.PickeringJ. (2009).
Multiple mini-interviews versus traditional interviews: Stakeholder acceptability comparison. Medical Education,
43, 993–1000. doi:10.1111/j.1365-2923.2009.03447.x
31.
ReesE. L.HawardenA. W.DentG.HaysR.BatesJ.HassellA. B. (2016).
Evidence regarding the utility of multiple mini-interview (MMI) for selection to undergraduate health programs: A BEME systematic review: BEME guide no. 37. Medical Teacher,
38, 443–455. doi:10.3109/0142159x.2016.1158799
32.
ReiterH. I.EvaK. W. (2018).
Vive la différence: The freedom and inherent responsibilities when designing and implementing multiple mini-interviews. Academic Medicine,
93, 969–971. doi:10.1097/acm.0000000000002042
33.
ReiterH. I.EvaK. W.RosenfeldJ.NormanG. R. (2007).
Multiple mini-interviews predict clerkship and licensing examination performance. Medical Education,
41, 378–384. doi:10.1111/j.1365-2929.2007.02709.x
34.
RobertsC.ClarkT.BurgessA.FrommerM.GrantM.MossmanK. (2014).
The validity of a behavioural multiple-mini-interview within an assessment centre for selection into specialty training. BMC Medical Education,
14, 169. doi:10.1186/1472-6920-14-169
35.
SalvatoriP. (2001).
Reliability and validity of admissions tools used to select students for the health professions. Advances in Health Sciences Education,
6, 159–175. Retrieved from https://link.springer.com/journal/10459
36.
ThomasA.YoungM. E.MazerB. L.LubarskyS. E.RazackS. I. (2015).
Candidates’ and interviewers’ perceptions of multiple-mini interviews for admission to an occupational therapy professional program. Occupational Therapy in Health Care,
29(2), 186–200. doi:10.3109/07380577.2015.1012776
37.
YamadaT.SatoJ.YoshimuraH.OkuboT.HiraokeE.ShigaT., … BanN. (2017).
Reliability and acceptability of six station multiple mini-interviews: Past behavioural versus situational questions in postgraduate medical admission. BMC Medical Education,
17(1), 57. doi:10.1186/s12909-017-0898-z
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
