This report summarizes more than a decade of experiences with implementing computer-based testing across a 4-year medical curriculum. Practical considerations are given to the fields incorporated within an item database and their use in the creation and analysis of examinations, security issues in the delivery and integrity of examinations, curricular integration, use of examination log files, effectiveness and timeliness of reports, and the potential for educational research. The solutions to many complicated issues have practical relevance and interest to the community of educators who are considering the adoption of this technology for assessment.
Get full access to this article
View all access options for this article.
References
1.
AgarwalP. K.KarpickeJ. D.KangS. H. K.RoedigerH. L.McDermottK.B. (2008). Examining the testing effect with open- and closed-book tests. Applied Cognitive Psychology, 22(7), 861–876.
2.
ButlerA. C.KarpickeJ. D.RoedigerH. L. (2008). Correcting a metacognitive error: Feedback increases retention of low-confidence correct responses. Journal of Experimental Psychology: Learning, Memory, and Cognition, 34(4), 918–928.
Hols-EldersW.BloemendaalP.BosN.QuaakM.SijstermansR.De JongP. (2008). Twelve tips for computer-based assessment in medical education. Medical Teacher, 30(7), 673–678.
5.
HoytA.McNultyJ. A.GruenerG.ChandrasekharA.EspirituB.EnsmingerD. (2010). An audience response system may influence student performance on anatomy examination questions. Anatomical Sciences Education, 36(3), 295–299.
6.
KerfottB. P. (2009). Learning benefits of on-line spaced education persist for 2 years. The Journal of Urology, 181, 2671–2673.
7.
McNultyJ. A.SonntagB.SinacoreJ. M. (2007). Test-taking behaviors on a multiple-choice exam are associated with performance on the exam and with learning style. JIAMSE, 17, 51–57.
8.
OgilvieR. W.TruskT. C.BlueA. V. (1999). Students' attitudes towards computer testing in a basic science course. Medical Education, 33(11), 828–831.
9.
PetersonM. W.GordonJ.ElliottS.KreiterC. (2004). Computer-based testing: Initial report of extensive use in a medical school curriculum. Teaching and Learning in Medicine, 16(1), 51–59.
10.
ScheuermannF.BjornssonJ. (Eds.). (2009). The transition to computer-based assessment. New approaches to skills assessment and implications for large-scale testing. Retrieved from http://www.gesci.org/assets/files/reporttransition.pdf
SevenairJ. P.BurkettA. R. (1988). Difficulty and discrimination of multiple-choice questions: A counterintuitive result. Journal of Chemical Education, 65, 441.
13.
SimS. M.RasiahR. I. (2006). Relationship between item difficulty and discrimination indices in true/false-type multiple choice questions of a para-clinical multidisciplinary paper. Annals of the Academy of Medicine, Singapore, 35, 67–71.
