Both multiple-choice and short-answer tests can be beneficial to learning in the classroom. However, fact-based multiple-choice questions, because they include the correct answer as a response option, could lead to inflated estimates of learning and higher evaluations of teaching effectiveness.
Objective
The objective of this study was to examine the effects of test format on perceptions of learning and teaching.
Method
Undergraduate students (N = 123) completed either a multiple-choice or short-answer test based on a brief psychology lesson. Then, they predicted their performance on later tests of knowledge and evaluated the quality of the lesson.
Results
Taking a multiple-choice test led to predictions about future performance that were 10% higher than those taking a short-answer test. No consistent differences emerged in participants’ evaluations of teaching effectiveness between the two test formats.
Conclusion
These results suggest that test format may significantly influence students’ confidence in their ability to produce answers on future tests.
Teaching Implications
Teachers who want to take advantage of testing as a metacognitive learning tool should adopt question formats that utilize recall of information from memory without retrieval cues.
AddisonW. E.BestJ.WarringtonJ. D. (2006). Students’ perceptions of course difficulty and their ratings of the instructor. College Student Journal, 40(2), 409–416.
2.
AgarwalP. K.NunesL. D.BluntJ. R. (2021). Retrieval practice consistently benefits student learning: A systematic review of applied research in schools and classrooms. Educational Psychology Review, 33(4), 1409–1453. https://doi.org/10.1007/s10648-021-09595-9
3.
BentonS. L.CashinW. E. (2012). Student ratings of teaching: A summary of research and literature: IDEA paper #50. The IDEA Center.
4.
BentonS. L.LiD. (2015). Validity and reliability of IDEA “Teaching Essentials”. IDEA Research Report #8. IDEA Center.
5.
BjorkE. L.BjorkR. A. (2011). Making things hard on yourself, but in a good way: Creating desirable difficulties to enhance learning. In GernsbacherM. A.PewR. W.HoughL. M.PomerantzJ. R. (Eds.), Psychology and the real world: Essays illustrating fundamental contributions to society (pp. 56–64). Worth Publishers.
BoysenG. A.OsgoodP. N. (2023). Test format, learning overconfidence, and perceptions of teaching effectiveness [Data set, syntax, materials]. https://osf.io/7txp2/.
8.
CentraJ. A. (2003). Will teachers receive higher student evaluations by giving higher grades and less coursework?Research in Higher Education, 44(5), 495–518. https://doi.org/10.1023/A:1025492407752
9.
CuddyA. J. C.FiskeS. T.GlickP. (2007). The BIAS map: Behaviors from intergroup affect and stereotypes. Journal of Personality and Social Psychology, 92(4), 631–648. https://doi.org/10.1037/0022-3514.92.4.631
10.
DunloskyJ.RawsonK. A. (2015). Practice tests, spaced practice, and successive relearning: Tips for classroom use and for guiding students’ learning. Scholarship of Teaching and Learning in Psychology, 1(1), 72–78. https://doi.org/10.1037/stl0000024
11.
FisherM.GodduM. K.KeilF. C. (2015). Searching for explanations: How the internet inflates estimates of internal knowledge. Journal of Experimental Psychology: General, 144(3), 674–687. https://doi.org/10.1037/xge0000070
12.
FisherM.OppenheimerD. M. (2021a). Harder than you think: How outside assistance leads to overconfidence. Psychological Science, 32(4), 598–610. https://doi.org/10.1177/0956797620975779
13.
FisherM.OppenheimerD. M. (2021b). Who knows what? Knowledge misattribution in the division of cognitive labor. Journal of Experimental Psychology: Applied, 27(2), 292–306. https://doi.org/10.1037/xap0000310.supp
14.
FisherM.SmileyA. H.GrilloT. L. H. (2022). Information without knowledge: The effects of internet search on learning. Memory, 30(4), 375–387. https://doi.org/10.1080/09658211.2021.1882501
15.
FiskeS. T.CuddyA. J. C.GlickP.XuJ. (2002). A model of (often mixed) stereotype content: Competence and warmth respectively follow from perceived status and competition. Journal of Personality and Social Psychology, 82(6), 878–902. https://doi.org/10.1037/0022-3514.82.6.878
16.
HolzingerA.LettnerS.Steiner-HofbauerV.Capan MelserM. (2020). How to assess? Perceptions and preferences of undergraduate medical students concerning traditional assessment methods. BMC Medical Education, 20(1), 1–7. https://doi.org/10.1186/s12909-020-02239-6
KhannaM. M. (2015). Ungraded pop quizzes: Test-enhanced learning without all the anxiety. Teaching of Psychology, 42(2), 174–178. https://doi.org/10.1177/0098628315573144
LyleK. B.CrawfordN. A. (2011). Retrieving essential material at the end of lectures improves performance on statistics exams. Teaching of Psychology, 38(2), 94–97. https://doi.org/10.1177/0098628311401587
21.
MarshH. W. (1983). Multidimensional ratings of teaching effectiveness by students from different academic settings and their relation to student/course/instructor characteristics. Journal of Educational Psychology, 75(1), 150–166. https://doi.org/10.1037/0022-0663.75.1.150
22.
McDermottK. B.AgarwalP. K.AntonioL. D.RoedigerH. L.McdanielM. A. (2014). Both multiple-choice and short-answer quizzes enhance later exam performance in middle and high school classes. Journal of Experimental Psychology: Applied, 20(1), 3–21. https://doi.org/10.1037/xap0000004
23.
MichaelsJ. L. (2017). Quizzes benefit freshman and sophomore students more than junior and senior students in introductory psychology classes with noncumulative exams. Scholarship of Teaching and Learning in Psychology, 3(4), 272–283. https://doi.org/10.1037/stl0000098
NetoJ.NetoF.FurnhamA. (2022). Predictors of students’ preferences for assessment methods. Assessment and Evaluation in Higher Education, 48(4), 556–565. https://doi.org/10.1080/02602938.2022.2087860
26.
ParkesJ.StefanouC. (2010). Does pragmatism trump motivation in college students’ preferences for examination formats?Learning Environments Research, 13(3), 225–241. https://doi.org/10.1007/s10984-010-9077-4
27.
RiversM. L. (2021). Metacognition about practice testing: A review of learners’ beliefs, monitoring, and control of test-enhanced learning. Educational Psychology Review, 33(3), 823–862. https://doi.org/10.1007/s10648-020-09578-2
28.
ScoullerK. (1998). The influence of assessment method on students’ learning approaches: Multiple choice question examination versus assignment essay. Higher Education, 35(4), 453–472. https://doi.org/10.1023/A:1003196224280
29.
StehleS.SpinathB.KadmonM. (2012). Measuring teaching effectiveness: Correspondence between students’ evaluations of teaching and different measures of student learning. Research in Higher Education, 53(8), 888–904. https://doi.org/10.1007/s11162-012-9260-9
30.
StruyvenK.DochyF.JanssensS. (2005). Students’ perceptions about evaluation and assessment in higher education: A review. Assessment and Evaluation in Higher Education, 30(4), 325–341. https://doi.org/10.1080/02602930500099102
