Recommendation for English multiple-choice cloze questions based on expected test scores

Abstract

When students study for multiple-choice cloze tests as the Test of English for International Communication (TOEIC), they tend to repeatedly tackle questions of the same type. In such situations, students can effectively solve questions related to their incorrectly answered questions. However, since they need several different kinds of knowledge and a large vocabulary to derive answers, it is inappropriate to statically define the relations among questions from various viewpoints beforehand. In this paper, we propose a recommendation algorithm for English multiple-choice cloze questions that maximize students' expected improvements of test scores based on the learning log data of other students. Effective questions may be identical for most students who incorrectly answered the same questions. Therefore, in our approach, relations among questions in tests and questions studied during tests are determined based on the change from incorrect to the correct answers of the test questions. Questions that maximize the expected test scores, which are calculated based on the input test scores using regression models, are recommended for future students. Based on this method, students can acquire higher test scores with better learning efficiency. Experimental results show that our method yields major improvements in performance compared with random material recommendation method.