This study examines the strategies used in answering a computerized multiple-choice test where the items have been semantically blocked (all questions on a semantic topic grouped together) or unblocked (semantics randomly distributed throughout the test). Student subjects had almost total control to navigate the test in any way they chose and also to reorder the organization of the multiple-choice items. The strategies were captured using a non-intrusive computer logging mechanism that records the actions of the subjects. Correlation analysis was used to evaluate the strategies that the subjects employed in completing the test. The findings indicate that students grouped by performance on the test used distinctly different strategies in completing the test. It is proposed that the differences are due to distinct cognitive processes between the groups.
Get full access to this article
View all access options for this article.
References
1.
YoonG. S., The Effects of Instructional Control, Cognitive Style, and Prior Knowledge on Learning of Computer-Assisted Instruction, Journal of Educational Technology Systems, 22: 4, pp. 357–370, 1993–94.
2.
SnowR. E., Aptitude, Learner Control, and Adaptive Instruction, Educational Psychologist, 15, pp. 151–158, 1980.
3.
TennysonR. D., Instructional Control Strategies and Content Structure as Design Variables in Concept Acquisition using Computer-Based Instruction, Journal of Educational Psychology, 72: 4, pp. 525–532, 1980.
4.
SteinbergE. R., Review of Student Control in Computer-Assisted Instruction, Journal of Computer-Based Instruction, 3: 3, pp. 84–90, 1977.
5.
GagneR. M., The Conditions of Learning, Holt, Rinehart, and Winston, New York, 1977.
6.
HickenS.SullivanH., and KleinJ., Learner Control Modes and Incentive Variations in Computer-Delivered Instruction, Educational Technology Research and Development, 37: 1, pp. 19–33, 1989.
7.
ReiserR. A., Instructional Technology: A History, in Instructional Technology: Foundations, GagneR. M. (eds.), Erlbaum, Hillsdale, New Jersey, 1987.
8.
ClarianaR. B., The Effects of Item Organization and Feedback Density Using Computer-Assisted Multiple-Choice Questions as Instruction, Journal of Computer-Based Instruction, 20: 1, pp. 26–31, 1993.
9.
ClarianaR. B.RossS. L., and MorrisonG. R., The Effects of Different Feedback Strategies Using Computer-Assisted Multiple-Choice Questions as Instruction, Educational Technology Research and Development, 39: 2, pp. 5–17, 1991.
10.
FisherK.WilliamsS., and RothJ., Qualitative and Quantitative Differences in Learning Associated with Multiple-Choice Testing, Journal of Research in Science Teaching, 18: 5, pp. 449–464, 1981.
11.
FoosP. W. and FisherR. P., Using Tests as Learning Opportunities, Journal of Educational Psychology, 80: 2, pp. 179–183, 1988.
12.
FishM. C. and FeldmanS. C., A Comparison of Reading Comprehension Using Print and Microcomputer Presentation, Journal of Computer-Based Instruction, 14: 2, pp. 57–61, 1987.
13.
EinhornH. J. and HogarthR. M., Behavioral Decision Theory: Processes of Judgment and Choice, Annual Review of Psychology, 32, 1981.
14.
NewellA. and SimonH., Human Problem Solving, Prentice-Hall, Inc., Englewood Cliffs, New Jersey, 1972.
15.
ChiM. T. H. and GlaserR., Problem-Solving Ability, in Human Abilities an Information-Processing Approach, SternbergR. (ed.), W. H. Freeman and Company, New York, 1985.
16.
ToddP. and BenbasatI., Process Tracing Methods in Decision Support Styles Research: Exploring the Black Box, MIS Quarterly, December 1987.
17.
RasmussenJ., Use of Computer Games to Test Experimental Techniques and Cognitive Models, in Proceedings of the Third Symposium on Empirical Foundations of Information and Software Science, October 21–24, 1985, Plenum Press, Roskilde, Denmark, 1987.
18.
HietalaP., Combining Logging, Playback and Verbal Protocols: A Method for Analyzing and Evaluating Interactive Systems, in Proceedings of the Third Symposium on Empirical Foundations of Information and Software Science, October 21–24, 1985, Plenum Press, Roskilde, Denmark, 1987.
19.
YovitsM. C.de KorvinA.KleyleR., and MascarenhasM., Information and Its Relationship to Decision Making: The Information Profile and Other Quantitative Measures; A Brief Summary, Proceedings of the Third Symposium on Empirical Foundations of Information and Software Science, October 21–24, 1985, Plenum Press, Roskilde, Denmark, 1987.
20.
PiagetJ., The Equilibration of Cognitive Structures: The Central Problem of Intellectual Development, BrownT. and ThampyK. J. (trans.), The University of Chicago Press, Chicago, Illinois, 1985.
