A computer-based algorithm for simulating human ratings of the Paragraph Completion Method, an open-ended response technique for assessing conceptual level, was assessed. The results indicate that a reasonably reliable, efficient approximation to human ratings may be achieved through the use of a computer. Advantages to computer-based simulation of ratings are reduced costs of training human raters and reduced fluctuations in reliability.
Get full access to this article
View all access options for this article.
References
1.
CampbellD. T.StanleyJ. C.Experimental and quasi-experimental designs. In GageN. L. (Ed.). Handbook of research on teaching. Chicago: Rand McNally, 1963. Pp. 171–246.
2.
HammondK. R.McClellandG. H.MumpowerJ.Human judgment and decision making. New York: Praeger, 1980.
3.
HuntD. E.Matching models in education: The coordination of teaching methods with student characteristics. Toronto, Canada: Ontario Institute for Studies in Education, 1971.
4.
HuntD. E.BPE: A challenge found wanting before it was tried. Review of Research in Education, 1975, 45, 209–230.
5.
HuntD. E.ButlerL. F.NoyJ. E.RosserM. E.Assessing conceptual level by the paragraph completion method. Toronto, Canada: Ontario Institute for Studies in Education, 1978.
