With the advent of computer programs that rate essays, English teachers may use computers to help them evaluate and provide feedback on student essays. But how might teachers use the computer-generated ratings? To answer this question, 117 English teachers were surveyed to determine their current essay grading practices and their preferences for receiving and using computer ratings. Middle school and high school English teachers reported spending much of their time grading essays; yet, they provided students with relatively few words of feedback. Almost all of the teachers reported that they would use computer ratings to provide feedback to students. However, many teachers also reported that they would do less marking on student essays that are rated by computer than they do currently. Potential uses of the computer ratings include guiding teacher feedback and focusing peer feedback.
Get full access to this article
View all access options for this article.
References
1.
ElliotS.BurnhamW.ChernoffM.KernK., Computerized Scoring of Open-Ended Bar Examination Questions, paper presented at the Annual Meeting of the American Educational Research Association, Chicago, 1997.
2.
ElliotS.BurnhamW.ChernoffM.KernK., Validation of the Computerized Scoring of Open-Ended Assessments, paper presented at the Annual Meeting of the American Educational Research Association, Chicago, 1997.
3.
FinnP., Computer-Aided Description of Mature Word Choices in Writing, in Evaluating Writing: Describing, Measuring, Judging, CooperC. R.OdellL. (eds.), National Council of Teachers of English, Urbana, Illinois, pp. 69–90, 1977.
4.
PageE. B., The Imminence of Grading Essays by Computer, Phi Delta Kappan, 48, pp. 238–243, 1966.
5.
PageE. B., The Use of Computers in Analyzing Student Essays, International Review of Education, 14, pp. 210–221, 1968.
6.
RoyE., Evaluating Placement Exams with a Structured Decision System, Computers and Composition, 9, pp. 71–86, 1992.
7.
RoyE., Computerized Scoring of Placement Exams: A Validation, Journal of Basic Writing, 12, pp. 41–54, 1993.
8.
SlotnickH., Toward a Theory of Computer Essay Grading, Journal of Educational Measurement, 9, pp. 253–263, 1972.
9.
PageE. B., Computer Grading of Student Prose, Using Modern Concepts and Software, Journal of Experimental Education, 62:2, pp. 127–142, 1994.
10.
PageE. B., The Second Blind Test with ETS: PEG Predicts the Graduate Record Exams, paper presented at an Invited Symposium at the Annual Meeting of the AERA/NCME, Chicago, 1997.
11.
PageE. B.PetersenN. S., The Computer Moves Into Essay Grading: Updating The Ancient Test, Phi Delta Kappan, 76:7, pp. 561–566, 1995.
12.
PageE. B.KeithT. Z.LavoieM. J., Computer Grading of Essay Traits in Student Writing, paper presented at an Invited Symposium at the Annual Meeting of the National Council on Measurements in Education, New York, 1996.
13.
ShermisM. D.MzumaraH. R.OlsonJ.HarringtonS., On-line Grading of Student Essays: PEG Goes on the Web at IUPUI, paper presented at the Annual Meeting of the American Educational Research Association, San Diego, California, 1998.
14.
WreschW., The Imminence of Grading Essays by Computer—25 Years Later, Computers and Composition, 10:2, pp. 45–58, 1993.
15.
KeithT. Z., The Computer, Human Judges, and Construct Validity, paper presented at an Invited Symposium at the Annual Meeting of the American Educational Research Association, San Francisco, 1995.
16.
KeithT. Z., Construct Validity of PEG, paper presented at an Invited Symposium at the Annual Meeting of the American Educational Research Association, San Diego, 1998.
17.
PageE. B.KeithT. Z.LavoieM. J., Construct Validity in the Computer Grading of Essays, paper presented at the Annual Meeting of the American Psychological Association, New York, 1995.
18.
PageE. B.PoggioJ. P.KeithT. Z., Computer Analysis of Student Essays: Finding Trait Differences in the Student Profile, paper presented at an Invited Symposium at the Annual Meeting of the AERA/NCME, Chicago, 1997.
19.
BeachR., The Effects of Between-Draft Teacher Evaluation Versus Student Self-Evaluation on High School Students' Revising of Rough Drafts, Research in the Teaching of English, 13:2, pp. 111–119, 1979.
20.
LynchC.KlemansP., Evaluating Our Evaluations, College English, 40:2, pp. 166–180, 1978.
21.
ZivN. D., The Effect of Teacher Comments on the Writing of Four College Freshman in New Directions In Composition Research, BeachR.BridwellL. S. (eds.), Guilford, New York, pp. 348–380, 1984.
22.
LandR. E.EvansS., What Our Students Taught Us About Paper Marking, English Journal, 76:2, pp. 113–116, 1987.
23.
SommersN., Responding to Student Writing, College Composition and Communication, 32:2, pp. 148–156, 1982.
24.
OlsonM. W.RaffeldP., The Effects of Written Comments on the Quality of Student Compositions and the Learning of Content, Reading Psychology: An International Quarterly, 8, pp. 273–293, 1987.
25.
StraubR., Students' Reactions to Teacher Comments: An Exploratory Study, Research in the Teaching of English, 31:1, pp. 91–119, 1997.
26.
HarrisW. H., Teacher Response to Student Writing: A Study of the Response Patterns of High School English Teachers to Determine the Basis for Teacher Judgment of Student Writing, Research in the Teaching of English, 11:2, pp. 175–185, 1977.
27.
SearleD.DillonD., The Message of Marking: Teacher Written Responses to Student Writing at Intermediate Grade Levels, Research in the Teaching of English, 14:3, pp. 233–242, 1980.
28.
ConnorsR. J.LunsfordA. A., Teachers' Rhetorical Comments on Student Papers, College Composition and Communication, 44:2, pp. 200–223, 1993.
29.
DickinsonP. F., Feedback That Works: Using the Computer to Respond, paper presented at the 4th National Basic Writing Conference, University of Maryland at College Park, 1992.
30.
FlynnE. A., Students as Readers of Their Classmates' Writing: Some Implications for Peer Critiquing, The Writing Instructor, 3:3, pp. 120–128, 1984.
31.
BeasonL., Feedback and Revision in Writing Across the Curriculum Classes, Research in the Teaching of English, 27:4, pp. 395–422, 1993.
32.
YagelskiR. P., The Role of Classroom Context in the Revision Strategies of Student Writers, Research in the Teaching of English, 29:2, pp. 216–238, 1995.
