The Advanced Placement Computer Science (APCS) Practice System is an instructional assessment device meant to give students practice in, and feedback on, elementary programming tasks. The system includes a programming editor, item pool, two feedback facilities, and electronic portfolio tools. Students write Pascal procedures using the editor, test them with system-generated data, and, for selected problems, can call for a nonsyntactic analysis that produces a partial-credit score and a diagnostic commentary. Results of solution testing and nonsyntactic analysis are recorded by the portfolio tools. This article describes the system's background, instructional model, feedback facilities, and potential uses.
Get full access to this article
View all access options for this article.
References
1.
AndersonJ. R. and ReiserB. J., The LISP Tutor, Byte, 10: 4, pp. 159–175, April 1985.
2.
BonarJ. G. and CunninghamR., BRIDGE: Tutoring the Programming Process, in Intelligent Tutoring Systems: Lessons Learned, PsotkaJ.MasseyL. D., and MutterS. A. (eds.), Lawrence Erlbaum Associates, Hillsdale, New Jersey, pp. 409–434, 1988.
3.
JohnsonW. L., Intention-based Diagnosis of Novice Programming Errors, Morgan Kaufmann Publishers, Los Altos, California, 1986.
4.
JohnsonW. L. and SolowayE., PROUST: An Automatic Debugger for Pascal Programs, Byte, 10: 4, pp. 179–190, 1985.
5.
ReiserB. J.KimbergD. Y.LovettM. C., and RanneyM., Knowledge Representation and Explanation in GIL, An Intelligent Tutor for Programming, in Computer Assisted Instruction and Intelligent Tutoring Systems: Shared Goals and Complementary Approaches, LarkinJ. H. and ChabayR. W. (eds.), Lawrence Erlbaum Associates, Hillsdale, New Jersey, pp. 201–238, 1992.
6.
AndersonJ. R., Analysis of Student Performance with the LISP Tutor, in Diagnostic Monitoring of Skill and Knowledge Acquisition, FrederiksenN.GlaserR.LesgoldA., and ShaftoM. G. (eds.), Lawrence Erlbaum Associates, Hillsdale, New Jersey, 1990.
7.
BennettR. E.GongB.KershawR. C.RockD. A.SolowayE., and MacAladadA., Assessment of an Expert System's Ability to Grade and Diagnose Automatically Student's Constructed Responses to Computer Science Problems, in Artificial Intelligence and the Future of Testing, FreedleR. O. (ed.), Lawrence Erlbaum Associates, Hillsdale, New Jersey, pp. 293–320, 1990.
8.
BennettR. E.RockD. A.BraunH. I.FryeD.SpohrerJ. C., and SolowayE., The Relationship of Expert-system Scored Constrained Free-response Items to Multiple-choice and Open-ended Items, Applied Psychological Measurement, 14, pp. 151–162, 1990.
9.
BraunH. I.BennettR. E.FryeD., and SolowayE., Scoring Constructed Responses using Expert Systems, Journal of Educational Measurement, 27, pp. 93–108, 1990.
10.
BennettR. E.SackW., and SolowayE., A Practice and Feedback System for Advanced Placement Computer Science, (RM-92-9), Educational Testing Service, Princeton, New Jersey, 1992.
11.
SackW. and BennettR. E., Method and System for Interactive Computer Science Testing, Analysis and Feedback, U.S. Patent No. 5259766, November 9, 1993.
12.
BennettR. E., Environments for Presenting and Automatically Scoring Complex Constructed-response Items, in Personnel Selection and Classification, RumseyM. G.WalkerC. B., and HarrisJ. H. (eds.), Lawrence Erlbaum Associates, Hillsdale, New Jersey, pp. 173–192, 1994.
13.
FeuersteinR., The Dynamic Assessment of Retarded Performers; The Learning Potential Assessment Device, Theory Instruments, and Techniques, University Park Press, Baltimore, 1979.
14.
CampioneJ. C. and BrownA. L., Linking Dynamic Assessment with School Achievement, in Dynamic Assessment: An Interactional Approach to Evaluating Learning Potential, LidzC. S. (ed.), The Guilford Press, New York, 1987.
15.
EmbretsonS. E., Toward Development of a Psychometric Approach, in Dynamic Assessment: An Interactional Approach to Evaluating Learning Potential, LidzC. S. (ed.), The Guilford Press, New York, 1987.
