Testing Computer Programming Skills—Paper and Pencil versus a Computer and Compiler

Abstract

Having students write programs is the best method to test students programming ability. Most of the time these tests are administered via paper and pencil whereas the homework is completed using a computer and compiler. So why not use a computer and compiler to administer programming tests? This article describes an experiment done in a Java Programming class where both methods of testing were compared. There was no significant difference in students' scores between the two types of testing, but there was a significant difference in the time it took students to complete the test. It took them much longer to complete the test using a computer and compiler. Students were surveyed and they unanimously preferred the computer and compiler method of testing even though it took them longer to complete the test.