If at First You Don't Succeed Setting Passing Scores When More Than One Attempt Is Permitted

Abstract

For licensing and certification examinations designed to protect the public, passing incompetent candidates (false positives) is a more serious error than failing competent ones. Yet to avoid classification mistakes against individuals and subsequent litigation, current practices for these tests increase the relative risk of false positives. These practices are identified, and one that allows positive errors of measurement arising from multiple opportunities to pass the test is discussed in detail. Unsatisfactory ways to mitigate this problem are considered. Increasing the amount of testing or, if that is not feasible, raising the required passing score for repeaters is recommended.