Getting at Student Understanding - the Key to Teachers’ Use of Test Data

Abstract

Background/Context

Much has been written about the efficacy of formative assessment. However, relatively little of that research focuses on the design qualities of the assessment instruments themselves that might provide useful information to teachers.

Purpose/Objective/Research Question/Focus of Study

This article decomposes the formative assessment process and reviews the empirical literature on the feedback from an assessment event to the teacher to investigate two research questions. First, what are the design elements of assessments that can enhance their embedded information to help teachers understand how students are thinking about a particular content area? Second, what do teachers need to know to be able to take advantage of more sophisticated assessment designs?

Research Design

The article reviews the literature on test design qualities, focusing on empirical studies that have examined how the qualities of tests inform teachers about student understanding. Overall, 117 articles were synthesized to extract three qualities of test design that enable or constrain their potential to provide insight to teachers about student thinking.

Findings/Results

The literature review identified three crucial test qualities that improve their potential value to teachers. First, tests can convey information about students’ developmental path toward a learning goal. Second, tests can provide information about students’ thought processes. Third, tests can be designed to reveal information about students’ misconceptions within a content area.

Conclusions/Recommendations

The article concludes with a conceptual framework to guide future research on ways to maximize the potential feedback that teachers can receive from assessments. The framework, and hence suggestions for future research, focuses on conducting research on the hypothesized relationships between the qualities of a test itself, the analyses that teachers conduct from the resulting data of student answers, teachers’ instructional responses, and the effect of this process on student learning.