In this commentary, we examine Braverman's insights into the trade-offs between feasibility and rigor in evaluation measures and reject his assessment of the trade-off as a zero-sum game. We, argue that feasibility and policy salience are, like reliability and validity, intrinsic to the definition of a good measure. To reduce the tension between feasibility and measurement rigor, we argue that evaluators should make greater use of existing data, identify ways in which improved measurement will result in improved program management, and “thickly” invest measurement resources in areas where questions are most important and evaluation is most needed.
AlthausF.ParozS.HugliO.GhaliW. A.DaeppenJ. B.Peytremann-BridevauxI.BodenmannP. (2011). Effectiveness of interventions targeting frequent users of emergency departments: A systematic review. Annals of Emergency Medicine, 58, 41–52.
2.
BravermanM. T. (2013) Negotiating Measurement: Methodological and interpersonal considerations in the choice and interpretation of instruments. American Journal of Evaluation, 34, 99–114.
3.
BrysonJ. M.PattonM. Q.BowmanR. A. (2011). Working with evaluation stakeholders. A rationale, step-wise approach and toolkit. Evaluation and Program Planning. 34, 1–12.
4.
ChoH.GlewweP.WhitlerM. (2012). Do reductions in class size raise students’ test scores? Evidence from population variation in Minnesota’s elementary schools. Economics of Education Review, 31, 77–95.
5.
FleischerD. N.ChristieC. A. (2009). Evaluation use: Results from a survey of U.S. American Evaluation Association members. American Journal of Evaluation, 30, 158–175.
6.
HinrichsP. (2011). When the bell tolls: The effects of school starting times on academic achievement. Education Finance and Policy, 6, 486–507.
7.
HouseE. R. (1980). Evaluating with validity. Beverly Hills, CA: Sage.
8.
JohnsonK.GreenseidL. O.ToalS. A.KingJ. A.LawrenzF.VolkovB. (2009). Research on evaluation use: A review of the empirical literature from 1986 to 2005. American Journal of Evaluation, 30, 377–410.
9.
WeissC. H. (1998). Have we learned anything new about the use of evaluation?American Journal of Evaluation, 19, 21–33.
