The Waive of the Future? School Accountability in the Waiver Era

Abstract

Forty-two states and the District of Columbia have recently received waivers to the school accountability requirements of the No Child Left Behind Act (NCLB). As the prospects for reauthorizing the Act in the near term are dim, these new accountability systems will be law for at least several years. Drawing on a four-part framework from the measurement literature, we describe and critique the approved waiver accountability plans, comparing them to the NCLB accountability rules. We find a mixed bag—some states have made large improvements and others have not. Overall we conclude that states missed opportunities to design more effective school accountability systems that might minimize negative unintended consequences of these policies. The article concludes with suggestions for state and federal policy in light of the available literature.

Keywords

accountability policy policy analysis validity/reliability

Get full access to this article

View all access options for this article.

References

Acemoglu

Kremer

Mian

(2008). Incentives in markets, firms, and governments. Journal of Law, Economics, and Organization, 24(2), 273–306. doi: 10.1093/jleo/ewm055

American Education Research Association, American Psychological Association, and National Council on Measurement in Education. (1999). Standards for educational and psychological testing. Washington, DC: Author.

Baker

E. L.

Linn

R. L.

(2004). Validity issues for accountability systems. In Fuhrman

S. H.

Elmore

R. F.

(Eds.), Redesigning accountability (pp. 47–72). New York: Teachers College Press.

Balfanz

Legters

West

T. C.

Weber

L. M.

(2007). Are NCLB’s measures, incentives, and improvement strategies the right ones for the nation’slow-performing high schools? American Educational Research Journal, 44(3), 559–593. doi: 10.3102/0002831207306768

Barlevy

Neal

(2011). Pay for percentile. American Economic Review, 102(5), 1805–1831.

Betebenner

D. W.

(2011). A technical overview of the student growth percentile methodology: Student growth percentiles and percentile growth trajectories/projections. The National Center for the Improvement of Educational Assessment. Retrieved from http://www.nj.gov/education/njsmart/performance/SGP_Technical_Overview.pdf

Booher-Jennings

(2005). Below the bubble: “Educational triage” and the Texas accountability system. American Educational Research Journal, 42(2), 231–268. doi: 10.3102/00028312042002231

Camilli

(2006). Test fairness. In Brennan

R. L.

(Ed.), Educational measurement (4th ed., pp. 221–256). Westport, CT: American Council on Education/Praeger.

Charbonneau

Van Ryzin

G. G

. (2011). Performance measures and parental satisfaction with New York City schools. The American Review of Public Administration, 42(1), 54–65. doi: 10.1177/0275074010397333

10.

Chingos

M. M.

(2012). Strength in numbers: State spending on K-12 assessment systems. Washington, DC: Brown Center on Education Policy, Brookings Institution.

11.

Clotfelter

C. T.

Ladd

H. F.

(1996). Recognizing and rewarding success in public schools. In Ladd

H. F.

(Ed.), Holding schools accountable: Performance-based reform in education (pp. 23–64). Washington, DC: The Brookings Institution.

12.

Crocker

Aligna

(2006). Introduction to classical and modern test theory. Independence, KY: Wadsworth Publishing Company.

13.

Cronbach

L. J.

Meehl

P. E.

(1955). Construct validity in psychological tests. Psychological Bulletin, 52, 281–302.

14.

Davidson

Reback

Rockoff

J. E.

Schwartz

H. L.

(2013). Fifty ways to leave a child behind: Idiosyncrasies and discrepancies in states’ implementation of NCLB (NBER Working Paper No. 18988). Cambridge, MA: National Bureau of Economic Research.

15.

Dee

Jacob

Schwartz

N. L.

(2013). The effects of NCLB on school resources and practices. Educational Evaluation and Policy Analysis, 35(2), 252–279.

16.

Domaleski

Perie

(2013). Promoting equity in state education accountability systems. Dover, NH: National Center for the Improvement of Educational Assessment.

17.

Ehlert

Koedel

Parsons

Podgursky

(2013). Selecting growth measures for school and teacher evaluations (Department of Economics Working Paper Series, WP 12–10). Columbia: University of Missouri.

18.

Figlio

D. N.

Ladd

H. F.

(2007). School accountability and student achievement. In Ladd

H. F.

Fiske

(Eds.), Handbook of research in education finance and policy (pp. 166–182). New York: Routledge.

19.

Figlio

D. N.

Loeb

(2011). School accountability. In Hanushek

E. A.

Machin

S. J.

Woessmann

(Eds.), Handbooks in economics: Economics of education (Vol. 3, pp. 383–421). North-Holland, the Netherlands: Elsevier.

20.

Goldhaber

Hansen

(2012). Is it just a bad class? Assessing the long-term stability of estimated teacher performance. Economica, 80(319), 589–612.

21.

Hanushek

E. A.

Raymond

M. A.

(2005). Does school accountability lead to improved student performance? Journal of Policy Analysis and Management, 24(2), 297–327.

22.

Heck

R. H.

(2006). Assessing school achievement progress: Comparing alternative approaches. Educational Administration Quarterly, 42(5), 667–699.

23.

Hernández

R. A.

(2013). Maintaining a focus on subgroups in an era of Elementary and Secondary Education Act waivers. Washington, DC: Campaign for High School Equity.

24.

A. D.

(2008). The problem with “proficiency”: Limitations of statistics and policy Under No Child Left Behind. Educational Researcher, 37(6), 351–360. doi: 10.3102/0013189x08323842

25.

Holmstrom

Costa

J. R.

(1986). Managerial incentives and capital management. The Quarterly Journal of Economics, 101(4), 835–860.

26.

Jacobsen

Snyder

J. W.

Saultz

(2012). When accountability strategies collide: Do policy changes that raise accountability standards also erode public satisfaction. Educational Policy, 27(2), 360–389.

27.

Kane

T. J.

Staiger

D. O.

(2002). The promise and pitfalls of using imprecise school accountability measures. The Journal of Economic Perspectives, 16(4), 91–114.

28.

Kremer

Sarychev

(2000). Why do governments operate schools (Harvard Working Paper). Cambridge, MA: Harvard University.

29.

Krieg

J. M.

Storer

(2006). How much do students matter? Applying the Oaxaca Decomposition to explain determinants of Adequate Yearly Progress. Contemporary Economic Policy, 24(4), 563–581. doi: 10.1093/cep/byl003

30.

Linn

R. L.

(2000). Assessments and accountability. Educational Researcher, 29(2), 4–16.

31.

Linn

R. L.

(2004). Accountability models. In Fuhrman

S. H.

Elmore

R. F.

(Eds.), Redesigning accountability systems for education (pp. 245–273). New York: Teachers College Press.

32.

Linn

R. L.

Haug

(2002). Stability of school-building accountability scores and gains. Educational Evaluation and Policy Analysis, 24(1), 29–36.

33.

McCaffrey

D. F.

Sass

Lockwood

J. R.

Mihaly

(2009). The intertemporal variability of teacher effect estimates. Education Finance and Policy, 4(4), 572–606.

34.

McEachin

Polikoff

M. S.

(2012). We are the 5%: Which schools would be held accountable under a proposed revision of the Elementary and Secondary Education Act? Educational Researcher, 41(7), 243–251.

35.

McNeil

(August 29, 2012). Virginia and U.S. Ed. Dept. agree to NCLB waiver do over [blog post]. Retrieved from http://blogs.edweek.org/edweek/campaign-k-12/2012/08/_this_is_not_what.html

36.

Milgrom

(1988). Employment contracts, influence activities, and efficient organization design. Journal of Political Economy, 96(1), 42–60.

37.

Milgrom

Roberts

(1988). An economic approach to influence activities in organizations. American Journal of Sociology, 94, S154-S179.

38.

National Center for Education Statistics. (2007). Mapping 2005 state proficiency standards onto the NAEP scales. Washington, DC: Author.

39.

Neal

Schanzenbach

D. W.

(2010). Left behind by design: Proficiency counts and test-based accountability. Review of Economics and Statistics, 92, 263–283.

40.

Polikoff

M. S.

Wrabel

S. L.

(2013). When is 100% not 100%? The use of safe harbor to made Adequate Yearly Progress. Education Finance and Policy, 8(2), 251–270.

41.

Porter

A. C.

Linn

R. L.

Trimble

C. S.

(2005). The effects of state decisions about NCLB adequate yearly progress targets. Educational Measurement: Issues and Practice, 24(4), 32–39.

42.

Prendergast

(1999). The provision of incentives in firms. Journal of Economic Literature, 37(1), 7–63.

43.

Reardon

S. F.

Raudenbush

(2009). Assumptions of value-added models for estimating school effects. Education Finance and Policy, 4(4), 492–519.

44.

Riddle

Kober

(2011). State policy differences greatly impact AYP numbers. Wasington, DC: Center on Education Policy.

45.

Rothstein

Jacobsen

Wilder

(2008). Grading education: Getting accountability right. Washington, DC and New York: Economic Policy Institute and Teachers College Press.

46.

Shapiro

(1983). Premiums for high quality products as returns to reputations. The Quarterly Journal of Economics, 98(4), 659–679.

47.

Sims

D. P.

(2013). Can failure succeed? Using racial subgroup rules to analyze the effect of school accountability failure on student performance. Economics of Education Review, 32, 262–274.

48.

Smith

M. S.

O’Day

J. A.

(1990). Systemic school reform. In Fuhrman

S. H.

Malen

(Eds.), The politics of curriculum and testing (pp. 233–268). New York: Falmer Press.

49.

Stein

J. C.

(1988). Takeover threats and managerial myopia. Journal of Political Economy, 96(1), 61–80.

50.

U.S. Department of Education. (2010). Interim report on the Evaluation of the Growth Model Pilot Project. Retrieved from http://www2.ed.gov/rschstat/eval/disadv/growth-model-pilot/gmpp.pdf

51.

U.S. Department of Education. (2011). Letter from the Education Secretary, September 23, 2011. Retrieved from http://www2.ed.gov/policy/gen/guid/secletter/110923.html

52.

Weiss

M. J.

May

. (2012). A policy analysis of the federal growth model pilot program’s measurs of school performance: The Florida case. Education Finance and Policy, 7(1), 44–73.