Policy makers have focused on promoting test-based accountability systems as a tool for correcting a wide variety of educational problems, including low standards, weak motivation, poor curriculum and instruction, inadequate learning, and educational equity. This article argues that the appropriateness of testing, or any other form of assessment, as a solution to such problems should be guided by one primary motivation: whether it enables all students to function at the highest possible level in the wider world. This motivation provides a standard for evaluating the effectiveness of assessment policies. The article looks for evidence that test-based accountability systems, when applied to various educational problems, enhance or impede diverse students’ ability to use their minds well. The evidence is, at best, mixed. This article argues for a more balanced use of assessments that can incorporate instructionally timely and useful information about students’ performance and concludes with guidelines and recommendations for appropriate test use.
Get full access to this article
View all access options for this article.
References
1.
American Educational Research Association, American Psychological Association, & National Council on Measurement in Education. (1999). Standards for educational and psychological testing. Washington, DC: American Educational Research Association.
2.
Amrein, A. L., & Berliner, D. C. (2002). High-stakes testing, uncertainty, and student learning. Education Policy Analysis Archives, 10(18). Retrieved from http://epaa.asu.edu/epaa/v10n18/
3.
Banks, J. A. (1994a). Multicultural education: An introduction. Needham Heights, MA: Allyn& Bacon.
4.
Banks, J. A. (1994b). Multiethnic education: Theory and practice(3rd ed.). Needham Heights, MA: Allyn & Bacon.
5.
Banks, J. A. (2001). Multicultural education: Historical development, dimensions, and practice. In J. A. Banks & C. A. M. Banks (Eds.), Handbook of research on multicultural education (pp. 3-24). San Francisco: Jossey-Bass.
6.
Baron, R., Tom, D., & Cooper, M. (1985). Social class, race, and teacher expectations. In J. B. Dusek (Ed.), Teacher expectancies(pp. 251-269). Hillsdale, NJ: Lawrence Erlbaum.
7.
Bishop, J., & Mane, F. (2001). The impacts of minimum competency exam graduation equirements on college attendance and early labor market success of disadvantaged students. In G. Orfield & M. L. Kornhaber (Eds.), Raising standards or raising barriers? Inequality and high-stakes testing in public education(pp. 51-84). New York: Century Foundation.
8.
Black, P., & Wiliam, D. (1998). Inside the black box: Raising standards through classroom assessment. Phi Delta Kappan, 80(2), 139-148.
9.
Blank, R. K., Porter, A., & Smithson, J. (2001). New tools for analyzing teaching, curriculum and standards in mathematics& science: Results from the survey of enacted curriculum project. Washington, DC: Council of Chief State School Officers.
Callahan, R. E. (1962). Education and the cult of efficiency. Chicago: University of Chicago Press.
12.
Chase, W. G., & Simon, H. A. (1973). The mind’s eye in chess. InW. G. Chase (Ed.), Visual information processing(pp. 215-281). New York: Academic Press.
13.
Chi, M. T. H., Glaser, R., & Farr, M. J. (Eds.). (1988). The nature of expertise. Hillsdale, NJ: Lawrence Erlbaum.
14.
Cizek, G. (1998). Putting standardized tests to the test. Fordham Report, 2(11), 1-51.
15.
Cook, P. J., & Ludwig, J. (1998). The burden of “acting White”: Do Black adolescents disparage academic achievement? In C. Jencks & M. Phillips (Eds.), The Black-White test score gap (pp. 375-400). Washington, DC: Brookings Institution.
16.
Council of Chief State School Officers. (2002). Annual survey of state student assessment programs: Summary report, fall 2002. Washington, DC: Author.
17.
Cross, W. E. (1995). Oppositional identity and African-American youth: Issues and prospects. In W. D. Hawley& A. W. Jackson (Eds.), Toward a common destiny: Improving race and ethnic relations in America(pp. 185-204). San Francisco: Jossey-Bass.
18.
Darling-Hammond, L. (2001). Inequality and access to knowledge. In J. A. Banks & C. A. M. Banks (Eds.), Handbook of research on multicultural education(pp. 465-483). San Francisco: Jossey-Bass.
19.
Darling-Hammond, L., Ancess, J., & Falk, B. (2001). Authentic assessment in action: Studies of schools and students at work. New York: Teachers College Press.
20.
Darling-Hammond, L., & Sykes, G. (2003). Wanted: Anational teacher supply policy for education: The right way to meet the “Highly Qualified Teacher” challenge. Education Policy Analysis Archives, 11(33). Retrieved from http://epaa.asu.edu/epaa/v11n33/
21.
Debra P. v. Turlington, 474 F. Supp. 244 (M.D. Fla. 1979).
22.
Delpit, L. (1995). Other people’s children. New York: New Press.
23.
Dorn, S. (1998). The political legacy of school accountability systems. Education Policy Analysis Archives, 6(1). Available from http://epaa.asu.edu/epaa/v6n1.html
24.
Eisner, E. W. (1999). The uses and limits of performance assessment. Phi Delta Kappan, 80(9), 658-660.
Elmore, R. F., Fuhrman, S., & Abelmann, C. H. (1996). The new accountability in state education reform: From process to performance. In H. Ladd (Ed.), Holding schools accountable: Performance-based reform in education. Washington, DC: Brookings Institution.
27.
Elmore, R. F., & Rothman, R. (Eds.). (1998). Testing, teaching, and learning: A guide for states and school districts. Washington, DC: National Academy Press, National Research Council Committee on Title I Testing and Assessment.
28.
Ferguson, R. (1998). Teachers’perceptions and expectations and the Black-White test score gap. In C. Jencks& M. Phillips (Eds.), The Black-White test score gap(pp. 318-374). Washington, DC: Brookings Institution.
29.
Ferguson, R. (2002). What doesn’t meet the eye: Understanding and addressing racial disparities in high-achieving suburban schools. Retrieved December 20, 2002, from http://www.ncrel.org/gap/ferg/
30.
Finn, J., Gerber, S., Achilles, C. M., & Boyd-Zaharias, J. (2001). The enduring effects of small classes. Teachers College Record, 103(2), 145-183.
31.
Firestone, W. A., Camilli, D., Yurecko, M., Monfils, L., & Mayrowetz, D. (2000). State standards, socio-fiscal context and opportunity to learn in New Jersey. Education Policy Analysis Archives, 8(35). Retrieved from http://epaa.asu.edu/epaav8n35/
32.
Fordham, S., & Ogbu, J. (1986). Black students’school success: Coping with the burden of “ acting White.” Urban Review, 18(3), 176-206.
33.
Gardner, H. (1992). The unschooled mind: How children think and how schools should teach. New York: Basic Books.
34.
Gardner, H. (1999). The disciplined mind. New York: Basic Books.
35.
Garrison, L. (1989). Programming for the gifted American Indian student. In C. J. Maker & S. Schiever (Eds.), Critical issues in gifted education: Defensible programs for cultural and ethnic minorities(pp. 116-127). Austin, TX: Pro-Ed.
Gong, B., & Hill, R. (2001, March). Some consideration of multiple measures in assessment and school accountability. Paper presented at the seminar Using Multiple Measures and Indicators to Judge Schools’ Adequate Yearly Progress under Title I, Washington, D.C.
41.
Grissmer, D. W., Flanagan, A., Kawata, J., & Williamson, S. (2000). Improving student achievement: What state NAEP scores tell us. Santa Monica, CA: RAND.
42.
Haertel, E. (1999). Performance assessment and education reform. Phi Delta Kappan, 80(9), 662-666.
43.
Hambleton, R. K., Brennan, R. L., Brown, W., Dodd, B., Forsyth, R. A., Mehrens, W. A., et al. (2000). A response to “setting reasonable and useful performance standards” in the National Academy of Sciences’ “Grading the Nation’s Report Card.” Educational Measurement: Issues and Practice, 19(2), 5-14.
44.
Haney, W. (2000). The myth of the Texas miracle in education. Education Analysis and Policy Archives, 8(41). Retrieved from http://epaa.asu.edu/epaa/v8n41/
45.
Haney, W. (2001, January). Revisiting the myth of the Texas miracle in education: Lessons about dropout research and dropout prevention. Initial estimates using the common core of data. Paper presented at the Conference on Dropouts in America, Harvard Graduate School of Education, Cambridge, MA.
46.
Haney, W. (2002). Lake Woebeguaranteed: Misuse of test scores in Massachusetts, Part I. Education Policy Analysis Archives, 10(24). Retrieved from http://epaa.asu.edu/epaa/v10n24/
47.
Hauser, R. (2001). Should we end social promotion? Truth and consequences. In G. Orfield & M. L. Kornhaber (Eds.), Raising standards or raising barriers? Inequality and high-stakes testing in public education(pp. 151-178). New York: Century Foundation.
48.
Heubert, J. P., & Hauser, R. M. (Eds.). (1999). High stakes: Testing for tracking, promotion, and graduation. Washington, DC: National Academy Press, National Research Council, Committee on Appropriate Test Use.
49.
Hillocks, G. (2002). The testing trap: How state writing assessments control learning. New York: Teachers College Press.
50.
Holmes, C. T. (1989). Grade level retention effects: A meta-analysis of research studies. In L. Shepard & M. L. Smith (Eds.), Flunking grades: Research and policies on retention (pp. 16-33). London: Falmer.
51.
Howard, J., & Hammond, R. (1985). Rumors of inferiority: The hidden obstacles to Black success. The New Republic, 3686, 17-21.
52.
Jencks, C., & Phillips, M. (1998). The Black-White test score gap: An introduction. In C. Jencks & M. Phillips (Eds.), The Black-White test score gap(pp. 1-51). Washington, DC: Brookings Institution.
53.
Kane, T., & Staiger, D. O. (2002). Volatility in school test scores: Implications for test-based accountability systems. Education Next. Available from http://www.educationnext.org/20021/56.html
54.
Klein, S. P, Hamilton, L. S., McCaffrey, D. F., & Stecher, B. M. (2000). What do test scores in Texas tell us?Santa Monica, CA: RAND.
55.
Koretz, D., & Barron, S. (1998). The validity of gains in scores on the Kentucky instructional results information system (KIRIS).Santa Monica, CA: RAND.
56.
Koretz, D., Klein, S., McCaffrey, D., & Stecher, D. (1994). Can portfolios assess student performance and influence instruction?Santa Monica, CA: RAND.
57.
Kornhaber, M. L. (in press). Standards, assessment, and equity. In J. Banks & C. A. M. Banks (Eds.), Handbook of multicultural education. San Francisco: Jossey-Bass.
58.
Kornhaber, M. L., & Orfield, G. (2001). High-stakes testing policies: Examining their assumptions and consequences. In G. Orfield & M. L. Kornhaber (Eds.), Raising standards or raising barriers? Inequality and high-stakes testing in public education(pp. 1-18). New York: Century Foundation.
59.
Ladson-Billings, G. (2001a). Multicultural teacher education: Research, practice, and policy. In J. A. Banks & C. A. M. Banks (Eds.), Handbook of research on multicultural education (pp. 747-759). San Francisco: Jossey-Bass.
60.
Ladson-Billings, G. (2001b). Crossing over to Canaan: The journey of new teachers in diverse classrooms. San Francisco: Jossey-Bass.
61.
Levin, H. M. (2001). High-stakes testing and economic productivity. In G. Orfield & M. L. Kornhaber (Eds.), Raising standards or raising barriers? Inequality and high-stakes testing in public education(pp. 39-49). New York: Century Foundation.
62.
Lewin, T., & Medina, J. (2003, July 31). To cut failure rate, schools shed students. The New York Times, p. A1.
63.
Linn, R. L. (2000). Assessments and accountability. Educational Researcher, 29(2), 4-16.
64.
Linn, R. L., Baker, E. L., & Betebenner, D. W. (2002). Accountability systems: Implications of requirements of the No Child Left Behind Act of 2001. Educational Researcher, 31(6), 3-16.
65.
Madaus, G., & Clarke, M. (2001). The adverse impact of high-stakes testing on minority students: Evidence from one hundred years of test data. In G. Orfield & M. Kornhaber (Eds.), Raising standards or raising barriers? Inequality and high-stakes testing in public education (pp. 85-106). New York: Century Foundation.
McDonnell, L. M., McLaughlin, M. J., & Morison, P. (Eds.). (1997). Educating one and all: Students with disabilities and standards-based reform. Washington, DC: National Academy Press, National Research Council, Committee on Goals 2000 and the Inclusion of Students with Disabilities.
68.
McNeil, L. (2000). Contradictions of school reform: Educational costs of standardized testing. New York: Routledge Kegan Paul.
69.
McNeil, L., & Valenzuela, A. (2001). The harmful impact of the TAAS system of testing in Texas: Beneath the accountability rhetoric. In G. Orfield & M. L. Kornhaber (Eds.), Raising standards or raising barriers? Inequality and high-stakes testing in public education (pp. 127-150). New York: Century Foundation.
70.
Meier, D. (2000). Educating a democracy. In J. Cohen & J. Rogers (Eds.), Will standards save public education?(pp. 3-31). Boston: Beacon.
71.
Mickelson, R. A. (1990). The attitude-achievement paradox among Black adolescents. Sociology of Education, 63(1), 44-61.
72.
Miller, G. (1956). The magical number seven: Some limits on our capacity for processing information. The Psychological Review, 63, 81-97.
73.
Moore, D. (2000). Chicago’s grade retention program fails to help retained students. Chicago: Designs for Change.
74.
Moore, D., & Hanson, M. (2001). School system leaders propose ineffective strategies contradicted by results and research. Chicago: Designs for Change.
75.
Murnane, R. (2000). The case for standards. In J. Cohen& J. Rogers (Eds.), Will standards save public education?(pp. 57-63). Boston: Beacon.
National Commission on Excellence in Education. (1983). A nation at risk: The imperative for education reform. Washington, DC: Government Printing Office.
Natriello, G., & Pallas, A. (2001). The development and impact of high-stakes testing. In G. Orfield & M. L. Kornhaber (Eds.), Raising standards or raising barriers? Inequality and high-stakes testing in public education(pp. 19-38). New York: Century Foundation.
81.
Neill, M. (with Gayler, K.). (2001). Do high-stakes graduation tests improve learning outcomes? Using state-level NAEP data to evaluate the effects of mandatory graduation tests. In G. Orfield & M. L. Kornhaber (Eds.), Raising standards or raising barriers? Inequality and high-stakes testing in public education(pp. 107-125). New York: Century Foundation.
Ogbu, J. U. (1978). Minority education and caste: The American system in cross-cultural comparison. New York: Academic Press.
84.
Ogbu, J. U. (1991). Immigrant and involuntary minorities in comparative perspective. In M. A. Gibson & J. U. Ogbu (Eds.), Minority status and schooling: A comparative study of immigrant and involuntary minorities(pp. 3-33). New York: Garland.
85.
Orfield, G. (Ed.). (1993). Separate and unequal in the metropolis: The changing shape of the school desegregation battle. Washington, DC: Brookings Institution.
Orfield, G., & Kornhaber, M. L. (Eds.). (2001). Raising standards or raising barriers? Inequality and high-stakes testing in public education. New York: Century Foundation.
Pellegrino, J. W., Chudowsky, N., & Glaser, R. (2002). Knowing what students know: The science and design of educational assessment. Washington, DC: National Academy Press.
91.
Perkins, D. N., & Salomon, G. (1988). Are cognitive skills context-bound? Educational Researcher, 18(1), 16-25.
Salomon, G., & Perkins, D. N. (1989). Rocky roads to transfer: Rethinking mechanisms of a neglected phenomenon. Educational Psychologist, 24(2), 113-142.
98.
Schemo, D. J. (2003, July 26). Education secretary defends school system he once led. The New York Times, p. A9.
99.
Simmons, W., & Resnick, L. (1993). Assessment as the catalyst of school reform. Educational Leadership, February, 11-15.
100.
Sizer, T. (1984). Horace’s compromise. Boston: Houghton Mifflin.
101.
Skrla, L., Scheurich, J. J., & Johnson, J.F. (2000). Equity-driven achievement-focused school districts: A report on systemic school success in four Texas school districts serving diverse student populations. Austin: University of Texas at Austin, The Charles A. Dana Center.
102.
Spalding, E. (2000). Performance assessment and the newstandards project: Astory of serendipitous success. Phi Delta Kappan, 81(10), 758-764.
103.
Spencer, M. B., Noll, E., Stoltzfus, J., & Harpalani, V. (2001). Identity and school adjustment: Revisiting the “acting White” assumption. Educational Psychologist, 36(1), 21-30.
104.
Stotsky, S. (2000). What’s at stake in the K-12 standards war. New York: Peter Lang.
105.
Taylor, W. (2000, November 15). Standards, tests, and civil rights. Education Week, 20(11), 56, 40-41.
106.
Tyack, D. (1974). The one best system. Cambridge, MA: Harvard University Press.
107.
Valenzuela, A. (1999). Subtractive schooling: U.S.–Mexican youth and the politics of caring. Albany: State University of New York Press.
108.
Viadero, D. (1994, July 13). Teaching to the test. Education Week, XIII(39), 21-25.
109.
Wiggins, G. (1998). Educative assessment: Designing assessments to inform and improve student performance. San Francisco: Jossey-Bass.
110.
Winerip, M. (2003a, June 4). In the affluent suburbs, an invisible race gap. The New York Times, p. B8.
111.
Winerip, M. (2003b, June 18). On education: Moving quickly through history. The New York Times, p. B10.
112.
Zessoules, R., & Gardner, H. (1991). Authentic assessment: Beyond the buzzword and into the classroom. InV. Perrone (Ed.), Assessment in schools(pp. 47-71). Washington, DC: Association for Supervision and Curriculum Development.
