Pulling Back the Curtain: Revealing the Cumulative Importance of High-Performing,Highly Qualified Teachers on Students’ Educational Outcome

Abstract

This study examines the relationship between two dominant measures of teacher quality, teacher qualification and teacher effectiveness (measured by value-added modeling), in terms of their influence on students’ short-term academic growth and long-term educational success (measured by bachelor’s degree attainment). As students are exposed to teachers of varying quality over the course of their schooling, this study computes cumulative teacher quality indices that are able to more precisely estimate the impact of teacher quality. Notably, this study found that students who had been taught by a succession of high-performing and qualified teachers tend to have a positive relationship with students’ short- and long-term educational success.

Keywords

teacher qualification teacher effectiveness value-added modeling student achievement cumulative teacher quality

Get full access to this article

View all access options for this article.

References

Aaronson

Barrow

Sander

(2007). Teachers and student achievement in the Chicago public high schools. Journal of Labor Economics, 25, 95−135.

Adelman

(2006). The toolbox revisited: Paths to degree completion from high school through college. Washington, DC: U.S. Department of Education. Retrieved from https://files.eric.ed.gov/fulltext/ED490195.pdf

Archer

(1998, February 18). Students’ fortunes rest with assigned teacher. Education Week. Retrieved from https://www.edweek.org/ew/articles/1998/02/18/23dallas.h17.html

Aud

Hussar

Planty

Snyder

Bianco

Fox

M. A.

. . . Drake

(2010). The Condition of Education 2010 (NCES 2010-028). Washington DC: National Center for Education Statistics. Retrieved from https://nces.ed.gov/pubs2010/2010028.pdf

Baker

E. L.

Barton

P. E.

Darling-Hammond

Haertel

Ladd

H. F.

Linn

R. L.

Shepard

(2010). Problems with the use of student test scores to evaluate teachers. Washington, DC: Economic Policy Institute. Retrieved from https://files.eric.ed.gov/fulltext/ED516803.pdf

Betts

J. R.

Shkolnik

J. L.

(2000). The effects of ability grouping on student achievement and resource allocation in secondary schools. Economics of Education Review, 19, 1–15.

Betts

J. R.

Zau

Rice

(2003). Determinants of student achievement: New evidence from San Diego. San Francisco, CA: Public Policy Institutes of California.

Borman

G. D.

Kimball

S. M.

(2005). Teacher quality and educational equality: Do teachers with higher standards-based evaluation ratings close student achievement gaps? The Elementary School Journal, 106, 3–20.

Brophy

Good

T. L.

(1986). Teacher Behavior and Student Achievement. In Wittrock

M. C.

(Ed.), Handbook of research on teaching (pp. 328–375). London, England: Collier Macmillan.

10.

Carlin

B. P.

Louis

T. A.

(2000). Bayes and empirical Bayes methods for data analysis (2nd ed.). Boca Raton, FL: CRC Press.

11.

Chetty

Friedman

J. N.

Hilger

Saez

Schanzenbach

D. W.

Yagan

(2010). How does your kindergarten classroom affect your earnings? Evidence from Project STAR (Working Paper No. 16381). Retrieved from http://www.nber.org/papers/w16381.pdf

12.

Chetty

Friedman

J. N.

Rockoff

J. E.

(2011). The long-term impacts of teachers: Teacher value-added and student outcomes in adulthood (Working Paper No. 17699). Retrieved from http://www.nber.org/papers/w17699.pdf

13.

Chetty

Friedman

J. N.

Rockoff

J. E.

(2013a). Measuring the impacts of teachers I: Evaluating bias in teacher value-added estimates (Working Paper No. 19423). Retrieved from http://www.nber.org/papers/w19423.pdf

14.

Chetty

Friedman

J. N.

Rockoff

J. E.

(2013b). Measuring the impacts of teachers II: Teacher value-added and student outcomes in adulthood (Working Paper No. 19424). Retrieved from http://www.nber.org/papers/w19424.pdf

15.

Chingos

M. M.

Peterson

P. E.

(2011). It’s easier to pick a good teacher than to train one: Familiar and new results on the correlates of teacher effectiveness. Economics of Education Review, 30, 449–465.

16.

Clotfelter

Ladd

H. F.

Vigdor

Wheeler

(2006). High-poverty schools and the distribution of teachers and principals. North Carolina Law Review, 85, 1345–1379.

17.

Clotfelter

C. T.

Ladd

H. F.

Vigdor

J. L.

(2007). Teacher credentials and student achievement: Longitudinal analysis with student fixed effects. Economics of Education Review, 26, 673–682.

18.

Coleman

J. S.

Campbell

E. Q.

Hobson

C. J.

McPartland

Mood

A. M.

Weinfeld

F. D.

York

(1966). Equality of educational opportunity. Washington, DC: U.S. Government Printing Office. Retrieved from https://files.eric.ed.gov/fulltext/ED012275.pdf

19.

Collins

Amrein-Beardsley

(2014). Putting growth and value-added models on the map: A national overview. Teachers College Record, 116(1), 1–32.

20.

Conger

(2005). Within-school segregation in an urban school district. Educational Evaluation and Policy Analysis, 27, 225–244.

21.

Cowan

Goldhaber

(2016). National board certification and teacher effectiveness: Evidence from Washington State. Journal of Research on Educational Effectiveness, 9, 233–258.

22.

Dee

T. S.

Cohodes

S. R.

(2008). Out-of-field teachers and student achievement evidence from matched-Pairs comparisons. Public Finance Review, 36, 7–32.

23.

DiPrete

T. A.

Eirich

G. M.

(2006). Cumulative advantage as a mechanism for inequality: A review of theoretical and empirical developments. Annual Review of Sociology, 32, 271–297.

24.

Dynarski

(2016). Teachers observations have been a waste of time and money. Washington, DC: Brookings Institution. Retrieved from https://www.brookings.edu/research/teacher-observations-have-been-a-waste-of-time-and-money/

25.

Ehrenberg

R. G.

Brewer

D. J.

Gamoran

Willms

J. D.

(2001). Class size and student achievement. Psychological Science in the Public Interest, 2, 1–30.

26.

Feistritzer

C. E.

Griffin

Linnajarvi

(2011). Profile of teachers in the U.S. 2011. Washington, DC: National Center for Education Information. Retrieved from https://www.edweek.org/media/pot2011final-blog.pdf

27.

Gamoran

(2002). Beyond curriculum wars: Content and understanding in mathematics. In Loveless

(Ed.), The great curriculum debate: How should we teach reading and math? (pp. 134–162). Washington, DC: Brookings Institution Press.

28.

George

(2003). Growth in students’ attitudes about the utility of science over the middle and high school years: Evidence from the longitudinal study of American youth. Journal of Science Education and Technology, 12, 439–448.

29.

Goe

(2007). The link between teacher quality and student outcomes: A research synthesis. Washington, DC: National Comprehensive Center for Teacher Quality. Retrieved from https://files.eric.ed.gov/fulltext/ED521219.pdf

30.

Goldhaber

D. D.

(2007). Everyone’s doing it, but what does teacher testing tell us about teacher effectiveness? Journal of Human Resources, 42, 765–794.

31.

Goldhaber

D. D.

Brewer

D. J.

(1996). Evaluating the effect of teacher degree level on educational performance. In Fowler

W. J.

(Ed.), Developments in school finance (pp. 197–210). Washington, DC: National Center for Education Statistics, U.S. Department of Education.

32.

Goldhaber

D. D.

Brewer

D. J.

(1997). Why don’t schools and teachers seem to matter? Assessing the impact of unobservables on educational productivity. Journal of Human Resources, 32, 505–523.

33.

Goldhaber

D. D.

Brewer

D. J.

(2000). Does teacher certification matter? High school teacher certification status and student achievement. Educational Evaluation and Policy Analysis, 22, 129–145.

34.

Goldhaber

D. D.

Quince

Theobald

(2018). Has it always been this way? Tracing the evolution of teacher quality gaps in U.S. public schools. American Educational Research Journal, 55, 171–201.

35.

Goldhaber

D. D.

Walch

Gabele

(2014). Does the model matter? Exploring the relationship between different student achievement-based teacher assessments. Statistics and Public Policy, 1, 28–39.

36.

Graham

J. W.

Hofer

S. M.

Donaldson

S. I.

MacKinnon

D. P.

Schafer

J. L.

(1997). Analysis with missing data in prevention research. In Bryant

K. J.

Windle

West

S. G.

(Eds.), The science of prevention: Methodological advances from alcohol and substance abuse research (pp. 325−366). Washington, DC: American Psychological Association.

37.

Grissmer

D. W.

Flanagan

Kawata

J. H.

Williamson

LaTourrette

(2000). Improving student achievement: What state NAEP test scores tell us. Santa Monica, CA: RAND.

38.

Grissom

J. A.

Kalogrides

Loeb

(2015). Using student test scores to measure principal performance. Educational Evaluation and Policy Analysis, 37, 3–28.

39.

Guarino

C. M.

Maxfield

Reckase

M. D.

Thompson

P. N.

Wooldridge

J. M.

(2015). An evaluation of empirical Bayes’s estimation of value-added teacher performance measures. Journal of Educational and Behavioral Statistics, 40, 190–222.

40.

Hanushek

E. A.

Kain

J. F.

O’Brien

D. M.

Rivkin

S. G.

(2005). The market for teacher quality (Working Paper No. 11154). Retrieved from http://www.nber.org/papers/w11154.pdf

41.

Hanushek

E. A.

Rivkin

S. G.

(2006). Teacher quality. In Hanushek

E. A.

Welch

(Eds.), Handbook of the economics of education (Vol. 2, pp. 1051–1078). Amsterdam, The Netherlands: North Holland.

42.

Harris

D. N.

(2011). Value-added measures in education: What every educator needs to know. Cambridge, MA: Harvard University Press.

43.

Harris

D. N.

Sass

T. R.

(2011). Teacher training, teacher quality and student achievement. Journal of Public Economics, 95, 798–812.

44.

Haycock

(1998). Good teaching matters: How well-qualified teachers can close the gap. Thinking K-16, 3(2), 1–17.

45.

Herrmann

Walsh

Isenberg

Resch

(2013). Shrinkage of value-added estimates and characteristics of students with hard-to-predict achievement levels. Washington, DC: Mathematica Policy Research. Retrieved from https://aefpweb.org/sites/default/files/webform/Herrmann_et_al_2013_Shrinkage_and_Student_Characteristics.pdf

46.

Hong

(2010). The reciprocal relationship between parental involvement and mathematics achievement: Autoregressive cross-lagged modeling. Journal of Experimental Education, 78, 419–439.

47.

Hoxby

(2000). Peer effects in the classroom: Learning from gender and race variation (Working Paper No. 7867). Retrieved from http://www.nber.org/papers/w7867

48.

Ingersoll

R. M.

(2003). Why schools have difficulty staffing their classrooms with qualified teachers? Educational Leadership, 60(8), 30–33.

49.

Jackson

C. K.

(2012). Non-cognitive ability, test scores, and teacher quality: Evidence from 9th grade teachers in North Carolina (Working Paper No. 18624). Retrieved from http://www.nber.org/papers/w18624.pdf

50.

Jacob

B. A.

Lefgren

Sims

(2008). The persistence of teacher-induced learning gains (Working Paper No. 14065). Retrieved from http://www.nber.org/papers/w14065.pdf

51.

Jacob

B. A.

Rockoff

J. E.

Taylor

E. S.

Lindy

Rosen

(2016). Teacher applicant hiring and teacher performance: Evidence from DC public schools (Working Paper No. 22054). Retrieved from http://http://www.nber.org/papers/w22054

52.

Kalogrides

Loeb

(2013). Different teachers, different peers the magnitude of student sorting within schools. Educational Researcher, 42, 304–316.

53.

Kane

M. T.

(2017). Measurement error and bias in value-added models (ETS Research Report Series No. 17–25). Princeton, NJ: Educational Testing Services. Retrieved from https://doi.org/10.1002/ets 2.12153

54.

Kane

T. J.

Cantrell

(2013). Ensuring fair and reliable measures of effective teaching: Culminating findings from the MET Project’s three-year study. Seattle, WA: Bill and Melinda Gates Foundation. Retrieved from https://files.eric.ed.gov/fulltext/ED540958.pdf

55.

Kane

T. J.

Staiger

D. O.

(2008). Estimating teacher impacts on student achievement: An experimental evaluation (Working Paper No. 14607). Retrieved from http://www.nber.org/papers/w14607

56.

Koretz

D. M.

(2008). Measuring up: What educational testing really tells us. Cambridge, MA: Harvard University Press.

57.

Ladd

H. F.

(2008). Teacher effects: What do we know? In Duncan

Spillane

(Eds.), Teacher quality: Broadening and deepening the debate (pp. 3–26). Evanston, IL: Northwestern University. Retrieved from http://www.sesp.northwestern.edu/docs/teacher-quality.pdf

58.

Ladd

H. F.

Sorensen

L. C.

(2015). Do master’s degrees matter? Advanced degrees, career paths, and the effectiveness of teachers. Washington, DC: National Center for Analysis of Longitudinal Data in Education Research. Retrieved from https://caldercenter.org/sites/default/files/WP%20136_0.pdf

59.

Lankford

Loeb

Wyckoff

(2002). Teacher sorting and the plight of urban schools: A descriptive analysis. Educational Evaluation and Policy Analysis, 24, 37–62.

60.

Lee

S. W.

Min

Mamerow

G. P.

(2015). Pygmalion in the classroom and the home: Expectation’s role in the pipeline to STEMM. Teachers College Record, 117(9), 1–40.

61.

Lewis

Parsad

Carey

Bartfai

Farris

Smerdon

(1999). Teacher quality: A report on the preparation and qualifications of public school teachers. Washington, DC: National Centre for Educational Statistics. Retrieved from https://nces.ed.gov/pubs99/1999080.pdf

62.

Little

R. J.

(1988). A test of missing completely at random for multivariate data with missing values. Journal of the American Statistical Association, 83, 1198–1202.

63.

Little

R. J.

Rubin

D. B.

(1989). The analysis of social science data with missing values. Sociological Methods & Research, 18, 292–326.

64.

Long

M. C.

Iatarola

Conger

(2009). Explaining gaps in readiness for college-level math: The role of high school courses. Education Finance and Policy, 4, 1–33.

65.

Lucas

S. R.

Berends

(2002). Sociodemographic diversity, correlated achievement, and de facto tracking. Sociology of Education, 75, 328–348.

66.

(2001). Participation in advanced mathematics: Do expectation and influence of students, peers, teachers, and parents matter? Contemporary Educational Psychology, 26, 132–146.

67.

(2004). Determining the causal ordering between attitude toward mathematics and achievement in mathematics. American Journal of Education, 110, 256–280.

68.

McCaffrey

D. F.

Lockwood

J. R.

Koretz

Louis

T. A.

Hamilton

(2004). Models for value-added modeling of teacher effects. Journal of Educational and Behavioral Statistics, 29, 67–101.

69.

McCaffrey

D. F.

Lockwood

J. R.

Koretz

D. M.

Hamilton

L. S.

(2003). Evaluating value-added models for teacher accountability. Santa Monica, CA: RAND. Retrieved from https://www.rand.org/content/dam/rand/pubs/monographs/2004/RAND_MG158.pdf

70.

McEwan

P. J.

(2003). Peer effects on student achievement: Evidence from Chile. Economics of Education Review, 22, 131–141.

71.

Miller

J. D.

Kimmel

Hoffer

T. B.

Nelson

(2000). Longitudinal study of American youth: User’s manual. Chicago, IL: International Center for the Advancement of Scientific Literacy, Northwestern University.

72.

Miller

Roza

(2012). The sheepskin effect and student achievement: De-emphasizing the role of master’s degrees in teacher compensation. Washington, DC: Center for American Progress. Retrieved from https://files.eric.ed.gov/fulltext/ED535593.pdf

73.

Newton

X. A.

Darling-Hammond

Haertel

Thomas

(2010). Value-added modeling of teacher effectiveness: An exploration of stability across models and contexts. Education Policy Analysis Archives, 18(23), 1–23.

74.

Nye

Konstantopoulos

Hedges

L. V.

(2004). How large are teacher effects? Educational Evaluation and Policy Analysis, 26, 237–257.

75.

Papay

J. P.

(2011). Different tests, different answers the stability of teacher value-added estimates across outcome measures. American Educational Research Journal, 48, 163–193.

76.

Papay

J. P.

Kraft

M. A.

(2015). Productivity returns to experience in the teacher labor market: Methodological challenges and new evidence on long-term career improvement. Journal of Public Economics, 130, 105–119.

77.

Potter

Morris

D. S.

(2017). Family and schooling experiences in racial/ethnic academic achievement gaps: A cumulative perspective. Sociological Perspectives, 60, 132–167.

78.

Potter

Roksa

(2013). Accumulating advantages over time: Family experiences and social class inequality in academic achievement. Social Science Research, 42, 1018–1032.

79.

Rice

J. K.

(2003). Teacher quality: Understanding the effectiveness of teacher attributes. Washington, DC: Economic Policy Institute.

80.

Rivkin

S. G.

Hanushek

E. A.

Kain

J. F.

(2005). Teachers, schools, and academic achievement. Econometrica, 73, 417–458.

81.

Rockoff

J. E.

(2004). The impact of individual teachers on student achievement: Evidence from panel data. American Economic Review, 94, 247–252.

82.

Rothstein

(2009). Student sorting and bias in value-added estimation: Selection on observables and unobservables. Education Finance and Policy, 4, 537–571.

83.

Rothstein

(2017). Measuring the impacts of teachers: Comment. American Economic Review, 107, 1656–1684.

84.

Royston

(2005). Multiple imputation of missing values: Update of ice. Stata Journal, 5, 527–536.

85.

Rubin

D. B.

(1987). Multiple imputation for nonresponse in surveys. New York, NY: John Wiley.

86.

Sanders

W. L.

Rivers

J. C.

(1996). Cumulative and residual effects of teachers on future student academic achievement. Knoxville: University of Tennessee Value-Added Research and Assessment Center. Retrieved from https://www.heartland.org/_template-assets/documents/publications/3048.pdf

87.

Schafer

J. L.

Graham

J. W.

(2002). Missing data: Our view of the state of the art. Psychological Methods, 7, 147–177.

88.

Shettle

Roey

Mordica

Perkins

Nord

Teodorovic

. . . Kastberg

(2007). The nation’s report card: America’s high school graduates (NCES 2007–467). Washington, DC: U.S. Government Printing Office. Retrieved from https://files.eric.ed.gov/fulltext/ED495682.pdf

89.

von Hippel

P. T

. (2007). Regression with missing Ys: An improved strategy for analyzing multiply imputed data. Sociological Methodology, 37, 83–117.

90.

Wang

Wildman

(1996). The relationship between parental influences and student achievement in seventh grade mathematics. School Science and Mathematics, 96, 395–400.

91.

Weisberg

Sexton

Mulhern

Keeling

(2009). The widget effect: Our national failure to acknowledge and act on differences in teacher effectiveness. Brooklyn, NY: New Teacher Project. Retrieved from https://tntp.org/assets/documents/TheWidgetEffect_2nd_ed.pdf

92.

Willson

A. E.

Shuey

K. M.

Elder

G. H.

Jr. (2007). Cumulative advantage processes as mechanisms of inequality in life course health. American Journal of Sociology, 112, 1886–1924.

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.06 MB