We evaluate the predictive validity of the Massachusetts Candidate Assessment of Performance (CAP), a practice-based assessment of teaching skills that is now a requirement for teacher preparation program completion in Massachusetts. We find that candidates’ performance on the CAP significantly predicts their in-service summative performance evaluations in their first 2 years in the teaching workforce, but it is not predictive of their value added to student test scores in these years. These findings suggest that the CAP captures aspects of candidates’ skills and competencies that are better reflected in their future performance evaluations than by their impacts on student performance.
Bacher-HicksA.ChinM. J.KaneT. J.StaigerD. O. (2019). An experimental evaluation of three teacher quality measures: Value-added, classroom observations, and student surveys. Economics of Education Review, 73, 101919. https://doi.org/10.1016/j.econedurev.2019.101919
2.
BartanenB.KwokA. (2021). Examining clinical teaching observation scores as a measure of preservice teacher quality. American Educational Research Journal, 58(5), 887–920. https://doi.org/10.3102/0002831221990359
3.
BastianK. C.HenryG. T.PanY.LysD. (2016). Teacher candidate performance assessments: Local scoring and implications for teacher preparation program improvement. Teaching and Teacher Education, 59, 1–12.
4.
BastianK. C.LysD.PanY. (2018). A framework for improvement: Analyzing performance-assessment scores for evidence-based teacher preparation program reforms. Journal of Teacher Education, 69(5), 448–462.
5.
BoydD. J.GrossmanP. L.LankfordH.LoebS.WyckoffJ. (2009). Teacher preparation and student achievement. Educational Evaluation and Policy Analysis, 31(4), 416–440.
6.
CampbellS. L.RonfeldtM. (2018). Observational evaluation of teachers: Measuring more than we bargained for?American Educational Research Journal, 55(6), 1233–1267. https://eric.ed.gov/?id=EJ1196784
7.
CantrellS.FullertonJ.KaneT. J.StaigerD. O. (2008). National Board certification and teacher effectiveness: Evidence from a random assignment experiment. National Bureau of Economic Research.
8.
ChettyR.FriedmanJ. N.RockoffJ. E. (2014). Measuring the impacts of teachers. I: Evaluating bias in teacher value-added estimates. American Economic Review, 104(9), 2593–2632.
9.
ClotfelterC. T.LaddH. F.VigdorJ. L. (2007). Teacher credentials and student achievement: Longitudinal analysis with student fixed effects. Economics of Education Review, 26(6), 673–682.
10.
CowanJ.GoldhaberD. (2016). National Board certification and teacher effectiveness: Evidence from Washington State. Journal of Research on Educational Effectiveness, 9(3), 233–258.
11.
CowanJ.GoldhaberD.JinZ.TheobaldR. (2020). Teacher licensure tests: Barrier or predictive tool? (CALDER Working Paper No. 245-1020). National Center for Analysis of Longitudinal Data in Education Research.
12.
CowanJ.GoldhaberD.TheobaldR. (2018). An exploration of sources of variation in teacher evaluation ratings across classrooms, schools, and districts (CALDER Working Paper 197-0618-1). National Center for Analysis of Longitudinal Data in Education Research.
13.
Darling-HammondL.NewtonS. P.Chung WeiR. (2013). Developing and assessing beginning teacher effectiveness: The potential of performance assessments. Educational Assessment, Evaluation and Accountability, 25(3), 179–204.
14.
GillB.ShojiM.CoenT.PlaceK. (2016). The content, predictive power, and potential bias in five widely used teacher observation instruments (No. REL 2017–191). U.S. Department of Education, Institute of Education Sciences, National Center for Education Evaluation and Regional Assistance, Regional Educational Laboratory Mid-Atlantic.
15.
GoldhaberD. (2007). Everyone’s doing it, but what does teacher testing tell us about teacher effectiveness?Journal of Human Resources, 42(4), 765–794.
16.
GoldhaberD.CowanJ.TheobaldR. (2017a). Evaluating prospective teachers: Testing the predictive validity of the edTPA. Journal of Teacher Education, 68(4), 377–393.
17.
GoldhaberD.GratzT.TheobaldR. (2017b). What’s in a teacher test? Assessing the relationship between teacher licensure test scores and student secondary STEM achievement and course taking. Economics of Education Review, 61, 112–129.
18.
GoldhaberD.KriegJ.TheobaldR. (2014). Knocking on the door to the teaching profession? Modeling the entry of prospective teachers into the workforce. Economics of Education Review, 43, 106–124.
19.
GoldhaberD.KriegJ. M.TheobaldR. (2017c). Does the match matter? Exploring whether student teaching experiences affect teacher effectiveness. American Educational Research Journal, 54(2), 325–359.
20.
GrissomJ. A.LoebS. (2017). Assessing principals’ assessments: Subjective evaluations of teacher effectiveness in low- and high-stakes environments. Education Finance and Policy, 12(3), 369–395.
21.
HarrisD. N.IngleW. K.RutledgeS. A. (2014). How teacher evaluation methods matter for accountability: A comparative analysis of teacher effectiveness ratings by principals and teacher value-added. American Educational Research Journal, 51(1), 73–112.
22.
HendricksM. D. (2014). Public schools are hemorrhaging talented teachers. Can higher salaries function as a tourniquet?Association for Education Finance and Policy.
23.
HoA. D.KaneT. J. (2013). The reliability of classroom observations by school personnel (Measures of Effective Teaching Project). Bill & Melinda Gates Foundation.
24.
HuttE. L.GottliebJ.CohenJ. J. (2018). Diffusion in a vacuum: edTPA, legitimacy, and the rhetoric of teacher professionalization. Teaching and Teacher Education: An International Journal of Research and Studies, 69(1), 52–61.
25.
KraftM. A.GilmourA. F. (2017). Revisiting the widget effect: Teacher evaluation reforms and the distribution of teacher effectiveness. Educational Researcher, 46(5), 234–249.
26.
KraftM. A.PapayJ. P.ChiO. L. (2020). Teacher skill development: Evidence from performance ratings by principals. Journal of Policy Analysis and Management, 39(2), 315–347.
27.
LeisingD.ErbsJ.FritzU. (2010). The letter of recommendation effect in informant ratings of personality. Journal of Personality and Social Psychology, 98(4), 668–682.
28.
Massachusetts Department of Elementary and Secondary Education. (2016). Guidelines for the Candidate Assessment of Performance: Assessment of teacher candidates. http://www.doe.mass.edu/edprep/cap/guidelines.html
29.
PecheoneR.ShearB.WhittakerA.Darling-HammondL. (2013). 2013 edTPA field test: Summary report. Stanford Center for Assessment, Learning, and Equity.
30.
RockoffJ. E.LockwoodB. B. (2010). Stuck in the middle: Impacts of grade configuration in public schools. Journal of public economics, 94(11–12), 1051–1061.
31.
RonfeldtM. (2012). Where should student teachers learn to teach? Effects of field placement school characteristics on teacher retention and effectiveness. Educational Evaluation and Policy Analysis, 34(1), 3–26.
32.
SteinbergM. P.GarrettR. (2016). Classroom composition and measured teacher performance: What do teacher observation scores really measure?Educational Evaluation and Policy Analysis, 38(2), 293–317.
33.
WhitehurstG. J. R.ChingosM. M.LindquistK. M. (2014). Evaluating teachers with classroom observations. Brown Center on Education Policy, Brookings Institution.
34.
WilsonM.HallamP. J.PecheoneR.MossP. (2010). Using student achievement test scores as evidence of external validity for indicators of teacher quality: Connecticut’s beginning educator support and training program. Stanford Center for Opportunity Policy in Education.
