Predictive Validity and Impact of CAEP Standard 3.2: Results From One Master’s-Level Teacher Preparation Program

Abstract

This study investigates the predictive validity and policy impact of Council for Accreditation of Educator Preparation minimum admission requirements in Standard 3.2 on teacher preparation programs (TPPs), their applicants, and the broader field of educator preparation. Undergraduate grade point average (GPA) and Graduate Record Examination (GRE) scores from 533 program graduates in one master’s-level TPP were examined for their ability to predict graduate GPA and the effect minimum admissions criteria had on enrollment. Findings indicate that only undergraduate GPA is moderately related to a program graduate’s success, controlling for student background characteristics. The study also finds that implementing GRE scores as a criterion in admissions decisions significantly reduces the number of admitted candidates so that the program may no longer be financially sustainable. These findings suggest many negative consequences may result from minimum admission requirements and more research is needed to evaluate the potential impact on other TPPs, teacher labor markets, and student learning outcomes.

Keywords

preservice teacher education standards teacher characteristics educational policy quantitative research

Get full access to this article

View all access options for this article.

References

American Educational Research Association Panel on Research and Teacher Education. (2005). Studying teacher education: The report of the AERA panel on research and teacher education ( Cochran-Smith

Zeichner

K. M.

, Eds.). Mahwah, NJ: Lawrence Erlbaum.

American Educational Research Association. (2015). AERA statement on use of value-added models (VAM) for the evaluation of educators and educator preparation programs. Educational Researcher, 44(8), 448-452. doi:10.3102/0013189X15618385

American Federation of Teachers. (2012). Raising the bar: Aligning and elevating teacher preparation and the teaching profession. Washington, DC: Author.

Andrew

M. D.

Cobb

C. D.

Giampietro

P. J.

(2005). Verbal ability and teacher effectiveness. Journal of Teacher Education, 56(4), 343-354. doi:10.1177/0022487105279928

Andrew

M. D.

Lent

E. L.

Moorehead

Moss

D. M.

Singer

M. O.

Woolf

K. H.

(1996). Predicting performance in a teaching internship. Journal of Personnel Evaluation in Education, 10, 271-278.

Barber

Mourshed

(2007). How the world’s best-performing school systems come out on top. Boston, MA: McKinsey.

Bleske-Rechek

Browne

(2014). Trends in GRE scores and graduate enrollments by gender and ethnicity. Intelligence, 46, 25-34. doi:10.1016/j.intell.2014.05.005

Boyd

D. J.

Lankford

Loeb

Rockoff

Wyckoff

(2008). The narrowing gap in New York City teacher qualifications and its implications for student achievement in high-poverty schools. Journal of Policy Analysis and Management, 27(4), 793-818. doi:10.1002/pam.20377

Brabeck

Koch

(2013). Why the new teacher ed. standards matter. Education Week, 33(4), 26-27.

10.

Bridgeman

Burton

Cline

(2009). A note on presenting what predictive validity numbers mean. Applied Measurement in Education, 22(2), 109-119. doi:10.1080/08957340902754577

11.

Casey

C. E.

Childs

R. A.

(2007). Teacher education program admission criteria and what beginning teachers need to know to be successful teachers. Canadian Journal of Educational Administration and Policy, 67, 1-24.

12.

Casey

C. E.

Childs

R. A.

(2011). Teacher education admission criteria as measure of preparedness for teaching. Canadian Journal of Education, 34(2), 3-20.

13.

Caskey

M. M.

Peterson

K. D.

Temple

J. B.

(2001). Complex admission selection procedures for a graduate preservice teacher education program. Teacher Education Quarterly, 28(4), 7-21.

14.

Coble

Crowe

Allen

(2016). CAEP Standard 3.2 research, study and analysis: A report to the Council for the Accreditation of Educator Preparation. Washington, DC: Teacher Preparation Analytics.

15.

Cochran-Smith

Villegas

A. M.

(2015). Framing teacher preparation research: An overview of the field, part 1. Journal of Teacher Education, 66(1), 7-20. doi:10.1177/0022487114549072

16.

College Board. (2015). SAT 2015 college-bound seniors: Total group profile report. Princeton, NJ: Author.

17.

Council for the Accreditation of Educator Preparation. (2013). CAEP accreditation standards. Washington, DC: Author.

18.

Council for the Accreditation of Educator Preparation. (2016). Demonstrating academic achievement: CAEP Board clarifies, refines CAEP Standard 3. Washington, DC: Author. Retrieved from http://caepnet.org/about/news-room/caep-board-clarifies-refines-caep-standa

19.

Darling-Hammond

(2002). Research and rhetoric on teacher certification. Educational Policy Analysis Archives, 10(36). Retrieved from http://dx.doi.org/10.14507/epaa.v10n36.2002

20.

DeLuca

(2012). Selecting inclusive teacher candidates: Validity and reliability issues in admission policy and practice. Teacher Education Quarterly, 39, 7-31.

21.

Educational Testing Service. (2010). GRE guide to the use of scores: 2010-2011. Princeton, NJ: Author. Retrieved from www.ets.org/gre/guide

22.

Educational Testing Service. (2014). GRE guide to the use of scores: 2014–2015. Princeton, NJ: Author. Retrieved from www.ets.org/gre/guide

23.

Ehrenberg

R. G.

Brewer

D. J.

(1995). Did teachers’ verbal ability and race matter in the 1960s? Coleman revisited. Economics of Education Review, 14(1), 1-21.

24.

Feeley

T. H.

Williams

V. M.

Wise

T. J.

(2007). Testing the predictive validity of the GRE exam on communication graduate student success: A case study at University at Buffalo. Communication Quarterly, 53(2), 229-245. doi:10.1080/01463370500090209

25.

Ferguson

R. F.

Ladd

H. F.

(1996). How and why money matters: An analysis of Alabama schools. In Ladd

H. F.

(Ed.), Holding schools accountable: Performance-based reform in education (pp. 265-298). Washington, DC: Brookings Institute.

26.

Freeman

D. J.

Martin

R. J.

Brousseau

B. A.

West

B. B.

(1989). Do higher program admission standards alter profiles of entering teacher candidates? Journal of Teacher Education, 40(3), 33-41.

27.

Gitomer

D. H.

Anderson

S. E.

(2009). Teacher quality in a changing policy landscape: Improvements in the teacher pool (NCES 2008-153). Washington, DC: National Center for Educational Statistics.

28.

Goldhaber

Walch

(2013). Rhetoric versus reality: Is the academic caliber of the teacher workforce changing? (CEDR Working Paper 2013-4). Washington, DC: Center for Education Data & Research.

29.

Greenwald

Hedges

L. V.

Laine

R. D.

(1996). The effect of school resources on student achievement. Review of Educational Research, 66(3), 361-396.

30.

Grossbach

Kuncel

N. R.

(2011). The predictive validity of nursing admission measures for performance on the national council licensure examination: A meta-analysis. Journal of Professional Nursing, 27(2), 124-128. doi:10.1016/j.profnurs.2010.09.010

31.

Hanushek

E. A.

(1971). Teacher characteristics and gains in student achievement: Estimation using micro data. American Economic Review, 61(2), 280-288.

32.

Hennessy

J. J.

Pagnotta

(2015, October). The mismeasurement of teaching: Unintended consequences of using general scholastic aptitude as a determinant of entry and retention in teaching. Paper presented at the annual meeting of the. Northeastern Educational Research Association, Trumbull, CT.

33.

Holmes Group. (1986). Tomorrow’s teachers: A report of the Holmes Group. East Lansing, MI: Author.

34.

Holt

D. T.

Bleckman

C. A.

Zitzmann

C. C.

(2006). The Graduate Record Examination and success in an engineering management program: A case study. Engineering Management Journal, 18(1), 10-16.

35.

House

J. D.

(1983). Effects of restriction of range on predictive validity for the Graduate Record Examination. Psychological Reports, 53(3), 710. doi:10.2466/pr0.1983.53.3.710

36.

House

J. D.

Johnson

J. J.

(2002). Predictive validity of the Graduate Record Examination advanced psychology test for grade performance in graduate psychology courses. College Student Journal, 36(1), 32.

37.

Jewell

R. T.

McPherson

M. A.

Tieslau

M. A.

(2011). Whose fault is it? Assigning blame for grade inflation in higher education. Applied Economics, 45, 1185-1200.

38.

C.-H. C.

(1998). Predictive validity of the Graduate Record Examination in education. Psychological Reports, 82, 899-904.

39.

Katz

J. R.

Chow

Motzer

S. A.

Woods

S. L.

(2009). The Graduate Record Examination: Help or hindrance in nursing graduate school admissions? Journal of Professional Nursing, 25(6), 369-372. doi:10.1016/j.profnurs.2009.04.002

40.

Klieger

D. M.

Cline

F. A.

Holzman

S. L.

Minsky

J. L.

Lorenz

(2014). New perspectives on the validity of the GRE general test for predicting graduate school grades. Princeton, NJ: Educational Testing Service.

41.

Konstantopoulos

(2014). Teacher effects, value-added models, and accountability. Teachers College Record, 116(1), 1-22.

42.

Kosnik

Brown

Beck

(2005). The preservice admissions process: What qualities do future teachers need and how can they be identified in applicants? The New Educator, 1(2), 101-123.

43.

Kuncel

N. R.

Hezlett

S. A.

(2007). Standardized tests predict graduate students’ success. Science, 315(5815), 1080-1081.

44.

Kuncel

N. R.

Hezlett

S. A.

Ones

D. S.

(2001). A comprehensive meta-analysis of the predictive validity of the Graduate Record Examinations: Implications for graduate student selection and performance. Psychological Bulletin, 127(1), 162-181. doi:10.1037//Q033-2909.127.1.162

45.

Kuncel

N. R.

Wee

Serafin

Hezlett

S. A.

(2010). The validity of the Graduate Record Examination for master’s and doctoral programs: A meta-analytic investigation. Educational and Psychological Measurement, 70(2), 340-352. doi:10.1177/0013164409344508

46.

Lankford

Loeb

McEachin

Miller

L. C.

Wyckoff

(2014). Who enters teaching? Encouraging evidence that the status of teaching Is improving. Educational Researcher, 43(9), 444-453. doi:10.3102/0013189X14563600

47.

Levine

(2006). Educating school teachers. Washington, DC: The Education Schools Project.

48.

Messick

(1985). The once and future issues of validity: Assessing the meaning and consequences of measurement. In Wainer

Braun

H. I.

(Eds.), Test validity (pp. 33-45). Hillsdale, NJ: Lawrence Erlbaum.

49.

The National Commission on Excellence in Education. (1983). A nation at risk: The imperative for educational reform. Washington, DC: Author.

50.

National Commission on Teaching and America’s Future. (1996). What matters most: Teaching for America’s future. New York, NY: Author.

51.

National Research Council. (2010). Preparing teachers: Building evidence for sound policy. Washington, DC: The National Academies Press.

52.

Rice-King

(2003). Teacher quality: Understanding effectiveness of teacher attributes. Washington, DC: Economic Policy Institute.

53.

Rivkin

S. G.

Hanushek

E. A.

Kain

J. F.

(2005). Teachers, schools, and academic achievement. Econometrica, 73(2), 417-458.

54.

Sawchuk

(2013). Accrediting body unveils teacher-prep proposal. Education Week, 32(21), 6.

55.

Shepard

L. A.

(1997). The centrality of test use and consequences for test validity. Educational Measurement: Issues and Practice, 16(2), 5-24.

56.

Smith

H. A.

Pratt

(1996). The use of biodata in admissions to teacher education. Journal of Teacher Education, 47(1), 43-52. doi:10.1177/0022487196047001008

57.

U.S. Department of Education. (2011). Preparing and credentialing the nation’s teachers: The Secretary’s eighth report on teacher quality based on data provided for 2008, 2009, 2010. Washington, DC: Author.

58.

U.S. Department of Education. (2013). Preparing and credentialing the nation’s teachers: The secretary’s ninth report on teacher quality. Washington, DC: Author. Retrieved from https://title2.ed.gov/TitleIIReport13.pdf

59.

Wayne

A. J.

Youngs

(2003). Teacher characteristics and student achievement gains: A review. Review of Educational Research, 73(1), 89-122.

60.

Zumwalt

Craig

(2009). Teachers’ characteristics: Research on the indicators of quality. In Cochran-Smith

Zeichner

K. M.

(Eds.), Studying teacher education: The report of the AERA panel on research and teacher education (pp. 157-260). Washington, DC: American Educational Research Association.