Equipping Preservice Teachers for Data Use: A Study of Secondary Educator Preparation Programs in Virginia

Abstract

Because data-informed decision-making (DIDM) can help teachers meet diverse learners’ needs (van Geel et al., 2016), educator preparation programs (EPPs) must ensure that preservice teachers (PSTs) develop the data literacy skills needed for effective data use. However, little is known about the ways in which EPPs work towards building PSTs’ data literacy, despite licensure and accreditation requirements compelling EPPs to do so. In this study, we analyzed survey, document, and interview data from Virginia EPPs to determine what present practices for DIDM preparation are taking place across the state. Results point to a lack of uniformity among EPPs for how preparation is undertaken, and that PSTS seem to have limited coursework on data use. Additionally, there appears to be minimal collaboration between EPPs and clinical partners, such that PSTs infrequently have opportunities to engage in DIDM during field experiences.

Keywords

Data use secondary teacher preparation teacher education instructional decision-making data informed decision-making

Get full access to this article

View all access options for this article.

References

Beck

J. S.

Nunnaley

(2021). A continuum of data literacy for teaching. Studies in Educational Evaluation, 69, 1–34. https://doi.org/10.1016/j.stueduc.2020.100871

Bitsch

(2005). Qualitiative research: A grounded theory example and evaluation criteria. Journal of Agribusiness, 23(1), 75–91.

Boeije

(2002). A purposeful approach to the constant comparative method in the analysis of qualitative interviews. Quality & Quantity, 36, 391–409.

Bolhuis

Voogt

Schildkamp

(2019). The development of data use, data skills, and positive attitude towards data use in a data team intervention for teacher educators. Studies in Educational Evaluation, 60, 99–108. https://doi.org/10.1016/j.stueduc.2018.12.002

Carlson

Borman

Robinson

(2011). A multistate district-level cluster randomized trial of the impact of data-driven reform on reading and mathematics achievement. Educational Evaluation and Policy Analysis, 33(3), 378–398. https://dx.doi.org/10.3102/0162373711412765

Charmaz

(2006). Constructing grounded theory: A practical guide through qualitiative analysis. Sage Publications.

Chick

Pierce

(2013). The statistical literacy needed to interpret school assessment data. Mathematics Teacher Education and Development, 15(2), 5–26.

Coburn

C. E.

Turner

E. O.

(2011). Research on data use: A framework and analysis. Measurement Interdisciplinary Research and Perspectives, 9(4), 173–206. https://doi.org/10.1080/15366367.2011.626729

Conn

C. A.

Bohan

K. J.

Bies-Hernandez

N. J.

Powell

P. J.

Sweeny

S. P.

Persinger

L. L.

Persinger

J. D.

(2022). Expected data literacy knowledge and skills for early career teachers: Perspectives from school and district personnel. Teaching and Teacher Education, 111, 103607. https://doi.org/10.1016/j.tate.2021.103607

10.

Connelly

L. M.

(2016). Trustworthiness in qualitative research. Medsurg Nursing, 25(6), 435–436

11.

Council of Chief State School Officers. (2013). InTASC model core teaching standards and learning progressions for teachers 1.0: A resource for ongoing teacher development. https://ccsso.org/resource-library/intasc-model-core-teaching-standards-and-learning-progressions-teachers-10

12.

Cowie

Cooper

(2017). Exploring the challenge of developing student teacher data literacy. Assessment in Education: Principles, Policy & Practice, 24(2), 147–163. https://doi.org/10.1080/0969594X.2016.1225668

13.

Datnow

Park

(2018). Opening or closing doors for students? Equity and data use in schools. Journal of Educational Change, 19(2), 131–152. https://doi.org/10.1007/s10833-018-9323-6

14.

DeLuca

Bellara

(2013). The current state of assessment education: Aligning policy, standards, and teacher education curriculum. Journal of Teacher Education, 64(4), 356–372. http://dx.doi.org/10.1177/002248711348814

15.

DeLuca

Klinger

D. A.

(2010). Assessment literacy development: Identifying gaps in teacher candidates’ learning. Assessment in Education: Principles, Policy & Practice 17(4), 419–438. https://doi.org/10.1080/0969594x.2010.516643

16.

Dodman

S. L.

Swalwell

DeMulder

E. K.

View

J. L.

Stribling

S. M.

(2021). Critical data-driven decision-making: A conceptual model of data use for equity. Teaching and Teacher Education, 99, 103272. https://doi.org/10.1016/j.tate.2020.103272

17.

Duncan

(2009, June). Robust data gives us the roadmap to reform. Speech made at the fourth annual IES Research Conference, Washington, DC. http://www.ed.gov/news/speeches/2009/06/06-82009.html

18.

Every Student Succeeds Act, 20 U.S.C. § 6301 (2015). https://www.congress.gov/bill/114th-congress/senate-bill/1177

19.

Garner

Thorne

J. K.

Horn

I. S.

(2017). Teachers interpreting data for instructional decisions: Where does equity come in? Journal of Educational Administration, 55(4), 407–426. https://doi.org/10.1108/JEA-09-2016-0106

20.

Greenberg

Walsh

. (2012). What teacher preparation programs teach about K-12 assessment: A review. National Council on Teacher Quality. https://www.nctq.org/publications/What-Teacher-Preparation-Programs-Teach-about-K–12-Assessment:-A%20-review

21.

Hamilton

Halverson

Jackson

Mandinach

Supovitz

Wayman

(2009). Using student achievement to support instructional decision-making (NCEE 2009-4067). IES practice Guide. U.S. Department of Education, Institute of Education Sciences, National Center for Education Evaluation and Regional Assistance. https://ies.ed.gov/ncee/wwc/PracticeGuide.aspx?sid=12

22.

Hammerness

Klette

(2015). Indicators of quality in teacher education: Looking at features of teacher education from an international perspective. In LeTendre

G. K.

Wiseman

A. W.

(Eds.), Promoting and sustaining a quality teacher workforce (pp. 239–278). Emerald Group. https://doi.org/10.1108/s1479-367920140000027013

23.

Jimerson

Choate

Gietz

L. K

. (2015). Supporting data-informed practice among early career teachers: The role of mentors. Leadership and Policy in Schools, 14(2), 204–232. https://doi.org/10.1080/15700763.2014.997937

24.

Kang

Windschitl

(2018). How does practice-based teacher preparation influence novices’ first-year instruction? Teachers College Record, 120(8), 1–44. https://doi.org/10.1177/01614681181200080

25.

Kippers

W. B.

Wolterinck

C. H. D.

Schildkamp

Poortman

C. L.

Visscher

A. J.

(2018). Teachers’ views on the use of assessment for learning and data-based decision-making in classroom practice. Teaching and Teacher Education, 75, 199–213. https://doi.org/10.1016/j.tate.2018.06.015

26.

König

Bremerich-Vos

Buchholtz

Lammerding

Straub

Fladung

Schleiffer

(2017). Modelling and validating the learning opportunities of preservice language teachers: On the key components of the curriculum for teacher education. European Journal of Teacher Education, 40(3), 394–412. https://doi.org/10.1080/02619768.2017.1315398

27.

Lasater

Albiladi

W. S.

Davis

W. S.

Bengtson

(2019). The data culture continuum: An examination of school data cultures. Educational Administration Quarterly, 56(4), 533–569. https://doi.org/10.1177/0013161X19873034

28.

Lincoln

Y. S.

Guba

E. G.

(1986). But is it rigorous? Trustworthiness and authenticity in naturalistic evaluation. New Directions for Program Evaluation, 30, 73–84.

29.

Mandinach

E. B.

Friedman

J. M.

Gummer

E. S.

(2015). How can schools of education help to build educators’ capacity to use data? A systemic view of the issue. Teachers College Record, 117(4), 1–50. https://doi.org/10.1177/016146811511700404

30.

Mandinach

E. B.

Gummer

E. S.

(2012). Navigating the landscape of data literacy: It IS complex. Education Northwest and WestEd.

31.

Mandinach

E. B.

Gummer

E. S.

(2013). A systemic view of implementing data literacy in educator preparation. Educational Researcher, 42(1), 30–37. https://doi.org/10.3102/0013189X12459803

32.

Mandinach

E. B.

Gummer

E. S.

(2016). What does it mean for teachers to be data literate: Laying out the skills, knowledge, and dispositions. Teaching and Teacher Education, 60, 360–376. https://doi.org/10.1016/j.tate.2016.07.011

33.

Mandinach

E. B.

Jimerson

J. B.

(2016). Teachers learning how to use data: A synthesis of the issues and what is known. Teaching and Teacher Education, 60, 452–457. https://dx.doi.org/10.1016/j.tate.2016.07.009

34.

Mandinach

E. B.

Jimerson

J. B.

(2021). Data ethics in education: A theoretical, practical, and policy issue. Studio Paedogogica, 26(4), 9–26. https://doi.org/10.5817/SP2021-4-1

35.

Mathis

W. J.

Trujillo

T. M.

(Eds.) (2016). Learning from the federal market-based reforms: Lessons for the Every Student Succeeds Act (ESSA). Information Age Publishing

36.

Means

Chen

Debarger

Padilla

(2011). Teachers’ ability to use data to inform instruction: Challenges and supports. United States Department of Education, Office of Planning, evaluation, and Policy Development. https://www2.ed.gov/rschstat/eval/data-to-inform-instruction/report.doc

37.

Meyers

C. V.

Moon

T. R.

Patrick

Brighton

C. M.

Hayes

(2021). Data use processes in rural schools: Management structures undermining leadership opportunities and instructional change. School Effectiveness and School Improvement, 33(1), 1–20. https://doi.org/10.1080/09243453.2021.1923533

38.

Obery

Sletten

Vallor

R. R.

Schmitt-Wilson

(2021). Data driven decision-making in teacher education: Perceptions of pre-service teachers and faculty who teach them. Action in Teacher Education, 43(2), 231–246. https://doi.org/10.1080/01626620.2020.1762139

39.

Oláh

L. N.

Lawrence

N. R.

Riggan

(2010). Learning to learn from benchmark assessment data: How teachers analyze results. Peabody Journal of Education, 85(2), 226–245. https://doi.org/10.1080/01619561003688688

40.

Poortman

C. L.

Schildkamp

(2016). Solving student achievement problems with a data use intervention for teachers. Teaching and Teacher Education, 60, 425–433. https://doi.org/10.1016/j.tate.2016.06.010

41.

Prenger

Schildkamp

(2018). Data-based decision making for teacher and student learning: A psychological perspective on the role of the teacher. Educational Psychology, 38(6), 734–752. https://doi.org/10.1080/01443410.2018.1426834

42.

Raffe

C. P.

Loughland

(2021). “We’re not data analysts”: Teachers’ perspectives on factors impacting their use of student assessment data. Issues in Educational Research, 31(1), 224–240. http://www.iier.org.au/iier31/raffe.pdf

43.

Ravitch

Carl

N. M.

(2016). Qualitative research: Bridging the conceptual, theoretical, and methodological. Sage Publications.

44.

Reeves

T. D.

(2017). Pre-service teachers’ data use opportunities during student teaching. Teaching and Teacher Education, 63, 263–273. https://doi.org/10.1016/j.tate.2017.01.003

45.

Reeves

T. D.

Chiang

(2017). Building pre-service teacher capacity to use external assessment data: An intervention study. The Teacher Educator, 52(2), 155–172. https://doi.org/10.1080/08878730.2016.1273420

46.

Reeves

T. D.

Chiang

(2018). Online interventions to promote teacher data-driven decision-making: Optimizing design to maximize impact. Studies in Educational Evaluation, 59, 256–269. https://doi.org/10.1016/j.stueduc.2018.09.006

47.

Reeves

T. D.

Honig

S. L.

(2015). A classroom data literacy intervention for pre-service teachers. Teaching and Teacher Education, 50, 90–101. https://doi.org/10.1016/j.tate.2015.05.007

48.

Reeves

T. D.

Summers

K. H.

Grove

(2016). Examining the landscape of teacher learning for data use: The case of Illinois. Cogent Education, 3(1), 1–21. http://dx.doi.org/10.1080/2331186X.2016.1211476

49.

Schelling

Rubenstein

L. D.

(2021). Elementary teachers’ perceptions of data-driven decision-making. Educational Assessment, Evaluation and Accountability, 33(2), 317–344. https://doi.org/10.1007/s11092-021-09356-w

50.

Schelling

Rubenstein

L. D.

(2023). Pre-service and in-service assessment training: impacts on elementary teachers’ self-efficacy, attitudes, and data-driven decision-making practice. Assessment in Education: Principles, Policy, and Practice, 30(2), 177–202. https://doi.org/10.1080/0969594X.2023.2202836

51.

Schildkamp

Poortman

C. L.

(2015). Factors influencing the functioning of data teams. Teachers College Record, 117(5), 1–42. https://doi.org/10.1177/016146811511700403

52.

Tuval-Mashiach

(2021). Is replication relevant for qualitative research? Qualitative Psychology, 8(3), 365-377. https://doi.org/10.1037.qup0000217

53.

U.S. Department of Education (USED) (2009). Race to the Top Program: Executive summary. http://www2.ed.gov/programs/racetothetop/executive-summary.pdf

54.

van der Kleij

F. M.

Vermeulen

J. A.

Schildkamp

Eggen

T. J. H. M

. (2015). Integrating data-based decision-making, assessment for learning, and diagnostic testing in formative assessment. Assessment in Education: Principles, Policy and Practice, 22(3), 324–343. https://doi.org/10.1080/0969594X.2014.999024

55.

van der Linden

McKenney

. (2020). Uniting epistemological perspectives to support contextualized knowledge development. Educational Technology Research Development, 68(2), 703–727. https://doi.org/10.1007/s11423-020-09772-7

56.

van Geel

Keuning

Visscher

A. J.

Fox

J. P

. (2016). Assessing the effects of a school-side data-based decision-making intervention on student achievement growth in primary schools. American Educational Research Journal, 53(2), 360–394. https://doi.org/10.3102/000283121663734

57.

Virginia Department of Education. (2007). 8VAC20-22-130 Professional studies requirements for preK-12 endorsements, special education, secondary grades 6–12 endorsements, and adult education. https://register.dls.virginia.gov/vol23/iss25/v23i25.pdf

58.

Virginia Department of Education. (2018). 8VAC20-543-140 Professional studies requirements for preK-12 endorsements, special education, secondary grades 6–12 endorsements, and adult education. https://law.lis.virginia.gov/admincode/title8/agency20/chapter543 /section140/

59.

Virginia Department of Education. (2022). Colleges and universities with educator preparation programs (EPPs). https://www.doe.virginia.gov/teaching-learning-assessment/teaching-in-virginia/teacher-licensure/teacher-preparation-programs

60.

Wayman

J. C.

Jimerson

J. B.

(2014). Teacher needs for data-related professional learning. Studies in Educational Evaluation, 42, 25–34. https://doi.org/10.1016/j.stueduc.2013.11.001

61.

Wayman

J. C.

Shaw

Cho

(2017). Longitudinal effects of teacher use of a computer data system on student achievement. AERA Open, 3(1), 1–18. https://doi.org/10.1177/2332858416685534

62.

Willig

(2109). What can qualitative psychology contribute to psychological knowledge? Psychological Methods, 24(6), 796–804. https://doi.org/10.1037/met0000218