Effects of BEST in CLASS–Web on Teacher Outcomes: A Preliminary Investigation

Abstract

This study examined the effects of the BEST in CLASS intervention professional development component when delivered online in comparison with in person and a control group. A total of 29 early childhood teachers serving young children demonstrating challenging behaviors were included as participants. Data were collected on teachers’ classroom quality, self-efficacy, implementation of the BEST in CLASS practices, acceptability of the intervention, and costs of delivery. Positive outcomes on several dimensions of classroom quality were found for the BEST in CLASS–Web condition when compared with the BEST in CLASS and control conditions. Alternatively, teachers’ sense of self-efficacy was greater when BEST in CLASS was delivered in person when compared with teachers who received online delivery or those in the control condition. Finally, teachers in both treatment conditions increased their use of the practices in comparison with control teachers. Teachers in both treatment conditions rated BEST in CLASS with high levels of acceptability. Implications and future research directions are discussed.

Keywords

early childhood online professional development practice-based coaching social-emotional intervention

Get full access to this article

View all access options for this article.

References

Artman-Meeker

K. M.

Hemmeter

M. L.

(2012). Effects of training and feedback on teachers’ use of classroom preventive practices. Topics in Early Childhood Special Education, 33(2), 112–123. https://doi.org/10.1177/0271121412447115

Artman-Meeker

K. M.

Hemmeter

M. L.

Snyder

(2014). Effects of distance coaching on teachers’ use of Pyramid model practices: A pilot study. Infants & Young Children, 27, 325–344. https://doi.org/10.1097/IYC.0000000000000016

Becker

K. D.

Domitrovich

C. E

. (2011). The conceptualization, integration, and support of evidence-based interventions in the schools. School Psychology Review, 40(4), 582–589. https://doi.org/10.1080/02796015.2011.12087531

Blair

Raver

C. C.

(2012). Child development in the context of adversity: Experiential canalization of brain and behavior. American Psychologist, 67, 309–318. https://doi.org/10.1037/a0027493

Bruder

M. B.

Mongro-Wilson

Stayton

V. D.

Dietrich

S. L.

(2009). The national status of in-service professional development systems for early intervention and early childhood special education practitioners. Infants and Young Children, 22, 13–20. https://doi.org/10.1097/01.IYC.0000343333.49775.f8

Bulotsky-Shearer

R. J.

Bell

E. R.

Dominguez

(2012). Latent profiles of problem behavior within learning, peer, and teacher contexts: Identifying subgroups of children at academic risk across the preschool year. Journal of School Psychology, 50, 775–798. https://doi.org/10.1016/j.jsp.2012.08.001

Castle

S. R.

McGuire

C. J.

(2010). An analysis of student self-assessment of online, blended, and face-to-face learning environments: Implications for sustainable education delivery. International Education Studies, 3(3), 36–40.

Cloney

Cleveland

Hattie

Tayler

(2016). Variations in the availability and quality of early childhood education and care by socioeconomic status of neighborhoods. Early Education and Development, 27(3), 384–401. https://doi.org/10.1080/10409289.2015.1076674

Cohen

(1988). Statistical power analysis for the behavioral sciences. Routledge.

10.

Conroy

M. A.

Sutherland

K. S.

(2011). BEST in CLASS—PK intervention: Research version 2.0 [Unpublished intervention]. Anita Zucker Center of Excellence in Early Childhood Studies, University of Florida.

11.

Conroy

M. A.

Sutherland

K. S.

Algina

Ladwig

Werch

Martinez

Jessee

Gyure

(2019). Outcomes of the BEST in CLASS intervention on teachers’ use of effective practices, self-efficacy, and classroom quality. School Psychology Review, 48(1), 31–45. https://dx.doi.org/10.17105/SPR-2018-0003.V48-1

12.

Conroy

M. A.

Sutherland

K. S.

Feil

(2019). BEST in CLASS—Web: Research version 1.0 [Unpublished web-based training modules]. Anita Zucker Center of Excellence in Early Childhood Studies, University of Florida.

13.

Dede

Ketelhut

D. J.

Whitehouse

Breit

McCloskey

E. M.

(2009). A research agenda for online teacher professional development. Journal of Teacher Education, 60(1), 8–19. https://doi.org/10.1177/0022487108327554

14.

Downer

J. T.

Pianta

R. C.

Fan

Hamre

B. K.

Mashburn

Justice

(2011). Effects of web-mediated teacher professional development on the language and literacy skills of children enrolled in prekindergarten BEST in CLASS. NHSA Dialog, 14(4), 189–212. https://doi.org/10.1080/15240754.2011.613129

15.

Feil

E. G.

Baggett

Davis

Landry

S. H.

Sheeber

L. B.

Leve

Johnson

(2020). Randomized control trial of an internet-based parenting intervention for mothers of infants. Early Childhood Research Quarterly, 50, 36–44. https://doi.org/10.1016/j.ecresq.2018.11.003

16.

Feil

E. G.

Walker

H. M.

Severson

H. H.

(1995). The Early Screening Project for young children with behavior problems. Journal of Emotional and Behavioral Disorders, 3(4), 194–202. https://doi.org/10.1177/106342669500300401

17.

Fox

Dunlap

Hemmeter

M. L.

Joseph

G. E.

Strain

P. S.

(2003). The Teaching Pyramid: A model for supporting social competence and preventing challenging behavior in young children. Young Children, 58(40), 48–52.

18.

Fox

Hemmeter

M. L.

Snyder

Binder

D. P.

Clarke

(2011). Coaching early childhood special educators to implement a comprehensive model for promoting young children’s social competence. Topics in Early Childhood Special Education, 31, 178–192. https://doi.org/10.1177/0271121411404440

19.

Geisser

Greenhouse

S. W.

(1958). An extension of Box’s results on the use of the F distribution. Annals of Mathematical Statistics, 29, 885–891.

20.

Hartley

H. O.

(1940). Testing the homogeneity of a set of variances. Biometrika, 31, 249–255.

21.

Hemmeter

M. L.

Snyder

P. A.

Fox

Algina

(2016). Evaluating the implementation of the Pyramid Model for promoting social-emotional competence in early childhood classrooms. Topics in Early Childhood Special Education, 36, 133–146. https://doi.org/10.1177/0271121416653386

22.

Joyce

Showers

(2002). Student achievement through staff development (3rd ed.). Association for Supervision and Curriculum Development.

23.

Xie

(2009). Toward deep learning for adult students in online courses. The Internet and Higher Education, 12(3–4), 136–145. https://doi.org/10.1016/j.iheduc.2009.08.001

24.

Knight

D. S.

(2012). Assessing the cost of instructional coaching. Journal of Education Finance, 38(1), 52–80.

25.

Knowles

M. S.

(1984). Andragogy in action: Applying modem principles of adult education. Jossey-Bass.

26.

Lilliefors

H. W.

(1967). On the Kolmogorov-Smirnov test for normality with mean and variance unknown. Journal of the American Statistical Association, 62, 399–402.

27.

Lloyd

C. M.

Modlin

E. L.

(2012). Coaching as a key component in teachers’ professional development improving classroom practices in Head Start settings. U.S. Department of Health and Human Services, Office of Planning, Research and Evaluation (OPRE). http://www.mdrc.org/publications/620/full.pdf

28.

Mauchley

J. W.

(1940). Significance test for sphericity of a normal n-variable distribution. Annals of Mathematical Statistics, 11, 204–209.

29.

McCabe

P. C.

Altamura

(2011). Empirically valid strategies to improve social and emotional competence of preschool children. Psychology in the Schools, 48(5), 513–540. https://doi.org/10.1002/pits.20570

30.

Nakagawa

Cuthill

I. C.

(2007). Effect size, confidence interval and statistical significance: A practical guide for biologists. Biological Reviews, 82, 591–605. https://doi.org/10.1111/j.1469-185X.2007.00027.x

31.

Newberg

(2005). Battelle developmental inventory (2nd ed.). Riverside.

32.

Otte

Bangerter

Britsch

Wuthrich

(2014). Attitudes of coaches towards the use of computer-based technology in coaching. Consulting Psychology Journal: Practice and Research, 66(1), 38–52. https://doi.org/10.1037/a0035592

33.

Patriota

A. G.

(2017). On some assumptions of the null hypothesis significance testing. Educational and Psychological Measurement, 77, 507–528. https://doi.org/10.1177/0013164416667979

34.

Pianta

R. C.

La Paro

K. M.

Hamre

(2008). Classroom assessment scoring system (CLASS): Pre-K version. Paul H. Brookes.

35.

Reeves

T. D.

Pedulla

J. J.

(2011). Predictors of teacher satisfaction with online professional development: Evidence from the USA’s e-learning for educators initiative. Professional Development in Education, 37(4), 591–611. https://doi.org/10.1080/19415257.2011.553824

36.

Schindler

H. S.

Kholoptseva

S. S.

Yoshikawa

Duncan

G. J.

Magnuson

D. A.

Shonkoff

J. P.

(2015). Maximizing the potential of early childhood education to prevent externalizing behavior problems: A meta-analysis. Journal of School Psychology, 53(3), 243–263. https://doi.org/10.1016/j.jsp.2015.04.001

37.

Snyder

P. A.

Hemmeter

M. L.

Fox

L. K.

(2015). Supporting implementation of evidence-based practices through practice-based coaching. Topics in Early Childhood Special Education, 35(3), 133–143. https://doi.org/10.1177/0271121415594925

38.

Snyder

P. A.

Hemmeter

M. L.

Fox

L. K.

(2022). Essentials of practice-based coaching. Paul H. Brookes.

39.

Snyder

P. A.

Hemmeter

M. L.

Meeker

K. A.

Kinder

Pasia

McLaughlin

(2012). Characterizing key features of the early childhood professional development literature. Infants and Young Children, 25(3), 188–212. https://doi.10.1097/IYC.0b013e31825a1ebf

40.

Spybrook

Raudenbush

. (2009). An examination of the precision and technical accuracy of the first wave of group-randomized trials funded by the Institute of Education Sciences. Educational Evaluation and Policy Analysis, 31(3), 298–318. https://doi.org/10.3102/0162373709339524

41.

Sutherland

K. S.

McLeod

B. D.

Conroy

M. A.

Abrams

L. M.

Smith

M. M.

(2014). Preliminary psychometric properties of the BEST in CLASS Adherence and Competence Scale. Journal of Emotional and Behavioral Disorders, 22(4), 249–259. https://doi.org/10.1177/1063426613497258

42.

Sutherland

K. S.

McLeod

B. D.

Conroy

M. A.

Cox

J. R.

(2013). Measuring implementation of evidence-based programs targeting young children at risk for emotional/behavioral disorders: Conceptual issues and recommendations. Journal of Early Intervention, 35(2), 129–149. https://doi.org/10.1177/1053815113515025

43.

Tapp

(2010). Lily data collector [Computer software]. Vanderbilt Kennedy Center.

44.

Thompson

(2002). Statistical, practical, and clinical: How many kinds of significance do counselors need to consider? Journal of Counseling and Development, 80, 64–71. https://doi.org/10.1002/j.1556-6678.2002.tb00167.x

45.

Tschannen-Moran

Hoy

A. W.

(2001). Teacher efficacy: Capturing an elusive construct. Teaching and Teacher Education, 17(7), 783–805. https://doi.org/10.1016/S0742-051X(01)00036-1

46.

Yoshikawa

Aber

J. L.

Beardslee

W. R.

(2012). The effects of poverty on the mental, emotional, and behavioral health of children and youth: Implications for prevention. American Psychologist, 67(4), 272–284. https://doi.org/10.1037/a0028015

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.04 MB