Preliminary Study of the Effects of BEST in CLASS—Web on Young Children’s Social-Emotional and Behavioral Outcomes

Abstract

Many young children entering early childhood programs demonstrate challenging behaviors that place them at risk for emotional/behavioral disorders (EBDs), which impact their future success in school. The purpose of this study was to conduct a conceptual replication of BEST in CLASS by examining child outcomes from BEST in CLASS—Web, a web-based professional development intervention supporting teachers’ use of effective practices for ameliorating young children’s challenging behaviors. Participants included 29 early childhood teachers and 54 children (ages 3–5 years old) who were identified at-risk for EBD. Positive outcomes were found for both BEST in CLASS—Web and BEST in CLASS in reductions of children’s problem behaviors and conflictual relationships with their teachers as well as increases in social skills, engagement, and closeness with teachers in comparison to children who did not receive the intervention. In some cases, positive child outcomes were greater when teachers received professional development in the web-condition as compared to the onsite condition. Future research directions and implications are discussed.

Keywords

early childhood social-emotional learning behavioral disorders tier-2 intervention

Get full access to this article

View all access options for this article.

References

Achenbach

T. M.

Rescorla

L. A.

(2000). CBCL/1, 5-5 & C-TRF/1, 5-5 profiles. Research Center for Children, Youth, and Families.

Beyer

Postert

Muller

J. M.

Furniss

(2012). Prognosis and continuity of child mental health problems from preschool to primary school: Results of a four-year longitudinal study. Child Psychiatry and Child Development, 43(4), 533–543. https://doi.org/10.1007/s10578-012-0282-5

Blair

Raver

C. C.

(2012). Child development in the context of adversity: Experiential canalization of brain and behavior. American Psychologist, 67(4), 309–318. https://doi.org/10.1037/a0027493

Bragg

L. A.

Walsh

Heyeres

(2021). Successful design and delivery of online professional development for teachers: A systematic review of the literature. Computers & Education, 166, Article 104158. http://www.elsevier.com/locate/compedu

Briggs-Gowan

M. J.

Carter

A. S.

(2008). Social-emotional screening status in early childhood predicts elementary school outcomes. Pediatrics, 121(5), 957–962. https://doi.org/10.1542/peds.2007-1948

Brown

W. H.

Conroy

M. A.

(2012). Social-emotional competence in young children with developmental delays: Our reflection and vision for the future. Journal of Early Intervention, 33(4), 310–320. https://doi.org/10.1177/1053815111429969

Bulotsky-Shearer

R. J.

Bell

E. R.

Dominguez

(2012). Latent profiles of problem behavior within learning, peer, and teacher contexts: Identifying subgroups of children at academic risk across the preschool year. Journal of School Psychology, 50(6), 775–798. https://doi.org/10.1016/j.jsp.2012.08.001

Campbell

S. B.

Shaw

D. S.

Gilliom

(2000). Early externalizing behavior problems: Toddlers and preschoolers at risk for later maladjustment. Development and Psychopathology, 12(3), 467–488. https://doi.org/10.1017/S0954579400003114

Cohen

(1988). Statistical power analysis for the behavioral sciences. Routledge Academic.

10.

Conroy

M. A.

Bulotsky-Shearer

Morris

Hetrick

A. A.

(2020). Prevention and intervention in preschool and early elementary school years. In Farmer

T. W.

Conroy

M. A.

Farmer

E. M. Z.

Sutherland

(Eds.), Handbook of research in emotional and behavioral disorders (pp. 35–50). Routledge.

11.

Conroy

M. A.

Sutherland

K. S.

(2011). BEST in CLASS–PK intervention: Research version 2.0 [Unpublished intervention]. Anita Zucker Center of Excellence in Early Childhood Studies, University of Florida.

12.

Conroy

M. A.

Sutherland

K. S.

Algina

Ladwig

Werch

Martinez

Jessee

Gyure

(2019). Outcomes of the BEST in CLASS intervention on teachers’ use of effective practices, self-efficacy, and classroom quality. School Psychology Review, 48(1), 31–45. https://doi.org/10.17105/SPR-2018-0003.V48-1

13.

Conroy

M. A.

Sutherland

K. S.

Wilson

R. E.

Martinez

Whalon

K. J.

Algina

(2015). Measuring teacher implementation of the BEST in CLASS intervention program and corollary child outcomes. Journal of Emotional and Behavioral Disorders, 23(3), 144–155. https://doi.org/10.1177/1063426614532949

14.

Cronbach

L. J.

(1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16, 297–334. https://doi.org/10.1007/BF02310555

15.

Dede

Ketelhut

D. J.

Whitehouse

Breit

McCloskey

E. M.

(2009). A research agenda for online teacher professional development. Journal of Teacher Education, 60(1), 8–19. https://doi.org/10.1177/0022487108327554

16.

Driscoll

K. C.

Pianta

R. C.

(2010). Banking time in Head start: Early efficacy of an intervention designed to promote supportive teacher-child relationships. Early Education and Development, 21(1), 38–64. https://doi.org/10.1080/10409280802657449

17.

Durlak

J. A.

Dupre

E. P.

(2008). Implementation matters: A review of research on the influence of implementation on program outcomes and the factors affecting implementation. American Journal of Community Psychology, 41(3-4), 327–350. https://doi.org/10.1007/s10464-008-9165-0

18.

Feil

E. G.

Baggett

Davis

Landry

S. H.

Sheeber

L. B.

Leve

Johnson

(2020). Randomized control trial of an internet-based parenting intervention for mothers of infants. Early Childhood Research Quarterly, 50, 36–44. https://doi.org/10.1016/j.ecresq.2018.11.003

19.

Feil

E. G.

Baggett

K. M.

Davis

Sheeber

Landry

Carta

J. J.

Buzhardt

(2008). Expanding the reach of preventive interventions: Development of an Internet-based training for parents of infants. Child Maltreatment, 13(4), 334–346. https://doi.org/10.1177/1077559508322446

20.

Feil

E. G.

Walker

H. M.

Severson

H. H.

(1995). The Early Screening Project for young children with behavior problems. Journal of Emotional and Behavioral Disorders, 3(4), 194–202. https://doi.org/10.1177/106342669500300401

21.

Forness

S. R.

Freeman

S. F. N.

Paparella

Kauffman

J. M.

Walker

H. M.

(2012). Special education implications of point and cumulative prevalence for children with emotional or behavioral disorders. Journal of Emotional and Behavioral Disorders, 20(1), 4–18. https://doi.org/10.1177/1063426611401624

22.

Gresham

F. M.

Elliott

S. N.

(2008). Social skills improvement system: Teacher rating scales. Pearson Assessments.

23.

Hemmeter

M. L.

Ostrosky

Fox

(2006). Social and emotional foundations for early learning: A conceptual model for intervention. School Psychology Review, 35(4), 583–601. https://doi.org/10.1080/02796015.2006.12087963

24.

Hetzner

N. P.

Johnson

A. D.

Brooks-Gunn

(2011). Poverty, effects on social and emotional development. In Jarvela

(Ed.), Social and emotional aspects of learning (pp. 77–86). Elsevier.

25.

Xie

(2009). Toward deep learning for adult students in online courses. The Internet and Higher Education, 12(3–4), 136–145. https://doi.org/10.1016/j.iheduc.2009.08.001

26.

Knight

D. S.

(2012). Assessing the cost of instructional coaching. Journal of Education Finance, 38(1), 52–80. https://www.jstor.org/stable/23259121

27.

Kupersmidt

J. B.

Bryant

Willoughby

M. T.

(2000). Prevalence of aggressive behaviors among preschoolers in Head Start and community child care programs. Behavioral Disorders, 26(1), 42–52. https://doi.org/10.1177/019874290002600105

28.

McCabe

P. C.

Altamura

(2011). Empirically valid strategies to improve social and emotional competence of preschool children. Psychology in the Schools, 48(5), 513–540. https://doi.org/10.1002/pits.20570

29.

McClelland

M. M.

Cameron

C. E.

Connor

C. M.

Farris

C. L.

Jewkes

A. M.

Morrison

F. J.

(2007). Links between behavioral regulation and preschoolers’ literacy, vocabulary, and math skills. Developmental Psychology, 43(4), 947–959. http://dx.doi.org/10.1037/0012-1649.43.4.947

30.

McDonald

R. P.

(1999). Test theory: A unified approach. Lawrence Erlbaum.

31.

Nakagawa

Cuthill

I. C.

(2007). Effect size, confidence interval and statistical significance: A practical guide for biologists. Biological Reviews, 82, 591–605.

32.

National Science Foundation and Institute of Education Sciences. (2018). Companion guidelines on replication & reproducibility in education research: A supplement to the common guidelines for education research and development. https://ies.ed.gov/pdf/CompanionGuidelinesReplicationReproducibility.pdf

33.

Newborg

(2005). Battelle Developmental Inventory (2nd ed.). Riverside Publishing.

34.

Novick

M. R.

Lewis

(1967). Coefficient alpha and the reliability of composite measurements. Psychometrika, 32, 1–13. https://doi.org/10.1007/BF02289400

35.

Olsen

Donaldson

A. J.

Hudson

S. D.

(2010). Online professional development: Choices for early childhood educators. Dimensions of Early Childhood, 38(1), 12–18. https://www.learntechlib.org/p/107028/

36.

Patriota

A. G.

(2017). On some assumptions of the null hypothesis statistical testing. Educational and Psychological Measurement, 77(3), 507–528. https://doi.org/10.1177/0013164416667979

37.

Pianta

R. C.

(2001). Student-Teacher Relationship Scale–short form. Psychological Assessment Resources.

38.

Ringeisen

Stambaugh

Bose

Casanueva

Hedden

Avenevoli

. . . West

(2017). Measurement of childhood serious emotional disturbance: State of the science and issues for consideration. Journal of Emotional and Behavioral Disorders, 25, 195–210. https://doi.org/10.1177/1063426616675165

39.

Sameroff

A. J.

(1983). Developmental systems: Contexts and evolution. In Mussen

P. H.

(Gen. Ed.) & Kessen

(Vol. Ed.), Handbook of child psychology: Vol. 1 History, theory, and methods (4th ed., pp. 237–294). Wiley.

40.

Schindler

H. S.

Kholoptseva

S. S.

Yoshikawa

Duncan

G. J.

Magnuson

K. A.

Shonkoff

J. P.

(2015). Maximizing the potential of early childhood education to prevent externalizing behavior problems: A meta-analysis. Journal of School Psychology, 53(4), 243–263. https://doi.org/10.1016/j.jsp.2015.04.001

41.

Schmidt

(2009). Shall we really do it again? The powerful concept of replication is neglected in the social sciences. Review of General Psychology, 13(2), 90–100. https://doi.org/10.1037/a0015108

42.

Shelton

R. C.

Cooper

B. R.

Stirman

S. W.

(2018). The sustainability of evidence-based interventions and practices in public health and health care. Annual Review of Public Health, 39(1), 55–76. https://www.annualreviews.org/doi/pdf/10.1146/annurev-publhealth-040617-014731

43.

Skinner

B. F.

(1953). Science and human behavior. Simon & Schuster Inc.

44.

Skyhar

(2020). Thinking outside the box: Providing effective professional development for rural teachers. Theory & Practice in Rural Education, 10(1), 42–72. https://doi.org/10.3776/tpre.2020.v10n1p42-72

45.

Snyder

P. A.

Hemmeter

M. L.

Fox

(2015). Supporting implementation of evidence-based practices through practice-based coaching. Topics in Early Childhood Special Education, 35(3), 133–143. https://doi.org/10.1177/0271121415594925

46.

Snyder

P. A.

Hemmeter

M. L.

McLean

Sandall

McLaughlin

Algina

(2018). Effects of professional development on preschool teachers’ use of embedded instruction practices. Exceptional Children, 84(2), 213–232. https://doi.org/10.1177/0014402917735512

47.

Spybrook

Raudenbush

(2009). An examination of the precision and technical accuracy of the first wave of group-randomized trials funded by the Institute of Education Sciences. Educational Evaluation and Policy Analysis, 31(3), 298–318. https://doi.org/10.3102/0162373709339524

48.

Sutherland

K. S.

Conroy

M. A.

Algina

Ladwig

Jessee

Gyure

(2018). Reducing child problem behaviors: A randomized controlled trial of BEST in CLASS. Early Childhood Research Quarterly, 42(1), 31–43. https://doi.org/10.1016/j.ecresq.2017.08.001

49.

Sutherland

K. S.

Conroy

M. A.

Abrams

Ogston

(2013). An initial evaluation of the Teacher-Child Interaction Direct Observation System: Measuring teacher-child interaction behaviors in classroom settings. Assessment for Effective Intervention, 39(1), 12–23. https://doi.org/10.1177/1534508412463814

50.

Sutherland

K. S.

McLeod

B. D.

(2010). Treatment adherence and competence measure for classroom based interventions [Unpublished instrument]. Department of Special Education and Disability Policy, Virginia Commonwealth University.

51.

Sutherland

K. S.

McLeod

B. D.

Conroy

M. A.

Abrams

L. M.

Smith

M. M.

(2014). Preliminary psychometric properties of the BEST in CLASS Adherence and Competence Scale. Journal of Emotional and Behavioral Disorders, 22(4), 249–259. https://doi.org/10.1177/1063426613497258

52.

Tapp

(2010). Lily data collector [Computer software]. Vanderbilt Kennedy Center.

53.

Tapp

Wehby

J. H.

Ellis

(1995). A multiple option observation system for experimental studies: MOOSES. Behavior Research Methods, Instruments, & Computers, 27(1), 25–31. https://doi.org/10.3758/BF03203616

54.

Thompson

(2002). Statistical, practical, and clinical: How many kinds of significance do counselors need to consider? Journal of Counseling and Development, 80, 64–71.

55.

TORSH Inc. (2018a). Today’s One Room School House: TORSH Talent. Louisiana Entertainment. https://www.torshtalent.com/

56.

TORSH Inc. (2018b). TORSH Talent (Version 1.0.11).[Mobile app]. App store. https://apps.apple.com/us/app/torsh-talent/id577665140

57.

Travers

J. C.

Cook

B. G.

Therrien

W. J.

Coyne

M. D.

(2016). Replication research and special education. Remedial and Special Education, 37(4), 195–204. https://doi.org/10.1177/0741932516648462

58.

Wei

R. C.

Darling-Hammond

Adamson

(2010). Professional development in the United States: Trends and challenges. National Staff Development Council.

59.

Wiltsey Stirman

Kimberly

Cook

Calloway

Castro

Charns

. (2012). The sustainability of new programs and innovations: A review of the empirical literature and recommendations for future research. Implementation Science, 7(1), Article 17. https://doi.org/10.1186/1748-5908-7-17

60.

Yoshikawa

Aber

J. L.

Beardslee

W. R.

(2012). The effects of poverty on the mental, emotional, and behavioral health of children and youth: Implications for prevention. American Psychologist, 67(4), 272–284. https://doi.org/10.1037/a0028015