The Engaged Learners Program: Effects on Student Engagement During Small Group Reading Instruction

Abstract

In this study we tested the usability, feasibility, social validity, and effectiveness of Engaged Learners, a behavior support program designed to be integrated into small group reading interventions. Participants included eight Grade 3 to 5 students with co-occurring reading difficulties and inattention. A concurrent multiple-baseline design was utilized to test the effects of Engaged Learners on engagement outcomes. Visual analysis and effect sizes indicated an improvement in engagement for seven students. Interventionists and students viewed the Engaged Learners program to be effective and socially valid. Limitations included lower than expected levels of fidelity for one interventionist and high student absenteeism. More research is needed to identify the extent to which Engaged Learners can support reading outcomes. Educators seeking an effective behavior support program that requires minimal training and coaching may consider integrating Engaged Learners into their small group reading instruction.

Keywords

special education learning disability reading behavior attention

Get full access to this article

View all access options for this article.

References

Alonzo

Tindal

Ulmer

Glasgow

(2006). EasyCBM online progress monitoring assessment system. Center for Educational Assessment Accountability.

Busk

P. L.

Serlin

R.C.

(1992). Meta-analysis for single-case research. In Kratochwill

T. R.

Levin

J. R.

(Eds.), Single-case research design and analysis: New directions for psychology and education (pp.187–212). Erlbaum.

Brossart

D. F.

Laird

V. C.

Armstrong

T. W.

(2018). Interpreting Kendall’s Tau and Tau-U for single-case experimental designs. Cogent Psychology, 5(1), 1518687. https://doi.org/10.1080/23311908.2018.1518687

Bruhn

Watt

(2012). Improving behavior by using multicomponent self-monitoring within a targeted reading intervention. Behavioral Disorders, 38(1), 3–17. https://doi.org/ghxn

Burns

M. K.

Riley-Tillman

T. C.

VanDerHeyden

A. M.

(2012). RTI applications: Academic and behavioral interventions (Vol. 1). Guilford Press.

Cassar

A. G.

Jang

E. E.

(2010). Investigating the effects of a game-based approach in teaching word recognition and spelling to students with reading disabilities and attention deficits. Australian Journal of Learning Difficulties, 15(2), 193–211. https://doi.org/10.1080/19404151003796516

Catts

H. W.

Adlof

S. M.

Hogan

T. P.

Weismer

S. E.

(2005). Are specific language impairment and dyslexia distinct disorders? Journal of Speech, Language, and Hearing Research, 48(6), 1378–1396. https://doi.org/10.1044/1092-4388(2005/096)

Center on PBIS. (2022). Supporting and responding to student’s social, emotional, and behavioral needs: Evidence-based practices for educators (Version 2). Center on PBIS, University of Oregon. https://www.pbis.org/resource/supporting-and-responding-to-behavior-evidence-based-classroom-strategies-for-teachers

Chall

J. S.

(1996). American reading achievement: Should we worry? Research in the Teaching of English, 30(3), 303–310. https://www.jstor.org/stable/40171366

10.

Compton

D. L.

Fuchs

L. S.

Elleman

A. M.

Gilbert

J. K.

(2008). Tracking children who fly below the radar: Latent transition modeling of students with late-emerging reading disability. Learning and Individual Differences, 18(3), 329–337. https://doi.org/10.1016/j.lindif.2008.04.003

11.

Cook

B. G.

Cook

Therrien

W. J.

(2018). Group-difference effect sizes: Gauging the practical importance of findings from group experimental research. Learning Disabilities Research & Practice, 33, 56–63. https://doi.org/10.1111/ldrp.12167

12.

Cooper

J. O.

Heron

T. E.

Heward

W. L.

(2020). Applied behavior analysis (3rd ed.). Pearson.

13.

Denckla

M. B.

Barquero

L. A.

Lindstrom

E. R.

Benedict

S. L.

Wilson

L. M.

Cutting

L. E.

(2013). Attention-deficit/hyperactivity disorder, executive function, and reading comprehension: Different but related. In Swanson

H. L.

Harris

K. R.

Graham

(Eds.), Handbook of learning disabilities (2nd ed., pp. 155–168). The Guilford Press.

14.

Donegan

R. E.

Wanzek

Al Otaiba

(2020). Effects of a reading intervention implemented at differing intensities for upper elementary students. Learning Disabilities Research & Practice, 35(2), 62–71. https://doi.org/10.1111/ldrp.12218

15.

DuPaul

G. J.

Gormley

M. J.

Daffner-Deming

(2022). School-based interventions for elementary school students with attention-deficit/hyperactivity disorder. Child and Adolescent Psychiatric Clinics, 31(1), 149–166. https://doi.org/10.1016/j.chc.2021.08.003

16.

DuPaul

G. J.

Weyandt

L. L.

Janusis

G. M.

(2011). ADHD in the classroom: Effective intervention strategies. Theory Into Practice, 50(1), 35–42. https://doi.org/10.1080/00405841.2011.534935

17.

Eisman

A. B.

Kilbourne

A. M.

Greene

Jr Walton

Cunningham

(2020). The user-program interaction: How teacher experience shapes the relationship between intervention packaging and fidelity to a state-adopted health curriculum. Prevention Science: The Official Journal of the Society for Prevention Research, 21(6), 820–829. https://doi.org/10.1007/s11121-020-01120-8

18.

Ennis

R. P.

Royer

D. J.

Lane

K. L.

Dunlap

K. D.

(2020). Behavior-specific praise in pre-K–12 settings: Mapping the 50-year knowledge base. Behavioral Disorders, 45(3), 131–147. https://doi.org/10.1177/0198742919843075

19.

Gough

P. B.

Tunmer

W. E.

(1986). Decoding, reading, and reading disability. Remedial and Special Education, 7(1), 6–10. https://doi.org/10.1177/074193258600700104

20.

Horner

R. H.

Swaminathan

Sugai

Smolkowski

(2012). Considerations for the systematic analysis and use of single-case research. Education and Treatment of Children, 35(2), 269–290. https://doi.org/10.1353/etc.2012.0011

21.

Idler

A. M.

Mercer

S. H.

Starosta

Bartfai

J. M.

(2017). Effects of a mindful breathing exercise during reading fluency intervention for students with attentional difficulties. Contemporary School Psychology, 21(4), 323–334. https://doi.org/ggbktc

22.

Institute of Education Sciences (IES). (2022). What works clearinghouse procedures and standards handbook (Version 5.0). https://ies.ed.gov/ncee/wwc/handbooks

23.

Janney

D. M.

Umbreit

Ferro

J. B.

Liaupsin

C. J.

Lane

K. L.

(2013). The effect of the extinction procedure in function-based intervention. Journal of Positive Behavior Interventions, 15(2), 113–123. https://doi.org/f4zgs2

24.

Kauffman

J. M.

(2010). Commentary: Current status of the field and future directions. Behavioral Disorders, 35, 180–184. https://www.jstor.org/stable/43153815

25.

Kim

J. Y.

Fienup

D. M.

A. E.

Wang

(2022). Systematic review and meta-analysis of token economy practices in K-5 educational settings, 2000 to 2019. Behavior Modification, 46(6), 1460–1487. https://doi-org.du.idm.oclc.org/10.1177/01454455211058077

26.

Klauda

S. L.

Guthrie

J. T.

(2015). Comparing relations of motivation, engagement, and achievement among struggling and advanced adolescent readers. Reading and Writing, 28, 239–269. https://doi.org/10.1007/s11145-014-9523-2

27.

Kuchle

L. B.

Riley-Tillman

T. C.

(2019). Integrating behavior and academics in intervention planning. In Edmonds

R. Z.

Gandhi

A. G.

Danielson

(Eds.), Essentials of intensive intervention (pp. 51–68). Guilford Press.

28.

Lane

K. L.

(1999). Young students at risk for antisocial behavior: the utility of academic and social skills interventions. Journal of Emotional and Behavioral Disorders, 7(4), 211–223. https://doi.org/10.1177/106342669900700403

29.

Lawson

G. M.

Owens

J. S.

Mandell

D. S.

Tavlin

Rufe

Power

T. J.

(2023). Exploring teachers’ intentions to use behavioral classroom interventions. Evidence-Based Practice in Child and Adolescent Mental Health. Advance online publication. https://doi.org/10.1080/23794925.2023.2183434

30.

Ledford

J. R.

Gast

D. L.

(2018). Single case research methodology: Applications in special education and behavioral sciences. Routledge. https://doi.org/10.4324/9781315150666

31.

Ledford

J. R.

Lane

J. D.

Severini

K. E.

(2018). Systematic use of visual analysis for assessing outcomes in single case design studies. Brain Impairment, 19(1), 4–17. https://doi.org/10.1017/BrImp2017.16

32.

Lemons

C. J.

Al Otaiba

Conway

S. J.

Mellado De La Cruz

(2016). Improving professional development to enhance reading outcomes for students in special education. New Directions for Child and Adolescent Development, 154, 87–104.

33.

Lindström

E. R.

Chow

J. C.

Zimmerman

K. N.

Zhao

Settanni

Ellison

(2021). A systematic review and meta-analysis of the relation between engagement and achievement in early childhood research. Topics in Early Childhood Special Education, 41(3), 221–235. https://doi.org/gqzt

34.

Lindström

E. R.

Lemons

C. J.

(2021). Teaching reading to students with intellectual and developmental disabilities: An observation study. Research in Developmental Disabilities, 115, 103990. https://doi.org/gkhq4p

35.

Lonergan

Doyle

Cassidy

MacSweeney Mahon

Roche

R. A.

Boran

Bramham

(2019). A meta-analysis of executive functioning in dyslexia with consideration of the impact of comorbid ADHD. Journal of Cognitive Psychology, 31(7), 725–749. https://doi.org/10.1080/20445911.2019.1669609

36.

Lonigan

C. J.

Burgess

S. R.

Schatschneider

(2018). Examining the simple view of reading with elementary school children: Still simple after all these years. Remedial and Special Education, 39(5), 260–273. https://doi.org/10.1177/0741932518764833

37.

Macdonald

K. T.

Barnes

M. A.

Miciak

Roberts

Halverson

K. K.

Vaughn

Cirino

P. T.

(2021). Sustained attention and behavioral ratings of attention in struggling readers. Scientific Studies of Reading, 25(5), 436–451. https://doi.org/10.1080/10888438.2020.1826950

38.

Maggin

D. M.

Cook

B. G.

Cook

(2019). Making sense of single-case design effect sizes. Learning Disabilities Research & Practice, 34(3), 124–132. https://doi.org/10.1111/ldrp.12204

39.

McDougall

Heine

R. C.

Wiley

L. A.

Sheehey

M. D.

Sakanashi

K. K.

Cook

B. G.

Cook

(2017). Meta-analysis of behavioral self-management techniques used by students with disabilities in inclusive settings. Behavioral Interventions, 32, 399–417. https://doi.org/10.1002/bin.1491

40.

Miller

A. C.

Fuchs

L. S.

Compton

Kearns

Zhang

Yen

Patton

Kirchner

D. P.

(2014). Behavioral attention: A longitudinal study of whether and how it influences the development of word reading and reading comprehension among at-risk readers. Journal of Research on Educational Effectiveness, 7(3), 232–249.

41.

Morris

R. D.

Stuebing

K. K.

Fletcher

J. M.

Shaywitz

S. E.

Lyon

G. R.

Shankweiler

D. P.

Katz

Francis

D. J.

Shaywitz

B. A.

(1998). Subtypes of reading disability: Variability around a phonological core. Journal of Educational Psychology, 90(3), 347–373. https://doi.org/10.1037/0022-0663.90.3.347

42.

Parker

R. I.

Vannest

(2009). An improved effect size for single-case research: Nonoverlap of all pairs. Behavior Therapy, 40(4), 357–367. https://doi.org/10.1016/j.beth.2008.10.006

43.

Parker

R. I.

Vannest

K. J.

Davis

J. L.

Sauber

S. B.

(2011). Combining nonoverlap and trend for single-case research: Tau-U. Behavior Therapy, 42(2), 284–299. https://doi.org/10.1016/j.beth.2010.08.006

44.

Pustejovsky

J. E.

(2018). Using response ratios for meta-analyzing single-case designs with behavioral outcomes. Journal of School Psychology, 68, 99–112. https://doi.org/10.1016/j.jsp.2018.02.003

45.

Pustejovsky

J. E

Chen

Grekov

Swan

D. M.

(2023). Single-case effect size calculator (Version 0.7.1) [Web application]. https://jepusto.shinyapps.io/SCD-effect-sizes/

46.

Reynolds

C. R.

Kamphaus

R. W.

(2015). Behavior assessment system for children (BASC-3) (3rd ed.). Pearson.

47.

Ringwalt

C. L.

Ennett

Johnson

Rohrbach

Simons-Rudolph

Vincus

Thorne

(2016). Factors associated with fidelity to substance use prevention curriculum guides in the nation’s middle schools. Health Education & Behavior, 30(3), 375–391. https://doi.org/10.1177/1090198103030003010

48.

Roberts

G. J.

Cho

Garwood

J. D.

Goble

G. H.

Robertson

Hodges

(2020). Reading interventions for students with reading and behavioral difficulties: A meta-analysis and evaluation of co-occurring difficulties. Educational Psychology Review, 32, 17–47. https://doi.org/10.1007/s10648-019-09485-1

49.

Roberts

G. J.

Lindstrom

E. R.

Zaira

Ghosh

Mehmedovic

McFadden

K. A.

Bahadori Fallah

(2023). Intervention research for students with co-occurring reading difficulties and inattention: A systematic review of single-case design studies. Journal of Behavioral Education. Advance online publication. https://doi.org/10.1007/s10864-023-09517-5

50.

Roberts

G. J.

Mehmedovic

Cote

Wexler

Strain

(2023). The impact of embedding behavioral supports into reading instruction for upper elementary students with reading difficulties and inattention. The Elementary School Journal, 123(3), 457–478. https://doi.org/10.1086/723397

51.

Roberts

G. J.

Solis

Chance

(2019). Embedding self-regulation into reading interventions to support reading and behavior outcomes. Teaching Exceptional Children, 52, 78–86. https://doi.org/10.1177/0040059919874306

52.

Roberts

G. J.

Vaughn

Roberts

Miciak

(2021). Problem behaviors and response to reading intervention for upper elementary students with reading difficulties. Remedial and Special Education, 42, 169–181. https://doi.org/10.1177/0741932519865263

53.

Rosenshine

B. V.

(1978). Academic engaged time, content covered, and direct instruction. Journal of Education, 160(3), 38–66. https://doi.org/10.1177/002205747816000304

54.

Sayal

Washbrook

Propper

(2015). Childhood behavior problems and academic outcomes in adolescence: Longitudinal population-based study. Journal of the American Academy of Child & Adolescent Psychiatry, 54(5), 360–368. https://doi.org/10.1016/j.jaac.2015.02.007

55.

Sen

P. K.

(1968). Estimates of the regression coefficient based on Kendall’s Tau. Journal of the American Statistical Association, 63(324), 1379–1389. https://doi.org/10.2307/2285891

56.

Shimabukuro

S. M.

Prater

M. A.

Jenkins

Edelen-Smith

(1999). The effects of self-monitoring of academic performance on students with learning disabilities and ADD/ADHD. Education and Treatment of Children, 22(4), 397–414.

57.

Simonsen

Fairbanks

Briesch

Myers

Sugai

(2008). Evidence-based practices in classroom management: Considerations for research to practice. Education and Treatment of Children, 31(3), 351–380. https://doi.org/10.1353/etc.0.0007

58.

Stewart

A. A.

Austin

C. R.

(2020). Reading interventions for students with or at risk of attention deficit hyperactivity disorder: A systematic review. Remedial and Special Education, 41(6), 352–367. https://doi.org/10.1177/0741932519849660

59.

Sutherland

K. S.

Conroy

M. A.

McLeod

B. D.

Granger

Broda

Kunemund

(2020). Preliminary study of the effects of BEST in CLASS–elementary on outcomes of elementary students with problem behavior. Journal of Positive Behavior Interventions, 22(4), 220–233. https://doi.org/10.1177/1098300719900318

60.

Sutherland

K. S.

Conroy

M. A.

McLeod

B. D.

Kunemund

McKnight

(2019). Common practice elements for improving social, emotional, and behavioral outcomes of young elementary school students. Journal of Emotional and Behavioral Disorders, 27(2), 76–85. https://doi.org/10.1177/106342661878400

61.

Swanson

J. M.

Schuck

Porter

M. M.

Carlson

Hartman

C. A.

Sergeant

J. A.

Clevenger

Wasdell

McCleary

Lakes

Wigal

(2012). Categorical and dimensional definitions and evaluations of symptoms of ADHD: History of the SNAP and the SWAN rating scales. The International Journal of Educational and Psychological Assessment, 10(1), 51–70.

62.

Tannock

Frijters

J. C.

Martinussen

White

E. J.

Ickowicz

Benson

N. J.

Lovett

M. W.

(2018). Combined modality intervention for ADHD with comorbid reading disorders: A proof of concept study. Journal of Learning Disabilities, 51(1), 55–72. https://doi.org/10.1177/0022219416678409

63.

Tarlow

K. R.

(2017). An improved rank correlation effect size statistic for single-case designs: Baseline corrected Tau. Behavior Modification, 41(4), 427–467. https://doi.org/10.1177/014544516676750

64.

Theil

(1950). A rank-invariant method of linear and polynomial regression analysis, I, II, and III. Proceedings of the Royal Netherlands Academy of Sciences, 53, Part I: 386–392, Part II: 521–525, and Part III: 1397–1412.

65.

Torgesen

J. K.

Wagner

R. K.

Rashotte

C. A.

(2012). Test of word reading efficiency. Pro-Ed.

66.

Vannest

K. J.

Ninci

(2015). Evaluating intervention effects in single-case research designs. Journal of Counseling & Development, 93(4), 403-411. https://doi.org/10.1002/jcad.12038

67.

Voyager Sopris Learning. (2020). Passport. Voyager Sopris Learning.

68.

Wagner

R. K.

Torgesen

J. K.

Rashotte

C. A.

Pearson

N. A.

(2010). TOSREC: Test of sentence reading efficiency and comprehension. Pro-Ed.

69.

Wanzek

Petscher

Al Otaiba

Kent

S. C.

Schatschneider

Haynes

Brenna

K. R.

Jones

F. G.

(2016). Examining the average and local effects of a standardized treatment for fourth graders with reading difficulties. Journal of Research on Educational Effectiveness, 9(sup1), 45–66. http://dx.doi.org/10.1080/19345747.2015.1116032

70.

Wanzek

Petscher

Otaiba

S. A.

Rivas

B. K.

Jones

F. G.

Kent

S. C.

Schatschneider

Mehta

(2017). Effects of a year-long supplemental reading intervention for students with reading difficulties in fourth grade. Journal of Educational Psychology, 109(8), 1103–1119. https://doi.org/10.1037/edu0000184

71.

Watts

G. W.

Bryant

D. P.

Carroll

M. L.

(2019). Students with emotional-behavioral disorders as cross-age tutors: A synthesis of the literature. Behavioral Disorders, 44(3), 131–147. https://doi.org/10.1177/0198742918771914

72.

Watts

G. W.

Bryant

D. P.

Roberts

G. J.

(2020). Effects of cross-age tutors with EBD on the mathematics performance of at-risk kindergarteners. Journal of Emotional and Behavioral Disorders, 28(4), 244–256. https://doi.org/10.1177/1063426619884271

73.

Wills

Wehby

Caldarella

Kamps

Swinburne Romine

(2018). Classroom management that works: A replication trial of the CW-FIT program. Exceptional Children, 84(4), 437–456. https://doi/10.1177/0014402918771321

74.

Zimmerman

B. J.

(2002). Becoming a self-regulated learner: An overview. Theory Into Practice, 41(2), 64–70. https://doi.org/10.1207s15430421tip4102_2