Functional Assessment–Based Interventions for Students With or At-Risk for High-Incidence Disabilities: Field Testing Single-Case Synthesis Methods

Abstract

This systematic review investigated one systematic approach to designing, implementing, and evaluating functional assessment–based interventions (FABI) for use in supporting school-age students with or at-risk for high-incidence disabilities. We field tested several recently developed methods for single-case design syntheses. First, we appraised the quality of individual studies and the overall body of work using Council for Exceptional Children’s standards. Next, we calculated and meta-analyzed within-case and between-case effect sizes. Results indicated that studies were of high methodological quality, with nine studies identified as being methodologically sound and demonstrating positive outcomes across 14 participants. However, insufficient evidence was available to classify the evidence base for FABIs due to small number of participants within (fewer than recommended three) and across (fewer than recommended 20) studies. Nonetheless, average within-case effect sizes were equivalent to increases of 118% between baseline and intervention phases. Finally, potential moderating variables were examined. Limitations and future directions are discussed.

Keywords

functional behavior assessment behavior intervention plan Tier 3 evidence-based practice quality indicator effect size

Get full access to this article

View all access options for this article.

References

*Aitken

Harlan

Hankins

Michels

Moore

T. C.

Oakes

W. P.

Lane

K. L.

(2011). Increasing academic engagement during writing activities in an urban elementary classroom. Beyond Behavior, 20, 31–43.

American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). Washington, DC: Author.

Borenstein

Hedges

L. V.

Higgins

J. P. T.

Rothstein

H. R.

(2009). Introduction to meta-analysis. Hoboken, NJ: Wiley.

Christensen

Renshaw

Caldarella

Young

(2012). Training a general educator to use function-based support for students at risk for behavior disorders. Education, 133, 313–335.

Common

E. A.

Lane

K. L.

Cantwell

E. D.

Brunsting

Oakes

W. P.

Bross

L. A.

(2016). Teacher-delivered strategies to increase students’ opportunities to respond: A systematic methodological review. Manuscript in preparation.

Cook

B. G.

Buysse

Klingner

Landrum

T. J.

McWilliam

R. A.

Tankersley

Test

D. W.

(2015). CEC’s standards for classifying the evidence base of practices in special education. Remedial and Special Education, 36, 220–234.

Cooper

J. O.

Heron

T. E.

Heward

W. L.

(2007). Applied behavior analysis (2nd ed.). Upper Saddle River, NJ: Pearson Merrill Prentice Hall.

Council for Exceptional Children. (2014). CEC standards for evidence-based practices in special education. Arlington, VA: Author.

*Cox

Griffin

M. M.

Hall

Oakes

W. P.

Lane

K. L.

(2011). Using a functional assessment-based intervention to increase academic engaged time in an inclusive middle school setting. Beyond Behavior, 20, 44–54.

10.

Division for Early Childhood. (2014). DEC recommended practices in early intervention/early childhood special education 2014. Retrieved from http://www.dec-sped.org/recommendedpractices

11.

Drasgow

Yell

M. L.

(2001). Functional behavioral assessments: Legal requirements and challenges. School Psychology Review, 30, 239–251.

12.

Etscheidt

(2006). Behavioral intervention plans: Pedagogical and legal analysis of issues. Behavioral Disorders, 31, 223–243.

13.

Fisher

Tipton

(2014). robumeta: Robust variance meta-regression (R package version 1.3). Retrieved from https://CRAN.R-project.org/package=robumeta

14.

Gage

N. A.

Lewis

T. J.

Stichter

J. P.

(2012). Functional behavioral assessment-based interventions for students with or at risk for emotional and/or behavioral disorders in school: A hierarchical linear modeling meta-analysis. Behavioral Disorders, 37, 55–77.

15.

Gann

C. J.

Ferro

J. B.

Umbreit

Liaupsin

C. J.

(2014). Effects of a comprehensive function-based intervention applied across multiple educational settings. Remedial and Special Education, 35, 50–60. doi:10.1177/074193251350108

16.

Gast

D. L.

Ledford

J. R.

(2014). Single case research methodology: Applications in special education and behavioral sciences. Baltimore, MD: Paul H. Brookes.

17.

Gast

D. L.

Spriggs

A. D.

(2014). Visual analysis of graphic data. In Gast

D. L.

Ledford

J. R.

(Eds.), Single case research methodology: Applications in special education and behavioral sciences (pp. 176–210). Baltimore, MD: Paul H. Brookes.

18.

*Germer

K. A.

Kaplan

L. M.

Giroux

L. N.

Markham

E. H.

Ferris

G. J.

Oakes

W. P.

Lane

K. L.

(2011). A function-based intervention to increase a second-grade student’s on-task behavior in a general education classroom. Beyond Behavior, 20, 19–30.

19.

Goh

A. E.

Bambara

L. M.

(2012). Individualized positive behavior support in school settings: A meta-analysis. Remedial and Special Education, 33, 271–286.

20.

Hedges

L. G.

Pustejovsky

Shadish

W. R.

(2012). A standardized mean difference effect size for single-case designs. Research Synthesis Methods, 3, 224–239.

21.

Hedges

L. G.

Pustejovsky

Shadish

W. R.

(2013). A standardized mean difference effect size for multiple baseline designs across individuals. Research Synthesis Methods, 4, 324–341. doi:10.1002/jrsm.1086

22.

Hedges

L. V.

Tipton

Johnson

M. C.

(2010). Robust variance estimation in meta-regression with dependent effect size estimates. Research Synthesis Methods, 1, 39–65.

23.

Horner

R. H.

Carr

E. G.

Halle

Mcgee

Odom

Wolery

(2005). The use of single-subject research to identify evidence-based practice in special education. Exceptional Children, 71, 165–179. doi:10.1177/001440290507100203

24.

Horner

R. H.

Sugai

(2015). School-wide PBIS: An example of applied behavior analysis implemented at a scale of social importance. Behavior Analysis in Practice, 8, 80–85.

25.

Individuals With Disabilities Education Improvement Act of 2004, P.L. 108-446, 20 U.S.C. $ 1400 et seq.

26.

Institute of Education Science & National Science Foundation. (2013). Common guidelines for education research and development. Washington, DC: Author.

27.

Iwata

B. A.

Dorsey

M. F.

Slifer

K. J.

Bauman

K. E.

Richman

G. S.

(1982). Toward a functional analysis of self-injury. Analysis and Intervention in Developmental Disabilities, 2, 3–20. doi:10.1016/0270-4684(82)90003-9

28.

*Janney

D. M.

Umbreit

Ferro

J. B.

Liaupsin

C. J.

Lane

K. L.

(2013). The effect of the extinction procedure in function-based intervention. Journal of Positive Behavior Interventions, 15, 113–123. doi:10.1177/1098300712441973

29.

Lane

K. L.

Bruhn

A. L.

Crnobori

M. E.

Sewell

A. L.

(2009). Designing functional assessment-based interventions using a systematic approach: A promising practice for supporting challenging behavior. In Scruggs

T. E.

Mastropieri

M. A.

(Eds.), Advances in learning and behavior disabilities (Vol. 22, pp. 341–370). Bingley, UK: Emerald Group.

30.

Lane

K. L.

Common

E. A.

Royer

D. J.

Muller

(2014). Group comparison and single-case research design quality indicator matrix (Unpublished tool).

31.

*Lane

K. L.

Eisner

S. L.

Kretzer

J. K.

Bruhn

A. L.

Crnobori

Funke

. . . Casey

(2009). Outcomes of functional assessment-based interventions for students with and at risk for emotional and behavioral disorders in a job-share setting. Education & Treatment of Children, 32, 573–604. doi:10.1353/etc.0.0073

32.

Lane

K. L.

Kalberg

J. R.

Shepcaro

J. C.

(2009). An examination of the evidence base for function-based interventions for students with emotional and/or behavioral disorders attending middle and high schools. Exceptional Children, 75, 321–340.

33.

Lane

K. L.

Oakes

W. P.

Cox

(2011). Functional assessment-based interventions: A university-district partnership to promote learning and success. Beyond Behavior, 20, 3–18.

34.

Lane

K. L.

Oakes

W. P.

Menzies

H. M.

(2014). Comprehensive, integrated, three-tiered models of prevention: Why does my school—And district—Need an integrated approach to meet students’ academic, behavioral, and social needs? Preventing School, 58, 121–128. doi:10.1080/1045988X.2014.893977

35.

Lane

K. L.

Oakes

W. P.

Powers

Diebold

Germer

Common

E. A.

Brunsting

(2015). Improving teachers’ knowledge of functional assessment-based interventions: Outcomes of a professional development series. Education & Treatment of Children, 38, 93–120. doi:10.1353/etc.2015.0001

36.

*Lane

K. L.

Rogers

L. A.

Parks

R. J.

Weisenbach

J. L.

Mau

A. C.

Merwin

M. T.

Bergman

W. A.

(2007). Function-Based interventions for students who are nonresponsive to primary and secondary prevention efforts illustrations at the elementary and middle school levels. Journal of Emotional and Behavioral Disorders, 15, 169–183. doi:10.1177/10634266070150030401

37.

*Lane

K. L.

Smither

Huseman

Guffey

Fox

(2007). A function-based intervention to decrease disruptive behavior and increase academic engagement. Journal of Early and Intensive Behavior Intervention, 3.4-4.1, 348–364. doi:10.1037/h0100348

38.

*Lane

K. L.

Weisenbach

J. L.

Little

M. A.

Phillips

Wehby

(2006). Illustrations of function-based interventions implemented by general education teachers: Building capacity at the school site. Education & Treatment of Children, 29, 549–571.

39.

*Lane

K. L.

Weisenbach

J. L.

Phillips

Wehby

J. H.

(2007). Designing, implementing, and evaluating function-based interventions using a systematic, feasible approach. Behavioral Disorders, 32, 122–139.

40.

Levay

R. D.

(1998). Guidance on Functional Behavioral Assessments for Students with Disabilities (Memo July 1998). The National Association of State Directors of Special Education (NASDSE). Retrieved from http://www.p12.nysed.gov/specialed/publications/policy/functionbehav.htm

41.

*Liaupsin

C. J.

Umbreit

Ferro

J. B.

Urso

Upreti

(2006). Improving academic engagement through systematic, function-based intervention. Education & Treatment of Children, 29, 573–591.

42.

Maggin

D. M.

Pustejovsky

J. E.

Lane

K. K.

(2017). Introduction to the Special Issue on Single-Case Systematic Reviews and Meta-Analyses. Remedial and Special Education, 38, 323–330.

43.

*Majeika

C. E.

Walder

J. P.

Hubbard

J. P.

Steeb

K. M.

Ferris

G. J.

Oakes

W. P.

Lane

K. L.

(2011). Improving on-task behavior using a functional assessment-based intervention in an inclusive high school setting. Beyond Behavior, 20, 55–66.

44.

*Nahgahgwon

K. N.

Umbreit

Liaupsin

C. J.

Turton

A. M.

(2010). Function-based planning for young children at risk for emotional and behavioral disorders. Education & Treatment of Children, 33, 537–559. doi:10.1353/etc.2010.0005

45.

National Association of School Psychologists. (2000). Guidelines for the Provision of School Psychological Services. Bethesda, MD: Author.

46.

Pigott

T. D.

Valentine

J. C.

Polanin

J. R.

Williams

R. T.

Canada

D. D.

(2013). Outcome-reporting bias in education research. Educational Researcher, 42, 424–432.

47.

Pustejovsky

J. E.

(2015). Measurement-comparable effect sizes for single-case studies of free-operant behavior. Psychological Methods, 20, 342–359. doi:10.1037/met0000019

48.

Pustejovsky

J. E.

(2016). scdhlm: Estimating hierarchical linear models for single-case designs (R package version 0.3). Retrieved from http://github.com/jepusto/scdhlm

49.

Pustejovsky

J. E.

Hedges

L. V.

Shadish

W. R.

(2014). Design-comparable effect sizes in multiple baseline designs a general modeling framework. Journal of Educational and Behavioral Statistics, 39, 368–393. doi:10.3102/1076998614547577

50.

R Core Team. (2016). R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing. Available from http://www.R-project.org/

51.

Rohatgi

(2015). WebPlotDigitizer (Version 3.8). Retrieved from http://arohatgi.info/WebPlotDigitizer

52.

Scott

T. M.

McIntyre

Liaupsin

Nelson

C. M.

Conroy

Payne

L. D.

(2005). An examination of the relation between functional behavior assessment and selected intervention strategies with school-based teams. Journal of Positive Behavior Interventions, 7, 205–215. doi:10.1177/10983007050070040201

53.

Shadish

W. R.

Brasil

I. C.

Illingworth

D. A.

White

K. D.

Galindo

Nagler

E. D.

Rindskopf

D. M.

(2009). Using ungraph to extract data from image files: Verification of reliability and validity. Behavior Research Methods, 41, 177–183.

54.

Shadish

W. R.

Hedges

L. V.

Horner

R. H.

Odom

S. L.

(2015). The role of between-case effect size in conducting, interpreting, and summarizing single-case research (NCER 2015-002). Washington, DC: National Center for Education Research, Institute of Education Sciences, U.S. Department of Education.

55.

*Stahr

Cushing

Lane

Fox

(2006). Efficacy of a function-based intervention in decreasing off-task behavior exhibited by a student with ADHD. Journal of Positive Behavior Interventions, 8, 201–211. doi:10.1177/10983007060080040301

56.

Swaminathan

Rogers

H. J.

Horner

R. H.

(2014). An effect size measure and Bayesian analysis of single-case designs. Journal of School Psychology, 52, 105–122.

57.

Tipton

(2015). Small sample adjustments for robust variance estimation with meta-regression. Psychological Methods, 20, 375–393. doi:10.1037/met0000011

58.

Tipton

Pustejovsky

J. E.

(2015). Small-sample adjustments for tests of moderators and model fit using robust variance estimation in meta-regression. Journal of Educational and Behavioral Statistics, 40, 604–634. doi:10.3102/1076998615606099

59.

*Turton

A. M.

Umbreit

Liaupsin

C. J.

Bartley

(2007). Function-based intervention for an adolescent with emotional and behavioral disorders in Bermuda: Moving across culture. Behavioral Disorders, 33, 23–32.

60.

*Turton

A. M.

Umbreit

Mathur

S. R.

(2011). Systematic function-based intervention for adolescents with emotional and behavioral disorders in an alternative setting: Broadening the context. Behavioral Disorders, 36, 117–128.

61.

Umbreit

Ferro

Liaupsin

Lane

K. L.

(2007). Functional behavioral assessment and function-based intervention: An effective, practical approach. Upper Saddle River, NJ: Prentice Hall.

62.

*Umbreit

Lane

K. L.

Dejud

(2004). Improving classroom behavior by modifying task difficulty: Effects of increasing the difficulty of too-easy tasks. Journal of Positive Behavior Interventions, 6, 13–20. doi:10.1177/10983007040060010301

63.

Van Acker

Boreson

Gable

R. A.

Potterton

. (2005). Are we on the right course? Lessons learned about current FBA/BIP practices in schools. Journal of Behavioral Education, 14, 35–56. doi:10.1007/s10864-005-0960-5

64.

*Whitford

D. K.

Liaupsin

C. J.

Umbreit

Ferro

J. B.

(2013). Implementation of a single comprehensive function-based intervention across multiple classrooms for a high school student. Education & Treatment of Children, 36, 147–167.

65.

Wood

B. K.

Oakes

W. P.

Fettig

Lane

K. L.

(2015). A review of the evidence base of functional assessment-based interventions for young students using one systematic approach. Behavioral Disorders, 40, 230–250.

66.

*Wood

B. K.

Umbreit

Liaupsin

C. J.

Gresham

F. M.

(2007). A treatment integrity analysis of function-based intervention. Education & Treatment of Children, 30, 105–120. doi:10.1353/etc.2007.0035