Data-Based Decision Making for Social Behavior: Setting a Research Agenda

Abstract

With the advent of Precision Teaching more than 50 years ago, researchers and practitioners began to examine how to use K-12 students’ academic data to guide instructional decisions. Although the field has advanced with the use of curriculum-based measurement and data-driven decision rules for reading and math, the same is not true in the area of social behavior. In this article, we provide a brief retrospective of academic decision making to inform an initial call for research related to behavioral decision making. Then, we highlight areas for exploration related to baseline data, measurement tools, and features of behavior that, if answered via rigorous scientific inquiry, can move the field forward in making data-based decisions to improve behavioral outcomes.

Keywords

assessment challenging behavior single-case designs data analysis

Get full access to this article

View all access options for this article.

References

Adamson

R. M.

Wachsmuth

S. T.

(2014). A review of direct observation research within the past decade in the field of emotional and behavioral disorders. Behavioral Disorders, 39, 181–189.

Barton

E. E.

Meadan-Kaplansky

Fettig

(2019). Comparison of visual analysis, non-overlap methods, and effect sizes in the evaluation of parent implemented functional assessment based interventions. Research in Developmental Disabilities, 85, 31–41.

Betts

(1992). How systems thinking applies to education. Educational Leadership, 50, 38–41.

Briesch

A. M.

Chafouleas

S. M.

Riley-Tillman

T. C.

, & Contributors. (2016). Direct behavior rating: Linking assessment, communication and intervention. New York, NY: Guilford Press.

Bruhn

A. L.

Barron

Fernando

J. A.

Balint-Langel

(2018). Extending the direct behavior rating: An examination of schoolwide behavior ratings and academic engagement. Journal of Positive Behavior Interventions, 20, 31–42. doi:10.1177/1098300717713441

Bruhn

A. L.

Estrapala

Mahatmya

Rila

Vogelgesang

(in press). Training teachers on data-based individualization: A mixed methods study. Behavioral Disorders.

Bruhn

A. L.

McDaniel

Rila

Estrapala

(2018). A step-by-step guide to tier 2 behavioral progress monitoring. Beyond Behavior, 27, 15–27. doi:10.1177/1074295618756984

Bruhn

A. L.

Rila

Mahatmya

Estrapala

Hendrix

(2018). Analyzing the effects of data-based, individualized interventions using multilevel modeling and visual analysis. Journal of Emotional and Behavioral Disorders. Advance online publication. doi:10.1177/1063426618806279

Bruhn

A. L.

Woods-Groves

Huddle

(2014). A preliminary investigation of emotional and behavioral screening practices in K-12 schools. Education and Treatment of Children, 37, 611–634.

10.

Burke

M. D.

Davis

J. L.

Lee

Y. H.

Hagan-Burke

Kwok

Sugai

(2012). Universal screening for behavioral risk in elementary schools using SWPBS expectations. Journal of Emotional and Behavioral Disorders, 20, 38–54. doi:10.1177/1063426610377328

11.

Chafouleas

S. M.

Briesch

A. M.

Riley-Tillman

T. C.

Christ

T. J.

Black

A. C.

Kilgus

S. P.

(2010). An investigation of the generalizability and dependability of Direct Behavior Rating Single Item Scales (DBR-SIS) to measure academic engagement and disruptive behavior of middle school students. Journal of School Psychology, 48, 219–246.

12.

Chafouleas

S. M.

Kilgus

S. P.

Jaffery

Riley-Tillman

T. C.

Welsh

Christ

T. J.

(2013). Direct Behavior Rating as a school-based behavior screener for elementary and middle grades. Journal of School Psychology, 51, 367–385. doi:10.1016/j.jsp.2013.04.002

13.

Christ

T. J.

Riley-Tillman

T. C.

Chafouleas

S. M.

(2009). Foundation for the development and use of Direct Behavior Rating (DBR) to assess and evaluate student behavior. Assessment for Effective Intervention, 34, 201–213.

14.

Crone

D. A.

Hawken

L. S.

Horner

R. H.

(2010). Responding to problem behavior in schools: The behavior education program (2nd ed.). New York, NY: Guilford Press.

15.

Dunn

K. E.

Airola

D. T.

W. J.

Garrison

(2013). Becoming data driven: The influence of teachers’ sense of efficacy on concerns related to data-driven decision making. The Journal of Experimental Education, 81, 222–241.

16.

Every Student Succeeds Act of 2015, Pub. L. No. 114-95.

17.

Fabiano

G. A.

Pyle

Kelty

M. B.

Parham

B. R.

(2017). Progress monitoring using Direct Behavior Rating single item scales in a multiple-baseline design study of the daily report card intervention. Assessment for Effective Intervention, 43, 21–33.

18.

Filderman

M. J.

Toste

J. R.

(2018). Decisions, decisions, decisions: Using data to make instructional decisions for struggling readers. TEACHING Exceptional Children, 50, 130–140.

19.

Filderman

M. J.

Toste

J. R.

Didion

L. A.

Peng

Clemens

N. H.

(2018). Data-based decision making in reading interventions: a synthesis and meta-analysis of the effects for struggling readers. The Journal of Special Education, 52, 174–187.

20.

Gage

Prykanowski

Hirn

(2014). Increasing reliability of direct observation measurement approaches in emotional and/or behavioral disorders research using generalizability theory. Behavioral Disorders, 39, 228–244.

21.

Gresham

F. M.

Elliott

S. N.

Kettler

R. J.

(2010). Base rates of social skills acquisition/performance deficits, strengths, and problem behaviors: An analysis of the Social Skills Improvement System–Rating Scales. Psychological Assessment, 22, 809–815.

22.

Haring

N. G.

Liberty

K. A.

White

O. R.

(1980). Rules for data-based strategy decisions in instructional programs: Current research and instructional implications. In Sailor

Wilcox

Brown

(Eds.), Methods of instruction for severely handicapped students (pp. 159–192). Baltimore, MD: Brookes.

23.

Hirsch

S. E.

Bruhn

A. L.

Kittleman

(February, 2019). Technology across the tiers. A Presentation at the International Association for Positive Behavior Support Conference, Washington, DC.

24.

Horner

R. H.

Sugai

Anderson

C. M.

(2010). Examining the evidence base for school-wide positive behavior support. Focus on Exceptional Children, 42, 1–14.

25.

Hutton

J. B.

Dubes

Muir

(1992). Estimating trend in progress monitoring data: A comparison of simple line-fitting methods. School Psychology Review, 21, 300–312.

26.

Jung

P. G.

McMaster

K. L.

Kunkel

A. K.

Shin

Stecker

P. M.

(2018). Effects of data-based individualization for students with intensive learning needs: A meta-analysis. Learning Disabilities Research & Practice, 33, 144–155.

27.

Kratochwill

T. R.

Hitchcock

J. H.

Horner

R. H.

Levin

J. R.

Odom

S. L.

Rindskopf

D. M.

Shadish

W. R.

(2013). Single-case intervention research design standards. Remedial and Special Education, 34, 26–38.

28.

Lane

J. D.

Ledford

J. R.

(2014). Using interval-based systems to measure behavior in early childhood special education and early intervention. Topics in Early Childhood Special Education, 34, 83–93.

29.

Lewis

T. J.

Scott

T. M.

Wehby

J. H.

Wills

H. P.

(2014). Direct observation of teacher and student behavior in school settings: Trends, issues, and future directions. Behavioral Disorders, 39, 190–200.

30.

Lindsley

O. R.

(1990). Precision Teaching: By teachers for children. Teaching Exceptional Children, 22(3), 10–15.

31.

Lloyd

Bruhn

A. L.

Sutherland

Bradshaw

(2019). Progress and priorities in research to improve outcomes for students with or at risk for emotional and behavioral disorders. Behavioral Disorders, 44, 85–96. doi:10.1177/0198742918808485

32.

Maggin

Bruhn

A. L.

(2018). Evidence-based assessment and single-subject research: A commentary for the special issue on direct behavior ratings. Assessment for Effective Intervention, 43, 71–78. doi:10.1177/1534508417738722

33.

Majeika

C.E.

Wilkinson

Wehby

J.H.

(in preparation). How are preservice special education teachers trained to use data to monitor the progress of behavioral interventions?

34.

McCurdy

B. L.

Empson

D. N.

Knoster

Fluke

S. M.

Grant

C. A.

(2019). School resource officers and schoolwide PBIS: Considerations for training. Preventing School Failure: Alternative Education for Children and Youth, 63, 1–8.

35.

McIntosh

Campbell

A. L.

Carter

D. R.

Zumbo

B. D.

(2009). Concurrent validity of office discipline referral cut points used in schoolwide positive behavior support. Behavioral Disorders, 34, 100–113.

36.

McIntosh

Frank

J. L.

Spaulding

S. A.

(2010). Establishing research-based trajectories of office discipline referrals for individual students. School Psychology Review, 39, 380–394.

37.

National Center on Intensive Intervention. (2013). Data-based individualization: A framework for intensive intervention. Washington, DC: Office of Special Education, U.S. Department of Education.

38.

Ninci

Vannest

K. J.

Willson

Zhang

(2015). Interrater agreement between visual analysts of single-case data: A meta-analysis. Behavior Modification, 39, 510–541. doi:10.1177/0145445515581327

39.

No Child Left Behind Act of 2001. Pub. L. No. 107-110, y 115, Stat. 1425. (2002).

40.

Pas

Bradshaw

C. P.

Mitchell

M. M.

(2011). Examining the validity of office discipline referrals as an indicator of student behavior problems. Psychology in the Schools, 48, 541–555.

41.

Riley-Tillman

T. C.

Chafouleas

S. M.

Briesch

A. M.

Eckert

T. L.

(2008). Daily behavior report cards and systematic direct observation: An investigation of the acceptability, reported training and use, and decision reliability among school psychologists. Journal of Behavioral Education, 17, 313–327. doi:10.1007/s10864-008-9070-5

42.

Riley-Tillman

T. C.

Chafouleas

S. M.

Sassu

K. A.

Chanese

J. A. M.

Glazer

A. D.

(2008). Examining the agreement of Direct Behavior Ratings and systematic direct observation for on-task and disruptive behavior. Journal of Positive Behavior Interventions, 10, 136–143. doi:10.1177/1098300707312542

43.

Sharp

R. A.

Mudford

O. C.

Elliffe

(2015). A data-based method for selecting parameters of momentary time sampling to provide representative data. European Journal of Behavior Analysis, 16, 279–294. doi:10.1080/15021149.2015.1083294

44.

Smith

R. L.

Eklund

Kilgus

S. P.

(2018). Concurrent validity and sensitivity to change of Direct Behavior Rating Single–Item Scales (DBR-SIS) within an elementary sample. School Psychology Quarterly, 33, 83–93. doi:10.1037/spq0000209

45.

Stecker

P. M.

Fuchs

L. S.

Fuchs

(2005). Using curriculum-based measurement to improve student achievement: Review of research. Psychology in Schools, 42, 795–819.

46.

Stormont

Reinke

Herman

(2011). Teachers’ knowledge of evidence-based interventions and available school resources for children with emotional and behavioral problems. Journal of Behavioral Education, 20, 138–147.

47.

Sugai

Sprague

J. R.

Horner

R. H.

Walker

H. M.

(2000). Preventing school violence: The use of office discipline referrals to assess and monitor school-wide discipline interventions. Journal of Emotional and Behavioral Disorders, 8, 94–101.

48.

Wood

B. K.

Hojnoski

R. L.

Laracy

S. D.

Olson

C. L.

(2016). Comparison of observational methods and their relation to ratings of engagement in young children. Topics in Early Childhood Special Education, 35, 211–222.