Data-based problem solving is a hallmark of research-supported practices such as positive behavioral interventions and supports. In this study, we provided members of positive behavioral interventions and supports (PBIS) teams from 38 elementary schools with professional development focused on a research-supported problem-solving model (Team-Initiated Problem Solving). We used direct observations to document procedures, practices, and outcomes before and after participating in the professional development workshop. Within the context of a randomized waitlist controlled trial, team members in the Immediate Group demonstrated greater improvement in (a) problem-solving procedures, (b) decision-making practices, and (c) meeting outcomes than did members of PBIS teams in the Waitlist Group. Our findings extend what is known about team-based problem solving and provide a framework for future research and improved practice related to decision making by school teams.
AlgozzineB.HornerR. H.ToddA. W.NewtonJ. S.AlgozzineK.CusumanoD. (2016). Measuring the process and outcomes of team problem solving. Journal of Psychoeducational Assessment, 35, 211–229. doi:10.1177/0734282915592535
2.
AlgozzineB.NewtonJ. S.HornerR. H.ToddA. W.AlgozzineK. (2012). Development and technical characteristics of a team decision-making assessment tool: Decision Observation, Recording, and Analysis (DORA). Journal of Psychoeducational Assessment, 30, 237–249. doi:10.1177/0734282911423884
3.
BahrM. W.WhittenE.DiekerL.KocarekC. E.MansonD. (1999). Intervention teams: Implications for educational and legal reform. Exceptional Children, 66, 67–83.
4.
BoudettK. P.CityE. A.MurnaneR. J. (Eds.). (2005). Data wise: A step-by-step guide to using assessment results to improve teaching and learning. Cambridge, MA: Harvard Education Press.
5.
BoudettK. P.CityE. A.MurnaneR. J. (Eds.). (2013). Data wise: A step-by-step guide to using assessment results to improve teaching and learning (Rev. and Expanded ed.). Cambridge, MA: Harvard Education Press.
6.
BransfordJ. D.SteinB. S. (1984). The IDEAL problem solver: A guide for improving thinking, learning, and creativity. New York, NY: W.H. Freeman.
7.
BurnsM. K.PetersR.NoellG. H. (2008). Using performance feedback to enhance implementation fidelity of the problem-solving team process. Journal of School Psychology, 46, 537–550. doi:10.1016/j.jsp.2008.04.001
8.
BurnsM. K.SymingtonT. (2002). A meta-analysis of pre-referral intervention teams: Student and systemic outcomes. Journal of School Psychology, 40, 437–447.
9.
BurnsM. K.VanderwoodM. L.RubyS. (2005). Evaluating the readiness of pre-referral intervention teams for use in a problem solving model. School Psychology Quarterly, 20, 89–105. doi:10.1521/scpq.20.1.89.64192
10.
BurnsM. K.WileyH. I.VigliettaE. (2008). Best practices in facilitating problem-solving teams. In ThomasA.GrimesJ. (Eds.), Best practices in school psychology (5th ed., pp. 1633–1644). Bethesda, MD: National Association of School Psychologists.
11.
ChafouleasS. M.VolpeR. J.GreshamF. M.CookC. R. (2010). School-based behavioral assessment within problem-solving models: Current status and future directions. School Psychology Review, 39, 343–349.
12.
CoburnC. E.TurnerE. O. (2012). The practice of data use: An introduction. American Journal of Education, 118, 99–111.
13.
CoffeyJ.HornerR. H. (2012). The sustainability of school-wide positive behavioral interventions and supports. Exceptional Children, 78, 407–422.
14.
CohenJ. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum.
15.
CroneD. A.CarlsonS. E.HaackM. K.KennedyP. C.BakerS. K.FienH. (2016). Data-based decision-making teams in middle school: Observations and implications from the middle school intervention project. Assessment for Effective Intervention. 41, 79–93. doi: http://dx.doi.org/10.1177/1534508415610322
16.
CruzB. C. (2015). The problem we still live with. Educational Leadership, 72(6), 16–20.
17.
EllerbrockC. R.CruzB. C. (2014). A vision of diversity in teacher education. In CruzB. C.EllerbrockC. R.VásquezA.HowesE. V. (Eds.), Talking diversity with teachers and teacher educators: Exercises and critical conversations across the curriculum (pp. 13–27). New York, NY: Teachers College Press.
18.
HornerR. H.SugaiG.SmolkowskiK.EberL.NakasatoJ.ToddA. W.EsperanzaJ. (2009). A randomized, wait-list controlled effectiveness trial assessing school-wide positive behavior support in elementary schools. Journal of Positive Behavior Interventions, 11, 133–144.
19.
HornerR. H.ToddA.SampsonN.DickeyC.MayS.AmedoM.TalmadgeN. (2008). School-wide information system facilitator training manual. Eugene: Educational and Community Supports, University of Oregon.
20.
IrvinL. K.HornerR. H.IngramK.ToddA. W.SugaiG.SampsonN.BolandJ. (2006). Using office discipline referral data for decision-making about student behavior in elementary and middle schools: An empirical investigation of validity. Journal of Positive Behavior Interventions, 8, 10–23.
21.
LewisT. J.HudsonS.RichterM.JohnsonN. (2004). Scientifically supported practices in emotional and behavioral disorders: A proposed approach and brief review of current practices. Behavioral Disorders, 29, 247–259.
22.
LittleJ. W. (2012). Understanding data use practice among teachers: The contribution of micro-process studies. American Journal of Education, 118, 143–166.
23.
MayS.ArdW.ToddA.HornerR.GlasgowA.SugaiG.. . . SpragueJ. (2016). School-wide Information System 5.5.9 b542. Eugene: Educational and Community Supports, University of Oregon.
24.
McDougalJ.ClonanS.MartensB. (2000). Using organizational change procedures to promote the acceptability of prereferral intervention services. School Psychology Quarterly, 15, 149–171.
25.
McIntoshK.MercerS. H.HumeA. E.FrankJ. L.TurriM. G.MathewsS. (2013). Factors related to sustained implementation of schoolwide positive behavior support. Exceptional Children, 79, 293–311.
26.
MeyerM. M.Behar-HorensteinL. S. (2015). When leadership matters: Perspectives from a teacher team implementing Response to Intervention. Education and Treatment of Children, 38, 383–402. doi:10.1353/etc.2015.0022
27.
MyersD.DynarskiM. (2003). Random assignment in program evaluation and intervention research: Questions and answers. Washington, DC: Institute of Education Sciences.
28.
NellisL. M. (2012). Maximizing the effectiveness of building teams in response to intervention implementation. Psychology in the Schools, 49, 245–256. doi:10.1002/pits.21594
29.
NewtonJ. S.AlgozzineR.AlgozzineK.HornerR.ToddA. W. (2011). Building local capacity for training and coaching data-based problem solving with positive behavior intervention and support teams. Journal of Applied School Psychology, 27, 228–245. doi:10.1080/15377903.2011.590104
30.
NewtonJ. S.HornerR. H.AlgozzineB.ToddA. W.AlgozzineK. M. (2012). A randomized wait-list controlled analysis of the implementation integrity of team-initiated problem solving processes. Journal of School Psychology, 50, 421–441. doi:10.1016/j.jsp.2012.04.002
31.
NewtonJ. S.HornerR. H.AlgozzineR. F.ToddA. W.AlgozzineK. M. (2009). Using a problem-solving model to enhance data-based decision making in schools. In SailorW.DunlapG.HornerR.SugaiG. (Eds.), Handbook of positive behavior support (pp. 551–580). New York, NY: Springer. doi:10.1007/978-0-387-09632-2_23
32.
NewtonJ. S.HornerR. H.ToddA. W.AlgozzineB.AlgozzineK. M. (2012). A pilot study of a problem-solving model for team decision making. Education and Treatment of Children, 35, 25–49. doi:10.1353/etc.2012.0001
33.
NewtonJ. S.ToddA. W.AlgozzineB.AlgozzineK.HornerR. H.CusumanoD. L. (2014). Supporting team problem solving in inclusive schools. In McLeskeyJ.WaldronN. L.SpoonerF.AlgozzineB. (Eds.), Handbook of research and practice for inclusive schools (pp. 275–291). New York, NY: Routledge.
34.
NewtonJ. S.ToddA. W.AlgozzineK. M.HornerR. H.AlgozzineB. (2009). Team-initiated problem solving training manual. Eugene: Educational and Community Supports, University of Oregon.
35.
OsterlohM.SiemersE.PrayB. (2005). The dilemma of pragmatics: Why schools don’t use quality team consultation practices. Journal of Educational & Psychological Consultation, 16, 127–155. doi:10.1207/s1532768xjepc1603_1
36.
ShadishW. R.CookT. D.CampbellD. T. (2002). Experimental and quasi-experimental designs for generalized causal inference. Boston, MA: Houghton Mifflin.
37.
SpillaneJ. P. (2012). Data in practice: Conceptualizing the data-based decision-making phenomena. American Journal of Education, 118, 113–141.
38.
StoneC. A. (2001). Issues in data-based decision making in special education: Introduction to the special series. School Psychology Review, 30, 463–465.
39.
TillyW. D.III. (2008). The evolution of school psychology to a science-based practice: Problem solving and the three-tiered model. In GrimesJ.ThomasA. (Eds.), Best practices in school psychology V (pp. 17–36). Bethesda, MD: National Association of School Psychologists.
40.
ToddA. W.HornerR. H.BerryD.SandersC.BugniM.CurrierA.. . . AlgozzineK. (2012). A case study of team-initiated problem solving in an elementary school. Journal of Special Education Leadership, 25, 81–89.
41.
ToddA. W.HornerR. H.NewtonJ. S.AlgozzineR. F.AlgozzineK. M.FrankJ. L. (2011). Effects of team-initiated problem solving on decision making by schoolwide behavior support teams. Journal of Applied School Psychology, 27, 42–59. doi:10.1080/15377903.2011.540510
42.
TorgersonD. J.TorgersonC. J. (2008). Designing randomised trials in health, education, and the social sciences: An introduction. New York, NY: Palgrave Macmillan.
