Measuring School-wide Positive Behavior Support Implementation

Abstract

School-wide positive behavior support (SWPBS) has been implemented in more than 4,000 schools as a means of addressing problem behavior in a systemic fashion. Preliminary outcomes (e.g., office discipline referrals, suspensions) indicate the effectiveness of SWPBS in decreasing school-wide behavior problems and creating a positive school climate. Although the results of a majority of the program evaluations yielded significant findings, there has been a lack of measurement of treatment fidelity, possibly due to the absence of expedient, effective assessment tools. This article describes the theoretical background and development, including a qualitative pilot study and psychometric properties, of the School-wide Benchmarks of Quality (BoQ; Kincaid, Childs, & George, 2005), a tool intended to measure the implementation of SWPBS. Descriptive data on the instrument, including internal consistency, test—retest reliability, interrater reliability, and concurrent validity, were collected and analyzed. Results indicate that the BoQ for SWPBS is a reliable, valid, efficient, and useful instrument for measuring the fidelity of implementation of the primary or universal level of PBS application in individual schools. Future considerations for evaluating the psychometric properties of the BoQ include extending the data collection and analysis to many more schools across multiple states.

Get full access to this article

View all access options for this article.

References

Baer, G.G. , Manning, M.A. , & Shiomi, K. (2006). Children's reasoning about aggressions: Differences between Japan and the United States and implications for school discipline . School Psychology Review, 35, 62—77.

Eber, L. , Lewis- Palmer, T. , & Pacchiano , D. (2001, February). School-wide positive behavior systems: Improving school environments for all students including those with EBD. Paper presented at the 14th Annual Research Conference, Tampa, FL.

Florida's Positive Behavior Support Project. ( 2004—2005). Team training on school-wide positive behavior support. Unpublished training manual, University of South Florida.

Horner, R.H. , Todd, A.W. , Lewis-Palmer, T. , Irvin, L.K. , Sugai, G. , & Boland, J.B. (2004). The school-wide evaluation tool (SET): A research instrument for assessing school-wide positive behavior support. Journal of Positive Behavior Interventions, 6, 3—12.

Kincaid, D. , Childs, K. , & George, H. (2005). School-wide benchmarks of quality. Unpublished instrument, University of South Florida.

Leitman, R. , & Binns, K. (1993). The American teacher 1993: Violence in America's schools: Metropolitan Life survey. New York: Louis Harris. (ERIC Document Reproduction Service No. ED397190)

Lewis, T.J. , & Newcomer, L.L. (2002). Examining the efficacy of school-based consultation: Recommendations for improving outcomes. Child & Family Behavior Therapy, 24, 165—181.

Lewis, T.J. , & Sugai, G. (1999). Effective behavior support: A systems approach to proactive school-wide management. Focus on Exceptional Children, 31, 1—17.

Mayer, M.J. , & Leone, P.E. (1999). A structural analysis of school violence and disruption: Implications for creating safer schools. Education & Treatment of Children, 22, 333—356.

10.

McCurdy, B.L. , Mannella, M.C. , & Eldridge, N. (2003). Positive behavior support in urban schools: Can we prevent the escalation of antisocial behavior? Journal of Positive Behavior Interventions, 5, 158—179.

11.

McKennel, A.C. (1974). Surveying attitude structures. Amsterdam: Elsevier.

12.

Messick, S. (1988). The once and future issues of validity: Assessing the meaning and consequences of measurement. In H. Wainer (Ed.), Test validity (pp. 33—48). Hillsdale, NJ: Erlbaum.

13.

Metzler, C.W. , Biglan, A. , & Rusby, J.C. (2001). Evaluation of a comprehensive behavior management program to improve school-wide positive behavior support. Education & Treatment of Children, 24, 448—479.

14.

Nelson, J.R. (2000). Educating students with emotional and behavioral disabilities in the 21st century: Looking through windows, opening doors. Journal of Education and Treatment of Children, 23, 204—220.

15.

Nunnally, J. (1978). Psychometric theory. New York : McGraw-Hill.

16.

Ponti, C.R. , Zins, J.E. , & Graden, J.L. (1988). Implementing a consultation-based service delivery system to decrease referrals for special education: A case study of organizational considerations. School Psychology Review, 17, 89—100.

17.

Rose, L.C. , & Gallup, A.M. (2004). The 36th annual Phi Delta Kappa/Gallup poll of the public's attitudes toward the public schools. Phi Delta Kappan, 86. Retrieved June 2005 from http://www.pdkintl.org/kappan/k0409pol.htm

18.

Scott, T.M. (2001). A school-wide example of positive behavior support . Journal of Positive Behavior Interventions, 3, 88—94.

19.

Schechter, S. , Blair, J. , & Vande Hey, J. (1996). Conducting cognitive interviewing to test self-administered and telephone surveys: Which methods should we use? In Proceedings of the Section on Survey Research Methods, American Statistical Association (pp. 10—17). Alexandria, VA: American Statistical Association.

20.

Sugai, G. , Horner, R.H. , Dunlap, G. , Hieneman, M. , Lewis, T.J. , Nelson, C.M. , et al. (1999). Applying positive behavioral support and functional behavioral assessment in schools (Technical Assistance Guide 1, Version 1.4.4). Eugene: University of Oregon, Center on Positive Behavioral Interventions and Support.

21.

Taylor-Greene, S.J. , Brown, D. , Nelson, L. , Longton, J. , Gassman, T. , Cohen, J. , et al. (1997). School-wide behavioral support: Starting the year off right. Journal of Behavioral Education, 7, 99—112.

22.

University of Oregon, Center on Positive Behavioral Interventions and Supports. (2004). School-wide positive behavior support: Implementers' blue-print and self-assessment. Eugene, OR: Author.

23.

U.S. Department of Education, Office of Special Education Programs. (2005). Technical assistance center on positive behavioral interventions and supports: Final report. Washington, DC: Author.

24.

Willis, G.B. (1999, August). Cognitive interviewing: A “how to” guide. Paper presented at the meeting of the American Statistical Association, Baltimore, MD.