Restricted accessResearch articleFirst published online 2011-1
Comparing a Behavioral Check-In/Check-Out (CICO) Intervention to Standard Practice in an Urban Middle School Setting Using an Experimental Group Design
Students who continue to demonstrate at-risk behaviors after a school implements schoolwide primary (Tier 1) interventions require targeted-group secondary (Tier 2) interventions. This study was conducted to compare the effectiveness of a targeted-group behavioral check-in/check-out (CICO) intervention with the school’s standard practice (SP) with respect to decreasing students’ off-task and other problem behavior. Researchers used a pretest—posttest control group design with random assignment to compare the two interventions (CICO and SP). Statistically significant differences were detected for systematic direct observation data of classroom behavior; however, statistically significant differences were not demonstrated for rating scale data. Limitations and implications are discussed.
Aseltine, R.H., Dupre, M., & Lamlein, P. ( 2000). Mentoring as a drug prevention strategy: An evaluation of across ages. Adolescent and Family Health, 1, 11-20.
2.
Bradshaw, C., Koth, C., Bevans, K., Ialongo, N., & Leaf, P. (in press). The impact of school-wide positive behavioral interventions and supports (PBIS) on the organizational health of elementary schools. School Psychology Quarterly.
3.
Bradshaw, C., Mitchell, M., & Leaf, P. (in press). Examining the effects of school-wide positive behavioral interventions and supports on student outcomes: Results from a randomized controlled effectiveness trial in elementary schools. Journal of Positive Behavior Interventions.
4.
Bradshaw, C., Reinke, W., Brown, L., Bevans, K., & Leaf, P. ( 2008). Implementation of school-wide positive behavioral interventions and supports (PBIS) in elementary schools: Observations from a randomized trial. Education and Treatment of Children, 31, 1-26.
5.
Campbell, D.T., & Stanley, J.C. ( 1963). Experimental and quasi-experimental designs for research on teaching. In N. L. Gage (Ed.), Handbook of research on teaching (pp. 171-246). Chicago: Rand McNally.
6.
Cohen, J. ( 1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Erlbaum.
7.
Cook, T.D., & Campbell, D.T. (1979). Quasi-experimentation: Design and analysis for field settings. Chicago: Rand McNally. Crone, D.A., Horner, R.H., & Hawken , L.S. (2004). Responding to problem behavior in schools: The Behavior Education Program . New York: Guilford.
8.
Dappen, L., & Isernhagen, J.C. (2006). Urban and nonurban schools: Examination of a statewide student mentoring program. Urban Education, 41, 151-168.
9.
Fairbanks, S., Sugai, G., Guardino, D., & Lathrop, M. ( 2007). Response to intervention: Examining classroom behavior support in second grade. Exceptional Children, 73, 288-310.
10.
Filter, K.J., McKenna, M.K., Benedict, E.A., Horner, R.H., Todd, A.W., & Watson, J. ( 2007). Check in/check out: A post-hoc evaluation of an efficient, secondary-level targeted intervention for reducing problem behavior in schools . Education and Treatment of Children, 30, 69-84.
11.
Glass, G.V., McGraw, B., & Smith, M.L. ( 1981). Meta-analysis in social research. Beverly Hills, CA: Sage.
12.
Gresham, F.M., & Elliott, S.N. ( 1990). Social Skills Rating System: Manual. Circle Pines, MN: American.
13.
Grossman, J.B., & Tierney, J.P. ( 1998). Does mentoring work? An impact study of the big brothers big sisters program. Evaluation Review, 22, 403-426.
14.
Harris, K.R., Preller, D.M., & Graham, S. ( 1990). Acceptability of cognitive-behavioral and behavioral interventions among teachers. Cognitive Therapy and Research , 14, 573-587.
15.
Hawken, L.S. ( 2006). School psychologists as leaders in the implementation of a targeted intervention: The Behavior Education Program. School Psychology Quarterly, 21, 91-111.
16.
Hawken, L.S., & Horner, R.H. ( 2003). Evaluation of a targeted intervention within a schoolwide system of behavior support. Journal of Behavioral Education , 12, 225-240.
17.
Hawken, L.S., MacLeod, K.S., & Rawlings, L. ( 2007). Effects of the Behavior Education Program on office discipline referrals of elementary school students. Journal of Positive Behavior Interventions, 9, 94-101.
18.
Horner, R. ( 2007). Discipline prevention data. Eugene : University of Oregon, Office of Special Education Programs Center on Positive Behavior Interventions and Supports.
19.
Horner, R.H., & Sugai, G. ( 2005). School-wide positive behavior support: An alternative approach to discipline in schools. In L. Bambara & L. Kern (Eds.), Positive behavior support (pp. 359-390). New York: Guilford.
20.
Horner, R.H., Sugai, G., Smolkowski, K., Eber, L., Nakasato, J., Todd, A., et al. (2009). A randomized, wait-list controlled effectiveness trial assessing school-wide positive behavior support in elementary schools. Journal of Positive Behavior Interventions, 11, 133-144.
21.
Horner, R.H., Todd, A.W., Lewis-Palmer, T., Irvin, L.K., Sugai, G., & Boland, J.B. ( 2004). The School-wide Evaluation Tool (SET): A research instrument for assessing schoolwide positive behavior support, Journal of Positive Behavior Interventions, 6, 3-12.
22.
Irvin, L.K., Horner, R.H., Ingram, K., Todd, A.W., Sugai, G., Sampson, N.K., et al. (2006). Using office discipline referral data for decision making about student behavior in elementary and middle school: An empirical evaluation of validity. Journal of Positive Behavior Interventions, 8, 10-23.
23.
Irvin, L.K., Tobin, T.J., Sprague, J.R., Sugai, G., & Vincent, C.G. ( 2004). Validity of office discipline referral measures as indices of school-wide behavioral status and effects of school-wide behavioral interventions . Journal of Positive Behavioral Interventions, 6, 131-147.
24.
Kartub, D.T., Taylor-Greene, S., March, R.E., & Horner, R.H. ( 2000). Reducing hallway noise: A systems approach. Journal of Positive Behavior Interventions, 2, 179-182.
25.
Lane, K.L. ( 2003). Identifying young students at risk for antisocial behavior: The utility of "teachers as tests." Behavior Disorders, 28, 360-369.
26.
Lane, K.L., & Menzies, H.M. ( 2005). Teacher-identified students with and without academic and behavioral concerns: Characteristics and responsiveness. Behavior Disorders, 31, 51-64.
27.
Lane, K.L., Wehby, J., Menzies, H.M., Doukas, G.L., Munton, S.M., & Gregg, R.M. ( 2003). Social skills instruction for students at risk for antisocial behavior: The effects of small-group instruction. Behavioral Disorders, 28, 229-248.
28.
Lewis, T.J., Powers, L.J., Kelk, M.J., & Newcomer, L.L. (2002). Reducing problem behaviors on the playground: An investigation of the application of schoolwide positive behavior supports. Psychology in the Schools, 39, 181-190.
29.
March, R.E., & Horner, R.H. ( 2002). Feasibility and contributions of functional behavioral assessment sin schools. Journal of Emotional and Behavioral Disorders, 13, 158-170.
30.
March, R., Horner, R.H., Lewis-Palmer, T., Brown, D., Crone, D., Todd, A.W., & Carr, E. ( 2000). Functional Assessment Checklist for Teachers and Staff (FACTS). Eugene: University of Oregon, Department of Educational and Community Supports.
31.
Martens, B.K., Witt, J.C., Elliott, S.N., & Darveaux, D.X. (1985). Teacher judgments concerning the acceptability of school-based interventions. Professional Psychology: Research and Practice, 16, 191-198.
32.
McGraw, B., & Glass, G.V. ( 1979, November). Choice of the metric for effect size in meta-analysis . Paper presented at the meeting of the Australian Association for Research in Education, Melbourne, Australia.
33.
McIntosh, K., Borgmeier, C., Anderson, C.M., Horner, R.H., Rodriguez, B.J., & Tobin, T.J. ( 2008). Technical adequacy of the Functional Assessment Checklist: Teachers and Staff (FACTS) FBA interview measure. Journal of Positive Behavior Interventions, 10, 33-45.
34.
McIntosh, K., Campbell, A.L., Carter, D.R., & Dickey, C.R. ( 2009). Differential effects of a tier two behavior intervention based on function of problem behavior. Journal of Positive Behavior Interventions, 11, 68-81.
35.
Pedhazur, E.J. ( 1997). Multiple regression in behavioral research (3rd ed.). Orlando, FL: Harcourt Brace.
36.
Quinn, M.M., Mathur, S.R., & Rutherford, R.B. (1995). Early identification of anti-social boys: A multi-method approach. Education and Treatment of Children, 18, 272-281.
37.
Reynolds, L.K., & Kelley, M.L. ( 1997). The efficacy of a response cost-based treatment package for managing aggressive behavior in preschoolers. Behavior Modification, 21, 216-230.
38.
Riley-Tillman, T.C., Kalberer, S.M., & Chafouleas, S.M. (2005). Selecting the right tool for the job: A review of behavior monitoring tools used to assess student response-to-intervention. California School Psychologist, 10, 81-91.
39.
Rollin, S.A., Kaiser-Ulrey, C., Potts, I., & Creason, A.H. ( 2003). A school-based violence prevention model for at-risk eight grade youth. Psychology in the Schools, 40, 403-416.
40.
Rose, L.C., & Gallup, A.M. ( 2005, September). 37th annual Phi Delta Kappa/Gallup poll of the public’s attitudes toward the public schools. Kappan , pp. 41-59.
41.
Safran, S.P., & Oswald, K. ( 2003). Positive behavior supports: Can schools reshape disciplinary practices? Exceptional Children, 69, 361-373.
42.
Spaulding, S.A., Horner, R.H., May, S.L., & Vincent, C.G. ( 2008, November). Evaluation brief: Implementation of school-wide PBS across the United States. Washington, DC: Office of Special Education Programs Technical Assistance Center on Positive Behavioral Interventions and Supports. Retrieved June 26, 2009 from http://pbis.org/evaluation/evaluation-briefs/default.aspx
43.
Sugai, G., & Horner, R. ( 1994). Including students with severe behavior problems in general education settings: Assumptions, challenges, and solutions. In J. Marr, G. Sugai , & G. Tindal (Eds.), The Oregon conference monograph (Vol. 6, pp. 102-120). Eugene: University of Oregon.
44.
Sugai, G., & Horner, R.H. ( 1999). Discipline and behavioral support: Preferred processes and practices. Effective School Practices, 17, 10-22.
45.
Sugai, G., & Horner, R.H. ( 2002). The evolution of discipline practices: School-wide positive behavior supports. Child and Family Behavior Therapy, 24, 23-50.
46.
Sugai, G., Horner, R.H., Dunlap, G., Hieneman, M., Lewis, T.J., Nelson, C.M., et al. (2000). Applying positive behavior support and functional behavioral assessment in schools. Journal of Positive Behavior Interventions, 2, 131-143.
Todd, A.W., Campbell, A.L., Meyer, G.G., & Horner, R.H. ( 2008). The effects of a targeted intervention to reduce problem behaviors: Elementary school implementation of check in-check out. Journal of Positive Behavior Interventions, 10, 46-55.
Walker, H.M., Severson, H.H., & Feil, E.G. ( 1995). The early screening project. Longmont, CO: Sopris West.
51.
Westhues, A., Clarke, L., Watton, J., & St. Claire-Smith, S. (2001). Building positive relationships: An evaluation of process and outcomes in a big sister program. Journal of Primary Prevention, 21, 477-493.
52.
Wilson, D.R., & Prentice-Dunn, S. (1981). Rating scales in the assessment of child behavior. Journal of Clinical Child Psychology , 10, 121-126.
53.
Witt, J.C., & Elliott, S.N. ( 1985). Acceptability of classroom intervention strategies. In T. R. Kratochwill (Ed.), Advances in school psychology (Vol. 4, pp. 251-288). Mahwah, NJ: Lawrence Erlbaum.
