Development of a Brief Pre-Implementation Screening Tool to Identify Teachers Who Are at Risk for Not Implementing Intervention Curriculum and High-Implementing Teachers

Abstract

Few questionnaires have been developed to screen for potentially poor implementers of school-based interventions. This study combines teacher characteristics, perceptions, and teaching/training experiences to develop a short screening tool that can identify potential “low-performing” or “high-performing” teachers pre-implementation. Data were gathered from 208 teachers and 4,411 students who participated in the national implementation of an evidence-based HIV intervention in The Bahamas. Sensitivity and specificity were evaluated for the detection of “low-performing” and “high-performing” teachers. The validity of the screening tool was assessed using receiver operating characteristics analysis. The School Pre-implementation Screening Tool consists of seven predictive factors: duration as teacher, working site, attendance at training workshops, training in interactive teaching, perceived importance of the intervention, comfort in teaching the curriculum, and program priority. The sensitivity and specificity were 74% and 57% in identifying “low-performing” teachers and 81% and 65% with “high-performing” teachers. The screening tool demonstrated an acceptable/good validity (area under the receiver operating characteristics curve was 0.68 for “low-performing teachers” and 0.78 for “high-performing” teachers). Our brief screening tool can facilitate teacher training and recruitment of engaged teachers in implementation of school-based interventions.