Abstract
The development of communication is a fundamental part of early childhood. Yet many students with disabilities require supports such as augmentative and alternative communication to develop communication skills. Teachers and paraeducators play key roles in supporting communication for these students, but often lack effective and accessible training options that include relevant content, active engagement, and application with individualized coaching. To meet this need, we engaged in iterative development, revision, and testing of the POWR Training System, an online training and coaching program for teachers and their paraeducators. As part of a multi-year, federally funded grant, this iterative process was informed by feedback from educators and experts as well as by outcomes for paraeducators, a teacher, and children in a series of nonconcurrent single case studies. A description of the iterative process, outcomes for paraeducators, a teacher, and children as well as feedback related to the program are described. Future research directions are discussed.
Introduction
The development of communication skills is a fundamental part of early childhood and essential for academic success (Erickson & Geist, 2016). Although most children communicate primarily through speech (Dodd, 2011), many children with disabilities experience significant delays (Beukelman & Light, 2020). Approximately half of all children in early childhood special education settings require speech and language services (Morgan et al., 2016), including 12% who have complex communication needs (CCN; Binger & Light, 2006), meaning they are unable to use speech to meet their daily communication needs (Light & McNaughton, 2014). Augmentative and alternative communication (AAC) systems (e.g., picture symbols, communication apps, speech generating devices) can be used to support the development of communication for children with CCN (Beukelman & Light, 2020). However, learning to make effective use of AAC is not intuitive for children or their communication partners. Children who require AAC need the ongoing assistance of trained communication partners who support communication development by providing opportunities for communication, waiting for communication, responding to communication, and modeling AAC (Kent-Walsh et al., 2015). High quality AAC intervention to support communication partners can help achieve this goal.
Quality Intervention Development
The need for high quality intervention development has been recognized through United States federal funding agencies such as the Institute for Education Science (IES). In fact, since its inception (Education Sciences Reform, 2002) IES has consistently provided funding opportunities to develop and test new interventions (see https://ies.ed.gov/funding/grantsearch). Unfortunately, the ways in which intervention development is carried out is rarely reported in the published literature. There is a need for increased transparency in the process of intervention development particularly when public funding is provided (Hoddinott, 2015). Intervention development utilizes a systematic and iterative process with numerous steps. The National Center for Special Education Research (Buckley et al., 2014) indicates the iterative process includes “implementing, gathering feedback, revising, and implementing again” and notes the value of single case research designs as an important tool in the process. Variation exists in the literature related to how intervention development is carried out, but generally includes the following components: initial intervention development, review, refinement, and preliminary evaluation (see Kern et al., 2011; Wight et al., 2016).
Paraeducators as Critical Communication Partners
In this article, the authors describe the development of an online intervention to support paraeducators. Within educational settings, paraeducators are the most critical communication partner for children with CCN (Cole-Lade & Bailey, 2020). Federal law defines paraeducators as school employees who provide instructional support to students under the direct supervision of a teacher (Every Student Succeeds Act, 2015). Paraeducators are most often assigned to support students with disabilities (Binger et al., 2010), many of whom struggle with communication (Fisher & Pleasants, 2012). Children with CCN spend the majority of their school day interacting with adults (89% of interactions), with paraeducators as the most common communication partner (Chung et al., 2012). Despite the important role paraeducators play, interactions between children with CCN and paraeducators tend to be brief with little reciprocity (Chung et al., 2012), indicating a need for intervention to train paraeducators better support child communication.
Paraeducator Training
Although federal law requires paraeducator training (Every Student Succeeds Act, 2015) and professional standards emphasize the importance of providing training in communication skills (Council for Exceptional Children, 2022), lack of training for paraeducators remains a persistent problem (Jones et al., 2012). Challenges related to training paraeducators include: limited effectiveness of traditional training models, lack of supervision (Brock & Carter, 2013; Douglas et al., 2016), high turnover which creates a need for ongoing training (Fisher & Pleasants, 2012; Douglas et al., 2022b), lack of administrative support including limited funding, and logistical challenges (e.g., release time, coordination of coaching and supervision; Douglas et al., 2022a; 2022b). There are also unique challenges related to training paraeducators to support children with CCN. Many educational organizations lack personnel with expertise specific to children with CCN and may have only a handful of paraeducators who have training needs related to supporting these children (Douglas et al., 2016). Thus, the development of training programs of this nature may be a low priority or an area in which support is needed.
Online Training
Online training is one delivery method that can help address many of the aforementioned challenges and meet the needs of paraeducators as adult learners. Online training offers a flexible learning environment that can actively engage learners and meet specific needs across wide geographic areas, so training is accessible to paraeducators who support children with CCN in various educational organizations. Online training may likely be the wave of the future because online programs can be standardized, accessible, and utilized at any time – which addresses the need to train new paraeducators throughout the year. As indicated in a recent review of online asynchronous trainings for paraeducators supporting children with disabilities, these programs became especially common during the COVID-19 pandemic (Knowles et al., 2022), yet few address content relevant to supporting children who use AAC. Although not an exhaustive look at all available online training programs (commercial training programs were not reviewed), the number of programs highlights growing interest in online training for paraeducators.
Current best practice recommendations suggest that paraeducator training be based on existing professional standards (Council for Exceptional Children, 2022), and developed with adult learning theory in mind (Douglas & Uitto, 2021), such as the use of self-reflection to help paraeducators identify new skills (Bagawan et al., 2023). To ensure best practice for online paraeducator training, programs should include: (a) relevant content, (b) active engagement by paraeducators, and (c) application of skills to the classroom, in addition to being easy to access and use (Knowles et al., 2022; Dunst et al., 2010; Martin & Alborz, 2014). Relevant content within training programs is not just critical for supporting targeted skills and knowledge, but also because paraeducators will be more motivated to engage in the training if the content is applicable to their immediate needs (Martin & Alborz, 2014). Active engagement is also essential within online training programs (Dunst et al., 2010) and can be supported through the use of embedded activities, discussion questions, assessments, or requiring clicks within the online training program to continue to engage with training materials (Douglas et al., 2013; Layden et al., 2018). Online training should also prepare the paraeducator to implement learned skills in the classroom setting (Knowles et al., 2022). This includes materials for teachers to support the coaching and supervision of paraeducators as they implement learned skills in the classroom (Brock & Carter, 2013). Online materials should also be accessible and easy for paraeducators to use (Knowles et al., 2022) because materials that are cumbersome and offer a poor user experience will result in limited completion and application.
Existing Research
Although literature has looked at paraeducator training to support child communication (see Gregori et al., 2022), limited research has explored the efficacy of intervention packages that provide training for paraeducators who support young children who use AAC. However, training packages that utilize a strategy instruction approach outlined in the communication partner instructional model (Kent-Walsh & McNaughton, 2005) appear to be most promising based on literature reviews specific to paraeducators (Douglas, 2012) and other communication partners (Kent-Walsh et al., 2015). Key components of this paraeducator training model are: (a) a descriptive overview of the strategy, (b) modeling of the strategy, (c) rehearsal of the strategy steps, (d) practice implementing the strategy, and (e) feedback on strategy implementation.
Since the aforementioned literature reviews, a number of research projects have subsequently been conducted where communication partner training was successfully carried out using the communication partner instructional model (Kent-Walsh & McNaughton, 2005) with paraeducators in person (Douglas et al., 2013) and online (Douglas et al., 2014). Past training for paraeducators has also included common content designed to support young children who use AAC. For example, content has included: the importance of providing communication opportunities (i.e., asking questions, providing choices, commenting), waiting for the child’s communication, modeling AAC, and responding to the child’s communication (Binger et al., 2010; Douglas et al., 2013; 2014). Although results from previous studies have shown increased implementation of communication partner strategies by paraeducators, and improvements in child communication, variability in paraeducator and child performance was noted. This illuminates the need for further development and refinement of specific components (e.g., coaching) of the training to ensure implementation fidelity and maximize child outcomes.
This research was carried out as part of a large-scale, multi-year, federally funded grant project designed to refine and expand the original POWR intervention into a fully online training program with paraeducator and teacher components (Douglas et al., 2013; 2014). The iterative process included three steps: (a) initial intervention development, (b) expert/educator panel review and revision of materials, and (c) evaluation and adjustment of the POWR Training System. The first two steps are described in full detail elsewhere (see Douglas et al., 2022c), but included additional content to support modeling AAC, and the development of training and coaching materials for supervising teachers. The focus of this article is on the evaluation and adjustment of the POWR Training System though iterative testing.
The following primary research question guided the evaluation of the POWR Training System on paraeducator outcomes: Is there a functional relationship between the POWR Training System and the frequency of paraeducator communication behaviors (i.e., POWR: opportunities for communication, responses to communication; POWR+: AAC modeling)? Two secondary research questions were also posed to determine outcomes for child and teacher participants: Is there a functional relationship between paraeducator implementation of the POWR intervention on the frequency of child communication?; Does the POWR Training System support supervising teachers in providing high quality coaching (90% or above) to paraeducators related to their implementation of the POWR strategies? Paraeducator and teacher perceptions of the POWR Training System were also evaluated to determine the social validity of the intervention and inform adjustments to the intervention.
Method
This research was carried out as part of a large-scale, multi-year, federally funded grant project designed to refine and expand the original POWR intervention into a fully online training program with paraeducator and teacher components (Douglas et al., 2013; 2014). The iterative process was guided by the work of Wainer et al. (2018) and included three steps: (a) initial intervention development, (b) expert/educator panel review and revision of materials, and (c) evaluation and adjustment of the POWR Training System; the focus of this article is on the final step. All research was approved through the federal funder and university institutional review board. Following the (a) initial intervention development and (b) expert/educator panel review and revision of materials, iterative testing of the POWR Training System occurred using a series of nonconcurrent A-B-C single case design studies (i.e., baseline, intervention which consisted of training and post training, maintenance; Slocum et al., 2022) to measure how paraeducators implemented trained skills. This design was purposefully selected so the research team could engage in iterative revisions after each paraeducator completed training, and make adjustments to teacher supervision and coaching materials based on feedback and participant performance. Participation was staggered so changes could be made to training before the next participant began. Feedback about training was obtained from paraeducators and teachers using qualitative interviews.
The iterative testing of the online POWR Training System was staggered and took place over the course of three school years with 7 separate paraeducators who supported preschool children who used AAC. All participants who engaged in the evaluation process completed consent (paraeducators, teachers, parental consent for children). Data were collected during natural classroom activities with different levels of structure, as such, some variability in paraeducator and child behaviors was expected.
Participants
Paraeducator Participant Demographics.
Child Participant Demographics.
Notes. *AAC systems are listed as defined at the start of the study; M = male; F = female; ASD = autism spectrum disorders; SGD = speech generating device; LAMP = Language Acquisition through Motor Planning; ELL = English language learner.
In line with iterative testing, data collection for the first five paraeducators (A-E), was staggered and took place for 4–5 months for each paraeducator depending on school closures, illness, paraeducator performance, and maintenance data collection. Data collection for the last two paraeducators (F & G), took place over 3–5 months. Because the COVID-19 pandemic occurred during parts of the project, some data collection was interrupted due to school closures or student/staff quarantine. Such interruptions, if applicable, are illustrated within the figures.
Materials
The POWR Training System consisted of online training materials for both paraeducators and supervising teachers. The POWR strategy steps included: Prepare the activity and AAC, Offer opportunities for communication, Wait for communication, Respond to communication, and ± Model AAC (see Figure 1 for details about the strategy and its components). The online training for paraeducators included two training sections, Paraeducator POWR (approximately 1.75 hr to complete; POWR steps) and Paraeducator POWR+ (approximately 1 hr to complete; + step). The online teacher training, completed by the teacher for Paraeducator F and G, included two separate sections: Teacher POWR Part 1 which focused on the POWR/POWR + strategies for paraeducators (approximately 1 hr to complete) and Teacher POWR Part 2 which focused on coaching paraeducator implementation of the POWR/POWR + strategies (approximately .75 hr to complete) and was completed prior to coaching the paraeducator. POWR/POWR + strategy components.
The online training materials for both paraeducators and teachers were developed using a strategy instruction approach (Kent-Walsh & McNaughton, 2005). This included: (a) a descriptive overview of the strategy (i.e., POWR/POWR+), (b) modeling of the strategy (e.g., video models), (c) rehearsal of the strategy steps (e.g., naming and describing strategy steps), (d) practice implementing the strategy (e.g., during naturally occurring opportunities in the classroom), and (e) feedback on strategy implementation (e.g., provided by the teacher during coaching sessions).
Trainings were divided into small sections to allow flexibility in training completion and included interactive materials such as engaging animations describing training steps, video examples of communication partners implementing each step, as well as learning, reflection, and application activities. A wide variety of AAC systems were illustrated in video models to ensure relevance for paraeducator and teacher participants who support children with various needs and AAC systems (e.g., sign, mobile communication apps, core boards). Paraeducators and teachers were provided with a packet of printed materials to support online training completion. These materials were also available in the online training system for participants. The packet included login information for the online training, images illustrating the login process and navigation of the training website, completion time for each section of training, and copies of materials for instructional and application activities.
Measures
The primary dependent variables were related to paraeducator behavior. Specifically, the number paraeducator communication opportunities, paraeducator responses to child communication, and AAC models provided by paraeducators were measured. Changes in the number of communication opportunities and responses were expected after POWR training, and changes in AAC models were expected after POWR + training which emphasized modeling. Although the primary focus of the study was to measure changes in paraeducator performance after completion of the POWR and POWR + training programs, the team also wanted to understand how implementation impacted child communication. As such, child communication turns were coded as a secondary measure. Although immediate change for children was hoped for, it was anticipated that it might take children time to adjust to the new interaction style of the paraeducators. Evaluation of the training materials also included qualitative interviews to gain feedback from paraeducators and teachers. Interviews occurred at the end of studies and were recorded for later transcription and analysis. Participants were asked to note the benefits, challenges, impact, and suggested changes to the training.
Coding for all dependent variables (i.e., communication opportunities provided by paraeducators, responses to child communication, AAC models provided by paraeducators, and child communication) was done using behavioral definitions provided to coders (a copy of the coding manual is available from the first author). Coding was completed using the Datavyu software program (Datavyu Team, 2014) which provides timestamps marking all coded behaviors. Prior to coding, all research assistants were trained until they demonstrated 90% interobserver agreement (IOA) for all dependent variables. IOA was calculated point by point for each behavior (start time within 1 s) across each dyad and was calculated by taking the number of agreements divided by the number of agreements plus disagreements and multiplying by 100. A minimum of 30% of sessions were randomly selected across dyads and conditions for IOA coding. Paraeducator communication opportunity IOA averaged 96% across all dyads (range = 84–100%). Paraeducator responses to child communication IOA averaged 95% across all dyads (range = 81–100%). Paraeducator AAC model IOA averaged 96% across all dyads (range = 60–100%). Child communication turn IOA averaged 93% across all dyads (range = 57–100%). Any coding disagreements were discussed until resolved.
Procedural fidelity was measured across all conditions and sessions of the study and training fidelity was measured within the online training system for all online trainings that were completed. In baseline and maintenance procedural fidelity included eight steps, for training and post training this included nine steps. Procedural fidelity across sessions was 100% for baseline, 99% for training (range = 88–100%), 100% for post training, and 100% for maintenance. The lower procedural fidelity a single missing step in two separate training sessions (i.e., researcher forgot to ask the paraeducator if they had questions, forgot to provide a prompt to use POWR at the beginning of the session). Fidelity of training completion was 100% for all participants.
Data Analysis
Data were graphed and visually analyzed for level, trend, variability, immediacy of effect, and overlap (Kratochwill et al., 2010). To compliment visual inspection and serve as a measure of intervention impact on paraeducator and child behaviors Tau-U, an effect size index that estimates nonoverlap between conditions and can control for baseline trend (Parker et al., 2011), was also calculated using www.singlecaseresearch.org. Baseline trend was controlled for when baseline slope was over 0.40 (Parker et al., 2011). Values were calculated for each participant, and then for the entire intervention to provide an overall aggregate of intervention effect. Tau-U values ranged from −1 to 1 with positive scores indicating desired improvement. Values below 0.19 indicated a small effect, 0.2 to 0.59 indicated a moderate effect, 0.60 to 0.79 indicated a large effect, and above 0.80 indicated a very large effect (Vannest & Ninci, 2015). For Teams F and G teacher coaching fidelity was also analyzed to determine if high fidelity was met (i.e., 90% fidelity). Interviews of paraeducators and teachers were transcribed and data were analyzed using a content analysis approach (Patton, 2015). Themes that were derived from this process informed material revision and provided social validity evidence.
Procedures
Each dyad completed three study conditions: baseline, training, and post training. When possible, a maintenance condition (i.e., Dyads A, B, C, and F) was also included. Maintenance data could not be collected for some dyads due to the end of the school year, school closures, or paraeducator position changes (see Figures 1, 2, and 3). Data collection of paraeducator-child interactions were staggered and collected during 10-minute sessions via video across 3–5 months to measure the impact of the POWR Training System on paraeducator and child behaviors. The interactions took place in a nearby room or quiet area of the classroom. Activities were pre-planned by paraeducators and designed to be motivating to the child (e.g., puzzles, games, toys, books). The child’s AAC system was provided during each session. A total of 13–20 sessions were observed and analyzed for each dyad. Paraeducator and child behaviors without teacher training and coaching. Paraeducator and child behaviors with teacher training and coaching provided.

Baseline
During baseline paraeducators and children engaged in normal interactions in the classroom. The only guidance provided was that the activity should be motivating to the child. No instruction, feedback, or coaching was provided to paraeducators during baseline.
Training
Prior to the training condition paraeducators completed the online Paraeducator POWR training modules. For Paraeducator F and G, the supervising teacher also completed the Teacher POWR training modules. During the training condition of the study, paraeducators engaged in paraeducator-child interactions with an activity planned that was motivating to the child. No instruction, feedback, or coaching was provided to Paraeducators A-E during this condition of the study. Paraeducators F and G were provided with teacher coaching after each paraeducator-child session. Teacher coaching focused only on components of the POWR strategy.
Post Training
Prior to the post training condition of the study paraeducators completed the online Paraeducator POWR + training modules. During the post training condition, they engaged in paraeducator-child interactions with an activity planned that was motivating to the child. No instruction, feedback, or coaching was provided to paraeducators A-E during this part of the study. Paraeducators F and G were provided with teacher coaching after each paraeducator-child session during this condition, which focused on components of the POWR + strategy.
Maintenance
During maintenance paraeducators and children engaged in normal interactions. No guidance, instruction, feedback, or coaching was provided to paraeducators during maintenance. Maintenance data were collected every 2 weeks after the completion of the post training condition. Up to five maintenance data points were collected (2, 4, 6, 8, 10 weeks).
Results
Results from the iterative testing of the POWR Training System are provided next including findings from nonconcurrent single case studies (Slocum et al., 2022) and interviews with paraeducators and teacher that informed social validity and intervention adjustment.
Nonconcurrent Single Case Design Studies
Frequency of Paraeducator Behaviors.
Note. *Missing data in the table is due to school COVID-19 closures which shortened the originally scheduled data collection period. These closures varied across districts.
Frequency of Child Communication Turns.
Note. *Missing data in the table is due to school COVID closures which shortened the originally scheduled data collection period. These closures varied across districts.
Tau-U Results.
Note. *Tau-U calculation missing for Dyad E due to school COVID closures.
Relationship Between POWR Training System and Paraeducator Behaviors
In baseline, the level of communication opportunities provided by paraeducators to children varied among dyads, but aligned with the child’s communication level. Trend was relatively stable or descending for most paraeducators with limited variability, except Paraeducators A, D, and E. Paraeducator E showed an ascending trend in baseline, but baseline extended much longer than other participants. After baseline, variability reduced for communication opportunities provided by most paraeducators. Levels (see Table 3) increased for five paraeducators (A, B, C, E, and G) and decreased for two (D and F). Overlap to baseline occurred for all paraeducators and immediacy of effect was only noted for two paraeducators (i.e., C and E) although effects did not remain at the same level. Tau-U results comparing paraeducator communication opportunities from baseline to training (when communication opportunities were introduced) indicated no effect for Paraeducators A, B, D, or E, a moderate effect for Paraeducator G, and a large effect for Paraeducator C and F (see Table 6 for Tau-U results). Paraeducators who received teacher coaching had better outcomes.
In baseline, the level of responses to child communication closely mirrored opportunities, as well as child communication (see Figures 2 and 3), showing that paraeducators were generally responsive to child communication even during baseline. Paraeducator responses also showed level increases from baseline for all paraeducators (see Table 3), although the condition in which this occurred varied and in some cases the effect did not last (Paraeducator D and F). Overlap to baseline occurred for all paraeducators and immediacy of effect was only noted for Paraeducator E although this effect did not maintain at the same level. Tau-U results comparing paraeducator responses to child communication from baseline to training (when responses were introduced) indicated no effect for Paraeducators A, B, E, or F, small effect for Paraeducators D and G, and moderate effect for Paraeducator C (see Table 6).
In baseline, AAC models provided by paraeducators to children were low and relatively stable for all paraeducators (see Figures 2 and 3). The level of AAC models increased in post training compared to baseline for all paraeducators who completed post training, although the effect was lowest for Paraeducator C. While some paraeducators showed an increase in AAC models after POWR training (perhaps because some video examples illustrated this technique even though it was not explained, discussed, or part of the POWR strategy), most did not show notable growth in AAC models, or stable use of AAC models until after POWR + training which is consistent with what was taught within POWR+. Overlap to baseline was noted for two paraeducators (C and E) and immediacy of effect from baseline was noted for all but one paraeducator (C). Tau-U results comparing paraeducator AAC models from baseline to post training (when AAC models were introduced) indicated a small effect for Paraeducator C, moderate effect for Paraeducator F, and very large effect for A, B, D, and G. Tau-U could not be calculated for Paraeducator E because post training data were not collected due to COVID-19.
Relationship Between POWR Training System and Child Behaviors
In baseline child communication varied. The trend for child communication was relatively stable or descending for most children with noted variability for three children (A, D, and E). Child E showed an ascending trend in baseline, but baseline extended much longer than other participants. In most cases clear increases in child communication occurred after observed changes in paraeducator behavior, especially when paraeducators modeled AAC more often (see Dyad B data in Figure 2). Variability reduced for most children after baseline. Level changes (see Table 3) were observed for all but Child D after baseline. Overlap to baseline occurred for all children. Immediacy of effect for children was not clearly demonstrated, but was also not expected as it often takes children time to adjust to new expectations from their partner (see Douglas et al., 2018). Tau-U results comparing child communication from baseline to post training (when AAC models were introduced) indicated no effect for Child D, a small effect for Child B and F, a large effect for Child A and G, and a very large effect for Child C. Tau-U could not be calculated for Child E because post training data were not collected due to COVID-19.
POWR Training System and Teacher Behaviors
The teacher who engaged in paraeducator coaching with two separate paraeducators implemented coaching with high fidelity. Table 5 provides details of average coaching fidelity which was above 90% overall. The most common coaching fidelity steps missed included starting the session with praise, writing down goals at the end of the session (they were discussed, but sometimes not written down), and providing corrective feedback for the Wait step. The most often missed step during POWR + coaching was completing the POWR + rating before the session. Frequently, the teacher did this during the coaching session instead.
Coaching Fidelity by Teachers to Paraeducators.
Note. The most often missed step during POWR coaching was starting the session with praise, and recording goals at the end of the session (at times the team ran out of time in their schedule to record the goals on the sheet, but they were discussed). The most often missed step during POWR+ was completing the POWR + rating before the session, instead teachers often did this as part of the coaching session.
Social Validity of the POWR Training System
Within interviews, paraeducators and teachers noted benefits and challenges, provided suggestions for improving the training, and indicated that they would recommend the training to other educational teams. Overall, feedback was positive with benefits noted for the teachers, paraeducators, and children. Paraeducator E noted the use of AAC with other children in the classroom. Teacher D noted that after training, Paraeducator D was “more comfortable using the AAC book.” Benefits were also noted for children. Paraeducator A indicated: “[Child A] became more comfortable with the AAC device.”
Similarly, teachers and paraeducators who engaged in training and coaching highlighted the value of coaching sessions. Paraeducator F indicated: “Coaching is very important because [Teacher F] made me feel like I was getting there.” Teachers and paraeducators also highlighted that improved teamwork was a valuable outcome of coaching. Teacher G noted: I can validate their efforts for trying something new! I get to see what they did and how the child responded to them. Coaching helps with bonding and comradery. I validate what they do and this builds our relationship and teamwork in the class.
Despite the benefits of the training and coaching, some paraeducators noted challenges. For example, some paraeducators supported children who engaged in challenging behavior and found it difficult to implement the strategy when they needed to address challenging behaviors. Paraeducator F worked with a child who frequently left his seat and attempted to elope from the classroom: “we tried to do the session in the class and other students wanted to participate because it is fun. Child F got distracted though so a quiet spot to do communication with him is important.” Paraeducator G also supported a student who engaged in challenging behavior, but still saw benefits from implementing the POWR strategies: “[Child G] is not getting as frustrated as she usually would because she can communicate herself now.” Difficulty learning to wait for the child’s communication was noted even though teachers and paraeducators agreed on its importance. Paraeducator B said: “the training helped improve wait skills.”
Participants also provided important suggestions for improving training. This included providing more video models of the strategy steps, getting feedback from teachers on their performance and implementation of the POWR/POWR + strategy (provided from paraeducators in the Paraeducator POWR Evaluation), and adding frequently asked questions with answers in the online training website. Benefits of these adjustments to training were noted by subsequent teachers and paraeducators who completed training with these improvements. Teachers also provided suggestions for improving the coaching process, which focused on streamlining the process and including only one coaching form for teachers to complete during coaching sessions.
All participants indicated they would recommend the training to other paraeducators and teachers. Paraeducator E said the training would help other paraeducators “use the AAC with their students more and make them become more familiar. It makes you use it.” Paraeducator C’s advice to other paraeducators was simple: “take the training.” Paraeducator G indicated: “I feel comfortable maybe even teaching families how to use the communication system and some of these strategies.” Participants who viewed final materials were most positive about the training and excited to implement what they learned within their classrooms. During the interview, one teacher exclaimed, “I am all fired up now!” and she listed the various ways she would be implementing the POWR/POWR + strategies in her classroom (e.g., lunch table, circle, playsets). Another teacher said, “I enjoyed it! We want to share POWR with all our parapros!”
Discussion
The POWR Training System provides a fully online training program for teachers and paraeducators to support children with CCN. The training is built off best practice knowledge of online training (Knowles et al., 2022), adult learning theory (Dunst et al., 2010), coaching (Brock & Carter, 2013) and communication partner instruction (Kent-Walsh & McNaughton, 2005; Kent-Walsh et al., 2015). Findings from the development of this training program indicate it is effective and socially valid.
Additions to and Connections with the Literature
Data from the development of this project build on existing research (Douglas et al., 2013; 2014) and show adequate implementation of POWR/POWR + strategies by paraeducators and ways in which the intervention should be refined. Although numerous adjustments were made during iterative testing, these adjustments focused on instructional design rather than the overall content. After training the most consistent increase in paraeducator behavior was for AAC models, a common intervention target in the literature (Kent-Walsh et al., 2015). The level increase for AAC models from baseline to post training was 22 additional AAC models (range 1–48). However, it is important to note that the increase in use of AAC models varied among paraeducators. This highlights the variance in AAC system type (lower tech AAC systems often corresponded with fewer AAC models), the need for teacher coaching (Paraeducator C appears to be one who would have benefited from teacher coaching, something which was noted in the follow up interview), and the benefits of the revisions that were made (e.g., additional video models, the addition of coaching). Although variable, an increase in frequency of paraeducator responses to child communication was noted. This is critical because responsive partners are key to children with CCN learning communication skills (see Fäldt et al., 2020).
Although not the primary focus of this study, an improvement in child communication was also noted when paraeducators implemented the POWR Training System. To further explore the impact of the types of communication opportunities provided by paraeducators the team conducted a follow up study that helped us learn that children communicated more quickly after a choice, question, or AAC model, and least likely after a comment (Sun et al., 2023). These findings are not surprising given that all child participants were emerging communicators and choices, questions, and AAC models have a clearer expectation for a child response.
Findings also show that teachers were able to coach paraeducators with fidelity, a finding noted in related research (Gregori et al., 2022). Coaching for Paraeducator F and G showed high rates of fidelity (POWR M = 94%, range 85–100%; POWR + M = 92%, range 84–96%). Based on interview feedback from teachers related to coaching, coaching materials were also streamlined (e.g., use of only one form during coaching). The team continues to explore the fidelity and impact of teacher coaching in future research using the POWR Training System.
Finally, initial evidence supports that the POWR Training System is socially valid. Feedback of the training content and format by educator and expert panels (Step 2 of the project) was also designed to assess social validity of the POWR Training System. Results from participating teachers and paraeducators confirm that they found the POWR Training System to be effective and acceptable. Participants said they would recommend the training to other teachers and paraeducators who support children with CCN (Douglas et al., 2022c). Additional social validity measures are planned in future work including measurement of the goals, procedures, and outcomes by various stakeholders (Wolf, 1978).
Limitations and Implications for Research and Practice
Although this study provided important insights into the development of the POWR Training System, there were some limitations. The research team tested and revised the POWR Training System; however, the POWR Training System itself was continually revised to improve paraeducator and child outcomes which makes it difficult to generalize the findings from this phase of the project. The need to make iterative revisions also required the use of a series of nonconcurrent A-B-C single case design studies, which are generally considered less rigorous than concurrent single case design because of the lack of demonstrated effect across participants (Slocum et al., 2022). Additionally, due to the ongoing impact of the COVID-19, limited testing occurred for teacher coaching materials. Follow up feedback was sought to account for this lack of data from 4 additional teachers and 1 paraeducator. These individuals completed the finalized version of training and an interview to gain feedback and explore social validity of the training. Their responses indicated the intervention was ready for final testing.
Research is underway to test the finalized version of the POWR Training System using concurrent single case studies across paraeducator/child dyads with teacher-paraeducator teams who have not yet engaged in the POWR Training System. Data gathered will provide additional information about teacher coaching and demonstrate the overall impact of the POWR Training System on teacher coaching to paraeducators, paraeducator implementation of the POWR/POWR + strategies, and child communication. At the end of the evaluation phase, the training will be broadly available for use by teacher-paraeducator teams and important implications about use in school settings will be available. Given the early stage of development of the intervention, we encourage other research teams to examine the effects of the POWR Training System in varied contexts using the What Works Clearinghouse Standards (Kratochwill et al., 2010) to provide further evidence of its effect outside of this team and project.
Footnotes
Declaration of Conflicting Interests
The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding
The author(s) disclose receipt of the following financial support for the research, authorship, and/or publication of this article: This work was supported by the United States Department of Education grant R324A180122.
