Sage Journals: Discover world-class research

Abstract

One relatively low-cost mechanism to assist teachers serving many English learner (EL) students and struggling readers is to hire, train, and manage paraprofessionals to provide supplementary instruction to such students. This study evaluated a program in which one district provided instructional aides to all first-grade teachers in the lowest-performing schools. To estimate program effects on reading, we used matched comparison schools in two research designs. One was a comparative interrupted time-series design, which compared school-level test score averages for treatment and comparison schools before and after program implementation. The other analyzed student-level test scores in these schools before and after the program. Both yielded positive estimates of program effects, significant at the p < .10 and p < .05 levels.

Keywords

paraprofessionals English learners (ELs)supplemental reading instruction

The percentage of Latina/o students in the United States has increased to nearly 27% of the total public school enrollment (NCES, 2021). However, Latinos still demonstrate many academic disparities across the U.S. education system (Schneider et al., 2006). For instance, socioeconomic and racial/ethnic opportunity and achievement gaps between Latino students and non-Latino peers are present at kindergarten entry (Reardon & Portilla, 2016), and these gaps tend to persist throughout elementary school and beyond.

In this study, we evaluated the effectiveness of one strategy aimed to reduce the gap in such disparities, that is, by hiring paraprofessional instructional assistants to provide supplemental literacy instruction to students, particularly those from Spanish-speaking homes. Specifically, during the 2018–2019 academic year, a predominantly Latina/o district in Southern California provided selected schools additional instructional support by hiring approximately 25 part-time teacher assistants who were also biliterate in English and Spanish. The intention behind this decision was to improve the school-level English Language Arts (ELA) performance of six of the lowest-performing schools that were selected based on their fall 2017 ELA performance and growth as determined by tests administered statewide in California. Paraprofessionals, also known as paraeducators, teacher assistants, teacher aides, or in this study as biliterate instructional assistants (BIAs), were placed in select schools to assist and supplement the instruction provided by first-grade teachers (Goe & Matlach, 2014). Thus, we evaluated the success of the paraprofessionals in promoting students’ foundational literacy skills by comparing the reading test scores of students in schools that received BIAs with those of students in comparison schools that did not receive BIAs within the same district who were selected to match these schools. Next, we present an overview of the literature on supplemental reading instruction and the effectiveness of paraeducator-led reading instruction.

Literature Review

Effective reading instruction

According to the National Reading Panel (2000), the five components necessary for effective reading instruction are phonemic awareness, phonics, fluency, vocabulary, and comprehension. Also, both individual (e.g., working memory, motivation) and environmental (e.g., formal and informal instruction) factors influence the reading comprehension skills of monolingual and bilingual students alike (August & Shanahan, 2006). Hakuta et al. (2000) have also noted that it can take language minority students from 3 to 7 years to develop sufficient English oral language proficiency skills necessary for academic excellence. Thus, effective reading instruction for ELs requires appropriate second-language scaffolding and high-quality instruction targeting different areas of reading throughout their elementary school years and beyond.

The IES Practice Guide (Gersten et al., 2008) offers specific recommendations to educators in identifying students who need targeted support in reading when core instruction is, by itself, insufficient. Within a multi-tier system of supports (MTSS) framework, the Guide recommends that educators provide students scoring below a benchmark score with intensive and systematic instruction on up to three of the reading components (outlined above), 3 to 5 times per week, for 20 to 40 min per day, in small groups. They also state that it does not matter whether a teacher or a paraprofessional provides the instruction, but instruction should be highly explicit, systematic, interactive, and must include instruction in other reading components beyond phonemic awareness and decoding, such as vocabulary and comprehension.

Supplemental reading instruction

Accordingly, one common approach for improving the foundational literacy skills of ELs and struggling readers is providing them with supplemental reading instruction in the early grades. Foorman and Torgesen (2001) note that this instruction must be made more comprehensive and explicit, more intensive, and more supportive in small group and one-to-one formats to ensure students’ needs are being met. Several studies reviewing prior research on programs for struggling readers in elementary school have reported the positive effects of one-to-one and small-group tutoring on both standardized and researcher-developed reading measures (Gersten et al., 2017; Neitzel et al., 2022). Important to note is that the Gersten et al. (2017) review excluded programs that specifically targeted EL students and did not distinguish outcomes based on who delivered the intervention (e.g., teachers, paraeducators, or researchers).

Neitzel et al. (2022) reviewed programs for struggling readers in elementary school. Studies in their review needed to include independent reading measures (they excluded studies using measures developed by the program implementers themselves), and programs had to be implemented by school personnel, such as teachers and teaching assistants. They found an overall positive impact of reading programs across 65 studies (Effect Size [ES] = 0.23). No significant differences in outcomes were found between teachers and teaching assistants serving as tutors, although programs offering one-to-one tutoring resulted in significantly better outcomes than small-group tutoring (ES = 0.41 vs. ES = 0.24, respectively). As in the other reviews, they did not identify or code for the language status of study participants.

Supplemental reading instruction for ELs

In a review of reading programs for Spanish-dominant EL students, Cheung and Slavin (2012) found that structured small-group and one-to-one tutoring programs had overall effect sizes of 0.48 and 0.19, respectively. Although the overall effect size of small-group tutoring was larger than one-to-one tutoring, the programs included in this review varied in terms of sample characteristics and program structure, making it difficult to compare the two types of tutoring. Nevertheless, the programs that were proven to be effective in promoting students’ reading skills included extensive coaching and professional development for teachers and paraeducators who were tutors. These programs also provided educators with explicit curricular manuals and materials while offering ongoing support and feedback throughout program implementation, although they did not distinguish study outcomes based on who implemented the program.

Richards-Tutor and Colleagues (2016) reviewed research on the effectiveness of reading interventions for ELs who were identified as at risk for reading difficulties or with a learning disability. They identified 12 studies published from 2000 to 2012, and these were all randomized control trials. Spanish was the home language of participants in all but two of the studies, and only three employed paraprofessionals as interventionists. Across seven studies that focused on kindergarteners and first graders, findings indicated that the reading interventions had significant moderate-to-large effects (ES = 0.58–0.91) on beginning reading skills. Furthermore, they found no significant differences between moderating variables, including group size, minutes of the intervention, or personnel delivering the intervention (i.e., researchers vs. school personnel). Again, they did not distinguish differences in program effectiveness between teachers and paraprofessionals.

Paraprofessionals as reading tutors

The reviews cited earlier offer substantial support for providing struggling readers and ELs with supplemental reading instruction. However, there has been less focus on evaluating the effectiveness of paraprofessionals in delivering this instruction. This is significant, given the increasing presence of noncertified instructional support staff in districts receiving Title I funds, particularly those with greater enrollments of minoritized students, ELs, and those from low-income backgrounds (U.S. Department of Education, 2007).

The U.S. Department of Education defines paraprofessionals as those individuals employed by schools and supervised by certified or licensed teachers who provide instructional support to students, including support for language instruction programs, special education, and migrant education (Every Student Succeeds Act [ESSA], 2015). Considering the instructional roles of paraprofessionals in many public schools across the nation, the legislation also now requires paraprofessionals employed in Title I programs to have completed at least 2 years of study at a higher education institution or an equivalent level of education (Lewis, 2005).

In the most recent review of literature on the overall effectiveness of paraprofessionals as reading tutors, Jones et al. (2020) found the mean effect size of paraeducators across nine studies and six reading outcomes was ES = 0.55. However, only two of the studies included in their review specifically targeted language minority students, and all the studies were conducted in settings that included researcher training and support. In a best-evidence synthesis of the literature, Samson et al. (2015) identified three key components associated with the effective use of paraprofessionals as reading tutors. Like the recommendations offered by Cheung and Slavin (2012), the three components they identified were (a) extensive training of paraprofessionals in delivering research-based reading instruction, (b) ongoing supervision of tutors, and (c) access to scripted reading lessons with an emphasis on phonics instruction.

Aside from the studies cited earlier, much of the research on the use of paraprofessionals for instruction has been qualitative or observational in nature (Bonner et al., 2011; Causton-Theoharis et al., 2007; French, 2001; Giangreco, 2003), and much of this research has focused on paraprofessionals’ roles in supporting students with identified disabilities in inclusive settings (Giangreco et al., 2010; Mason et al., 2020), with very little focusing on their work with EL students.

Current Study

Although the evidence on paraprofessionals as reading tutors looks promising, there is still quite limited research on their overall effectiveness in improving the reading performance of ELs. In addition, many of the supplemental reading programs implemented by paraeducators and evaluated in the literature cited earlier were developed and implemented by researchers, typically working from research grants. By contrast, in the current study, district administrators were responsible for hiring, funding, training, and providing ongoing support to paraprofessionals to improve student reading outcomes at selected schools.

Hence, the current study expands the evidence base by evaluating a large-scale implementation of paraprofessional reading tutors within one low-income school district where student enrollment was almost completely Latina/o. This study expands the evidence base in three ways: (a) assesses the impact of bilingual paraprofessionals on the English reading achievement of Spanish-dominant EL first graders; (b) evaluates the effectiveness of paraprofessionals hired and trained by district and school leaders as opposed to researchers; (c) analyzes individual and school reading outcomes using standardized reading measures. The following research questions were addressed:

Research Question 1: What is the school-level impact of Biliterate Instructional Assistants (BIAs) on the reading performance of first graders in selected schools?

Research Question 2: What is the individual-level impact of BIAs on the reading performance of students within these schools?

Program delivery

BIA training

After recruiting the BIAs, the district provided a full-day training session at the beginning of the academic year, which included ice breakers, a guest presentation by university faculty, and researchers discussing relevant research on language, phonological awareness, and reading achievement, specifically with an emphasis on ELs, and a rundown on best teaching practices for teaching foundational literacy skills to emerging and struggling readers. This was followed by a half-day training session after BIAs spent some time in the classrooms. During these district-led training sessions, emphasis was placed on phonics instruction and the importance of phonological awareness for reading skill development. BIAs also had the opportunity to practice teaching such skills after observing the trainers, learned more about their role in the classroom, asked specific questions they had about any issues they confronted, and received some training on behavior management.

After these initial trainings, they continued to attend training meetings for 2 hr each month to continue learning about teaching strategies they could utilize with students. Topics covered during the training meetings included phonemic awareness (i.e., how to identify and manipulate individual sounds in spoken words), teaching sight words or high-frequency words and the significance of automatic word recognition, how to work with decodable books, how to boost students’ reading fluency, grammar, spelling, and assessing reading comprehension. BIAs were also instructed on how to individualize instruction depending on a student’s level of performance, were provided with an overview of the curriculum, and received additional materials from the curriculum manual that included a range of strategies they could utilize to teach different sound and word patterns.

In addition, during the winter term, the district hired an instructional coach who went to each school site to provide the instructional aides further training on how to organize and implement the curriculum in small-group settings, to observe their instruction, and provide feedback. The instructional coach went to the school sites once a week for about a month, and BIAs were able to reflect on and discuss their instructional experiences. Aside from the training provided by the district, some BIAs also received additional training at their respective school sites by administrators and teachers.

Instructional content

The instruction the BIAs provided to students largely reflected the training they received. Instructional lessons were teacher-directed and drawn from both the Benchmark Advance (Dorta-Duque de Reyes et al., 2017) and Open Court (U.S. Department of Education, 2014) curricula and included lessons from the SIPPS (Systematic Instruction in Phonological Awareness, Phonics, and Sight Words) program (Shefelbine & Aldridge, 2013) that many teachers were familiar with. They reviewed specific phonics lessons with students, often mirroring the teacher’s lesson of the week, reviewed letters, sounds, digraphs, word families, multisyllabic and sight words, blending and segmenting words, read decodable books, had students practice their reading fluency, assessed reading comprehension, assisted students with spelling and dictation, and monitored student progress by maintaining student records.

Instructional delivery

Each school had discretion in how to organize the BIAs schedules; thus, the frequency and intensity of supplemental instruction varied from school-to-school and from classroom-to-classroom. For instance, within some schools, BIAs were placed in only kindergarten and first-grade classrooms, whereas in other schools, BIAs assisted all grade levels and floated between classrooms. Nonetheless, the BIAs’ schedules were consistent throughout the year, and many of the BIAs provided both small-group and individualized instruction depending on student needs and teacher preferences. The amount of one-to-one and small-group instruction first-grade students received varied from 10 to 40 min per day at least 3 to 5 times per week, and student groups were often readjusted throughout the year depending on student progress.

Data and Method

Participants

Six schools providing academic instruction primarily in English were selected to receive BIAs in the fall of 2018, based on their ELA performance and growth in prior years. Demographic characteristics, that is, percentage of female, Latina/o, EL, free or reduced-price lunch status (FRPL), and parent education level, and fall of 2018 average reading performance of each non-BIA school in the district were then compared with the six BIA schools through significance testing. A total of five non-BIA schools matched at least one of the six BIA schools (p < .05 on all covariates and test scores) in the fall of 2018 (during the implementation year) and were included as comparison schools in the comparative interrupted time-series (CITS) and student-level analyses described below.

Tables 1 and 2 summarize the demographic characteristics and average reading test scores of the BIA and comparison schools, respectively. Regarding missing data, less than 15% of all participants included in the student-level analysis had missing data on any of the covariates included in the regression model. Multiple imputation was used to account for these missing data, and results using imputed data are presented in Table 5. Although the data are multilevel, we chose not to use hierarchical linear modeling to estimate the effects. Instead, we used the “sandwich” estimator in Stata, which gives equivalent results (McNeish et al., 2017).

Table 1.

School-Level Demographic Characteristics (Percentages) of First Graders in BIA and Comparison Schools (AY 2018–2019).

School	Parent education
	n	Female	Avg. class size	Latina/o	EL	FRPL	Non-HS	HS	Some college	College
Biliterate instructional assistant (BIA)
BIA School 1	73	57.5	25	100	90.4	93.2	54.8	28.8	16.4	0
BIA School 2	82	43.9	22	100	68.3	87.8	36.6	41.5	18.3	3.7
BIA School 3	69	49.3	24	98.6	75.4	84.1	49.3	37.7	8.7	4.3
BIA School 4	110	56.4	26	98.2	80.9	95.5	50.0	35.5	12.7	1.8
BIA School 5	70	44.3	23	98.6	85.7	94.3	57.1	28.6	10	4.3
BIA School 6	77	48.1	22	100	90.9	94.8	46.8	41.6	9.1	2.6
Overall	481	49.9	24	99.2	81.9	91.6	49.1	35.6	12.5	2.8
Comparison
Non-BIA School 1^1,3,4,5,6	70	60.0	26	100	84.3	92.9	42.9	42.9	12.9	1.4
Non-BIA School 2^1,4,6	96	51.0	25	97.9	88.5	96.9	55.2	35.4	9.4	0
Non-BIA School 3^1,3,4,5	97	48.5	24	97.9	76.3	90.7	44.3	35.1	13.4	7.2
Non-BIA School 4^1,4,5,6	47	55.3	20	100	83.0	91.5	61.7	21.3	14.9	2.1
Non-BIA School 5^2,3,4,5	74	51.4	24	97.3	79.7	98.6	44.6	40.5	12.2	2.7
Overall	384	53.2	23.8	98.6	82.4	94.1	49.7	35.0	12.6	2.7

Note. Comparison schools matched at least one of the BIA schools (indicated by superscript numbers) on all demographic characteristics (alpha level = 0.05). Superscripts show that there were no significant differences between comparison schools and corresponding BIA schools on all variables. Overall demographic characteristics between BIA and comparison schools did not significantly differ. EL = English learner; FRPL = free or reduced-priced lunch; HS = high school.

Table 2.

School-Level First-Grade DIBELS Performance in BIA and Comparison Schools (AY 2018–2019).

School	Fall NWF-correct letter sound scores					Spring ORF words correct scores
School	n	M	SD	Range	% scoring zero	n	M	SD	Range	% scoring zero
Biliterate instructional assistant (BIA)
BIA School 1	73	31.4	18.7	0–98	2.7	73	47.5	30.3	0–140	4.1
BIA School 2	82	24.7	15.7	0–71	3.7	82	54.3	28.4	0–135	1.2
BIA School 3	69	40.7	29.6	0–143	1.5	69	61.1	36.1	0–146	1.5
BIA School 4	110	26.2	19.3	0–105	3.6	110	42.3	30.5	0–139	0.9
BIA School 5	70	26.2	21.6	0–143	7.1	70	40.2	27.7	6–111	0
BIA School 6	77	21.3	12.7	0–60	1.3	77	44.2	26.6	10–118	0
Overall	481	28.4	19.6	0–143	3.3	481	48.3	29.9	0–159	1.3
Comparison
Non-BIA School 1^1,2,4,5,6	70	25.7	17.4	0–100	2.9	70	37.3	28.5	5–104	0
Non-BIA School 2^1,2,4,5	96	29.2	16.9	3–91	0	96	45.0	31.0	2–107	0
Non-BIA School 3^1,2,4,5	97	33.6	18.6	3–117	0	97	41.7	31.8	0–127	2.1
Non-BIA School 4^1,3	47	29.4	20.4	0–123	2.1	47	50.9	36.0	0–143	4.3
Non-BIA School 5^1,3	74	33.7	21.9	0–110	1.4	74	51.0	28.3	2–115	0
Overall	384	30.3	19.0	0–123	1.3	384	45.2	31.1	0–143	1.3

Note. Comparison schools matched at least one of the BIA schools (indicated by superscript numbers) on fall of 2018 test scores (alpha level = 0.05). Superscripts show that there were no significant differences between comparison schools and corresponding BIA schools on all variables. Overall test scores between BIA and comparison schools did not significantly differ in fall or spring. DIBELS = dynamic indicators of basic early literacy skills; NWF = Nonsense word fluency; ORF = oral reading fluency; SD = standard deviation.

Table 1 shows that within each school included in the sample (n = 11), more than 97% of students were Latina/o, a large percentage were English Learners (68–91%), and more than 84% qualified for free or reduced-price lunch. Overall, BIA and comparison schools did not differ significantly on demographic characteristics and test scores at the beginning of the implementation year (2018–2019). Superscripts show that each comparison school matched many of the BIA schools on all variables. The overall statistics for the two groups of schools (BIA and comparison) also matched quite well.

Table 2 shows each school’s average fall 2018 and spring 2019 first-grade scores on the DIBELS nonsense word fluency and oral reading fluency subtests, respectively. Overall, the program schools began the year about two points below the comparison schools and ended the year about three points above the comparison schools, suggesting the likelihood of a positive program effect. This is tested more formally below.

As for program implementation, biliterate instructional assistants (n = 27) were all female, except for one male participant, and all identified as Latina/o. Between three and five BIAs were placed at each of the selected schools corresponding with the number of first-grade classrooms at each site. In accordance with federal and state policy, hiring criteria required all BIAs to have at least an associate of arts (A.A.) degree or 48 college or university units. Of the 27 BIAs interviewed, 70% of them had bachelor’s degrees, two were credentialed teachers, another three were pursuing their bachelor’s degree, and the remainder had their associate of arts degree. Given the large percentage of Spanish-speaking students within the district, BIAs were also required to pass a Spanish language proficiency exam to be eligible for hiring.

Prior to data collection, this study was approved by the Institutional Review Board in the Office of Research at the University. Approval was also obtained by the Research and Evaluation office at the participating school district. Participating teachers, paraprofessionals, and school leaders provided informed consent during an initial meeting where they were given more information about the study.

Measures

Students’ standardized scores on district-administered reading assessments were used to assess the impact of BIAs on reading outcomes. The Nonsense Word Fluency (NWF) subtest of the Dynamic Indicators of Basic Early Literacy Skills (DIBELS; University of Oregon, 2018) is administered to first graders at the beginning of each school year. This measure assesses letter–sound correspondence and students’ ability to blend basic vowel-consonant and consonant-vowel-consonant words. The reliability estimate for this measure is .94, the median concurrent validity with the Woodcock-Johnson Psycho-Educational Battery is 0.51, and with the Stanford Binet Verbal Reasoning and Abstract/Visual tests is 0.30 and 0.32, respectively (Good et al., 2004).

The DIBELS Oral Reading Fluency (ORF) subtest was administered to first graders at the end of each school year. Students were asked to read a short passage, and their score was the total number of words they read correctly in 1 min. Alternate-form reliability for the ORF is above .90, and concurrent validity ranges between 0.92 and 0.96 (Good et al., 2004). The DIBELS tests were administered by school staff, including school psychologists and certified teachers. Demographic data were also collected by the district and include EL status, FRPL status, parent education level, and whether the student was eligible for special education.

Analytic Design

To assess whether BIAs had a positive impact on the average first-grade reading performance of students within selected schools (RQ1), BIA and comparison schools’ average spring of 2017 to 2019 DIBELS scores were used in short CITS (Hallberg et al., 2018) analysis, controlling for their fall scores each year. The CITS design allows for differences in initial performance between treatment and comparison schools as long as their school-level achievement followed parallel trends during the academic years 2016–2017 and 2017–2018, prior to the implementation of the program. This is known as the parallel trends assumption (Mora & Reggio, 2013). This can be understood through a causal framework where the counterfactual condition is predicted based on preprogram slopes. In other words, school outcomes during the postprogram period (Spring of 2019) for both BIA and comparison schools are projected from their preprogram trends (Spring of 2017 and 2018) so that any significant changes in the postprogram slopes of BIA but not comparison schools’ test scores can be attributed to the program. By comparing test score changes in BIA and comparison schools, any time-invariant school characteristics (both observed and unobserved) among the two groups of schools are differenced out of the equation. Thus, as long as any differences in the preprogram slopes are appropriately accounted for, CITS can yield unbiased program effects.

Prior to running the CITS model, the parallel trends assumption was tested by graphing BIA and comparing schools’ average reading performance gains during the preprogram and postprogram period with academic year on the x-axis and average standardized gains on the y-axis (see Figure 1). A visual inspection of this graph clearly depicts the parallel trends of BIA and comparison schools during the 2 years prior to the implementation of the program. A significance test of the null hypothesis that the slopes were identical was run, H₀: b = b₁—b₂ = 0, resulting in b = 0.08, t = 0.18, p = .86 and provided confidence in using CITS analysis to evaluate the impact of the program, given the parallel trends of both groups during the preprogram period.

Figure 1.

Preprogram and Postprogram Trends of BIA and Comparison Schools.

CITS analysis of school-level data

This study utilizes the baseline mean model, which is the simplest modeling approach and is characterized by the following equation,

\begin{array}{l} Y_{jt} = β_{0} + β_{1} {POST}_{t} + β_{2} {PRO}_{j} + β_{3} {POST}_{t} {PRO}_{j} \\ + β_{4} {FALL}_{j t} + β_{5} {EL}_{j t} + v_{j} + u_{j t}, \end{array}

(1)

where . $Y$ _jt is the average spring reading outcome for school j at time t; $β$ ₀ is the intercept for the average spring reading performance of comparison schools during the preprogram period; POST_t is a dichotomous indicator of whether year t is a preprogram or postprogram year (1 = postprogram year); $β$ ₁ is the average difference in the spring reading outcomes between preprogram and postprogram years; PRO_j is a dichotomous indicator of whether school j received the program; $β$ ₂ is the average difference in performance between BIA and comparison schools during preprogram years; POST_tPRO_j is an interaction term identifying BIA schools after the program was implemented; FALL_jt is average fall reading performance for school j during year t; EL_jt is the percentage of ELs for school j during year t; v_j is a school-level random error term; and u_jt is a random error term. $β$ ₃ is the estimate of program effects assuming all BIA schools and all comparison schools share the same trend, respectively. This model was also adjusted for clustering at the school level using robust standard errors. Furthermore, to reduce bias arising from the small number of school clusters (n = 11), a bias-reduced linearization (BRL) estimator was also calculated using the cluster-robust (sandwich) variance estimator command in STATA (Bell & McCaffrey, 2002).

Regression analysis of student-level data

To provide a second estimate of the impact of BIAs on student performance (RQ2), multiple regression analysis was conducted using individual-level data with the following equation,

Y i = β_{0} + β_{1} {FALL}_{i} + β_{2} {BIA}_{i} + \dots + β_{k} {Xk}_{k} + u_{i} .

(2)

In this equation, $Y$ _i is student i’s spring DIBELS score; $β$ ₀ is a constant term; FALL_i is student i’s fall DIBELS score; BIA_i is whether student i attended a school with BIAs; X represents student-level demographic characteristics (i.e., EL, FRPL, parent education level, and eligibility for special education); and u_i is an error term. In this model, $β$ ₂ is the standardized regression coefficient estimate for the predictive relationship between spring reading performance and attending a school with BIAs in comparison to attending matched schools that did not receive BIAs, controlling for fall reading scores and demographic characteristics. In addition, robust standard errors are estimated in this model to account for heteroskedasticity and the clustering of students in classrooms.

Results

Table 3 presents the results of the CITS analysis and estimates of the parameters in Equation 1. For the six BIA and five comparison schools, the equation predicts first-grade spring test scores for two preprogram years (2017 and 2018) and one postprogram year (2019). After controlling for schools’ average DIBELS Nonsense Word Fluency scores in the fall and percentage of ELs during any given year, schools who received BIAs averaged .825 of a standard deviation higher than controls on the DIBELS Oral Reading Fluency subtest administered in the spring, and this was a marginally significant finding (p < .10; Model 3). This p value is considered acceptable, given the small number of clusters and considering this was a pilot study. Although the two groups of schools followed parallel trends prior to the implementation of the program (2016–2017 and 2017–2018), during the implementation year (2018–2019), BIA schools exhibited steeper growth in reading performance when compared with matched comparison schools (see Figure 1).

Table 3.

CITS Estimates Predicting Schools’ Average DIBELS Oral Reading Fluency Standardized Scores in Spring 2019.

Variables	Model 1	Model 2	Model 3
Postprogram year	−0.304 (0.307)	−0.526 (0.552)	−1.553*** (0.391)
Biliterate instructional assistant (BIA) school	0.206 (0.446)	0.070 (0.402)	0.342 (0.412)
Postprogram year × BIA School^a		0.409 (0.657)	0.825† (0.430)
Average Fall DIBELS Nonsense Word Fluency scores (standardized)			0.649*** (0.188)
% EL (standardized)			−0.898*** (0.237)
Constant	−0.011 (0.268)	0.063 (0.309)	0.181 (0.291)
n	33	33	33
R ²	.032	.041	.509

Note. Schools’ spring DIBELS performance in 2019 was compared with performance in prior years (2017 and 2018). CITS = comparative interrupted time-series; DIBELS = dynamic indicators of basic early literacy skills; BIA = biliterate instructional assistants; EL = English learners.

The impact of the program is represented by the coefficient estimates for the interaction term (Postprogram Year × BIA School) in Models 2 and 3, controlling for schools’ fall scores and Percentage of EL each year. Standard error in parentheses.

†

p < .10. ***p < .001.

Descriptive statistics for students with complete data within BIA and comparison schools are found in Table 4. Overall, students within these schools were largely from Spanish-speaking homes with 82% of them classified as English learners, 93% qualified for the free or reduced-price lunch program, and a majority of their parents had a high school diploma (36%), or did not graduate from high school (49%). Students in BIA and comparison schools gained approximately 20 and 14 raw score points, respectively, from fall to spring on reading tests suggesting that the BIAs had a positive influence on students’ test scores.

Table 4.

Descriptive Statistics for Student-Level Analysis.

Variables	Students in comparison schools (n = 384)				Students in BIA schools (n = 481)				Overall (N = 865)
Variables	M	SD	Min.	Max.	M	SD	Min.	Max.	M	SD
DIBELS NWF scores (Fall)	30.55	19.05	0	123	28.01	20.74	0	143	29.14	20.03
DIBELS ORF scores (Spring)	44.65	31.17	0	143	47.85	30.69	0	146	46.43	30.93
English learner	0.82	0.38	0	1	0.82	0.39	0	1	0.82	0.38
FRPL	0.94	0.23	0	1	0.92	0.27	0	1	0.93	0.26
Less than a high school degree	0.49	0.50	0	1	0.49	0.50	0	1	0.49	0.50
High school diploma	0.36	0.48	0	1	0.36	0.48	0	1	0.36	0.48
Some college	0.12	0.33	0	1	0.13	0.33	0	1	0.12	0.33
College graduate	0.03	0.17	0	1	0.03	0.16	0	1	0.03	0.16
Eligible for special education	0.08	0.27	0	1	0.12	0.33	0	1	0.10	0.31

Note. BIA = biliterate instructional assistants; DIBELS = dynamic indicators of basic early literacy skills; NWF = nonsense word fluency; ORF = oral reading fluency; FRPL = free or reduced-price lunch status.

Table 5 shows the results of the student-level regression analysis using complete data as well as multiple imputation results used to account for missing data. After controlling for students’ demographic characteristics and fall test scores, students within BIA schools performed .193 of a standard deviation higher on the spring DIBELS compared with their peers in comparison schools, and this was a significant finding (p < .05; Model 1). Likewise, the results from the multiple imputation analysis using all available cases yielded nearly the same estimate. In this model, students in BIA schools compared with those in non-BIA schools performed .195 of a standard deviation higher on spring DIBELS scores, controlling for fall scores and demographics, and this was also a significant finding (p < .05; Model 2). Thus, the school-level CITS (Equation 1) and the student-level fall to spring analyses both yielded positive program effects, significant at the p < .10 and p < .05 levels, respectively.

Table 5.

Regression Estimates Predicting First Graders’ Spring DIBELS Oral Reading Fluency Scores.

Variables	Model 1	Model 2
Fall DIBELS Nonsense Word Fluency score	0.657*** (0.027)	0.656*** (0.027)
School with BIAs	0.193* (0.088)	0.195* (0.085)
English learner	−0.119 (0.079)	−0.110 (0.075)
Free or reduced-price lunch status	−0.075 (0.108)	−0.098 (0.103)
Parent education level
Less than a high school degree	−0.087 (0.054)	−0.078 (0.053)
Some college	0.048 (0.084)	0.107 (0.075)
College graduate	−0.148 (0.144)	−0.106 (0.141)
Eligible for special education	−0.242* (0.096)	−0.230* (0.097)
Constant	0.116 (0.138)	0.119 (0.133)
N	865	1,009
R ²	.464	—

Note. Model 1 includes all first graders within BIA and comparison schools with complete data on key variables and includes cluster-robust (sandwich) variance estimators. Model 2 uses multiple imputation with 20 imputed datasets, thereby analyzing all available cases and includes cluster-robust variance estimators. The reference group for Parent Education Level is parents with a high school diploma. Fall and spring test scores are standardized. Standard error in parentheses. DIBELS = dynamic indicators of basic early literacy skills; BIA = biliterate instructional assistants.

p < .05. ***p < .001.

Discussion

We used two methods to estimate the effects of biliterate paraprofessionals serving as instructional aides to first-grade teachers on student reading performance in the lowest-performing elementary schools in an almost entirely Latina/o, low-income district. The CITS analysis, comparing school-level average test scores for BIA and comparison schools before and after the program, yielded a large, positive effect, ES = .83 SD, approaching significance at p < .10. The analysis using students as the unit of analysis and comparing fall to spring test score gains for students in BIA and comparison schools during the program implementation year yielded a positive effect, ES = .19 SD, significant at p < .05.

The magnitude of the impact of the BIA program on DIBELS ORF scores aligns well with prior research on the effectiveness of small-group and one-to-one tutoring. For example, Vadasy and Sanders (2011) found a supplemental phonics program had a significant effect on language minority students’ reading fluency (ES = 0.18 SD). Similarly, Vaughn et al. (2006) found a small-group reading tutoring program serving Spanish-English bilingual students had a positive impact on a range of literacy skills, although the effect (ES = 0.18 SD) on DIBELS reading fluency was nonsignificant at p < .05. Despite the substantial variation of implementation features across schools, the BIAs had a large positive impact (ES = 0.83 SD, p < .10) on schools’ aggregated reading performance, lending support to the district’s decision to hire paraprofessionals as an evidence-based approach to raising students’ reading performance at low-performing schools.

Study Limitations

The study had at least four limitations. First, the findings of a positive program impact would have been more definitive if the program had been studied across more grade levels and more years of implementation. Second, estimated program effects would have been better protected against selection bias if an experimental design had been used, by randomly assigning schools, classrooms within schools, or students within classrooms to treatment or control status. Instead, matched control schools were used to estimate the counterfactual. However, the matching was good, and if any bias was involved, it should have acted against finding a program effect, as the program was implemented in the lowest-performing schools. On the positive side, the data met the CITS requirement for parallel slopes in the preprogram period. Two separate analyses—the CITS analysis comparing test score averages for BIA and comparison schools before and after the program implementation, and the student-level analysis comparing fall to spring test score gains for students in BIA and comparison schools—gave positive effect estimates, significant at the p < .10 level and the p < .05 level, respectively.

Third, reading performance in this study was assessed using the DIBELS oral reading fluency subtest. A more complete analysis of the program’s impact on reading performance would include other measures of different reading components, such as phonics, phonemic awareness, vocabulary/background knowledge, word recognition, reading comprehension, spelling, and Spanish-English language proficiency. As in prior studies, results may vary depending on the choice of reading skill and its measurement instrument. Students were also observed receiving instructional support in writing, mathematics, science, and art activities throughout the week. Thus, a more comprehensive review of the program’s impact would have employed a more comprehensive set of measures. Finally, external validity was limited by the restriction of the study to a single school district in Southern California. Replication in other, similar districts would increase the generalizability of the findings.

Implications for Practice

Despite the limitations, the results of this study are promising. They suggest that large-scale, district-administered supplemental reading instruction delivered by biliterate paraprofessionals may improve student performance in a cost-effective way. More importantly, these findings indicate that Latino students and ELs can be properly supported in terms of their reading development by providing them with individualized or small-group supplemental instruction tailored to their individual needs. Findings also suggest that policy efforts should aim toward providing more schools with extra funding and teachers with extra support and assistance, particularly those with larger class sizes and greater numbers of students with learning needs. Federal grants could also fund and expand this research to widen the scope of students benefiting from such evidence-based reading programs as the one presented in this study. It is important to provide supplemental instruction to Latino students and ELs during the early grades when they are building foundational literacy skills as doing so can reduce the prevalence of subsequent reading difficulties and promote these students’ long-term reading achievement.

Bilingual paraprofessionals could also serve as language brokers for families by communicating with parents about student progress and offering guidance on how to better support literacy learning at home. For instance, Kosanovich et al. (2021) provide practitioners with specific recommendations on strategies parents could utilize at home to support literacy learning. Paraprofessionals could collaborate and assist teachers with preparing home literacy activities and explain to families how to engage with their child in an activity. Extending children’s learning time outside the classroom and providing them with greater opportunities to practice literacy skills at home would have a positive impact on their reading performance as well as engage families as partners in their child’s learning.

Still, more research is needed in identifying effective strategies bilingual paraprofessionals can use to harness students’ linguistic strengths and promote their literacy skills as well as their role in meeting students’ social–emotional and psychological needs. In addition, more evidence on the effectiveness of different implementation features (e.g., optimal group size, frequency and intensity of supplemental instruction, language scaffolding, and family involvement) may provide further guidance to other school and district leaders who are considering hiring paraprofessionals to supplement their core reading instruction and improve student outcomes.

Footnotes

Declaration of Conflicting Interests

The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.

Funding

This research was supported in part by grants from the National Science Foundation Graduate Research Fellowship (grant no. DGE-1839285).

ORCID iD

Melina Aurora

References

August

Shanahan

(Eds.). (2006). Developing literacy in second-language learners: Report of the national literacy panel on language-minority children and youth. Lawrence Erlbaum.

Bell

R. M.

McCaffrey

D. F.

(2002). Bias reduction in standard errors for linear regression with multi-stage samples. Survey Methodology, 28(2), 169–181.

Bonner

P. J.

Pacino

M. A.

Stanford

B. H.

(2011). Transition from paraprofessionals to bilingual teachers: Latino voices and experiences in education. Journal of Hispanic Higher Education, 10(3), 212–225. https://doi.org/10.1177/1538192711403483

Causton-Theoharis

J. N.

Giangreco

M. F.

Doyle

M. B.

Vadasy

P. F.

(2007). The “Sous Chefs” of literacy instruction. TEACHING Exceptional Children, 40(1), 56–62. https://doi.org/10.1177/004005990704000107

Cheung

A. C. K.

Slavin

R. E.

(2012). Effective reading programs for Spanish-dominant English language learners (ELLs) in elementary grades: A synthesis of research. Review of Educational Research, 82(4), 351–395. https://doi.org/10.3102/0034654312465472

Dorta-Duque de Reyes

Fernandez

Klein

Smith

& Benchmark Education Company. (2017). Benchmark advance: Grades K-6. Benchmark Education Company.

Every Student Succeeds Act (ESSA). (2015). 20 U.S.C. § 6301 et seq.. https://www.congress.gov/114/plaws/publ95/PLAW-114publ95.pdf

Foorman

B. R.

Torgesen

(2001). Critical elements of classroom and small-group instruction promote reading success in all children. Learning Disabilities Research & Practice, 16, 203–212. https://doi.org/10.1111/0938-8982.00020

French

N. K.

(2001). Supervising paraprofessionals: A survey of teacher practices. The Journal of Special Education, 35(1), 41–53. https://doi.org/10.1177/002246690103500105

10.

Gersten

Compton

Connor

C. M.

Dimino

Santoro

Linan-Thompson

Tilly

W. D.

(2008). Assisting students struggling with reading: Response to intervention and multi-tier intervention for reading in the primary grades. A practice guide (NCEE 2009-4045). National Center for Education Evaluation and Regional Assistance, Institute of Education Sciences, U.S. Department of Education. https://ies.ed.gov/ncee/wwc/PracticeGuide/3

11.

Gersten

Newman-Gonchar

R. A.

Haymond

K. S.

Dimino

(2017). What is the evidence base to support reading interventions for improving student outcomes in grades 1–3? (REL 2017–271). U.S. Department of Education, Institute of Education Sciences, National Center for Education Evaluation and Regional Assistance, Regional Educational Laboratory Southeast. https://files.eric.ed.gov/fulltext/ED573686.pdf

12.

Giangreco

M. F.

(2003). Working with paraprofessionals. Educational Leadership, 61(2), 50–53.

13.

Giangreco

M. F.

Suter

J. C.

Doyle

M. B.

(2010). Paraprofessionals in inclusive schools: A review of recent research. Journal of Educational and Psychological Consultation, 20(1), 41–57. https://doi.org/10.1080/10474410903535356

14.

Goe

Matlach

(2014). Supercharging student success: Policy levers for helping paraprofessionals have a positive influence in the classroom [Policy Snapshot]. Center on Great Teachers & Leaders at American Institute for Research.

15.

Good

R. H.

Kaminski

R. A.

Shinn

Bratten

Shinn

Laimon

Smith

Flindt

(2004). Technical adequacy of DIBELS: Results of the Early Childhood Research Institute on measuring growth and development (Technical Report, No. 7). University of Oregon.

16.

Hakuta

Butler

G. Y.

Witt

(2000). How long does it take learners to attain English proficiency? University of California Linguistic Minority Research Institute.

17.

Hallberg

Williams

Swanlund

Eno

(2018). Short comparative interrupted time series using aggregate school-level data in education research. Educational Researcher, 47(5), 295–306. https://doi.org/10.3102/0013189X18769302

18.

Jones

B. T.

Erchul

W. P.

Geraghty

C. A.

(2020). Supplemental reading interventions implemented by paraprofessionals: A meta-analysis. Psychology in the Schools, 58, 723–741. https://doi.org/10.1002/pits.22427

19.

Kosanovich

Lee

Foorman

(2021). A first grade teacher’s guide to supporting family involvement in foundational reading skills (REL 2021-042). Regional Educational Laboratory Southeast, Institute of Education Sciences. https://files.eric.ed.gov/fulltext/ED608239.pdf

20.

Lewis

K. C.

(2005). Seen but not heard: ESEA and instructional aides in elementary education. Review of Research in Education, 29, 131–149. https://www.jstor.org/stable/3568122

21.

Mason

R. A.

Gunersel

A. B.

Irvin

D. W.

Wills

H. P.

Gregori

Z. G.

Ingram

P. B.

(2020). From the frontlines: Perceptions of paraprofessionals’ roles and responsibilities. Teacher Education and Special Education, 44(2), 97–116. https://doi.org/10.1177/0888406419896627

22.

McNeish

Stapleton

L. M.

Silverman

R. D.

(2017). On the unnecessary ubiquity of hierarchical linear modeling. Psychological Methods, 22(1), 114–140. https://doi.org/10.1037/met0000078

23.

Mora

Reggio

(2013, November 1–28). Treatment effect identification using alternative parallel assumptions. Working Papers, 12–33. Universidad Carlos III de Madrid.

24.

National Reading Panel (U.S.) & National Institute of Child Health and Human Development (U.S.). (2000). Report of the national reading panel: Teaching children to read: An evidence-based assessment of the scientific research literature on reading and its implications for reading instruction. U.S. Department of Health and Human Services, Public Health Service, National Institutes of Health, National Institute of Child Health and Human Development.

25.

Neitzel

Lake

Pellegrini

Slavin

(2022). A synthesis of quantitative research on programs for struggling readers in elementary schools. Reading Research Quarterly, 57(1), 149–179. https://doi.org/10.1002/rrq.379

26.

Reardon

S. F.

Portilla

X. A.

(2016). Recent trends in income, racial, and ethnic school readiness gaps at kindergarten entry. AERA Open, 2(3), 1–18. https://doi.org/10.1177/2332858416657343

27.

Richards-Tutor

Baker

D. L.

Gersten

Baker

S. K.

Smith

J. M.

(2016). The effectiveness of reading interventions for English learners: A research synthesis. Exceptional Children, 82(2), 144–169. https://doi.org/10.1177/0014402915585483

28.

Samson

Hines

(2015). Effective use of paraprofessionals as early intervention reading tutors in grades K-3. Mentoring & Tutoring: Partnership in Learning, 23, 164–177. https://doi.org/10.1080/13611267.2015.1049014

29.

Schneider

Martinez

Owens

(2006). Barriers to educational opportunities for Hispanics in the U.S. In Tienda

(Ed.), Hispanics and the future of America (pp. 179–227). National Academies Press.

30.

Shefelbine

J. L.

Aldridge

(2013). SIPPS: Systematic instruction in phonological awareness, phonics, and sight words. Developmental Studies Center.

31.

University of Oregon, Center on Teaching and Learning. (2018). Understanding the research behind DIBELS® 8th edition (Technical Report 1801).

32.

U.S. Department of Education, Institute of Education Sciences. (2007). Description and employment criteria of instructional paraprofessionals (Issue Brief 2007-008). https://nces.ed.gov/pubs2007/2007008.pdf

33.

U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics (NCES). (2021). Racial/ethnic enrollment in public schools. https://nces.ed.gov/programs/coe/pdf/2021/cge_508c.pdf

34.

U.S. Department of Education, Institute of Education Sciences, What Works Clearinghouse. (2014). Beginning reading: Open court reading (WWC Intervention Report). https://ies.ed.gov/ncee/wwc/Docs/InterventionReports/wwc_opencourt_102114.pdf

35.

Vadasy

P. F.

Sanders

E. A.

(2011). Efficacy of supplemental phonics-based instruction for low-skilled first graders: How language minority status and pretest characteristics moderate treatment response. Scientific Studies of Reading, 15(6), 471–497. https://doi.org/10.1080/10888438.2010.501091

36.

Vaughn

Mathes

Linan-Thompson

Cirino

Carlson

Pollard-Durodola

Cardenas-Hagan

Francis

(2006). Effectiveness of an English intervention for first-grade English language learners at risk for reading problems. Elementary School Journal, 107(2), 153–180. https://doi.org/10.1086/510653

Paraprofessional Instructional Assistants Raise the Reading Performance of Latina/o First Graders in a Low-Income District

Abstract

Keywords

Literature Review

Effective reading instruction

Supplemental reading instruction

Supplemental reading instruction for ELs

Paraprofessionals as reading tutors

Current Study

Program delivery

BIA training

Instructional content

Instructional delivery

Data and Method

Participants

Measures

Analytic Design

CITS analysis of school-level data

Regression analysis of student-level data

Results

Discussion

Study Limitations

Implications for Practice

Footnotes

Declaration of Conflicting Interests

Funding

ORCID iD

References