Preliminary Psychometrics of the Participatory Evaluation and Expert Review for Classrooms Serving Students with Emotional/Behavioral Disabilities (PEER-EBD)
Restricted accessResearch articleFirst published online May, 2013
Preliminary Psychometrics of the Participatory Evaluation and Expert Review for Classrooms Serving Students with Emotional/Behavioral Disabilities (PEER-EBD)
The quality of classrooms serving students with emotional and behavioral disabilities (EBD) is a continuing concern because of its influence on students’ educational outcomes. Program evaluation of classrooms for students with EBD has been a recommended practice for many years since Grosenick, George, and George (1987) conducted their national study. One current approach to program evaluation has been the inclusion of classroom and school staff in a process known as participatory evaluation. The development of a program evaluation instrument, known as the Participatory Evaluation and Expert Review for Classrooms Serving Students with EBD (PEER-EBD), is reviewed in this article. This study evaluated the psychometric properties of validity and reliability for the PEER-EBD. An extensive literature review and subsequent evaluation by an expert panel established the content validity of the instrument. Data collected from 145 educators in 23 classrooms serving students with EBD revealed that the PEER-EBD has excellent internal consistency reliability. Finally, a confirmatory factor analysis supported the four-factor theoretical model of the PEER-EBD and suggested that the instrument has acceptable construct validity. These initial results suggest that the PEER-EBD has promise as a tool to help school staff self-evaluate their services, identify program strengths, and identify the areas that need further improvement.
Get full access to this article
View all access options for this article.
References
1.
BentlerP. M. (2005). EQS 6 structural equations program manual.Encino, CA: Multivariate Software.
2.
BorensonL. (2006). Effective programs for students with emotional behavioral disabilities (EBD). Retrieved from Wisconsin Department of Public Instruction website: http://sped.dpi.wi.gov/files/sped/doc/ebdeffprog.doc
3.
ByrneB. M. (2006). Structural equation modeling with EQS: Basic concepts, applications, and programming (2nd ed.). Mahwah, NJ: Erlbaum.
4.
CheneyD., & BarringerC. (1999). A transdisciplinary model for students’ social and emotional development: Creating a context for inclusion. In ScottiJ. R., & MeyerL. H. (Eds.), New directions for behavioral intervention: Principles, models, and practices (pp. 149–174). Baltimore, MD: Paul H. Brookes.
5.
CheneyD., BlumC., & WalkerB. (2004). An analysis of leadership team's perceptions of positive behavior support and the outcomes of typically developing and at-risk students in their schools.Assessment for Effective Intervention30, 7–24.
6.
FilterK. J., & HornerR. H. (2009). Function-based academic interventions for problem behavior.Education and Treatment of Children32(1), 1–19.
7.
FitzpatrickJ. L., SandersJ. R., & WorthenB. R. (2011). Program evaluation: Alternative approaches and practical guidelines (4th ed.). New York: Allyn & Bacon.
8.
GliemJ. A., & GliemR. R. (2003, October). Calculating, interpreting, and reporting Cronbach's alpha reliability coefficient for Likert-type scales. Paper presented at Midwest Research to Practice Conference in Adult, Continuing, and Community Education, Columbus, OH.
9.
GrosenickJ. K., GeorgeM. P., & GeorgeN. L. (1987). A profile of school programs for the behaviorally disordered: Twenty years after Morse, Cutler, and Fink.Behavioral Disorders12, 159–168.
10.
HarveyV. S. (1996). Educators’ perceptions of effectiveness of programs for students with emotional and behavioral disorders.Behavioral Disorders21(3), 205–215.
11.
JasonM. H. (2008). Evaluating programs to increase student achievement (2nd ed.). Thousand Oaks, CA: Corwin Press.
12.
JonesV., DohrnE., & DunnC. (2004). Creating effective programs for students with emotional and behavior disorders: Interdisciplinary approaches for adding meaning and hope to behavior change interventions.Boston, MA: Allyn & Bacon.
13.
KernL., DelaneyB., ClarkeS., DunlapG., & ChildsK. (2001). Improving the classroom behavior of students with emotional and behavioral disorders using individualized curricular modifications.Journal of Emotional and Behavioral Disorders9(4), 239–247.
14.
KlineR. B. (2005). Principles and practice of Structural Equation Modeling (2nd ed.). New York: Guilford Press.
15.
KnitzerJ., SteinbergZ., & FleischB. (1990). At the schoolhouse door. An examination of programs and policies for children with behavioral and emotional problems.New York: Bank Street College of Education.
16.
LynnM. R. (1986). Determination and quantification of content validity.Nursing Research35(6), 382–386.
17.
NeelR. S., CessnaK., BorockJ., & BechardS. (2003). Quality program indicators for children with emotional and behavioral disorders.Beyond Behavior12(3), 3–9.
18.
NelsonJ. R., BennerG. J., LaneK. L., & SmithB. W. (2004). Academic achievement of K–12 students with emotional and behavioral disorders.Exceptional Children71, 59–73.
19.
NunnallyJ. C. (1978). Psychometric theory (2nd ed.). New York: McGraw-Hill.
20.
PonterottoJ. G., & RuckdeschelD. E. (2007). An overview of coefficient alpha and a reliability matrix for estimating adequacy of internal consistency coefficients with psychological research measures.Perceptual and Motor Skills105, 997–1014.
21.
RaudenbushS. W., & BrykA. S. (2002). Hierarchical linear models for social and behavioral research: Applications and data analysis methods.Newbury Park, CA: Sage.
22.
ReidR., GonzalezJ. E., NordnessP. D., TroutA., & EpsteinM. H. (2004). A meta-analysis of the academic status of students with emotional/behavioral disturbance.The Journal of Special Education38, 130–144.
23.
SpauldingD. T. (2008). Program evaluation: Core concepts and examples for discussion and analysis.San Francisco, CA: Jossey-Bass.
24.
SteinbergZ., & KnitzerJ. (1992). Classrooms for emotionally and behaviorally disturbed students: Facing the challenge.Behavioral Disorders17, 145–156.
25.
StreinerD. L., & NormanG. R. (2008). Health measurement scales–A practical guide to their development and use (4th ed.). Great Clarendon Street, Oxford: Oxford University Press.
26.
TsaiS. (2011). Preliminary psychometrics of the participatory evaluation and expert review for classrooms serving students with emotional/behavioral disabilities. (Doctoral dissertation). University of Washington, Seattle, WA.
WagnerM., & CametoR. (2004). The characteristics, experiences, and outcomes of youth with emotional disturbances.NLTS-2 Data Brief3(2). Minneapolis, MN: National Center on Secondary Education and Transition, University of Minnesota.
29.
WagnerM., FriendM., BursuckW. D., KutashK., DuchnowskiA. J., SumiW. C., & EpsteinM. H. (2006). Educating students with emotional disturbances: A national perspective on school programs and services.Journal of Emotional and Behavioral Disorders14, 12–30.
30.
WalkerB., & FecserF. (2002). Elements of an effective Re-EDucation program for the 21st century.Reclaiming Children and Youth11(2), 110–115.
31.
WalkerB., & FecserF. (2007). Components of a model Re-EDucation classroom for the 21st century. In LongN., MorseW., FecserF., & NewmanR. (Eds.), Conflict in the Classroom (6th ed., pp. 172–185). Austin, TX: ProEd Publications.
32.
WalkerB., & CheneyD. (2007). Participatory Evaluation & Expert Review for Classrooms Serving Students with Emotional and Behavioral Disabilities.Seattle: University of Washington.
33.
ZukoskiA., & LuluquisenE. M. (2002). Participatory Evaluation: What is it? Why do it? What are the challenges?Community-Based Public Health Policy and Practice5, 1–6.
