Meta-analysis is often assumed to be the sine qua non of quantitative research. However, face validity of published meta-analyses in emotional or behavioral disorders (E/BD), as in other areas, can be substantially impacted by the information supplied. The quality of information reported, therefore, can also have important implications for theory and practice. This analytical narrative review summarizes and examines 36 E/BD meta-analyses across six domains of information necessary for securing face validity. Results indicate a wide variation in the amount of reported data similar to other analyses of the meta-analytical literature in special education.
Get full access to this article
View all access options for this article.
References
1.
*AchenbachT. M., McConaughyS. H., & HowellC. T. (1987). Child/adolescent behavioral and emotional problems: Implications of cross-informant correlations for situational specificity.Psychological Bulletin, 101, 213–232.
2.
*AllisonD. B., FaithM. S., & FranklinR. D. (1995). Antecedent exercise in the treatment of disruptive behavior: A meta-analytic review.Clinical Psychology—Science and Practice, 2, 279–304.
3.
*AngR. P., & HughesJ. N. (2002). Differential benefits of skills training with antisocial youth based on group composition: A meta-analytic investigation.School Psychology Review, 31, 164–186.
4.
*BeelmanA., PfingstenU., & LoselF. (1994). Effects of training social competence in children: A metaanalysis of recent evaluation studies.Journal of Clinical Psychology, 23, 260–271.
5.
*BuehlerC., AnthonyC., KrishnkumarA., StoneG., GerardJ., & PembertonS. (1997). Interparental conflict and youth problem behaviors: A meta-analysis.Journal of Child and Family Studies, 6, 233–247.
6.
*ConnellA. M., & GoodmanS. H. (2002). The association between psychopathology in fathers versus mothers and children's internalizing and externalizing behavior problems: A meta-analysis.Psychological Bulletin, 128, 746–773.
7.
CooperH. M. (1982). Scientific guidelines for conducting integrative research reviews.Review of Educational Research, 52, 291–302.
8.
CooperH. M., & LindsayJ. J. (1998). Research synthesis and meta-analysis. In BickmanL., & RogD. J. (Eds.), Handbook of applied social research methods (pp. 315–337). Thousand Oaks, CA: Sage.
9.
*de CastroB., VeermanJ. W., KoopsW., BoschJ. D., & MonshouwerH. J. (2002). Hostile attribution of intent and aggressive behavior: A meta-analysis.Child Development, 73, 916–934.
10.
*DenhamS. A., & AlmeidaM. C. (1987). Children's social problem solving skills, behavioral adjustment, and interventions: A meta-analysis evaluation theory and practice.Journal of Applied Developmental Psychology, 8, 391–409.
11.
*DuhigA. M., RenkK., EpsteinM. K., & PharesV. (2000). Interparental agreement on internalizing, externalizing, and total behavior problems: A meta-analysis.Clinical Psychology—Science and Practice, 7, 435–453.
12.
DunnR. (1990). Bias over substance: A critical analysis of Kavale and Forness’ report on modality instruction.Exceptional Children, 56, 352–356.
13.
DunnR., GriggsS. A., OlsonJ., BeasleyA., & GormanB. S. (1995). A meta-analytic validation of the Dunn and Dunn model of learning style preferences.Journal of Educational Research, 88, 353–362.
14.
*DurlakJ. A., FuhrmanT., & LampmanC. (1991). Effectiveness of cognitive-behavior therapy for maladapting children: A meta-analysis.Psychological Bulletin, 110, 204–214.
15.
*DushD. M., HirtM. L., & SchroederH. E. (1989). Self-statement modification in the treatment of child behavior disorders: A meta-analysis.Psychological Bulletin, 106, 97–106.
16.
FornessS. R., KavaleK. A., BlumI. M., & LloydJ. W. (1997). Mega-analysis of meta-analyses: What works in special education and related services.Teaching Exceptional Children, 29(6), 4–9.
17.
*GanongL. H., & ColemanM. (1993). A meta-analytic comparison of self-esteem and behavior problems of stepchildren to children in other family structures.Journal of Divorce and Remarriage, 19(3–4), 143–163.
18.
GaubM., & CarlsonC. L. (1997). Gender differences in ADHD: A meta-analysis and critical review.Journal of the American Academy of Child and Adolescent Psychiatry, 36, 1036–1045.
19.
*GendreauP., GogginC. E., & LawM. A. (1997). Predicting prison misconducts.Criminal Justice and Behavior, 24, 414–431.
20.
GoldringE. B. (1990). Assessing the status of information on classroom organizational frameworks for gifted students.Journal of Educational Research, 83, 313–326.
21.
GreshamF. M. (1998). Social skills training: Should we raze, remodel, or rebuild?Behavioral Disorders, 24, 19–25.
22.
GuzzoR. A., JacksonS. E., & KatzellR. A. (1987). Meta-analysis analysis. In CummingsL. L., & StawB. M. (Eds.), Research in organizational behavior (pp. 407–442). Boston: JAI.
23.
HalvorsenK. T. (1994). The reporting format. In CooperH., & HedgesL. V. (Eds.), Handbook of research synthesis (pp. 425–437). New York: Russell Sage Foundation.
24.
InglisJ., & LawsonJ. S. (1987). Reanalysis of a meta-analysis of the validity of the Wechsler Scales in the diagnosis of learning disability.Learning Disability Quarterly, 10, 198–202.
25.
JacksonG. B. (1980). Methods for integrative reviews.Review of Educational Research, 50, 438–460.
26.
*JoinerT. E., & WagnerK. D. (1996). Parental, child-centered attributions and outcome: A meta-analytic review with conceptual and methodological implications.Journal of Abnormal Psychology, 24(1), 37–52.
27.
KavaleK. A., & DobbinsD. A. (1993). The equivocal nature of special education interventions.Early Child Development and Care, 86, 23–37.
28.
KavaleK. A., & FornessS. R. (1984). A meta-analysis of the validity of the Wechsler Scale profiles and recategorizations: Patterns or parodies?Learning Disability Quarterly, 7, 136–156.
29.
KavaleK. A., & FornessS. R. (1987). Substance over style: Assessing the efficacy of modality testing and teaching.Exceptional Children, 54, 228–239.
30.
KavaleK. A., & FornessS. R. (1990). Substance over style: A rejoinder to Dunn's animadversions.Exceptional Children, 56, 357–361.
31.
KavaleK. A., HirshorenA., & FornessS. R. (1998). Meta-analytic validation of the Dunn and Dunn model of learning style preferences: A critique of what was Dunn.Learning Disabilities Research and Practice, 13, 75–80.
32.
KavaleK. A., MathurS. R., FornessR., RutherfordR. B., & QuinnM. M. (1997). Effectiveness of social skills training for students with behavior disorders: A meta-analysis. In ScruggsT. E., & MastropieriM. A. (Eds.), Advances in learning and behavioral disabilities (pp. 1–28). New York: Elsevier.
33.
*KavaleK., & NyeC. (1984). The effectiveness of drug treatment for severe behavior disorders: A meta-analysis.Behavioral Disorders, 9, 117–130.
34.
LipseyM. W., & WilsonD. B. (1993). The efficacy of psychological, educational, and behavioral treatment.American Psychologist, 48, 1181–1209.
35.
*MastropieriM. A., ScruggsT. E., & CastoG. (1985). Early intervention for behaviorally disordered children: An integrative review.Behavior Disorders Monograph11, 27–35.
36.
*MathurS. R., KavaleK. A., QuinnM. M., FornessS. R., & RutherfordR. B. (1998). Social skills interventions with students with emotional and behavioral problems: A quantitative synthesis of single-subject research.Behavioral Disorders, 23, 193–201.
37.
*McLaughlin-ChengE. (1998). Asperger syndrome and autism: A literature review and meta-analysis.Focus on Autism and Other Developmental Disabilities, 13, 234–246.
38.
*MilesD. R., & CareyG. (1997). Genetic and environmental architecture of human aggression.Journal of Personality and Social Psychology, 72, 207–217.
39.
MostertM. P. (1996). Reporting meta-analyses in earning disabilities.Learning Disabilities Research and Practice, 11, 2–14.
40.
MostertM. P. (2001). Characteristics of meta-analyses reported in mental retardation, learning disabilities, and emotional and behavioral disorders.Exceptionality, 9, 199–225.
41.
MostertM. P. (2003). Meta-analyses in mental retardation.Education and Training in Developmental Disabilities, 38, 229–249.
42.
MostertM. P., & KavaleK. A. (2001). Evaluation of research for usable knowledge in behavioral disorders: Ignoring the irrelevant, considering the germane.Behavioral Disorders, 27, 51–67.
43.
MuellerH. H., MathesonD. W., & ShortR. H. (1983). Bannatyne-recategorized WISC-R patterns of mentally retarded, learning disabled, normal, and intellectually superior children: A meta-analysis.Mental Retardation and Learning Disability Bulletin, 11, 60–78.
44.
*NelsonJ. R., SmithD. J., & DoddJ. (1990). The moral reasoning of juvenile delinquents: A meta-analysis.Journal of Abnormal Child Psychology, 18, 231–239.
45.
*NewcombA. F., BukowskiW. M., & PatteeL. (1993). Children's peer relations: A meta-analytic review of popular, rejected, neglected, controversial, and average sociometric status.Psychological Bulletin, 113, 99–128.
46.
OchoaS. H., & OlivarezA. (1995). A meta-analysis of peer rating sociometric studies of pupils with learning disabilities.Journal of Special Education, 29, 1–19.
47.
*OosterlaanJ., LoganG., & SergeantJ. A. (1998). Response inhibition in AD/HD, CD, comorbid AD/HD+CD, anxious, and control children: A meta-analysis of studies with the stop task.Journal of Child Psychology and Psychiatry and Allied Disciplines, 39, 411–425.
48.
O'ShaughnessyT. E., & SwansonH. L. (1998). Do immediate memory deficits in students with earning disabilities in reading reflect a developmental lag or deficit? A selective meta-analysis of the literature.Learning Disabilities Quarterly, 21, 123–148.
49.
*QuinnM. M., KavaleK. A., MathurS., RutherfordR. B., & FornessS. R. (1999). A metaanalysis of social skill interventions for students with emotional or behavioral disorders.Journal of Emotional and Behavioral Disorders, 7, 54–64.
50.
*ReddyL., Barboza-WhiteheadS., FilesT., & RubelE. (2000). Clinical focus of consultation outcome research with children and adolescents.Journal of Applied School Psychology, 16, 1–22.
51.
*ReidW. J., & CrisafulliA. (1990). Marital discord and child behavior problems: A meta-analysis.Journal of Abnormal Child Psychology, 18, 105–117.
52.
*RheeS. H., & WaldmanI. D. (2002). Genetic and environmental influences on antisocial behavior: A meta-analysis of twin and adoption studies.Psychological Bulletin, 128, 490–529.
53.
*RobinsonT. R., SmithS. W., MillerM. D., & BrownellM. T. (1999). Cognitive behavior modification of hyperactivity-impulsivity and aggression: A meta-analysis of school-based studies.Journal of Educational Psychology, 91, 195–203.
54.
*RothbaumF., & WeiszJ. R. (1994). Parental care-giving and child externalizing behavior in non-clinical samples: A meta-analysis.Psychological Bulletin, 116, 55–74.
55.
*SchneiderB. H. (1992). Didactic methods for enhancing childrens’ peer relations: A quantitative review.Clinical Psychology Review, 12, 363–382.
56.
*SchneiderB. H., & LerouxJ. (1994). Educational environments for the pupil with behavioral disorders: A “best evidence” synthesis.Behavioral Disorders, 19, 192–204.
57.
*ScottiJ. R., EvansI. M., MeyerL. H., & WalkerP. (1991). A meta-analysis of intervention research with problem behavior: Treatment validity and standards of practice.American Journal on Mental Retardation, 96, 233–256.
58.
*ScruggsT. E., MastropieriM. A., CookS. B., & EscobarC. (1986). Early intervention for children with conduct disorders: A quantitative synthesis of single-subject research.Behavioral Disorders, 11, 260–271.
59.
*SkibaR., & CaseyA. (1985). Interventions for behaviorally disordered students: A quantitative review and methodological critique.Behavioral Disorders, 11, 239–252.
60.
*SkibaR. J., CaseyA., & CenterB. A. (1985-1986). Nonaversive procedures in the treatment of classroom behavior problems.Journal of Special Education, 19, 459–481.
61.
SutherlandK. S., & WehbyJ. H. (2001). Exploring the relationship between increased opportunities to respond to academic requests and the academic and behavioral outcomes of students with E/BD.Remedial and Special Education, 21, 13–121.
62.
SwansonH. L. (1996). Meta-analysis, replication, social skills, and learning disabilities.Journal of Special Education, 30, 213–221.
63.
SwansonH. L. (1999). Interventions for students with learning disabilities: A meta-analysis of treatment outcomes.New York: Guilford.
64.
SwansonH. L., CarsonC., & Saches-LeeC. M. (1996). A selective synthesis of intervention research for students in learning disabilities.School Psychology Review, 25, 370–391.
65.
SwansonH. L., & MaloneS. (1992). Social skills and learning disabilities: A meta-analysis of the literature.School Psychology Review, 21, 427–443.
66.
SwansonJ. M., McBurnettK., WigalT., PfiffnerL. J., LernerM. A., WilliamsL. (1993). Effect of stimulant medication on children with attention deficit disorder: A “review of reviews.”Exceptional Children, 60, 154–162.
67.
WhiteW. A. T. (1988). A meta-analysis of the effects of direct instruction in special education.Education and Treatment of Children, 11, 364–374.
68.
*WhiteheadJ. T., & LabS. P. (1989). A meta-analysis of juvenile correctional treatment.Journal of Research in Crime and Delinquency, 26, 276–295.
69.
WhitleyB. E., & FriezeI. H. (1985). Children's causal attributions for success and failure in achievement settings: A meta-analysis.Journal of Educational Psychology, 77, 608–616.
70.
WilsonD. A., GallagherC. A., & MacKenzieD. L. (2000). A meta-analysis of corrections-based education, vocation, and work programs for adult offenders.Journal of Research in Crime and Delinquency, 37, 347–368.
71.
*WilsonD. B., GottfredsonD. C., & NajakaS. S. (2001). School-based prevention of problem behavior: A meta-analysis.Journal of Quantitative Criminology, 17, 247–272.
72.
*WilsonS. J., LipseyM. W., & DerzonJ. (2003). The effects of school-based intervention programs on aggressive behavior: A meta-analysis.Journal of Consulting and Clinical Psychology, 71, 136–149.
