Valid and reliable teacher ratings serve as the foundation for screening and assessment of youth with behavioral disorders and twin studies offer an opportunity to study those ratings. We conducted a meta-analysis of 15 empirical investigations of aggressive and rule-breaking behavior using teacher ratings in the context of a twin research design. We retrieved n = 53 correlations from n = 7,885 pairs of monozygotic (MZ) twins and n = 67 correlations from n = 11,696 pairs of dizygotic (DZ) twins with two goals: (a) to test the best-fitting models for predicting similarity (correlations) in teacher ratings of MZ and DZ twin pairs and (b) to identify significant predictors in the respective models. We found that, for both MZ and DZ twins, the best-fitting model included all predictors and interactions. In the MZ model, we found a significant positive interaction between the percentage of same teachers who completed the ratings and male twins; in the DZ model, we found a significant negative interaction between the percentage of same teachers who completed the ratings and opposite sex twins. Teacher ratings converged and diverged in expected ways, advancing research in the context of the attributions-bias-context (ABC) model of informant ratings.
AchenbachT. M.McConaughyS. H.HowellC. T. (1987). Child/adolescent behavioral and emotional problems: Implications of cross-informant correlations for situational specificity. Psychological Bulletin, 101, 213–232. https://doi.org/10.1037/0033-2909.101.2.213
2.
AchenbachT. M.RescorlaL. A. (2001). Manual for the ASEBA school-age forms and profiles: An integrated system of multi-informant assessment. University of Vermont.
3.
AdelmanH. S.TaylorL. (2010). Mental health in schools: Engaging learners, preventing problems, and improving schools. Thousand Oaks, CA: Corwin Press.
4.
American Psychological Association Zero Tolerance Task Force. (2008). Are zero tolerance policies effective in the schools? An evidentiary review and recommendations. American Psychologist, 63, 852–862. https://doi.org/10.1037/0003-066X.63.9.852
5.
*ArseneaultL.MoffittT. E.CaspiA.TaylorA.RijsdijkF. V.JaffeeS. R.. . . MeaselleJ. R. (2003). Strong genetic effects on cross-situational antisocial behavior among 5-year-old children according to mothers, teachers, examiner-observers, and twins’ self reports. Journal of Child Psychology and Psychiatry, 44, 832–848. https://doi.org/10.1111/1469-7610.00168
6.
BakerL. A.JacobsonK. C.RaineA.LozanoD. I.BezdjianS. (2007). Genetic and environmental bases of childhood externalizing behavior: A multi-informant twin study. Journal of Abnormal Psychology, 116, 219–235. https://doi.org/10.1037/0021-843X.116.2.219
7.
*BakerL. A.RaineA.LiuJ.JacobsonK. C. (2008). Differential genetic and environmental influences on reactive and proactive aggression in children. Journal of Abnormal Child Psychology, 36, 1265–1278. https://doi.org/10.1007/s10802-008-9249-1
8.
*BarkerE. D.LarssonH.VidingE.MaughanB.RijsdijkF.FontaineN.PlominR. (2009). Common genetic but specific environmental influences for aggressive and deceitful behaviors in preadolescent males. Journal of Psychopathology and Behavioral Assessment, 31, 299–308. https://doi.org/10.1007/s10862-009-9132-6
9.
BartelsM.BoomsmaD. I.HudziakJ. J.van BeijsterveldtT. C. E. M.van den OordE. J. C. G. (2007). Twins and the study of rater dis(agreement). Psychological Methods, 12, 451–466. https://doi.org/10.1037/1082-989X.12.4.451
10.
BradshawC. P.MitchellM. M.O’BrennanL. M.LeafP. J. (2010). Multilevel exploration of factors contributing to the overrepresentation of black students in office disciplinary referrals. Journal of Educational Psychology, 102, 508–520. https://doi.org/10.1037/a0018450
11.
*BrendgenM.DionneG.GirardA.BoivinM.VitaroF.PerusseD. (2005). Examining genetic and environmental effects on social aggression: A study of 6-year-old twins. Child Development, 76, 930–946. https://doi.org/10.1111/j.1467-8624.2005.00887.x
12.
*BrendgenM.VitaroF.BoivinM.DionneG.PerusseD. (2006). Examining genetic and environmental effects on reactive versus proactive aggression. Developmental Psychology, 42, 1299–1312. https://doi.org/10.1037/0012-1649.42.6.1299
13.
BrieschA. M.FergusonT. D.VolpeR. J.BrieschJ. M. (2013). Examining teachers’ perceptions of social-emotional and behavioral referral concerns. Remedial and Special Education, 34, 249–256. http://dx.doi.org/10.1177/0741932512464579
14.
*BullockB. M.Deater-DeckardK.LeveL. D. (2006). Deviant peer affiliation and problem behavior: A test of genetic and environmental influences. Journal of Abnormal Child Psychology, 34, 29–41. https://doi.org/10.1007/s10802-005-9004-9
15.
Campbell Collaboration. (2019). Campbell policies and guidelines series: Campbell systematic reviews: Policies and guidelines (No. 1). https://doi.org/10.4073/cpg.2016.1
16.
ChafouleasS. M.BrieschA. M.Riley-TillmanT. C.ChristT. J.BlackA. C.KilgusS. P. (2010). An investigation of the generalizability and dependability of Direct Behavior Rating Single Item Scales (DBR-SIS) to measure academic engagement and disruptive behavior of middle school students. Journal of School Psychology, 48, 219–246. https://doi.org/10.1016/j.jsp.2010.02.001
ChristT. J.Riley-TillmanT. C.ChafouleasS. M. (2009). Foundation for the development and use of direct behavior rating (DBR) to assess and evaluate student behavior. Assessment for Effective Intervention, 34, 201–213. https://doi.org/10.1177/1534508409340390
19.
Coalition for Psychology in Schools and Education. (2006, August). Report on the Teacher Needs Survey. Center for Psychology in Schools and Education, American Psychological Association.
De Los ReyesA.AugensteinT. M.WangM.ThomasS. A.DrabickD. A. G.BurgersD. E.RabinowitzJ. (2015). The validity of the multi-informant approach to assessing child and adolescent mental health. Psychological Bulletin, 141, 858–900. https://doi.org/10.1037/a0038498
22.
De Los ReyesA.HenryD. B.TolanP. H.WakschlagL. S. (2009). Linking informant discrepancies to observed variations in young children’s disruptive behavior. Journal of Abnormal Child Psychology, 37, 637–652. https://doi.org/10.1007/s10802-009-9307-3
23.
De Los ReyesA.KazdinA. E. (2005). Informant discrepancies in the assessment of childhood psychopathology: A critical review, theoretical framework, and recommendations for further study. Psychological Bulletin, 131, 483–509. https://doi.org/10.1037/0033-2909.131.4.483
24.
De Los ReyesA.ThomasS. A.GoodmanK. L.KundeyS. M. A. (2013). Principles underlying the use of multiple informants’ reports. Annual Review of Clinical Psychology, 9, 123–149.
25.
DenisonD. G.HolmesC. C.MallickB. K.SmithA. F. (2002). Bayesian methods for nonlinear classification and regression. John Wiley.
26.
DirksM. A.De Los ReyesA.Briggs-GowanM.CellaD.WakschlagL. (2012). Annual research review: Embracing not erasing contextual variability in children’s behavior: Theory and utility in the selection and use of methods and informants in developmental psychopathology. Journal of Child Psychology and Psychiatry, 53, 558–574. https://doi.org/10.1111/j.1469-7610.2012.02537.x
27.
EpkinsC. C. (1995). Teachers’ ratings of inpatient children’s depression, anxiety, and aggression: A preliminary comparison between inpatient-facility and community-based teachers’ ratings and their correspondence with children’s self-reports. Journal of Clinical Child Psychology, 24, 63–70. https://doi.org/10.1207/s15374424jccp2401_8
28.
FelsonJ. (2009). What can we learn from twin studies? A comprehensive evaluation of the equal environments assumption [Doctoral dissertation, Pennsylvania State University]. ProQuest Dissertations and Theses Global.
29.
FreemanJ.SimonsenB.GoodmanS.MitchellB.GeorgeH. P.Swain-BradwayJ.. . . PutnamB. (2017). PBIS technical brief on systems to support teachers’ implementation of positive classroom behavior support. PBIS Center.
30.
GoodmanR. (2001). Psychometric properties of the Strengths and Difficulties Questionnaire. Journal of the American Academy of Child & Adolescent Psychiatry, 40, 1337–1345. https://doi.org/10.1097/00004583-200111000-00015
31.
GreenhalghT.PeacockR. (2005). Effectiveness and efficiency of search methods in systematic reviews of complex evidence: Audit of primary sources. BMJ, 331, 1064–1065. https://doi.org/10.1136/bmj.38636.593461.68
32.
*HaberstickB. C.SchmitzS.YoungS. E.HewittJ. K. (2005). Contributions of genes and environments to stability and change in externalizing and internalizing problems during elementary and middle school. Behavior Genetics, 35, 381–396. https://doi.org/10.1007/s10519-004-1747-5
33.
HenryD. B. (2006). Associations between peer nominations, teacher ratings, self-reports, and observations of malicious and disruptive behavior. Assessment, 13, 241–252. https://doi.org/10.1177/1073191106287668
34.
HenryD. B.Miller-JohnsonS.SimonT. R.SchoenyM. E. & the Multisite Violence Prevention Project (2006). Validity of teacher ratings in selecting influential aggressive adolescents for a targeted preventive intervention. Prevention Science, 7, 31–41. https://doi.org/10.1007/s11121-005-0004-3
35.
HinshawS. P.HanS. S.ErhardtD.HuberA. (1992). Internalizing and externalizing behavior problems in preschool children: Correspondence among parent and teacher ratings and behavior observations. Journal of Clinical Child Psychology, 21(2), 143–150. https://doi.org/10.1207/s15374424jccp2102_6
36.
KarabatsosG.TalbottE.WalkerS. (2015). A Bayesian non-parametric meta-analysis model. Research Synthesis Methods, 6, 28–44.
37.
KeileyM. K.BatesJ. E.DodgeK. A.PettitG. S. (2000). A cross-domain growth analysis: Externalizing and internalizing behaviors during 8 years of childhood. Journal of Abnormal Child Psychology, 28, 161–179. https://doi.org/10.1023/A:1005122814723
38.
KellyM. S.LueckC. (2011). Adopting a data-driven public health framework in schools: Results from a multi-disciplinary survey on school-based mental health practice. Advances in School Mental Health Promotion, 4, 5–12. https://doi.org/10.1080/1754730X.2011.9715638
39.
*LambD. J.MiddeldorpC. M.Van BeijsterveldtC. E. M.BoomsmaD. I. (2012). Gene–environment interaction in teacher-rated internalizing and externalizing problem behavior in 7-to-12-year-old twins. Journal of Child Psychology and Psychiatry, 53, 818–825. https://doi.org/10.1111/j.1469-7610.2011.02497.x
40.
LaudP.IbrahimJ. (1995). Predictive model selection. Journal of the Royal Statistical Society. Series B (Methodological), 57, 247–262.
41.
*LyttonH.WattsD.DunnB. E. (1988). Stability of genetic determination from age 2 to age 9: A longitudinal twin study. Social Biology, 35, 62–73. https://doi.org/10.1080/19485565.1988.9988688
42.
McIntoshK.GionC.BastableE. (2018). Do schools implementing SWPBIS have decreased racial and ethnic disproportionality in school discipline?OSEP Technical Assistance Center on Positive Behavioral Interventions and Supports, University of Oregon.
43.
MihalasS.MorseW. C.AllsoppD. H.McHaltonP. A. (2009). Cultivating caring relationships between teachers and secondary students with emotional and behavioral disorders: Implications for research and practice. Remedial and Special Education, 30, 108–125. https://doi.org/10.1177/0741932508315950
44.
MinerJ. L.Clarke-StewartK. A. (2008). Trajectories of externalizing behavior from age 2 to age 9: Relations with gender, temperament, ethnicity, parenting, and rater. Developmental Psychology, 44, 771–786. https://doi.org/10.1037/0012-1649.44.3.771
45.
MoherD.LiberatiA.TetzlaffJ.AltmanD. G., & The PRISMA Group. (2009). Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. PLOS Medicine, 6(7), Article e1000097. https://doi.org/10.1371/journal.pmed.1000097
46.
National Research Council and Institute of Medicine. (2009). Preventing mental, emotional, and behavioral disorders among young people: Progress and possibilities. National Academies Press.
47.
OlsonS. L.SameroffA. J.LansfordJ. E.SextonH.Davis-KeanP.BatesJ. E.DodgeK. A. (2013). Deconstructing the externalizing spectrum: Growth patterns of overt aggression, covert aggression, oppositional behavior, impulsivity/inattention, and emotion dysregulation between school entry and early adolescence. Development and Psychopathology, 25, 817–842. http://dx.doi.org/10.1017/S0954579413000199
48.
OverstreetS.ChafouleasS. M. (2016). Trauma-informed schools: Introduction to the special issue. School Mental Health, 8, 1–6. https://doi.org/10.1007/s12310-016-9184-1
49.
PigottT. G.ValentineJ. C.PolaninJ. R.WilliamsR. T.CanadaD. D. (2013). Outcome-reporting bias in education research. Educational Researcher, 42, 424–432. https://doi.org/10.3102/0013189X13507104
50.
*PoldermanT. J. C.PosthumaD.De SonnevilleL. M. J.VerhulstF. C.BoomsmaD. I. (2006). Genetic analyses of teacher ratings of problem behavior in 5-year-old twins. Twin Research and Human Genetics, 9, 122–130. doi.org/10.1375/twin.9.1.122
51.
PulkkinenL.KaprioJ.RoseR. (1999). Peers, teachers, and parents as assessors of the behavioural and emotional problems of twins and their adjustment: The Multidimensional Peer Nomination Inventory. Twin Research and Human Genetics, 2, 274–285. doi.org/10.1375/twin.2.4.274
52.
RadlerB. T.RyffC. D. (2010). Who participates? Accounting for longitudinal retention in the MIDUS National Study of health and well-Being. Journal of Aging and Health, 22, 307–331. https://doi.org/10.1177/0898264309358617
53.
RaineA.DodgeK.LoeberR.Gatze-KoppL.LynamD.ReynoldsC.. . . LiuJ. (2006). The Reactive–Proactive Aggression Questionnaire: Differential correlates of reactive and proactive aggression in adolescent boys. Aggressive Behavior, 32, 159–171. https://doi.org/10.1002/ab.20115
54.
ReinkeW. M.StormontM.HermanK. C.PuriR.GoelN. (2011). Supporting children’s mental health in schools: Teacher perceptions of needs, roles, and barriers. School Psychology Quarterly, 26, 1–13. https://doi.org/10.1037/a0022714
55.
RutterM.TizardJ.WhitmoreK. (1970). Education, health, and behavior. Longman.
56.
*SaudinoK. J.RonaldA.PlominR. (2005). The etiology of behavior problems in 7-year-old twins: Substantial genetic influence and negligible shared environmental influence for parent ratings and ratings by same and different teachers. Journal of Abnormal Child Psychology, 33,113–130. https://doi.org/10.1007/s10802-005-0939-7
57.
*ScourfieldJ.Van den BreeM.MartinN.McGuffinP. (2004). Conduct problems in children and adolescents: A twin study. Archives of General Psychiatry, 61, 489–496. https://doi.org/10.1001/archpsyc.61.5.489
58.
SutherlandK. S.ConroyM. A.McLoedB. D.KunemundR.McKnightK. (2018). Common practice elements for improving social, emotional, and behavioral outcomes of young elementary school students. Journal of Emotional and Behavioral Disorders, 27(2), 76–85. https://doi.org/10.1177/1063426618784009
59.
TalbottE.KarabatsosG.ZurheideJ. L. (2018a). Informant similarities, twin studies, and the assessment of externalizing behavior: A meta-analysis. Journal of School Psychology, 67, 31–55. https://doi.org/10.1016/j.jsp.2017.09.004
60.
TalbottE.MagginD. M.Van AckerE. Y.KummS. (2018). Quality indicators for reviews of research in special education. Exceptionality, 26(4), 245–265. https://doi.org/10.1080/09362835.2017.1283625
61.
ThompsonB.DiamondK. E.McWilliamR.SnyderP.SnyderS. W. (2005). Evaluating the quality of evidence from correlational research for evidence-based practice. Exceptional Children, 71, 181–194. https://doi.org/10.1177/001440290507100204
*TowersH.SpottsE.NeiderhiserJ. M.PlominR.HetheringtonE. M.ReissD. (2000). Genetic and environmental influences on teacher ratings of the Child Behavior Checklist. International Journal of Behavioral Development, 24, 373–381. https://doi.org/10.1080/01650250050118367
64.
TurkheimerE. (2000). Three laws of behavior genetics and what they mean. Current Directions in Psychological Science, 9, 160–164. https://doi.org/10.1111/1467-8721.00084
65.
*VierikkoE.PulkkinenL.KaprioJ.RoseR. J. (2006). Genetic and environmental sources of continuity and change in teacher-rated aggression during early adolescence. Aggressive Behavior, 32, 308–320. https://doi.org/10.1002/ab.20117
66.
*VierikkoE.PulkkinenL.KaprioJ.VikenR.RoseR. J. (2003). Sex differences in genetic and environmental effects on aggression. Aggressive Behavior, 29, 55–68. https://doi.org/10.1002/ab.10038
67.
WangH.HallN. C. (2018). A systematic review of teachers’ causal attributions: Prevalence, correlates, and consequences. Frontiers in Psychology, 9, Article 2305. https://doi.org/10.3389/fpsyg.2018.02305
