Emotion regulation is a key developmental skillset, but many existing measures rely on self-report or laboratory-based measurement approaches. This study aimed to develop a training and implementation protocol for the widely used Facial Expression Coding System (FACES) to be used in real-world settings with pre-recorded video data. A revised coding system with supplemental guidelines and training procedures was developed to use FACES with video data recorded in special education classrooms. This system resulted in adequate interrater reliability as well as reduced training time for coders. Specific training methods included close study of code definitions, coding of practice video, quantitative analysis of observation data to generate interrater agreement and kappa statistics, review of comparison charts to identify discrepancies between coder and training observations using the Noldus Observer XT software, and post-observation discussions. The revised FACES protocol and new training method presented here offer a more robust, efficient, and versatile tool that can be applied to systematic behavior observations conducted of students in real-world classroom settings.
AldaoA.Nolen-HoeksemaS.SchweizerS. (2010). Emotion-regulation strategies across psychopathology: A meta-analytic review. Clinical Psychology Review, 30(2), 217–237. https://doi.org/10.1016/j.cpr.2009.11.004
2.
BakemanR.QueraV. (2011). Sequential analysis and observational methods for the behavioral sciences. Cambridge University Press. https://doi.org/10.1017/CBO9781139017343
3.
BeauchaineT. P.McNultyT. (2013). Comorbidities and continuities as ontogenic processes: Toward a developmental spectrum model of externalizing psychopathology. Development and Psychopathology, 26(2), 1505–1528. https://doi.org/10.1017/S0954579413000746
4.
BerkingM.WhitleyB. (2014). Emotion regulation: Definition and relevance for mental health. In BerkingM.WhitleyB. (Eds.), Affect regulation training (pp. 5–17). Springer.
5.
BrockmeyerT.SkundeM.WuM.BressleinE.RudofskyG.HerzogW.FriederichH. C. (2014). Difficulties in emotion regulation across the spectrum of eating disorders. Comprehensive Psychiatry, 55(3), 565–571. https://doi.org/10.1016/j.comppsych.2013.12.001
6.
BrooksP. H.BaumeisterA. A. (1983). A plea for consideration of ecological validity in the experimental psychology of mental retardation. Peabody Journal of Education, 60(3), 45–59. http://www.jstor.org/stable/1492179
7.
BuckholdtK. E.ParraG. R.AnestisM. D.LavenderJ. M.Jobe-ShieldsL. E.TullM. T.GratzK. L. (2015). Emotion regulation difficulties and maladaptive behaviors: Examination of deliberate self-harm, disordered eating, and substance misuse in two samples. Cognitive Therapy and Research, 39(2), 140–152. https://doi.org/10.1007/s10608-014-9655-3
CompasB. E.JaserS. S.BettisA. H.WatsonK. H.GruhnM. A.DunbarJ. P.WilliamsE.ThigpenJ. C. (2017). Coping, emotion regulation, and psychopathology in childhood and adolescence: A meta-analysis and narrative review. Psychological Bulletin, 143(9), 939–991. https://doi.org/10.1037/bul0000110
EisenbergN.SpinradT. L.EggumN. D. (2010). Emotion-related self-regulation and its relation to children’s maladjustment. Annual Review of Clinical Psychology, 6, 495. https://doi/10.1146/annurev.clinpsy.121208.131208
FleissJ. L. (1981). Statistical methods for rates and proportions (2nd ed.). Wiley.
16.
GratzK. L.RoemerL. (2004). Multidimensional assessment of emotion regulation and dysregulation: Development, factor structure, and initial validation of the difficulties in emotion regulation scale. Journal of Psychopathology and Behavioral Assessment, 26(1), 41–54. https://doi.org/10.1007/s10862-008-9102-4
KringA. M.SloanD. M. (2007). The Facial Expression Coding System (FACES): Development, validation, and utility. Psychological Assessment, 19(2), 210. https://doi.org/10.1037/1040-3590.19.2.210
21.
KringA. M.SmithD. A.NealeJ. M. (1994). Individual differences in dispositional expressiveness: Development and validation of the emotional expressivity scale. Journal of Personality and Social Psychology, 66(5), 934–949. https://doi.org/10.1037//0022-3514.66.5.934
22.
LuterekJ. A.OrsilloS. M.MarxB. P. (2005). An experimental examination of emotional experience, expression, and disclosure in women reporting a history of childhood sexual abuse. Journal of Traumatic Stress: Official Publication of the International Society for Traumatic Stress Studies, 18(3), 237–244. https://doi.org/10.1002/jts.20027
23.
McCulloughA.RuehrdanzA.GartheR.HellmanC.O’HaireM. (2019). Measuring the social, behavioral, and academic effects of classroom pets on third and fourth-grade students. Human Animal Interaction Bulletin, 9(1), 1–21.
24.
MenninD. S.FrescoD. M. (2009). Emotion regulation as an integrative framework for understanding and treating psychopathology. In KringA. M.SloanD. M. (Eds.), Emotion regulation and psychopathology: A transdiagnostic approach to etiology and treatment (pp. 356–379). The Guilford Press. https://psycnet.apa.org/record/2009-21674-015
25.
Riley-TillmanT. C.KalbererS. M.ChafouleasS. M. (2005). Selecting the right tool for the job: A review of behavior monitoring tools used to assess student response to intervention. The California School Psychologist, 10(1), 81–91. https://doi.org/10.1007/BF03340923
26.
RobinsonM. D.CloreG. L. (2002). Belief and feeling: Evidence for an accessibility model of emotional self-report. Psychological Bulletin, 128(6), 934. https://doi.org/10.1037/0033-2909.128.6.934
27.
SloanD. M.StraussM. E.WisnerK. L. (2001). Diminished response to pleasant stimuli by depressed women. Journal of Abnormal Psychology, 110(3), 488. https://doi.org/10.1037/0021-843X.110.3.488
28.
SteinerN. J.SidhuT.ReneK.TomasettiK.FrenetteE.BrennanR. T. (2013). Development and testing of a direct observation code training protocol for elementary aged students with attention deficit/hyperactivity disorder. Educational Assessment, Evaluation and Accountability, 25(4), 281–302.
29.
WagnerA. W.RoemerL.OrsilloS. M.LitzB. T. (2003). Emotional experiencing in women with posttraumatic stress disorder: Congruence between facial expressivity and self-report. Journal of Traumatic Stress: Official Publication of the International Society for Traumatic Stress Studies, 16(1), 67–75. https://doi.org/10.1023/A:1022015528894
30.
WeissN. H.TullM. T.LavenderJ.GratzK. L. (2013). Role of emotion dysregulation in the relationship between childhood abuse and probable PTSD in a sample of substance abusers. Child Abuse & Neglect, 37(11), 944–954. https://doi.org/10.1016/j.chiabu.2013.03.014
31.
YoderP. J.LloydB. P.SymonsF. J. (2018). Observational measurement of behavior. Paul H. Brooks Publishing.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
