Abstract
Wearing face masks has become a usual practice in acute infection events inducing the problem of misinterpreting the emotions of others. Empirical evidence about face masks mainly relies on adult data, neglecting, for example, school kids who firmly are dependent on effective nonverbal communication. Here we offer insights from a joint school–university project. Data indicate that emotional reading of 9 to 10 years old pupils (
In situations of acute infection events, wearing face masks is an effective measure to reduce the risk of being infected when combined with other hygienic measures such as social distancing and handwashing (Chu et al., 2020; Esposito et al., 2020; Verma et al., 2020). In extreme cases such as epidemics, wearing masks is a daily and ongoing practice and affects most places where people from different households gather together for an extended period. This leads to a long list of needed transpositions and adjustments, starting from well-thought hygienic and replacement concepts of face masks to the correct handling, dressing, and undressing of masks. Due to the mere physical occlusion of prominent and quite informative parts of the face (about 60% of the facial area, see Carbon, 2020), converging study results report problems on several dimensions: Identifying persons (e.g., Carragher & Hancock, 2020; Freud et al., 2020), understanding acoustic messages (e.g., Porschmann et al., 2020), and forming impressions about further person-related variables such as attributing trust (Marini et al., 2021). Emotional reading is also hardened by wearing face masks, at least as long as nontransparent, standard masks are used (Marini et al., 2021). Carbon (2020) was the first to substantiate the everyday problems in recognizing facial emotions people reported during the first wave of the COVID-19 Pandemic, back in May 2020: Not only the recognition performance of emotional reading decreased, but the participants also confused several emotions, especially disgust (confused with anger), happiness (with a neutral emotional state), and anger (with disgust, neutral, and sadness). The participants also reported lower degrees of confidence in their emotional reading capabilities (Carbon, 2020). Altogether, this indicates a clear handicap for nonverbal communication when face masks are used. These results are mirrored by subsequent research and analyses (e.g., Mheidly et al., 2020) and are supported by practice reports from areas where emotional reading is pivotal, for instance in psychiatric and psycho-therapeutical practice. Masks may particularly diminishing the perception of positive emotions (Nestor et al., 2020), especially expressed by happy faces which are mainly indicated by a toothy grin. The impact of masks on negative emotions is less clear, but it seems that masks do not specifically increase the feeling that the mask wearer shows negative emotions (Carbon, 2020; Marini et al., 2021).
The scientific database of the impact of wearing masks on children’s face processing performance is meanwhile thin although there are some first examples available (e.g., about face recognition performance, see Stajduhar et al., 2021). Regarding research on the impact of masks on the ability to read emotions from masked faces is mostly lacking. The main reason for this overall low number of studies might be that during several lockdowns during the COVID-19 Pandemic, empirical studies with school kids facing heavy hygienic requirements are technically hardly feasible. A rare empirical study of this kind was provided by Ruba and Pollak (2020) who employed 7 to 13 years old school kids using the Japanese and Caucasian Facial Expressions of Emotion (JACFEE) face database (for reliability data, see Biehl et al., 1997; Matsumoto & Ekman, 1988). The authors used frontal depictions of stereotypical facial configurations showing three different negative emotions: sadness, anger, and fear. They employed pictures of two persons showing each emotion without a mask (original depictions from JACFEE) plus two other persons showing each emotion with graphically added masks—additionally, they employed a condition where sunglasses had been graphically added. Children were more accurate in inferring others’ emotion when faces were unmasked—this showed up with a large effect size, Cohen’s
The Present Study
The evident gap in knowledge of how face masks 1 affect emotional reading in children made a specific study necessary, especially as the wearing of face masks has become a political issue (Wong, 2020) and the acceptance of masks is generally under risk (Egan et al., 2021). The topic of wearing masks is particularly emotionally and politically charged when it comes to children. Consequently, usage of face masks is highly debated for schools in particular (Spitzer, 2020). The major force behind aiming the present study was the second author (M. S.), a 9-year-old schoolboy from Florida, who contacted the first author (C.C.C.), who is a perceptual scientist with a focus on face research. After having read an article about C.C.C.’s specific research on emotional reading of faces in adults (i.e., Carbon, 2020) with masks typically used in the first wave of the COVID-19 Pandemic, M. S. was curious to know about the possibility to extend the study to a sample with school kids. He planned to conduct a replication study specifically with children because he identified this a valuable study as school kids strongly depend their everyday communication, especially in classrooms, on nonverbal communication—and even if this emotional reading might be limited in most cases to affirmations by expressing a happy face. M. S. also aimed at submitting such a replication study to the school’s STEM (Science, Technology, Engineering, and Mathematics) fair in 2020 (which he won—and, fortunately, he subsequently also won the second prize in the district STEM fair in 2020 with this project).
We decided to wholeheartedly collaborate on all issues of the scientific process in order to be able to submit a report about the study to the STEM committee of the school in time and by strictly following the usual scientific protocols. This required a strict organization and communication structure which we realized via the Open Science Framework (OSF). C.C.C. was in charge of guiding through the entire process, including explaining and teaching methodological as well as statistical basics, in order to present a conclusive and reliable scientific report. This short note of the entire collaboration is relevant, as we will briefly return to this important side kick of this research project later to make clear how STEM projects can attract school students by active involvement of scientific advisors and supervisors. All means towards the final product of a scientific paper were finely concerted with M. S.’s mother in order to optimally support M. S.
The main aim of the present study was to analyze the performance of reading basic emotions in faces that were masked versus unmasked. Here, we were particularly interested in gaining knowledge about the specific confusion of expressed emotions with the perception of these emotions. As the first author has conducted a similar study at the start of the first wave of the COVID-19 Pandemic with adults (Carbon, 2020), we were also keen to compare both datasets to gain knowledge on the specific problems children have with reading emotions from masked faces.
Method
Participants
Fifty-seven participants volunteered for the study (
Material
All stimuli were based on frontal depictions of faces which were obtained from the MPI FACES database (Ebner et al., 2010) by a study-specific contract. Specifically, we employed frontal photos of four white European persons (previously called “Caucasian” in most research arenas), two female and two male, who belonged to two different face age groups (

Two exemplary persons (a female in the upper part and a male in the lower part, both from the medium old age group) showing six different emotions without a mask (“no mask”) and wearing a mask (“mask”). Original material showing faces without face masks stems from MPI FACES database (persons #168 and #116, respectively, Ebner et al., 2010). Depiction used with kind permission of the Max Planck Institute—further distribution, publication or display beyond illustrating the research methodology of this study is prohibited by the Max Planck Institute.
In sum, we employed 2 [Face Sex] × 2 [Face Age Group] × 6 [Emotions] × 2 [Face Mask] = 48 facial versions in our study.
Procedure
The experiment was set up as a Microsoft Forms project which was conveniently approachable via a QR code and which was distributed among participating school students. The entire study was conducted between 3 November 2020 (at 12:29 local time—Eastern Standard Time) and 19 November 2020 (at 10:06 EST) during the COVID-19 Pandemic, precisely, during the second rise of cases in the United States. Prior to the experimental session, written informed consent was obtained from the parent of each participant. Each participant was exposed to the complete set of stimuli. The stimuli were presented subsequently, with the order of trials being fully randomized across participants. The entire routine was repeated three times on consecutive days to gain more data points and to be able to check for training effects. Participants were asked to spontaneously assess the depicted person’s emotional state from a list of six emotions reflecting the same compilation of emotions shown by the different versions of the faces (
Results
Data Analysis Strategy
The data were processed using R 4.0.4 (R Core Team, 2021). In addition to the
Overall performance for correctly identifying facial emotions in faces

Mean percentage of correct assessment of the emotional states for faces with masks (blue) or without masks (red) on the face. Error bars indicate confidence intervals CI-95% based on adjusted values for taking within-subject variances into account (Morey, 2008). Asterisks indicate statistical differences between conditions of wearing and nonwearing on the basis of paired
After having qualified the general pattern of data, we statistically tested the effect of wearing masks on the recognition of facial emotions by means of Linear Mixed Models (LMM). Our primary interest was in the impact of face masks on emotion recognition performance, so we first defined a null model (Model #0) with factors involved for which we had no specific hypothesis in mind: Model #0 used
Comparison of Models for the Dependent Variable Emotion Recognition Performance.
Table 2 shows the parameters of the finally selected Model #2 which explains 27.8% of the variance of the data. From session to session, participants earned higher recognition performance, indicated by significant effects of Session 2 and Session 3 tested against Session 1 (indicated by “Reference” in Table 2). Most importantly, we did not only find an overall effect of hampered emotional reading when masked faces were shown, but face masks had specific effects on certain facial emotions as demonstrated by significant interactions between expressed emotions and face mask wearing or not. We detected a particularly large effect of face masking on the reading ability of disgust, substantiated by an estimate of –56.73 for the interaction of
Linear Mixed Model #2 Identified as Most Adequate to Describe the Data Pattern by Subsequent Testing of Model #1 Against Model #0 and Then Model #2 Against Model #1 via Likelihood Ratio Tests.
*
Additionally, we followed a signal detection theory (SDT) approach to investigate whether the impact of face masks was mainly about the sensitivity of reading emotions or the response bias based on a different decision criterion. For conducting this additional analysis, we did not any more taking the sessions and different base faces into account. Figure 3 shows the respective distribution plus the means of the data for the sensitivity (operationalized by

Analysis following a signal detection theory approach, conducted for each emotion separately: (a) sensitivity and (b) decision criterion. Upper data (red) in each sub figure show the condition with no masks, lower data (blue) show the condition with masks. Additionally, mean values are given as numbers along with vertical, colored lines. For (b) we also provide information on the quality of the criterion: Negative values indicate more liberal, positive values more conservative decision criteria; the neutral position (0) is further indicated by a dotted black vertical line.
We statistically tested the effect of wearing masks on the processing of facial emotions by means of independent LMM for the sensitivity measure
Linear Mixed Model #2 Identified as Most Adequate to Describe the Data Pattern by Subsequent Testing of Models via Likelihood Ratio Tests.
*
We were further interested in how specifically face masks affected the ability to read emotions regarding the confusion of emotions (specifically misperceiving an expressed emotion as a different one). As the confusion matrices in Figure 4 (left panel) show, participants were very good at perceiving the correct emotions as long as faces did not show face masks. Only for disgust and sadness, we observed characteristic misattributions of emotions in more than 10% cases specifically towards a specific alternative emotion: Disgust was misinterpreted as sadness in 10.5% of the cases and sadness was misinterpreted as fear in 10.1% of the cases. As soon as we added community masks to the depicted faces, participants showed stronger misinterpretations of emotions. Most pronouncedly, this happened for disgust which was nearly equally often perceived as sadness, anger, and disgust. Expressed sadness was much more interpreted as neutral when a mask covered the mouth area. Additionally, with a mask on, fear was often misinterpreted as happiness.

Confusion matrix of expressed vs. perceived emotions. Left side: relevant data of the present study; right side: comparison data from the study with adults from Carbon (2020)—note: the original Carbon study employed not only portraits of young and middle-aged persons, but also of elderly people; to be better able to compare the datasets of both studies we re-processed the Carbon (2020) dataset excluding the data for images of the elderly persons. Top matrices (in reddish hues): faces without masks, bottom matrices (in blueish hues): faces with masks. Percentages compile up to 100% for each expressed emotion. The more saturated the color, the higher the score of this cell. Empty cells indicate no perceived emotion of that kind, for example, expressed anger was never misperceived as happiness—for the conditions neither with nor without masking.
Although the overall pattern was relatively similar to the original study from May 2020 where we tested adult participants (Carbon, 2020), there are also important differences to be reported. As the original study with adults employed not only portraits of young and middle-aged persons, but also of elderly people, we re-processed the Carbon (2020) dataset excluding the data for images of the elderly persons in the following. As can be seen in Figure 4 (right panel), the control data of adult persons showed particular confusions for the emotions of sadness and disgust when masks were presented; however, for children, anger was even
Testing the Effect of Age Group (Kids vs. Adults).
*
Discussion
We tested school kids aged 9 to 11 years on their recognition performance of facial emotions in the times of the COVID-19 Pandemic where face masks were common hygienic accessories to mitigate possible infections. The participants had to recognize emotional expressions displayed by faces which we showed with and without masks. The recognition performance was further qualified by comparing the data with a similar study that tested adult participants in May 2020 (Carbon, 2020).
First of all, the kids performed very well on a general basis. They reached nearly 90% of correct responses when confronted with faces without masks. This is quite remarkable as many theories claim a needed and ongoing maturation of face processing skills lasting about 12 to 14 years, particularly to develop the so-called
When comparing our data with further studies on assessing the emotional status of faces, our sample of children also showed much better performances than the adult participants tested by Derntl et al. (2009) where performance rates of 73.2%, 73.7%, 63.2%, and 72.2% for sadness, anger, disgust, and fear, respectively, were detected. Derntl et al., however, employed less normative and clear stimuli and utilized a presentation limitation task, which should be taken into account when interpreting such performance figures in an absolute way. The overall performance finding is therefore more compatible with an early and fast cognitive development and maturation of face processing skills
Previous studies identified the emotional states
Most notable in the present study is the strong negative effect of face masks on the recognition of disgust. Adult participants in an earlier, very similar study (Carbon, 2020) also showed a pronounced decline of performance for this specific emotion; however, adult participants mainly misperceived disgust as anger—reflecting a common finding (see, e.g., Cigna et al., 2015)—but they did not confuse disgust with sadness as the kids did. We do not yet know the base of this effect, but it points to the relevance of such findings for children’s everyday life: Face masks cover a large part of the face, and only so they seem to be effective in mitigating the viral load entering the respiratory passages through the mouth and the nose. This comes at a price, for example, an imposed change of the processing of faces. Changing processing does not evidently mean to impede the informative value of such processes. This can be tellingly seen with the emotional state of anger, which was better recognizable when faces were masked. Only the recognition of disgust was indeed dramatically affected, calling for effective and easy to implement countermeasures: In situations where disgust is aimed to be expressed, this should be accompanied by explicit and clearly pronounced verbal wording and, by nature and in daily routines already implemented, by a clear body language showing resistance and retreat (see Brotto et al., 2021). Mheidly et al. (2020) developed a sophisticated set of coping measures to enhance communication with face masks. In order to cope with hampered emotional reading, we can use the following actions from this set: (a) the increase of awareness of the typical communication challenges, (b) amplified utilizing of the upper face parts, (c) emphasizing body language, and (d) facing communication partners more directly and with more attention.
By all these thoughts, it is also clear that the application of masks to children should always be executed with much diligence and empathy. The usage of masks and the need to wear masks have to be comprehensibly explained (Esposito & Principi, 2020).
The present study tells us a further, important lesson: As we know, our capabilities as scientists to attract young people for STEM is rather limited, but explicit interest in our research expressed by children should be open-heartedly taken up. For fruitful, stimulating and productive interactions between STEM research and schools, it is important to take such interactions (like the present one where a 9-year-old schoolboy contacted a perceptual scientist) very seriously. We should support naturally interested school kids with the same level of commitment as typically invested in regular collaborations. Based on such a spirit, such collaborations will not be just promotionally effective events but will be serious scientific enterprises leading to new insights and potentially upcoming careers in the fields of STEM.
Supplemental Material
sj-pdf-1-ipe-10.1177_20416695211038265 - Supplemental material for The Impact of Face Masks on the Emotional Reading Abilities of Children—A Lesson From a Joint School–University Project
Supplemental material, sj-pdf-1-ipe-10.1177_20416695211038265 for The Impact of Face Masks on the Emotional Reading Abilities of Children—A Lesson From a Joint School–University Project by Claus-Christian Carbon and Martin Serrano in i-Perception
Footnotes
Acknowledgements
The authors would like to thank the great support of Taylor Ranch Elementary School in Venice, Florida, United States of America.
Declaration of Conflicting Interests
The authors declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding
The authors received no financial support for the research, authorship, and/or publication of this article.
Note
References
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
