Abstract
Our aim was to explore emotions in Instagram images marked with hashtags referring to body image–related components using an artificial intelligence–based discrete emotional analysis. A total of 500 Instagram photos marked by specific hashtags related to body image components were analyzed and specific discrete emotions expressed in each picture were detected using the Emotion application program interface API from Microsoft Azure Cognitive Service. Results showed that happiness and neutrality were the most intense and recognizable emotions expressed in all images. Happiness intensity was significantly higher in images with #bodyimage and #bodyconfidence and higher levels of neutral emotion were found in images tagged with #body, #bodyfitness, and #thininspirational. This study integrated a discrete emotional model with the conventional dimensional one, and offered a higher degree of granularity in the analysis of emotions–body link on Instagram through an artificial intelligence technology. Future research should deepen the use of discrete emotions on Instagram and the role of neutrality in body image representation.
Introduction
Instagram is an image-based social media platform that promotes a new form of communication and self-expression. On this platform, it is possible to upload, edit, and share pictures and video with others users (Alhabash & Ma, 2017; Fardouly et al., 2018).
Specifically, Instagram works on two main communication levels. The first concerns images. The second concerns text. That is, users can choose to “post” (i.e., write a text as a comment or as a first prompt to an online material) and to associate hashtag “#” to each media posted online to make it recognizable and easy to be found by other users. The integration of images and related tags expands the communicative potential of Instagram to even complex concepts, such as emotions. It is possible to give an “emotional mark” on materials posted on Instagram, that is, to associate even specific and complex emotions to likewise specific ideas or concepts, which can be easily shared online with other users. This is the case of body image. An increasing number of people post images of body conveying more than the image per se. By posting these images on Instagram, people can communicate and share the complexity of their inner emotional words to a wider audience in a genuine and intuitive way. However, research has only partially explored this aspect, as explained in the next paragraph.
Instagram and Emotions
Research concerning emotions on Instagram has focused mainly on the emotional valence of individual posts (Yin et al., 2014) by adopting a dimensional approach based on affect (Russell, 2003). In other words, it would be more correct to label this research line as affect on Instagram. With this regard, it emerged an online bias toward positive affect called “positivity bias,” that is, a major tendency to post materials conveying positive instead of negative affect (Lin et al., 2014; Reinecke & Trepte, 2014). According to Reinecke and Trepte (2014), positive forms of authenticity are shown more frequently on social networks sites (SNSs) and are more likely to receive reinforcement in the SNS context than the negative ones. Consistently, Qiu et al. (2012) in their study showed that participants revealed a significantly higher willingness to express positive rather than negative emotions and disclosed more positive emotions on social networks than in their offline interactions. The expression of positive affect is perceived considerably more appropriate than negative one especially for Instagram and Facebook compared with Twitter (Chaikin & Derlega, 1974; Howell & Conway, 1990; Waterloo et al., 2018). Affect is a general term defined as a feeling state (Barrett & Bliss-Moreau, 2009; Schimmack & Crites, 2005) that characterizes at least by two qualities, valence and arousal (Barrett & Bliss-Moreau, 2009; Clore & Schnall, 2005).
It might be defined as an indicator of people’s own evaluative reactions to the world. For example, positive or negative affect might be experienced as positive or negative evaluations about something, as an object or a person (Clore & Schnall, 2005). Positive affect indicates the positive way of interacting with life-changes and interactions (Cohn & Fredrickson, 2009), while negative affect relates to the feeling of unhappiness and negativity in relationships and surroundings.
The positivity bias emerged online may be due to prevailing positivity norms that social media encourage (Reinecke & Trepte, 2014). Disclosures of negative affect might seem as more intimate and therefore perceived as maladjusted behavior when directed at strangers or acquaintances (Chaikin & Derlega, 1974; Howell & Conway, 1990). These findings corroborate the existing literature showing the tendency of a positive self-promotional use of Instagram due to its visual properties (Sheldon & Bryant, 2016) and the popularity of negative valences content on Twitter (Naveed et al., 2011). Furthermore, there is evidence that the control required from the online settings of how people present themselves on Instagram lead to a more desirable way of self-presentation (Walther, 2007). While positive and negative affect have received substantial attention from researchers, neutral affect has been very little investigated. Neutral affect might be defined as feeling indifferent, nothing in particular or a lack of preference one way or the other. According to Gasper and colleagues (2019), neutral affect is not the absence of feeling, but rather the feeling of nothing in particular. Even if people often use neutral expression both in online and offline communication, through their facial expressions or face emojis, however, this affective state has not been deepened in research field of affection and emotions.
Self-expression and positive/negative bias on Instagram showed a differential pattern according to users’ gender. A rich series of studies showed significant gender differences in computer-mediated communication, such as communication expression and technology usage (Chou & Tsai, 2007). Women seem to be more inclined to share emotions with people and in wider social context compared with men (Derks et al., 2008). Men are more task-oriented, likely to discuss rational information or social facts using reasonable language (Savicki & Kelley, 2000).
Men primarily consider social network as a pragmatic communication medium but not a relevant platform for self-portrayal, whereas women seem to be driven by a more hedonistic motive of self-presentation, which makes them more concerned about how they are perceived by others (Haferkamp et al., 2012). Furthermore, Zhang (2018) investigated gender difference in hashtag use on Instagram, classifying the hashtags into informative and emotional, positive and negative. They showed that female users tend to use more emotional and positive expression on Instagram compared with males. Although gender roles are important in technology communications, studies have overlooked gender preferences in hashtag usage and emotional expression on social networks. Most existing gender emotional studies have focused on the face-to-face communication medium, yet few are based on social media and Instagram in particular.
Despite the enormous possibilities provided by Instagram to communicate even fine and complex emotions have been extensively exploited by its users (Sonne & Erickson, 2018), research tended to diverge. First, research has mainly studied emotions starting from textual materials (hashtags or post; Lee et al., 2014; Pilař et al., 2016) instead of adopting an integrated analysis of both images and text. Then, evidence on emotions on Instagram relied mainly on a dimensional analysis of affect instead of specific discrete emotions (e.g., Hyvärinen & Beck, 2018), despite preliminary evidence supporting the usefulness of adopting a discrete emotional approach (Hyvärinen & Beck, 2018). The focus on discrete emotions could offer greater precision in determining how differently self-expressions vary in their perceived appropriateness (Waterloo et al., 2018). Furthermore, the adoption of a discrete emotion model might specify what type of negative or positive emotions cause certain types of behavior online or are associated with a type of widespread online phenomenon. Focusing on discrete emotions can be more informative and avoid oversimplifying self-expressions across Instagram. Therefore, despite the increasing number of studies focusing on affect on Instagram (de Vries et al., 2018; Reinecke & Trepte, 2014; Sonne & Erickson, 2018; Yin et al., 2014), we still know little regarding specific emotions users tend to express and even less regarding the image-based expressions of them. This can be due to the difficulty to implement emotion detection on image-based materials, which would require more sophisticated tools. To address these issues, we detected emotions on Instagram on the base of images by means of Azure Cognitive Service API (application program interface; Sole, 2018)—an artificial intelligence (AI) tool which relies on a discrete model of emotions and can detect eight emotions from faces on pictures. During the last years, emotion recognition using computer vision has become a very interesting domain for many researchers (Aguiar et al., 2016; Khanal et al., 2018). This labeling method, which is largely considered as the gold standard for measuring emotion in the emotion detection industry, stems from a system called the Emotion Facial Action Coding System (EMFACS), developed in 1978 by Paul Ekman, along with Wallace Friesen. The scientific assumption is based on the hypothesis of six universal emotions—anger, disgust, fear, happiness, sadness, and surprise—that are hardwired into us and can be detected across all cultures by analyzing muscle movements in the face (Ekman, 2016). The system is used to measure all visually distinguishable facial movements for encoding, which results in the changes in the appearance of the face movements of facial muscles. This field of human–computer interaction and affective computing focus on emotion recognition is a new frontier that could have relevant consequences in health care or education. The algorithm uses facial detection and semantic analysis to interpret mood from photos and videos both static and real time (Deshmukh & Jagtap, 2017). Technology that reveals human feelings could be used to identify students in trouble in a classroom environment, help autistics better interact with others, and encourage better relationships based on empathy and understanding. These applications may be helpful to advance this area of research crucially.
One of the main advantages provided by this approach concerns an integrated measurement of both textual and image-based materials. In other words, it allows focusing on two related aspects at the same time: emotions on Instagram and other concepts which the emotional images refer to. The hashtag is used to make this bridge and link emotional images to any type of other topics. A crucial topic concerns how people emotionally depict even delicate aspects of themselves on Instagram, such as the way they perceive their own body (Fardouly et al., 2018; Wagner et al., 2016). In the next paragraph, we deepened this aspect.
Body and Emotions on Instagram
Many studies have investigated Instagram posts as reflections of user’s characteristics (Pilař et al., 2016), such as the body (Fardouly et al., 2018). Instagram plays a significant role in the acceptance and construction of body standards (Aziz, 2017). Abundant literature showed the relevance of body image on social media communities (Fardouly et al., 2018; Ferguson et al., 2011; Kakish et al., 2018; Lewallen & Behm-Morawitz, 2016; Tiggemann & Zaccardo, 2018). Alarming implications on body acceptance both for females and males are due to social media exposure (Fardouly et al., 2017; Fardouly & Vartanian, 2016; Holland & Tiggemann, 2016). Specifically, the repeated exposure and publication of particular photos that promote specific beauty ideals, might lead to a greater body dissatisfaction and self-objectification, and lower self-confidence (Brown & Tiggemann, 2016; Lenhart, 2015; Myers & Crowther, 2009; Riva et al., 2015; Slater et al., 2019; Vandenbosch & Eggermont, 2012). Based on theory and practice, body image is a multidimensional construct consisting of perceptions, cognitions, emotions, and behaviors pertaining to one’s appearance, body shape, and size (Cash et al., 2004). Body image refers to the perceptions and attitudes that individuals hold about their own bodies in relation to larger cultural expectations (Davison & McCabe, 2005). It involves self-assessments of many different bodily features (Szymanski et al., 2011) and entails making social and cultural comparisons that might feed into a person’s sense of physical attractiveness and larger self-worth (Cash et al., 2004). In recent years, the development of measures of the perceptual, cognitive, emotional, and behavioral components of body image construct has grown rapidly with a particular explosion of interest in the last two decades (Cash & Pruzinsky, 2002; Thompson, 2004), and mainly in relation to several components of this aspect, such as affective and attitudinal perceptions of one’s body (Stice & Whitenton, 2002; Thompson & Stice, 2001; Van den Berg et al., 2002). If the body image-affective link has been extensively investigated in experimental research, how it develops on a larger scale it is still an open issue. Specifically, despite the increasing posting of body-related hashtags and posts on Instagram, and the widespread #bodypositivity and #bodyneutrality movement on Instagram (Cwynar-Horta, 2016; Sastre, 2014) to encourage body acceptancy, there is no evidence on how this relevant dimension of body are emotionally represented on Instagram.
In this study, we operationalized body image as defined by Cash and Pruzinsky (2002) in terms of body-related hashtag on Instagram and the integration of the prominence of thin-inspiration images posted on Instagram (Tiggemann & Zaccardo, 2018). Body and body image were investigated in terms of hashtags as a superordinate construct since there are evidence on their prominence on Instagram (Fardouly et al., 2017, 2018; Fardouly & Vartanian, 2016; Ferguson et al., 2011; Kakish et al., 2018; Tiggemann & Zaccardo, 2018). Looking specifically at the construction of body image, it is also decisive how the body is experienced and evaluated by the subjects himself (Mills et al., 2018).
Then, we carried out an image-based emotion detection by means of the Azure Cognitive Service (Sole, 2018)—an AI tool which relies on a discrete model of emotions and can detect eight emotions from faces on pictures. This integrated approach allowed us to capture the complexity of body–emotion link on a larger scale and in a granular mode for the first time, to our best knowledge. Our aim was to elucidate peculiar pathways between body image–related hashtag and emotional images the hashtags refer to. As part of a larger research project on the emotionally, bodily, and personality expression on Instagram, this article offers an initial challenge on this matter, evaluating the emotional detections and how the facets of body image are represented and depicted on Instagram.
Despite the preliminary nature of this study, we have been able to formulate these specific hypotheses:
According to previous studies on positive bias and positive valence on Instagram, hashtags in general were mostly related to positive emotions (vs. negative ones).
According to previous studies on the role that Instagram plays in the acceptance and construction of body standards, hashtag related to thin inspiration and body fitness were significantly related to negative emotions (vs. positive ones) while body, body image, and body confidence were related to positive emotions.
According to the existing literature, female faces expressed significantly more positive emotions compared with male ones.
Method
Sample and Data Collection
The sample consisted of 500 Instagram photos of both males and females. To obtain a random sample of photos, each hashtag was entered on Instagram’s public timeline, which displays a subset of Instagram media that was most recent at that moment, most of which were female (86.2% females). This majority of female’s picture might suggest that body hashtags are mainly posted by women than men. The hashtags were selected accordingly to a web-ranking on the most commonly used hashtags for body on Instagram. A list of body image–related hashtags was compiled and included: #body, #bodyimage, #bodyconfidence, #bodyfitness, and #thininspirational.
According to Cash and Pruzinsky’s (2002) definitions of body image, we explored the body confidence hashtag as an attitudinal dimension of body image since it comprises evaluative, affective, and cognitive subcomponents. Exploring body confidence hashtags on Instagram provides the representation and the expressions of the mainstream beliefs and thoughts linked to the body (Neagu, 2015; Petersen, 2017). Furthermore, we investigated body fitness hashtag as a behavioral component of body image since Instagram’s fitness culture seems to influence users’ body perception and body satisfaction (Carrotte et al., 2017). The behavioral manifestations of body image include actions intended to monitor the condition of the body. In this term, the investigation of body fitness tag on Instagram might provide a behavioral indication of users’ perceptions and feeling about their bodies. Finally, we investigated thin inspiration construct as nowadays thin inspiration images are one of the most prominent photos posted on Instagram designed to motivate people to exercise, to eat healthily, or to be skinnier. This hashtag refers to content posted on Instagram that inspires a user to be thin, and this is typically achieved through the presentation of images that contain thin bodies (Tiggemann & Zaccardo, 2018).
The inclusion criteria for emotion recognition envisaged to meet photos that showed only faces, and not the entire body, of female and men. A basic requirement for photo selection was the image clarity: the picture needed to be clear, sharp, with the faces in the foreground, and not blurry. Exclusion criteria regarded photos that showed multiple faces and not clear images. The photos were randomly downloaded on 28 October 2019 for each hashtag to select those that fulfilled the criteria for the recognition of emotions. The dataset does not include posts from private accounts and videos.
Measures
The emotions expressed in each photo were measured using the Emotion API from Microsoft Azure Cognitive Service (Sole, 2018) introduced in November 2015 and relying on machine learning algorithms. This technology can detect eight emotions based on Ekman’s FACS (anger, contempt, disgust, fear, happiness, neutral, sadness, and surprise) from faces on a given photo and assign a score to the emotional categories for each detected face so that the sum of the eight scores will be one (Kim & Kim, 2018). The analysis of still images consists in finding the face in the image, extracting the relevant features (facial action units, AUs), and finally classifying the image using algorithms trained through machine learning techniques (Bryant & Howard, 2019). The emotion detection is performed after detecting the face. The confidence (values between 0 and 1) gives the likelihood for each class of emotion.
This software allows to obtain at least one highest emotion from the face that defines the intensity of the emotion expressed. Emotion recognition using facial image processing seeks to predict the real feeling of a person expressed through facial appearance.
Results
Preliminary Analyses
A preliminary repeated measures analysis of variance (ANOVA) revealed that Instagram’s images related to the #body are characterized by specific emotions, each one with a different emotional intensity, F(1, 499) = 1,986.49, p < .001,
Emotion Detection in Five Different Body Hashtags
To elucidate the different pathways linking specific emotions to specific body-related hashtags, we ran a mixed ANOVA four (Within-Subject: Emotion) × five (Between-Subject: # category [#body, #bodyimage, #bodyconfidence, #bodyfitness, and #thininspirational]). Each emotion was considered as a repeated measure across the five # category (#body, #bodyimage, #bodyconfidence, #bodyfitness, and #thininspirational) as the between-subjects variable. As expected, the analysis revealed a significant interaction effect of emotion type and body hashtags on emotional intensity, F(4, 495) = 16.70, p < .001,
Average Emotional Intensity According to Emotion Type (Anger, Contempt, Disgust, Fear, Happiness, Neutral, Sadness, and Surprise) and Body Hashtag Category (#bodyimage vs. #bodyconfidence vs. #body vs. #bodyfitness vs. #thininspirational).
Note. Emotional intensity for each emotion ranged from 0.000 to 1.000. Column means with different subscripts differ significantly from each other at p < .002 (Bonferroni-corrected). Standard deviations (SDs) are displayed in parenthesis.
Gender Differences
Further analyses showed a significant association between gender and hashtag categories, χ2 (4) = 91.53, p < .001. In particular, all of the Instagram’s photographs tagged with #thininspirational portrayed females (adjusted residual ra = 4.5). Likewise, photographs tagged with #bodyconfidence portrayed more females than proportionally expected (adjusted residual ra = 3.8), while photos tagged with #bodyfitness more frequently showed males (adjusted residual ra = 8.8).
Finally, we tested the hypothesis that gender could be associated with different detected emotions. The analysis revealed no main effect of gender on emotion detection, F(1, 497) = .68, p = .410,
Discussion
This study adopted an AI-based discrete emotional analysis for detecting emotions in Instagram images marked with hashtags referring to body image–related components. This approach allowed analyzing emotions in a fine-grained way to deepen the understanding of the link with body image facets (Hyvärinen & Beck, 2018).
Despite the preliminary nature of this study, our results confirmed the positivity bias (Waterloo et al., 2018) that we posited as a first hypothesis, thus showing that happiness was one of the most intense and recognizable emotion expressed in all photos. Specifically, findings evidenced that positivity was mainly expressed through happiness, as a specific discrete emotion. Moreover, our study added to existing literature another crucial information related to neutrality. A balance between positivity and neutrality emerged as a constant emotional component across all hashtags. This finding may offer a preliminary scientific evidence of current trends on body image acceptance on Instagram overcoming the need to accept our body unconditionally. On one hand, positivity bias—mainly evident in the widespread #bodypositivity movement on Instagram (Cwynar-Horta, 2016; Sastre, 2014)—relies on a forced acceptance of the body despite its shape and its health (i.e., the fat acceptance movement or the national association to advance fat acceptance). As a counterpart, it has taken hold a new movement around a more realistic and attainable body acceptance view, which has been translated in the increasing use of #bodyneutrality instead of #bodypositivity. Therefore, it might be useful to further investigate the neutrality expressed online linked to the body both defined as a symbol, a word, or emotions. By going into detail, according to our second hypothesis, significant interactions between specific emotions and different dimensions of body image hashtags were found. Specifically, happiness and neutral resulted to be significantly detected within each hashtag category. In particular, happiness intensity was significantly higher in images with #bodyimage and #bodyconfidence compared with all other hashtags, whereas higher levels of neutral emotion were found in images tagged with #body, #bodyfitness, and #thininspirational. Our findings on happiness were in line with previous studies on the self-promotional use and the more socially desirable way of self-presentation found on Instagram, compared with other social networks. According to this, Sheldon and Bryant (2016) in their study showed that one major goal of many Instagram users was to gain a substantial amount of “likes” on their posts as well as achieving a high number of followers. Moreover, Nadkarni and Hofmann (2012) indicated the same needs at the base of the use of social networks, and as a further result, they showed also the need to need to belong as a key motivational factor. Our findings were also in line with the hyperpersonal perspective (Walther, 2007) assuming that individuals more typically present themselves in a socially desirable way (i.e., positively) due to the control provided by online settings over one’s self-presentation. Furthermore, Waterloo and colleagues (2018) focused on the norms among expressions of emotions on Facebook, Twitter, Instagram, and Whatsapp, and they found that the expressions of positive emotions were generally considered more appropriate than expressions of negative emotions across all platforms and especially on Instagram. Thus, they suggested that the specific features of a social media platform may facilitate certain types of expressions and beliefs on what may be considered appropriate, beyond differences in perceived behavioral privacy. With this regard, it has been demonstrated that an overuse of self-promotional content on Instagram is due to its visual properties (Sheldon & Bryant, 2016). On the other hand, the higher neutrality found in #body, #bodyfitness, and #thinispirational is in contrast with our second hypothesis. This neutrality might be interpreted as a form of emotional flatness due to the positive bias found on Instagram (Wildes et al., 2010). Users might prefer showing neutral emotions or nothing in particular, rather than expressing negative emotions perceived as considerably less appropriate (Caltabiano & Smithson, 1983). Interestingly, neutrality resulted as mainly associated with #bodyfitness and #thinispirational referring to the most prominent Instagram posts which push toward physical activity, eating healthily, or being skinnier (Talbot et al., 2017). Crucially, there is evidence that being exposed to posts illustrating thin, muscular, and unrealistic but socially desirable body ideals can increase body dissatisfaction and self-objectification tendencies with salient clinical implications (Myers & Crowther, 2009; Riva et al., 2015; Santarossa & Woodruff, 2017; Vandenbosch & Eggermont, 2012). Specifically, users’ choice to present themselves mainly with neutral images could be consistent with the mitigation of emotional expressions or the expression of nothing in particular, which is typical of eating disorders (EDs; McLean et al., 2017; Meyer et al., 2010). Despite the preliminary nature of this study, results suggest the need and the value of a deeper investigation of neutrality across image-based social media as a further theoretical and methodological step to (a) promote an up-to-date grounded analysis of new trends on Instagram (e.g., #bodyneutrality), and to (b) disambiguate the link between emotions and specific delicate processes on Instagram, such as in the case of body image.
Finally, we did not find support for our third hypothesis on the link between expressed emotions on Instagram and gender. Instead, we evidenced a significant association between gender and specific body-related hashtags. Specifically, results evidenced that images marked with body hashtags related to body esteem and thinness showed more female faces, while those images marked with #bodyfitness showed males faces more frequently. Crucially, a recent study (Lavender et al., 2017) demonstrated different tendencies in posting on Instagram between female and males. Rather than extreme thinness, there is an increase trend among men (Lavender et al., 2017) of many images featuring male bodies and the desire leanness and muscularity, using extreme exercise and dieting to achieve the right picture of themselves.
Conclusion
This study adopted an AI-based discrete emotional analysis for detecting emotions in Instagram images marked with hashtags referring to body image–related components. To our knowledge, this is the only existing study showing a positivity–neutrality balance across Instagram pictures featuring facial expressions marked with body image–related #. Specifically, this study extended the previous literature on the emotional expression on Instagram specifically linked to body image dimensions. The current results showed that happiness and neutrality were the main emotions expressed on Instagram related to body image dimensions and these findings could provide a constant up-to-date emotional picture of Instagram body-related trends. This is a sensitive topic that could be analyzed in detail using this advanced methodology—AI—enabling for a finer investigation, which other would be too demanding or excessively costly. Another major contribution of this study to the existing literature on emotions in general and social network research in particular is that it embraces the techniques that can analyze photos on content. This study has successfully analyzed what a given photo is about, and what emotion is expressed on a given photo and described by a specific hashtag. This approach allowed analyzing emotions in a fine-grained way (Hyvärinen & Beck, 2018) to deepen the understanding of the link with body image facets. Finally, the study presents some limitations. One limitation of the study, which will be addressed in further research, is related to the need a higher number of photos to analyze. Another limit is related to the imbalance numbers of images depicting males compared with females that limited the gender differences analysis. Finally, the use of only public unknown accounts denied the possibility to contact participants and ask them more demographic informations, Instagram’s use, their relationship with the body, and body image perception. Further studies are necessary to better understand the emotional nuances found in our results, with a particular focus on neutrality emotion and its implication on self-presentation and body depiction, as well as a higher number of pictures. These preliminary findings might be extended also looking at the personality of the users to offer a broader vision of Instagram involvement on the main aspects of the everyday life, emotions, body perception, and interactions.
Footnotes
Declaration of Conflicting Interests
The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding
The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This article was supported by the Italian MIUR research project “Unlocking the memory of the body: Virtual Reality in Anorexia Nervosa” (201597WTTM).
