Abstract
Social comparison has a significant impact on individuals’ motivation, affect, and behavior. However, we lack a scale that captures individual differences in attitudes toward social comparison. To address this gap, we developed the Attitudes Toward Social Comparison Inventory (ASCI) drawing on existing scales that tap into metacognitive beliefs about worrying, self-motives, beliefs about emotions, and the general comparative-processing model. We examined the psychometric properties of the ASCI in a longitudinal study (
Social comparison—defined as comparing oneself with others—shapes people’s judgment, motivation, affect, and behavior (Baldwin & Mussweiler, 2018; Festinger, 1954), and serves motives of self-evaluation, namely, self-enhancement, self-verification, self-assessment, and self-improvement (Gregg et al., 2011; Morina, 2021; Sedikides & Strube, 1997). Social comparison outcomes can be broadly categorized as upward (e.g., perceiving oneself as less good looking than one’s best friend), lateral (e.g., perceiving oneself as equally good looking as one’s neighbor), and downward (e.g., perceiving oneself as better looking than one’s brother). Accordingly, the outcome of social comparison can be perceived as aversive (i.e., threatening the motives of the comparer), neutral, or appetitive (i.e., consonant with or challenging the motives of the comparer).
Due to the ubiquitous role of social comparison in self-evaluation and behavior, it is conceivable that individuals develop different attitudes toward social comparison. However, to date, interindividual differences in attitudes toward social comparison have been underinvestigated. A better understanding of metacognitive processes may help elucidate how and why individuals choose to engage in social comparison (Festinger, 1954). While the need to serve self-motives may underlie positive attitudes that encourage individuals to engage in social comparison (Gregg et al., 2011), individuals may hold negative attitudes toward social comparison as it often produces negative cognitive and emotional reactions (Morina & Schlechter, 2023). To facilitate a more in-depth understanding of these processes, the present paper, therefore, reports the development and validation of the Attitudes Toward Social Comparison Inventory (ASCI), which captures individuals’ positive and negative attitudes toward social comparison.
Positive Beliefs About Social Comparison
There are several reasons why individuals may hold positive views about social comparison. In general, social comparison informs individuals about one's self-attributes, as all self-judgments essentially rely on frames of references, including social ones (Morina, 2021; Vlaev et al., 2011). For instance, when individuals construe judgments about how they are doing academically, they may rely on their academic peers as a frame of reference (Meyer et al., 2022; Unkelbach et al., 2023). Therefore, social comparison serves humans’ innate self-motives (Gerber et al., 2018; Morina, 2021; Unkelbach et al., 2023), four of which have been described extensively in the literature: self-enhancement, self-verification, self-assessment, and self-improvement (Sedikides & Strube, 1997). Depending on these motives and their activation across contexts, individuals may hold different positive beliefs about social comparison. For example, individuals with high levels of self-assessment (i.e., striving to know the truth about the self) may view social comparison positively because it informs them about where they stand socially. Moreover, by means of social comparison, individuals can become aware of their weaknesses and strengths, gain more accurate self-knowledge and a better intuition to guide them in important life decisions. For similar reasons, individuals scoring high on self-verification (i.e., striving to confirm preexisting view of oneself) may hold positive attitudes toward social comparison, as they may selectively and deliberately engage in comparison with standards that fit into their existing self-concept (Gregg et al., 2011). Meanwhile, individuals with elevated levels of the self-enhancement motive (i.e., striving to view oneself positively) may selectively and deliberately engage in downward social comparison as a means of enhancing their self-esteem or to feel better (Gregg et al., 2011). They may selectively compare themselves with others they consider to be worse-off and avoid comparisons with better-off individuals. Consequently, they may hold positive attitudes toward social comparison as they help them feel better about themselves. Finally, individuals scoring high on self-improvement (i.e., striving to improve oneself) may hold positive views toward social comparison (e.g., to very skilled or successful people), as these can guide them in improving their skills or abilities (Gregg et al., 2011). To that end, they tend to frequently compare themselves with individuals who are better-off on some relevant comparison dimension. Such upward comparisons are likely to produce positive behavioral outcomes given that the desired end state is perceived as attainable (Morina, 2021). For instance, an individual may compare with a friend who is doing better academically. By realizing that her friend engages in healthier sleep patterns and a productive learning routine, she can adjust her own schedule and establish similar routines. Therefore, these individuals may be more likely to hold positive attitudes toward social comparison as they may help improve themselves. Yet, these proposed mechanisms may be influenced by the context-dependent activation of self-motives, which remains to be investigated empirically (Morina, 2021), reiterating the need for a measurement of attitudes toward social comparison.
Negative Beliefs About Social Comparison
People are likely to also hold negative attitudes toward social comparison. Individuals often communicate to each other that comparing with other people is bad, leading to normative standards that one should not compare with other individuals (e.g., Nolte, 2020). In addition, comparison appraised as threatening the motives of the comparer often elicits negative cognitive, emotional, and behavioral outcomes (Morina & Schlechter, 2023). Indeed, literature suggests that negative self-evaluations relative to others are associated with more symptoms of depression and anxiety (McCarthy & Morina, 2020). Accordingly, individuals may believe that social comparison is fundamentally bad for them and deliberate engagement in comparison may harm them psychologically. Such attitudes would be similar to (and possibly associated with) negative attitudes toward emotions (e.g., believing that having an emotion is harmful, damaging, or uncontrollable; Becerra et al., 2020; Karnaze & Levine, 2020; Manser et al., 2012). In addition, holding negative attitudes toward social comparison may moderate both the frequency and the affective impact of such comparisons. For instance, when individuals think of comparison as uncontrollable or harmful, noticing them may become highly distressing and instigate a cascade of maladaptive responses, such as thought suppression, rumination, or repetitive engagement in additional comparisons to ameliorate the negative self-evaluation (e.g., secondary or tertiary comparisons; see Morina, 2021). As such, negative attitudes toward comparison may share similarities to maladaptive metacognitions in the context of excessive worrying (Wells & Carter, 2001). The metacognitive model of pathological worrying suggests that worrying constitutes an adaptive process up to a certain degree, but can become excessive and maladaptive, in particular when individuals appraise their thought processes negatively (cf. type 2 worries; Wells & Cartwright-Hatton, 2004). Taken together, negative attitudes toward social comparison may play an important role in the habitual frequency with which individuals engage in them, as well as in the distress caused by aversive comparison, potentially contributing to overwhelming feelings of helplessness, loss of control, increased worry or rumination (Schlechter & Morina, 2023), lower self-efficacy, or negative self-views (e.g., “Not being able to stop comparing with others means that I am weak or indecent”).
Existing Measurement Approaches
From a comparative-processing perspective, attitudes toward social comparison may be essential both in determining when and why individuals engage in social comparison, and in shaping the engendered cognitive, emotional, and behavioral reactions (Morina, 2021). Understanding attitudes toward social comparison would also enable us to address myriad research gaps (for review, see Morina, 2021), including the question if and when attitudes about social comparison transits from being adaptive (e.g., “Comparing informs me about what I can and cannot do”) to becoming maladaptive (e.g., “I cannot control my comparison to others”). In general, a wide range of instruments and paradigms have been developed to study social comparison (Gerber et al., 2018). Current measurement approaches focus on different ways to assess social comparison, for instance, by assessing individuals’ perceived social rank (Allan & Gilbert, 1995), or social comparison in specific domains such as physical appearance (Schaefer & Thompson, 2018) or well-being (Morina & Schlechter, 2023). However, to the best of our knowledge, there is currently no measure that taps into beliefs about social comparison, which constitutes an important gap in current literature on social comparison. Therefore, we developed the ASCI in the present study taking inspiration from scales that assess attitudes toward cognitions and emotions. To this end, we examined different questionnaires tapping into metacognitions concerning worrying (Wells & Cartwright-Hatton, 2004), self-evaluation motives (Gregg et al., 2011), and beliefs about emotions (Becerra et al., 2020; Karnaze & Levine, 2020; Manser et al., 2012), as a starting point to developing items.
The Meta-Cognitions Questionnaire–30 (MCQ-30) is pertinent because it assesses metacognitions about worrying (Wells & Cartwright-Hatton, 2004) and their crucial role in psychopathology (Wells & King, 2006). Similarly, understanding metacognitive aspects of comparative behavior may enable a greater understanding of (mal)adaptive beliefs about social comparison. In addition, item development was inspired by a set of questions capturing the self-evaluation motives self-enhancement, self-verification, self-assessment, and self-improvement presented by Gregg et al. (2011), as these motives constitute the major reasons to derive value from comparison outcomes. Consequently, these motives may shape how positively individuals think about comparison and how often they deliberately engage in comparison (Morina et al., 2022). A further set of relevant instruments stems from research concerning beliefs about emotions, which can be perceived as help or hindrance for one’s general psychological functioning. Higher endorsement of perceiving emotions as help (vs. hindrance) predicted the use of reappraisal strategies, which in turn predicted greater happiness (Karnaze & Levine, 2020). Other scholars have proposed similar differentiations concerning beliefs and metacognitions about emotions, such that emotions may be perceived as either useful or overwhelming, uncontrollable and potentially harmful (Becerra et al., 2020; Manser et al., 2012). In view of the conceptual overlap in these scales with our considerations on social comparison, we took direct inspiration from these instruments in constructing our scale (Table 1).
Item Development.
The Present Study
To develop and validate the ASCI, we broadly defined positive and negative attitudes, and included any attitudes that individuals may have concerning social comparison. We then examined the psychometric properties of our scale in three studies. Following rational, expert-based item development in Study 1, we employed a data-driven approach and explored the underlying structure of the ASCI. Despite this data-driven procedure, we expected to find two main factors reflecting positive and negative attitudes toward social comparison. The structure of the scale was then retested with confirmatory approaches in a subsample of Study 1 and a 3-month follow-up. We conducted a second and third study to confirm the structure and validity of the English and German version of the ASCI. To test the validity of the ASCI, we examined its correlations with different constructs. Given that the ASCI is designed to measure attitudes toward social comparison, we anticipated that the resulting factors would display significant relationships with social comparison (Allan & Gilbert, 1995). Moreover, given the conceptual parallels between social comparison and comparison with other standards (for review, see Morina, 2021), such as one’s own past (i.e., past temporal), certain expectations (i.e., criterion-based), other life domains (i.e., dimensional), or alternative scenarios (i.e., counterfactual), we predicted that the ASCI would also be associated with the frequency of engaging in these types of comparison. We also expected moderate correlations with metacognitions related to worry, due to their similar cognitive underpinnings (Wells & Cartwright-Hatton, 2004). In view of the established link between social comparison and various mental health and well-being outcomes, including depression, anxiety, life orientation (McCarthy & Morina, 2020), or self-esteem (Unkelbach et al., 2023), we anticipated that ASCI scores would demonstrate associations with these variables as well. Due to their proposed role in the motivation to engage in social comparison, positive attitudes measured with the ASCI were expected to correlate positively with self-evaluation motives (Gregg et al., 2011). In addition, we expected that positive and negative attitudes would be positively and negatively associated with the perceived controllability and usefulness of emotions, respectively (Becerra et al., 2020). We expected especially negative attitudes to be related to lower levels of self-concept clarity (Campbell et al., 1996). Positive attitudes toward social comparison were expected to be associated with benign envy and negative attitudes toward social comparison with malicious envy (Lange & Crusius, 2015). In general, we anticipated that the emerging factors (if more than one factor was found) would display differential associations, such that positive attitudes would be more strongly associated with positive outcomes and less strongly with negative outcomes, while negative attitudes would be more strongly associated with negative outcomes (cf. supra).
Method
Participants and Design
We report how we determined our sample size, all data exclusions, all manipulations, and all measures in the study. In Study 1, we aimed to have a sample size of at least 1,000 participants, which is recommended for scale development, as this allows adequately low measurement errors and stable factor loadings (Boateng et al., 2018). The sample sizes for the other two studies were based on practical considerations of available resources for participant compensation. In Study 1,
In Study 2, we assessed another English-speaking sample, again recruited from Prolific, consisting of
In Study 3, we recruited a German sample of
ASCI Scale Development
The aim of the ASCI development was to capture positive and negative attitudes toward social comparison. We focused on positive and negative attitudes toward social comparison, as we were specifically interested in how they influence social comparison behavior and other outcomes. Explicitly neutral attitudes were not included as we expected neutral attitudes to have limited incremental predictive value relative to attitudes that carry an evaluative valence. Attitudes were defined broadly and could cover any attitudes that individuals may hold concerning social comparison. As there was no clear starting point for such a scale in the literature, we based the item development process on existing scales tapping into adjacent constructs, that is, primarily metacognitive beliefs about worrying (Wells & Cartwright-Hatton, 2004), self-evaluation motives (Gregg et al., 2011), and beliefs about emotions (Becerra et al., 2020; Karnaze & Levine, 2020; Manser et al., 2012). After the development of candidate items, we broadly evaluated (a) whether the respective item clearly carries either positive or negative valence concerning social comparison; (b) for positive items, whether they align with one of the motives of self-enhancement, self-verification, self-assessment, or self-improvement; and (c) for all items, whether they fit in one of the categories usefulness or controllability (which reflect important dimensions on which metacognitions toward worries or emotions are evaluated; for example, Becerra et al., 2020). In the latter categorization, note that all items on the positive scale address some aspect of usefulness (e.g., “Comparing helps me improve myself”), whereas items on the negative scale could address either usefulness (e.g., “There is very little use for comparing myself to others”) or controllability (e.g., “Comparing stops me from getting things done”). This information can be found for each item in Table 1, which also describes the main source used to formulate the item or that informed item development. Along the mentioned scales, the general comparative-processing model (gComp) served as an overarching theoretical account for item development (Morina, 2021).
In a first step, we formulated items independently based on the outlined considerations. This led to an initial item pool of 49 items. Then, we discussed each of the items and evaluated their fit with the scope of the scale, clarity, and unambiguity of the language, and nonredundancy within the item pool. In several revision rounds, we eliminated items based on these criteria, which resulted in the final item pool of 24 items. These items were then sent to two different English native speakers who refined the wording in several revision rounds. The German items were developed using back translation procedures with several rounds of back-and-forth translations involving two native speakers of both languages. The final item pool of 24 items can be found in Table 1. For each item, respondents had to indicate their agreement on a 5-point Likert-type scale ranging from 1 (
Study 1: Validation Scales
Comparison Standards Scale for Well-Being
The Comparison Standards Scale for Well-Being (CSS-W; Morina & Schlechter, 2023) examines habitual upward and downward comparison with social, temporal, counterfactual, and criteria-based standards related to one’s own well-being. The CSS-W consists of (a) 14 obligatory items assessing the frequency of well-being comparisons in the past 3 weeks on 6-point Likert-type scales (0 =
Social Comparison Scale
The Social Comparison Scale (SCS) uses a semantic differential methodology to assess social rank evaluations (Allan & Gilbert, 1995). Participants make global social comparison judgments of themselves relative to others with bipolar dimensions rated from 1 to 10. For example, the scale asks, “In relation to others I generally feel”:
Meta-Cognitions Questionnaire–30
We used two subscales of the MCQ-30 (Wells & Cartwright-Hatton, 2004), namely,
Life Orientation Test–Revised
The Life Orientation Test–Revised (LOT-R; Scheier & Carver, 1992) measures positive life orientation with seven items. An example item is, “In uncertain times, I usually expect the best.” Response options range from 1 (
Patient Health Questionnaire–4
Depression and anxiety symptoms (both αs = .84) were assessed with the Patient Health Questionnaire–4 (PHQ-4), a four-item questionnaire assessing symptoms on a 4-point scale from 0 (
Rosenberg Self-Esteem Scale
The Rosenberg Self-Esteem Scale (RSES; Rosenberg, 1965) was used to measure general self-esteem consisting of 10 items. Items (e.g., “On the whole, I am satisfied with myself”) are rated on a 4-point Likert-type scale (0 =
Follow-Up: Validation Scales
In the follow-up, we also used the CSS-W (αs = .61–.79), MCQ-30 subscales (positive beliefs about worry, α = .91, and beliefs about uncontrollability of thoughts and corresponding danger, α = .91), the PHQ-4 (α = .87 for anxiety and α = .84 for depression), and the RSES (α = .93).
Study 2: Validation Scales
Self-Motives Scale
The Self-Motives Scale (SMS; Gregg et al., 2011) assesses motives of self-enhancement (α = .66), self-verification (α = .63), self-assessment (α = .74), and self-improvement (α = .66). Two items assess each of the four self-motives on a 7-point Likert-type scale (1 =
Comparison Standards Scale for Appearance
The Comparison Standards Scale for Appearance (CSS-A; Morina et al., 2023) mirrors the CSS-W described above in its structure, but focuses on one’s own appearance as the dimension of comparison. In addition to social, temporal, counterfactual, and criterion-based standards, it also assesses comparisons relative to dimensional standards (e.g., comparing one’s appearance with some other personal attribute that may stand out, or compensate for one’s appearance). Cronbach’s alpha ranged from .69 to .83 for the appetitive and aversive frequency, discrepancy, and affective impact subscales.
Emotion Beliefs Questionnaire
The Emotion Beliefs Questionnaire (EBQ; Becerra et al., 2020) was used to assess people’s beliefs about emotions, specifically their controllability and usefulness. The EBQ consists of 16 items utilizing an 8-point Likert-type scale (1 =
Help and Hinder Theories About Emotion Measure
The Help and Hinder Theories About Emotion Measure (HHTEM; Karnaze & Levine, 2020) was used to assess individuals’ beliefs about emotion. Two subscales assess whether they perceive emotions as help (α = .78) or hindrance (α = .78), with four items each on a scale from 1 (
Self-Concept Clarity Scale
The Self-Concept Clarity Scale (SCCS; Campbell et al., 1996) was used to measure the stability, clarity, and confidence of self-beliefs. This scale contains 12 items (α = .92) on a 7-point Likert-type scale (1 =
Benign and Malicious Envy Scale
Benign and Malicious Envy Scale (BeMaS; Lange & Crusius, 2015) assesses benign (α = .83) and malicious (α = .83) envy with five items each on a 6-point Likert-type scale (1 =
Study 3: Validation Scales
In the German sample in Study 3, we used the German version of the CSS-W (Morina, 2020, αs = .56–.77), the SCS (see Ascone et al., 2017 for the German version α = .89), the PHQ-4 (see Löwe et al., 2010 for the German version, α = .69 for anxiety and α =.81 for depression), and the RSES (Roth et al., 2008, for the German version, α = .90).
Analysis Plan
The data, materials, and code to reproduce the present analyses are openly available on the open science framework: https://osf.io/u9b4n/?view_only=c945a29e3e33449b937e176e5e30f3e0. Our studies were not preregistered. All analyses were conducted in R version 4.01 (R Core Team, 2021). Our analysis was data-driven, and we aimed to reduce the number of items for the final scale. First, we conducted exploratory factor analysis (EFA) to explore the underlying number of latent factors. Second, we used confirmatory factor analysis (CFA) to confirm this factor structure. To this end, we randomly split the sample of Study 1 into one sample for the EFA and one sample for the CFA. In the follow-up sample of Study 1 as well as in Study 2 and Study 3, we conducted CFAs to confirm the factor solution found in Study 1.
Exploratory Factor Analysis
To explore the underlying structure of our data, we used EFA. To discern the number of latent factors, we conducted parallel analysis and visually inspected the scree-plot (Fabrigar & Wegener, 2011). In line with Fabrigar and Wegener (2011), we additionally used the Velicer’s minimum average partial (MAP) test, the very simple structure (VSS), and the Kaiser criterion (eigenvalues above 1). As rotation method, we chose promax rotation (allowing factors to be correlated), as we assumed that the underlying factors would be correlated among each other. As data were ordinal, we ran the EFA with the lavaan package in
Confirmatory Factor Analysis
To confirm the factor structure that was found in the EFA, we used the second subsample of Study 1 to conduct a CFA with this factor structure. The same procedure was applied for the follow-up data of Study 1 and the samples in Study 2 and Study 3. For the CFA, items were again treated as ordinal and we used the WLSMV estimator (Asparouhov & Muthén, 2010). To evaluate model fit, we used the following criteria: Comparative fit index (CFI) and Tucker–Lewis index (TLI) values > 0.95 indicate good fit and values > 0.90 indicate acceptable fit; root mean square error of approximation (RMSEA) and standardized root mean square residuals (SRMR) values < .05 indicate good fit and values < .10 indicate acceptable fit (Hu & Bentler, 1999). The lavaan package in R was used (Rosseel, 2012).
Measurement Invariance Across Gender, Time, and Language
For a new measure, it is important to demonstrate that any differences in the manifest variables between different groups and across time reflect true-score differences. Research on habitual comparison frequencies suggests that gender differences may play a role in comparison processes (Morina & Schlechter, 2023). We, therefore, additionally tested whether the ASCI measures the same underlying construct among males and females and across time. To this end, we conducted measurement invariance analysis between men and women and across time from Study 1 to follow-up (Chen et al., 2020). Following Svetina et al. (2020), increasingly constrained nested models were sequentially tested against each other. The respective constraints were added for each model in addition to the constraints introduced in the model before (Chen et al., 2020). First, the factor structure was constrained to be equivalent across gender and across the first assessment and the follow-up assessment (configural invariance/ baseline model). Second, we tested a model, in which the thresholds were constrained to be equal across groups or time (threshold invariance). Third, as recommended for ordinal data (Svetina et al., 2020; Wu & Estabrook, 2016) the factor loadings were additionally constrained to be equivalent to gauge whether the factor loadings and observed thresholds conditional on the latent factors do not differ across gender and time (threshold/loading invariance). Finally, the residual variances of the items were also constrained to be equal to scrutinize whether the amount of variance in the items not explained by the latent factors does not differ across gender and time (residual invariance; Chen et al., 2020). Longitudinal measurement invariance was modeled in a wide format, in which we allowed the residuals of the same indicators to freely vary over time (Liu et al., 2017). As data were ordinal, we used theta parameterization. To detect violations of measurement invariance, we evaluated changes (Δ) in the CFI and RMSEA. The differences between the fit indices of two nested models indicate that measurement invariance has been violated when ΔCFI exceeds 0.010 and ΔRMSEA exceeds 0.007 (Chen et al., 2020; Neufeld et al., 2023).
Nomological Network
To examine the convergent validity of the ASCI, we calculated scale composite scores of the resulting scales and correlated them with the mean values of the variables that were theoretically expected to be associated with our new measure (Table 7). Specifically, in Study 1 and its follow-up, the resulting scores were correlated with aversive and appetitive well-being comparison frequency, discrepancy, and affective impact as well as social comparison, metacognitive beliefs about worry (positive beliefs & beliefs about uncontrollability and danger), life orientation, depression, anxiety, and self-esteem. In Study 2, we correlated the corresponding scores with self-motives, aversive and appetitive appearance-related comparisons, beliefs about emotions, self-concept clarity and benign and malicious envy in the English-speaking sample. In Study 3, scores were correlated with comparison frequency, discrepancy and affective impact, social comparison, depression, anxiety, and self-esteem.
Results
Descriptive Statistics and Exploratory Factor Analysis
Descriptive statistics for the initial 24 items can be found in Table 2. Skewness and kurtosis for all items were good. Next, we conducted the EFA with the first subsample of Study 1 (
Descriptive Statistics of All Items.
Item Selection
In a next step, we examined the factor loadings of the resulting two-factor solution (Table 3). First, we excluded items that loaded below our cut-off of .50, which only accounted for Items 1 and 19 (Table 3 for the item content). Next, we identified items with substantial double loadings (i.e., a factor loading of > .20 on a different factor than the primary factor), which was the case for Items 4, 6, 7, 11, 12, 13, 14, 15, and 17. A closer inspection of these items revealed that they were ambiguous and may be interpreted differently depending on contextual factors and the activation of different self-motives. This item exclusion resulted in a remaining item pool of 13 items. Accordingly, these items best represent the two factors underlying the data.
Initial EFA Factor Loadings in the First Subsample of Study 1 (N = 542).
Inspection of the item content revealed that the first factor captures positive attitudes toward social comparison (eight items), whereas the second factor taps into negative attitudes toward social comparison (five items). Item 18 (“Comparing helps me know where I stand socially”) and Item 22 (“Comparing helps me know where I stand in society”) appeared to measure very similar contents, leading to potentially spurious item intercorrelations. Factor loadings of these items were also very similar (Table 3). Based on the consideration that Item 18 (“Comparing helps me know where I stand socially”) leaves greater room to refer to the proximal environment (e.g., friends, peers, and family) and aligns more closely with the putative underlying motives of engaging in social comparison, we decided to exclude Item 22. Accordingly, we had 12 items in our final item pool, of which Items 2, 8, 10, 16, 18, 20, and 24 loaded on Factor 1, and Items 3, 5, 9, 21, and 23 loaded on Factor 2 (Table 4 for the final item pool). Based on the item content, Factor 1 was coined
Standardized Factor Loadings of the Second EFA and of the Different CFAs.
Confirmatory Factor Analysis
We used the second subsample of Study 1 to conduct a CFA (
Model Fit for the Two-Factorial Solution in the CFAs.
In both Study 2 and Study 3, model fit was good according to the CFI and TLI and acceptable according to RMSEA and SRMR. The latent correlation among the two latent factors
Measurement Invariance Across Gender, Time, and Languages
In Study 1, the highest level of measurement invariance was established (see Table 6), which allows the interpretation of mean differences across gender. In Study 1, men reported higher levels of
Measurement Invariance of the Two-Factor Solution Between Males and Females and Across Baseline to Follow-Up.
Nomological Network
Table 7 shows the correlations of the two factors with other constructs. In Study 1 and with respect to the cross-sectional assessment,
Correlations With Validators and Among Each Other.
The CSS-W was used in all studies expect for the English sample in Study 2 where the CSS-A was used instead.
Concerning the predictive validity of the ASCI, we found that
In Study 2,
In Study 3, in the German sample,
Discussion
Given the lack of a scale on individual differences in positive and negative attitudes toward social comparison, we developed and validated the ASCI in three studies, including one longitudinal examination. By employing data-driven reduction methods, we were able to derive a 12-item two-factor solution accounting for
Of our initial item pool that was based on detailed theoretical considerations informed by current literature on comparative thinking (Morina, 2021) as well as existing scales tapping into metacognitions about worrying (Wells & Cartwright-Hatton, 2004), self-evaluation motives (Gregg et al., 2011), and beliefs about emotions (Karnaze & Levine, 2020; Manser et al., 2012), 12 items constituted the final version of the ASCI. Seven of these items reflected the underlying factor
The second factor
Crucially, the psychometric properties of the scale were robust, as evidenced by good model fit of the two-factor model, excellent factor loadings of the indicators, and internal consistencies of the ASCI scores. Furthermore, the scale demonstrated measurement invariance across gender, which is particularly relevant given that gender differences were observed in the scale, with women exhibiting more negative attitudes toward social comparison compared with men. The demonstration of measurement invariance indicates that gender effects are true effects and not a result of measurement error or other artifacts. These findings are in line with prior research demonstrating that women engage in social comparison more frequently than men and experience greater negative affect following comparison (Morina & Schlechter, 2023), and suggest that attitudes toward comparison may contribute to gender differences. Likewise, ASCI demonstrated measurement invariance across time, which is important for longitudinal investigations. Stability (i.e., retest reliability) of the ASCI scores was only moderate, which is not necessarily surprising as attitudes do not represent stable traits, for which a higher stability would be expected. Given that longitudinal measurement invariance was supported, the moderate stability appears to reflect some genuine changes in attitudes over time. Within 3 months between assessments, individuals may have encountered situations where social comparison was beneficial or harmful to them, and this may have instigated a change in their attitudes. Furthermore, the observed associations with external validators are consistent with the theoretical propositions generated from our theoretical framework both cross-sectionally and longitudinally (Becerra et al., 2020; Gregg et al., 2011; Morina, 2021; Wells & Cartwright-Hatton, 2004), thus supporting convergent and predictive validity of the scale scores. Association with scales that informed our item development was strong for metacognitive beliefs about worrying (Wells & Carter, 2001), but lower correlations were found with self-motives (Gregg et al., 2011) and beliefs about emotions (Becerra et al., 2020). This may reflect the circumstance that self-motives are complex and often not easily obtainable to individuals and are often contingent upon contextual activation (Sedikides & Strube, 1997). However, stronger correlations of ASCI scores with benign envy or self-concept clarity point to the importance of self-motives as they may reflect motives of self-improvement or self-assessment (Sedikides & Strube, 1997). Thus, the present study may not have fully captured the complexity of self-motives, warranting further investigation to better understand the conditions under which individuals engage in upward or downward social comparison. The beliefs about emotions scales were instrumental in developing items that capture attitudes toward social comparison but attitudes concerning emotions may differ from cognitive processes of comparison and worry. Notably, positive and negative attitudes toward social comparison were differentially associated with validators such as positive and negative beliefs about worrying or benign and malicious envy, highlighting the potential of the scale to address nuanced research questions. Nomological networks differed between the German sample and the other samples. In the German sample, positive attitudes were positively associated with depressive symptoms, which we did not find in the other samples. Likewise, the two attitudes toward social comparison factors correlated negatively with each other, but their magnitude differed across studies (range
Our study has some limitations. Although the study had large sample sizes, it would be prudent for future research to expand the scope of the investigation by using the ASCI with broader, more diverse groups of participants across contexts outside of Western Europe. In addition, the German sample in Study 3 was relatively small, and its gender composition was predominantly female. Therefore, evidence for the validity of the German version of the scale is preliminary at best and further investigation is required. Moreover, we examined the scale properties within the framework of classical test theory. Future research can use item response theory for a more in-depth investigation of item properties or latent reliability (Reise & Waller, 2009). The ASCI exclusively assesses positive and negative attitudes toward social comparison. Although the inclusion of neutral attitudes may provide a comprehensive understanding of the entire spectrum of attitudes toward social comparison, we anticipated limited incremental predictive value in terms of social comparison behavior and other outcomes. Furthermore, we expected that a reasonable amount of the variance associated with neutral attitudes would be captured by the ASCI response options. Yet, future research needs to investigate the role of neutral attitudes toward social comparison and associated outcomes. Our research revealed that negative attitudes exhibited somewhat stronger associations with external validators than positive attitudes toward social comparison. Future research may focus on constructs that should align more closely with positive attitudes toward social comparison, to investigate how such attitudes influence social comparison processes. Subsequently, it would be worthwhile to examine the correlation between ASCI scores and more specific components of comparison processes (e.g., comparison frequencies, standard selection, cognitive, affective, and behavioral responses to comparison outcomes). To allow such an in-depth investigation of positive and negative attitudes and their translational effects, careful experimental settings or experience sampling studies are required. This is an important step to further validate the ASCI, as we validated it against scores of other measures. Given that the construct of attitudes toward social comparison is not empirically established, research needs to examine whether ASCI scores predict actual behavior in naturalistic settings. Moreover, future studies could attempt to thoroughly disentangle different types of social comparison based on their function. For instance, downward social comparison may sometimes serve as a strategic means to counteract negative emotions that arise from upward comparison. In gComp, this constitutes a tertiary comparison that primarily serves the self-enhancement motive by adjusting the consequences of a previous comparison, and is distinct from primary or secondary comparisons that mainly serve self-assessment or self-improvement motives (Morina, 2021). Furthermore, there is currently a lack of knowledge concerning appropriate cut-offs for differences in fit indices to establish measurement invariance in ordinal data. We, therefore, used strict cut-offs, but they need to be interpreted with caution (Chen et al., 2020; Neufeld et al., 2023). Finally, some internal consistencies of the CSS scales were rather low, necessitating careful interpretation of the associations between the ASCI and CSS subscales.
Conclusion
The ASCI has shown residual measurement invariance across gender and time, and both factors were associated with various relevant constructs. It provides a psychometrically sound tool for researchers and practitioners interested in studying individual differences in attitudes toward social comparison, a pivotal construct in enhancing our comprehension of social comparison processes and their role on individuals’ cognitions, emotions, and behavior.
Footnotes
Author Contributions
P.S. contributed to conceptualization, data curation, formal analysis, investigation, methodology, software, validation, writing—original draft, writing—review and editing. T.M. contributed to conceptualization, data curation, project administration, resources, writing—original draft, writing—review and editing. N.M. contributed to conceptualization, data curation, investigation, project administration, resources, supervision, validation, writing—original draft, writing—review and editing.
Declaration of Conflicting Interests
The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding
The author(s) received no financial support for the research, authorship, and/or publication of this article.
