Abstract
Recent research on CEOs’ narcissism has mostly used unobtrusive measures, even though such measures have not been validated sufficiently. In two settings (Study 1 with 601 participants from various occupations and Study 2 with 97 managing directors), we analyze the construct validity of the commonly used narcissism index (NI). We find that the NI is only moderately correlated with the established and validated Narcissistic Personality Inventory (NPI), which calls into question the convergent validity of the NI. We further alter the company’s financial performance in our simulation to test whether performance affects the NI. Results show that individuals have different levels of NI after a period with a high compared with a low financial performance. This casts doubt on previous findings in organizational research using the NI and other unobtrusive measures because it reverses the common assumption of cause and effect.
Unobtrusive measures (Webb et al., 1966; Webb & Weick, 1979) have gained a lot of attention, especially, from researchers who investigate how CEO’s personality traits and values affect strategic choices and firm performance (Carpenter et al., 2004). Because direct access to leaders within large companies is limited and CEOs will scarcely answer questions about their psychological traits (Carpenter et al., 2004; Cycyota & Harrison, 2006), many scholars rely on evidence executives leave behind in their environment such as in public documents (Chin et al., 2013; Dahl et al., 2012; Finkelstein et al., 2009). One of the most prominent approaches is Chatterjee and Hambrick’s (2007) narcissism index (NI), an alternative measure for CEO narcissism when other established approaches (e.g., collecting self-reported data) are not feasible. Their unobtrusive measure includes the prominence of CEO’s photograph in annual reports (ARs), the prominence of a CEO’s name in press releases, the CEO’s use of first-person singular pronouns in interviews, and relative compensation. They found in a study of 111 CEOs that narcissists, as measured by the NI, prefer bold actions such as acquisitions and tend to generate higher fluctuations in performance. Their measure has appealed to many academic scholars who study the impact of narcissistic CEOs, for instance, on risk taking or different performance outcomes (Chatterjee & Hambrick, 2011; Engelen et al., 2013; Gerstner et al., 2013; Patel & Cooper, 2014; Tang et al., 2018; Zhu & Chen, 2015a, 2015b). In their recent meta-analysis, Cragun et al. (2020) highlight that the NI (in its original or slightly modified version) has become the most frequently used method in CEO narcissism research with 23 out of 42 articles using the NI. However, despite its common use, several concerns come up when using the NI. For example, findings from a recent review and replication study question the reliability (or more precisely, the internal consistency) of the NI (Van Scotter, 2019). In our study, we focus on two important concerns that cast doubt on whether the NI truly reflects a narcissistic personality.
First, research has failed to provide a clear picture of the relationship between this measure and other established measures of narcissism (convergent validity), the most important of which is the predominant and extensively validated Narcissistic Personality Inventory (NPI; Emmons, 1984; Raskin & Hall, 1979, 1981); and has not tested its relationship to other personality constructs (discriminant validity) yet. This is all the more surprising since this lack of validation is constantly criticized (Blettner, 2012; Hill et al., 2014; Wales et al., 2013) and even recognized as a main limitation by scholars using the NI (Chatterjee & Hambrick, 2007, 2011; Ingersoll et al., 2017; Tang et al., 2018; Zhu & Chen, 2015a). The first objective of our work is therefore to test the construct validity of Chatterjee and Hambrick’s (2007) NI. We design an online simulation that allows for simultaneous assessment of the NI and the NPI. In two different studies (Study 1 with employees from various occupations and Study 2 with a sample of managing directors), we test convergent validity by examining correlations between both measures. In addition, we test discriminant validity in Study 1 and compare the pattern of correlations with a set of frequently studied personality constructs (e.g., psychopathy and Machiavellianism).
Second, we argue that the NI is also affected by external factors such as company growth or performance and highlight the general concern that empirical studies investigating CEO characteristics as determinants of corporate decisions might be endogenous to (expected) outcomes (Antonakis et al., 2010; Bascle, 2008). In our studies, to exemplify the context, we test whether the NI is robust for a company’s financial performance. In a counterbalanced within-subjects design, we observe whether manipulations in the financial performance (three levels in Study 1 and two levels in Study 2) influence the reactions of participants as displayed in their NI score (e.g., choice of the size of picture in the AR).
With our work, we directly address the limitation mentioned by Chatterjee and Hambrick (2007) that characteristics other than CEO narcissism might confound the NI and requests for further validation. The lack of empirical evidence that supports the construct validity of the NI and other unobtrusive measures is a serious concern because poor construct validity can make any other type of validity (statistical conclusion, internal, and external validity) dispensable. Thus, measure deficiency may produce a series of subsequent failures in these studies and lead to flawed theoretical and practical implications. Deriving the right conclusions is crucial since narcissism and similar attributes of leaders are important indicators of organizational behavior and outcomes and spark interest among academic scholars (Grijalva et al., 2015; O’Reilly et al., 2018; Simonet et al., 2018; Wong et al., 2017).
Narcissism and Its Measurement
The psychological construct of narcissism consists of two elements: a grandiose self-view and self-regulating strategies to uphold or inflate that view (e.g., Morf & Rhodewalt, 2001). The narcissists’ grandiose self-view refers to an agentic and inflated sense of the own capabilities, such as intelligence and leadership ability (Gabriel et al., 1994; Judge et al., 2006). To maintain and further bolster their exaggerated self-view, narcissists swagger about their qualities, direct attention to the self (Buss & Chiodo, 1991), and seek applause and affirmation from outside (Morf & Rhodewalt, 2001; Wallace & Baumeister, 2002). They also show a need for power and to dominate other people (Bradlee & Emmons, 1992; Carroll, 1987).
Since Kets de Vries and Miller’s (1985) research established the topic of narcissism in organizational contexts, narcissistic leaders have been studied extensively (W. K. Campbell et al., 2011; Hoffman et al., 2013; Rosenthal & Pittinsky, 2006). In empirical studies, the most common measurement of narcissism is the NPI (Emmons, 1984; Raskin & Hall, 1979, 1981). The NPI is a forced-choice questionnaire that in its original version was derived from the traits of narcissistic personality according to the
Nonetheless, upper echelon researchers have mostly relied on unobtrusive measures of narcissism (Cragun et al., 2020) because top executives are disinclined to participate in surveys and scarcely allow asking about their personalities (Carpenter et al., 2004; Cycyota & Harrison, 2006). In an initial study, Chatterjee and Hambrick (2007) computed the NI by gathering information about CEOs from public documents: prominence of a CEO’s photograph in the AR, prominence of a CEO’s name in press releases, cash and noncash compensation relationship between a CEO and the second-highest paid executive, and CEOs’ use of personal pronouns in interviews. The last indicator has been excluded from most studies (Chatterjee & Hambrick, 2011; Engelen et al., 2013; Gerstner et al., 2013; Tang et al., 2018; Zhu & Chen, 2015a, 2015b) because its inclusion weakened internal reliability of the index, CEOs’ interviews follow a more rigid format in the post-Sarbanes-Oxley era, or the number of available interviews was insufficient. In a few recent studies, the CEO’s name in press releases has also been excluded and the coding of the CEO’s photograph has been modified (Ingersoll et al., 2017; Marquez-Illescas et al., 2019). While these scholars reduced the number of indicators, others used the CEO narcissism score, a more composite measure consisting of 15 indicators adding, for instance, number of awards or acquisitions (Buchholz et al., 2019; Rijsenbilt & Commandeur, 2013). Table 1 contains an overview of the studies using the NI in its original or modified version. In all these studies, CEO narcissism has a direct or moderating effect on company decisions and outcomes.
Overview of NI Studies and Their Validation Checks.
NI of Chatterjee and Hambrick (2007): (1) Photograph, (2) Name in press releases, (3) Relative cash and (4) Relative noncash compensation, (5) Personal pronouns in interviews; CNS of Rijsenbilt and Commandeur (2013): (1) Publicity (2) Awards, (3) Lines in biography, (4) Corporate jet use, (5) Cash compensation, (6) Total compensation, (7) Ratio cash compensation, (8) Ratio total compensation, (9) Rank compensation, (10) CEO duality, (11) Role titles, (12) Governance index (13) Photography, (14) Value of acquisitions, (15) Number of acquisitions.
Concerns About the Narcissism Index
Chatterjee and Hambrick (2007) aligned items from Emmons’ (1984) NPI to their indicators to illustrate how the NI reflects a narcissistic personality. For example, they argued that the NPI item “I like to look at myself in the mirror” can be translated into “I enjoy the visibility that comes with being CEO” and, thus, narcissistic CEOs would also enjoy more prominence in ARs and press releases (for more details, see Chatterjee & Hambrick, 2007, Table 1, p. 365).
Whereas their argument seems logical and provides some face validity, the NI might lack construct validity. Chatterjee and Hambrick (2007) and few other researchers using the NI include some kind of validity checks. Table 1 displays how (if at all) they address construct validity concerns. In sum, these studies may provide some evidence that the NI overlaps with the definition of narcissism. However, results rely on very small subsamples (10 to 39 CEOs) and third-party ratings that are mostly based on very short definitions and a 1-item measure of narcissism. In another study, Petrenko et al. (2016) used third-party ratings of video samples of CEOs to measure CEO narcissism and identified in one of their robustness checks a much weaker correlation between their measure of narcissism and the NI (
Furthermore, we are not aware of any study examining discriminant validity. Ruling out alternatives is important to determine which construct the measures exactly tap. For example, other work has used the same indicators as used in the NI to measure CEO self-importance, core-self evaluations, or dominance (Hambrick & D’Aveni, 1992; Hayward & Hambrick, 1997; Hiller & Hambrick, 2005). Hence, we question whether the NI would be highly correlated with other traits and measures constructs other than narcissism.
In addition, relationships found between the NI and company outcomes might be subject to reversed causality, or omitted variable biases (contextual factors that influence both the NI, and the outcome variables such as acquisition decisions or risk taking). Chatterjee and Hambrick (2007) and few ensuing studies discussed similar issues and controlled at least for some potential antecedent and contemporaneous variables. Nonetheless, they can only diminish the problems, and other scholars have not corrected for endogeneity at all. In the following, we use the company’s financial performance as an example to show that external stimuli might affect the NI and that CEOs may show higher NI values without having a narcissistic disposition.
Individuals are inclined to reinforce the positivity of their self-concept by self-serving biases in the attribution of causality (Bradley, 1978; Miller & Ross, 1975). Furthermore, individuals use impression management (Baumeister, 1982) and self-present to others in a specific manner revealing only some aspects, but concealing others (Goffmann, 1959). In managerial contexts, executives attribute the cause of success to themselves and name their own capabilities when explaining good outcomes, but renounce responsibility and name external causes when explaining bad outcomes (Bettman & Weitz, 1983; Clapham & Schwenk, 1991; Salancik & Meindl, 1984). As a consequence, we expect CEOs to present themselves in a more prominent manner following good years (e.g., they choose a larger picture of them alone). Of course, other factors such as firm size, innovativeness, or risk may have similar effects. However, for the ease of readability and interpretation, we limit our argumentation and empirical study to financial performance and discuss other factors in the future research section in more detail. Based on these considerations, we question whether the NI is disturbed by contextual factors.
We test both questions in two studies with different samples.
Study 1
Sample and Procedure
We conducted an online experiment on Amazon Mechanical Turk (MTurk) with 601 individuals (mean age = 34.02, 47% female, 53.7% with bachelor’s degree or higher, 69.7% with work experience of 6 years or more). The study was divided into two parts and participation took about 25 minutes. First, we used a simulation to rebuild the NI. Therefore, we developed a cover story where participants were put into the position of CEO of one of the 500 largest U.S. companies. Participants then made decisions that capture the NI indicators over a period of 3 years. Each year started with a background story about the company’s financials in the preceding year, which was high, medium, or low. All participants were confronted with these three manipulations (within subjects). To avoid order or learning effects, the order varied randomly between participants. In the second part, participants completed self-descriptive personality scales such as the NPI, provided demographic information, and answered questions that we used as manipulation checks.
Measures
We gathered (in the order described below) and computed the
The variable
We did not include CEOs’ use of first-person singular pronouns in interviews as this indicator was excluded from almost all subsequent studies. We computed the
Study 1: Descriptive Statistics and Correlations of NPI and NI.
NI is the sum of the three standardizes variables picture, pay, and press. bPicture, pay, and press are averaged across the three situations.
We measured self-rated narcissism with the
For the nomological network, we included concise measurements of related constructs that have proven important in prior studies. We measured self-esteem (Rosenberg Self-Esteem Scale [RSE]) with Rosenberg’s (1965) 10 items. We used Gosling’s et al. (2003) Ten-Item Personality Inventory (TIPI) to measure the Big-Five personality dimensions (McCrae & Costa, 1987):
We controlled for
In addition, we included manipulation checks. In the end of the survey, we asked whether participants identified with their role as CEO using a 7-point scale from 1 (
Analytical Strategy
The first goal of the analysis was to assess the convergent and discriminant validity of the NI (Research Question 1). To do so, we followed D. T. Campbell and Fiske’s (1959) multitrait–multimethod criteria and placed the NI and the NPI into the nomological network of narcissism. The second aim of our analyses was to corroborate whether differences exist in the NI between the three financial situations (Research Question 2). Therefore, repeated measures analysis of variance (ANOVA) was appropriate.
Results
Manipulation Checks
We found that on average participants identified with their role as CEO, with a mean of 5.26 on a 7-point scale. A repeated-measures ANOVA conducted on the manipulation checks for the three conditions yielded statistically significant within-subject effects,
Convergent and Discriminant Validity
To answer Research Question 1, we followed D. T. Campbell and Fiske’s (1959) four criteria to test the construct validity of the NI. In these analyses, we averaged and standardized the NI across the three conditions to yield an overall NI for each individual neglecting the financial performance. First, we tested convergent validity while correlating the NI and the single components with the NPI and its four factors. The correlations among these variables are displayed in Table 2. The analysis revealed a positive but only moderate correlation between the NPI and the NI (
Second, we examined discriminant validity by looking at the pattern of correlations in the nomological network (Cronbach & Meehl, 1955). Table 3 displays correlations among the NI, NPI, and the other personality scales and controls. According to the second and third criteria, the monotrait–heteromethod correlation (NI and NPI), should be higher than all heterotrait–heteromethod (e.g., NI and RSE) and heterotrait–monomethod (e.g., NPI and RSE) correlations. We found that the correlation between the NI and the NPI exceeded all the heterotrait–heteromethod correlations. However, we found higher correlations among the NPI and some other personality dimensions measured with the same method such as extraversion, openness to experience, Machiavellianism, and psychopathy. Thus, the third criterion was not fulfilled.
Study 1: Descriptive Statistics, Reliabilities, and Correlations Among Variables.
NI is averaged and standardized across the three situations. bOrdinal variable, 37.3% no degree, 9.0% associates degree, 40.0% bachelor’s degree, 12.5% master’s degree, 1,2% doctorate. cOrdinal variable, 12.2% < 3 years, 18.1% 3-5 years, 25.1% 6-10 years, 25% 11-20 years, 19.6% > 20 years.
The fourth criterion from a construct validation perspective is that the pattern of correlations should be similar across methods. In our setting (see Table 3), the NI exhibited patterns of correlations that matched only slightly those obtained for the validated NPI. Significant correlations between the two narcissism measures and the personality dimensions diverged substantially (Δ
To test whether our findings were driven by common method bias (Podsakoff et al., 2003) and to provide another test of discriminant validity, we included a variable in our experiment (
In sum, we did not find a consistent pattern of convergent and discriminant validity in our data, with the validity correlation (NPI and NI) being stronger than the other correlations. In contrast, we found a stronger overlap between the NPI and other personality scales.
Effects of Financial Performance
To answer Research Question 2, we investigate differences in the NI among the three financial conditions within individuals in that we computed three NI scores (one for each year/condition) for each CEO. We then compared the mean NI scores across the three conditions using a repeated-measures ANOVA. Table 4 displays means and standard deviations of the NIs for each financial performance condition. We found significant differences in the test of within-subjects’ effects,
Study 1: Means and Standard Deviations of NI for Each Financial Condition.
Numbers with different letters are statistically different from each other.
Robustness of Results and Further Analyses
Demand characteristics due to the repeated measures design could cause the context effects found in our main analysis. To mitigate this concern, we neglected the repeated measures in an additional analysis where we took only the first year into account. We yielded qualitatively similar results. In addition, we found no support for the order of the manipulations influencing our results. Furthermore, we ran several multivariate analyses to model the effect of the financial performance on the NI within individuals (tables are not displayed, but analyses are available on request). We regressed NI on NPI, financial performance and other control variables. In a two-stage multilevel model taking, the repeated measures of the NI into account, the NPI remained positive, but only moderately related to the NI. The results provide further support for NI being affected by the financial situation. We achieved similar results when we excluded all outliers or participants who provided incongruous answers in the manipulation checks.
Study 2
Sample and Procedure
The aim of Study 2 was to replicate the main findings from Study 1 in a sample of CEOs and managing directors. We sent an e-mail invitation to personal contacts and contacts of colleagues and friends as well as recruited managing directors and CEOs, mainly from small and medium sized companies, via a social network platform for business contacts. In total, we were able to use a sample of 97 managing directors and CEOs (20.6% female, 80.4% bachelor degree or higher, 67% with experience as a director of a company of more than 6 years) who lead companies of different size (37.1% with up to 10 employees, 34% with 11-50 employees, 14.5% with 51-250 employees, 14.4% with 251 up to 22,500 employees) and in different industries (e.g., automotive, manufacturing, wholesale, finance, and services) in Germany.
We designed the experiment as a brief version of the experiment in Study 1 to increase the likelihood of participation. Participation took about 15 minutes. We translated the first part of Study 1 into German and made some minor changes with regard to the German context. The procedure and tasks remained equal except for the reductions mentioned below. In the second part, we only measured self-rated narcissism with the NPI and included questions that we used for manipulation checks and demographic information to keep process time short.
Measures
We computed the
Study 2: Descriptive Statistics and Correlations of NPI and NI.
NI is the sum of the three standardizes variables picture, pay, and press. bPicture, pay, and press are averaged across the two situations.
We used a German translation of the
Analytical Strategy
The goal of the analyses was to replicate the main results from Study 1. First, we intended to measure convergence of the NI with the NPI (Research Question 1). Second, we aimed to test whether the financial performance influenced the NI (Research Question 2). Therefore, we ran a paired samples
Results
Manipulation Checks
We tested whether our manipulation was effective using a paired samples
Convergent Validity
As in Study 1, we averaged and standardized the NI across the two financial conditions to yield an average NI for each individual. To answer our Research Question 1, we tested convergent validity with correlations that are displayed in Table 5. The correlation between the NPI and the NI were positive but even smaller than in the MTurk sample and not significant (
Effects of Financial Performance
We next compared the effects of the two financial situations on the NI with a paired samples
Study 2: Means and Standard Deviations of NI for Each Financial Condition.
To lower concerns that demand characteristics created this result, we again took only the first year of each CEO into account and tested whether the manipulation had different effects between participants. An independent samples
Discussion
Discussion of Results
Our work directly addresses Chatterjee and Hambrick’s (2007) call to assess the correlation between the NI and Emmons’ (1984) NPI. The results of our two studies indicate that the decisions that form the NI are positively related to the NPI. Nonetheless, we cannot establish strong convergent validity since we find in two different samples that the correlations between the two measures of narcissism are only small to moderately high (
Consistent with previous work, our results exemplify problems about the measurement of CEO personality and invalid inferences (Hollenbeck et al., 2006; Pitcher et al., 2000). We question the validity of the NI and find that the NI is only weakly related to the common and validated NPI. This extends results from Van Scotter (2019), who found that the reliability estimates of the NI are mostly insufficient. Furthermore, we find evidence that context indeed affects the NI. Interestingly, the effect of financial performance on the NI differs in our two studies. When the simulated financial performance is high, the NI is significantly higher in the MTurk sample with participants mostly from the United States (Study 1) and significantly lower in the sample with managing directors and CEOs from Germany (Study 2). In the theoretical part of our manuscript, we assumed that the NI is higher following good financial performance based on self-serving biases (Bradley, 1978; Miller & Ross, 1975). However, we found the opposite in Study 2. That is, managing directors and CEOs in Germany are more inclined to give priority to their executive team members when performance was high, but were more likely to refer to themselves when performance was low. This result is surprising and we can only speculate on its causes. First, cultural differences might affect how participants react to their company’s performance. According to GLOBE, institutional collectivism is valued more in Germany than in the United States, which indicates that group loyalty and group cohesion are more encouraged in the German culture (House et al., 2004). Consequently, German participants might feel stronger obliged to accept part of the blame for low company performance. Moreover, prior cross-cultural research has indicated some differences in the use of impression management practices between countries (Bolino et al., 2016). In line with our findings, self-enhancement and emphasizing individual excellence have been sown to be rather common in the United States, but relatively rare in Germany (Bye et al., 2011; Sandal et al., 2014). It has been reasoned that individuals within societies with lower economic inequality (such as Germany) are less dependent on self-presentation tactics (Sandal et al., 2014). Moreover, Germany compared with the United States scores higher (lower) on Schwartz’s (2006) cultural value orientations of autonomy (vs. embeddedness), harmony (vs. mastery), and egalitarianism (vs. hierarchy; Schwartz, 2008) that have all been proposed to be negatively related to emphasizing individual excellence (Sandal et al., 2014). Second, the two samples also differed with regard to leadership experience. Managing directors and CEOs, who were surveyed in Study 2, might have a better understanding of team dynamics that arise when they claim success, but blame others for failures. In addition, CEOs might also possess higher self-monitoring capacities to control expressive behavior and self-presentation oriented toward social appropriateness (Snyder, 1974; Sosik et al., 2002). Overall, we could not disentangle in our studies,
We propose to carefully interpret the findings of studies using the NI to measure CEO narcissism and to be cautious when drawing the conclusion that the strategies and outcomes investigated result from a narcissistic personality. Our results have far-reaching implications since the NI has become the most prominent measure in CEO narcissism research in the management literature (Cragun et al., 2020) and has recently also sparked interest among other research areas such as marketing or accounting (Kashmiri et al., 2017; Olsen et al., 2014). Our work calls for attention to other studies using unobtrusive measures. If researchers use weak (unobtrusive) measures with low construct validity, their work, even if thoroughly conducted, may exhibit low statistical conclusion validity and, thus, low internal and external validity. Wrong conclusions due to weak measures may further lead to deficient practical implications (e.g., for selection and placement of CEOs) and distort theoretical implications and frameworks that rely on findings from studies using the NI and other unobtrusive measures. This is all the more relevant since research on CEO personality in general (Araujo-Cabrera et al., 2017; Colbert et al., 2014; Wong et al., 2017), and narcissism in particular (Gupta & Misangyi, 2018; Gupta et al., 2018; O’Reilly et al., 2018; Zhang et al., 2017), continues to engender interest among researchers. Our findings also cast doubt on previous studies that showed that the NI and similar measures predict outcomes such as financial performance as it reverses the common assumption of cause and effect. Looking at the CEO studies using the NI included in the meta-analysis of Cragun et al. (2020), we identified that only half (12 out of 23) of the manuscripts discussed endogeneity concerns or controlled for some potential antecedent and contemporaneous variables to reduce these concerns. While the meta-analysis of Cragun et al. (2020) provides indications that the NI is influenced by firm size, our study demonstrates that financial performance affects the NI. Taken together, our findings highlight that endogeneity is a serious problem in these studies that should not be neglected, but needs to be addressed accordingly. We encourage future work to consider and critically reflect on the problems of reversed causality and omitted variable biases. Before making causal claims, researchers need to thoroughly identify the source of endogeneity and follow the recommendations provided in the literature (e.g., Antonakis et al., 2010; Bascle, 2008).
Although we illustrate concerns about the NI, our intention is not to discourage researchers’ pursuit of using or developing unobtrusive measures. Nor do we intend to reflect poorly on studies investigating CEO narcissism. We acknowledge that Chatterjee and Hambrick (2007) who were very open about the limitations of the NI provide a solid theoretical framework for how CEO narcissism may affect organizational outcomes and a starting point to address the difficulty in gathering personality data from CEOs. However, we believe that their study should not encourage researchers to use the NI in its current version or with slight modifications. Rather, we derive important implications for future research. We call for more and proper validity tests that include convergent and discriminant validities before using unobtrusive measures that have not been thoroughly validated. Most studies only provide theoretical arguments for why their measures should relate to the construct. While they are mostly logical, they do not provide justification for the use of these measures. Only few studies contain convergent validity tests, for example, for indicators of power (Finkelstein, 1992) and political ideologies (Chin et al., 2013). Assessments should, in addition, comprise different constructs that are relevant in the specific context. Future studies can transfer our approach to other personality measures and include similar simulations.
When developing a new unobtrusive measure, researchers should make sure that all relevant aspects of the concept are reflected in the measure, and that the measure is not contaminated by components that are not reflected by the concept. Chatterjee and Hambrick (2007) make use of publicly available documents that could offer comprehensive data of exclusive individuals, if observed properly. Considering that the information sources used are usually produced for many different purposes, the NI or other unobtrusive measures should not only be the result of a simple categorical algorithm applied by sifting through these public documents (e.g., size of picture, or word count). They rather need to be thoroughly analyzed. If self-ratings are not available, including a huge variety of sources that also show how individuals interact with others and how they react to criticism (e.g., public speeches, TV shows, and radio interviews) would provide deeper insights as these are important aspects of personality and especially narcissism.
Other researchers on CEO narcissism have used approaches which seem to be more promising. While some authors were able to collect NPI data from CEOs (Peterson et al., 2012; Reina et al., 2014; Wales et al., 2013; Zhang et al., 2017), other authors asked current employees as internal informants to rate their CEOs narcissistic personality (O’Reilly et al., 2014; O’Reilly et al., 2018). Recent work also used video-metric approaches (Gupta & Misangyi, 2018; Gupta et al., 2018). For example, Petrenko et al. (2016) used the NPI, but instead of self-ratings, relied on expert ratings of video samples of CEOs. Resick et al. (2009) used a more complex approach where assessors evaluated and rated 75 CEOs of Major League Baseball organizations on narcissism using very comprehensive biographical information packets (including direct quotes from the CEOs). Thus, we are optimistic that there are opportunities to capture narcissism and other personality constructs of CEOs.
Limitations and Future Research
When interpreting our results, there are several restrictions that must be considered. We did not run the experiment with CEOs of large U.S. companies, who we doubt would participate in this kind of study. In Study 1, the platform MTurk is a source of reliable and high-quality data (Buhrmester et al., 2011; Sprouse, 2011) that allowed us to test our concerns in a large sample and to include several measures which would have reduced the likelihood of participation in the sample of CEOs. Previous research relied on similar samples to validate scales that were later successfully used for samples of CEOs (Carpenter & Golden, 1997; Peterson et al., 2012; Resick et al., 2009). In Study 2, we used a sample with managing directors and CEOs that is closer to the sample used by Chatterjee and Hambrick (2007). The results of both studies indicate that our main conclusions are robust across samples.
We collected the NI in a simulated setting rather than gathering participants’ real-life decisions. Therefore, we translated the unobtrusive measures into a controlled experimental setting following past research (e.g., Carey et al., 2015). In line with previous work (Fazio et al., 1995; Paulhus et al., 2003), the NI in our study serves as an “unobtrusive” measure only in the sense that it indicates an indirect measurement (i.e., the true purpose of the measure is covert), while interfering with the subjects under study. Our experimental design was essential to show the cause-and-effect relationship (financial performance influences the NI) within subjects in a controlled setting. In addition, our approach guaranteed participants to be treated anonymously. Since risks of dishonest responses and experimenter effects are very low in such kind of studies (Sprouse, 2011), we expect participants to provide their true NPI responses and that their decisions in our controlled setting does not differ substantially from real behavior. Nonetheless, we acknowledge that it would be desirable to conduct a study with CEOs in their actual settings.
Demand characteristics due to our repeated measures design could have created the effects of the financial performance on the NI. However, we yield qualitatively same results in both studies, when we neglect the repeated measures and take only the first year of each participant into account. This lowers concerns that demand characteristics influence our results.
In our studies, we focused on financial performance as a contextual variable. However, there are many other potentially confounding variables of the NI. For example, firm size has been shown to be significantly related to the NI (Cragun et al., 2020) and is also related to many of the outcomes under study. Additionally, CEOs might tend to choose larger pictures of themselves and stress their importance in press releases (i.e. the dimensions picture and press in the NI), the more they have been criticized in the media or when they need to cumulate power to enforce major change projects. In a similar vein, the postulated effects of the NI on innovation and growth might be confounded as innovations may increase the likelihood that CEOs are (by choice) more often or more prominent in the news (press dimension of the NI). Furthermore, CEOs might choose higher relative cash and noncash compensation (pay dimension in the NI) when their tenure ends in the foreseeable future or when they are opposed to greater risk, for instances. Our approach might be a fruitful avenue for future research to assess how these factors may affect the NI. For example, future studies may use our experimental approach and create different (e.g., high vs. low risk) scenarios. Looking at field data and investigating whether these variables are antecedents of the NI would also be an interesting possibility for future endeavors.
Conclusion
Overall, our results cast doubt on the use of unobtrusive measures, but we do not call for abandoning these measures from organizational research. Rather, we acknowledge that unobtrusive measures can be valuable in many settings. However, they offer a fruitful avenue for further studies only if they adequately gauge the proposed construct. We call for the inclusion of validity tests, make suggestions for the development of unobtrusive measures and for measuring CEO narcissism.
Footnotes
Acknowledgements
We thank the editor and anonymous reviewers for their helpful comments and suggestions. Feedback on an earlier version of this article is acknowledged from Frank Walter. We also thank Anna Diehl for recruiting managing directors and CEOs for our Study 2.
Declaration of Conflicting Interests
The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding
The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: The first author received financial support for attending the Academy of Management conference by the Office of the President of the University of Mannheim.
