Abstract
Leader evaluations are a crucial aspect in representative democracy. We analyse the patterns, antecedents and consequences of European Union leader evaluations against the backdrop of the 2019 European Parliament elections in ten countries. The article shows, firstly, that leader evaluations are unidimensional, both among voters with low and high knowledge as well as partisans and non-partisans. Secondly, among the antecedents of leader evaluations, European Union trust and performance evaluations are positively associated with leader evaluations, while European identity hardly plays a role compared to other factors. Lastly, the positive effect of leader evaluations on vote choice is conditional upon the individual leader and their party affiliation. Our results have important implications for expectations towards and evaluations of European Union leadership in the long term.
Introduction
The European Union (EU) has undergone a number of pivotal moments in recent history. These comprise both changes to the polity, such as new treaties, enlargement and Brexit and external shocks, including the financial crisis, the so-called refugee crisis and most recently the Covid-19 pandemic. They have thereby contributed to the increased contestation within and of the EU (see Van der Brug et al., 2022). Political observers and scholars perpetually emphasize the (limited) role of EU leadership in times of crisis (e.g. Tömmel, 2020; Van Esch, 2017). However, most studies have approached EU political leadership from the perspective of inter- or intra-institutional relations at the EU level (e.g. Cini, 2008; Kassim and Laffan, 2019; Tömmel and Verdun, 2017). We know little about citizens’ perceptions of EU leadership, although the question of EU leadership contests that are decided by European voters is increasingly being considered important for the EU's legitimacy (e.g. Føllesdal and Hix, 2006; Hobolt and Tilley, 2014).
In response to rising legitimacy concerns, the European Parliament (EP) designed the so-called
Against this backdrop, the aim of this article is three-fold. Firstly, we seek to understand the
The article proceeds by underlining the relevance of understanding patterns and antecedents of EU leader evaluations in the first place and discusses possible scenarios. After that, we explore leader evaluations provided by panel survey data from the 2019 EP elections from ten EU member states (Goldberg et al., 2019), which include questions about how respondents evaluate five attributes – leadership skills, empathy, reliability, competence and charisma – for outgoing Commission President Juncker and the
The particularity of leader evaluations in the EU
Before the introduction of the
Up until now, these studies have pointed to the limited personalization of political communication during EP election campaigns (e.g. Braun and Schwarzbözl, 2019; Schulze, 2016), which may also explain why personalized voting behaviour has thus far played a subordinate role in EP elections (Gattermann and de Vreese, 2017; Gattermann and Marquart, 2020; Schmitt et al., 2015). After all, only few voters recognise candidates standing in EP elections and the extent to which they do so depends on the information provided by political parties (Popa et al., 2020), campaign-specific information (Gattermann et al., 2016; Schmitt et al., 2015) and news exposure (Gattermann and de Vreese, 2017). As the available information provided through campaigns or media coverage to voters tends to focus on political parties and institutions, individual politicians are not yet considered effective cue-providers that help voters form their opinion in European elections (Gattermann, 2020). 2
In light of previous findings, we might expect that only the most sophisticated voters are likely to align evaluations of EU leaders with their vote choice, thus underlining the potentially limited consequences of personalization in EP elections. This article thus pursues a different approach to shed further light on the phenomenon: we are first and foremost interested in the
With few exceptions (e.g. Bartels, 2002; Brettschneider and Gabriel, 2002; Dumitrescu et al., 2015; Huber, 2014), the literature on comparative political behaviour has largely dealt with leader evaluations as an explanatory factor for vote choice (e.g. Bittner, 2011; Garzia, 2014; Karvonen, 2010); also in the context of EU politics (Gattermann and de Vreese, 2017; Gattermann and Marquart, 2020). In doing so, research has either treated leader evaluations as unidimensional by measuring them on single scales (e.g. Gattermann and de Vreese, 2017; Holmberg and Oscarsson, 2011; Michel et al., 2020) or distinguished several leader characteristics or personality traits (e.g. Bittner, 2011; Gattermann and Marquart, 2020; Ohr and Oscarsson, 2011). These either concern a candidate's
In this article, we are, for one part, interested in the extent to which evaluations of EU leaders are multidimensional. This has two reasons. First, personalization has the potential to bring EU politics closer to European citizens (see Gattermann and Marquart, 2020). If that were the case, it would also enable the latter to assess different strengths and weaknesses of EU leaders and ultimately hold them accountable for their political behaviour and integrity. Second, with the rising politicisation of European integration, public opinion towards the EU and its representatives has also become increasingly multidimensional over time (Boomgaarden et al., 2011; de Vreese et al., 2019). In other words, European citizens distinguish between different aspects of European integration and evaluate these aspects to a differentiated degree, although attitudes on various dimensions are still correlated. Would this also be the case for individual EU leaders?
We consider five different attributes, namely
Our second research question asks whether attitude formation towards EU leaders is contingent on certain voter characteristics, including the level of specific information, party preferences and EU attitudes. As the most sophisticated voters are more likely to recognise EU leaders in the first place (Gattermann and de Vreese, 2020; Popa et al., 2020), there may be less variation among them when it comes to images of EU leaders. Nonetheless, one could expect that multidimensional evaluations are more likely to apply to those voters who have acquired additional, specific information than those who do not. This is related to information processing, which is the way by which voters rely either on memory-based or online processing to formulate their opinions (e.g. Hastie and Park, 1986; Lodge et al., 1989). If voters have little knowledge about individual leaders, they likely base their evaluations on memory, that is not up-to-date while those who have acquired more specific information are able to rely on a summary of the information that they have encountered thus far. A similar empirical argument was put forward by Huber (2014): respondents in a three-country experiment more often evaluated a candidate's character when they received
Lastly, it is important to investigate the extent to which leader evaluations in the EU are distinct from EU attitudes. Since EU attitudes are multidimensional (e.g. Boomgaarden et al., 2011; de Vreese et al., 2019), they are also likely to be associated to a differing degree with leader evaluations. If not, we would conclude that voters hardly distinguish between the polity and its key representatives. Put differently, individual leaders, including their leadership skills, competence and reliability, would not make a difference for EU politics in the eyes of European voters. This would be a likely finding if voters rely on their evaluations of the EU as a heuristic to assess EU leaders about whom they likely have less information compared to the EU more generally (see Gattermann, 2020). Bartels’ (2002: 55) findings, for example, suggest that the political context ‘rather than differences in the various candidates’ intrinsic personal qualities’ plays an important role for voters’ assessment of US Presidential candidates over time. This in turn means that if there were differentiated relationships between EU attitudes and leader evaluations, we would derive that voters distinguish between EU integration and the political system, on the one hand, and the quality of EU leadership, on the other, which would be a positive development for the democratic functioning of and representation in the EU. The following analyses will therefore shed light onto these relationships.
Data and measures of EU leader evaluations
We rely on original panel survey data (Goldberg et al., 2019; data version 2) to explore the core research questions. The survey was administered by
Evaluations of outgoing Commission President Juncker were surveyed in December 2018 in five countries (Netherlands, Denmark, Germany, Hungary and Spain;
If respondents indicated that they had heard about a certain lead candidate, they were then asked to evaluate him or her. For survey efficiency reasons, we asked for evaluations of a maximum of three
Specifically, we asked for both Juncker and the
Examining EU leader evaluations
The unidimensionality of EU leader evaluations
We conducted exploratory rotated principal components factor analysis with oblique rotation (direct oblimin) for Juncker and each
Next, we split each country sample into: (a) voters who have acquired specific information about EU politics and those who have not
5
; and (b) those who have a high and low propensity to vote (PTV) for the domestic party that is affiliated with either the EPP in case of Juncker and Weber or the PES, of which Timmermans was the
Antecedents of EU leader evaluations
Before providing the remaining answer to
Comparing evaluations within each leader.
SD: standard deviation.
Taking a closer look at Weber and Timmermans, i.e. the lead candidates of the EPP and PES, respectively, Table 2 shows that Timmermans scores better than Weber on all items bar competence. Dutch respondents evaluated Timmermans more positively than Weber on all traits. Surprisingly, Weber did not score better than Timmermans among German respondents suggesting that in this case a nationality effect is absent, i.e. German respondents did not appear to favour Weber just because he is German. German respondents rated Timmermans as being more charismatic than Weber.
Comparing evaluations between Timmermans (T) and Weber (W).
***
To shed more light onto the antecedents of the EU leader evaluations, the following figures report the average marginal effects of ordinary least square regressions with individual evaluation items as dependent variables. The main independent variables are PTVs, EU attitudes and specific knowledge. EU attitudes consist of five distinct dimensions. They each comprise three items and have been applied by the survey designers (Goldberg et al., 2019) following Boomgaarden et al. (2011). The dimensions are
Figures 1–3 report the results for the individual evaluations of Juncker, Weber and Timmermans, respectively. Generally, the cross-country variation in leader evaluations is larger for Juncker compared to Weber (and Timmermans). Dutch voters appear more positive towards Timmermans compared to voters from other countries. Regarding individual voter characteristics, PTVs are positively associated with all leader items, except for the assessment of Juncker's empathy and competence (Figure 1). Specific knowledge does not matter in the case of Juncker and Weber, but it has a negative association with all of Timmermans’ attributes, bar competence (Figure 3). It thus appears that more sophisticated voters tend to be more critical towards Timmermans. Likewise, political interest in EU affairs is negatively associated with voters’ evaluations of Juncker regarding his leadership, reliability and charisma. Contrariwise, those with higher levels of stable knowledge evaluate EU leaders more positively, particularly Timmermans on all items, Weber on leadership and competence (Figure 2) and Juncker on competence.

Average marginal effects of PTVs, knowledge and EU attitudes on Juncker's evaluation.

Average marginal effects of PTVs, knowledge and EU attitudes on Weber's evaluation.

Average marginal effects of PTVs, knowledge and EU attitudes on Timmermans’ evaluation.
Turning to EU attitudes, identity hardly matters for leader evaluations relative to the other items, although there are weak (Timmermans) to moderate correlations (Juncker, Weber) between identity and leader evaluations (see the Online appendix). The positive associations of trust and EU performance evaluations with individual leader evaluations hold in all models. These effects are rather sizeable compared to those of other voter characteristics across the board. Attitudes towards strengthening EU integration are positively associated to the evaluations of Juncker on all items, while they do not play a role for the assessments of Weber when considered together with other EU attitudes. In case of Timmermans, the positive relationship is only significant (
The consequences of EU leader evaluations for vote choice
Having explored the dimensionality and antecedents of EU leader evaluations, our final objective is to examine the consequences for voting behaviour. A popular hypothesis in the personalization literature is that leader or candidate evaluations have a causal effect on the party vote, although there has thus far been mixed evidence in support for this hypothesis (e.g. Bartels, 2002; Brettschneider and Gabriel, 2002; Garzia, 2014; Holmberg and Oscarsson, 2011; Karvonen, 2010). We, therefore, ask whether EU leader evaluations matter for vote choice (
The particularity of the
To investigate this relationship, we estimated mixed effects logistic regression models with random effects at the individual level and country fixed-effects. Our dependent variable is vote choice in all models. The respective question was asked in the April 2019 wave, i.e. in the same wave as our main independent variables and read ‘Which party would you vote for if the EP elections were held tomorrow?’. Respondents were provided with a list of domestic parties. We recoded
The results show that there is a positive association between leader evaluations and vote choice in the case of Timmermans and the PES (
Discussion and conclusion
In a time when ‘(c)risis appears to be the new normal for the EU’ (Haugthon, 2016: 5), calls for leadership of and within the EU have become ever more important (e.g. Tömmel, 2020; Van Esch, 2017). Given the EU institutional set up, executive leadership can be found in several institutions and personalities, ranging from the European Council over the European Commission to the Eurogroup and their respective members and leaders. In this article, our focus lay on the President of the European Commission and the two main contestants for that office in the 2019 EP elections. Outgoing President Juncker was elected by the EP in 2014 following the newly established
In a first empirical step, we provided an overview of our measures of leader evaluations, which consisted of five items measuring leadership skills, empathy, reliability, competence and charisma. We explored the degree to which leader evaluations – like EU attitudes (Boomgaarden et al., 2011; de Vreese et al., 2019) – are multidimensional. Our analysis showed that all items load into one single factor for each leader in each country sample. This is remarkable because research on national leaders often identified several different dimensions that distinguish between politically relevant and non-political attributes (e.g. Brettschneider and Gabriel, 2002; Meeks, 2017; Ohr and Oscarsson, 2011), or that tap affection, qualification and electability (Dumitrescu et al., 2015: 48). Yet, not even leadership skills stand out, even though it has been a distinct scholarly assessment in the literature of the European Commission and its President (e.g. Kassim et al., 2013; Tömmel, 2013). One potential explanation for this unidimensionality is that voters have only a vague image of European leaders and hardly distinguish between their political and personal qualities. The findings of Gattermann and Marquart (2020) support these assumptions as they also identified one single scale for similar items with respect to Green Party candidates in the 2019 EP elections. Moreover, our findings show that leader images are not conditional on specific knowledge or partisanship. Advocates of the
While our descriptive analysis showed that Timmermans was evaluated more positively than Weber, the antecedents of leader evaluations are largely similar across EU leaders, including Juncker. We find that PTVs are mostly positively associated with all leader attributes as is stable political knowledge. Furthermore, if specific knowledge and interest in EU politics play a role, they tend to have negative effects on leader evaluations. Particularly, the results suggest that more sophisticated voters tend to be more critical towards Timmermans. Finally, EU attitudes matter to a differentiated degree for leader evaluations: trust and EU performance assessments tend to have the largest positive associations with the evaluations of all leader attributes which suggests that voters align their assessment of EU politics with that of their leaders. Comparatively speaking, feelings of European identity, on the contrary, hardly play a role for EU leader evaluations, while attitudes towards EU integration and utilitarian considerations have weaker and different ties to EU leader evaluations. This implies that voters distinguish between the polity and its idea, on the one hand, and their leaders, on the other. Attitudes towards strengthening EU integration are positively associated to the evaluations of Juncker on all items, while they either play no (Weber) or a limited role (Timmermans) for the evaluations of the
Lastly, we asked whether leader evaluations have consequences for vote choice. Our analysis considered only the aggregate measure of leader evaluations with an additional focus on Weber and Timmermans who headed the two main European party families, the EPP and PES. Our analysis showed that positive leader evaluations are associated with a higher likelihood to vote for a domestic party that is affiliated with Timmermans’ PES; but we find no such relationship with respect to Weber and the EPP. However, we have to bear in mind that controlling for PTVs increases the thresholds for leader evaluations to have any effect as they are strong predictors of vote choice in European elections (e.g. Gattermann and de Vreese, 2017). Future research needs to address the extent to which leaders can indeed draw voters away from other parties. Such closer examination is relevant against the backdrop of political observers claiming that there had been a so-called ‘Timmermans effect’ in the Netherlands following the substantial increase in the Dutch social democrats’ vote share compared to previous national and European elections. Moreover, Weber's Bavarian Christian Social Union has also received slightly more votes in 2019 compared to 2014 (and an increase from 5 to 6 seats in the EP), but we do not yet know whether this is due to the
Our study is not without limitations. With respect to the antecedents of leader evaluations, previous research has shown that mediated leader images can shape perceptions of politicians (Aaldering et al., 2018; Bos et al., 2011). We did not pursue this question here since we do not have media exposure and leader evaluations for all combinations. Generally, while traditional media can bring news from Brussels closer to EU citizens, in the digital age we must ask not only how prominent EU leaders are on social media (e.g. Daniel and Obholzer, 2020) but also whether online and social media influence attitude formation towards them (see Meeks, 2017). However, attention paid to European lead candidates in both media coverage and party campaigns has been rather limited so far (Braun and Schwarzbözl, 2019; Schulze, 2016). Regarding the electoral consequences, future research should also enquire the extent to which media exposure moderates leader effects, although news about national lead candidates has not been found to moderate the effect of evaluations on vote choice in EP elections (Gattermann and de Vreese, 2017).
Furthermore, we acknowledge that a conditional logit model would allow us to compare the relationships between leader evaluations and party choice across European party families. However, we are unable to test the effects of lead candidates Tomić and Cué of the European Left Party on vote choice for radical left domestic parties. Likewise, no
Future research needs to unpack to what extent our findings correspond to leader evaluation dynamics as such (e.g. Bittner, 2011; Brettschneider and Gabriel, 2002; Ohr and Oscarsson, 2011) and the degree to which they are contingent upon EU-specific dynamics of public opinion formation (e.g. de Vreese et al., 2019). The constraints in our data with respect to the sample – which is conditional on
Supplemental Material
sj-pdf-1-eup-10.1177_14651165211046108 - Supplemental material for Understanding leader evaluations in European Parliament elections
Supplemental material, sj-pdf-1-eup-10.1177_14651165211046108 for Understanding leader evaluations in European Parliament elections by Katjana Gattermann and Claes H. de Vreese in European Union Politics
Footnotes
Acknowledgements
We would like to thank the participants of the ‘The European Elections 2019’ Workshop at the Amsterdam Centre for European Studies in January 2020, particularly Erika van Elsas, Miriam Sorace and James Wilhelm, as well as the two anonymous reviewers at EUP for their excellent comments.
Declaration of conflicting interests
The authors declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding
The authors disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: The study was funded by the European Research Council (ERC), grant number 647316 (Principal investigator: Claes H. de Vreese). Part of the time invested in this research was additionally funded by Katjana Gattermann's personal grant from the
Supplemental material
Supplemental material for this article is available online.
Notes
References
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
