Abstract
The abundance of information on social media, partly conflicting with government information, might negatively affect citizens’ compliance with policies. Based on Dutch representative survey data from the COVID-19 pandemic, we find that citizens who ranked social media as a more important information resource were generally less compliant with COVID-19 measures and less willing to get vaccinated. A higher ranking of social media is more strongly associated with non-compliance among citizens with lower levels of institutional trust. Based on these findings, we suggest that efforts to encourage compliance should focus not only on countering misinformation, but also on enhancing institutional trust.
Points for practitioners
Citizens who ranked social media as a more important information resource on COVID-19 were less compliant with government COVID-19 measures and less willing to get vaccinated. This relationship was strongest among citizens with low levels of trust in the institutions of government involved in managing the pandemic. To enhance compliance with policy measures, government efforts should focus not only on countering misinformation, but also on enhancing trust in government institutions.
Introduction
The effectiveness of many public policies relies on citizens’ voluntary compliance (Gofen, 2015; May, 2005; Tyler, 2006; Weaver, 2014; Winter and May, 2001). The recent COVID-19 pandemic made this clear once again. Compliance with public policies is commonly explained by rational factors including a calculated risk of sanctions, normative factors including belief in the effectiveness and legitimacy of the policy, and social factors including peer pressure to comply (Im et al., 2014; May, 2004; Tyler, 2006; Winter and May, 2001). During the recent COVID-19 pandemic, governments worldwide tried to appeal to all three types of factors with ‘sermon’ types of policy incentives (May, 2004; Porumbescu et al., 2017; Weaver, 2014). Governments used information and awareness campaigns to inform citizens about the risks of the virus and appealed to people’s sense of personal and social responsibility to comply with public health measures, including social distancing and hygiene measures, and vaccines. Yet compliance varied across political orientation, economic status, risk perception, prosocial attitudes and demographic characteristics (Martinescu et al., 2023; Pedersen and Favero, 2020; Snel et al., 2023).
In today's media landscape, governments are no longer the primary information source available to citizens. Whereas legacy media generally prioritize information from government authorities (Bennett, 1990; Entman, 2004), the decentralized platforms of social media allow for information from a large variety of sources to circulate, eroding state control over information (Im et al., 2014; Van Dijck and Alinejad, 2020). During the COVID-19 pandemic, the World Health Organization (WHO) voiced a concern about an ‘infodemic’ on social media and its effects on compliance (Zarocostas, 2020). This concept which gained prominence during the COVID-19 pandemic refers to an ‘
This article will first analyse how citizens’ compliance with COVID-19 measures and their willingness to get vaccinated is associated with their ranking of importance of social media as an information source on COVID-19. We hypothesize that a higher ranking of social media is negatively associated with compliance with COVID-19 measures and vaccination intent. Next, we analyse how differences in citizens’ levels of institutional trust impact this relationship. We hypothesize that the negative associations between social media ranking and policy compliance and vaccination intent are particularly strong among citizens with low levels of trust in the institutions of government that are involved in managing the crisis. The central question is:
This study is based on a representative survey conducted in March 2021 among the Dutch population (
The Netherlands is a relevant context to study social media and policy compliance for three reasons. First, the Netherlands has among the highest rates of internet access, smartphone ownership and social media use worldwide (Poushter et al., 2018), which makes this country a relevant context to study the effects of social media. The most-used platforms are Facebook, YouTube and Instagram. Second, the country was coping with decreasing levels of institutional trust during the pandemic. Trust in the Dutch national government dropped from 69% in April 2020 to 49% in March 2021 (Engbersen et al., 2021b). Third, instead of opting for strict and hierarchical rule enforcement, COVID-19 measures in the Netherlands were developed and enforced in cooperation with many stakeholders (Pattyn et al., 2021) – fitting with the Dutch model of consensus democracy. Consequently, voluntary compliance was crucial for COVID-19 measures in the Netherlands to be effective.
In the remainder of this article, we first discuss current theory on the relations between social media, policy compliance and institutional trust based on public policy literature in general and literature focused on the COVID-19 pandemic specifically. We develop a conceptual model to be tested. Then, we present our data and method. The results section first presents how the use of social media to find information on COVID-19 differs among the Dutch population. Next, we test our hypotheses based on correlations and regression analyses. We conclude with a discussion of the theoretical implications and policy implications of our findings.
Theory and hypotheses
Social media use and compliance with policy measures
Social media have changed the ways in which information on public problems and public policy disseminates. Next to information which ‘cascades down’ from authoritative actors from government and politics (Entman, 2004; Im et al., 2014), information from non-state actors can also enter the stream of information, with the algorithms of social media providing a ‘pumping mechanism’ (Entman, 2003: 420) for some of this information to cascade upwards in the information stream. Information which is highly contentious, emotional and moralized in nature is prioritized by the algorithms of social media platforms as it will keep the attention of users and enables the platforms to collect and capitalize on user data (Van Dijck and Poell, 2013; Zuboff, 2019). As a result, misinformation tends to spread quicker and further than information based on expert consensus (Vosoughi et al., 2018).
Studies indeed found that during the COVID-19 pandemic, social media enabled the spread of information from different sources and of different quality, functioning as double-edged swords of public health information (Pavelea et al., 2022; Van Dijck and Alinejad, 2020). On the one hand, social media were used by government organizations and public health authorities to inform citizens about the pandemic and to promote policy compliance. Several governments, including the Dutch government, used social media campaigns and paid influencers to enhance compliance with COVID-19 measures (Han and Baird, 2024; Mansoor, 2021; Van Dijck and Alinejad, 2020). In addition, social media were used by medical staff to share experience-based information first-hand. This included dramatic images of overworked hospital workers and emotional calls to take the virus seriously and comply with measures.
On the other hand, similar to other crises characterized by uncertainty and developing expert consensus, a large diversity of information circulated on the decentralized platforms of social media. This included information which partly or fully conflicted with information from government and public health authorities (Van Dijck and Alinejad, 2020). The literature describes many examples of COVID-19 misinformation which conflicted with the best expert evidence available at the time (Hameleers et al., 2023; Pulido et al., 2020; Vraga and Bode, 2020), and of conspiracy theories which spread incorrect information about the origins of the virus and the safety of vaccines (Mari et al., 2022).
The extent of the diffusion of government information, as opposed to information (including misinformation) from other sources on social media, is the subject of scholarly debate. Evidence from a study on five social media platforms suggests that information from reliable and questionable sources did not present different dissemination patterns (Cinelli et al., 2020). A study on Twitter demonstrates that false information was more likely to be tweeted, but less likely to be retweeted than science-based evidence or fact-checking tweets (Pulido et al., 2020).
Looking into how this information affects citizens, research indicates that social media use (Bridgman et al., 2021) and trust in social media (Fridman et al., 2020) are negatively associated with accurate knowledge about COVID-19. Melki et al. (2021) found that those who trust COVID-19 information from social media are more likely to believe in COVID-19 myths and false information. Furthermore, Islam et al. (2023) found that exposure to misinformation on social media is negatively associated with knowledge about COVID-19 measures.
There is also evidence that social media affect people's compliance with COVID-19 measures. Studies have found that social media use is negatively associated with compliance with social distancing and hygiene measures (Caplanova et al., 2021; Pavelea et al., 2022; Pedersen and Favero, 2020). Other studies have found similar effects on vaccination intent, when comparing different sources of information on COVID-19 (Piltch-Loeb et al., 2021). Nicholls and Yitbarek (2022) add that although engaging with social media might not in itself predict less adoption of preventive measures, placing higher trust in information from social media than in other, more reputable information sources is associated with less compliance with lockdowns and preventive measures, and lower vaccine adoption.
Although the behavioural effects of social media as an information source on policy compliance have scarcely been studied in relation to other public issues and policies, a study by Im et al. (2014) found that in general, the more time people spend on the internet, the lower their levels of compliance with government policies. This finding from public administration literature resonates with more recent studies on compliance with COVID-19 measures. The authors suggest that whereas information from government is likely to portray a relatively unified and consistent message, the diversity of online information fosters increasingly different public opinions and citizen expectations, triggering a reduction in compliance instead of a shared sense of direction.
Based on this literature review, we hypothesize that attributing a higher ranking to social media for information on COVID-19 is associated with lower compliance with the government's public health measures. We will test this for two dependent variables: compliance with social distancing and hygiene measures, and vaccination intent.
Institutional trust and compliance with policy measures
Citizens’ trust in the institutions of government is based on their general inclination to trust as well as their short-and long-term evaluation of government performance which comprises its capacity, integrity and benevolence (Christensen and Lægreid, 2005; Zhai and Han, 2024). Institutional trust is generally considered as an important condition for compliance with government policies (Kim, 2005; Levi, 1998; Tyler, 2006). This was found in recent studies on the COVID-19 pandemic as well, which found that trust in government is a strong predictor of compliance with protective measures (Bargain and Aminjonov, 2020; Caplanova et al., 2021; Robinson et al., 2021) and vaccination intent (Engbersen et al., 2021b; Wynen et al., 2022).
Studies on the effects of social media use and institutional trust as predictors of compliance generally find that social media use is negatively associated with compliance and institutional trust is positively associated with compliance (Caplanova et al., 2021; Im et al., 2014). Islam et al. (2023) found that trust in government moderates the relationship between perceived exposure to misinformation related to the pandemic and knowledge about government measures. They explain this by the mechanism that citizens who possess higher levels of trust in government will more quickly perceive information from other sources to be misinformation (Islam et al., 2023: 581). We hypothesize a similar moderating effect of institutional trust on the relationship between social media ranking and policy compliance as well as vaccination intent. Building upon political communication literature, the underlying mechanism might be that citizens with high levels of trust in government may ignore information conflicting with government recommendations when they encounter it, or they might only be searching for information from government sources which is present on social media as well. In addition, because of social media algorithms which prioritize content that is likely to hold people's attention based on their past engagement (Zuboff, 2019), it is plausible that citizens with high levels of institutional trust are presented more often with information coming from government institutions, whereas citizens with lower levels of institutional trust might be more exposed to information from other sources. We expect that a higher ranking of social media is more strongly associated with non-compliance among citizens with lower levels of trust in the institutions of government. We will again test this for our two dependent variables:
Figure 1 (available online) summarizes our hypotheses in a conceptual model.
Data and methds
Data, sample and weighting
The data used in this study are derived from a large-scale online survey on societal impact of the COVID-19 pandemic in the Netherlands conducted in March 2021 by election research institute Kieskompas. The questionnaire was distributed among their national panel, which is a representative stratified sample of the Dutch voting population (18 + years). Additionally, the three largest Dutch cities (Amsterdam, Rotterdam and The Hague) undertook extra activities to recruit respondents from unerrepresented groups. The data was weighted to make the survey results representative for education, age, gender, region, migration background and voting behavior. Questionnaires with insufficient information about these characteristics were excluded from the sample. This resulted in a sample of 24,227 respondents which is representative of the Dutch adult population. More information on sampling and weighting can be found in Engbersen et al. (2021a).
Measurements
Our study uses two dependent variables measuring compliance with COVID-19 policy measures: At this point during the COVID-19 outbreak in The Netherlands … I stay at home as much as possible; I avoid crowded places; I avoid public transport; I avoid parks and playgrounds; I avoid face-to-face contact with friends and family; I wash my hands more often; I always sneeze into my elbow; I don’t shake people's hands; I keep one and a half meters distance [sic] to others.
These items are measured on a scale of 1–5 with 5 indicating the highest level of compliance with COVID-measures.
Our independent variable,
To measure
We control for age, gender, level of education, migration background, personal health, political orientation and socio-economic status. These
Analysis
We test our hypotheses using linear regression for our dependent variable ‘Compliance with COVID-measures’ and logistic regression for our dependent variable ‘Vaccination intent’. We ensured that our models adhere to the assumptions underlying regression analysis (independent errors, homoscedasticity, normally distributed errors). Low to moderate correlations were found between social media ranking and several other variables (Table 2, available online), but these correlations were not substantial enough to create multicollinearity issues.
Self-reported data on compliance with COVID-measures might be influenced by social desirability bias (Daoust et al., 2021). Although this risk is inherent to our research method, earlier research into COVID-19 survey estimates found no evidence that citizens under-report non-compliant behaviour (Larsen et al., 2020). To measure compliance with COVID-measures, we use a set of key responses similar to items used in other COVID-19-related research (Pedersen and Favero, 2020) and we assess non-response on these items.
Results
Which citizens attribute a higher ranking to social media for information on COVID-19?
First, we analysed how Dutch citizens rank social media as a resource of information on COVID-19. As Table 1 (available online) shows, 41.6% of all respondents rank social media as their least important source of information on COVID-19. However, a substantial subgroup of 19.6% rank social media in their top three information sources and for 5.8% of the respondents, social media are the most important source of information on COVID-19.
Next, Table 3 (available online) shows how people's ranking of social media differs along socio-demographic characteristics including gender, age, migration background, level of education, income, loss of income due to the pandemic, political orientation and self-reported health. Chi-square tests indicate significant differences in the use of social media as a source of information on COVID-19 on all variables. Men, younger respondents, those with a non-western migration background, lower-educated and lower-income groups, those who fear income loss or have actually lost income due to COVID-19, people with a right-wing political orientation and those reporting poor health tend to rank social media higher for their information on COVID-19 (Table 3, available online).
Social media use, COVID-19 policy compliance and institutional trust
Exploring Spearman's rho correlations between the key variables in our model (Table 2, available online) indicates that those who assign a higher ranking to social media for their information on COVID-19 are less compliant with COVID-19 policy measures and less willing to get vaccinated. Furthermore, it shows that policy compliance correlates positively with vaccination intent. A high ranking of social media as an information source on COVID-19 is associated with lower levels of institutional trust.
Next, we present multivariate regression analyses to estimate the relationships between social media ranking for information on COVID-19 and policy compliance and vaccination intent (H1a–b) (Tables 4 and 5, available online). All models include our set of socio-demographic control variables. In both tables (available online), model 1 shows negative associations between social media ranking and the outcome variable. Those who rank social media higher than other sources of information on COVID-19 are less likely to comply with COVID-19 measures and they are less willing to get vaccinated. This supports hypotheses H1a and H1b. Although the direction of this relationship and causality cannot be established with this type of analysis, it is plausible for information on COVID-19 to influence policy compliance rather than vice versa, based on the premise that information is a determinant of citizen behaviour (Im et al., 2014).
In model 2 we add institutional trust which associates positively with both policy compliance and vaccination intent. The negative effects of social media ranking slightly decrease, but remain significant for those who rank social media in their top three information sources. In model 3 we add the interaction variable of social media ranking and institutional trust in order to test whether the negative associations between social media ranking and policy compliance and vaccination intent are stronger among citizens with lower levels of institutional trust (H2a–b). We find significant interaction effects with both outcome variables, confirming hypotheses H2a and H2b (Tables 4 and 5, available online).
Figures 2 and 3 (available online) visualize the interaction effects. These graphs show that a negative correlation between social media ranking and policy compliance and vaccination intent remains for citizens with different levels of institutional trust. However, the effects differ between groups: particularly among those with the lowest levels of institutional trust (the dotted lines in Figures 2 and 3, available online), assigning a higher ranking to social media for information on COVID-19 is associated with a much stronger decrease in policy compliance and vaccination intent. This aligns with the reported effect sizes in Tables 4 and 5 (available online). The negative relation is much stronger among citizens with low trust than among citizens with moderate or high levels of trust (the striped and solid lines in the graphs).
Discussion
Our findings demonstrate that social media have gained an information function during the pandemic for a substantial subgroup of Dutch citizens. One in five (19.6%) Dutch citizens rank social media in their top three information sources on COVID-19. For 5.8%, social media are the most important source of information. The demographic characteristics of those who assign a high ranking to social media for information on COVID-19 correspond to some extent with known characteristics of active social media users such as a younger age and a higher level of education (Boukes, 2019). However, for information on COVID-19, it is not only younger people, but also the lower-educated, right-wing voters and those in more vulnerable labour market positions who are drawn to social media.
Both hypotheses on the relationships between social media ranking and COVID-19 policy compliance are confirmed: those who assign a higher ranking to social media for their information on COVID-19 are less compliant with COVID-19 measures and less willing to get vaccinated. These empirical outcomes provide provisional support for the existence of an ‘infodemic’ which undermines government efforts to contain the pandemic. Citizens who assign a relatively high ranking to social media for information on COVID-19 are likely exposed to a large diversity of information, including misinformation, which may lead them to ignore government policy and advice.
We found support for a moderating effect of institutional trust as well. The association between a lower ranking of social media with policy compliance (H2a) and vaccination intent (H2b) is stronger among citizens with lower levels of trust in the institutions of government. Interestingly, those with high levels of trust in government who rank social media as their first source of information are even slightly
The moderating effect of institutional trust could be explained in two ways. First, citizens with higher levels of institutional trust might be using social media mainly to access government information and other trusted sources on social media, or the algorithms of social media may expose them more frequently to such information. Second, as the study by Islam et al. (2023) suggests, they might be less susceptible to information that conflicts with government advice as it is not consistent with their pre-existing views. Qualitative studies are needed to shed more light on the mechanisms behind the interaction effect.
Conclusions
The effectiveness of many policies relies on citizens’ voluntary compliance which in turn is dependent on the information citizens receive on the urgency of the policy problem and being convinced of the need for them to act (May, 2004; Porumbescu et al., 2017; Weaver, 2014). Social media have democratized the dissemination of policy-relevant information, making governments no longer the only information source, while information from other actors can ‘cascade up’ the information stream (Entman, 2003). The COVID-19 pandemic provides a revelatory case in which concerns about an ‘infodemic’ developing on social media in parallel to the pandemic were widespread. This article studied the effects of people's ranking of social media as an important information source on COVID-19, as opposed to other information resources where information from governments is likely to dominate (Bennett, 1990; Entman, 2004), on citizens’ compliance with government policy measures to fight the pandemic and their willingness to get vaccinated.
People who ranked social media in their top three information sources on COVID-19 represent a relatively small segment of the population. We found that these citizens who assign a higher ranking to social media report lower compliance with social distancing and hygiene measures and lower vaccination intent. Institutional trust moderates these relationships: we find smaller negative effects among citizens with moderate and high levels of trust in government institutions involved in managing the pandemic. These findings contribute to the literature on COVID-19 and public health communication, as well as broader discussion on social media, institutional trust and policy compliance.
In addition to studies which demonstrated the effects of specific examples of misinformation (Hameleers et al., 2023), this study found an effect of social media as an information source, encompassing the full variety of information present there, on compliance with public health measures, including vaccination. Even though studies indicate that posts referring to reliable sources prevail on social media, and that users engage more with reliable posts rather than with posts referring to questionable sources (Pulido et al., 2020), we found an overall negative association between social media use and compliance. This suggests that the overabundance of information on social media, including misinformation (even if a minority of posts), can undermine government information campaigns.
Furthermore, this research adds to current studies by demonstrating a moderating effect of institutional trust in the relationship between social media prioritization and compliance with public health measures, including vaccination. Although earlier studies have shown independent effects of information sources and institutional trust on compliance, our study found that there is an interaction effect: citizens with higher levels of institutional trust might be less likely to encounter alternative information on social media, or they might be less susceptible to this.
COVID-19 provided a revelatory case to study the relationship between social media as an information resource, policy compliance and institutional trust. We believe that our findings are relevant to other policy issues where an overabundance of information, including misinformation, circulates on social media – such as policies to mitigate climate change (Winter and May, 2001). In addition, our findings are generalizable to other consensus democracies, such as Sweden, which tend to rely on voluntary compliance rather than strict enforcement of policy measures.
This study comes with several methodological limitations. First, the cross-sectional survey design does not allow us to assess the directionality of the relationships between social media as an information source and compliance with COVID-19 measures, nor to establish causality. However, it is more plausible that information on social media influences policy compliance than the other way around (Im et al., 2014), or misinformation on social media might not be an exogenous cause of non-compliance, but rather a manifestation of the same social, political or psychological factors that lead to non-compliance (Enders et al., 2022). A longitudinal or experimental study design would be required to establish causality.
A second limitation of our study is that it is based on self-reported measures of social media ranking, policy compliance and vaccination intent. Reported answers may be subject to memory biases and social desirability. We did not directly measure citizens’ information diets during the pandemic and our independent variable, ranking of the importance of social media for one's information on COVID-19, could be underreported. On social media, information about COVID-19 is encountered not only in targeted searches, but also during day-to-day use. As a result, respondents may underestimate the importance of social media for their information on COVID-19. Non-compliance and vaccine hesitancy on our dependent variables might also be underreported because these are socially undesirable answers (Daoust et al., 2021). However, self-reported, anonymous online surveys such as ours are generally less prone to social desirability bias and we found no problematic item non-response. Non-response on these items ranged between 0.14% and 0.36%. Also, earlier research into COVID-19 survey estimates found no evidence that citizens underreport non-compliant behaviour (Larsen et al., 2020).
How can governments encourage compliance with public policies in the face of the overabundance of information, including misinformation on social media? Several government organizations attempt to counter online misinformation through fact checking and misinformation awareness campaigns (European External Action Service's East StratCom Task Force, 2022; Ministry of Health, Welfare and Sport, 2021; WHO, 2021). Although experimental research demonstrates that discrediting misinformation – particularly by government authorities – can correct misperceptions, these efforts face significant challenges. Studies indicate that completely false information can be more easily discredited than partially incorrect information – which is in fact more persuasive (Hameleers et al., 2023). Furthermore, correcting misinformation increases the likelihood that people misremember information as true, which is known as a backfire effect (Nyhan and Reifler, 2010; Vitriol and Marsh, 2021). Misinformation warnings and redirecting social media users towards correct information can be effective in reducing the effects of misinformation (Lewandowsky et al., 2012). However, as the amount of misinformation increases, which happened in the case of COVID-19, these effects are likely to wear off (Kreps and Kriner, 2022). When online misinformation includes conspiracies discrediting government institutions, removal or correction of information by government actors might even reinforce these beliefs (Enders et al., 2022; Thorson, 2016).
This study suggests that efforts to encourage compliance in the face of social media infodemics should also be focused on enhancing institutional trust. Building institutional trust is not only important in itself, but it can also be a means to enhance compliance by influencing which information people receive and trust (Islam et al., 2023; Robinson et al., 2021). Studies have shown that trust in government services from which citizens receive personalized advice is generally higher (Robinson et al., 2021). This suggests that trust can best be built in personal, day-to-day contact with citizens, where the relevance of policies to people's individual circumstances, as well as changing expert consensus and proposed measures over the course of volatile policy issues, can be explained.
Supplemental Material
sj-docx-1-ras-10.1177_00208523241306410 - Supplemental material for The effect of institutional trust on the relationship between social media as an information resource and policy non-compliance: Dutch survey evidence from the COVID-19 pandemic
Supplemental material, sj-docx-1-ras-10.1177_00208523241306410 for The effect of institutional trust on the relationship between social media as an information resource and policy non-compliance: Dutch survey evidence from the COVID-19 pandemic by Rianne Dekker, Godfried Engbersen, Erik Snel and Jan de Boom in International Review of Administrative Sciences
Footnotes
Declaration of conflicting interests
The authors declared no potential conflicts of interest with respect to the research, authorship and/or publication of this article.
Funding
The authors disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This work was supported by ZonMw, ‘De maatschappelijke impact van COVID-19’ (The social impact of COVID-19) (grant number 10430032010034).
Supplemental material
Supplemental material for this article is available online.
References
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
