Sage Journals: Discover world-class research

Abstract

Introduction/Objectives:

Despite the efficacy of vaccines in preventing disease and disability and their cost-effectiveness, a proportion of the population remains reluctant to vaccination. Vaccination literacy is one of the main determinants of vaccine decision-making. The aims of this study were to assess the measurement properties of the Hungarian version of a vaccination literacy instrument and describe the level and determinants of vaccination literacy among the Hungarian adult population.

Methods:

A cross-sectional study was conducted on a sample of 1205 Hungarian adult respondents within the European Health Literacy Population Survey 2019–2021. The data were collected by computer-assisted telephone survey in December 2020. The questionnaire covered the following topics: sociodemographic data, self-perceived health, social support, and general and vaccination literacy. The instrument’s internal consistency was measured using Cronbach’s alpha, its reliability was assessed based on the Spearman–Brown correlation coefficient. The construct validity of the questionnaire was examined using principal component analysis based on a polychoric correlation matrix. Multivariate ordered logistic regression analyses investigated the relationship between vaccination literacy and other relevant variables.

Results:

The Cronbach’s alpha was 0.78, while the Spearman-Brown correlation coefficient was 0.725. The principal component analysis extracted 1 significant factor that explained 69% of the total variance. The Hungarian adult population had a good level of vaccination literacy (mean score: 82.4, 95% CI 74.9-89.8). We found that social support (OR for the moderate support: 1.93, OR for the strong support: 2.19; P < .001 for both), lack of financial deprivation (OR: 2.05, P < .001), and secondary education level (OR: 1.50, P: .024) are positively correlated with vaccination literacy.

Conclusion:

We recommend using the vaccination literacy instrument to identify individuals with inadequate vaccination literacy. Interventions focusing on social support and education to promote vaccine-related information would contribute to enhancing vaccination literacy.

Keywords

vaccination literacy measurement properties European Health Literacy Population Survey 2019-2021 social support general health literacy

Introduction

Vaccines are highly effective and cost-efficient in protecting individuals from diseases, disabilities, and death caused by vaccine-preventable diseases, and although there is overwhelming evidence of their benefits, a significant part of the population doubts the need for and usefulness of immunization.^1,2

Numerous factors affect vaccine decision-making; general health literacy (GHL) and vaccination literacy (VHL) are among the main determinants.ⁱ Being health and vaccine literate leads to vaccine empowerment, trust in vaccines and their effectiveness, as well as trust in the healthcare system, and results in vaccine acceptance and uptake.^3,4

The idea of VHL has flourished within the concept of GHL.^5-7 It was first defined by Ratzan in 2011 as “not simply knowledge about vaccines but also developing a system with decreased complexity to communicate and offer vaccines as sine qua nonⁱⁱ of a functioning health system.”⁸(p. 229) The most recent definition of VHL emphasizes that the concept encompasses both skills (at the personal, community, and population levels) and context. According to it, VHL “is linked to health literacy. It entails people’s and communities’ knowledge, motivation, and competencies to access, understand, and critically appraise and apply information about immunization, vaccines, vaccination programs, and organizational processes to access vaccination and to navigate the health system, in order to make informed decisions about vaccines for themselves, the members of their family, and the community, and to appreciate the larger global impact of vaccines with respect to population health.”⁹(p. 4-5)

Previously, there had not been any research in Hungary specifically measuring VHL in general.¹⁰ Hungary joined the Action Network on Measuring Population and Organizational Health Literacy (M-POHL), which was established under the aegis of the World Health Organization’s European Health Initiative and aims to improve health literacy (HL) in the World Health Organization’s European Region. Hungary participated in the Health Literacy Survey 2019-2021 (HLS₁₉), which is M-POHL’s first project. HLS₁₉ was a multicenter cross-sectional study in which data were collected between November 2019 and June 2021.¹¹

Investigating the measurement properties of the VHL instrument is essential to ensure it measures reliably and validly individuals’ ability to access, understand, appraise, and apply information related to vaccination. Demonstrating its psychometric soundness enables proper assessment of VHL levels within the population and facilitates comparison across studies and contexts. However, validation alone does not fully capture the complexity of VHL as a public health construct. It is equally important to examine the determinants of VHL in order to identify the social, economic, and educational factors that shape individuals’ capacity to make informed vaccination decisions. Understanding these associations can inform the design of targeted interventions and communication strategies aimed at improving VHL and ultimately enhancing vaccine confidence and uptake within the population. Therefore, the aims of our study were to (1) assess the measurement properties of the Hungarian version of the HLS₁₉-VAC instrument, the VHL instrument of the HLS₁₉, (2) describe the level of VHL in the Hungarian adult population, and (3) investigate its determinants.

Methods

Study Design and Sampling

A nationwide cross-sectional survey was conducted on a sample of 1205 people (response rate calculated based on the number of completed interviews divided by the sum of interviews and refusals: 27%) aged 18 and over among Hungarian residents as part of the HLS₁₉.¹² The study sample was representative of the Hungarian population by age, sex, educational level, and place of residence.

A professional polling company collected the data in December 2020, using computer-assisted telephone interviews (CATI) in Hungarian in response to the COVID-19 pandemic. A probability sampling strategy was used which included stratification based on regions/type of settlements to define the case numbers to achieve per each, while ensuring random selection by using a pool of phone numbers drawn from public registries. The probability sample had been selected in multiple stages with proportional stratification during the data collection. The regions formed the first strata, type of settlements the second. The localities were chosen from these strata with the help of probability-proportional-to-size (PPS) sampling. Afterwards, it was determined how many persons should get into the sample from each type of settlement within each region in accordance with the proportion of the basic population in the whole adult population broken down to regions, and the proportion of the population of the type of settlement within the region. After the localities and the number of target interviews for each have been set, the phone numbers were selected from the online public phonebook. This process complemented by a quota for sex/age/region/type of settlement control during fieldwork ensured a representative sample of the Hungarian population aged 18 years and older who are living in private households. Details of weighting and data collection have been described elsewhere.¹³ The Medical Research Council Scientific and Research Committee, Hungary (IV/10181-3/2020/EKU) approved the study and informed consent was obtained from all participants in accordance with the Declaration of Helsinki.

Data Collection Domains and Tools

Sociodemographic Data

We collected the following sociodemographic data: sex, age, educational level, child-rearing, being trained in a health profession, self-perceived social status, and financial deprivation. Sex was dichotomized as male and female. Three age groups were set up as 18 to 35, 36 to 65, and 66 years of age and over. Four categories were created for the highest level of education (primary education; secondary education without baccalaureate; secondary education with baccalaureate; college, university degree, or higher). Information about child-rearing and being trained in a health profession was dichotomized as yes or no. The self-perceived social status was measured on a 10-point Likert scale, with step 1 standing for the lowest level in society and step 10 representing the highest level in society. Low level in society was defined as 1 to 4.¹² The difficulty of paying utility bills and paying for necessary medical examinations, treatments, and medications was used as a gauge of financial deprivation. Each question was answered using a 4-point Likert scale ranging from “very difficult” to “very easy”. The available score was calculated on a scale from 0 to 100, based on the combined percentage of “difficult” and “very difficult” responses. Higher scores indicate more severe financial deprivation, a score above 50 was considered deprived.¹²

Self-Perceived Health and Social Support

A 5-point Likert-scale (1 – “very bad”, 5 – “very good”) based on the question of the European Health Interview Survey 2019 was used to assess self-perceived health.^14,15 The perceived social support was measured using the 3-item Oslo Social Support Scale. Social support is classified as poor below 8 points, moderate between 9 and 11 points, and strong above 12 points.^14,15

General and Vaccination Literacy

GHL was measured using the 12-item HLS₁₉-Q12 questionnaire.¹⁶ For each question, the respondent had to select the most relevant answer on a 4-point Likert scale from “very easy” to “very difficult.” The total score was calculated if at least 80% of the questions were answered.¹² The scale has shown high internal reliability in previous Hungarian study.¹³

The HLS₁₉-VAC instrument assessed the 4 aspects of vaccination-related information management with 1 item for each aspect. The questionnaire consisted of 4 questions: How easy or difficult would you say it is to find information on recommended vaccinations for you or your family?; understand why you or your family may need vaccinations?; judge which vaccinations you or your family may need?; and decide if you should have a flu vaccination?¹² Respondents were asked to select the most appropriate answer on a 4-point Likert scale (from “very easy” to “very difficult”). The score was calculated based on the valid responses, on the percentage of “easy” or “very easy” answers (0 and 100), where a higher score indicated a higher level of VHL.

Statistical Analyses

The terminology from the COnsensus-based Standards for the selection of health status Measurement INstruments (COSMIN) taxonomy was used when the measurement properties of the questionnaire were described.¹⁷ The internal consistency of the HLS₁₉-VAC instrument was measured using Cronbach’s alpha with the corresponding bootstrapped 95% confidence intervals and “alpha if item deleted” (change in coefficient alpha after removal of a single component), where a value between 0.70 and 0.95 was considered as acceptable reliability.¹⁸ The Spearman rank correlation was used to measure the association between the total scores of GHL and VHL. The Spearman correlation coefficient (rho) was calculated for both the total sample and the socioeconomic subsamples. Correlations are considered moderate if rho >0.4 and strong if rho >0.6.¹⁹

Because of the COVID-19 pandemic, it was not possible for us to perform a “test-retest” analysis with repeated data collection, so an alternative reliability indicator was quantified using the Spearman-Brown split-half reliability method. For this method, the items were randomly allocated into 2 groups, and the total score for each half of the instrument was calculated. The 2 sets of scores were correlated, and the corrected Spearman-Brown correlation coefficients were calculated. Consistency was considered moderate if the correlation was 0.50 to 0.69, strong if the correlation was 0.70 to 0.89 and very strong if the Spearman-Brown coefficient was >0.90. Item-total correlations were also analyzed, with a value greater than 0.3 being considered as acceptable. As a sensitivity analysis, we also tested the internal consistency of the HLS₁₉-VAC instrument in different subsamples. The construct validity of the questionnaire was examined using principal component analysis (PCA) based on a polychoric correlation matrix, which is appropriate for items measured on a 4-point Likert scale. Factorability was assessed using the Measure of Sampling Adequacy (MSA) derived from the anti-image matrix of the polychoric correlations, and the number of components to retain was guided by inspection of the scree plot and parallel analysis with polychoric correlations.

Descriptive analyses were based on data weighted by age, sex, education, and place of residence with 95% confidence intervals (95% CI). Multivariate ordered logistic regression analyses were conducted to examine the relationship between VHL and sociodemographic, social support, and self-perceived health variables. Due to the limited number of items (n = 4) and the resulting discrete score distribution (0, 25, 50, 75, 100), the VHL score was treated as an ordinal variable in these analyses rather than applying arbitrary cut-off points. This analysis was adjusted for self-perceived social status, child-rearing, and being trained in a health profession, and was based on complete case data. The validity of the proportional odds assumption was checked using a full likelihood ratio test comparing the fitted location model to a model with varying location parameters. Associations were quantified using odds ratios (OR) and corresponding 95% confidence intervals (95% CI). A P-value less than 0.05 was considered statistically significant.

Data analysis was performed using the statistical software Stata/IC 16 survey data analysis module (StataCorp. 2019. Stata Statistical Software: Release 16. College Station, TX: StataCorp LLC), with the SPSS 26.0 software (IBM Corporation, Armonk, New York, USA) and R version 4.4.3 (R Core Team, 2025).

Results

Characteristics of the Sample

Our sample consisted of 1205 people. The mean age of respondents was 48.0 years (min. 18, max. 91 years; SD: 17.5 years), with an almost equal proportion of males and females (47% vs 53%). The largest part of the sample had a secondary education. More than 70% of the respondents rated their level in society to normal. Nearly one-third of respondents were financially deprived and nearly half of them has rated their health as good or very good and received moderate social support (Table 1).

Table 1.

Main Characteristics of the Study Sample (Weighted by Age, Sex, Education, and Place of Residence), and Cronbach’s Alpha Values and Spearman-Brown Correlation Coefficients for the Subsamples.

Variables	Subsamples	Percentage (95% CI)	Cronbach’s alpha (95% CI)	Spearman-Brown coefficient
	Total sample		0.78 (0.75-0.80)	0.725
Sex	Male	46.8 (43.9-49.6)	0.77 (0.72-0.80)	0.797
Sex	Female	53.2 (50.4-56.1)	0.79 (0.75-0.83)	0.638
Age categories	Age 18-35 years	19.6 (17.5-22.0)	0.78 (0.74-0.83)	0.872
	Age 36-65 years	52.9 (50.0-55.7)	0.78 (0.74-0.82)	0.603
	Age 66+ years	27.5 (24.9-30.1)	0.51 (0.20-0.79)	0.763
Education level	Primary education	14.8 (12.9-16.9)	0.85 (0.78-0.89)	0.816
	Secondary school without a baccalaureate	27.8 (25.3-30.4)	0.77 (0.71-0.82)	0.735
	Secondary school with a baccalaureate	34.7 (31.9-37.4)	0.76 (0.70-0.81)	0.632
	College, university degree, or above	22.7 (20.5-25.2)	0.75 (0.67-0.80)	0.686
Self-perceived social status	Self-perceived social status: low	27.6 (25.1-30.2)	0.77 (0.70-0.82)	0.822
Self-perceived social status	Self-perceived social status: normal	72.4 (69.8-74.9)	0.78 (0.74-0.81)	0.607
Financial deprivation	Deprived	34.9 (32.1-37.7)	0.77 (0.70-0.81)	0.615
Financial deprivation	Not deprived	65.1 (62.3-67.9)	0.76 (0.72-0.79)	0.744
Child-rearing	Yes	69.8 (67.2-72.4)	0.78 (0.74-0.81)	0.874
Child-rearing	No	30.2 (27.6-32.8)	0.77 (0.70-0.82)	0.601
Being trained in a health profession	Yes	22.2 (19.9-24.7)	0.82 (0.75-0.86)	0.843
Being trained in a health profession	No	77.8 (75.3-80.1)	0.76 (0.72-0.79)	0.660
Self-perceived health	Bad or very bad	8.2 (6.8-9.9)	0.78 (0.65-0.86)	0.744
	Fair	36.8 (34.0-39.5)	0.74 (0.67-0.78)	0.800
	Good or very good	55.1 (52.3-57.9)	0.80 (0.76-0.83)	0.698
Social support	Poor	17.4 (15.3-19.7)	0.72 (0.61-0.80)	0.675
	Moderate	52.8 (49.9-55.7)	0.78 (0.73-0.81)	0.688
	Strong	29.8 (27.2-32.5)	0.77 (0.72-0.81)	0.721

Abbreviation: 95% CI, 95% confidence interval.

Measurement Properties of the Questionnaire

The internal consistency measured by Cronbach’s alpha was 0.78, while the split-half reliability calculated with the Spearman-Brown correlation coefficient was 0.725 for the total sample. Table 1 displays the calculated values for the various subsamples. The Cronbach’s alpha for the subsample showed a quite wide range from 0.51 (age above 65) to 0.85 (primary education). The values of the Spearman-Brown correlation coefficient varied between 0.601 (having no children) and 0.874 (having children).

We tested the Cronbach’s alpha coefficient by removing individual items and found that, except for the last item, removing any item results in a decrease in the coefficient. The item-total correlation coefficients were higher than the minimum acceptable level (0.3) in all cases. The lowest was for the last item (0.74), and the highest was for the third item (0.82).

The Measure of Sampling Adequacy (MSA = 0.794) indicated that the data were suitable for conducting PCA based on the polychoric correlation matrix. Examining the scree plot confirmed the suitability of a 1-factor solution. The PCA extracted 1 significant factor that explained 69% of the total variance. The factor loadings were between 0.73 (“decide if you should have a flu vaccination”) and 0.89 (“understand why you or your family may need vaccinations” and “judge which vaccinations you or your family may need”). Values for uniqueness ranged from 0.21 to 0.47, which means that the common factor explained most of the differences between items (Table 2).

Table 2.

Result of the Principal Components Analysis Based on Polychoric Correlation Matrix, Estimated by the R package “psych”.

Items of the scale	Factor loadings	Uniqueness
Item 1: find information on recommended vaccinations for you or your family	0.81	0.34
Item 2: understand why you or your family may need vaccinations	0.89	0.21
Item 3: judge which vaccinations you or your family may need	0.89	0.22
Item 4: decide if you should have a flu vaccination	0.73	0.47
Variance	2.77
Variance proportion (%)	69

We found a statistically significant correlation between GHL and VHL scores for the total sample (rho: 0.41, P < .001) and for all subsamples. It means that respondents with a higher level of GHL are more likely to have a better level of VHL. The strongest correlation, indicating a moderate positive correlation (r: 0.49, P < .001) between GHL and VHL, is found in the primary education group. The lowest correlation is found in the tertiary education group (r: 0.32, P < .001), indicating a weak positive correlation between GHL and VHL scores (Table 3).

Table 3.

Correlation Coefficients Between Health Literacy Scores and Vaccination Literacy Scores for the Subsamples.

Group	Spearman’s rho (95% CI)	P-value
Total sample	0.41 (0.36-0.46)	<.001
Male	0.44 (0.36-0.50)	<.001
Female	0.39 (0.32-0.46)	<.001
Age 18-35 years	0.37 (0.25-0.47)	<.001
Age 36-65 years	0.39 (0.32-0.46)	<.001
Age 66+ years	0.48 (0.39-0.57)	<.001
Primary education	0.49 (0.36-0.60)	<.001
Secondary school without a baccalaureate	0.43 (0.33-0.51)	<.001
Secondary school with a baccalaureate	0.40 (0.32-0.49)	<.001
College, university degree, or above	0.32 (0.21-0.43)	<.001
Self-perceived social status: low	0.39 (0.29-0.49)	<.001
Self-perceived social status: normal	0.41 (0.34-0.46)	<.001
Financial deprivation	0.39 (0.29-0.47)	<.001
No financial deprivation	0.40 (0.34-0.46)	<.001
Having children	0.43 (0.37-0.48)	<.001
No children	0.36 (0.25-0.46)	<.001
Being trained in a health profession	0.36 (0.25-0.46)	<.001
Not being trained in a health profession	0.42 (0.36-0.47)	<.001

Abbreviation: 95% CI, 95% confidence interval. Significant results are in bold.

The Vaccination Literacy of the Hungarian Adults and its Determinants

The weighted mean VHL score in Hungary was 82.4 (95% CI 74.9-89.8), it was the lowest among people with primary education and the highest among non-deprived people (Figure 1). More than one-fifth of respondents found it difficult to “judge which vaccination you or your family may need?” (Figure 2).

Figure 1.

The weighted mean vaccination literacy stratified by the respondent socio-demographic characteristics in Hungary.

Figure 2.

Distribution of responses to questions in the vaccination literacy instrument (weighted by sex, age, educational level, and place of residence).

Moderate (OR: 1.93, P < .001) and strong (OR: 2.19, P < .001) social support and the lack of financial deprivation (OR: 2.05, P < .001) had a positive effect on VHL. In terms of educational level, we observe that VHL is significantly higher among individuals without a baccalaureate (OR: 1.50, P = .024) compared to primary school graduates (Table 4).

Table 4.

Determinants of Vaccination Literacy According to the Multivariate Ordinal Logistic Regression Analyses.

Explanatory variables	OR^a (95% CI)	P-value
Female sex (ref.: male)	0.81 (0.62;1.06)	.125
Age	1.01 (0.99;1,02)	.127
Educational level (ref.: primary education)
Secondary school without a baccalaureate	1.50 (1.05;2.13)	.024
Secondary school with a baccalaureate	1.35 (0.92;1.97)	.126
College, university degree or above	1.11 (0.70;1.76)	.662
Lack of financial deprivation (ref.: deprivation)	2.05 (1.52;2.77)	<.001
Self-perceived health (ref.: bad, very bad)
Fair	0.77 (0.48;1.25)	.298
Good, very good	1.05 (0.63;1.75)	.855
Social support (ref.: poor)
Moderate	1.93 (1.36;2.74)	<.001
Strong	2.19 (1.48;3.25)	<.001

Abbreviations: OR (95% CI), odds ratio (95% confidence interval); ref., reference category.

Adjusted for self-perceived social status, child-rearing, and being trained in health profession.

Significant results are in bold.

Discussion

The aims of our study were to investigate the measurement properties of the Hungarian version of the HLS₁₉-VAC instrument, to describe the level of VHL of the Hungarian adult population and to investigate its determinants.

The Cronbach’s alpha coefficient (0.78), measuring internal consistency of the instrument, is higher than the acceptable level and the Cronbach’s alpha in the international study (0.72).^12,20 The high split-half reliability coefficient suggests a strong correlation between the 2 halves of the test, indicating good internal consistency of the questionnaire. Our analyses confirm that no modifications to the item set are needed to enhance the scale’s reliability and consistency in the Hungarian version. The HLS₁₉-VAC instrument has a 1-factor structure based on the PCA, which is also supported by Rasch analysis carried out on the HLS₁₉ data.^12,20 We observed a moderate positive correlation between GHL and VHL. Since the idea of VHL has flourished within the concept of GHL, the 2 constructs reveal partial overlap. Our findings suggest that GHL is an important foundation for VHL, particularly in vulnerable groups such as older adults and those with lower educational attainment.

The Hungarian VHL level was 82.4 on a scale from 0 to 100. Our result is not directly comparable with previous Hungarian results from 2015 and 2017, because the content and scoring of the VHL tool, as well as the data collection method, have evolved over time.^10,21 In our survey “to judge which vaccine you or your family may need” was the most difficult task. This question was also among the most difficult tasks in the previous Hungarian surveys^10,21 and in other HLS₁₉ countries.¹² This may indicate that respondents have difficulty assessing which recommendations apply to them.

The determinants of VHL included lack of financial deprivation, social support, and education, highlighting the impact of socioeconomic status on individuals’ capacity to access, understand, and use vaccine-related information. These findings underscore the importance of targeted interventions for disadvantaged populations to improve vaccine literacy and public health outcomes.

Individuals with low VHL may struggle to find, interpret, and apply health information. A vaccine-literate environment, particularly within healthcare organizations, can help compensate for these limitations.⁹ As healthcare professionals are trusted sources, their training should include vaccinology, communication, and strategies to identify and support people with low VHL.²² Patient educators or health mediators can help healthcare professionals and clients communicate better.²³ To help people make vaccine-related decisions, multiple channels must provide trustworthy, commercially unbiased information. Also important is building and maintaining trust in public institution information channels. It is also essential to combat health and vaccine misinformation, monitor antivaxxer groups, and dismantle their arguments.

Community projects, which can be organized by health mediators and health promotion offices using the comprehensive health literacy intervention model, can boost social support.²⁴ Local events and projects can reach more people, identify leaders, and train them as non-professional community health workers. Health flyers could also be tailored to local vaccination culture and VHL levels.

Education from primary school onward can be a priority area for promoting health- and vaccine-related information. Developing GHL and VHL can be an equal part of the curriculum, while adults could participate in GHL and VHL activities as part of lifelong learning.

VHL was surveyed in 10 other countries besides Hungary in the HLS₁₉. Hungary has the second highest VHL score after Portugal (M: 87.1, SD: 22.5).^12,25 When comparing international results, it should be considered that both the method and timing of data collection may differ between countries participating in the HLS₁₉. The COVID-19 pandemic, as well as the availability of vaccines and information about them may have influenced the survey results.¹²

Vaccination policies vary widely in countries measuring VHL within the HLS₁₉. Austria, Ireland, Germany, Norway, and Portugal have only recommended childhood vaccinations; Belgium has 1, the Czech Republic has 8, Italy and Slovenia have 10, Bulgaria has 11, and Hungary has 12 mandatory childhood vaccinations.²⁶ If a country has a high number of compulsory vaccinations, this may have an impact on individuals’ attitudes toward vaccination. The lack of choice may lead to individuals seeking less information about vaccination, which may also affect their VHL. In the HLS₁₉, Bulgaria and Hungary have the highest number of mandatory vaccinations, but while Hungary has one of the highest levels of VHL, Bulgaria has the lowest. This indicates that factors beyond vaccination policy, such as public trust, education, and communication strategies, play important roles in shaping VHL.

Our findings highlight the necessity of comparing not only scores but also important contextual factors, such as policy, socioeconomic conditions, and public trust, on an international scale. Further studies may investigate the correlation between mandatory vaccination policies and VHL, just as VHL for mandatory and recommended vaccines, as well as evaluate the long-term impact of targeted interventions.

Strengths and Limitations

One of the strengths of our study is its large, representative sample. Our study was part of an international survey, so the results are internationally comparable and give a good picture of Hungarian VHL. Because our data was collected before Hungary’s COVID-19 vaccine rollout, this sensitive period may have influenced the study’s results. The first and second waves of the COVID-19 pandemic raised debate about vaccines. People may know more about vaccines, their risks and benefit, and how to navigate the health system. It may have a positive impact on VHL. Due to the cross-sectional nature of the study, causal relationships cannot be drawn. Even though we used a stratified sampling method and a weighting procedure to represent the Hungarian adult population in our study, selection bias attributable to non-responses cannot be excluded.

Conclusions

Our study shows that adult Hungarians have good level of VHL. Our study found that the HLS₁₉-VAC instrument could be used to identify low VHL risk. The HLS₁₉-VAC instrument should be combined with other vaccination attitude tools because high VHL does not guarantee vaccine uptake.

VHL determinants included lack of financial deprivation, social support, and education. Interventions targeting these determinants should improve both VHL and GHL, as education and social support are also determinants of GHL.²⁷

Footnotes

Acknowledgements

Authors’ NoteThe professional polling company responsible for data collection had no role in the analyses, or interpretation of data; in the writing of the manuscript; or in the decision to publish the results. They were involved in sample drawing, data collection, and creation of the weighted database.The HLS₁₉ instrument used in this research was developed within “HLS₁₉ – the International Health Literacy Population Survey 2019–2021” of M-POHL. Further information about using the HLS₁₉ instruments can be found here: .

ORCID iDs

Gabriella Mátyás

Ferenc Vincze

Éva Bíró

Ethical Considerations

The study was conducted in accordance with the Declaration of Helsinki, and approved by the MEDICAL RESEARCH COUNCIL AND RESEARCH COMMITTEE, Hungary (IV/10181-3/2020/EKU – 2020).

Consent to Participate

Verbal informed consent was obtained from all subjects involved in the study.

Consent for Publication

Not applicable.

Author Contributions

Conceptualization, G.M. and É.B.; methodology, F.V.; formal analysis, F.V. and É.B.; data curation, F.V.; writing—original draft preparation, G.M.; writing—review and editing, F.V, R.Á. and É.B.; visualization, F.V.; supervision, R.Á.; funding acquisition, R.Á. All authors have read and agreed to the published version of the manuscript.

Funding

The authors disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: The work was supported by the Ministry of Human Capacities, Hungary (IV/956-4/2020/EKF) and by the Interior Ministry, Hungary (BM/10449-2/2023). This paper was supported by the János Bolyai Research Scholarship of the Hungarian Academy of Sciences (BO/00933/22/5). This project was also financed by the HUN-REN Research Network (TKCS-2021/32). RÁ also works as team member of the National Laboratory for Health Security Hungary (RRF-2.3.1-21-2022-00006) supported by the National Research, Development and Innovation Office (NKFIH).

Declaration of Conflicting Interests

The authors declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.

Data Availability Statement

The raw data supporting the conclusions of this article will be made available by the authors upon reasonable request. The data are not publicly available due to the participants of this study did not give written consent for their data to be shared publicly.

Notes

References

Lorini

Santomauro

Donzellini

, et al. Health literacy and vaccination: a systematic review. Hum Vaccines Immunother. 2018;14(2):478-488. doi:10.1080/21645515.2017.1392423

World Health Organization. Ten threats to global health in 2019. 2019. Accessed September 4, 2025. https://www.who.int/news-room/spotlight/ten-threats-to-global-health-in-2019

Michel

Goldberg

Education, healthy ageing and vaccine literacy. J Nutr Health Aging. 2021;25(5):698-701. doi:10.1007/s12603-021-1627-1

Cissé

Rosano

Griebler

, et al. Exploring vaccination literacy and vaccine hesitancy in seven European countries: results from the HLS19 population survey. Vaccine X. 2025;25:100671. doi:10.1016/j.jvacx.2025.100671

Biasio

Bonaccorsi

Lorini

Pecorelli

Assessing COVID-19 vaccine literacy: a preliminary online survey. Hum Vaccines Immunother. 2021;17(5):1304-1312. doi:10.1080/21645515.2020.1829315

Badua

Caraquel

Cruz

Narvaez

RA.

Vaccine literacy: a concept analysis. Int J Ment Health Nurs. 2022;31(4):857-867. doi:10.1111/inm.12988

Zhang

Dai

Wang

Zhang

Fang

Vaccine literacy and vaccination: a systematic review. Int J Public Health. 2023;68:1605606. doi:10.3389/ijph.2023.1605606

Ratzan

SC.

Vaccine literacy: a new shot for advancing health. J Health Commun. 2011;16(3):227-229. doi:10.1080/10810730.2011.561726

Lorini

Del Riccio

Zanobini

, et al. Vaccination as a social practice: towards a definition of personal, community, population, and organizational vaccine literacy. BMC Public Health. 2023;23(1):1501. doi:10.1186/s12889-023-16437-6

10.

Kun

Gács

Benedek

Mészner

Koltai

A HPV-oltás és a szülői egészségértés – kanyargós út az oltásig. Egészségfejlesztés. 2017;58(4):10-19. doi:10.24365/ef.v58i4.186

11.

Dietscher

Pelikan

Bobek

Nowak

, Europe WHORO for. The action network on measuring population and organizational health literacy (M-POHL): a network under the umbrella of the WHO European Health Information Initiative (EHII). Public Health Panor. 2019;5(1):65-71.

12.

The HLS19 Consortium of the WHO Action Network M-POHL. International report on the methodology, results, and recommendations of the European Health Literacy Population Survey 2019-2021 (HLS19). The HLS19 Consortium of the WHO Action Network M-POHL; 2021.

13.

Bíró

Vincze

Nagy-Pénzes

Ádány

. Investigation of the relationship of general and digital health literacy with various health-related outcomes. Front Public Health. 2023;11:1229734. doi:10.3389/fpubh.2023.1229734

14.

Központi Statisztikai Hivatal. Európai lakossági egészségfelmérés kérdőív 2019. Központi Statisztikai Hivatal; 2019.

15.

European Commission: Eurostat. European Health Interview Survey (EHIS Wave 3): Methodological Manual: 2020 Edition (Re Edition). Publications Office; 2020. doi:10.2785/135920

16.

Pelikan

Link

Strassmayr

, et al. Measuring comprehensive, general health literacy in the general adult population: the development and validation of the HLS19-Q12 instrument in seventeen countries. Int J Environ Res Public Health. 2022;19(21):14129. doi:10.3390/ijerph192114129

17.

Mokkink

Terwee

Patrick

, et al. The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes. J Clin Epidemiol. 2010;63(7):737-745. doi:10.1016/j.jclinepi.2010.02.006

18.

Terwee

Bot

SDM

De Boer

, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60(1):34-42. doi:10.1016/j.jclinepi.2006.03.012

19.

Prion

Haerling

KA.

Making sense of methods and measurement: spearman-rho ranked-order correlation coefficient. Clin Simul Nurs. 2014;10(10):535-536. doi:10.1016/j.ecns.2014.07.005

20.

The HLS19 Consortium of the WHO Action Network M-POHL. The HLS19-VAC Instrument to Measure Vaccination Literacy (Scoring Based on Dichotomized Items). The HLS19 Consortium of the WHO Action Network M-POHL; Updated version July 2023.

21.

Koltai

Kun

A magyarországi egészségértés nemzetközi összehasonlításban. Egészségfejlesztés. 2016;57(3):3-20. doi:10.24365/ef.v57i3.62

22.

Biasio

LR.

Vaccine literacy is undervalued. Hum Vaccines Immunother. 2019;15(11):2552-2553. doi:10.1080/21645515.2019.1609850

23.

Kósa

Katona

Papp

, et al. Health mediators as members of multidisciplinary group practice: lessons learned from a primary health care model programme in Hungary. BMC Fam Pract. 2020;21(1):19. doi:10.1186/s12875-020-1092-7

24.

Geboers

Reijneveld

Koot

JAR

De Winter

AF.

Moving towards a comprehensive approach for health literacy interventions: the development of a health literacy intervention model. Int J Environ Res Public Health. 2018;15(6):1268. doi:10.3390/ijerph15061268

25.

Arriaga

Francisco

Nogueira

, et al. Health literacy in Portugal: results of the health literacy population survey project 2019–2021. Int J Environ Res Public Health. 2022;19(7):4225. doi:10.3390/ijerph19074225

26.

European Centre for Disease Prevention and Control. Vaccine Scheduler. 2025. Accessed September 4, 2025. https://vaccine-schedule.ecdc.europa.eu/

27.

Bíró

Szabó

Kósa

. A magyar felnőtt lakosság egészségműveltsége. Egészségfejlesztés. 2022;63(3):3-11. doi:10.24365/ef.8496

Vaccination Literacy and Its Determinants in Hungary: Results of a Cross-Sectional Survey

Abstract

Introduction/Objectives:

Methods:

Results:

Conclusion:

Keywords

Introduction

Methods

Study Design and Sampling

Data Collection Domains and Tools

Sociodemographic Data

Self-Perceived Health and Social Support

General and Vaccination Literacy

Statistical Analyses

Results

Characteristics of the Sample

Measurement Properties of the Questionnaire

The Vaccination Literacy of the Hungarian Adults and its Determinants

Discussion

Strengths and Limitations

Conclusions

Footnotes

Acknowledgements

ORCID iDs

Ethical Considerations

Consent to Participate

Consent for Publication

Author Contributions

Funding

Declaration of Conflicting Interests

Data Availability Statement

Notes

References