This article aimed to develop the Multidimensional Vaccine Hesitancy Scale (MVHS). In Study 1 (n = 336), we identified 13 possible vaccine hesitancy dimensions and developed an item list. In Study 2 (n = 444), we performed an exploratory factor analysis that supported an eight-dimension structure and reduced our measure to 32 items. We supported its validity by establishing relations with associated variables, even while controlling for measures of the same and similar constructs. In Study 3 (n = 575), we confirmed its factor structure and replicated its validity results. Support was provided for the psychometric properties and validity of the MVHS.
AlmirallDComptonSNGunlicks-StoesselM, et al. (2012) Designing a pilot sequential multiple assignment randomized trial for developing an adaptive treatment strategy. Statistics in Medicine31(17): 1887–1902.
2.
BedfordHAttwellKDanchinM, et al. (2018) Vaccine hesitancy, refusal and access barriers: The need for clarity in terminology. Vaccine36(44): 6556–6558.
3.
BetschCSchmidPHeinemeierD, et al. (2018) Beyond confidence: Development of a measure assessing the 5C psychological antecedents of vaccination. PLoS One13(12): e0208601.
4.
BishAMichieS (2010) Demographic and attitudinal determinants of protective behaviours during a pandemic: A review. British Journal of Health Psychology15(Pt 4): 797–824.
5.
BishAYardleyLNicollA, et al. (2011) Factors associated with uptake of vaccination against pandemic influenza: A systematic review. Vaccine29(38): 6472–6484.
6.
BrownTA (2015) Confirmatory Factor Analysis for Applied Research. New York: Guilford Publications.
7.
BuhrmesterMDTalaifarSGoslingSD (2018) An evaluation of Amazon’s mechanical Turk, its rapid rise, and its effective use. Perspectives on Psychological Science13(2): 149–154.
8.
CataldiJRSevickCPyrzanowskiJ, et al. (2019) Addressing personal parental values in decisions about childhood vaccination: Measure development. Vaccine37(38): 5688–5697.
9.
ChampionVLSkinnerCS (2008) The health belief model. In: GlanzKRimerBKViswanathK (eds) Health Behavior and Health Education: Theory, Research, and Practice. San Francisco, Jossey-Bass, pp.45–65.
10.
CollinsLMBakerTBMermelsteinRJ, et al. (2011) The multiphase optimization strategy for engineering effective tobacco use interventions. Annals of Behavioral Medicine41(2): 208–226.
11.
CollinsLMMurphySAStrecherV (2007) The multiphase optimization strategy (MOST) and the sequential multiple assignment randomized trial (SMART): New methods for more potent eHealth interventions. American Journal of Preventive Medicine32(5 Suppl): S112–S118.
12.
CortinaJMShengZKeenerSK, et al. (2020) From alpha to omega and beyond! A look at the past, present, and (possible) future of psychometric soundness in the journal of applied psychology. Journal of Applied Psychology105: 1351–1381.
13.
CostelloABOsborneJ (2005) Best practices in exploratory factor analysis: Four recommendations for getting the most from your analysis. Practical Assessment, Research, and Evaluation10(1): 1–9.
14.
DubéELabergeCGuayM, et al. (2013) Vaccine hesitancy: An overview. Human Vaccines & Immunotherapeutics9(8): 1763–1773.
15.
DudleyMZPrivor-DummLDubéÈ, et al. (2020) Words matter: Vaccine hesitancy, vaccine demand, vaccine confidence, herd immunity and mandatory vaccination. Vaccine38(4): 709–711.
16.
FabrigarLRWegenerDTMacCallumRC, et al. (1999) Evaluating the use of exploratory factor analysis in psychological research. Psychological Methods4(3): 272–299.
17.
GilkeyMBMagnusBEReiterPL, et al. (2014) The vaccination confidence scale: A brief measure of parents’ vaccination beliefs. Vaccine32(47): 6259–6265.
18.
GilkeyMBReiterPLMagnusBE, et al. (2016) Validation of the vaccination confidence scale: A brief measure to identify parents at risk for refusing adolescent vaccines. Academic Pediatrics16(1): 42–49.
19.
GriffinRJDunwoodySNeuwirthK (1999) Proposed model of the relationship of risk information seeking and processing to the development of preventive behaviors. Environmental Research80(2Pt 2): S230–S245.
20.
HairJFBlackWCBabinBJ, et al. (2019) Multivariate Data Analysis, Andover. Hampshire: Cengage Learning.
21.
HarringtonD (2009) Confirmatory Factor Analysis. Oxford: Oxford University Press.
22.
HinkinTR (1995) A review of scale development practices in the study of organizations. Journal of Management21(5): 967–988.
23.
HinkinTR (1998) A brief tutorial on the development of measures for use in survey questionnaires. Organizational Research Methods1(1): 104–121.
24.
HowardMC (2016) A review of exploratory factor analysis decisions and overview of current practices: What we are doing and how can we improve?International Journal of Human-Computer Interaction32(1): 51–62.
25.
HowardMC (2018) Scale pretesting. Practical Assessment, Research, and Evaluation23(1): 1–14.
26.
HowardMC (2020) Understanding face mask use to prevent coronavirus and other illnesses: Development of a multidimensional face mask perceptions scale. British Journal of Health Psychology25: 912–924.
27.
HowardMCJacobsRR (2016) The multiphase optimization strategy (MOST) and the sequential multiple assignment randomized trial (SMART): Two novel evaluation methods for developing optimal training programs. Journal of Organizational Behavior37(8): 1246–1270.
28.
HuLBentlerPM (1999) Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling A Multidisciplinary Journal6(1): 1–55.
29.
JacksonDLGillaspyJAPurc-StephensonR (2009) Reporting practices in confirmatory factor analysis: An overview and some recommendations. Psychological Methods14(1): 6–23.
30.
JarrettCWilsonRO’LearyM, et al. (2015) Strategies for addressing vaccine hesitancy – A systematic review. Vaccine33(34): 4180–4190.
31.
Kocoglu-TanyerDDengizKSSacikaraZ (2020) Development and psychometric properties of the public attitude towards vaccination scale – health belief model. Journal of Advanced Nursing76(6): 1458–1468.
32.
LarsonHJJarrettCEckersbergerE, et al. (2014) Understanding vaccine hesitancy around vaccines and vaccination from a global perspective: A systematic review of published literature, 2007-2012. Vaccine32(19): 2150–2159.
33.
LarsonHJJarrettCSchulzWS, et al. (2015) Measuring vaccine hesitancy: The development of a survey tool. Vaccine33(34): 4165–4175.
34.
MacDonaldNE (2015) Vaccine hesitancy: Definition, scope and determinants. Vaccine33(34): 4161–4164.
35.
MarshHWBallaJRMcDonaldRP (1988) Goodness-of-fit indexes in confirmatory factor analysis: The effect of sample size. Psychological Bulletin103(3): 391–410.
36.
MarshHWHauKTWenZ (2004) In search of golden rules: Comment on hypothesis-testing approaches to setting cutoff values for fit indexes and dangers in overgeneralizing Hu and Bentler's (1999) findings. Structural Equation Modeling A Multidisciplinary Journal11(3): 320–341.
37.
MartiMde ColaMMacDonaldNE, et al. (2017) Assessments of global drivers of vaccine hesitancy in 2014-looking beyond safety concerns. PLoS One12(3): e0172310.
38.
MellisA. M.BickelW. K. (2020). Mechanical Turk data collection in addiction research: Utility, concerns and best practices. Addiction, 115(10), 1960–1968.
39.
OduwoleEOPienaarEDMahomedH, et al. (2019) Current tools available for investigating vaccine hesitancy: A scoping review protocol. BMJ Open9(12): e033245–e033247.
40.
PalanSSchitterC (2018) Prolific.ac—A subject pool for online experiments. Journal of Behavioral and Experimental Finance17: 22–27.
41.
PatersonPMeuriceFStanberryLR, et al. (2016) Vaccine hesitancy and healthcare providers. Vaccine34(52): 6700–6706.
42.
PerezSTatarOShapiroGK, et al. (2016) Psychosocial determinants of parental human papillomavirus (HPV) vaccine decision-making for sons: Methodological challenges and initial results of a pan-Canadian longitudinal study. BMC Public Health16(1): 1223.
43.
PresserSCouperMPLesslerJT, et al. (2004) Methods for testing and evaluating survey questions. Public Opinion Quarterly68(1): 109–130.
44.
QuinnSCJamisonAMAnJ, et al. (2019) Measuring vaccine hesitancy, confidence, trust and flu vaccine uptake: Results of a national survey of white and African American adults. Vaccine37(9): 1168–1173.
45.
RobinsonJRosenzweigCMossAJ, et al. (2019) Tapped out or barely tapped? Recommendations for how to harness the vast and largely unused potential of the mechanical turk participant pool. PLoS One14(12): e0226394.
46.
RosenstockIMStrecherVJBeckerMH (1988) Social learning theory and the health belief model. Health Education Quarterly15(2): 175–183.
47.
RosselliRMartiniMBragazziNL (2016) The old and the new: Vaccine hesitancy in the era of the web 2.0. Challenges and opportunities. Journal of Preventive Medicine and Hygiene57(1): E47–E50.
48.
SarathchandraDNavinMCLargentMA, et al. (2018) A survey instrument for measuring vaccine acceptance. Preventive Medicine109: 1–7.
49.
SchreiberJBNoraAStageFK, et al. (2006) Reporting structural equation modeling and confirmatory factor analysis results: A review. The Journal Educational Research99(6): 323–338.
50.
ShapiroGKHoldingAPerezS, et al. (2016) Validation of the vaccine conspiracy beliefs scale. Papillomavirus Research2: 167–172.
51.
ShapiroGKTatarODubeE, et al. (2018) The vaccine hesitancy scale: Psychometric properties and validation. Vaccine36(5): 660–667.
52.
TanevaSKYankovGP (2020) A step forward: From conceptualizing to measuring successful aging at work. Industrial and Organizational Psychology13(3): 417–421.
53.
WallaceASWannemuehlerKBonsuG, et al. (2019) Development of a valid and reliable scale to assess parents’ beliefs and attitudes about childhood vaccines and their association with vaccination uptake and delay in Ghana. Vaccine37(6): 848–856.
54.
WooSEKeithMThorntonMA (2015) Amazon Mechanical Turk for industrial and organizational psychology: Advantages, challenges, and practical recommendations. Industrial and Organizational Psychology8(2): 171–179.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
