Abstract
Background:
This study examined the association between patient experience (PX, events experienced by patients during primary care that are an indicator of patient-centered quality) of primary care and varicella-zoster virus (VZV) vaccine uptake in older adults.
Methods:
A case-control study of VZV vaccination was conducted at a community hospital in Ibaraki, Japan. Patients aged 65 years or older who had continuously been patients of the hospital between April 2018 and April 2021 were included in the study. The vaccinated group consisted of 166 VZV-vaccinated patients. The controls consisted of 29 age- and sex-matched patients who did not receive VZV vaccination. A self-administered questionnaire was distributed between August and September 2021. It included the Japanese version of the Primary Care Assessment Tool Short Form (JPCAT-SF) to evaluate PX and included questions about recommendations for VZV vaccination by a physician and the vaccination history of relatives. Multivariable and intermediate factor analyses were used to assess whether there was an association between VZV vaccination and PX.
Results:
Questionnaires were sent to 457 subjects. Responses from 228 (116 in the vaccination group and 112 in the non-vaccinated group) were included in the analysis. Multivariable analysis, which excluded physician recommendation for VZV vaccination as a variable because it was an intermediate factor in the analysis, showed an association between PX and VZV vaccination (odds ratio, 1.38; 95% confidence interval, 1.00-1.92; P = .049).
Conclusions:
PX was associated with past VZV vaccination. Physician recommendation for VZV vaccination was an intermediate factor between PX and VZV vaccination.
Keywords
Introduction
Herpes zoster is a disease in which reactivation of the varicella-zoster virus (VZV) causes the appearance of painful blisters clustered in the innervated area. The pain might persist for years as postherpetic neuralgia. 1 The number of people affected by herpes zoster was increasing in Japan, which has an aging population. 2 Approximately 1 in 3 people are estimated to be affected by herpes zoster by age 80 years. 2 Herpes zoster in the elderly has been shown to significantly reduce activities of daily living and quality of life 3 ; its impact is expected to become even greater in the future. In Japan, it became possible to administer live attenuated VZV vaccine in 2016, when it was approved for the purpose of preventing herpes zoster, approximately 10 years behind Europe and the United States. A prior study revealed that vaccination was effective in reducing the incidence of herpes zoster by 51.3%. 4 We do not know the number of Japanese residents undergoing VZV vaccination, but it may be small. This can be primarily attributed to the voluntary nature of VZV vaccination and the absence of an official program. Consequently, the precise number of vaccinations administered in Japan has not been made publicly available.
In Japan, inactivated recombinant zoster vaccine was approved in 2020, but distribution had been slow, with little available as of 2022.
Several studies on factors related to influenza and pneumococcal vaccination in Japan and the United States have suggested associations between patient experience (PX, events experienced by patients during primary care) and subjective health perspectives.5 -7 However, few studies have examined vaccination factors for the VZV vaccine. PX is a quality indicator of patient-centeredness. This indicator was increasingly used to assess the quality of primary care because patient-centeredness was a crucial concept, especially in the primary care setting. 8 PX affects health outcomes through patient behaviors such as adherence to treatment and health care resource use.9,10
If the association between PX and VZV vaccination can be clarified, the interventions needed to improve vaccination coverage can be identified, which might lead to higher VZV vaccine coverage. Therefore, this study evaluated whether PX is associated with VZV vaccination. Prior studies had shown that physician recommendation is strongly associated with receipt of other vaccinations, 5 although it is more likely to be an intermediate factor in actual clinical practice. Therefore, this study evaluated whether PX is associated with VZV vaccination and whether physician recommendation could serve as an intermediate factor.
Methods
Study Design and Study Settings
This a case-control study of VZV vaccination involved a self-administered questionnaire. The study site was a 30-bed community hospital in X city, Ibaraki prefecture, Japan. At this hospital, the VZV vaccine has been widely promoted to outpatients since 2017 through digital signage, advertising posters, and pamphlets in the hospital. VZV vaccination is actively encouraged during outpatient consultations.
X city is a small city with a population of approximately 72 000 as of 2023. The percentage of the population aged ≥65 years was 33.0%. The city is making efforts to widely publicize the VZV vaccine to its citizens by including articles on the VZV vaccine in its city newsletter. As of 2023, VZV vaccination was self-paid in X city, as in most municipalities in Japan.
The inactivated recombinant zoster vaccine was not used at the study site or other medical facilities in the area. Only the attenuated Oka VZV vaccine was used.
Participants
We first selected study participants for the vaccination group. Among all patients seen at the study site between April 2018 and April 2021, 297 who were vaccinated against VZV were chosen. VZV vaccination status was ascertained from electronic medical records. From the patients chosen, those who had already died (n = 21), were unable to respond to the questionnaire (n = 9), had not visited the hospital regularly for more than 6 months (n = 75), or aged less 65 years (n = 26) were excluded; 166 were selected as the vaccination group. Those who were unable to answer the questionnaire included patients who were listed as “unable to make decisions” or “unable to communicate” in the core symptoms of dementia column of the long-term care insurance attending physician opinion form 11 obtained from electronic medical records and municipal databases, as well as those who were unable to communicate. Information on death was obtained from electronic medical records.
The control (non-vaccinated) group was selected by hospital staff not involved in the study using a random number table. For the control group, we selected 2 persons of the same sex and age as each participant in the vaccination group to whom the questionnaire was sent. Matched persons who had already died, were unable to respond to the questionnaire, or unable to be vaccinated due to immunodeficiency (eg, use of immunosuppressive drugs) were excluded. A replacement was selected using a random number table. Information on immunodeficiency was obtained from electronic medical records.
If only 1 person was an appropriate match, only 1 person was selected. Since the non-vaccinated group was expected to have lower PX than the vaccination group, the questionnaire response rate was also expected to be lower. Therefore, the ratio of participants in the vaccinated group to the non-vaccinated group was set at 1:2. Two hundred ninety-one controls were selected to form the non-vaccinated group. A flowchart of the research participant selection process is shown in Figure 1.

Flowchart of the research participant selection process.
Self-administered questionnaires were sent by mail to a total of 457 participants in the vaccination and non-vaccinated groups between August and September 2021. The responses were returned by mail.
Exclusion criteria consisted of the following: inability to answer the self-administered questionnaire, no consent for study participation, and herpes zoster within 5 years as self-reported in the questionnaire. Patients who had herpes zoster within 5 years were excluded because they had been shown to have high shingles antibody titers and vaccination was not recommended for them at the time of the study. 12
Measurements
This study examined the association between PX and VZV vaccination. To measure PX, the Japanese version of the Primary Care Assessment Tool Short Form (JPCAT-SF) was used.
The Primary Care Assessment Tool (PCAT) is a widely used measure of PX developed by Drph et al 13 at the Johns Hopkins Primary Care Policy Center. Based on the PCAT, the JPCAT was translated into Japanese and modified to fit the Japanese context. 14 The JPCAT-SF was developed as a shortened version. 15 Validation studies have confirmed that it has higher validity and reliability than the PCAT. 13 The JPCAT-SF has been validated to have the same psychometric properties as the JPCAT. 14 This 13-item tool comprises 6 multi-item subscales addressing the following primary care attributes: first contact, longitudinality, coordination, comprehensiveness (services available), comprehensiveness (services provided), and community orientation. The JPCAT-SF scoring system converts each response on a 5-point Likert scale (1 = strongly disagree, 2 = somewhat disagree, 3 = not sure, 4 = somewhat agree, and 5 = strongly agree) into an item score from 0 to 4. The average of the item scores is calculated for each subscale and multiplied by 25 to obtain a subscale score from 0 to 100. The total JPCAT-SF score is the average of the 6 subscale scores. It provides an overall assessment of primary care performance, with higher scores indicating better performance.
Items in the JPCAT-SF, educational background(5 choices: less than high school, high school, vocational school, junior college, and university or graduate school), annual household income(4 choices: <2.50, 2.50–4.99, 5.00–7.99, and 8.00 million JPY ), self-assessment of health status (4 items), and subjective well-being (abbreviated Japanese version of the 11-item 16 revised Philadelphia Geriatric Center Morale Scale 17 ) were included in the self-administered questionnaire. In addition, whether and how the subject was aware of the VZV vaccine, whether and when the subject had herpes zoster, whether or not friends or relatives had herpes zoster, whether or not friends or relatives had been vaccinated against VZV, and whether or not vaccination was recommended by a doctor, friends, or relatives were investigated with the self-administered questionnaire.
Sex, age, type of health insurance (latter-stage elderly healthcare insurance, national health insurance, Japan Health Insurance Association, or other), municipality of residence, pneumococcal and influenza vaccination status, and underlying diseases (cardiac, respiratory, renal, malignant tumor, or diabetes) were abstracted from electronic medical records as of April 2021. The classification of underlying diseases followed previous studies 5 that investigated factors associated with influenza vaccination.
Educational background, annual household income, type of health insurance, and self-assessment of health status were investigated because they are known to be associated with PX18,19 and adult influenza and pneumonia vaccination. 6
Statistical Methods
We compared the vaccination and non-vaccinated groups. Descriptive statistics of the measured variables were performed. To examine factors related to VZV vaccination, we also examined differences between the vaccination and non-vaccinated groups using the t-test for continuous variables and the χ2 test for categorical variables in univariate analyses. Multivariable logistic regression with the forced entry method was then performed using sex, age, variables with a significant association in the univariate analysis (P < .10), and variables examined in the directed acyclic graph (DAG) based on background knowledge. In a DAG, an arrow connecting 2 variables indicates a causal relationship. Variables without a direct causal relationship are not connected. We illustrated this approach to explore variables associated with VZV vaccination status in a case-control study. The DAG (Figure 2) was created using the DAGitty program. 20

DAG for exploring variables associated with VZV vaccination status.
Since there are no previous studies on factors contributing to VZV vaccination, we considered a small number of variables with high predictive ability based on background knowledge, referring to previous studies on other types of vaccination.5,6 We selected VZV vaccination history of family members, VZV vaccination history of friends, family member recommendation for VZV vaccination, and friend recommendation for VZV vaccination.
Next, an intermediate factor analysis 21 was conducted. Figure 3 illustrates the flow of the intermediate factor analysis. This analysis examined the intermediate factors that intervene between PX and VZV vaccination. In addition to having no significant associations between PX and VZV vaccination in the multivariable analysis that included intermediate factors, the analysis needed to meet the following criteria: (1) a multivariable analysis with the intermediate factor as the dependent variable that shows an association with PX, (2) a multivariable analysis with VZV vaccination as the dependent variable that shows an association with the intermediate factor, and (3) a multivariable analysis that excludes the intermediate factor as an independent variable that indicates an association between PX and VZV vaccination.

Flow of the intermediate factor analysis.
Sample size was estimated using the rule of adherence to 10 events per variable in multivariable analysis. 22 We assumed 10 independent variables to be entered into the multivariable analysis; a sample size of 200 (100 cases and 100 controls) was calculated to be sufficient to fit a logistic regression model.
Missing values were addressed by performing an available-case analysis. In each analysis, we included all study participants with data available for the variable of interest. 23
Statistical analyses were performed with SPSS version 28.0-J (SPSS-Japan, Tokyo, Japan).
Ethical Considerations
This study was approved by the ethics committee of the Faculty of Medicine, University of Tsukuba (approval no. 1652). All study participants were mailed a description of the research study and its ethical considerations, a consent form, and the questionnaire. The consent form was collected by having study participants return the signed form along with the questionnaire.
Results
Descriptive Statistics and Univariate Analysis
A self-administered questionnaire was sent to 457 patients; 50.1% (n = 228; 69.8% (n = 116) in the vaccination group and 38.8% (n = 113) in the non-vaccinated group) returned the questionnaire. A study participant in the non-vaccinated group was excluded because the self-administered questionnaire revealed a history of herpes zoster within 5 years. Thus, 116 members of the vaccination group and 112 members of the non-vaccinated group were included in the final analysis.
Characteristics of the study participants and results of the univariate analysis are summarized in Table 1.
Characteristics of the Study Participants and Results of the Univariate Analysis.
Abbreviations: JPCAT-SF, JapaneseVersion of the Primary Care Assessment Tool Short Form; VZV, varicella-zoster virus.
The total JPCAT-SF score was calculated as the average of the 6 subscale scores from 0 to 100.
Student’s t-test.
Chi-squared test.
There were significant associations between the 2 groups in terms of pneumococcal vaccination, influenza vaccination, physician recommendation for VZV vaccination, VZV vaccination history of friends, JPCAT-SF longitudinality, and total JPCAT-SF score.
Multivariable Analysis
Logistic regression was conducted with VZV vaccination as the dependent variable and adjustment for age and sex. In addition, physician recommendation for VZV vaccination, family history of VZV vaccination, history of VZV vaccination of friends, total JPCAT-SF score, and family member recommendation for VZV vaccination, which showed an association (P < .10) in the univariate analysis, were used as independent variables. Friend recommendation for VZV vaccination, selected based on the DAG, was also added. Based on discussions among researchers and on the DAG, we performed adjustments for variables with P < .10 in the univariate analysis, which included pneumococcal vaccination status, influenza vaccination status, VZV vaccine awareness, and reason for VZV vaccine awareness.
The results of the multivariable logistic regression analysis are summarized in Table 2.
Multivariable Logistic Regression Analysis With VZV Vaccination as the Dependent Variable.
Abbreviations: CI, confidence interval; JPCAT-SF, Japanese Version of the Primary Care Assessment Tool Short Form; OR, odds ratio; SD, standard deviation; VZV, varicella–zoster virus.
The total JPCAT-SF score was calculated as the average of the 6 subscale scores from 0 to 100.
Per 1SD increase.
Multivariable analysis showed no significant associations between VZV vaccination status and total JPCAT-SF score but a significant association with physician recommendation for VZV vaccination.
Mediation Analysis
Physician recommendation for VZV vaccination, which had a significant association with VZV vaccination in the multivariable analysis, was analyzed as an intermediate factor.
(1) Results of the logistic regression analysis with physician recommendation for VZV vaccination as the dependent variable are shown in Table 3. This analysis corresponds to the analysis of part (1) in Figure 3. A significant association was found between the 2 groups in terms of total JPCAT-SF score and physician recommendation for VZV vaccination.
(2) Results of the logistic regression analysis with VZV vaccination as the dependent variable are shown in Table 4. This analysis corresponds to the analysis of part (2) in Figure 3. There was a significant association between physician recommendation for VZV vaccination and VZV vaccination.
(3) We analyzed the association between total JPCAT-SF score and VZV vaccination in the logistic regression analysis in which physician recommendation for VZV vaccination, which was considered an intermediate factor, was not included as an independent variable and VZV vaccination was the dependent variable (Table 5). This analysis corresponds to the analysis of part (3) in Figure 3. There was a significant association between total JPCAT-SF score and VZV vaccination.
Logistic Regression Analysis With Physician Recommendation for VZV Vaccination as the Dependent Variable.
Abbreviations: CI, confidence interval; JPCAT-SF, Japanese Version of the Primary Care Assessment Tool Short Form; OR, odds ratio; SD, standard deviation; VZV, varicella-zoster virus.
The total JPCAT-SF score was calculated as the average of the 6 subscale scores from 0 to 100.
Per 1SD increase.
Logistic Regression Analysis With VZV Vaccination as the Dependent Variable and Total JPCAT-SF Score Excluded as an Independent Variable.
Abbreviations: CI, confidence interval; JPCAT-SF, Japanese Version of the Primary Care Assessment Tool Short Form; OR, odds ratio; VZV, varicella-zoster virus.
Logistic Regression Analysis With VZV Vaccination as the Dependent Variable and Physician Recommendation for VZV Vaccination Excluded as an Independent Variable.
Abbreviations: CI, confidence interval; JPCAT-SF, Japanese Version of the Primary Care Assessment Tool Short Form; OR, odds ratio; SD, standard deviation; VZV, varicella-zoster virus.
The total JPCAT-SF score was measured from the average of the 6 subscale scores from 0 to 100.
Per 1SD increase.
Discussion
This study showed an association between PX and VZV vaccination in a multivariable analysis that excluded physician recommendation for VZV vaccination as a variable. The association between PX and VZV vaccination disappeared when physician recommendation for VZV vaccination was added as a variable. Multivariable analysis with physician recommendation for VZV vaccination as the dependent variable showed an association between physician recommendation for VZV vaccination and PX. Furthermore, multivariable analysis with VZV vaccination as the dependent variable showed an association between physician recommendation for VZV vaccination and VZV vaccination. Therefore, physician recommendation for VZV vaccination was found to be an intermediate factor between PX and VZV vaccination. This study might be the first to show an association between VZV vaccination and PX measured after VZV vaccination.
We found that PX can affect VZV vaccination if the physician’s recommendation for VZV vaccination was not included as a variable. Previous studies of pneumococcal and influenza vaccination 7 did not include physician recommendations as a variable; our findings show the same trend. PX can also be improved by the actions of a single physician, for example, by taking sufficient time to talk about the patient’s concerns. However, PX is improved to a greater extent through multidisciplinary and multi-departmental activities to enhance the quality of the entire healthcare organization than action at the individual level.24,25 To improve vaccination coverage and disease prevention behavior, it is not enough for each physician to be patient-centered. It is more important for multiple professions to work together to improve PX.
The study revealed that physician recommendations strongly influence vaccination behavior. This is consistent with previous findings about influenza vaccination 5 and a study showing that healthcare providers were the most trusted source of information about vaccination. 26 Although professional advice has been reported to be a significant factor in behavior change, 27 it is also possible that the halo effect 28 might influence the information provided by the physician. For the less well-known VZV vaccine, it is particularly likely that the information was first provided in a physician’s recommendation. Thus, it is possible that physician recommendation was a stronger factor for VZV vaccination than for other, more widely recognized vaccines.
The findings of this study, which showed that patients who rate the quality of their primary care highly are more likely to be vaccinated when their physicians recommend vaccines, are novel. A good doctor-patient relationship was reported to be associated with the success or failure of behavior change. 29 However, preventive interventions by primary care physicians were not always sufficient. 30 Evidence-based suggestions by individual physicians for vaccine-preventable diseases, along with daily activities to increase PX, might increase vaccination coverage, especially for vaccines that are not well recognized, such as the VZV vaccine.31,32 Considering that the COVID-19 vaccine and other new vaccines and evidence about them will continue to be developed, it will become even more necessary to promote actions to improve the quality of primary care and the dissemination of correct vaccine knowledge in the future.
One limitation of this study is that it was conducted at a single, small facility, and at a hospital with only a few physicians, which might have reflected the strong influence of specific physicians. As expected, the response rate for the questionnaires in the non-vaccinated group was low. Therefore, there is a possibility of bias in the results. Although there were 29 missing values for JPCAT-SF, we excluded them as part of a missing available-case analysis because JPCAT-SF was the most important factor in this study. This exclusion might have caused selection bias.
In addition, due to the study design, this study measured PX after VZV vaccination. PX, which covers a range of time, scores events experienced in primary care in the period prior to the time of measurement, so it is likely that events prior to VZV vaccination were assessed. However, it also reflects events experienced in primary care after VZV vaccination. Since there was a period of up to 3 years between VZV vaccination and the self-administered questionnaire survey, PX might have changed during that period. However, since there were no significant changes in physicians or hospital systems during this period, the impact of this change would be negligible. This study alone is insufficient to verify whether PX contributes to VZV vaccination. Further research is needed.
Furthermore, since the study used a self-administered questionnaire for elderly study participants, it is possible that the responses might differ from actual results due to recall bias or other factors. Elderly patients with cognitive decline who could not respond to the self-administered questionnaire were excluded from the study, but it is possible that patients with mild dementia were included. Since there was a period of up to 3 years between VZV vaccination and the self-administered questionnaire survey, it is possible that the respondents might have forgotten details such as whether or not their physicians had recommended the vaccine. Vaccination histories for influenza and pneumococcal vaccines were extracted from electronic medical records, but the date might have been incomplete because it is possible that vaccines given at other hospitals were not recorded.
As mentioned above, the survey was conducted in an environment where the VZV vaccine was widely publicized. The survey results might reflect a high level of awareness of the VZV vaccine compared with the general clinical setting in Japan today. However, since awareness of the VZV vaccine has been gradually increasing in Japan as a whole since the survey, the overall situation in Japan is expected to become closer to the setting of this study.
Conclusion
An association was found between PX measured after VZV vaccination and its vaccination. Physician recommendation for VZV vaccination is an intermediate factor between PX and VZV vaccination. A recommendation from a physician for VZV vaccination based on better PX is very useful for promoting VZV vaccination among the elderly.
Footnotes
Acknowledgements
Declaration of Conflicting Interests
The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding
The author(s) received no financial support for the research, authorship, and/or publication of this article.
Ethical Approval
This study was approved by the Ethics Committee of the Faculty of Medicine, University of Tsukuba (approval no. 1652). Study participants provided written informed consent.
