Abstract
The COVID-19 pandemic led to rapid expansion of telemedicine services. We surveyed parent/guardians from March 10 to June 29, 2020, in an academic and community pediatric practice, and community pediatric providers from June 5 to July 13, 2020, to better understand their perceptions of telemedicine and compare parent/guardian satisfaction between in-person and telemedicine encounters. Overall patient satisfaction scores were high in both settings and did not differ between in-person and telemedicine visits (community setting: 93.36 ± 12.87 in-person vs. 88.04 ± 22.04 telemedicine; academic setting: 92.25 ± 11.2 vs. 95.37 ± 8.21). Most providers (82.5%) would be willing to use telemedicine in a nonpandemic situation. Telemedicine should remain available for primary care pediatrics during and after resolution of the pandemic.
Introduction
The COVID-19 pandemic led to rapid expansion of telemedicine services. We sought to understand parent/guardian (hereafter referred to as parents) and provider perceptions of telemedicine and compare parent satisfaction between in-person and telemedicine encounters. We hypothesized that parents and providers would be satisfied with telemedicine.
Methods
We used electronic surveys (distributed using REDCap, Vanderbilt University) to assess parent satisfaction at community and academic pediatric practices in middle Tennessee for encounters between March 10 and June 29, 2020. At one community pediatric practice with eight sites, we used a modified version of the Hospital Consumer Assessment of Healthcare Providers and Systems Survey. 1 We modified the survey language for use in the outpatient setting and only included questions relevant to outpatient visits.
At three pediatric primary care clinics and one adolescent clinic at Vanderbilt Children's Hospital, a tertiary care teaching hospital, we collected data from Press-Ganey® surveys, 2 which are automatically distributed to all patients seen at this academic medical center. These clinics at Vanderbilt Children's Hospital are referred to as the “academic setting.” While all respondents provided a visit satisfaction score, they were not forced to complete all questions of the Press-Ganey survey.
Electronic provider surveys were sent to community providers from June 5 to July 13, 2020. All respondents had patient visits both in-person and using telemedicine. Provider surveys were not done at the academic practice.
Chi-squared and Student's t-tests were used to compare responses by visit type. The study was approved by the Vanderbilt University Institutional Review Board, and a waiver of consent for study participation in surveys was granted.
Results
Parent surveys
In the community practice, 2800 surveys were sent to parents during the study period (1475 [52.68%] in-person and 1325 [47.32%] telemedicine); 150 (5.36%) parents responded. The distribution of visit types among survey respondents was 127 (84.67%) in-person visits and 23 (15.33%) telemedicine visits. Compared with children with telemedicine encounters, more children with in-person visits were younger than 4 years (4 [17.39%] vs. 79 [62.2%], p < 0.001) and more had parents younger than 25 years (2 [8.7%] vs. 24 [18.9%], p = 0.001; Table 1).
Results of Parent Satisfaction Surveys
SD, standard deviation.
Overall visit satisfaction scores were high and did not differ by encounter type (93.36 ± 12.87 in-person vs. 88.04 ± 22.04 telemedicine, p = 0.12) or whether an antibiotic was prescribed (in-person visits with antibiotic 93.42 ± 21.58 vs. without antibiotic 93.35 ± 11.73, p = 0.99; telemedicine with antibiotic 94 ± 2.83 vs. 87.5 ± 23.08, p = 0.7; Table 1). The majority (22, 95.65%) of the 23 telemedicine respondents strongly agreed or agreed that a telemedicine visit was as effective as an in-person visit, and 19 (82.61%) would utilize telemedicine in the future.
In the academic setting, 14,610 visits (12,796 in-person and 1814 telemedicine) occurred during the study period and 3622 patient surveys were completed (24.79% response rate). Satisfaction scores were high and were similar for in-person (92.25 ± 11.2) and telemedicine visits (95.37 ± 8.21; Table 1). Data collected in the academic setting did not allow linkage of antibiotic prescribing with patient satisfaction scores.
Provider surveys
The online survey was completed by 40/75 (53%) community providers. Almost all providers (39, 97.5%) felt that telemedicine increased patient access to care (Table 2). Most (28, 70%) felt that they were less likely to prescribe antibiotics in a telemedicine encounter than in an in-person encounter (Table 2). The top concern with using telemedicine was the fear of incomplete patient assessment (Table 2). Most (33, 82.5%) would be willing to use telemedicine in nonpandemic situations.
Results of Provider Satisfaction Surveys Among Community Pediatricians
Discussion
In this evaluation of community and academic pediatric primary care practices during the COVID-19 pandemic, parent satisfaction scores were high and similar for telemedicine and in-person encounters. Community providers were also very satisfied with telemedicine and felt it increased patient access to care.
Parent satisfaction scores did not differ between visits with or without an antibiotic prescription. This finding differs from prior studies showing that higher antibiotic prescribing rates are associated with better patient satisfaction scores.3–5 In our study, providers felt they would not prescribe more antibiotics during telemedicine versus in-person visits, in contrast to prior studies.3–5 This difference may be because our study involved primary care providers, while other studies involved telemedicine providers who lacked preexisting relationships with patients. Of note, only two telemedicine visits in our study had an antibiotic prescribed.
Patients seen in-person were younger and had younger parents than those with telemedicine encounters. This was likely because providers were more vigilant about the need to assess younger children in-person and perform thorough physical examinations. We do not anticipate that age of parent or child would be a confounder to satisfaction scores. In addition, insurance coverage should not bias our results as most insurance companies covered telemedicine and in-person visits equally during the COVID-19 pandemic.
Our study has limitations. Our response rates were low and may have led to sampling bias. However, we surveyed patients from both community and academic practices, which may increase generalizability. We used two different surveys in the two study settings, which limits direct comparison of responses. We do not have data regarding reason for patient presentation, which may be a confounder for preference of visit type.
Many more of the patient survey respondents were seen in in-patient visits than were seen in telemedicine visits, which may introduce bias. We were not able to link provider perceptions of prescribing behavior with actual antibiotic prescriptions. In the academic setting, we did not assess clinician satisfaction or link patient satisfaction with antibiotic prescribing, which are areas for future research.
Despite these limitations, we observed that patients from community and academic pediatric settings and community-based pediatricians have had positive experiences with telemedicine during the COVID-19 pandemic. Telemedicine should remain available for primary care pediatrics during and after resolution of the pandemic.
Authorship Contribution Statement
S.E.K. conceptualized and designed the study, analyzed the data, drafted the initial article, and reviewed and revised the article. P.S. conceptualized and designed the study, designed the data collection instruments, coordinated and supervised data collection, and reviewed and revised the article. S.E.K. and L.H. conceptualized and designed the study and reviewed and revised the article. J.K. supervised data collection and reviewed and revised the article. R.B. conceptualized and designed the study and critically reviewed the article for important intellectual content. All authors approved the final article as submitted and agree to be accountable for all aspects of the work.
Footnotes
Acknowledgments
We thank the patients and providers who participated in the surveys for this study.
Author Disclosure Statement
The authors have no conflicts of interest relevant to this article to disclose.
Funding Information
S.E.K. received grant support from the Centers for Disease Control and Prevention as a recipient of the Leadership in Epidemiology, Antimicrobial Stewardship and Public Health fellowship, sponsored by the Society for Healthcare Epidemiology of America, Infectious Diseases Society of America and Pediatric Infectious Diseases Society. S.E.K and R.B. received funding for this study from the Tennessee Department of Health.