Abstract
The COVID-19 pandemic compelled rapid healthcare adaptations including increased use of telehealth (TH) and virtual care (VC) to provide rehabilitation services. This multi-site cross-sectional survey study examined rehabilitation patients’ and providers’ experiences with service delivery during the COVID-19 pandemic, including the use of TH/VC. Patients and providers who received or provided rehabilitation services were recruited from 1 of 3 large, post-acute rehabilitation systems located in the Southeastern and Midwestern United States during the COVID-19 pandemic. Participants rated personal satisfaction with rehabilitation services received or rendered during the pandemic and willingness to use TH/VC in the future. Questions also addressed accessibility, ease of use, and perceived barriers to TH/VC use. The adoption and personal satisfaction of TH/VC for rehabilitation care varied between patients and providers. Patients reported higher levels of satisfaction compared to providers (P < .001). Patients who did not use TH/VC had higher satisfaction than those who did (P < .05). Patients were less willing than providers to use TH/VC (P < .001). Those who used TH/VC prior to the pandemic were more willing to use post-pandemic (P < .001). Patients reported TH/VC was useful in increasing health services accessibility yet were neutral as to the ability of TH/VC to improve outcomes. Patients and providers agreed that TH/VC was easy to learn and use. Medical providers found TH/VC more useful than therapy providers. Participants who used TH/VC during the pandemic are more willing to use the service again in the future. Understanding patient and provider preferences and perspectives is key to the continued use of TH/VC in rehabilitation care.
Previous research highlighted potential benefits of using telehealth services (eg, greater accessibility, cost-savings, comparable outcomes) compared to traditional in-clinic rehabilitation care; however, studies were often limited to specific diagnoses, a single healthcare organization, or limited disciplines.
This work provides a more comprehensive study of rehabilitation experiences and future willingness to use telehealth / virtual care by patients and providers who did and did not use telehealth / virtual care during the pandemic. Barriers to use are discussed.
Given findings, rehabilitation providers may want to consider a mixed-delivery system incorporating in-clinic and TH/VC patient care visits and the use of a stratification model to identify patients who would benefit most from TH/VC services.
Introduction
The onset of the COVID-19 pandemic prompted a dramatic shift in delivery of healthcare from traditional in-person visits to telehealth (TH) and virtual care (VC) services. 1 To enable continuity of patient care and maintain physical distancing practices, the use of TH/VC increased substantially throughout the healthcare industry.2 -5 In the United States, the Coronavirus Preparedness and Response Supplemental Appropriations Act and Section 1135 waiver allowed beneficiaries to receive services through telehealth, including those rendered by a rehabilitation provider. 6 As the Centers for Medicare and Medicaid Services (CMS) announced these modifications, other carriers followed suit paving the way for TH/VC expansion in all areas.
Despite evidence regarding the benefits of access, cost savings and comparable outcomes to in-clinic care,7 -12 TH/VC services struggled to gain a foothold in rehabilitation prior to the pandemic. Restrictions in local regulations and reimbursement policies of both CMS and commercial insurance carriers hindered the adoption of TH/VC services in the United States. 13 Technical and equipment limitations, implementation costs, and patient and provider acceptance have also been identified as challenges in the telerehabilitation literature.14 -18 As actual and perceived barriers were rapidly overcome to meet care needs during the pandemic, TH/VC services in rehabilitation widely expanded.
In general, patients and providers are satisfied with TH/VC healthcare.19,20 Literature from the rehabilitation perspective, however, are scarce and tend to be limited to specific diagnoses or to single health care organizations.8,21 Pre-COVID literature does speak to satisfaction in regard to decreased travel and increased communication. 19 There is also evidence of positive outcomes in select cases with “virtual physical therapy.”20,21 Data from recent literature supports positive patient and provider experiences with TH/VC during the pandemic,1,22 -24 though preference for in-person visits has been observed for both populations.23,25
As physical distancing restrictions have lifted 26 and clinic visits have rebounded, 27 the future of TH/VC in rehabilitation is in question. The TH/VC modality, however, affords rehabilitation providers the flexibility to provide quality care when in-person services are not the best option for a patient. A comprehensive understanding of patient and provider satisfaction coupled with the evaluation of barriers to TH/VC during the pandemic provide valuable insights into best practices for TH/VC use in the future.
Objectives
To assess patients’ and providers’ levels of personal satisfaction, we designed a cross-sectional survey that captured the experiences of participants who did and did not use TH/VC during the pandemic. Our objectives were to (1) assess patient and provider satisfaction with rehabilitation care during the COVID-19 pandemic; (2) compare the rehabilitation experiences and willingness to use TH/VC in the future of patients and providers who did and did not use TH/VC services during the pandemic; and (3) identify factors influencing TH/VC acceptance among rehabilitation patients and providers.
Methods
Sample Population
Participants in this cross-sectional survey study included adult patients and healthcare providers who received or provided inpatient or outpatient rehabilitation services in 1 of 3 large, post-acute rehabilitation systems located in the Southeastern and Midwestern United States during the COVID-19 pandemic (March 11th, 2020 to September 30th, 2020). Each institution invited participation via an email containing a link to the anonymous survey from their respective patients and providers who satisfied the above criteria. Participants consented to study participation via the link before completing the survey. The study protocol was approved by the Advarra IRB (Pro00044614).
Survey Design
The survey was specifically designed to achieve the objectives of this study. The research team reviewed existing surveys related to TH/VC, technology acceptance, and patient satisfaction as well as consulted with clinical and administrative leaders from participating sites to develop and refine questions. Two separate but similar versions of the survey were developed, one for patients and one for providers. Logic rules were embedded in each version to customize question wording based on use or non-use of TH/VC during the pandemic as indicated by participants’ response to an introductory question. All survey versions were structured into the following sections:
Participant characteristics
The survey asked about participant demographics, use of TH/VC during the COVID-19 pandemic, use of TH/VC prior to the pandemic, and use of internet-based communication. Provider participants also identified their discipline and if they had ever used TH/VC as a patient.
Satisfaction
Participants rated their level of agreement (0 = completely disagree, 100 = completely agree) to their personal satisfaction with rehabilitation services received (patients) or rendered (providers) during the pandemic. Patient participants who used TH/VC to receive rehabilitation services were asked about their satisfaction with TH/VC services. Patients who did not use TH/VC were asked if they thought they would be as satisfied using TH/VC for rehabilitation services as they would be with in-person visits. Providers who rendered services using TH/VC were asked if they were equally satisfied using TH/VC as compared to traditional in-person visits, while providers who did not use TH/VC were asked if they thought they would be equally satisfied using TH/VC.
Future use of TH/VC for rehabilitation
All participants were asked to rate their level of agreement (0 = completely disagree, 100 = completely agree) with a statement indicating willingness to use TH/VC in the future once COVID-19 is no longer a threat to receiving in-person rehabilitation care.
Technology acceptance
Patients and providers who used TH/VC during the pandemic rated their level of agreement with statements indicating enhanced quality, enhanced efficiency, and improved outcomes associated with the use of TH/VC. 28 Patient TH/VC users were also asked about increased health services accessibility while providers were asked about the validity of information and enhanced clinical decision-making associated with use of TH/VC. Patient and provider TH/VC users were asked about the ease of learning to use TH/VC.
Challenges to TH/VC
All participants were asked to select experienced or expected barriers to the use of TH/VC. Participants could select more than one barrier.
Analysis
Participant characteristics and history of telehealth use were summarized using descriptive statistics for the survey respondents overall and for each of the 4 analysis groups: (1) patients with telehealth use, (2) patients without telehealth use, (3) providers with telehealth use, and (4) providers without telehealth use. Group assignment was based on responses to two introductory questions regarding status as a patient or provider and use of TH/VC. Group differences between telehealth users and telehealth non-users were assessed for both patients and providers using independent t-tests for continuous variables and Chi-square tests for categorical variables. Satisfaction questions were tested for normality using the Shapiro-Wilk test and the Mann-Whitney U test was used to examine group differences between telehealth users and non-users and between patients and providers. Participants’ decision to respond to each survey item was voluntary. Data were analyzed using IBM SPSS (version 26).
Results
Participants
Survey responses were received from 877 participants of whom 608 (69.3%) were eligible and contained sufficient data for inclusion in the analysis. Of the 441 patients and 167 rehabilitation providers included in the final analysis (Table 1), respondents were primarily female (55.9%) and White (76.3%). Patient responders were significantly (P < .001) older than provider respondents with a mean age of 46.1 years (SD 11.6) and 30.6 years (SD 9.3) respectively. Due to relatively small counts for some professions, provider data were aggregated into 2 groups: medical (n = 75, 44.9%) including physician, physician assistant, nurse practitioner, nurse, nursing assistant, and psychologist, and therapy (n = 92, 55.1%) including occupational therapist, physical therapist, speech language pathologist, occupational therapist assistant, physical therapist assistant, and other. Physical therapist represented the largest proportion of respondents across all groups.
Patient and Provider Characteristics by Group.
Note. Blanks represent questions not asked of the respective group.
TH/VC = telehealth/virtual care; PA = physician assistant; ARNP = nurse practitioner; CNA = nurse assistant; OT = occupational therapist; PT = physical therapist; SLP = speech language pathologist; COTA = occupational therapist assistant; PTA = physical therapist assistant.
P < .05.
Telehealth/Virtual Care Utilization
Prior to the COVID-19 pandemic, only 69 (11.3%) of the respondents had experience using TH/VC while 258 (42.4%) used TH/VC during the pandemic (Table 1). Patient respondents who were younger, White, and used TH/VC prior to the pandemic were significantly (P < .05) more likely to use TH/VC during the pandemic compared to their older, non-white, and no prior TH/VC use counterparts. For providers, only pre-pandemic TH/VC use as a provider or as a patient had a significant (P < .05) and positive association with TH/VC use during the pandemic. Neither gender nor frequency of internet-based telecommunications use was associated with TH/VC use during the pandemic for patients or providers.
Satisfaction
Personal satisfaction with services
Regardless of TH/VC use, patients reported significantly greater satisfaction with the rehabilitation services received during the COVID-19 pandemic as compared to providers’ reported satisfaction with the services they provided (P < .001); Table 2). Within-group comparisons demonstrated higher satisfaction among patients who did not use TH/VC compared to those who did (P < .05), while satisfaction among providers who did and did not use TH/VC during the pandemic did not differ significantly.
Comparison of Patient and Provider TH/VC Users Versus Non-TH/VC Users.
Note. Blanks represent questions not asked of the respective group; TH/VC = telehealth/virtual care. *P < .05.
Personal satisfaction with TH/VC
Patients who used TH/VC during the pandemic reported a generally positive experience with receiving rehabilitation services through this delivery mode [mean = 75.7 (SD 39.7); median = 93]. In comparison, patients who did not use TH/VC reported a low expectation for being equally satisfied using TH/VC versus in-person services [mean = 21.4 (SD 27.9); median = 10]. Providers who used TH/VC during the pandemic reported a significantly higher level of equal satisfaction for TH/VC versus traditional in-person care compared to the perceived level of equal satisfaction for TH/VC versus traditional in-person care reported by providers who did not use TH/VC (P < .001).
Future Telehealth/Virtual Care Use
Patients reported significantly less willingness to use TH/VC post-pandemic as compared to providers (P < .001; Table 2). Within-group comparisons show a similar pattern for both patients and providers, with those who used TH/VC during the pandemic being significantly more willing to use TH/VC post-pandemic (P < .001).
Technology Acceptance
Usefulness
Patient TH/VC users had the highest level of agreement that TH/VC was useful for increasing health services accessibility [mean = 72.2 (SD 34.5); median = 88] followed by enhancing the efficiency of care [mean = 58.5 (SD 35.6); median = 66]. Patient users were relatively neutral about the ability of TH/VC to improve outcomes (such as ability to improve daily activities) [mean = 44.9 (SD 35.0); median = 50]) and tended toward disagreement that TH/VC enhanced the quality of health care [mean = 38.9 (SD 33.2); median = 40]. Provider TH/VC users only indicated agreement that TH/VC provided valid information about patients [mean = 65.2 (SD 26.5); median = 70]. The TH/VC providers were neutral about TH/VC’s ability to enhance patient monitoring [mean = 50.1 (SD 30.4); median = 50] and improve outcomes [mean = 44.3 (SD 30.0); median = 50.0]. Providers tended toward disagreement that TH/VC enhanced quality [mean = 41.5 (SD 30.9); median = 40.0], efficiency [mean = 44.0 (SD 30.6); median = 42.5], and clinical decision-making [mean = 44.6 (SD 29.2); median = 45.0]. Medical rehabilitation providers who used TH/VC reported higher levels of agreement for all technology usefulness questions when compared to therapy rehabilitation who also used TH/VC (Table 3).
Comparison of TH/VC Users by Patient and Provider Type.
Note. Blanks represent questions not asked of the respective group; TH/VC = telehealth/virtual care; Neurological = stroke, spinal cord injury, concussion, traumatic brain injury, other neurologic condition; Musculoskeletal = musculoskeletal, post-surgical orthopedic, chronic pain, amputee; Other = other, oncology; Medical = nurse, nurse practitioner, certified nursing assistant, physician, physician assistant, and psychologist; Non-medical = occupational therapist, physical therapists, occupational and physical therapists assistants, speech language pathologists, and other non-medical providers (eg, recreational therapists). *P < .05; **P < .001.
Ease of use
There was general agreement that TH/VC was easy to learn by both patient TH/VC users [mean = 73.1 (SD 32.8); median = 90.0] and provider TH/VC users [mean = 74.2 (SD 27.9); median = 80.0]. Patient users agreed that TH/VC was easy to use independently [mean = 69.3 (SD 35.7); median = 90.0] while provider users agreed that TH/VC was easy to include as part of patient care [mean = 69.3 (SD 28.6); median = 80.0]. Medical providers reported greater agreement that TH/VC was easy to use as a part of patient care [mean = 80.7 (SD 22.8); median = 87.0] compared to TH/VC therapy providers ([mean = 37.6 (SD 24.9); median = 40.0]. Providers also agreed that TH/VC was easy to explain to patients [mean = 68.2 (SD 28.6); 74.0].
Barriers to Telehealth/Virtual Care Use
Patients who did not use TH/VC most frequently reported lack of interest (52.3%) as a barrier to using TH/VC, whereas lack of knowledge (43.3%) and lack of reimbursement (31.3%) were most frequently reported among providers who did not use TH/VC (Table 4).
Barriers to Telehealth/Virtual Care by Group.
Note. Blanks represent questions not asked of the respective group.
MSK = musculoskeletal.
P < .05.
Discussion
As the nation’s healthcare system responded to the realities of COVID-19, providers sought effective strategies to meet the ongoing needs of individuals rehabilitating from injuries, illnesses and surgeries. TH/VC offered an opportunity for patients to receive care from rehabilitation professionals while mitigating the risk of exposure to COVID-19. The aim of this multi-site cross-sectional study was to assess the experiences of rehabilitation patients and providers who did and did not use TH/VC during the pandemic with a goal of identifying factors that should be addressed to promote greater success using TH/VC in the future.
In this survey, the percentage of patients receiving rehabilitation care via TH/VC increased 4-fold during the pandemic. Despite this substantial increase, nearly 65% reported no TH/VC use at the time of the study. Patients who did not use TH/VC were older and had less experience with telerehabilitation compared to the adopter group. Lower telehealth use among older adults has been described previously,29,30 and may be attributable to a lesser familiarity with telehealth technology.31 -33 Relatedly, we found lack of interest to be an important barrier to TH/VC use for a majority of the non-adopter group. A recent study evaluating the success of home telehealth visits among older adults discussed the difficulty recruiting uninterested patients, despite their access to and confidence in the technology. 34 These results speak to the importance of motivational engagement strategies when implementing telehealth initiatives, which have shown some success. 31 With regard to future use, patients who utilized TH/VC services during the pandemic reported greater willingness to use TH/VC again post-pandemic when compared to their non-TH/VC counterparts. These results align with data from a national assessment of post-pandemic telehealth preferences for general healthcare. 25 With regard to post-acute rehabilitation, it is unknown if exposure to and training in telerehabilitation while in an inpatient care setting (eg, inpatient rehabilitation hospital or skilled nursing facility) affects the likelihood of patient adoption of TH/VC upon returning home. Future research should examine the extent to which telerehabilitation exposure acts as a catalyst to further use and should consider the possibility of self-selection bias with predisposed individuals opting to use telehealth technology.
Overall, the patients in our study were satisfied with the rehabilitation care they received during the pandemic, regardless of their use of TC/VC services. Similar findings have been reported for patients receiving rehabilitation therapy in the Northeastern United States.22,35 The achievement of positive patient satisfaction, despite obstacles brought on by the pandemic is testament to the resilient efforts of healthcare providers. 36 Although generally satisfied, the TH/VC adopters reported lower satisfaction with their rehabilitation care compared to non-adopters. These findings are contrary to a recent study where no difference in satisfaction was observed for patients receiving physical therapy in-person or through video visits. 22 Inconsistent results between these studies may be explained by the broader rehabilitation services explored in our study, differing telehealth acceptance by geographical location, or potentially by a difference in sensitivity of the rating scales used to measure satisfaction. 37 Lower satisfaction with care among the TH/VC adopters in our study may reflect preference for traditional in-person visits, especially as a majority of the TH/VC adopters were satisfied with their TH/VC services and reported the technology to be easy to learn. Patient preference for in-clinic care has been discussed previously.23,25 In-person therapy provides an opportunity for specified, personal treatment by rehabilitation providers and for patients to connect with others at similar points in their recovery.
Similar to patients, few participating providers utilized rehabilitation care through a TH/VC modality prior to the pandemic. This limited usage is likely due in large part to reimbursement regulations excluding telerehabilitation. 13 Despite payment coverage during the pandemic, the lack of reimbursement was reported among providers as a barrier to TH/VC utilization. This perceived rather than actual barrier suggests the lack of awareness to current payment policies among providers. Our results are consistent with data from the American Physical Therapy Association (APTA) where a majority of physical therapists reported being unsure about which insurance carriers were reimbursing TH/VC and their rates of reimbursement during the pandemic. 5 Such uncertainty narrows options for providers to select the best service modality for their patients. Future use of TH/VC in rehabilitation is unclear, but will be dependent upon telehealth regulation to incorporate TH/VC and efforts to raise awareness regarding TH/VC reimbursement coverage.
Regardless of care modality, providers’ satisfaction with care rendered was considerably lower than that of patients’ satisfaction for care received. These findings are not surprising considering the strain on healthcare providers during the pandemic. The ability to deliver high quality patient care was impacted by a multitude of factors, such as staffing shortages, limited personal protective equipment, and the potential for exposure to the virus while in-clinic. 38 As telerehabilitation alleviated many of these challenges, a majority of the providers incorporated TH/VC into their practice at the time of the study. Medical rehabilitation providers more readily adopted TH/VC than did therapists. Medical providers who utilized TH/VC reported greater agreement to the usefulness and ease of use in patient care when compared to the therapy providers. Due to the nature of therapy relying heavily on direct, hands-on patient care, TH/VC use may have been more challenging for therapists than for physicians and nurses. These results align with a qualitative assessment of barriers to telerehabilitation implementation where therapists, chiropractors and kinesiologists were hesitant to adopt telerehabilitation due to difficulty translating manual therapies into telerehabilitation. 14 Despite barriers related to therapeutic relationships, providers in this study reported obtaining valid patient information while using TH/VC, and most would likely continue TH/VC use in the future. A systematic review of the physical examination components adapted for telemedicine conducted by Lu et al. found that virtual assessments yielded comparable results to in-person physical examinations across various clinical domains, including musculoskeletal examinations. 39
A mixed-delivery system is an option that could allow providers to transition to increased use of TH/VC moving forward. Initial comprehensive evaluations could be completed in-person with follow-up care delivered through TH/VC. In addition, rehabilitation systems may consider the following three strategies to encourage directed TH/VC use among therapy providers: (1) actively stratifying patients (e.g., based on patient interest and factors indicating limited health services accessibility, such as living in rural areas, limited transportation, and/or mobility impairments that make travel difficult) to facilitate identification of patients most likely to benefit from TH/VC services; (2) incorporating therapy-specific accommodations to improve patient-provider interaction through TH/VC. Such provisions may include provider access to a high-quality video-conference device (shown to be a barrier among providers in our study) to capture whole body movement and modifications to at-home therapy equipment to facilitate TH/VC interaction; and (3) providing current and accurate information on telerehabilitation policy and reimbursement to alleviate confusion in a changing telehealth regulatory landscape.
Study Limitations
This study has some limitations. The survey was developed for this study and has not been tested for reliability or validity. In addition, an a priori power analysis was not performed due to unknown accuracy of patient contact information, provider turnover, and unknown number of deceased patients. The survey was administered at the peak of the COVID-19 pandemic when physical distancing was mandated. TH/VC adoption and personal satisfaction may be considerably different under post-pandemic circumstances. Although this work was completed through three participating sites throughout the US, survey completion was lower than expected. Low response rates, especially among providers, may be attributable to the nature of the pandemic and the fluidity of resources and personnel to accommodate changes in patient census. Given the geographic location of participating rehabilitation sites, minority and vulnerable populations may not be comparably represented based on the population as a whole. As this was a survey study and TH/VC services were not confirmed through EMR records, misclassification based on self-report could introduce bias.
Conclusions
This multi-site survey study examined TH/VC use and personal satisfaction of rehabilitation patients and providers during the COVID-19 pandemic. Providers adopted the use of TH/VC more readily than patients. Regardless of care modality, patients reported greater satisfaction with the care they received than providers did with the care they rendered. However, patients with in-clinic services had higher satisfaction than those using TH/VC. Medical rehabilitation providers adopted TH/VC technology and found it easier to use than did therapy providers. Patients and providers who used TH/VC during the pandemic reported being more likely to use TH/VC in the future when compared to non-adopters. Rehabilitation providers may consider a mixed-delivery system incorporating in-clinic and TH/VC patient care visits and the use of a stratification model to identify patients who would benefit most from TH/VC services.
Supplemental Material
sj-docx-1-inq-10.1177_00469580231222334 – Supplemental material for Virtual Rehabilitation and COVID-19: Varied Adoption and Satisfaction Among Patients and Providers Participating in a Multi-Site Survey Study
Supplemental material, sj-docx-1-inq-10.1177_00469580231222334 for Virtual Rehabilitation and COVID-19: Varied Adoption and Satisfaction Among Patients and Providers Participating in a Multi-Site Survey Study by Mindi R. Manes, Judith M. Burnfield, Kelsey Boersma, Jason Peoples, Anita Davis, Jason M. Beneciuk, Joel Bialosky, Katelyn Jordan and Raine Osborne in INQUIRY: The Journal of Health Care Organization, Provision, and Financing
Supplemental Material
sj-docx-2-inq-10.1177_00469580231222334 – Supplemental material for Virtual Rehabilitation and COVID-19: Varied Adoption and Satisfaction Among Patients and Providers Participating in a Multi-Site Survey Study
Supplemental material, sj-docx-2-inq-10.1177_00469580231222334 for Virtual Rehabilitation and COVID-19: Varied Adoption and Satisfaction Among Patients and Providers Participating in a Multi-Site Survey Study by Mindi R. Manes, Judith M. Burnfield, Kelsey Boersma, Jason Peoples, Anita Davis, Jason M. Beneciuk, Joel Bialosky, Katelyn Jordan and Raine Osborne in INQUIRY: The Journal of Health Care Organization, Provision, and Financing
Footnotes
Authors’ Note
Material Presentation: Burnfield, J., Boersma, K., Peoples, J., Manes, M.R., Osborne, R. “Virtual Rehabilitation and COVID-19: A multi-site survey of patients’ and providers’ satisfaction with care during a pandemic.” Brooks Rehabilitation Research Connection Webinar: Recent and Ongoing Projects with Aligned Partners, Virtual, March, 2022.
Declaration of Conflicting Interests
The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding
The author(s) received no financial support for the research, authorship, and/or publication of this article.
Ethical Approval
Our study was reviewed and approved by the Advarra Institutional Review Board (Pro00044614).
Supplemental Material
Supplemental material for this article is available online.
References
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
