Sage Journals: Discover world-class research

Abstract

The COVID-19 pandemic in the US prompted a sudden shift to telehealth in nurse-led care sites which provide services to diverse geolocations. Using a lens of intersectionality, this study characterizes provider and patient-perceived best and promising practices emerging from geographical variation. The aim of this study was to identify best practices of implementing telehealth in nurse-led care models in Colorado through patient and provider experiences of the sudden implementation of telehealth that can enhance health equity. In this exploratory/descriptive qualitative study, a purposive sample of 18 providers and 30 patients were interviewed using a guide informed by the RE-AIM implementation and evaluation framework to capture the contextual experiences related to the sudden shift to telehealth. Textual theme analysis and reflexive team strategies guided the interpretation. Four primary themes of perceived best practices were identified: using multiple modalities, tailoring triage and scheduling, cultivating safety through boundaries and expectations, and differentiating established versus new patient relationships. The findings suggest that telehealth is a flexible and powerful tool to enhance the delivery of equitable care through nurse-led care models within diverse communities such as the one represented in this study. Nurse leaders are positioned to participate in innovative research and create policies and protocols to ensure telehealth is a viable resource to deliver equitable, safe, and accessible high-quality healthcare.

Keywords

telemedicine practice guidelines COVID-19 nurses qualitative research policy intersectional framework

Introduction

The COVID-19 pandemic created disruption across the globe in social, economic, and healthcare domains. To decrease exposure of SARS-CoV-2 among patients and the healthcare workforce, a sudden transition to care delivery via telehealth occurred in mid-March 2020 (Monaghesh & Hajizadeh, 2020). Prior to the COVID-19 pandemic, widespread adoption of telehealth in the United States had been constrained due to technological, financial, legal, and human resource issues (LeRouge & Garfield, 2013). However, policy changes from the federally funded Centers for Medicare and Medicaid Services supporting provider reimbursement for telehealth visits similar to office visits (Hong et al., 2020) facilitated a rapid shift to virtual care (Hollander & Carr, 2020). The rapid expansion of telehealth in response to COVID-19 created an opportunity to study the innovations and challenges encountered by patient and provider experiences that help characterize perceived best and promising practices to identify the ways in which telehealth may be best utilized to enhance health equity moving forward.

Background

A review of telehealth implementations before COVID-19 revealed telehealth to be equivalent to in-person care for a wide variety of chronic and behavioral health conditions, with the potential to improve access for rural residents or those with transportation issues (Shigekawa et al., 2018). However, in a national consumer survey, Park et al. (2018) noted that low-income respondents used live video communication less than other groups. While telehealth and remote monitoring have been highly effective in managing chronic disease conditions, a randomized controlled trial demonstrated that this modality had a lower impact and utilization among low-income, Black, and Hispanic patients (Pekmezaris et al., 2019). This variance creates concerns about the possibility of telehealth paradoxically widening the inequities among historically underserved populations. These include rural communities, older adults, racial and ethnic minorities, and those with low socioeconomic status, who have lower rates of smartphone ownership, home broadband access, internet use, and basic digital literacy (Lau et al., 2022; Nouri et al., 2020).

In the state of Colorado, innovative nurse-led models of care at the registered nurse and advanced practice registered nurse levels are a vital component of healthcare delivery for the most ethnically, geographically, and economically diverse populations. Three successful nurse-led healthcare delivery models have been established through federally qualified health centers (FQHC) (Weber et al., 2021), certified nurse-midwifery practices (CNM) (Nodine et al., 2020), and the Nurse-Family Partnership home visitation program (NFP) (Neal & Fixsen, 2020). These models in Colorado experienced a rapid shift to telehealth in response to legislative state actions addressed in bipartisan Senate bill 20-212, signed by Governor Polis on July 6, 2020 (State of Colorado, 2020). The American Academy of Nursing clearly articulated nurses’ expanded roles in pandemic response, recognizing their crucial role in care coordination, primary care, and strengthening the public health infrastructure (Corless et al., 2018).

According to Lewis and Latney (2002), best practices are used to continuously, collaboratively, and systematically examine the strengths and weaknesses of different internal procedures. Best practices for telehealth have been recommended by the Department of Health and Human Services to support its use in the management of chronic conditions, maternal health services, behavioral health services, and with patients in rural areas among others (Health Resources and Services Administration, n.d). While these guidelines outline equipment needed and suggest the types of visits that are best suited for telehealth, they fail to include patient and provider experience in the recommendations. Several studies have evaluated patient and provider experiences with telehealth both prior to and after the onset of the COVID-19 pandemic (Barney et al., 2020; Gomez et al., 2021; Khairat et al., 2023; Powell et al., 2017). Findings from these studies suggest that there are changes within the patient-provider interaction that yield satisfaction and improved access for some, and infrastructure challenges and increased barriers exist for others (Gomez et al., 2021; Khairat et al., 2023; Powell et al., 2017), while also raising concerns for health equity (Barney et al., 2020). Previous recommendations from the literature have included the need to clarify expectations for the type of care that may be provided via telehealth, to improve usability of this modality, to ensure confidentiality, and to limit provider burden of facilitating the visit. No studies included patient and provider perspectives from nurse-led facilities. The current study aimed to identify themes of best and promising practices as grounded in patient and provider experiences within geographically diverse nurse-led care settings to inform the delivery of high-quality, safe, accessible, and equitable care to ethnically and geographically diverse communities.

Conceptual Research Framework

A theoretical lens of intersectionality was adopted to conduct and analyze qualitative data from interviews situated within the complex interconnected health system during the COVID-19 pandemic. Intersectionality is “a way of understanding and analyzing complexity in the world, in people, and in human experiences” (Collins & Bilge, 2016, p. 2) by considering the diverse interconnected social, political, and organizational factors that influence power imbalances and inform health inequalities. By employing intersectionality to guide this qualitative research process (Abrams et al., 2020), the research team captured the lived and multifaceted experiences of people's use of telehealth within diverse ethnicities, social and economic positions, and geographical locations.

Methods

In this descriptive exploratory qualitative study conducted between March 2020 and May 2021, semi-structured interviews were completed with patients and providers in English and Spanish and analyzed using a general inductive approach with an emergent design. The study protocol was approved by the Colorado Multiple Institutional Review Board (COMIRB-20-1513).

Setting

Study participants were recruited from a larger study evaluating the impacts of the implementation of telehealth in five nurse-led care sites across rural and urban communities in Colorado during the COVID-19 pandemic (Barton et al., 2023). These sites provide care to close to 50,000 low-income, ethnically diverse Coloradans living in urban, rural, and frontier regions of the state within three innovative nurse-led models of care: (1) community-based primary care/behavioral health in three FQHC located in frontier, rural, and urban settings; (2) the NFP implemented statewide; (3) and two CNM practices serving urban and suburban communities. Each of these sites were provided a stipend to promote participation in the study through advertisements disseminated in patient and provider portals with an invitation to participate using a linked survey.

Sample

Eligible participants were those who either provided or received care at one of the sites during the study time frame, 12 years and older, and English or Spanish-speaking. Survey respondents who volunteered for an interview were recruited through phone and email. Although the initial response was high with approximately 70% of survey respondents volunteering, recruitment became difficult over time with rejections related to time limits, inability of researchers to reach the population after three attempts, and personal or professional challenges in an ongoing pandemic. While convenience sampling was initially used, maximum sample variation was also sought to ensure heterogeneity in terms of nurse-led model, age, gender, ethnicity, and geographic location. Concurrent data collection and analysis informed the final sample size through cross-site informational saturation.

Data Collection

Individual interviews were conducted via Zoom or telephone by study-trained nurse research assistants and qualitative research experts, each lasting 20–60 min. The researchers used a semi-structured interview guide (Table 1) informed by Reach, Efficacy, Adoption, Implementation and Maintenance (RE-AIM) framework domains (Holtrop et al., 2018) to identify experiential nuances of the implementation of telehealth. Key areas of prompted discussion with patients included access to services, perceptions about telehealth, barriers, and needs, while paying special consideration to context and social determinants of health (e.g., rurality, gender, income, and ethnicity). Healthcare providers were asked to describe their experiences which addressed key topics of acceptability, adoption, implementation, and sustainability of the telehealth environment. The interview guide was translated into Spanish and culturally tailored by a native-speaking researcher and iteratively revised across the interviews to probe emerging themes. Interviews were conducted in the participants’ preferred language with native English or Spanish speakers. Verbal consent was obtained from interview participants.

Table 1.

Interview Guide Summary Table.

Domain	Probes
Providers	Explore provider perspectives of patient care experiences before, during, and after the stay-at-home phase of the COVID-19 pandemic.
Accessibility	What was their perception of trust in the new system? (What, if any, gaps in care occurred as a result of the sudden shift and describe an example. How did the care model in your organization/practice shift? (Implementation factors) What was useful? How acceptably was the sudden shift to telehealth?
Adoption	What factors influenced the sudden shift to telehealth in your organization/practice? Probe roles, timing, communication, equipment, structures, processes, preparation, rurality, ethnicity What were some of the barriers? What challenges did you experience? What were some of the facilitators? What helped the sudden shift?
Implementation	If you had to do this sudden shift again, what would you do differently?
Sustainability and spread	How will you maintain telehealth in your organization/practice moving forward? What resources, people or processes will it take to sustain telehealth?
Patients	Explore patient care experiences before, during, and after the stay-at-home phase of the COVID-19 pandemic.
Accessibility	How was your access to care? What was useful? Describe specific examples from your personal experiences or decisions not to use?
Adoption	What lessons did you learn?
Implementation	If you had to do this sudden shift again, what would you do differently? What would you expect your health care providers to do differently?

Analysis

Theme analysis commenced with the first participant interview and preceded alongside subsequent data collection until informational saturation was met (Creswell & Poth, 2018). Zoom and telephone interviews were digitally recorded, and English transcripts were created using Zoom transcripts when available. These transcripts were reviewed and cleaned by the research team. Spanish interviews were professionally translated from recordings and curated by native-speaking team members. ATLAS.ti V9 qualitative data analysis software was used by the research team to assist with data storage, coding, and memoing (Paulus & Lester, 2021). All team members were involved in the process of coding, with one lead methodologist acting as project manager. First cycle descriptive and in-vivo codes were revisited on a regular basis to define, rename, combine, and create coding groups to avoid replication (Saldana, 2016). Themes were identified over time as the patterns of codes were explored in reference to the study aim and later deductively with an intersectionality lens.

The research team was intentional in using rigorous procedures and strategies to establish confidence in the findings of this study. A team-based iterative, inductive, and deductive toolkit of analytic strategies was used to address credibility, dependability, confirmability, transferability, and authenticity (Cope, 2014). These strategies included field notes, memoing, general theme analysis, consultative and reflexive analysis, participant validation, and participant and triangulation. To reduce the risk of bias, analytical diaries and weekly team meetings aided in reflexive engagement, reflecting upon emergent categories, and confirming that the emergent codes and identified themes were grounded in the data. Validity and transparency were addressed by staying close to the data as text through the use of participant quotations and ensuring the participants’ own meaning and perspectives were represented. The study was reported in line with the Consolidated Criteria for Reporting Qualitative Research checklist (Tong et al., 2007).

Results

Eighteen healthcare providers and 30 patients were included in the study from four geographically varied locations representing three nurse-led models of care (Table 2). The providers were represented by white Caucasian non-Hispanic English-speaking women who worked in urban (n = 13) and rural locations (n = 5). While the patient demographics were more diversified, they were 20 years or older, predominately represented female, white, non-Hispanics (n = 21). Ten percent of the patient participants were male, 17% were primary Spanish-speaking, and 28% identified as Hispanics. All participants either provided or received care in the telehealth environment during the sudden implementation of telehealth.

Table 2.

Participant Demographic Table.

		Count	Percentage (%)
Provider participants (n=18)
Nurse-led model	FQHC	7	40
	CNM	1	5
	NFP	10	55
Gender	Female	18	100
Age	20–29	1	5
	30–39	5	29
	40–49	6	33
	50–59	3	17
	>60	2	11
	Nondisclose	1	5
Geolocation	Urban	13	72
	Rural	5	28
Primary language	English	18	100
Race	White	18	100
Patient participants (n = 30)
Nurse-led model	FQHC	21	70
	CNM	3	10
	NFP	6	20
Gender	Female	27	90
	Male	3	10
Age	20–29	4	13
	30–39	6	20
	40–49	11	37
	50–59	0
	>60	9	30
Geolocation	Urban	12	40
	Rural	10	33
	Frontier	8	27
Primary language	English	25	83
	Spanish	5	17
Ethnicity	Hispanic	8	28
	Non-Hispanic	21	72
Race	White	21	73
	Black	3	10
	Nondisclose	5	17

Note: FQHC = federally qualified health centers, CNM = certified nurse-midwifery practices, NFP = Nurse–family partnership home visitation program.

Four themes were identified as related to evolving perceived best practices in telehealth: (1) using multiple modalities, (2) tailoring triage and scheduling, (3) cultivating safety through boundaries and expectations, and (4) differentiating established versus new patient relationships. While these themes converge and interconnect in aspects (Figure 1), they are unique in informing meaning within the data and shaping our emerging understanding of best and promising practices to deliver high-quality care within the boundaries of the technological environment to support ethnically, geographically, and economically diverse communities.

Figure 1.

Interconnection of Themes.

Using Multiple Modalities

The first theme describes the opportunities that telehealth introduced for healthcare providers to provide and maintain access to high-quality, safe, and accessible healthcare within diverse communities and the need for these providers to remain flexible when implementing modalities of telehealth. The modalities of delivering care mentioned in this study included live video, audio-only, chat and text, or traditional in-person. Several healthcare provider participants discussed how telehealth introduced new opportunities for healthcare delivery that were not present before the COVID-19 pandemic. Equitable access to mental health care was challenging before and during the pandemic. However, some of the mental healthcare provider participants shared stories of the opportunity to provide high-quality access to their patients through the telehealth modalities of videoconferencing and phone calls.

So, she (patient) was 16 then and I thought about telehealth is going to be a nightmare because I was having trouble connecting with her in real life. She's had severe mental health issues, you know, really depressed, it's just like this is gonna be really difficult. And she did better on telehealth. I mean she sat in her bedroom on her bed, and the baby is crawling around, and she like opened up. (Provider 1, Rural)

Telehealth experiences have heightened the awareness of existing technological infrastructure inequalities, especially in rural and frontier communities that often include ethnically and economically diverse populations. Several providers and patients who lived or worked in rural and frontier communities mentioned technological infrastructure issues to include the lack of dependable broadband access and cellphone service connection. These issues contributed to technological inequalities and required healthcare providers and patients to be flexible while utilizing various telehealth modalities. Multiple provider participants shared frustrating experiences related to technological inequalities and provided examples of how telehealth visits may start with a video platform and need to be switched to phone audio-only because of the lack of high-quality and uninterrupted live videos.

I have to figure out how we’re going to do this … remotely, what are we going to do, and so I would kind of formulate a procedure and then we try it in real life with a patient, and then we like, okay, so that didn't work as well, how can we adapt? There was also some learning as you go. (Provider 10-Urban)

Tailoring Clinical Triage and Scheduling

The second theme describes the complexities with providing safe clinical triage and scheduling nuances that the sudden shift to telehealth introduced to healthcare providers, healthcare team members, and patients. Often provider participants reported the need for established protocols to assist healthcare team members in matching the best patient to the best encounter modality. Provider and patient participants identified the need for patients to be informed and educated about telehealth before the encounter.

Because telehealth has both video and audio call, it gets confusing when telehealth is scheduled because you aren't sure which is being scheduled, from a provider's end. It's supposed to be a phone call, and not a Zoom, ya know, and we have to use up appointment time. I think using the word telehealth for two different things is confusing for the patient. (Patient 12-Frontier)

Several provider and patient participants shared experiences regarding the complexities of performing a thorough physical assessment within the telehealth environment. They also spoke about the need to be flexible with switching the patient encounter modality, from audio-only to video and from video to in-person to meet the physical assessment requirements. Several perinatal care nurses and certified nurse-midwife participants spoke about the concern with using telehealth for the physical evaluation of their higher risk populations, including subgroups of obstetric and pediatric patients who needed physical exams, radiologic imaging such as mammograms, and lab specimens obtained through blood, urine, or body tissue.

I think one other thing is this possibility of we're missing something when we're not examining the patient. I’ve been a midwife for (many) years … and you know that one minute of listening, hearing something that wasn’t quite right that needed emergent care. (Provider 15-Urban)

Multiple healthcare provider participants reported issues completing home safety assessments and evaluating new physical complaints within the telehealth environment through modalities that did not include live and dependable video interaction.

I think with any telehealth it is much better than the phone to see people physically, and even when there are obvious limitations, you get a better sense of like a postpartum mom, is she swollen, is (she) you know looking yuck? (Provider 15-Urban)

Yet, multiple patients and provider participants voiced their beliefs that several types of healthcare appointments were safely and adequately addressed clinically within the telehealth environment using either videos or phones. These included follow-up visits that address established low-risk health problems, refills and titrations of medications, and referrals to specialists for new or established low-risk and less complex medical concerns.

The format of telehealth helps you in a follow up visit because you had the physical appointment in person, where you were able to be assessed, start working on some solutions, but then you are able to follow up on the phone to think about what's the next step. (Patient 8-Frontier)

Cultivating Safety Through Boundaries and Expectations

The third theme describes the need for healthcare providers and teams to create procedures and protocols addressing the variables of environmental safety in the telehealth visit. Several nurse participants who provide in-home perinatal care spoke to the challenges of obtaining intimate partner violence assessments within the telehealth patient encounter.

What ways can we make sure that she's safe and that there's nobody else there to hear her answer these questions, or you know, is there someone in the room? (Provider 2-Rural)

Their identified challenges speak to the need for cultivating safety assessment protocols and communicating these protocols to all patients. Some provider participants shared their experiences with personal knowing, described as intuition. These participants told stories of knowing when a patient was not feeling comfortable or when someone else was in the room but not on camera. Yet these nurses were unsure how to proceed in the telehealth visit, ensuring the patient's safety and privacy.

You're doing an intimate partner violence assessment and you think no one is there and then you don't know who's walking into the home five minutes later, after you've made sure no one is there and you're still asking those questions. Something is going on; you know there's another conversation going on off screen. (Provider 3-Rural)

Confidentiality and privacy were common concerns of best practices that were raised by the provider participants, for which they included the physical environment of the patient and the technological environment where the telehealth encounter occurs. These providers spoke to the need to clarify boundaries with the patient regarding what, when, and how the virtual environment is considered confidential. Some of these participants suggested defining clear expectations that patients be in a private, confidential, distraction-free, and physically safe space during the telehealth encounter. They shared examples from their own experiences of activities that should not be included as confidential and physically safe. These activities include engaging in telehealth visits while shopping, in a public place, or driving. While guidelines and expectations were often suggested, these providers also recognized their role to maintain safety in the virtual space required flexibility by offering to pause, stop, or reschedule appointments.

I'll just say hey let's reschedule, this isn't a good time because you know, that's not really safe for you to be video chatting and driving. I'll just tell it like you know, I wanted to talk today, I don't know if you really want to talk about it when you're at the grocery store, so why don't we reschedule. (Provider 11-Rural)

Differentiating Established Versus New Patient Relationships

The fourth theme communicates the patient's experience of developing and maintaining trust and connection in established versus new relationships with their healthcare providers and healthcare team members through and within the telehealth virtual environment. Multiple patient participants expressed feelings of comfort, trust, and connection with their healthcare provider when the healthcare relationship was previously established in-person before the implementation of a telehealth encounter. Some patient participants shared their feelings of not being known, a lack of rapport, a lack of connection, and a lack of trust when they established care with a new provider in the telehealth virtual environment. Other patients expressed being open to and comfortable with establishing new healthcare relationships via telehealth when they had experienced prior positive telehealth encounters.

I think the relationship that I had with my doctor and my counselor before I started telehealth helped me to be even more comfortable with the telehealth with my psychiatrist that I have not met in person. (Patient 22-Rural)

Whereas some patient participants shared their experiences of not feeling connected to their healthcare provider in-person, which made it even more challenging for them to feel heard and understood in the virtual environment.

It was cold, whether I was in-person with him or on telehealth with him, just very cold. And I just got the overwhelming feeling that he just wanted to get on to the next appointment. (Patient 14-Frontier)

Discussion

The COVID-19 pandemic revealed systemic health inequities, including barriers to accessing care and quality of care that disproportionately impacted diverse communities across the United States (Lau et al., 2022; Poulson et al., 2021). The themes identified help to define the facilitators and barriers around best practices that should be addressed by providers wishing to implement or increase the use of telehealth. The need for flexibility to address these barriers and planning for when and how to utilize telehealth is clearly represented in the data. Providers in this study voiced frustration about disparities in technological infrastructures and multiple, changing telehealth modalities that made initiating telehealth care challenging. Cohen (2021) describes the intersectional challenges that complicate rural health care, including access to transportation, financial resources, and limited income. Telehealth can provide an alternative to in-person care that limits the need for travel, however, many rural areas lack broadband access (Dornauer & Bryce, 2020; Graves et al., 2021) compared to their urban counterparts. Telehealth also presents challenges in urban areas, with non-English-speaking and low-income patients having less access to technology (Park et al., 2018; Pekmezaris et al., 2019).

Despite challenges accessing safe and equitable care through telehealth, telehealth is shown to be an effective tool for reaching hard-to-reach patients. Current literature provides examples of shared positive experiences between mental health providers and patients with telehealth reducing or eliminating barriers to care such as excessive travel. Nicholas et al. (2021) found that telehealth facilitated engagement between patients and providers by eliminating barriers and that patients using telehealth to access care felt supported and respected. Provider participants in this study indicated that appropriate triage and scheduling were essential for effective care delivery via telehealth. This study's finding is consistent with results by Gentry et al. (2021), which emphasized the importance of institutional support to design a process for triage and scheduling along with the proactive investment of time and capital to assess technologic infrastructure and clinician readiness to deliver care using telehealth.

The implications of telehealth on cultivating safety screening, privacy, and confidentiality are important themes consistent with emerging international literature. The ability to accurately assess risk for violence is commonly named a concern among telehealth providers in Lebanon and Australia (Ayres et al., 2021; Helou et al., 2020). The need to ensure that the patient is in a space that allows for privacy and safety was a concern, particularly among providers of social services or mental health services (Ayres et al., 2021; Nicholas et al., 2021). While a survey by Nicholas et al. (2021) noted that only 36% of providers felt telehealth had a negative impact on their ability to provide safe care, follow-up analysis of open-ended responses from this sample indicated clinicians had concerns about telehealth impacting the ability to perform adequate risk assessments or to ensure that clients have a private and safe space for telehealth visits. Established protocols for ensuring appropriate risk and safety assessments and patient privacy should be an integral component of telehealth practice.

While some providers have indicated that they found telehealth equally appropriate for new and established patients (Gentry et al., 2021), most emerging studies support this study's findings that telehealth may be a barrier to establishing rapport in a new patient-provider relationship. While some providers have gone so far as to say that an initial visit cannot be done remotely (Helou et al., 2020), many state that it is difficult to establish a therapeutic relationship over telehealth (Altman et al., 2023; Nicholas et al., 2021). Specific to developing relationships in community partnerships, there has been an emphasis on the importance of establishing a relationship with clients in-person that creates a foundation for enhancing future telehealth encounters (Ayres et al., 2021). Providers incorporating telehealth into practice should consider the nature of the patient-provider relationship and the ability to establish rapport in the relationship over telehealth versus in-person initial interactions.

Implications for Nurse Leaders in Healthcare Policy and Practice

As the nursing discipline continues to evolve and adapt to technology, nursing practice is called to find innovative ways to deliver care and to adapt to urgent health challenges during a pandemic and beyond. Nurses, nurse leaders, and healthcare policy advocates should design telehealth services that incorporate lessons learned and best practices from the evidence (Kissler et al., 2023). Implications for policy and practice include: addressing access disparities by supporting legislative actions that promote a robust and equitable technological infrastructure which remains reimbursable; policies and protocols to ensure safe, appropriate engagement with telehealth care; policies, protocols, and education around the types of visits most suited to telehealth; and inclusion of nurse-led practices as reimbursable telehealth models of care.

There is a clear need to prioritize policies that address technological inequalities to ensure widespread access to telehealth services (Lau et al., 2022; Shahid et al., 2023). Access to technology should be considered an essential determinant of health. As such, policy leaders should work to build technology and internet infrastructure that supports the broad range of modalities available as telehealth services, to include audio-only, live chat, and Apple Facetime video. It is imperative to support and introduce legislative actions that improve healthcare delivery for ethnically, geographically, and economically diverse communities while ensuring the systems implemented do not disadvantage those who have been historically marginalized or oppressed.

This study provides valuable perspectives which indicate the ongoing need for nurses to be proactive in addressing safety standards and privacy practices in the telehealth environment. The providers in this study emphasized the need for creating and implementing policies and protocols that address ethical questions around interpersonal violence and determine the patient's safety in their home environment. Nursing practice will need to also include training for patients about how to maximize benefit from a telehealth visit by ensuring they are in a private, appropriate environment where they can engage with providers without distractions or breaches in security standards.

Policies should be established that promote proper screening of visit requests to determine the best fit for telehealth services. Consideration for telehealth should include visit type, presence or absence of existing patient–provider relationship, and accessibility of appropriate telehealth modality by provider and patient. Nurses should include education for patients on the types of needs that are best met via telehealth. Additionally, protocols that appropriately triage visits to the most suited modality should be established.

Finally, the context of telehealth services and insurance reimbursement remains uncertain and is situated upon shifting legislative grounds. Nurses need to lead the way by developing and advocating for federal and state policies that improve quality healthcare access that is nurse-led. Nurses must have an infrastructure to document the quality and value-driven care that they provide while working in systems that allow for billing without restrictions. Nursing leaders must advocate for and continue to support bills which aim to protect local and universal access to telehealth services by partnering with their legislative representatives.

Strengths and Limitations

This study's strengths include the geographically representative nature of the participants served by both urban and rural clinical sites, the availability to conduct interviews in the preferred language, and the collection of rich qualitative data over the course of rapid telehealth implementation during the COVID-19 pandemic. There are also several limitations to this study. While this study has a large sample size, the learnings are contextually situated and nuanced and are not expected to be transferrable to all clinical settings. Second, our qualitative process continued data collection up to the point of saturation of themes for analysis, although it is possible that some factors were not discussed or missed during the semi-structured interviews. Third, our study focused on the experiences of individuals who engaged in telehealth and were comfortable participating in interviews virtually, but perspectives of individuals who did not engage in telehealth were not represented. We were unable to recruit enough Hispanic or Spanish-speaking rural patients to match the region's demographic. Additional research is needed to understand experiences among those for whom a digital divide, a language barrier, or hesitancy in engaging in conversations remotely might have occurred.

Conclusion

Telehealth can be a powerful tool to increase access to safe and equitable nursing-led models of care within frontier, rural, and urban communities. Grounded in experiential evidence, this study emphasizes important considerations for implementing or modifying a telehealth program, including using multiple modalities, tailoring triage and scheduling, cultivating safety boundaries, and differentiating the needs between established versus new patients. As patients and their support systems demand more flexibility for reimbursable technologically driven and high-quality healthcare service delivery, the nursing profession will need to evolve practices to meet these demands. It is essential that nursing leaders within complex healthcare systems collaborate to establish and implement best practices within telehealth environments to ensure the protection, promotion, and optimization of equitable health outcomes for patients now and for future generations.

Footnotes

Acknowledgments

Amy Joachim, Lorraine Garcia, Cheryl Taccogno, Rosario Medina, Jennifer Villalobos.

Declaration of Conflicting Interests

The authors declare that there is no conflict of interest.

Funding

The authors disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This project was funded under grant number 5 R01 HS028085 from the 10.13039/100000133Agency for Healthcare Research and Quality (AHRQ), 10.13039/100000016U.S. Department of Health and Human Services (HHS). The authors are solely responsible for this document's contents, findings, and conclusions, which do not necessarily represent the views of AHRQ. Readers should not interpret any statement in this report as an official position of AHRQ or of HHS. None of the authors has any affiliation or financial involvement that conflicts with the material presented in this report.

ORCID iD

Charlotte R. Weiss

Author Biographies

Charlotte R. Weiss, PhD, MSN, RN, APRN, was a doctoral student at the time of the study completion. She is a NRSA funded post doctoral fellow whose research interests are in cancer caregivers.

Mia Roberts, PhD, MSN, RN, CPNP-PC, was a doctoral student at the time of this study. Her interests are in AYA and mental health.

Melissa Florell, PhD, MSN, RN was a doctoral student at the time of this study. She is an assistant professor whose research interests are rural health and policy development.

Rachel Wood, PhD, RN, NPD-BC, CEN, CPEN, was a doctoral student at the time of this study. She is an assistant professor with research interest in loneliness among nurses.

Rachel Johnson-Koenke, PhD, LCSW, is an assistant professor with interest in narrative inquiry and interventions among veterans.

Claudia R. Amura, PhD, MPH, is an assistant professor of research who specializes in health equity research.

Katherine Kissler, PhD, RN, CNM, is an assistant professor specialized in maternal health.

Amy J. Barton, PhD, RN, FAAN, ANEF is a professor and Senior Associate Dean for Faculty and Students.

Jacqueline Jones, PhD, RN FAAN, is a professor and Associate Dean of PhD Studies who specializes in qualitative research.

References

Abrams

J. A.

Tabaac

Jung

Else-Quest

N. M.

(2020). Considerations for employing intersectionality in qualitative health research. Social Science & Medicine, 258, 113138. https://doi.org/10.1016/j.socscimed.2020.113138

Altman

M. R.

Mohammed

S. A.

Eagen-Torkko

M. K.

Kantrowitz-Gordon

Gavin

A. R.

(2023). Losing connection: Experiences of virtual pregnancy and postpartum care during the COVID-19 pandemic. The Journal of Perinatal & Neonatal Nursing, 37(1), 44–49. https://doi.org/10.1097/JPN.0000000000000704

Ayres

Pelkowitz

Simon

Thompson

S. C.

(2021). Necessity as the catalyst of change: Exploring client and provider perspectives of accelerated implementation of telehealth by a regional Australian community service organisation during COVID-19 restrictions. International Journal of Environmental Research and Public Health, 18(21), 11433. https://doi.org/10.3390/ijerph182111433

Barney

Buckelew

Mesheriakova

Raymond-Flesch

(2020). The COVID-19 pandemic and rapid implementation of adolescent and young adult telemedicine: Challenges and opportunities for innovation. Journal of Adolescent Health, 67(2), 164–171. https://doi.org/10.1016/j.jadohealth.2020.05.006

Barton

A. J.

Amura

C. R.

Willems

E. L.

Medina

Centi

Hernandez

Reed

S. M.

Cook

P. F.

(2023). Patient and provider perceptions of COVID-19-driven telehealth use from nurse-led care models in rural, frontier, and urban Colorado communities. Journal of Patient Experience, 10, https://doi.org/10.1177/23743735231151546

Cohen

(2021). The challenges of intersectionality in the lives of older adults living in rural areas with limited financial resources. Gerontology and Geriatric Medicine, 7. https://doi.org/10.1177/23337214211009363

Collins

P. H.

Bilge

(2016). Intersectionality. Polity.

Cope

(2014). Methods and meanings: Credibility and trustworthiness of qualitative research. Oncology Nursing Forum, 41(1), 89–91. https://doi.org/10.1188/14.ONF.89-91

Corless

I. B.

Nardi

Milstead

J. A.

Larson

Nokes

K. M.

Orsega

Kurth

A. E.

Kirksey

K. M.

Woith

(2018). Expanding nursing's role in responding to global pandemics. Nursing Outlook, 66(4), 412–415. https://doi.org/10.1016/j.outlook.2018.06.003

10.

Creswell

J. W.

Poth

C. N.

(2018). Qualitative inquiry and research design: Choosing among five approaches (4th ed.). Sage Publications.

11.

Dornauer

M. E.

Bryce

(2020). Too many rural Americans are living in the digital dark: The problem demands a new deal solution. Health Affairs Forefront.

12.

Gentry

M. T.

Puspitasari

A. J.

McKean

A. J.

Williams

M. D.

Breitinger

Geske

J. R.

Clark

M. M.

Moore

K. M.

Frye

M. A.

Hilty

D. M.

(2021). Clinician satisfaction with rapid adoption and implementation of telehealth services during the COVID-19 pandemic. Telemedicine and e-Health, 27(12), 1385–1392. https://doi.org/10.1089/tmj.2020.0575

13.

Gomez

Anaya

Y. B.

Shih

K. J.

Tarn

D. M.

(2021). A qualitative study of primary care physicians’ experiences with telemedicine during COVID-19. Journal of the American Board of Family Medicine: JABFM, 34(Suppl), S61–S70. https://doi.org/10.3122/jabfm.2021.S1.200517

14.

Graves

J. M.

Abshire

D. A.

Amiri

Mackelprang

J. L.

(2021). Disparities in technology and broadband internet access across rurality: Implications for health and education. Family & Community Health, 44(4), 257–265. https://doi.org/10.1097/FCH.0000000000000306

15.

Health Resources and Services Administration (n.d.). Best practice guides. Telehealth.HHS.gov. Retrieved November 10, 2022, from https://telehealth.hhs.gov/providers/best-practice-guides/.

16.

Helou

El Helou

Abou-Khalil

Wakim

El Helou

Daher

El Hachem

(2020). The effect of the COVID-19 pandemic on physicians’ use and perception of telehealth: The case of Lebanon. International Journal of Environmental Research and Public Health, 17(13), 4866. https://doi.org/10.3390/ijerph17134866

17.

Hollander

J. E.

Carr

B. G.

(2020). Virtually perfect? Telemedicine for COVID-19. New England Journal of Medicine, 382(18), 1679–1681. https://doi.org/10.1056/NEJMp2003539

18.

Holtrop

J. S.

Rabin

B. A.

Glasgow

R. E.

(2018). Qualitative approaches to use of the RE-AIM framework: Rationale and methods. BMC Health Services Research, 18(1), 1–10. https://doi.org/10.1186/s12913-018-2938-8

19.

Hong

Y. R.

Lawrence

Williams

Jr. Mainous Iii

(2020). Population-level interest and telehealth capacity of US hospitals in response to COVID-19: Cross-sectional analysis of Google search and national hospital survey data. JMIR Public Health and Surveillance, 6(2), e18961. https://doi.org/10.2196/18961

20.

Khairat

Chourasia

Muellers

K. A.

Andreadis

Lin

J. J.

Ancker

J. S.

(2023). Patient and provider recommendations for improved telemedicine user experience in primary care: A multi-center qualitative study. Telemedicine Reports, 4(1), 21–29. https://doi-org.proxy.library.upenn.edu/10.1089/tmr.2023.0002

21.

Kissler

Thumm

Smith

Anderson

Wood

R. E.

Johnson-Koenke

Roberts

Carmitchel-Fifer

Patterson

Amura

Barton

Jones

(2023). Perinatal telehealth: Meeting patients where they are. Journal of Midwifery and Women’s Health. https://doi-org.proxy.hsl.ucdenver.edu/10.1111/jmwh.13560

22.

Lau

K. V.

Anand

Ramirez

Phicil

(2022). Disparities in telehealth use during the COVID-19 pandemic. Journal of Immigrant and Minority Health, 24, 159–1593. https://doi.org/10.1007/s10903-022-01381-1

23.

LeRouge

Garfield

M. J.

(2013). Crossing the telemedicine chasm: Have the US barriers to widespread adoption of telemedicine been significantly reduced? International Journal of Environmental Research and Public Health, 10(12), 6472–6484. https://doi.org/10.3390/ijerph10126472

24.

Lewis

P. S.

Latney

(2002). Achieve best practice with an evidence-based approach. Nursing Management, 33(12), 24–30. https://doi.org/10.1097/00006247-200212000-00010

25.

Monaghesh

Hajizadeh

(2020). The role of telehealth during COVID-19 outbreak: A systematic review based on current evidence. BMC Public Health, 20(1), 1–9. https://doi.org/10.1186/s12889-020-09301-4

26.

Neal

Fixsen

(2020). The nurse–family partnership in Colorado: Supporting high-quality programming with implementation science. Journal of Nursing Scholarship, 52(1), 6–13. https://doi.org/10.1111/jnu.12506

27.

Nicholas

Bell

I. H.

Thompson

Valentine

Simsir

Sheppard

Adams

(2021). Implementation lessons from the transition to telehealth during COVID-19: A survey of clinicians and young people from youth mental health services. Psychiatry Research, 299, 113848. https://doi.org/10.1016/j.psychres.2021.113848

28.

Nodine

P. M.

Collins

M. R.

Wood

C. L.

Anderson

J. L.

Orlando

B. S.

McNair

B. K.

Mayer

D. C.

Stein

D. J.

(2020). Nitrous oxide use during labor: Satisfaction, adverse effects, and predictors of conversion to neuraxial analgesia. Journal of Midwifery & Women's Health, 65(3), 335–341. https://doi.org/10.1111/jmwh.13124

29.

Nouri

Khoong

E. C.

Lyles

C. R.

Karliner

(2020). Addressing equity in telemedicine for chronic disease management during the Covid-19 pandemic. NEJM Catalyst Innovations in Care Delivery, 1(3). https://doi.org/10.1056/CAT.20.0123

30.

Park

Erikson

Han

Iyer

(2018). Are state telehealth policies associated with the use of telehealth services among underserved populations? Health Affairs, 37(12), 2060–2068. https://doi.org/10.1377/hlthaff.2018.05101

31.

Paulus

T. M.

Lester

J. N.

(2021). Doing qualitative research in a digital world. Sage Publications, Incorporated.

32.

Pekmezaris

Nouryan

C. N.

Schwartz

Castillo

Makaryus

A. N.

Ahern

Akerman

M. B.

Lesser

M. L.

Bauer

Murray

Pecinka

Zeltser

Zhang

DiMarzio

(2019). A randomized controlled trial comparing telehealth self-management to standard outpatient management in underserved Black and Hispanic patients living with heart failure. Telemedicine and e-Health, 25(10), 917–925. https://doi.org/10.1089/tmj.2018.0219

33.

Poulson

Geary

Annesi

Allee

Kenzik

Sanchez

Tseng

Dechert

(2021). National disparities in COVID-19 outcomes between Black and White Americans. Journal of the National Medical Association, 113(2), 125–132. https://doi.org/10.1016/j.jnma.2020.07.009

34.

Powell

R. E.

Henstenburg

J. M.

Cooper

Hollander

J. E.

Rising

K. L.

(2017). Patient perceptions of telehealth primary care video visits. The Annals of Family Medicine, 15(3), 225–229. https://doi.org/10.1370/afm.2095

35.

Saldaña

(2016). The coding manual for qualitative researchers (3rd ed.). Sage Publications.

36.

Shahid

Hogeveen

Sky

Chandra

Budhwani

de Silva

Sascha Bhatia

Seto

Shaw

(2023). Health equity related challenges and experiences during the rapid implementation of virtual care during COVID-19: A multiple case study. International Journal for Equity in Health, 22(1), 44. https://doi.org/10.1186/s12939-023-01849-y

37.

Shigekawa

Fix

Corbett

Roby

D. H.

Coffman

(2018). The current state of telehealth evidence: A rapid review. Health Affairs, 37(12), 1975–1982. https://doi.org/10.1377/hlthaff.2018.05132

38.

State of Colorado (2020). Reimbursement for telehealth services. Colorado General Assembly. https://leg.colorado.gov/bills/sb20-212.

39.

Tong

Sainsbury

Craig

(2007). Consolidated criteria for reporting qualitative research (COREQ): A 32-item checklist for interviews and focus groups. International Journal for Quality in Health Care, 19(6), 349–357. https://doi.org/10.1093/intqhc/mzm042

40.

Weber

Stalder

Techau

Centi

McNair

Barton

A. J.

(2021). Behavioral health integration in a nurse-led federally qualified health center: Outcomes of care. Journal of the American Association of Nurse Practitioners, 33(12), 1166–1172. https://doi.org/10.1097/JXX.0000000000000506

Best Practices for Telehealth in Nurse-Led Care Settings—A Qualitative Study

Abstract

Keywords

Introduction

Background

Conceptual Research Framework

Methods

Setting

Sample

Data Collection

Analysis

Results

Using Multiple Modalities

Tailoring Clinical Triage and Scheduling

Cultivating Safety Through Boundaries and Expectations

Differentiating Established Versus New Patient Relationships

Discussion

Implications for Nurse Leaders in Healthcare Policy and Practice

Strengths and Limitations

Conclusion

Footnotes

Acknowledgments

Declaration of Conflicting Interests

Funding

ORCID iD

Author Biographies

References