Abstract
Background and Significance
When pharmacists are not available in rural communities and when rural hospitals lack resources to staff a pharmacy 24 h/day, 7 days/week, quality and safety of medication use may be compromised. 1,2 Telepharmacy, which is a subset of telemedicine, may be useful for improving pharmacy service coverage regardless of where the pharmacist is located. 2 –4 Telepharmacy applies to activities including a combination of electronic data entry, prescription order verification, centralized anticoagulation clinics, online benefit adjudication, medication dispensing, and telehealth consultation with medication use evaluation using computer technology. 1,2 Several rural hospitals in the United States 4 and Australia 5 have implemented telepharmacy services that allow for 24-h pharmacist review of all medication orders. In the United States, rural hospitals with or without on-site hospital pharmacists were incentivized by regulatory mandates from the Centers for Medicare and Medicaid Services and other regulatory agencies 6 to use computers and health information technology (HIT) as a vehicle for providing convenient and affordable pharmacy service solutions to meet patient needs. By implementing telepharmacy services, critical access hospitals with 25 or fewer beds in rural areas could qualify to receive incentive payments from the 2009 Medicare and Medicaid electronic health record (EHR) incentive programs for eligible professionals and eligible hospitals that adopt, implement, upgrade, or demonstrate “meaningful use” of certified EHR technology. 7
The Nebraska Medical Center Telepharmacy Service
Frequently, telepharmacy services administered via “excess capacity hub and spoke” models 8 generally utilize pharmacists in urban hospitals to triage and enter medication orders for rural hospital partners. In 2008, The Nebraska Medical Center (TNMC) in Omaha implemented a remote pharmacy model that tailors the service (excluding remote retail dispensing) to fit the needs of the rural hospital site. 9 The current TNMC model employs 16 part-time home-based pharmacists to provide remote pharmacy services for inpatients at rural hospitals. These remote pharmacists in TNMC service model (appropriately licensed for each state) work from home using secure virtual private network connections to the rural hospital sites.
TNMC and each rural hospital site enter into a business associate agreement along with a 2-year master service agreement. Each site tailors the service to their needs and technology, choosing from a menu of services offered: prospective medication order review, entry, or verification in the patient's electronic medical record, visual authentication of medications prior to administration or other use of videoconferencing, policy development for medication use, medication safety or clinical consultations. 8 Secure virtual private network tunnels are used for connectivity (Fig. 1). Secure credentials are issued by each site for all pharmacists. Each rural hospital establishes a methodology for backup access during connectivity interruptions. Superuser liaisons use a Web-based tool to record training sessions that can be accessed on demand when needed by remote pharmacists. A shared Web site on TNMC intranet includes “tip sheets” for commonly encountered questions, and details about each site are used for quick reference.

Structure of The Nebraska Medical Center's (TNMC's) telepharmacy service model.9 EMR, electronic medical record; HD, high-definition; TLS, transport layer security; HTTPS, hypertext transfer protocol secure; PCOIP, PC-over-IP (PCoIP) technology powers virtual workplace; VMWare, virtualization and cloud computing software; RDP, remote desktop protocol; VOIP, voice over Internet protocol; VPN, virtual private network.
Study Rationale and Significance
There is very limited knowledge evaluating the place of documented remote pharmacist interventions in a telepharmacy service model across the quality of care continuum and with or without an on-site pharmacist located in rural hospitals. Our study addresses important gaps in this knowledge. First, we developed a framework to categorize remote pharmacist interventions provided at three levels across the care continuum: intervention, patient, and health system (throughout the medication use process from transcribing to administration). This framework will enhance the design of an electronic data capture system that will help train current and future pharmacists to improve and coordinate medication therapy management for patients remotely. Second, we describe trends in the intervention categories by year, hospital, and remote pharmacist within the telepharmacy service model. Third, to understand place of the remote pharmacist along with the on-site rural hospital pharmacist, we compared intervention categories across hospitals served by a remote pharmacist with and without an on-site hospital pharmacist.
Objectives
This retrospective cross-sectional study evaluated a telepharmacy service model using a conceptual framework with three definitions at the intervention level, the patient-centered medication management level, and the health-system centered medication use process level to compare documented remote pharmacist interventions by year, hospital, and remote pharmacist and across rural hospitals with and without an on-site rural hospital pharmacist.
Materials and Methods
We conducted a retrospective study using descriptive and analytic methods. A software application (OrderImage; Health Care Systems Inc., Montgomery, AL) was used to establish the number of prescription orders processed during the period June 2008–November 2011. Data for the study were extracted from the RxFusion® clinical interventions database (a home-grown system, i.e., internally developed program at TNMC for capturing remote pharmacist-documented intervention data) where the remote pharmacists documented all interventions at the eight hospitals (six critical access hospitals in very rural areas of Nebraska and Iowa, one community hospital each in Nebraska and in a moderately rural area in eastern Iowa). These hospitals were receiving the telepharmacy services during the study time period for prospective order review and/or entry. Details of the eight hospitals (number of licensed beds [bed size], average daily census, telepharmacy service start dates, and on-site pharmacist presence) were collected (Table 1). Anonymized information was reported for the interventions without unique protected health information elements of patients. The authors' institutional review board approved the study as exempt from human subject requirements.
Characteristics of the Rural Hospitals Using the Telepharmacy Service
All have 25 or fewer beds.
The hospital added an on-site pharmacist after adding a telepharmacy service.
In TNMC telepharmacy service, medication orders transmitted from the rural hospital to a fax server are viewed by remote pharmacists in an OrderImage application. When the remote pharmacists interact (via a secure Web browser) with the rural hospital's information technology system to provide pharmacy services, they access and review the patient's electronic medical record using their clinical expertise and document relevant pharmacy interventions (e.g., wrong drug, dose, route, interval, etc.) in the RxFusion clinical interventions database. In practice, safety-related or urgent pharmaceutical care interventions were delivered verbally over the phone by the remote pharmacists to the rural hospital providers, and potentially routine or nonurgent interventions were delivered via a written recommendation faxed to the provider at the rural hospital for his or her consideration. These faxed remote pharmacist interventions are placed in the patient's paper medical record or placed as a clinical note in the patient's electronic health record for providers to consider during patient rounds. All the documented remote pharmacist interventions in the RxFusion database were the unit of analyses for this study.
Conceptual Framework to Map Remote Pharmaceutical Care Interventions
The study authors (the outcomes researcher, J.S.; the pharmacist administrator and director of the remote pharmacy service program, L.J.M.; and the remote clinical pharmacist, L.M.M.) reviewed the 37 classes of remote pharmaceutical care interventions (Table 2). Then, based on the literature on medication therapy management 10,11 and using the steps in the medication use process proposed by United States Pharmacopoeia, 12 the study authors conceptualized an analytical framework, mapping the 37 classes of remote pharmacist interventions to three broader-level definitions: (a) intervention, eight categories (interaction/potential interaction, contraindication, adverse effects, anticoagulation monitoring, drug product selection, drug regimen, summary, and recommendation), (b) medication management, two categories (medication therapy review and medication action), and (c) health system medication use process, four categories (prescribing, transcribing and documenting, administering, and monitoring) (Fig. 2).

Levels and categories for mapping pharmaceutical care interventions from Table 2.
The 37 Remote Pharmaceutical Care Interventions Documented in the Clinical Interventions Database
BMP, basic metabolic panel; BUN, blood urea nitrogen; CBC, complete blood count; CrCl, creatinine clearance; INR, international normalized ratio; PT, prothrombin time; SCr, serum creatinine; TPN, total parenteral nutrition.
Statistical Analyses
To describe trends in the provision of telepharmacy services, the median total number of documented interventions by half the number of hospitals and remote pharmacists across hospitals and pharmacists, respectively, was estimated. To investigate differences in frequencies of interventions over time across years, across the eight hospitals, and across the 16 remote pharmacists, chi-squared or Fisher's exact tests were used as appropriate. A Bonferroni correction was applied for more than two group comparisons. To investigate the association of each of the three definition levels of remote intervention categories with remote pharmacist coverage but with or without an on-site hospital pharmacist (dependent variable of interest), univariate logistic regression analyses was used. All analyses were carried out using a standard statistical analysis software (SAS version 9.3; SAS Institute, Cary, NC).
Results
About half a million prescription orders (n=450,000) were processed for the eight study hospitals over the 2.5-year study period (Table 3). In total, 19,222 remote pharmacist interventions documented in the RxFusion database were evaluated. Compared with 520 interventions in base year 2008, the number of interventions increased every year (6,832 interventions in 2009, 10,481 interventions in 2010, and 1,389 interventions in 2011). On average, 2,403 interventions (range, 846–5,307) were delivered per hospital. More than 1,807 (median) total interventions were documented by each of the four (out of the eight total) hospitals. On average, 1,201 interventions (range, 190–4,183) were documented by each of the 16 pharmacists over the 2.5-year period. More than 743 (median) total interventions were documented by each of the eight (out of the 16 total) remote pharmacists. Overall, the frequency of interventions differed significantly across the 4 years (p<0.01; Table 3), across the eight hospitals (p<0.01; data not shown), and across the 16 remote pharmacists (p<0.05; data not shown) for the eight proposed intervention level categories, two patient-centered medication management level categories, and four health system-centered medication use process level categories, respectively.
Frequency of Remote Pharmaceutical Care Interventions from 2008 to 2011 by Year (n=19,222)
Univariate associations of the three intervention levels each across the 4 years were studied using chi-squared tests for differences of association between the categorical variables. All p values less than 0.05 were significant. A Bonferroni correction was applied for more than 2 group comparisons.
Compared with hospitals with a remote pharmacist alone (i.e., without an on-site pharmacist), hospitals with both an on-site and remote pharmacist had a significantly higher frequency of interventions related to recommendations, drug product selection, summary, and drug regimen, followed by adverse effects, anticoagulation monitoring, potential interactions, and contraindications (Table 4). They also showed a higher frequency of interventions related to taking actions regarding medication use rather than interventions related to review of medications and a higher frequency of interventions related to prescribing and transcribing, followed by monitoring and administering functions.
Frequency of Remote Pharmaceutical Care Interventions at Hospitals With or Without an On-Site Pharmacist Along with Remote Pharmacist Coverage, 2008–2011 (n=19,222)
Univariate association of each of the three intervention definition levels across the two groups of hospital pharmacy status were studied using chi-squared tests for differences of association between the categorical variables. All p values less than 0.05 were significant. A Bonferroni correction was applied for more than 2 group comparisons.
There were significant differences between hospitals with both an on-site and remote pharmacist (n=12,141) versus with remote pharmacist coverage alone (i.e., without an on-site pharmacist) (n=7,081) for the three category levels (Table 5). Recommendation (odds ratio [OR]=1.34; 95% confidence interval [CI], 1.10–1.63; p≤0.0001), drug product selection (OR=1.31; 95% CI, 1.07–1.60; p=0.0002), and summary (OR=1.30; 95% CI, 1.06–1.59; p=0.0007) interventions each versus anticoagulation monitoring were significantly more likely to be associated with hospitals with both an on-site and remote pharmacist versus hospitals with remote pharmacist coverage alone (i.e., without an on-site pharmacist). However, drug regimen (OR=0.63; 95% CI, 0.49–0.81; p≤0.0001) versus anticoagulation monitoring intervention was significantly less likely to be associated with hospitals with both an on-site and remote pharmacist versus hospitals with remote pharmacist coverage alone (i.e., without an on-site pharmacist). Interventions related to taking actions regarding medication use (OR=1.12; 95% CI, 1.05–1.19; p=0.0003) versus interventions related to review of medications were significantly more likely to be associated with hospitals with both an on-site and remote pharmacist versus hospitals with remote pharmacist coverage alone (i.e., without an on-site pharmacist). Transcribing (OR=1.47; 95% CI, 1.12–1.95; p=0.0003)- and prescribing (OR=1.07; 95% CI, 1.07–1.85; p=0.0095)-related interventions each versus administering related interventions were significantly more likely to be associated with hospitals with both an on-site and remote pharmacist versus hospitals with remote pharmacist coverage alone (i.e., without an on-site pharmacist). However, monitoring- versus administering-related interventions were not significantly different across hospitals with both an on-site and remote pharmacist and hospitals with remote pharmacist coverage alone (i.e., without an on-site pharmacist) (p=0.5565).
Association of Intervention Categories with Hospital Pharmacy Status (With Versus Without an On-Site Pharmacist) Along with Remote Pharmacist Coverage in the Telepharmacy Service Model, 2008–2011 (n=19,222)
Univariate logistic regression; where probability of each of 3 defined intervention levels was modeled for hospital pharmacy status (with an on-site pharmacist and remote pharmacist [n=12,141] versus without an on-site pharmacist but with a remote pharmacist only (n=7,081).
p value not significant.
Discussion
To our knowledge the present study is one of the first to focus on remote pharmaceutical care interventions within a telepharmacy service model delivered to rural hospitals. We developed an analytical framework to evaluate the telepharmacy service model with three definitions at the intervention level, the patient-centered medication management level, and the health system-centered medication use process level and also compared the trends in these remote pharmacist interventions by year, hospital, and remote pharmacist and across hospitals with and without an on-site hospital pharmacist.
Rural hospitals in several states in the United States (for example, Washington State, 13 the hospital telepharmacy network in North Dakota, 14 –16 Colorado, 17 Alaska, 18 Iowa, 8,19 Kansas, 20,21 Florida, 22 and Maryland 23 ) and outside the United States (Australia 5 ) now use telepharmacy services. Previous studies have focused on describing telepharmacy activities in a small number of hospitals 5,8,13 –21 or in a single hospital. 22,23 Studies have reported the impact of telepharmacy by tracking medication error rates, 4 by describing pharmaceutical care activities focused on drug-related problems, 5 by evaluating number of orders reviewed, modified, discontinued, and voided by remote pharmacists, 9 by describing the 24-h pharmacy staffing coverage given, 15 or by showing increased speed of prescription order processing, 19,22 reducing order processing time, freeing up pharmacists for quality-enhancing initiatives, or saving money. 21
We found that the number of categories of proposed interventions, patient-centered interventions, and health system-centered interventions significantly increased from the baseline first year of implementation of the telepharmacy service. The proposed interventions, patient-centered interventions, and health system-centered interventions were also significantly different among the eight hospitals in the study as well as among the 16 remote pharmacists who provided and documented the pharmaceutical care interventions. We also found that hospitals with both an on-site and remote pharmacist versus hospitals with a remote pharmacist alone (i.e., without an on-site pharmacist) were significantly more likely to have remote pharmaceutical care interventions (1) that were patient-centered rather than drug-centered, (2) that had actionable recommendations rather than medication review related to medication use at the patient-centered level, and (3) that were related to the transcribing order and prescribing steps rather than administering step of the medication use process at the health system-centered level. These study findings suggest that remote pharmacists complement the on-site rural hospital pharmacist in their work and enhance the patient-centeredness in delivery of pharmaceutical care.
The present study demonstrates the potential for remote pharmacist interventions within a telepharmacy service model to coordinate patient-centered pharmaceutical care and to also facilitate the meaningful use of EHRs. 6,7 This supports the guidance from a Pharmacy e-Health Information Technology Collaborative white paper calling for integrating pharmacy HIT into the national HIT/EHR infrastructure for safe and effective medication use. 24 The current types of evaluations could help telepharmacy service providers and rural hospitals demonstrate the “meaningful use” of certified EHR technology and get qualified for getting incentive payments from the Medicare EHR incentive program. 7 Therefore, the current study findings would be of interest to payers, providers, and researchers in developing quality metrics for evaluations to guide reimbursement coverage for telepharmacy services beyond the “meaningful use” of EHRs. This is important given the growing acceptance of telemedicine by providers, policy makers, consumers, and insurers to increase access, improve quality, and reduce costs in the delivery of healthcare. In this context, the American Telemedicine Association's State Policy Toolkit has reported all 50 state Medicaids and 18 private insurers have or are adopting mandates for coverage of some aspects of telemedicine services. 25 Thus, continued demonstration projects studying the place and value of remote pharmaceutical care interventions and how they are facilitating the process of safe medication use could also help pharmacists become eligible professionals to qualify for these Medicare EHR incentive payments; however, all these are areas for future exploration.
Limitations
Several limitations could have affected the study estimates. First, because several hospitals were contracted for the remote pharmacy service at different dates, the trends across different hospitals for the calculated frequencies and types of remote pharmaceutical care interventions at the three definition levels would have been affected. Second, lack of time may have made pharmacists only record important interventions so that the study results may be an underestimate. This is because, like in all service delivery models, it is difficult to allow appropriate time to document every single intervention that a remote pharmacist does during the course of his or her duties or changes to the service provision. Of note is that although our study was limited to 2008–2011 data, following our evaluation, the telepharmacy service has grown to serve 13 remote sites. The remote pharmacists experienced an increase in workload due to an increase in order volume. Furthermore, some sites wanted the remote pharmacists to document interventions specifically in the patient's medical records within their pharmacy computer system. Thus, in 2011, for the sake of avoiding the duplicative burden of documenting interventions, remote pharmacists were instructed to only document interventions that significantly impacted patient safety and therapy. Consequently, a trend of documenting fewer interventions in the current home-based RxFusion documentation system emerged in the year 2011, which is also reflected in the lower number of remote interventions documented in 2011 in the current study. Furthermore, there were differences in documentation of remote care interventions from one pharmacist to the other, which suggests that technical and motivational training and reimbursement of these services are important to consider in future studies. Third, the effect of missing information in a patient's medical records on documented interventions and corroboration of these effects were beyond the scope of this study's objectives. Fourth, as in other studies, personal bias could also have affected study estimates because the same remote pharmacist delivered and documented the interventions. Fifth, our study was based entirely on interventions documented by the remote pharmacists. Although all documented interventions are considered to be implemented at hospitals, we were unable to corroborate whether all the interventions recorded by the remote pharmacists as recommendations were accepted and implemented by pharmacists and other healthcare professionals on-site at the hospitals as this was beyond the scope of the study.
Finally, data collection and assessment of the appropriateness or clinical impact, effectiveness, cost-effectiveness, and the delivery channels (phone, fax, etc.) of the remote pharmacist interventions were beyond the scope of this study. However, these limitations are the basis for future research and can potentially be built into the design of the electronic data capture system.
The delivery of pharmaceutical care services across the continuum of care in rural settings will call for the optimization of pharmacist services and the ability to capture meaningful data in the EHR. Numerous barriers continue to limit the ability to capture all pharmaceutical care value. Therefore, future research needs to address several areas: for example, (1) study opportunities to enhance the design of an efficient electronic data capture system that would enable remote pharmacists to document interventions with ease and would motivate all remote pharmacists to equally document their interventions, (2) use this framework to continuously evaluate in real-time the place and value of remote pharmaceutical care interventions in the current telepharmacy model and other models, and (3) use the framework developed to elucidate the growing role of pharmacists in medication therapy management within a telepharmacy model when patients transition from inpatient to outpatient settings of care.
In the long term, our study results will provide a framework that providers, administrators, and payers can adapt in the evaluation processes of telepharmacy service models. This will help stakeholders understand the significance of remote pharmaceutical care interventions to elucidate the critical role of the remote pharmacist in improving the quality of medication use processes within the current and other similar telepharmacy service delivery models.
Conclusions
This is one of the first studies to demonstrate to providers, payers, and policymakers about the patient- and health system-centered nature of pharmaceutical care delivered via a telepharmacy service model by evaluating documented remote pharmacist interventions with an analytical framework. With further validation and considering areas of future research, this framework could enhance the design of electronic data capture of documented interventions and can be used as a quality metric tool for routine real-time evaluations of telepharmacy service models. In summary, such studies and tools can enhance the quality of pharmaceutical care in rural as well as urban healthcare systems that will be of interest to providers, payers, and policymakers.
Footnotes
Acknowledgments
The authors thank the remote pharmacists who documented the interventions they made in the telepharmacy service model. We also thank Richard VanCura (associated with The Nebraska Medical Center) who prepared the data for the study and Lynette Smith, MS (biostatistician in the College of Public Health at the University of Nebraska Medical Center) who assisted with analysis.
Disclosure Statement
No competing financial interests exist.
Author Contributions
J.S. led the conceptualization, design, data collection planning, statistical analyses, interpretation of data, and drafting of the manuscript. L.J.M. was involved in the conceptualization, design, data collection planning, data acquisition, interpretation of data, and critical revision of manuscript. L.M.M. was involved in the conceptualization, design, data collection, reviewing, and critical revision of manuscript. All authors gave final approval.
