Abstract
Background:
Historically, fewer than half of American Indians and Alaska Natives (AI/AN) with diabetes received the annual diabetic retinopathy (DR) examination that is considered the minimum standard of care; this rate is similar to that of the general United States (U.S.) population with diabetes.
Solution:
The Indian Health Service-Joslin Vision Network (IHS-JVN) Teleophthalmology Program in 2000 to increase compliance with DR standards of care among AI/AN through validated, primary care-based telemedicine. The IHS-JVN provides remote diagnosis of DR severity, with a report including management recommendations that is returned to the patient's primary care provider. The program conforms with the American Telemedicine Association (ATA) Practice Guidelines for Ocular Telehealth-Diabetic Retinopathy.
Outcomes:
The IHS-JVN has been expanding incrementally since the first patients were recruited in 2000; this expansion coincides with large improvements in the annual DR examination rates reported as part of local, regional, and national regulatory compliance under the Government Performance and Results Act (GPRA). Currently, with 99 clinical implementations in 23 states, IHS-JVN is the largest primary care-based ATA validation category three telemedicine program in the U.S.
Summary:
This article describes the program's workflow, imaging and reading technologies, diagnostic protocols, reports to providers, training, quality assurance processes, and geographical distribution. In addition to its clinical use, the program has been utilized in research on utilization of diabetic eye care, cost-effectiveness, technology development, and DR epidemiology of the AI/AN population. Potential next steps for this program are discussed.
Introduction
At 15.1%, the age-adjusted rate of diagnosed diabetes is higher in American Indians and Alaska Natives (AI/AN) than any other major race/ethnic group in the United States (U.S.). 1 AI/AN also tend to have higher rates of diabetes-related complications. 2 Diabetic retinopathy (DR) is the most common microvascular complication of diabetes 3 and is the leading cause of moderate and severe vision loss among working age adults. 4 Timely diagnosis and treatment of DR is effective in substantially reducing vision loss due to DR, but approximately half of patients with diabetes in the United States do not receive the recommended annual DR examination. 5,6 Many factors contribute to this low exam rate, including access to care and patient awareness. 7,8
To increase the rate that AI/AN with diabetes receive DR examinations, the Indian Health Service launched the Joslin Vision Network (IHS-JVN) Teleophthalmology Program in 2000. The program arose from a federal, multicenter grant to support research for improved evaluation and management of diabetes and DR. Work leading to the IHS-JVN began in 1999 with the development of the technical infrastructure, Reading Center, and clinical protocols modeled after the JVN at the Joslin Diabetes Center (JDC). 9 Discrete aspects of the IHS-JVN and the JDC JVN have been described. 10 –14 This article gives a broad overview of the program's main components and outcomes.
American Telemedicine Association Validation Categories
DR best practices combined with telemedicine standards have been used extensively in the IHS-JVN. In turn, the IHS-JVN has participated in standards development for telemedicine, particularly the American Telemedicine Association (ATA) Telehealth Practice Recommendations for Diabetic Retinopathy. 15,16 The practice recommendations describe four validation categories, based on the Early Treatment Diabetic Retinopathy Study (ETDRS), the gold standard for DR diagnosis and treatment. 15 –17 The IHS-JVN is an ATA Category 3 program, meaning the program's clinicians identify the ETDRS defined clinical levels of DR and diabetic macular edema (DME; central involved and non-central involved) severity with a diagnostic accuracy that matches clinical retinal examination through dilated pupils or ETDRS photographs (Table 1, last column). Functionally, this means that levels of non-proliferative DR (NPDR) that are not yet considered sight-threatening can be found, referred for eye or other specialty care as needed, and medically managed appropriately before they progress to severe levels of DR. A Category 3 program also provides a management plan commensurate with the clinical recommendations that would have resulted from a traditional ophthalmology-based clinical retinal examination through dilated pupils. Category 1 programs differentiate between patients who have no DR and those who have any form of DR. Category 2 programs differentiate between patients who do or do not have potentially sight-threatening DR requiring prompt referral for eye care.
Classification Matrix
Category 4 validation is for a system that matches or exceeds the ability of ETDRS photos to identify lesions of DR to determine levels of DR and DME.
No Category 4 programs currently exist, and, therefore, this category is not shown here. 18
ATA, American Telemedicine Association; DME, diabetic macular edema; DR, diabetic retinopathy; ETDRS, Early Treatment Diabetic Retinopathy Study; NA, not applicable; NPDR, nonproliferative DR; PDR, proliferative DR.
The ATA validation categories do not constitute a quality continuum, but rather exist to optimize teleretinal services for a variety of settings. In the IHS, services are provided directly or indirectly through contracts or compacts with tribes or Tribal Organizations (TOs) and grants to Urban Indian Organizations (UIOs). 19 The IHS currently includes 46 hospitals (24 are IHS operated, 22 are tribally operated) and 568 ambulatory facilities (92 are IHS operated, 476 are tribally operated) in 35 states, 20 serving a user population (i.e., the number of patients who used IHS-funded services at least once in the most recent 3 years) of 1.6 million. 19 Most of the ambulatory facilities are rural with limited availability of specialty providers. 21 Given the largely rural context with limited access to specialists, the IHS-JVN program was designed to recruit patients opportunistically when they present for primary care and to minimize referrals for specialty care.
The ATA validation categories do not include measures for non-DR findings, but such findings are common and may be associated with severe vision loss and/or general health risks. Thus, the JVN protocol was studied to ensure its capacity to identify non-DR findings as well (e.g., cataract, age-related maculopathy choroidal lesions, etc.). 22,23
A few telemedicine programs for DR are validated to ATA Category 3. The IHS-JVN is the largest primary care-based ATA Category 3 program in the U.S.
Government Performance and Results Act
The IHS-JVN conforms with Government Performance and Results Act (GPRA), which provides for annual, national reporting of defined clinical outcomes considered key indicators of health care quality. 24 The GPRA defines a qualified retinal evaluation as: (1) a dilated retinal evaluation by an optometrist or ophthalmologist; (2) seven standard fields stereoscopic photos (ETDRS) evaluated by an optometrist or ophthalmologist; or (3) any photographic method formally validated to seven standard fields (ETDRS). The IHS-JVN satisfies the latter of these options.
Clinical Workflow
Clinical workflow of the IHS-JVN begins with opportunistic recruitment of patients during primary care encounters (Fig. 1). A certified Imager acquires a standardized series of retinal photographs specific to one of two imaging technologies (described below) and conducts limited diabetes and DR education during the encounter, using the patients' retinal images as conversation points. The Imager also looks at the patients' images to determine whether urgent assessment is needed from the Reading Center for possible urgent or sight-threatening findings (i.e., STAT read).

Intended clinical workflow of the IHS-JVN program. IHS-JVN, Indian Health Service-Joslin Vision Network.
The images are saved locally and then securely transmitted to the IHS-JVN National Reading Center at the Phoenix Indian Medical Center (PIMC) for assessment according to a standardized protocol performed by certified optometrist, teleretinal Readers with ophthalmologist oversight. The Reader diagnoses DR and DME severity level by using ETDRS rules-based, validated computer-assisted decision support and recommends a management plan in a report sent to the patient's primary care provider and imported into the electronic health record (EHR). If follow-up eye or other specialty care is needed, it is the responsibility of the primary care staff to make that referral. There are currently four Readers at PIMC.
Technologies and Protocols
The IHS-JVN technology has a modular architecture and a suite of applications for image acquisition, database management/monitoring/reporting, picture archiving and communication system, image display/post-imaging processing, study reading/reporting with computer-assisted decision support, and quality assurance (QA).
Image acquisition
The program uses two configurations of commercially available technology for image acquisition. The first configuration uses a low-illumination, nonmydriatic fundus photography (NMFP) digital imaging system (Topcon NW6S; Topcon Medical Systems, Inc., Paramus, NJ) with a custom digital camera back that provides low-light exposure capability to reduce reflexive pupillary constriction from multi-image light exposures (Megavision Retinal Image Capture; Santa Barbara, CA). 25 Three non-simultaneous stereo pair 45° (degree) and two non-simultaneous stereo pair 30° digital images of the retina of each eye are obtained. One external image of the anterior segment of each eye is also obtained. The NMFP showed substantial agreement with ETDRS controls for diagnosis of DR severity level (unweighted κ = 0.81, 95% confidence interval = 0.73–0.89). 25
The second configuration is nonmydriatic ultrawide-field imaging (UWFI) scanning laser ophthalmoscopy (Daytona, Optos, plc, Dunfermline, United Kingdom). The UWFI protocol includes non-simultaneous stereo pair 200° images from each eye, centered on the macula. The UWFI showed perfect agreement with ETDRS photography in 84% of cases, and agreement within one level of severity in 91% of cases (unweighted κ = 0.79). 26
The IHS-JVN introduced UWFI to the program in 2014. It has become the default imaging system for new deployments and upgrades, because it has greater clinical accuracy, requires fewer images, incorporates automatic image acquisition, and lowers the proportion of poor images from which Readers cannot make a diagnosis of DR/DME severity level. 27 However, the NMFP retinal imager is portable and durable, so it is still used in smaller and more remotely located settings requiring a durable and/or portable imager.
Image grading
The IHS-JVN images are transmitted to the IHS-JVN National Reading Center via an internet-based medical informatics program called the Comprehensive Diabetes Management Program. 28 The software automatically imports patient demographics, diabetes duration, medications, laboratory data, blood pressure, and problem list from the EHR. The Imager manually supplements this information if needed.
The IHS-JVN DR grading details are shown in Table 1 (Category 3 column). In addition, grading for DME severity is based on stereoscopic assessment. Grades include: (1) absent; (2) not clinically significant, characterized by retinal thickening or hard exudates at or within 3,000 μm from the fovea or thickening in the posterior pole within the arcades, but outside the threshold for Clinically Significant Macular Edema (CSME); and (3) CSME, characterized by retinal thickening at or within 500 μm of the fovea, hard exudates at or within 500 μm of the fovea with adjacent retinal thickening, or one or more disk areas of retinal thickening, any part of which is within 1,500 μm of the fovea or with center involvement. 29
If a conclusive determination of the level of DR or DME cannot be made, the Reader reports the study as ungradable for that condition. Stereo imaging and overlapping retinal fields provide redundancy of data within a single retinal field, so images may be ungradable for one condition but sufficient to grade for another. An ungradable outcome triggers a recommendation for referral. Usually, the recommended follow-up is within 3 months; however, the timeframe may be shorter depending on the basis for ungradability, whether other pathology is found, the patient's health status, and other factors.
Non-DR abnormalities evident in the images are included in the management recommendations. 22,23
Image reporting
The Reader generates a report for each IHS-JVN study, which is sent to the originating site for communication to the patient via their primary care physician or any other member of the primary care team. The report includes available information on patient risk factors for progression of DR/DME, DR/DME severity, findings of nondiabetic eye disease, and the recommended management plan (Table 2). The recommended plan may suggest modification of identified DR risk factors, repeat IHS-JVN imaging, or referral to an eye care provider, primary care provider, or appropriate specialty provider.
Content from IHS-JVN Grading Report, Two Example Patients
This information was obtained from real IHS-JVN Reading Center reports and reformatted for this table. Background information is not shown to protect patient privacy.
HDL, high-density lipoprotein; LDL, low-density lipoprotein; IHS-JVN, Indian Health Service-Joslin Vision Network; PCP, primary care provider.
Training
Standardized training of Imagers and Readers and structured QA protocols are used to promote ongoing fidelity with the validation studies by both existing and newly added sites.
Imager training begins with home-based, self-paced pre-training on ocular anatomy, DR, and telemedicine fundamentals before reporting to PIMC for a 2- or 3-day syllabus on UWFI or NMFP technology, respectively. This training includes structured exposure to Reading Center administrative and reading activities to facilitate the Imager's ability to request an urgent reading for possible urgent or sight-threatening findings. Provisional Imager certification is conveyed based on demonstrated technical, clinical, and administrative proficiency. Full certification is conveyed after 6 months of experience and 100 IHS-JVN patient encounters demonstrating successful quality reviews. Full certification is maintained by ongoing successful quality reviews or by formal retraining and recertification.
Reader training is provided to optometrist applicants with recent clinical experience. Most applicants come from IHS health care facilities. Home-based, self-paced pre-training emphasizes DR pathophysiology and foundational clinical trials. 17,30,31 This is followed by 3 days of Reader training at JDC (Boston). Provisional Reader certification is conveyed on demonstrated proficiency of: (1) application of ETDRS-based interpretation of JVN digital images (NMFP and UWFI) in native stereoscopic format, with and without post-imaging processing enhancement, as compared with reference ETDRS image sets; and (2) post-imaging processing and other reading tools, computer-assisted decision support, and standardized reporting. Full Reader certification is conveyed after 6 months of successful interpretation of the images and use of the technology as determined by senior Reading Center staff. Full certification is maintained by ongoing successful quality reviews, focused training stemming from structured peer review, or by formal retraining and recertification.
Quality Assurance
Ongoing QA is a requirement of accreditation regulations and the ATA DR practice guidelines. The IHS-JVN is carefully monitored end-to-end, with the outcome used for performance improvement as described by ATA recommendations. 15,16 Imagers and Readers are assessed for volume, recency, and proficiency of administrative and clinical performance. Technical support quality is similarly assessed. The overall program is assessed through monitoring of Reading Center latency (routine and STAT reads), reading queue, hosting site productivity, and hosting site annual DR examination rate. QA reporting is used internally to guide staff and provider education, provider re-credentialing, and regulatory compliance.
Outcomes
Outcomes to measure success of the program include: (1) geographical adoption by IHS and Tribal programs thus far and clinical volume; (2) improved DR surveillance rate with an associated improvement in DR treatment rate; (3) cost-effectiveness compared with a conventional examination; (4) technology testing for improved clinical performance and operational efficiency; and (5) expansion of epidemiologic data on DR and DME in AI/AN.
Geographical adoption and clinical volume
IHS health care services are administered through 12 administrative area offices and the IHS-JVN is currently active in 11: Alaska; Albuquerque; Bemidji; Billings; Great Plains; Nashville; Navajo; Oklahoma; Phoenix; Portland; and Tucson. 32 As of the final quarter of fiscal year 2019, the IHS-JVN program had 99 active sites, distributed across 23 states (Fig. 2). In fiscal year 2019, the IHS-JVN imaged 29,958 unique patients. Since the program was initiated, it has conducted 226,333 studies cumulatively. In the past 3 years, during which the program cumulatively imaged 62,091 patients, we estimate that the program served about 25% of the IHS user population with diabetes.

Location of all IHS-JVN sites active in fiscal year 2019.
Facility participation in the IHS-JVN program is optional for IHS and tribal facilities. Facilities apply to participate and the program evaluates their eligibility, taking into consideration the facility's number of patients with diabetes, their existing annual DR examination rate (GPRA), and the clinical, technical, and business ability of the facility to support ongoing operations of the IHS-JVN. As facilities apply, the program will continue to expand to serve more patients.
DR examination rate
A retrospective study of the annual (1999–2003) rates of DR examinations and follow-up laser treatment was conducted at PIMC, the site of the first IHS-JVN deployment in 2000. A nearby PIMC satellite clinic without the IHS-JVN was used for comparison. 33 Although the annual DR examination rates at the comparison clinic remained stable over the period of study, ranging from 51% to 59%, PIMC's annual DR examination rate increased from 50% in 1999 to 75% in 2003. The rate of laser treatment for the satellite clinic was not reported, but there was a parallel 51% increase in laser treatment for DR at PIMC in the same population during the same period.
There has been a similar trend in the national GPRA reports. Specifically, the national rate of annual DR examinations increased from 49.0% to 61.3% during 2007–2015. 34 This 25% increase in exam rates was due to both IHS-JVN exams and conventional eye exams. Because there was not a significant change in conventional eye examination capacity within the IHS in this period, 35 we believe that the IHS-JVN contributed substantially to the rate change.
Cost-effectiveness
A modeled economic analysis found that the IHS-JVN was more cost-effective than a conventional dilated retinal examination in detecting proliferative DR (PDR) and identifying patients requiring intervention to prevent vision loss. 36 Specifically, the analysis showed that the IHS-JVN would detect an additional 148 cases of PDR over conventional eye exams while lowering costs by $525,690. One hundred thirty-nine more patients would receive laser treatment for their PDR, at a cost savings of $195,210. Five fewer patients would develop severe vision loss while saving another $324,810.
Technology testing
The performance of UWFI was compared with NMFP in the IHS-JVN over a 1-year period and 25,635 patients. 37 The UWFI resulted in more than an 80% decrease in the image ungradable rate, doubled the rate of diagnosed DR, identified a more severe rate of DR in 9% of patients, and prevented unnecessary referrals in more than 4,000 patients.
DR/DME epidemiology
Prior reports of DR prevalence in AI/AN were dated, and research on DME in AI/AN was lacking. Thus, the IHS-JVN analyzed retrospective data from 53,998 consecutive patients imaged nationally by the program between November 1, 2011 and October 31, 2016 to determine the prevalence of: levels of DR and DME; presence/absence of any DR; and presence/absence of sight-threatening retinopathy (STR), defined as severe NPDR, any PDR, or any DME. 38 The analysis found any level of DR in 17.7% of patients and STR in 4.2% of patients. A subset analysis of the UWFI images (n = 16,535) found any level of DR in 28.2% of patients and STR in 5.4%. This latter finding suggests that the wider field of view and lower ungradable rate of UWFI particularly make it easier for Readers to see mild and moderate NPDR. That analysis was reported in the most comprehensive, peer-reviewed publication describing DR and DME prevalence and severity in AI/AN to date. 38
Discussion
The IHS-JVN is a large, nationally distributed, primary care-based, teleophthalmology program for AI/AN that is validated at ATA Validation Category 3 for the remote diagnosis and management of DR/DME severity levels and certain non-DR disease. Because Category 3 programs are complex and costly to operate, they are reserved for use in specific circumstances. 14 The IHS circumstances are such that referred specialty care may be limited. This makes the higher DR severity referral threshold, lower referral rate, and specific management plan reported to the primary care staff particularly important in the IHS. Cost-avoidance is also critical in the IHS due to lower per capita funding of health care for AI/AN than that of the general U.S. population. 20,39 Improving the timeliness of DR examinations with the IHS-JVN decreases DR/DME complications and allows for less costly and more effective interventions.
Adoption of innovation can be challenging for organizations wishing to improve processes and outcomes. 40 Although the value of teleophthalmology for DR has been established, 41,42 the IHS has shown less rapid adoption of the IHS-JVN than anticipated. This is unexpected since the program funds all costs of the equipment needed, the Imager training, the Reading Center services, and ongoing technical support. Sites pay their Imager's salary, usually a fraction of a full-time equivalent, and provide space for the imaging encounters. Imager salary costs can potentially be offset if sites bill third party payers for the technical component of the telemedicine services. Based on the literature and anecdote, we speculate that clinical inertia, 43,44 professional resistance, 45 the threat of workflow disruption to the clinic, 46 and competition for staffing/space (anecdote) are likely barriers to program adoption.
Looking ahead, a next step for the IHS-JVN program is to quantify its public health impact. As mentioned, the annual DR examination rate among IHS tribal facilities (as tracked by GPRA) has increased annually, in parallel with expansion of the IHS-JVN. This implies a favorable correlation between the two historical trends. But various administrative barriers have precluded retrospective statistical tests of this correlation. In addition, after 2015, changes in the data collection process of this DR GPRA element limit comparison of current and prior (pre-2015) examination rates. Prospectively examining the DR examination rate at existing and new IHS-JVN sites and counting which annual DR exams at these sites are from the program versus a conventional eye exam is needed. This would give administrators and providers guidance on how the IHS-JVN can help clinical performance, regulatory compliance, and utilization at existing sites and improve public health overall.
Recently, artificial intelligence has gained attention as a way to increase access to cost-effective screening for DR, particularly in low- and middle-income countries. 47 However, existing artificial intelligence systems for diagnosing DR are not validated at ATA Category 3, nor has the performance of these systems been evaluated in AI/AN populations. 48 For the IHS-JVN context, artificial intelligence is an opportunity for the program to enhance Reading Center performance, rather than replace manual grading and interpretation of retinal images. Specifically, the program plans to use artificial intelligence algorithms to triage patients with no or mild DR so that patients with more severe DR can be prioritized in the Readers' queue, shortening the reading latency for these cases.
Footnotes
Acknowledgments
The opinions expressed in this article are those of the authors and do not necessarily reflect the views of the Indian Health Service.
Disclosure Statement
S.J.F. is Vice President for Research, Estenda Solutions, Inc.; S.-E.B. is a scientific consultant for SocialEyes Corp., and sub-contractor for Estenda Solutions, Inc.; D.G.L. is President, Estenda Solutions, Inc.; D.C. and D.S. are federal employees of the IHS; and M.B.H. developed and directed the IHS-JVN as a federal employee of the IHS 2000–2017 and is now retired from federal service. The authors have no other disclosures to report.
Funding Information
Estenda Solutions, Inc., is subcontracted by the IHS Tele-retinal program to provide required infrastructure, technology, and research support. This work was supported under that subcontract, HHSI236201600002C.
