Abstract
Background:
The kidney failure risk equation (KFRE) can be used to predict progression to end-stage kidney disease in a clinical setting.
Objective:
Evaluate implementation of a formalized risk-based approach in nephrologists’ outpatient clinics and multidisciplinary chronic kidney disease (CKD) clinics to determine candidacy for multidisciplinary care, and the impact of CKD care selection on clinical outcomes.
Design:
Population-based descriptive cohort study.
Setting:
Alberta Kidney Care South.
Patients:
Adults attending or considered for a multidisciplinary CKD clinic between April 1, 2017, and March 31, 2019.
Measurements:
Exposure—The course of CKD care assigned by the nephrologist: management at multidisciplinary CKD clinic; management by a nephrologist or primary care physician. Primary Outcome—CKD progression, defined as commencement of kidney replacement therapy (KRT). Secondary Outcomes—Death, emergency department visits, and hospitalizations.
Methods:
We linked operational data from the clinics (available until March 31, 2019) with administrative health and laboratory data (available until March 31, 2020). Comparisons among patient groups, courses of care, and clinical settings with negative binomial regression count models and calculated unadjusted and fully adjusted incidence rate ratios. For the all-cause death outcome, we used Cox survival models to calculate unadjusted and fully adjusted hazard ratios.
Results:
Of the 1748 patients for whom a KFRE was completed, 1347 (77%) remained in or were admitted to a multidisciplinary CKD clinic, 310 (18%) were managed by a nephrologist only, and 91 (5%) were referred back for management by their primary care physician. There was a much higher kidney failure risk among patients who remained at or were admitted to a multidisciplinary CKD clinic (median 2-year risk of 34.7% compared with 3.6% and 0.8% who remained with a nephrologist or primary care physician, respectively). None of the people managed by their primary care physician alone commenced KRT, while only 2 (0.6%) managed by a nephrologist without multidisciplinary CKD care commenced KRT. The rates of emergency department visits, hospitalizations, and death were lower in those assigned to management outside the multidisciplinary CKD clinics when compared with those managed in the multidisciplinary care setting.
Limitations:
The follow-up period may not have been long enough to determine outcomes, and potentially limited generalizability given variability of care in multidisciplinary clinics.
Conclusions:
Our findings indicate that a portion of patients can be directed to less resource-intensive care without a higher risk of adverse events.
Trial registration:
Not applicable.
Introduction
Chronic kidney disease (CKD) is common, affecting approximately 10% of the population, 1 and is a significant risk factor for adverse outcomes, including morbidity, hospitalization, and cardiovascular events. 2 Slowing progression of CKD through early detection and management is important for people at all stages of kidney disease. 3 While identifying people at highest risk of progression is challenging, 4 tools such as the kidney failure risk equation (KFRE) can be used to predict the risk of progression to end-stage kidney disease (ESKD). 5 The KFRE uses age, sex, estimated glomerular filtration rate (eGFR), and urine albumin-creatinine ratio (ACR). It has been validated in multiple international cohorts and studied in the context of risk-based triage for nephrology referrals.6-9 However, there is limited knowledge regarding implementing the KFRE in outpatient multidisciplinary CKD clinics to support clinical decision-making regarding triage, intensity of care, and the effects on clinical outcomes for people with CKD.
While most people with early stages of CKD can be cared for in the primary care setting, 10 individuals with advanced CKD are more appropriately managed in a team-based setting that consists of nephrologists, nurses, dietitians, social workers, and pharmacists. These multidisciplinary CKD clinics aim to slow disease progression, manage comorbidities and symptoms, prepare individuals for kidney replacement therapy (KRT), and have been shown to improve health outcomes and provide cost-effective care. 11 However, there is heterogeneity in multidisciplinary team structure, admission criteria, follow-up, and processes. 12 For people with CKD, the lack of objective criteria to guide CKD clinic management may lead to a mismatch between the course of CKD care (intensity and complexity of care) that they receive, compared with what is needed.13,14
This study is part of a multiphase project evaluating a KFRE-based approach to guide CKD care. 15 The aim was to evaluate implementation of a formalized risk-based approach in nephrologists’ outpatient clinics and multidisciplinary CKD clinics to determine candidacy for multidisciplinary care, and the impact of CKD care selection on clinical outcomes, including kidney failure, death, emergency department (ED) visits, and hospitalizations.
Methods
Risk-Based Approach to Guide CKD Intensity of Care Initiative
Prior to formalizing the KFRE into clinical care (ie, clinical policy), we identified stakeholder perspectives (patients, family members, nurses, nephrologists, and allied health) on potential implementation challenges and solutions. These included the ability for nephrologists to override the KFRE recommendation based on their knowledge of patient characteristics (eg, comorbidities) and nephrologist and patient shared decision-making for referral back to their primary care physician (PCP). 16 In addition, stakeholders co-created an implementation plan that included a staff communication strategy, implementation support from a research team member, and education and training of nephrologists and staff.
In 2017, the KFRE was integrated into the nephrology electronic medical record (EMR) in nephrologists’ outpatient clinics and multidisciplinary CKD clinics in the Calgary Health Zone, Alberta, Canada, to guide clinician decisions regarding the intensity of care for patients with CKD. The KFRE was applied to patients currently in a multidisciplinary CKD clinic (prevalent patients) at their first routine visit following implementation as well as to new patients being considered for multidisciplinary care by their nephrologists at a routine general nephrology visit (incident patients), with a recommendation for course of CKD care based on their 2-year risk of kidney failure. Only a portion of patients seen by nephrologists in their clinics were considered for multidisciplinary care and, therefore, had a KFRE completed. Incident and prevalent patients at higher risk of kidney failure (2-year risk ≥ 10% or eGFR ≤ 15 mL/min/1.73 m2) were recommended to receive multidisciplinary care. Patients with a moderate-risk KFRE (2-year risk 3%-9.9%) were recommended to receive care from general nephrology (remaining under the care of their primary nephrologist). Patients with a low-risk KFRE (2-year risk < 3%) could be referred back to care by their PCP.
Study Setting and Population
The multidisciplinary CKD clinic provides team-based care involving nephrologists, nurses, dietitians, pharmacists, and social workers with expertise in CKD care. Patients attending the clinic are seen by their primary nephrologist, along with one or more team members based on their current health care needs. Eligible participants for the main cohort included both prevalent and incident patients. We included adults (≥18 years old) residing in the Calgary Zone who had attended or were considered for a multidisciplinary CKD clinic between April 1, 2017, and March 31, 2019 (Figure 1). We excluded anyone who had commenced KRT prior to the last KFRE assessment and recommendation between April 1, 2017, and March 31, 2019 (ie, the index date). The last recommendation for course of CKD care was most relevant in describing the patient’s disposition during the follow-up period, while we chose the accrual period for those who attended or were considered for a multidisciplinary CKD clinic to maximize the size of that group while having at least 1 year of follow-up data.

Flow diagram of study main cohort.
Outcomes and Covariates
We linked operational data from the clinic (available until March 31, 2019) with administrative health and laboratory data from Alberta, Canada (available until March 31, 2020). 17 Patient consent was not applicable for this study. The primary outcome was CKD progression, defined as commencement of KRT (chronic dialysis or preemptive kidney transplant). Secondary outcomes included all-cause ED visits, hospitalizations, and death. The exposure was the course of CKD care assigned by the nephrologist after the last KFRE assessment between April 1, 2017, and March 31, 2019: remain at or admit to a multidisciplinary CKD clinic; management by a nephrologist (without multidisciplinary CKD care); or management by a PCP. All covariates were defined at the index date. We used patients’ postal codes to include only those residing within the Calgary Zone, an administrative health region which in 2018 comprised 1.6 million people. 18 We also used postal codes to link with aggregated federal census data to obtain neighborhood household income quintile and urban/rural location. Mean eGFR was calculated from all outpatient serum creatinine measurements in the prior year, using the CKD-EPI equation. 19 We assessed albuminuria using the most recent urine ACR in the prior year; if an ACR was not available, we used the most recent protein-creatinine ratio (PCR), and if neither were available, we used the most recent urine protein dipstick result. Albumin-creatinine ratio was imputed from PCR and sex using a method developed by our group 20 and from the dipstick result using a similar method based on same-day ACR and dipstick tests, which also incorporated age, sex, eGFR, and diabetes. We defined comorbidities using validated algorithms based on diagnostic codes in administrative health data 21 and we calculated 2-year kidney failure risk using the 4-variable KFRE (age, sex, the most recent ACR [measured or imputed], and eGFR). 5
External Cohort
To make a general comparison with patients who were at risk of kidney failure but not managed at a multidisciplinary CKD clinic, we also identified a group of patients who were ≥18 years old, residing in the Calgary Zone, with a mean eGFR <45 mL/min/1.73 m2 based on all outpatient serum creatinine measurements in the year ending March 31, 2018, and who did not attend nor were considered for a multidisciplinary CKD clinic between April 1, 2017, and March 31, 2019 (Figure 2). Note that some patients in the external cohort may have attended the clinic before April 1, 2017, or after March 31, 2019. A cut-off eGFR of 45 mL/min/1.73 m2 was chosen to include patients who were similar to those being considered for multidisciplinary care. Also, we chose an index date of April 1, 2018, which was the mid-point of possible index dates for the main cohort.

Flow diagram of study external cohort.
Statistical Analyses
Initially, we assessed the variation in clinical and demographic characteristics and health service utilization across the 3 courses of care: multidisciplinary CKD care, nephrologist care, and PCP. We also compared the proportion commencing KRT by course of CKD care, category of kidney failure risk, and patient location at the time of KFRE completion (multidisciplinary CKD clinic vs nephrologist’s clinic). In addition, among those who commenced KRT, we compared initial modality and the location of initial KRT by course of CKD care. We compared the ED visit and hospitalization count outcomes by course of CKD care with negative binomial regression count models and calculated unadjusted and fully adjusted incidence rate ratios (IRRs). For the all-cause death outcome, we used Cox survival models to calculate unadjusted and fully adjusted hazard ratios (HRs). All statistical analyses were conducted in Stata 17 (StataCorp, College Station, Texas). Ethical approval to conduct this research was granted by the University of Calgary Conjoint Health Research Ethics Board.
Results
A total of 1748 patients qualified for the main cohort. Figure 3 shows that of this group, 1465 (83.8%) were attending a multidisciplinary CKD clinic while 283 (16.2%) were being managed by a nephrologist. Table 1 summarizes patient demographic and clinical characteristics by the course of CKD care assigned after application of the KFRE. Patients who remained at (or were admitted to) a multidisciplinary CKD clinic were younger, more likely to be male, had a lower eGFR, and more severe albuminuria than those who were managed by a nephrologist or PCP alone. These characteristics all contributed to a much higher kidney failure risk among patients managed in multidisciplinary CKD care (median 2-year risk of 34.7% compared with 3.6% among those managed by a nephrologist, and 0.8% among those managed by their PCP alone).

Course of CKD care result after KFRE application.
Baseline Clinical and Demographic Characteristics of the Main and External Cohorts.
Note. Numbers are percentages unless otherwise indicated. CKD = chronic kidney disease; PCP = primary care physician; KFRE = kidney failure risk equation; IQR = interquartile range; eGFR = estimated glomerular filtration rate; ACR = albumin-creatinine ratio; PCR = protein-creatinine ratio; UDIP = urine dipstick/
Among those not considered for the clinic, eligibility for the cohort was based on mean eGFR in the past year being <45 mL/min/1.73 m2. However, some individuals’ most recent eGFR was >45 mL/min/1.73 m2.
Course of CKD Care Versus 2-Year Kidney Failure Risk Category
Among the 1748 patients in the main cohort, nephrologists overrode the tool’s recommended action for 147 (8.4%) (Table 2). In 122 cases (7.0%), patients were managed in multidisciplinary CKD care despite the KFRE tool giving a kidney failure risk of <10% and the eGFR being >15 mL/min/1.73 m2. The most frequently provided reason was that the patient had multiple comorbidities which the nephrologist thought could be better managed at a multidisciplinary CKD clinic. In 25 cases (1.4%), patients were managed outside of a multidisciplinary CKD clinic despite the tool calculating a kidney failure risk of >10%. Most frequently, nephrologists either described the patient as stable or noted there had only been one KFRE assessment done.
Kidney Failure Risk Category and Course of CKD Care (Main Cohort).
Note. CKD = chronic kidney disease; PCP = primary care physician; KFRE = kidney failure risk equation; eGFR = estimated glomerular filtration rate.
Indicates patients who were assigned to management by a nephrologist or PCP despite a KFRE-based recommendation for multidisciplinary CKD care.
Indicates patients who were managed in multidisciplinary CKD care despite a KFRE-based recommendation for management by a nephrologist or PCP.
Characteristics of People Who Commenced KRT by Course of CKD Care
A total of 360 patients (2.1%) commenced KRT in the year following the index date. Overall, the proportion commencing KRT in 1 year increased with increasing kidney failure risk, from 0.06% among those with low risk (2-year risk < 3%) to 17.4% among those with high risk (2-year risk > 10%) (Table 3). In addition, within the high-risk category, those who were managed in a multidisciplinary CKD clinic had a much higher probability of commencing KRT than other high-risk patients. Similarly, patients who were managed in multidisciplinary CKD care had a much higher probability of commencing KRT (23.5%) compared with those who were managed by their nephrologist or PCP (0.5%). None of the 91 patients managed by their PCP commenced KRT, while only 2 of 310 (0.6%) who were managed by a nephrologist commenced KRT. Among patients receiving care at a multidisciplinary CKD clinic, 0 of 122 commenced KRT with a kidney failure risk of <10%. Meanwhile, 1 of 25 patients who were managed outside of a multidisciplinary CKD clinic commenced KRT with a kidney failure risk of >10%; however, this patient was referred out of the multidisciplinary CKD clinic because dialysis initiation had already been planned. Finally, among patients who commenced KRT, 44% of those who were managed in multidisciplinary CKD care started on peritoneal dialysis (PD).
Characteristics of Patients Commencing KRT Within 1 Year of Index Date, by Course of CKD Care (Main and External Cohorts).
Note. KRT = kidney replacement therapy; CKD = chronic kidney disease; PCP = primary care physician; KF = kidney failure; eGFR = estimated glomerular filtration rate.
Prevalent Versus Incident Patients
The 1465 patients who were already attending a multidisciplinary CKD clinic had a higher mean 2-year risk of kidney failure (36.0%) than the 283 who were being considered for admission (17.2%). Correspondingly, 83% of those attending a multidisciplinary CKD clinic remained there, while only 44% of those being considered were admitted. Among those initially attending a multidisciplinary CKD clinic, 297 commenced KRT, of whom 295 remained there; while of those considered for a multidisciplinary CKD clinic, 22 commenced KRT, all of whom were admitted to a clinic.
All-Cause ED Visit, Hospitalizations, and Death
The unadjusted model for ED visits shows that patients who were assigned to management outside a multidisciplinary CKD clinic (nephrologist or PCP care) had approximately half and two-thirds as many ED visits as those who were managed at the multidisciplinary CKD clinic, respectively (Table 4). Similarly, the unadjusted rate of hospitalizations for both groups was just over half the rate of those who remained at or were admitted to a multidisciplinary CKD clinic. After adjustment for covariates, the differences for both outcomes were attenuated substantially, with only the rate of ED visits among those managed by their nephrologist being significantly lower than those who remained at or were admitted to a multidisciplinary CKD clinic (IRR = 0.79, 95% confidence interval [CI] = 0.63-0.99). Similarly, the unadjusted risk of death was substantially lower among those who were managed outside of the multidisciplinary CKD clinic, compared with those who remained at or were admitted (Table 4). Again, the differences were attenuated by adjustment for covariates, and the adjusted HRs were not statistically significant.
Models for the Association Between All-Cause Outcomes (ED Visits/Hospitalizations in the Year Following the Index Date, Death) and Course of CKD Care (Main and External Cohorts).
Note. ED = emergency department; CKD = chronic kidney disease; IRR = incidence rate ratio; HR = hazard ratio; PCP = primary care physician; eGFR = estimated glomerular filtration rate.
From negative binomial count models (ED visits and hospitalizations) or Cox survival models (death). Models were adjusted for age, sex, eGFR, albuminuria, urea, long-term care residence, rural residence, neighborhood income quintile, and all the comorbidities in Table 1. For the count models, exposure time was censored at death or 1 year after the index date.
External Cohort
Compared with the main cohort, patients in the external cohort were older and less likely to be male (Table 1). They also had comparable eGFRs and ACRs to those managed by PCPs in the main cohort. These characteristics contributed to a relatively low risk of kidney failure. Consistent with this, a much smaller proportion commenced KRT within 1 year than those who were managed by multidisciplinary CKD care, even among those who were at high risk of kidney failure (Table 3). Among those who did commence KRT, only 15% started on PD, and 66% of dialysis starts were as inpatients.
They also had an unadjusted rate of ED visits and hospitalizations that was about half of those who received multidisciplinary CKD care (Table 4). These differences were reduced substantially in the adjusted models but remained significantly lower for ED visits (IRR = 0.80, 95% CI = 0.70-0.92). Likewise, the unadjusted risk of death was substantially lower among patients in the external cohort compared with those who were managed by multidisciplinary CKD care (Table 4). This was attenuated by adjustment for covariates, but the risk of death was still significantly lower among those not considered for multidisciplinary CKD care (HR = 0.77, 95% CI = 0.65-0.92). Of the 122 people who were managed by multidisciplinary CKD care despite a kidney failure risk of <10%, 13 (11%) died.
Discussion
The KFRE may be used to guide a risk-based approach for management of patients with CKD22,23; however, the wide-spread adoption of clinical decision-support tools into clinical practice has been limited due to having to manually transcribe the KFRE variables into data fields, 24 and the lack of implementation planning to inform and direct nephrologists in clinical decision-making for patients with CKD. Our risk-based approach initiative integrating the KFRE into clinic EMRs along with a clinical policy within these clinics that clearly outlines the delivery of care defined by KFRE stratification, in addition to allowing for clinicians’ clinical judgment, can enhance the accuracy of the appropriate course of CKD care for patients with CKD. We conducted a population-based descriptive cohort study to evaluate the implementation of this initiative in nephrologists’ outpatient clinics and multidisciplinary CKD clinics to determine candidacy for multidisciplinary care and subsequent impact on clinical outcomes, including kidney failure, death, ED visits, and hospitalizations. Our overall findings indicate that after triaging using the KFRE, 14% of patients were transferred out and managed in less resource-intensive care settings (nephrologist or PCP clinics) and did not result in ESKD or have a higher risk of adverse clinical outcomes.
Multidisciplinary care can provide a holistic approach to care and is relevant for patients who are at high risk of ESKD; however, it is resource-intensive and costly, and may not be globally feasible. 11 Previous recommendations for multidisciplinary care relied on an eGFR <30 mL/min/1.73 m2 as the eligibility entry criterion, but this can be problematic as it has been shown the risk of progression to ESKD is low for a majority of such patients, so they do not require high-intensity management. 25 Considering patients with a KFRE 2-year risk >10% raises concerns that discharge from multidisciplinary clinics would potentially lead to rapid CKD progression, sooner death, and increased ED visits and hospitalizations. We found that this was not the case for any of these outcomes.
Multidisciplinary care is not warranted for low-risk patients and there is limited evidence demonstrating improvement in health outcomes for these individuals. 26 Our findings are consistent with prior studies implying that the KFRE is effective at selecting the highest risk subset of patients25,27 who benefit from more intensive management. Also, among those who remained at or were admitted to a multidisciplinary CKD clinic, 24% commenced KRT in 1 year, with many starting on PD compared with nonclinic attendees. This is likely related to individuals attending the clinic largely having planned dialysis starts where the multidisciplinary team prepared those at highest risk of kidney failure for dialysis through shared decision-making and education. More importantly, among patients who were reallocated to management by their nephrologist or PCP, only 2 commenced KRT and both had favorable clinical outcomes. Our results are in line with a recent Canadian study finding a lower occurrence of mortality and KRT for patients discharged from multidisciplinary care. 28
Clinical decision support such as the KFRE can be a useful adjunctive tool for clinical decision-making; however, in certain cases, clinical judgment should be considered. The utility of the nephrologists’ ability to override the recommendation of the KFRE tool based on clinical judgment was a key factor in adopting a risk-based approach to CKD care. In a small number of cases (7%) where the KFRE recommendation was managed outside of a multidisciplinary CKD clinic, nephrologists chose to follow these patients within a multidisciplinary CKD clinic because of their complex needs (ie, multimorbidity).
The results of the study should be considered with its limitations. While we were able to adjust for many clinical factors, there were likely additional characteristics we could not adjust for, raising the possibility of residual confounding. Our follow-up period was 1 year, which may not have been long enough to determine outcomes, especially for low-risk patients. In addition, we lacked data on the course of CKD care after March 31, 2019, so it is possible that some patients were admitted to a multidisciplinary CKD clinic during their outcome ascertainment period. Finally, the care provided by the multidisciplinary CKD clinics may differ from that offered by other multidisciplinary CKD clinics, limiting the generalizability of the study.
In conclusion, planned implementation of a risk-based approach for CKD care supports best practices to guide nephrologists in clinical decision-making regarding the course of CKD care for people with CKD. Our findings indicate that a reasonable number of patients can be directed to less resource-intensive care without a higher risk of adverse events. Future studies evaluating the long-term impact of a point-of-care risk-based approach on patient and health system outcomes are needed.
Footnotes
Acknowledgements
This study is based in part on data provided by Alberta Health and Alberta Health Services. The interpretation and conclusions contained herein are those of the researchers and do not necessarily represent the views of the Government of Alberta or Alberta Health Services. Neither the Government of Alberta nor Alberta Health or Alberta Health Services express any opinion in relation to this study. The results presented in this paper have not been published previously in whole or part, except in abstract format.
Ethics Approval and Consent to Participate
This study has been approved by the Conjoint Health Research Ethics Board (CHREB) at the University of Calgary.
Consent for Publication
All authors provided consent for publication.
Availability of Data and Materials
Data are available from the corresponding author upon reasonable request, according to the terms of the relevant Alberta privacy legislation and regulation.
Declaration of Conflicting Interests
The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding
The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This study was supported by the Canadian Institutes of Health Research (CIHR).
