Sage Journals: Discover world-class research

Abstract

Studies have established that nurse practitioners (NPs) deliver primary care comparable to physicians in quality and cost, but most focus on Medicare, a program that reimburses NPs less than physicians. In this retrospective cohort study, we evaluated the quality and cost implications of receiving primary care from NPs compared to physicians in 14 states that reimburse NPs at the Medicaid fee-for-service (FFS) physician rate (i.e., pay parity). We linked national provider and practice data with Medicaid data for adults with diabetes and children with asthma (2012-2013). We attributed patients to primary care NPs and physicians based on 2012 evaluation & management claims. Using 2013 data, we constructed claims-based primary care quality measures and condition-specific costs of care for FFS enrollees. We estimated the effect of NP-led care on quality and costs using: (1) weighting to balance observable confounders and (2) an instrumental variable (IV) analysis using differential distance from patients’ residences to primary care practices. Adults with diabetes received comparable quality of care from NPs and physicians at similar cost. Weighted results showed no differences between NP- and physician-attributed patients in receipt of recommended care or diabetes-related hospitalizations. For children with asthma, costs of NP-led care were lower but quality findings were mixed: NP-led care was associated with lower use of appropriate medications and higher rates of asthma-related emergency department visits but similar rates of asthma-related hospitalization. IV analyses revealed no evidence of differences in quality between NP- and physician-led care. Our findings suggest that in states with Medicaid pay parity, NP-led care is comparable to physician-led care for adults with diabetes, while associations between NP-led care and quality were mixed for children with asthma. Increased use of NP-led primary care may be cost-neutral or cost-saving, even under pay parity.

Keywords

nurse practitioners primary care health care quality health care costs Medicaid

What do we already know about this topic?

Studies have established that nurse practitioners (NPs) deliver primary care comparable to that of physicians in quality and cost, but most focus on Medicare, a program that reimburses NPs less than physicians.

How does your research contribute to the field?

In this retrospective cohort study, we evaluated the quality and cost implications of receiving primary care from NPs compared to physicians in 14 states that reimburse NPs at the Medicaid fee-for-service physician rate (i.e., Medicaid pay parity).

What are your research’s implications toward theory, practice, or policy?

Our findings suggest NP-led primary care in Medicaid could help address primary care shortages without sacrificing quality or raising costs for adults, even under pay parity, but further research is needed to understand the outcomes of NP-led care for children.

Introduction

High-quality primary care is important to prevent and manage chronic disease, avoid acute illness, and control health care costs, yet many Americans with chronic conditions such as diabetes and asthma lack access to a primary care provider.^1,2 The Association of American Medical Colleges has projected a shortage of 17,800 to 48,000 primary care physicians by 2034.³ Growing primary care shortages in many areas contribute to challenges with access to care, particularly for underserved populations such as Medicaid enrollees. Medicaid-enrolled patients have historically faced lower appointment availability and longer wait times, largely due to lower Medicaid reimbursement rates relative to other payers.⁴ Ensuring access to care for Medicaid enrollees is an ongoing challenge for states, and Medicaid expansion in many states has led to increased demand.⁵ As the supply of primary care physicians continues to decline, nurse practitioners (NPs) play a growing role in meeting demands for care.⁶

NPs are advanced practice registered nurses trained at the masters or doctoral level and licensed by states to assess patients, order and interpret diagnostic tests, make diagnoses, initiate and manage treatment plans, and prescribe medications.^7,8 NPs practice independently or as part of interprofessional teams with physicians. The NP workforce has grown rapidly in recent years, more than doubling between 2010 and 2017.⁹ Among the 355,000 licensed NPs in the US, 89% are credentialed to deliver primary care and 70% practice in primary care.¹⁰ Previous studies suggest primary care NPs are more likely than primary care physicians to practice in rural, underserved, and socioeconomically disadvantaged areas and accept Medicaid-enrolled patients.^11-13

Numerous studies have established that NPs deliver high-quality primary care comparable to physicians,^14-20 and previous studies have found similar or lower costs of primary care delivered by NPs versus physicians.^14-18 However, these previous studies have focused primarily on the Medicare population, and there is little evidence on the impact of NP-led care among younger populations. Similarly, there is little evidence on the effects of NP-led care on health care costs when NPs and physicians are reimbursed at the same rate (i.e., pay parity). Some state Medicaid programs reimburse NPs at the Medicaid fee-for-service (FFS) physician rate, but in many states Medicaid reimbursement for NPs is up to 25% less than reimbursement for physicians.¹⁹ Total patient costs may be similar for NPs and physicians under pay parity if the services received are similar. Under pay parity, impacts of NP-led care on costs should be driven by impacts on service use: total patient costs may be lower for NPs than physicians if NP-led care lowers overall service use, or vice versa.

Scope of practice laws may also have implications for the quality of care provided by NPs and total costs of care. In many states scope of practice laws limit NPs’ abilities to practice without physician oversight or collaboration.²⁰ Studies suggest that quality of NP-led care in states with full practice authority for NPs (FPA states) is similar or better compared to non-FPA states.^21-24 Findings regarding FPA and health care spending have been mixed. Some studies suggest FPA is associated with cost savings due to greater efficiency of care delivery,^21,25-27 while others suggest expanded access to care under FPA may generate higher costs due to increased service use.^28,29 Thus it remains unknown how patient costs may vary for NP-led care in states with Medicaid pay parity with and without FPA.

To address these gaps in the literature, our objective was to evaluate the quality and cost implications of receiving primary care from NPs compared to physicians in 14 states that reimburse NPs at the Medicaid fee-for-service physician rate (i.e., Medicaid pay parity), including five FPA states and nine non-FPA states. We conducted a retrospective cohort study focused on Medicaid-enrolled patients from 2012 to 2013 with two of the most prevalent chronic conditions: adults with diabetes and children with asthma. We used a validated method to attribute primary care patients to NPs and physicians and then used two complementary empirical strategies to estimate the effect of NP-led care on quality and costs: (1) entropy balancing to derive weights to adjust for observed differences in patients attributed to NPs and physicians, and (2) an instrumental variables analysis using differential distance from patients’ residences to primary care practices with NPs on staff to adjust for unobserved differences in patients attributed to NPs and physicians.

Methods

This study was approved with a waiver of consent by the lead author’s Human Subjects Protection Committee.

Data Sources

We obtained data on health care service use and costs from the 2012 and 2013 Medicaid Analytic Extract (MAX) files. Developed by the Centers for Medicare & Medicaid Services (CMS) to support research and policy analysis for Medicaid populations, MAX files include person-level information on Medicaid eligibility, service utilization, and payments.³⁰ MAX files include National Provider Identifiers (NPI) but do not include Tax Identification Numbers (TIN) or clinician addresses or ZIP codes. Though more recent data is available from the T-MSIS Analytic File (TAF), the new generation of Medicaid data available for all states from 2016 onward, further work is needed to understand usability of the TAF data for policy analyses, including the extent of quality issues common in Medicaid claims such as missingness and variability across states.³¹

We sampled primary care practices and providers using national health care provider and practice data from the 2012 and 2013 SK&A files (now called OneKey by IQVIA).³² The SK&A files contain data on office-based physician practices across the U.S., including practice specialty, number and type of providers within the practice, provider specialties, NPIs, and practice location (ZIP code and latitude/longitude). This information allowed us to identify NPs working in primary care, an advantage over other data sources.³³

Sample Construction

To select the sample of states, we reviewed 2012 and 2013 MAX data validation reports for the 27 states with Medicaid pay parity in 2012 (Appendix Table A1) to identify those with the most complete NPI data. We also considered usability of MAX encounter data for managed care enrollees.³⁴ Based on these criteria, we included 5 FPA states (Iowa, Maine, Oregon, Washington, Wyoming) and 10 non-FPA states (California, Delaware, Michigan, Missouri,ⁱ New Jersey, New York, Ohio, Tennessee, Utah, and Virginia).

We used 2012 to 2013 SK&A data to identify primary care practices in the states of interest. We defined the following practice specialties as primary care: adolescent medicine, family practice, general practice, general preventative medicine, geriatric medicine, internal medicine, internal medicine/pediatrics, multi-specialty, and pediatrics.³⁵ We characterized the provider mix in each practice as the percentage of providers (including physicians, NPs, and physician assistants) that were NPs. To ensure adequate representation of practices with a large share of NPs, we included in our sample all primary care practices in which at least 80% of providers were NPs. From the remaining pool of primary care practices, we sampled 100% of practices in small states and 33 or 67% of practices in mid- and large-sized states (Appendix Table A1). This was to ensure the size of the patient cohort was not intractably large. We generated a deduplicated list of NPIs for all providers in the sampled primary care practices in 2012 or 2013, resulting in a sample of approximately 60,000 NPIs. Any patient with one or more outpatient claims from any of the NPIs on our list was included in the final cohort of approximately 12 million Medicaid enrollees.

Next, we identified adults with diabetes and children with persistent asthma who were continuously enrolled in Medicaid during 2012 to 2013 (inclusive of both enrollees in FFS and comprehensive managed care) and had one or more primary care visits in 2012. We excluded individuals dually enrolled in Medicaid and Medicare because we did not have information on care paid by Medicare. The diabetes sample included adults ages 18 to 64 with diagnoses of diabetes reported in the Medicaid Enrollee Supplemental File (MESF) chronic conditions file. The pediatric asthma sample included children ages 5 to 17 who met claims-based criteria for persistent asthma.³⁶

Patient Attribution

We used a validated method to attribute patients to providers.³⁷ To ensure an established relationship with the attributed primary care provider, patient attribution was based on 2012 evaluation and management (E&M) services from the Berenson-Eggers Type of Services Codes for new (M1A: 99201-99205) and established office visits (M1B: 99211-99215). Patients were attributed to the provider who delivered the plurality of E&M visits paid by Medicaid (at least 30% of visits). We excluded E&M services from inpatient, emergency, or specialty care settings so that attribution would be based on primary care. After applying these criteria, no patients in Missouri were attributed to NPs, therefore we excluded Missouri from our analytic sample. We caution that, under typical coding practices, billing data cannot identify care delivered by NPs under indirect billing (when an NP performs services but bills under a physician’s name). Some care delivered by NPs may consequently be inaccurately attributed to physicians (see Discussion for details). The final patient sample included 49,907 adults with diabetes and 39,765 children with asthma (Appendix Figures A1 and A2).

Control Variables

Our analyses adjusted for patient demographic and clinical characteristics including age, sex, race/ethnicity, county rural/urban residence (metropolitan, non-metropolitan—adjacent to metropolitan areas, non-metropolitan—not adjacent to metropolitan areas),³⁸ state of residence, Medicaid enrollment type (FFS or comprehensive managed care), Medicaid eligibility category,ⁱⁱ and chronic condition count.

Dependent Variables

Quality measures

We constructed claims-based quality measures using 2013 data based on specifications from the Healthcare Effectiveness Data and Information Set (HEDIS) and the Agency for Healthcare Research and Quality (AHRQ). For adults with diabetes, we constructed the following indicators of comprehensive diabetes care (CDC): receipt of hemoglobin A1c testing, annual low density lipoprotein (LDL) screening, and medical attention for nephropathy.³⁶ We also constructed indicators of having all three CDC measures and having zero CDC measures. We did not examine receipt of a retinal eye exam, another indicator of comprehensive diabetes care, because we could not reliably identify provider specialty in the MAX data. We also identified adults having any preventable hospitalizations for complications of diabetes.³⁹ For children with persistent asthma, we constructed a measure of receipt of appropriate medications,³⁶ an indicator of having one or more emergency department (ED) visits for asthma,⁴⁰ and an indicator of having one or more hospital admissions for asthma.³⁹

Costs

Our cost analyses were limited to FFS enrollees (<10% of our patient sample) in a subset of states with available data.ⁱⁱⁱ Among the patients in our sample with FFS enrollment, we evaluated diabetes- and asthma-related Medicaid costs in 2013. We identified FFS claims with a principal diagnosis or second listed diagnosis for diabetes or asthma, respectively, and summed total annualized costs for inpatient visits, outpatient visits, and prescription drugs. Costs in each category were winsorized at the 99th percentile for those with non-zero spending. We calculated total costs per patient as the sum of inpatient, outpatient, and prescription costs. Due to documented issues with incomplete and inaccurate cost data for Medicaid managed care payments,^41-43 including missing encounters, inappropriate zeros, and negative values, we were unable to measure costs for managed care enrollees.

Statistical Analysis

We used two approaches to address observable and unobservable differences between patients receiving primary care from NPs and those receiving primary care from physicians. Analyses were estimated using data from all states and then for groups of states stratified by FPA versus non-FPA status. Analyses were performed in Stata version 16 and SAS version 9.4. For all analyses we used two-sided tests with alpha level of 0.05.

Weighting estimates of the effects of NP-led care

We used entropy balancing⁴⁴ to derive weights that balance differences in observable patient characteristics between those attributed to NPs and those attributed to physicians, including age, sex, race/ethnicity, rural/urban residence, state of residence, Medicaid enrollment type, and Medicaid eligibility category. Entropy balancing was chosen over propensity score methods for ease of use and computational speed. We evaluated outcomes before and after weighting to examine whether differences in quality and cost outcomes associated with NP attribution are driven by observable differences between patient groups.

Instrumental variables (IV) estimates of the effects of NP-led care

To avoid confounding due to unobservable differences between NP- and physician-attributed patients (i.e., due to self-selection into NP-led care based on unobservable factors affecting quality or cost of care), we also conducted an IV analysis.

In addition to examining provider-level attribution to an NP (which is the explanatory variable of interest in our weighting estimates), we constructed a practice-level attribution measure intended to capture whether patients were attributed to providers at a practice with one or more NPs on staff. Practice-level exposure to NPs is of interest because the presence of NPs in a practice may affect quality of care even if the patient’s attributed provider is a physician. Practice-level attribution may also help address mismeasurement of NP-led care due to indirect billing.

We followed previous studies in using differential distance as an instrument,^45-48 where differential distance is defined as the additional distance beyond the nearest primary care practice that a patient needs to travel to reach a practice that has one or more NPs on staff. We counted a practice as having NPs on staff if one or more NPs were linked to that practice in the SK&A data. Our differential distance calculations included the universe of primary care practices in the states of interest in SK&A. We used Google Maps Application Programming Interfaces to calculate the driving distance between patient ZIP code centroids and practice coordinates (latitude and longitude) obtained from SK&A (Appendix B-1).

We report estimates from linear regression models of quality measures on an indicator for NP attribution, patient demographic and clinical characteristics, and state fixed effects. Heteroskedasticity-robust variance estimates were used for statistical inference.⁴⁹ Linear regression models that do not use the instrument were estimated using ordinary least squares (OLS), while the IV models were estimated using two-stage least squares (2SLS). We also estimated nonlinear IV models using two-stage residual inclusion (2SRI).⁵⁰ Nonlinear models (logistic regression for binary patient-level quality measures, and Poisson regression for a count outcome) may be more efficient for the outcomes considered here, but in practice both sets of IV models were imprecisely estimated and yield similar findings: we therefore do not report the 2SRI estimates in this paper.

Differential distance to an NP practice is a strong predictor of NP attribution. The first-stage F-statistics on the differential distance instruments are 116 for adults with diabetes and 50 for children with asthma, both well above the threshold of 10 customarily viewed as a warning sign of weak instruments. First-stage F-statistics for practice-level attribution were even higher: 289 for children with asthma and 540 for adults with diabetes. Reduced-form and first stage estimates are reported in the Appendix (Tables A6 and A7), where we also discuss why additional assumptions required for IV to identify causal effects are likely to be met in this setting (Appendix B-2).

We also used our IV specification to estimate effects of provider-level and practice-level attribution on costs for the subsample of FFS patients for whom costs could be measured reliably. However, these IV estimates were too imprecise to be informative, and we do not report them.

Results

Rates and Correlates of NP-Led Care

Patient attribution to an NP was somewhat rare; 3.51% of children with asthma and 4.55% of adults with diabetes were attributed to an NP as their primary care provider, with the remainder attributed to a physician. Among adults with diabetes (Appendix Table A2), those attributed to NPs were slightly younger, more likely to be female, non-Hispanic White, and live in rural areas, and had differences in Medicaid eligibility category: more likely to be blind/disabled, more likely to qualify through Section 1931, less likely to qualify through Section 1115, less likely to be medically needy. Among children with asthma (Appendix Table A3), those attributed to NPs were slightly older, more likely to be non-Hispanic White and live in rural areas, and had differences in Medicaid eligibility category: less likely to be blind/disabled, more likely to qualify through Section 1115, less likely to be medically needy. Entropy balancing weights achieved balance on all characteristics (Appendix Tables A2 and A3).

Estimates of the Effects of NP-Led Care

Quality outcomes: Adults with diabetes

After weighting, adult patients with diabetes attributed to NPs had no significant differences in performance on hemoglobin A1c testing, LDL cholesterol screening, or medical attention for nephropathy compared to those attributed to physicians (Table 1; Figure 1A). Though patients attributed to NPs had significantly lower unadjusted performance on these outcomes, there were no significant differences after weighting for patient characteristics. The proportion of patients with diabetes-related hospital admissions did not differ significantly between patients attributed to NPs and physicians before or after weighting (Table 1; Figure 1B). Findings were similar in FPA and non-FPA states; there were no significant differences in weighted outcomes between NPs and physicians. Performance on diabetes quality measures was slightly better overall in FPA states (Appendix Table A4).

Table 1.

Standardized Differences in Quality Outcomes for Patients Attributed to Nurse Practitioners and Physicians, Overall and by FPA and Non-FPA States.

	Overall		Non-FPA states		FPA states
	Standardized difference^a		Standardized difference^a		Standardized difference^a
	Unweighted	Weighted	Unweighted	Weighted	Unweighted	Weighted
Adults with diabetes
Hemoglobin A1c testing performed	−0.04*	0.02	−0.07**	0.02	−0.06	0.01
LDL-C screening	−0.11***	0.02	−0.12***	0.03	−0.09	−0.01
Medical attention for nephropathy	−0.05*	0	−0.05*	−0.01	−0.03	0
All 3 performed	−0.12***	0	−0.13***	0.02	−0.13*	−0.06
None performed	0	−0.03	0.01	−0.02	−0.04	−0.1
Has one or more claims for diabetes-related admissions	−0.01	0.01	0	0.02	−0.05	−0.06
Children with asthma
Use of appropriate medications for children with asthma	−0.14***	−0.10**	−0.17***	−0.11**	−0.02	−0.03
Has one or more claims for asthma-related emergency department visits	0.02	0.06*	0.02	0.06	0.06	0.06
Has one or more claims for asthma-related admissions	−0.04	0	−0.05	0	0	0.01

Standardized difference calculated as average rate of outcome for NP-attributed patients minus average rate of outcome for physician-attributed patients.

P < .05. **P < .01. ***P < .001.

Figure 1.

Quality outcomes for adults with diabetes and children with asthma. A. Percent of Adults with Diabetes Receiving Recommended Care; B. Diabetes-Related Hospital Admissions; C. Percent of Children with Asthma Receiving Recommended Care; D. Asthma-Related Emergency Department Visits; E. Asthma-Related Hospital Admissions.

All regression models (OLS and IV) indicated that receiving NP-led primary care (measured via provider-level attribution) was not associated with any differences in quality of care for adults with diabetes (Table 2). While the IV point estimates for the effects of NP attribution were large, they were imprecisely estimated, having large standard errors, and none are statistically significant at 5%. Receiving care from a practice that had one or more NPs on staff was also not associated with any differences in quality of care across all IV models. Instrumental variables estimates for the effects of NP care in FPA versus non-FPA states were statistically insignificant at both the provider level and the practice level in both groups of states (Appendix Table A8).

Table 2.

Linear Regression and Instrumental Variables Analysis of Quality for Adults With Diabetes.

Outcomes	Hemoglobin A1c testing performed	LDL-C screening	Medical attention for nephropathy	All 3 procedures performed	None performed	Has one or more claims for diabetes-related admissions in 2013
Explanatory variable: Provider-level attribution to NP
OLS estimate (standard error [SE])	0.012 (0.010)	0.009 (0.011)	−0.003 (0.008)	0.003 (0.011)	−0.005 (0.005)	0.001 (0.003)
2SLS (IV) estimate (SE)	−0.393 (0.249)	−0.420 (0.265)	−0.335 (0.193)	−0.454 (0.285)	0.209 (0.131)	−0.117 (0.089)
Mean of outcome	0.759	0.709	0.873	0.615	0.055	0.023
N	49 855	49 855	49 855	49 855	49 855	49 855
Explanatory variable: Practice-level attribution to practice with NP(s) on staff
OLS estimate (SE)	0.025*** (0.005)	−0.002 (0.005)	0.008* (0.004)	0.005 (0.005)	−0.009*** (0.003)	−0.001 (0.002)
2SLS (IV) estimate (SE)	−0.077 (0.048)	−0.082 (0.051)	−0.065 (0.037)	−0.089 (0.055)	0.041 (0.025)	−0.023 (0.017)
Mean of outcome	0.759	0.709	0.873	0.615	0.055	0.023
N	49 855	49 855	49 855	49 855	49 855	49 855

Note. Standard errors are heteroskedasticity-robust. Instrument is differential distance from nearest primary care practice to nearest primary care practice with one or more NPs on staff. First-stage F-statistic for individual-level NP attribution was 116.1. First-stage F-statistic for practice-level NP attribution was 540.3. All models control for state fixed effects and all covariates listed in Appendix Table A2.

OLS estimate = coefficient on indicator for patient attribution to NP from OLS regression of quality measure on attribution indicator and covariates; 2SLS (IV) estimate = coefficient on indicator for patient attribution to NP from OLS regression of quality measure on attribution indicator and covariates; N = sample size for 2SLS model.

P < .05. ***P < .001.

Quality outcomes: Children with asthma

Children with asthma who were attributed to NPs had lower unadjusted performance on use of appropriate medications for people with asthma (59.0 vs 65.7%, P < .001) (Table 1; Figure 1C). After weighting, this difference was reduced, but not eliminated (59.0 vs 63.8%, P < .001). NP-physician differences in performance on the asthma medication measure were driven by non-FPA states; we did not observe a significant difference in FPA states (Appendix Table A5). Children with asthma attributed to NPs had a similar unadjusted rate of asthma-related ED visits compared to those attributed to physicians (10.7 vs 10.3%, P = .567) (Table 1; Figure 1D). However, after weighting, children with asthma attributed to NPs had a higher rate of asthma-related ED visits compared to those attributed to physicians (10.7 vs 8.9%, P = .033), with similar findings in FPA and non-FPA states. The proportion of patients with asthma-related hospital admissions did not differ significantly between patients attributed to NPs and physicians before or after weighting (Table 1; Figure 1E), and findings were similar in FPA and non-FPA states.

In IV models, NP-led primary care (measured via provider-level attribution) was not associated with any differences in use of appropriate medications, ED visits, or hospital admissions for children with asthma (Table 3). Results were similar in the IV models examining receipt of care from a practice that had one or more NPs on staff. IV estimates for the effects of NP-led care in FPA versus non-FPA states were also statistically insignificant at both the provider level and the practice level in both groups of states (Appendix Table A9).

Table 3.

Linear Regression and Instrumental Variables Analysis of Quality for Children With Asthma.

Outcomes	Use of appropriate medications for children with asthma	Has one or more claims for asthma-related emergency department visits in 2013	Has one or more claims for asthma-related admissions in 2013
Explanatory variable: Provider-level attribution to NP
OLS estimate (SE)	–0.047*** (0.013)	0.0180* (0.00853)	–0.000115 (0.003)
2SLS (IV) estimate (SE)	0.012 (0.460)	0.247 (0.298)	0.002 (0.122)
Mean of outcome	0.655	0.103	0.016
N	39 744	39 744	39 744
Explanatory variable: Practice-level attribution to practice with NP(s) on staff
OLS estimate (SE)	–0.012* (0.006)	0.00151 (0.00376)	–0.003 (0.001)
2SLS (IV) estimate (SE)	0.002 (0.072)	0.0386 (0.0464)	0.000 (0.019)
Mean of outcome	0.655	0.103	0.016
N	39 744	39 744	39 744

Note. Standard errors are heteroskedasticity-robust. Instrument is differential distance from nearest primary care practice to nearest primary care practice with one or more NPs on staff. First-stage F-statistic for individual-level NP attribution was 49.95. First-stage F-statistic for practice-level NP attribution was 289.11. All models control for state fixed effects and all covariates listed in Appendix Table A3.

P < .05.***P < .001.

Cost outcomes: Adults with diabetes

Among adults with diabetes, there were no statistically significant differences in FFS costs for NP- and physician-attributed patients (Figure 2A). Although unadjusted annual mean costs were lower for NP-attributed patients ($5525) than for physician-attributed patients ($8123, P = .065), the difference shrunk after weighting to achieve balance on observable characteristics (weighted annual mean cost for physician-attributed patients = $5815, P = .74). Findings with regard to NP-physician cost differences were similar in FPA and non-FPA states (Appendix Table A10).

Figure 2.

Fee-for-service cost outcomes for adults with diabetes and children with asthma. A. Mean Annualized Cost for Adults with Diabetes; B. Mean Annualized Costs for Children with Asthma.

Cost outcomes: Children with asthma

Among children with asthma, those attributed to NPs had lower total FFS costs compared to those attributed to physicians (Figure 2B). Unadjusted annual mean costs were lower for NP-attributed patients ($588) than physician-attributed patients ($1586, P = .02). After weighting, costs remained significantly lower among children attributed to NPs (weighted annual mean cost for physician-attributed patients = $1306, P < .01). Findings with regard to NP-physician cost differences were similar in FPA and non-FPA states (Appendix Table A11).

Discussion

To our knowledge, no previous studies have evaluated the cost and quality outcomes of NP-led primary care in a context with pay parity. Examining states with Medicaid pay parity, we found that NP-attributed adults with diabetes received comparable quality of care at similar cost to physician-attributed patients. Quality findings were mixed for children with asthma: NP-led care was associated with lower use of appropriate medications and a higher rate of asthma-related ED visits. However, rates of asthma-related hospitalization were not associated with NP-led care, and children with asthma had lower FFS costs under NP-led care. The association between NP-led care and health care quality or cost did not differ substantially in FPA states versus non-FPA states.

We observed notable demographic, geographic, and eligibility category differences among the population of Medicaid enrollees served by primary care NPs compared to those served by primary care physicians. These characteristics may be associated with quality and cost outcomes. For example, rural patients may face barriers with access to care, which could lead to lower rates of hemoglobin A1c testing and LDL cholesterol screening. In both populations examined here (adults with diabetes and children with asthma), patients attributed to NPs were more likely to live in rural areas. We also found that adults with diabetes who were attributed to NPs had differences in Medicaid eligibility category (i.e., more likely to qualify through Section 1931) that may suggest greater poverty compared to patients attributed to physicians. These findings are consistent with previous studies that suggest NPs are more likely than physicians to deliver primary care in rural and socioeconomically disadvantaged areas.^11-13

Our findings for adults with diabetes suggest that if NPs and physicians treated the same patients, then quality of care would be similar. Without adjusting for patient characteristics, adult patients with diabetes attributed to NPs were less likely to receive hemoglobin A1c testing, LDL cholesterol screening, and medical attention for nephropathy. The fact that weighting to balance these characteristics between NP- and physician-attributed patients eliminated most quality differences suggests that quality differences in the unadjusted data were driven by differences in patient population rather than differences in provider behavior. However, for children with asthma, weighting for observable patient characteristics did not eliminate NP-physician differences in quality, suggesting a need for further research to better understand outcomes of NP-led care for children with asthma and other pediatric populations.

A limitation of many previous studies comparing quality and cost for NP- and physician-attributed patients is potential confounding due to unobserved differences in patient characteristics that may influence quality and cost outcomes. In our main analysis, in which we used weights based on observable patient characteristics, some NP-physician differences in quality remained (i.e., lower performance on use of appropriate medications and a higher rate of ED visits for children with asthma attributed to NPs). In IV analyses, we found no evidence of a causal relationship between NP attribution and quality of care, or between presence of NPs at the practice level and quality of care. We caution that, as is typical in IV analyses, the IV estimates were less precise than other estimates in our analysis, and so our results do not rule out clinically meaningful quality differences. However, the findings do not provide any evidence that such quality differences exist.

We also note that the focus of our study (the effects of receiving primary care from an NP, which we measure via patient attribution) is a patient-level variable. Potential concerns about the misuse of patient-level IVs to estimate the effects of practice- or facility-level characteristics therefore should not apply in this context.⁵¹

Few studies comparing costs for NP- and physician-attributed patients have accounted for lower reimbursement of NPs. In one study, Medicare beneficiaries attributed to NPs had 18% lower costs than those attributed to physicians even after accounting for case mix and differences in reimbursement.¹⁴ Another study found that lower costs for NP-attributed Medicare beneficiaries were driven by lower service use by NPs, and NP-physician cost differences were greatest for low acuity patients.⁵² We found that Medicaid FFS costs were similar for NP- and physician-attributed adults with diabetes, but children with asthma who received care from NPs versus physicians had significantly lower FFS costs across all spending categories. Though we did not have detailed clinical data to examine NP-physician cost differences by patient acuity, children with asthma had fewer chronic conditions, on average, than adults with diabetes (1.0 vs 4.5). Further research is needed to understand the potential drivers of lower FFS cost for children with asthma attributed to NPs versus physicians, including potential differences in patient acuity and differences in the volume or type of services provided.

We interpret these results in the context of several limitations. First, our comparisons of costs are limited to Medicaid FFS enrollees and are imprecise, due in part to small sample sizes. Our findings related to cost may not be generalizable to managed care enrollees, as we excluded managed care enrollees from cost analyses due to concerns about inaccurate encounter payments.^42,43 In addition, the completeness of provider NPI data in Medicaid claims varies widely across states,⁵³ limiting the number of patients we could attribute to providers. Newer Medicaid data in the T-MSIS Analytic File (TAF) may have more complete information on NPI, so this problem may be mitigated in future work using more recent data. Our patient sample was further restricted by limiting to patients attributed to providers in primary care specialties, as designated in SK&A. Further, it is unclear to what extent Medicaid claims data accurately distinguish services provided by NPs versus physicians. Current coding practices do not identify care delivered by NPs under indirect billing when an NP performs services but bills under a physician’s name.^54,55 Studies that rely on billing provider NPIs may inaccurately attribute care delivered by NPs to physicians, in which case comparisons of NP- and physician-led care may be biased toward the null. Finally, recognizing that the best Medicaid data available for this study were several years old, and predated state Medicaid expansions, future research should explore if findings have changed as the Medicaid-insured population has grown.

Conclusion

In the context of shifts in the composition of the primary care workforce and growing demand for care, NPs play an important role in delivery of high-quality primary care to Medicaid-enrolled patients, particularly in rural areas. Our findings suggest that in states with Medicaid pay parity, NP-led care is comparable to physician-led care for adults with diabetes, while associations between NP-led care and quality were mixed for children with asthma. The associations estimated here also suggest that increased use of NP-led primary care could be cost-neutral or cost-saving. However, further work is needed to obtain more precise estimates of the causal effect of NP-led care on cost and quality, both in Medicaid and in other settings beyond Medicare.

Footnotes

Appendix A

Table A11.

Fee-for-Service Cost Outcomes: Children With Asthma.

Total annualized costs	Total (N = 1818)			NP-attributed patients (N = 96)			Physician-attributed patients (N = 1722)			Standardized difference in mean cost⁺
Total annualized costs	N non-zero	Mean	SD	N non-zero	Mean	SD	N non-zero	Mean	SD	Unweighted	Weighted
Outpatient
Overall	901	$402	$1241	36	$147	$322	865	$417	$1273	−0.29	−0.27***
Non-FPA	619	$448	$1409	15	$130	$370	604	$464	$1439	−0.318	−0.33***
FPA	282	$266	$458	21	$177	$217	261	$273	$472	−0.263	−0.22
Inpatient
Overall	58	$319	$1755	1	$45	$404	57	$335	$1801	−0.22	−0.19**
Non-FPA	44	$341	$1838	1	$71	$506	43	$354	$1879	−0.206	−0.19*
FPA	14	$256	$1481	0	$0	$0	14	$278	$1541	−0.255	−0.21***
Prescription
Overall	921	$600	$962	39	$345	$583	882	$615	$978	−0.34*	−0.37***
Non-FPA	626	$635	$1053	16	$293	$627	610	$652	$1067	−0.410	−0.52***
FPA	295	$497	$610	23	$436	$493	272	$503	$619	−0.119	−0.07
Total
Overall	1161	$1531	$3724	48	$588	$990	1113	$1586	$3816	−0.36*	−0.35***
Non-FPA	812	$1692	$4100	23	$573	$1177	789	$1747	$4184	−0.382*	−0.43***
FPA	349	$1059	$2223	25	$613	$541	324	$1097	$2306	−0.289	−0.24*

Note. Total costs are based on the sum of inpatient, outpatient, and prescription costs.

Standardized difference calculated as average rate of outcome for NP-attributed patients minus average rate of outcome for physician-attributed patients.

P < .05. **P < .01. ***P < .001.

Appendix B: Methods

Author’s Note

Harry H. Liu is also affiliated to Analytica Now LLC, Brookline, MA, USA.

Declaration of Conflicting Interests

The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.

Funding

The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This study was funded by the American Association of Nurse Practitioners.

ORCID iDs

Jordan M. Harrison

Ashley M. Kranz

Grant R. Martsolf

Notes

References

National Academies of Sciences Engineering and Medicine. Implementing High-Quality Primary Care: Rebuilding the Foundation of Health Care. Washington, DC: The National Academies Press; 2021.

National Healthcare Quality and Disparities Report chartbook on effective treatment. Rockville, MD: Agency for Healthcare Research and Quality 2016.

Dall

Reynolds

Chakrabarti

Jones

Iacobucci

The Complexities of Physician Supply and Demand: Projections From 2019 to 2034; 2021.

Health Affairs Blog. Physician acceptance of new medicaid patients: what matters and what doesn’t. April 10, 2019. Accessed September 13, 2022. https://www.healthaffairs.org/do/10.1377/forefront.20190401.678690/full/

Mazurenko

Balio

Agarwal

Carroll

Menachemi

The effects of medicaid expansion under the ACA: a systematic review. Health Aff. 2018;37(6):944-950. doi:10.1377/hlthaff.2017.1491

Auerbach

Staiger

Buerhaus

PI.

Growing ranks of advanced practice clinicians—implications for the physician workforce. N Engl J Med. 2018;378(25):2358-2360. doi:10.1056/NEJMp1801869

American Association of Nurse Practitioners. All about NPs. 2022. Accessed July 5, 2022. https://www.aanp.org/about/all-about-nps

Martsolf

Kim

Germack

Harrison

Poghosyan

Determinants of nurse practitioner independent panel management in primary care. J Nurs Pract. 2022;18(2):212-216. doi:10.1016/j.nurpra.2021.11.002

Auerbach

Buerhaus

Staiger

DO.

Implications of the rapid growth of the nurse practitioner workforce in the US. Health Aff. 2020;39(2):273–279. doi:10.1377/hlthaff.2019.00686

10.

American Association of Nurse Practitioners. NP fact sheet. 2022. Accessed June 28, 2022. https://www.aanp.org/about/all-about-nps/np-fact-sheet

11.

Buerhaus

DesRoches

Dittus

Donelan

Practice characteristics of primary care nurse practitioners and physicians. Nurs Outlook. 2015;63(2):144-153. doi:10.1016/j.outlook.2014.08.008

12.

Davis

Anthopolos

Tootoo

Titler

Bynum

JPW

Shipman

SA.

Supply of healthcare providers in relation to county socioeconomic and health status. J Gen Intern Med. 2018;33(4):412-414. doi:10.1007/s11606-017-4287-4

13.

Xue

Smith

Spetz

Primary care nurse practitioners and physicians in low-income and rural areas, 2010-2016. JAMA. 2019;321(1):102-105. doi:10.1001/jama.2018.17944

14.

Perloff

DesRoches

Buerhaus

Comparing the cost of care provided to Medicare beneficiaries assigned to primary care nurse practitioners and physicians. Health Serv Res. 2016;51(4):1407-1423. doi:10.1111/1475-6773.12425

15.

Muench

Guo

Thomas

Perloff

Medication adherence, costs, and ER visits of nurse practitioner and primary care physician patients: evidence from three cohorts of Medicare beneficiaries. Health Serv Res. 2019;54(1):187-197. doi:10.1111/1475-6773.13059

16.

Kuo

Goodwin

Chen

Lwin

Baillargeon

Raji

MA.

Diabetes mellitus care provided by nurse practitioners vs primary care physicians. J Am Geriatr Soc. 2015;63(10):1980-1988. doi:10.1111/jgs.13662

17.

Liu

Hebert

Douglas

, et al. Outcomes of primary care delivery by nurse practitioners: Utilization, cost, and quality of care. Health Serv Res. 2020;55(2):178-189. doi:10.1111/1475-6773.13246

18.

Lutfiyya

Tomai

Frogner

, et al. Does primary care diabetes management provided to Medicare patients differ between primary care physicians and nurse practitioners? J Adv Nurs. 2016;73(1):240-252. doi:10.1111/jan.13108

19.

Harkless

Vece

Systematic review addressing nurse practitioner reimbursement policy: Part one of a four-part series on critical topics identified by the 2015 nurse practitioner research agenda. J Am Assoc Nurse Pract. 2018;30(12):673-682. doi:10.1097/JXX.0000000000000121

20.

American Association of Nurse Practitioners. State practice environment. 2022. Accessed May 6, 2021. https://www.aanp.org/advocacy/state/state-practice-environment

21.

Spetz

Parente

Town

Bazarko

Scope-of-practice laws for nurse practitioners limit cost savings that can be achieved in retail clinics. Health Aff. 2013;32(11):1977-1984. doi:10.1377/hlthaff.2013.0544

22.

Perloff

Clarke

DesRoches

O’Reilly-Jacob

Buerhaus

Association of state-level restrictions in nurse practitioner scope of practice with the quality of primary care provided to medicare beneficiaries. Med Care Res Rev. 2017;76(5):597-626. doi:10.1177/1077558717732402

23.

Kurtzman

Barnow

Johnson

Simmens

Infeld

Mullan

Does the regulatory environment affect nurse practitioners’ patterns of practice or quality of care in health centers?

Health Serv Res. 2017;52(Suppl 1):437-458. doi:10.1111/1475-6773.12643

24.

Yang

Johantgen

Trinkoff

Idzik

Wince

Tomlinson

State nurse practitioner practice regulations and U.S. health care delivery outcomes: a systematic review. Med Care Res Rev. 2020;78(3):183-196. doi:10.1177/1077558719901216

25.

Knepper

Sonenberg

Levine

Cost savings of diabetes outcomes: impact of nurse practitioner practice regulatory policy. Int J Serv Standards. 2015;10(1-2):17-31. doi:10.1504/IJSS.2015.068061

26.

Poghosyan

Timmons

Abraham

Martsolf

GR.

The economic impact of the expansion of nurse practitioner scope of practice for Medicaid. J Nurs Regul. 2019;10(1):15-20. doi:https://doi.org/10.1016/S2155-8256(19)30078-X

27.

Smith

LB.

The effect of nurse practitioner scope of practice laws on primary care delivery. Health Econ. 2022;31(1):21-41. doi:10.1002/hec.4438

28.

Stange

How does provider supply and regulation influence health care markets? Evidence from nurse practitioners and physician assistants. J Health Econ. 2014;33:1-27. doi:10.1016/j.jhealeco.2013.10.009

29.

Martsolf

Auerbach

Arifkhanova

The impact of full practice authority for nurse practitioners and other advanced practice registered nurses in Ohio. RAND Corporation; 2015. https://www.rand.org/pubs/research_reports/RR848.html

30.

Ruttner

Borck

Nysenbaum

Williams

Medicaid policy brief: Guide to MAX data; 2015. https://www.cms.gov/Research-Statistics-Data-and-Systems/Computer-Data-and-Systems/MedicaidDataSourcesGenInfo/Downloads/MAX_IB21_MAX_Data_Guide.pdf

31.

Nguyen

Sanghavi

A national assessment of legacy versus new generation Medicaid data. Health Serv Res. 2022;57:944-956. doi:10.1111/1475-6773.13937

32.

IQVIA Inc. One key reference assets. 2020. Accessed May 6, 2021. https://www.iqvia.com/locations/united-states/solutions/commercial-operations/essential-information/onekey-reference-assets

33.

Harrison

Germack

Poghosyan

Martsolf

GR.

Surveying primary care nurse practitioners: an overview of national sampling frames. Policy Polit Nurs Pract. 2021;22(1):6-16. doi:10.1177/1527154420976081

34.

Byrd

VLH

Dodd

AH.

Assessing the usability of MAX 2008 encounter data for comprehensive managed care. Medicare Medicaid Res Rev. 2013;3(1): mmrr.003.01.b01. doi:10.5600/mmrr.003.01.b01

35.

Harrison

Germack

Poghosyan

D’Aunno

Martsolf

GR.

Methodology for a six-state survey of primary care nurse practitioners. Nurs Outlook. 2021;69:609-616. doi:10.1016/j.outlook.2021.01.010

36.

National Committee for Quality Assurance. HEDIS 2013 volume 2: Technical specifications. National Committee for Quality Assurance; 2013.

37.

Mehrotra

Adams

Thomas

McGlynn

EA.

The effect of different attribution rules on individual physician cost profiles. Ann Intern Med. 2010;152(10):649-654. doi:10.7326/0003-4819-152-10-201005180-00005

38.

United States Department of Agriculture Economic Research Service. 2010 Rural-Urban Commuting Area Codes. 2019. Accessed May 6, 2021. https://www.ers.usda.gov/data-products/rural-urban-commuting-area-codes/

39.

Agency for Healthcare Research and Quality. Prevention quality indicators, technical specifications. Agency for Healthcare Research and Quality; 2013.

40.

Rate of Emergency Department Visit Use for Children Managed for Persistent Asthma. Content last reviewed August 2021. Agency for Healthcare Research and Quality, Rockville, MD. Accessed January 25, 2023. https://www.ahrq.gov/pqmp/measures/asthma-rate-ed-visit.html

41.

ResDAC. Prepaid plan value. Accessed July 5, 2022. https://resdac.org/cms-data/variables/prepaid-plan-value

42.

U.S. Department of Health and Human Services Office of Inspector General. Data on medicaid managed care payments to providers are incomplete and inaccurate. Report No. OEI-02-19-00180; 2021.

43.

U.S. Department of Health and Human Services Office of Inspector General. Not all states report medicaid managed care encounter data as required. Report No: OEI-07-13-00120; 2015.

44.

Hainmueller

Entropy balancing for causal effects: a multivariate reweighting method to produce balanced samples in observational studies. Polit Anal. 2012;20(1):25-46. doi:10.1093/pan/mpr025

45.

McClellan

McNeil

Newhouse

JP.

Does more intensive treatment of acute myocardial infarction in the elderly reduce mortality? Analysis using instrumental variables. JAMA. 1994;272(11):859-866. doi:10.1001/jama.1994.03520110039026

46.

Frogner

Harwood

Andrilla

CHA

Schwartz

Pines

JM.

Physical therapy as the first point of care to treat low back pain: an instrumental variables approach to estimate impact on opioid prescription, health care utilization, and costs. Health Serv Res. 2018;53(6):4629-4646. doi:10.1111/1475-6773.12984

47.

Burke

Ritter

Werner

RM.

Postacute care outcomes in home health or skilled nursing facilities in patients with a diagnosis of dementia. Health Serv Res. 2022;57(3):497-504. doi:10.1111/1475-6773.13855

48.

Joyce

McGuire

Bartels

Mitchell

Grabowski

DC.

The impact of dementia special care units on quality of care: an instrumental variables analysis. Health Serv Res. 2018;53(5):3657-3679. doi:10.1111/1475-6773.12867

49.

White

HL.

A heteroskedasticity-consistent covariance matrix estimator and a direct test for heteroskedasticity. Econometrica. 1980;48:817-838.

50.

Terza

Basu

Rathouz

PJ.

Two-stage residual inclusion estimation: Addressing endogeneity in health econometric modeling. J Health Econ. 2008;27:531-543. doi:10.1016/j.jhealeco.2007.09.009

51.

Konetzka

Yang

Werner

RM.

Use of instrumental variables for endogenous treatment at the provider level. Health Econ. 2019;28(5):710-716. doi:10.1002/hec.3861

52.

Razavi

O’Reilly-Jacob

Perloff

Buerhaus

Drivers of cost differences between nurse practitioner and physician attributed medicare beneficiaries. Med Care. 2021;59(2). https://journals.lww.com/lww-medicalcare/Fulltext/2021/02000/Drivers_of_Cost_Differences_Between_Nurse.13.aspx

53.

Bencio

Medicaid analytic extract provider characteristics (MAXPC) evaluation report, 2010; 2013.

54.

Buerhaus

Skinner

McMichael

, et al. The integrity of MACRA may be undermined by “incident to billing” coding. 2018. https://www.healthaffairs.org/do/10.1377/hauthor20141112.293006/full/

55.

Patel

Huskamp

Frakt

, et al. Frequency of indirect billing to Medicare for nurse practitioner and physician assistant office visits. Health Aff. 2022;41(6):805-813. doi:10.1377/hlthaff.2021.01968

56.

Angrist

Pischke

JS.

Mostly Harmless Econometrics: An Empiricist’s Companion. Princeton University Press; 2009.

57.

Lee

McCrary

Moreira

Porter

. Valid t-ratio Inference for IV. American Economic Review. 2022; 112(10), 3260-90.

58.

Finlay

Magnusson

Schaffer

. Weakiv: weak-instrument-robust tests and confidence intervals for instrumental-variable (IV) estimation of linear, probit and tobit models. 2013. Accessed May 6, 2021. http://ideas.repec.org/c/boc/bocode/s457684.html

The Impact of Nurse Practitioner-Led Primary Care on Quality and Cost for Medicaid-Enrolled Patients in States With Pay Parity

Abstract

Keywords

Introduction

Methods

Data Sources

Sample Construction

Patient Attribution

Control Variables

Dependent Variables

Quality measures

Costs

Statistical Analysis

Weighting estimates of the effects of NP-led care

Instrumental variables (IV) estimates of the effects of NP-led care

Results

Rates and Correlates of NP-Led Care

Estimates of the Effects of NP-Led Care

Quality outcomes: Adults with diabetes

Quality outcomes: Children with asthma

Cost outcomes: Adults with diabetes

Cost outcomes: Children with asthma

Discussion

Conclusion

Footnotes

Appendix A

Appendix B: Methods

Author’s Note

Declaration of Conflicting Interests

Funding

ORCID iDs

Notes

References