Electronic health records (EHRs) have transformed the way modern medicine is practiced, but they remain a major source of documentation burden among physicians. This study aims to use data from Signal, a tool provided by the Epic EHR, to analyze physician metadata in the Montefiore Health System via cluster analysis to assess EHR burden and efficiency.
Methods:
Data were obtained for a one-month period (July 2020) representing a return to normal operation post-telemedicine implementation. Six metrics from Signal were used to phenotype physicians: time on unscheduled days, pajama time, time outside of 7 AM to 7 PM, turnaround time, proficiency score, and visits closed the same day. k-Means clustering was employed to group physicians, and the clusters were assessed overall and by sex and specialty.
Results:
Our results demonstrate the partitioning of physicians into a higher-efficiency, lower-time outside of scheduled hours (TOSH) cluster and a lower-efficiency, higher-TOSH cluster even when stratified by sex and specialty. Intra-cluster comparisons showed general homogeneity of physician metrics with the exception of the higher-efficiency, lower-TOSH cluster when stratified by sex.
Conclusions:
Taken together, the clusters uniquely reflect the EHR efficiency-burden of the Montefiore Health System. Applying k-means clustering to readily available EHR data allows for a scalable, efficient, and adaptable approach of assessing physician EHR burden and efficiency, allowing health systems to examine documentation trends and target wellness interventions.
Get full access to this article
View all access options for this article.
References
1.
ArcherN, CocosilaM. A comparison of physician pre-adoption and adoption views on electronic health records in Canadian medical practices. J Med Internet Res, 2011; 13(3):e57; doi:10.2196/jmir.1726
2.
ShanafeltTD, BooneS, TanL, et al.Burnout and satisfaction with work-life balance among US physicians relative to the general US population. Arch Intern Med, 2012; 172(18):1377–1385; doi:10.1001/archinternmed.2012.3199
3.
WilliamsDC, WarrenRW, EbelingM, et al.Physician use of electronic health records: Survey study assessing factors associated with provider reported satisfaction and perceived patient impact. JMIR Med Inform, 2019; 7(2):e10949; doi:10.2196/10949
4.
SinskyCA, BeasleyJW, SimmonsGE, et al.Electronic health records: Design, implementation, and policy for higher-value primary care. Ann Intern Med, 2014; 160(10):727–728; doi:10.7326/M13-2589
5.
AndersonJ, LeubnerJ, BrownSR. EHR overtime: An analysis of time spent after hours by family physicians. Fam Med, 2020; 52(2):135–137; doi:10.22454/FamMed.2020.942762
6.
SaagHS, ShahK, JonesSA, et al.Pajama time: Working after work in the electronic health record. J Gen Intern Med, 2019; 34(9):1695–1696; doi:10.1007/s11606-019-05055-x
7.
GardnerRL, CooperE, HaskellJ, et al.Physician stress and burnout: The impact of health information technology. J Am Med Inform Assoc, 2019; 26(2):106–114; doi:10.1093/jamia/ocy145
8.
DowningNL, BatesDW, LonghurstCA. Physician burnout in the electronic health record era: Are we ignoring the real cause?. Ann Intern Med, 2018; 169(1):50–51; doi:10.7326/M18-0139
9.
TranB, LenhartA, RossR, et al.Burnout and EHR use among academic primary care physicians with varied clinical workloads. AMIA Jt Summits Transl Sci Proc, 2019; 2019:136–144
10.
RobertsonSL, RobinsonMD, ReidA. Electronic health record effects on work-life balance and burnout within the I(3) population collaborative. J Grad Med Educ, 2017; 9(4):479–484; doi:10.4300/JGME-D-16-00123.1
11.
ShanafeltTD, DyrbyeLN, SinskyC, et al.Relationship between clerical burden and characteristics of the electronic environment with physician burnout and professional satisfaction. Mayo Clin Proc, 2016; 91(7):836–848; doi:10.1016/j.mayocp.2016.05.007
12.
EschenroederHC, ManzioneLC, Adler-MilsteinJ, et al.Associations of physician burnout with organizational electronic health record support and after-hours charting. J Am Med Inform Assoc, 2021; 28(5):960–966; doi:10.1093/jamia/ocab053
13.
Adler-MilsteinJ, ZhaoW, Willard-GraceR, et al.Electronic health records and burnout: Time spent on the electronic health record after hours and message volume associated with exhaustion but not with cynicism among primary care clinicians. J Am Med Inform Assoc, 2020; 27(4):531–538; doi:10.1093/jamia/ocz220
14.
RuanE, BeiserM, LuV, et al.Physician electronic health record usage as affected by the COVID-19 pandemic. Appl Clin Inform, 2022; 13(4):785–793; doi:10.1055/a-1877-2745
15.
BeiserM, LuV, PaulS, et al.Electronic health record usage patterns: Assessing telemedicine's impact on the provider experience during the COVID-19 pandemic. Telemed J E Health, 2021; 27(8):934–938; doi:10.1089/tmj.2020.0490
16.
ManiK, CanarickJ, RuanE, et al.Impact of telemedicine and the COVID-19 pandemic on medical trainees' usage of the electronic health record in the outpatient setting. Appl Clin Inform, 2023; 14(2):309–320; doi:10.1055/a-2031-9437
17.
DomaneyNM, TorousJ, GreenbergWE. Exploring the association between electronic health record use and burnout among psychiatry residents and faculty: A pilot survey study. Acad Psychiatry, 2018; 42(5):648–652; doi:10.1007/s40596-018-0939-x
18.
HolzerKJ, LouSS, GossCW, et al.Impact of changes in EHR use during COVID-19 on physician trainee mental health. Appl Clin Inform, 2021; 12(3):507–517; doi:10.1055/s-0041-1731000
19.
MosqueraMJ, WardHB, HollandC, et al.Using objective clinical metrics to understand the relationship between the electronic health record and physician well-being: Observational pilot study. BJPsych Open, 2021; 7(5):e174; doi:10.1192/bjo.2021.993
20.
LivingstonK, BoviJ. Department-focused electronic health record thrive training. JAMIA Open, 2022; 5(2):ooac025; doi:10.1093/jamiaopen/ooac025
21.
KhairatS, ZallaL, GartlandA, et al.Association between proficiency and efficiency in electronic health records among pediatricians at a major academic health system. Front Digit Health, 2021; 3:689646; doi:10.3389/fdgth.2021.689646
22.
Hollister-MeadowsL, RichessonRL, De GagneJ, et al.Association between evidence-based training and clinician proficiency in electronic health record use. J Am Med Inform Assoc, 2021; 28(4):824–831; doi:10.1093/jamia/ocaa333
23.
ChatterjiP, LiY. Effects of the COVID-19 pandemic on outpatient providers in the United States. Med Care, 2021; 59(1):58–61; doi:10.1097/MLR.0000000000001448
24.
CalińskiT, HarabaszJ. A dendrite method for cluster analysis. Commun Stat, 1974; 3(1):1–27; doi:10.1080/03610927408827101
25.
ShahapureKR, NicholasC. Cluster Quality Analysis Using Silhouette Score. Presented at: 2020 IEEE 7th International Conference on Data Science and Advanced Analytics (DSAA); 6–9 October 2020; Sydney, NSW, Australia. Available from: https://ieeexplore.ieee.org/document/9260048 [Last accessed: June10, 2023].
26.
WagstaffK, CardieC, RogersS, et al.Constrained K-Means Clustering with Background Knowledge. Morgan Kaufmann Publishers, Inc.: San Francisco, CA; 2001.
27.
NguyenOT, TurnerK, ApathyNC, et al.Primary care physicians' electronic health record proficiency and efficiency behaviors and time interacting with electronic health records: A quantile regression analysis. J Am Med Inform Assoc, 2022; 29(3):461–471; doi:10.1093/jamia/ocab272
28.
RoterDL, HallJA. Physician gender and patient-centered communication: A critical review of empirical research. Annu Rev Public Health, 2004; 25:497–519; doi:10.1146/annurev.publhealth.25.101802.123134
29.
RoterDL, HallJA, AokiY. Physician gender effects in medical communication: A meta-analytic review. JAMA, 2002; 288(6):756–764; doi:10.1001/jama.288.6.756
30.
GuptaK, MurraySG, SarkarU, et al.Differences in ambulatory EHR use patterns for male vs. female physicians. NEJM Catal, 2019; 5(6):1.
31.
JeffersonL, BloorK, BirksY, et al.Effect of physicians' gender on communication and consultation length: A systematic review and meta-analysis. J Health Serv Res Policy, 2013; 18(4):242–248; doi:10.1177/1355819613486465
32.
TaitSD, OshimaSM, RenY, et al.Electronic health record use by sex among physicians in an academic health care system. JAMA Intern Med, 2021; 181(2):288–290; doi:10.1001/jamainternmed.2020.5036
33.
RotensteinLS, HolmgrenAJ, DowningNL, et al.Differences in total and after-hours electronic health record time across ambulatory specialties. JAMA Intern Med, 2021; 181(6):863–865; doi:10.1001/jamainternmed.2021.0256
34.
RotensteinLS, ApathyNC, BatesDW, et al.Variation in support for documentation among primary care physicians by gender. J Am Board Fam Med, 2022; doi:10.3122/jabfm.2022.AP.220071
35.
HirschO, AdarkwahCC. The issue of burnout and work satisfaction in younger GPs-A cluster analysis utilizing the HaMEdSi study. Int J Environ Res Public Health, 2018; 15(10);2190; doi:10.3390/ijerph15102190
36.
KurbatovV, ShaughnessyM, BarattaV, et al.Application of advanced bioinformatics to understand and predict burnout among surgical trainees. J Surg Educ, 2020; 77(3):499–507; doi:10.1016/j.jsurg.2019.11.008
37.
KusurkarRA, van der BurgtSME, IsikU, et al.Burnout and engagement among PhD students in medicine: The BEeP study. Perspect Med Educ, 2021; 10(2):110–117; doi:10.1007/s40037-020-00637-6
38.
LeeYC, HuangSC, HuangCH, et al.A new approach to identify high burnout medical staffs by Kernel K-means cluster analysis in a regional teaching hospital in Taiwan. Inquiry, 2016; 53:0046958016679306; doi:10.1177/0046958016679306
39.
AddessoLC, NimmerM, VisotckyA, et al.Impact of medical scribes on provider efficiency in the pediatric emergency department. Acad Emerg Med, 2019; 26(2):174–182; doi:10.1111/acem.13544
40.
GottliebM, PalterJ, WestrickJ, et al.Effect of medical scribes on throughput, revenue, and patient and provider satisfaction: A systematic review and meta-analysis. Ann Emerg Med, 2021; 77(2):180–189; doi:10.1016/j.annemergmed.2020.07.031
41.
LamC, ShumakerK, ButtM, et al.Impact of medical scribes on physician and patient satisfaction in dermatology. Arch Dermatol Res, 2022; 314(1):71–76; doi:10.1007/s00403-021-02206-1
