Abstract
Background
There is limited information about non-selective and contemporary data on quality of stroke care and its variation among hospitals at a national level.
Patients and methods
We analysed data of the patients admitted to 258 acute stroke care hospitals covering the entire country from the Acute Stroke Quality Assessment Program, which was performed by the Health Insurance Review and Assessment Service from 2008 to 2014 in South Korea. The primary outcome measure was defect-free stroke care (all-or-none), based on six get with the guidelines-stroke performance measures (except venous thromboembolism prophylaxis).
Results
Among 43,793 acute stroke patients (mean age, 67 ± 14 years; male, 55%), 31,915 (72.9%) were hospitalised due to ischaemic stroke. At a patient level, defect-free stroke care steadily increased throughout the study period (2008, 80.2% vs. 2014, 92.1%), but there were large disparities among hospitals (mean = 50.7%, SD = 21.7%). Defect-free stroke care was given more frequently in patients being treated in hospitals with 25 or more stroke cases per month (odds ratio [OR] 2.83; 95% confidence interval [CI] 1.69–4.72), delivery of intravenous thrombolysis one or more times per month (OR 2.37; 95% CI 1.44–3.92), or provision of stroke unit care (OR 1.75; 95% CI 1.22–2.52).
Discussion
This study shows that the quality of stroke care in Korea is improving over time and is higher in centres with a larger volume of stroke or intravenous thrombolysis cases and providing stroke unit care but hospital disparities exist.
Conclusion
Reducing large differences in defect-free stroke care among acute stroke care hospitals should be continuously pursued.
Introduction
The quality of stroke care is associated with better survival and quality of life after stroke.1,2 Several studies from the get with the guidelines (
However, previous studies are limited in the following ways: (1) because participation in such programs may be voluntary and limited by selection bias favouring participating hospitals having a greater interest in improving quality of stroke care,1,3,7–9 study subjects may not be representative of the population at large,1,7,9,10 and (2) comparisons of quality care across countries are difficult due to heterogeneity in study methodology and quality indicators. 8 To the best of our knowledge, there has been no peer-reviewed article providing the summary measure for quality of stroke care based on a nationwide sample of non-selected stroke patients and reporting global quality measures at both the patient and hospital levels.
The acute stroke quality assessment program (ASQAP) is an external audit to assess the quality of acute stroke care in Korean hospitals carried out by the Health Insurance Review and Assessment Service (HIRA). Using data from the ASQAP in Korea, we aimed to describe (1) the contemporary quality of stroke care, (2) secular trends of performance measures based on current stroke guidelines,11,12 (3) disparities in stroke care among hospitals, and (4) differences in performance measures among Korea, the United States (US), and Taiwan.
Materials and methods
The acute stroke quality assessment program
The ASQAP is a nationwide survey of acute care hospitals is conducted by the HIRA under the supervision of the Ministry of Health and Welfare to assess quality of acute stroke care in Korea. Its goals are to (1) improve the quality of acute stroke care for hospitalised stroke patients, (2) recognise and evaluate disparities in stroke care services among acute care hospitals, and (3) reduce the national cost burden for stroke care. 13 After the first assessment in 2005, the HIRA repeated stroke quality assessments in 2008, 2010, 2011, 2013, 2014, and 2017, with each assessment period lasting three months (Supplemental Figure). For the purpose of improving care quality of each hospital, the Value Incentive Program was introduced in 2011. 13 To be qualified for an each assessment, hospitals had to treat 10 or more acute stroke patients during a period of three consecutive months. The definitions of the quality indicators for stroke care have been changed during the seven assessment epochs as stroke guidelines have been amended (Supplemental Figure). During this process, corresponding hospitals were obliged to submit the data to the HIRA, and some cases were sampled to confirm the accuracy and authenticity of the submitted data by an external audit.
All of the population in South Korea is eligible for coverage under the National Health Insurance (NHI) program, a social insurance benefit system, and thus, all reimbursement claims for health services issued by healthcare providers in Korea are collected and assessed by the HIRA. Since the National Health Insurance system is mandatory for all Korean citizens, the healthcare providers cannot deny NHI patients, and admission to hospital for acute disease care is rarely affected by systemic or economic reasons. Thus, we were able to collect data of almost all patients with acute stroke who were admitted to hospitals during the assessment periods.
Study design and participants
This retrospective analysis was performed using the ASQAP database as part of the Joint Project on Quality Assessment Research by HIRA. 13 We included all individuals who were admitted to the emergency department in a Korean hospital within seven days of onset for acute stroke care, were assessed under the ASQAP between 2008 and 2014 (data from the 2005 and 2017 assessments were not available), and met one of the following International Classification of Diseases, Tenth Revision (ICD-10) discharge codes: I60 (subarachnoid haemorrhage), I61 (intracerebral haemorrhage), I62 (other non-traumatic intracranial haemorrhage), or I63 (cerebral infarction).
Ethics statement
This study was performed in accordance with the Declaration of Helsinki and approved by the Institutional Review Board of the HIRA. The need for obtaining written informed consent from the study subjects was waived as the study subjects were de-identified in the database.
Data collection
Patient level data were obtained including age, sex, discharge diagnosis according to the ICD-10 codes, use of an ambulance, last known time as being well, first time any neurological abnormality was noted, arrival time, stroke severity scale (the National Institutes of Health Stroke Scale [NIHSS] or the Glasgow Coma Scale) scores, type of first neuroimaging modality, intravenous tissue plasminogen activator (IV tPA) administration time (if administered), length of hospital stay, mortality (in-hospital, at three months, and at year year), dysphagia screening test results, and consideration for rehabilitation therapy. Hospital level data included hospital location, number of hospital beds, number of stroke cases per month, number of IV tPA administration per month, and presence or absence of a stroke unit certified by the Korean Stroke Society. The claims data were matched to the ASQAP database to obtain supplementary data for the study.
Performance measures for stroke care
The six
We defined three different summary measures as outcome variables which were obtained to summarise overall stroke-care quality. 14 A defect-free stroke care (all-or-none) measure was defined as a proportion of patients who were perfect for all the corresponding performance measures among all the eligible patients. A patient average measure was obtained by calculating a proportion of measures that were successfully met among all the applicable measures in each patient and averaging these proportions across all the eligible patients. Lastly, an overall percentage measure was obtained by collecting all the applicable measures from all the eligible patients and calculating a proportion of measures that were met over those measures overall. Since the information regarding the prescription of lipid-lowering agents at discharge based on the matched claims data was only available in the 2013 and 2014 assessments, the summary measures were obtained in two different ways: those excluding lipid-lowering drugs at discharge, and those including lipid-lowering drugs at discharge. The former, based on the 5 core performance measures, was used for secular trends and the latter, based on the 6 core measures, was used for examining hospital disparities and international comparisons.
Statistical analysis
Baseline characteristics of patients and hospitals enrolled in this study were presented as a frequency (percentage) for categorical variables and as a mean±SD or a median with an interquartile range for continuous variables. Cochran–Armitage trend tests, or beta-logistic models were used to assess secular trends of hospital characteristics and individual and summary performance measures, when appropriate. The relationships between hospital characteristics of the admitted patients and the level of stroke care quality of patients received were further examined with multilevel models. Variables used for adjustment included age, sex, history of atrial fibrillation, current smoking, NIHSS score, and time from onset to arrival. To account for the correlations between the outcomes of patients being treated within the same hospital, we applied a generalised linear mixed model with a binomial distribution using a logarithmic link function. For a comparison of the performance measures among countries,16,17 individual and summary measures were adapted and re-defined in patients who had the ICD-10 code I63 for their final diagnosis. To obtain overall rates of the US, we calculated the weighted average based on the reported rates of primary stroke centres and comprehensive stroke centres participating in the
Results
Patient characteristics
From the ASQAP database, 43,793 acute stroke patients (mean age, 67 ± 14 years; male, 55%) treated in 258 hospitals were evaluated in five (2nd–6th) consecutive assessments and included in the study. Ischaemic stroke cases accounted for 73% (n = 31,915). Half of the patients arrived at hospitals via ambulance, and the median NIHSS score was 4. Sixteen per cent of the patients had atrial fibrillation or flutter, and 36% were ever smokers (Supplemental Table II).
Hospital characteristics
Of the 258 hospitals, 137 hospitals (53.1%) were evaluated in all the 5 assessments, 32 (12.4%) in 4 assessments, 24 (9.3%) in 3 and 65 (25.2%) in 1 or 2. The median number of beds in the 258 hospitals was 548, and more than half had 500 or more beds. One-third provided acute stroke care services to less than five cases per month, and about 60% of the hospitals had less than one IV tPA case per month. Mean stroke admissions and IV tPA cases per month for each hospital were 12.2 and 0.8, respectively. The distribution of acute care hospitals was even throughout country, but the distribution of hospitals with certified stroke units showed an urban-to-rural gradient (Figure 1). There was an increase of hospitals providing stroke unit care over time from 13% to 34%.

Hospital characteristics and distribution of certified stroke units in Korea.
Contemporary status of stroke care quality in Korea
Overall, most of the summary and core performance measures were achieved in about 90% of the patients (Table 1). Among the patients arriving within 3 h from symptom onset, 68% underwent neuroimaging within 25 min of hospital arrival. Door-to-needle time within 60 and 45 minutes was achieved in 79% and 61%, respectively (Supplemental Table III).
Current status and secular trends of quality of stroke care in Korea.
IV tPA: intravenous tissue-plasminogen activator; NA: not assessed.
*P-values for secular trends of performance measures using Cochran–Armitage trend tests, or beta-logistic models as appropriate.
aSummary measures for evaluating secular trends in this table were based on five core performance measures without lipid-lowering drugs at discharge.
Secular trends in quality of stroke care
Over seven years (2008–2014), the achievement of summary measures based on five core measures increased by 12% for defect-free stroke care (all-or-none), 6% for patient average, and 7% for overall percentage (Table 1). All individual performance measures including additional measures demonstrated a steady increment from 2008 to 2014 (P-for-trend for all core performance measures except intervention for smoking cessation <0.01). Intervention for smoking cessation during hospitalisation was performed in most of the eligible patients in all assessment periods (99.1% in 2011, 99.7% in 2013, and 99.6% in 2014, P-for-trend = 0.33). Lipid-lowering drug at discharge showed a 5.4% increment from 2013 to 2014 (p < 0.01).
Hospital disparities in quality of stroke care
Hospital disparities were examined using the data from the 6th assessment performed in 2014. Being treated in hospitals with 500 or more beds, more stroke admissions per month, more IV tPA cases per month and providing stroke unit care increased the likelihood of receiving higher quality of stroke care (Figure 2). This tendency is most evident for defect-free stroke care (all-or-none). Large hospital disparities in the summary measures, especially in defect-free stroke care (all-or-none) were reported (hospital mean = 50.7%; SD = 21.7%) (Figure 3). Hospitals having more stroke cases, having more IV tPA cases and providing stroke unit care were more likely to provide more timely treatments (Supplemental Table IV).

Associations between hospital characteristics and quality of stroke care. (a) Defect-free stroke care (all-or-none) measure and (b) patient average measure. CI: confidence interval.

Center disparities in summary measures of acute stroke care.
Comparisons of quality of stroke care among Korea, the US, and Taiwan
Quality of stroke care in Korea was compared with that in other countries in terms of various quality measures based on data from the 5th (2013) and 6th (2014) assessments and the summary measures for these comparisons were based on the six core measures including lipid-lowering drugs at discharge. Defect-free stroke care (all-or-none) was lower in Korea (71%) than the US (94%) and patient average was higher in Korea (90%) than Taiwan (73%) (Table 2). Early administration of IV tPA, measured by the IV tPA 2 h (3.5 h) variable, was higher in Korea than other two countries. Prescription rates of antithrombotics and lipid-lowering drugs at discharge were lower in Korea than the US, while other core measures were comparable between Korea and the US. Generally, the achievement of the individual performance measures was higher in Korea than Taiwan.
International comparisons of performance measures.
GWTG: get with the guideline; NA: not available; IV tPA: intravenous tissue-plasminogen activator; DVT: deep vein thrombosis.
aSummary measures used in this table were obtained using all the six core performance measures.
Discussion
Based on the ASQAP database of 43,793 acute stroke patients who were admitted to 258 acute care hospitals in South Korea and were benchmarked against
The achievement of defect-free stroke care (all-or-none) based on the six core measures including lipid-lowering drugs at discharge in our study was 71.2% in 2013–2014, which was comparable to that of 73% in 2003–2009 in the US
Of the patients eligible for IV tPA, 94.6% were treated with IV tPA within the time window in 2013–2014; this figure is higher than the 42% for Portugal (2010), the 60% for Germany (2012), the 81% for the UK (2014),
21
and the highest rate of 85.2% in 2010–2013 in the US (Target: Stroke Initiative),
2
and comparable to 94.1% in 2013–2015 in the US
The achievement of stroke care quality in Korea is encouraging in this study. However, hospital disparities in defect-free stroke care (all-or-none) were quite large (Figure 2), and the achievement of defect-free stroke care (all-or-none) was associated with lower in-hospital mortality and higher rates of discharge to home. Implementation of a nationwide collaborative learning and feedback program 7 and more rigorous adherence to guidelines might reduce the variation of stroke care among hospitals, enhance the achievement of defect-free stroke care (all-or-none), and consequently improve clinical outcomes.
In Korea, standards for stroke unit care were proposed in 2008, and the certification of stroke units was started in 2012 by the Korean Stroke Society. Although the number of hospitals providing stroke unit care increased from 25 in 2008 to 65 in 2014 (Figure 1), only 47% of acute stroke patients were treated in hospitals equipped with stroke units in Korea (Supplemental Table II), which is higher than the 30% average in Europe, but much lower than that of Australia (67%), the UK (83%), Czech Republic (85%), and Sweden (88%).21,22 By emphasising on stroke unit care, one may reduce stroke dependence and mortality and overcome certain perceived disadvantages regarding stroke care in smaller hospitals.22,24 Reimbursement for stroke unit care by the Korean government was initiated in 2017. In addition to this expanded coverage of stroke unit care, establishing certified stroke units in rural areas might lead to further spread of integrated stroke care, 25 reducing hospital disparities in quality of stroke care and promoting adherence to current stroke guidelines.11,12,26 Through these efforts, we expect that the rates of acute care hospitals providing stroke unit care in Korea might attain the rates reported for Australia and European countries.
This study shows that the contribution of hospitals having little experience in acute stroke care but playing a role as acute care hospitals is not to be ignored. About 30% of all acute stroke patients were treated in hospitals with an average IV tPA case of less than one per month (Supplemental Table II), and these hospitals were less likely to provide IV tPA within 60 min of arrival (Supplemental Table IV). A previous study based on the
This study has several limitations. First, retrospective observational studies are subject to confounding and have limitation in generalisability of study findings. However, because all Koreans are obliged to participate in the National Health Insurance program and each hospital requests reimbursements for almost all the medical services that they have provided, we believe that we were able to analyse the vast majority of acute stroke patients admitted to hospitals in Korea during each assessment period. Second, the ASQAP is an external audit program based on self-report by enrolled hospitals. HIRA initiated a financial incentive plan based on reporting indicators in October 2011. Thus, selection bias or overreporting related to applying eligibility criteria more strictly or widely during the assessment periods might occur. Extremely high rates of IV tPA 2 h (3.5 h) and high achievements in most performance measures might be partly explained by this bias. Third, international comparisons of stroke care quality might be inappropriate because of heterogeneity in study periods, enrolment criteria, and definitions of performance measures. Data from Taiwan that we used were collected in earlier time epochs than those used for this study, which might explain why Taiwan had a worse quality metric. We modified the definitions of performance measures to minimise differences between the ASQAP and the
Conclusion
Based on the findings of this study, the quality of acute stroke care in Korea has improved over time and is comparable to that in other countries. Stroke care quality, however, was variable among hospitals, and the distribution of specialised stroke care facilities was unbalanced between urban and rural areas. Implementation of optimal preventive strategies and development of a nationwide stroke network would improve the quality of acute stroke care.
Supplemental Material
Supplemental material for Quality of acute stroke care in Korea (2008–2014): Retrospective analysis of the nationwide and nonselective data for quality of acute stroke care
Supplemental Material for Quality of acute stroke care in Korea (2008–2014): Retrospective analysis of the nationwide and nonselective data for quality of acute stroke care by Hong-Kyun Park, Seong-Eun Kim, Yong-Jin Cho, Jun Yup Kim, Hyunji Oh, Beom Joon Kim, Jihoon Kang, Keon-Joo Lee, Min Uk Jang, Jong-Moo Park, Kwang-Yeol Park, Kyung Bok Lee, Soo Joo Lee, Ji Sung Lee, Juneyoung Lee, Ki Hwa Yang, Ah Rum Choi, Mi Yeon Kang, Eric E Smith, Philip B Gorelick and Hee-Joon Bae in European Stroke Journal
Footnotes
Declaration of Conflicting Interests
The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding
The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This study was performed by the Joint Project on Quality Assessment Research of the Health Insurance Review and Assessment Service, Republic of Korea, and supported by a fund (2017ER620101#) by Research of Korea Centres for Disease Control and Prevention.
Informed consent
Stipulation of written informed consent from the study subjects was waived as the study subjects were de-identified in the database.
Ethical approval
Ethical approval for this study was obtained from the Institutional Review Board of the Health Insurance Review and Assessment Service in Korea.
Guarantor
Hee-Joon Bae.
Contributorship
Hong-Kyun Park contributed to the study design, data interpretation, manuscript drafting, and final approval of the manuscript.
Seong-Eun Kim contributed to the data analysis, data interpretation, review of draft, critical revision, and final approval of the manuscript.
Yong-Jin Cho, Jun Yup Kim, Hyunji Oh, Beom Joon Kim, Keon-Joo Lee, Jihoon Kang, Min Uk Jang, Jong-Moo Park, Kwang-Yeol Park, Kyung Bok Lee, Soo Joo Lee, Eric E. Smith, and Philip B. Gorelick, and PhDs Ji Sung Lee, and Juneyoung Lee contributed the review of the study design, data interpretation, critical revision, and final approval of the manuscript.
Ki Hwa Yang, Ah Rum Choi, and Mi Yeon Kang contributed to the data interpretation, review of draft, and final approval of the manuscript.
Hee-Joon Bae contributed to the study design, data interpretation, manuscript drafting, critical revision, and final approval of the manuscript.
References
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
