Level of agreement between medical record and ICD-10-AM coding of mental health,alcohol and drug conditions in trauma patients

Abstract

Background:

Despite the reliance on administrative data in epidemiological studies, there is little information on the completeness of co-morbidities in administrative data coded from medical records.

Objective:

The aim of this study was to quantify the agreement between the International Classification of Diseases, Tenth Revision, Australian Modification (ICD-10-AM) administrative coding of mental health, drug and alcohol co-morbidities and medical records in a severely injured patient population.

Method:

A random sample of patients (n = 500) captured by the Victorian State Trauma Registry and definitively managed at the state’s adult major trauma services was selected for the study. Retrospective medical record review was conducted to collect data about documented co-morbidities. The agreement between ICD-10-AM data generated from routine hospital coding and medical record–based co-morbidities was determined using Cohen’s κ and prevalence-adjusted bias-adjusted kappa (PABAK) statistics.

Results:

The percentage of agreement between the medical record and ICD-10-AM coding for mental health, drug and alcohol co-morbidities was 72.8%, and the PABAK showed moderate agreement (PABAK = 0.46; 95% confidence interval (CI): 0.37, 0.54). There was no difference in agreement between unintentional injury patients (PABAK = 0.52; 95% CI: 0.42, 0.62) compared with intentional injury patients (PABAK = 0.36, 95% CI: 0.23, 0.49), and no change in agreement for patients admitted before (PABAK = 0.40; 95% CI: 0.30, 0.50) and after the introduction of mandatory co-morbidity coding (PABAK = 0.46; 95% CI: 0.37, 0.54).

Conclusion:

Despite documentation in the medical record, a large proportion of mental health, drug and alcohol conditions were not coded in ICD-10-AM. Acknowledgement of these limitations is needed when using ICD-10-AM coded co-morbidities in research studies and health policy development.

Implications:

This work has implications for researchers of drug and alcohol abuse; mental health; accidents and injuries; workers' compensation; health workforce; health services; and policy decisions for healthcare, emergency services, insurance industry, national productivity and welfare costings reliant on those research outcomes.

Keywords

clinical coding medical record ICD-10-AM data quality documentation activity-based funding registries mental health co-morbid

Get full access to this article

View all access options for this article.

References

Bender

Smith

(2016) Using administrative mental health indicators in heart failure outcomes research: comparison of clinical records and international classification of disease coding. Journal of Cardiac Failure 22: 56–60.

Cheng

Gilchrist

Robinson

, et al. (2009) The risk and consequences of clinical miscoding due to inadequate medical documentation: a case study of the impact on health services funding. Health Information Management Journal 38: 35–46.

Cicchetti

Feinstein

(1990) High agreement but low kappa: II. Resolving the paradoxes. Journal of Clinical Epidemiology 43: 551–558.

Cohen

(1960) A coefficient of agreement for nominal scales. Educational and Psychological Measurement 20: 37–46.

Curtis

Bollard

Dickson

(2002) Coding errors and the trauma patient – is nursing case management the solution? Australian Health Review 25: 73–80.

Degroot

Beckerman

Lankhorst

, et al. (2003) How to measure comorbidity: a critical review of available methods. Journal of Clinical Epidemiology 56: 221–229.

Dicker

Mah

Lopez

, et al. (2011) Screening for mental illness in a trauma center: rooting out a risk factor for unintentional injury. Journal of Trauma Injury, Infection, and Critical Care 70: 1337–1344.

Duijsens

Bruinsma

Jansen

, et al. (1996) Agreement between self-report and semi-structured interviewing in the assessment of personality disorders. Personality and Individual Differences 21: 261–270.

Feinstein

Cicchetti

(1990) High agreement but low kappa: I. The problems of two paradoxes. Journal of Clinical Epidemiology 43: 543–549.

10.

Fowles

Fowler

Craft

(1998) Validation of claims diagnoses and self-reported conditions compared with medical records for selected chronic diseases. Journal of Ambulatory Care Management 21: 24–34.

11.

Gabbe

Cameron

Hannaford

, et al. (2006) Routine follow up of major trauma patients from trauma registries: what are the outcomes? Journal of Trauma Injury, Infection, and Critical Care 61: 1393–1399.

12.

Gabbe

Lyons

Fitzgerald

, et al. (2015) Reduced population burden of road transport-related major trauma after introduction of an inclusive trauma system. Annals of Surgery 261: 565–572.

13.

Gabbe

Simpson

Cameron

, et al. (2017) Long-term health status and trajectories of seriously injured patients: a population-based longitudinal study. PLoS Medicine 14: e1002322.

14.

Gijsen

Hoeymans

Schellevis

, et al. (2001) Causes and consequences of comorbidity: a review. Journal of Clinical Epidemiology 54: 661–674.

15.

Hawker

Coyte

Wright

, et al. (1997) Accuracy of administrative data for assessing outcomes after knee replacement surgery. Journal of Clinical Epidemiology 50: 265–273.

16.

Henderson

Shepheard

Sundararajan

(2006) Quality of diagnosis and procedure coding in ICD-10 administrative data. Medical Care 44: 1011–1019.

17.

Humphries

Rankin

Carere

, et al. (2000) Co-morbidity data in outcomes research: are clinical data derived from administrative databases a reliable alternative to chart review? Journal of Clinical Epidemiology 53: 343–349.

18.

Jablensky

(2016) Psychiatric classifications: validity and utility. World Psychiatry: Official Journal of the World Psychiatric Association 15: 26–31.

19.

Januel

Luthi

Quan

, et al. (2011) Improved accuracy of co-morbidity coding over time after the introduction of ICD-10 administrative data. BMC Health Services Research 11: 194.

20.

Kashner

(1998) Agreement between administrative files and written medical records: a case of the Department of Veterans Affairs. Medical Care 36: 1324–1336.

21.

Malenka

McLerran

Roos

, et al. (1994) Using administrative data to describe casemix: a comparison with the medical record. Journal of Clinical Epidemiology 47: 1027–1032.

22.

National Centre for Classification in Health (1998) International Statistical Classification of Diseases and Related Health Problems, Tenth Revision, Australian Modification (ICD-10-AM) Australian Coding Standards. Darlinghurst: University of Sydney.

23.

National Centre for Classification in Health (2015) Reference to Changes for ICD-10-AM/ACHI/ACS Ninth Edition. Darlinghurst: University of Sydney.

24.

Nau

Wutzler

Dorr

, et al. (2013) Liver cirrhosis but not alcohol abuse is associated with impaired outcome in trauma patients – a retrospective, multicentre study. Injury 44: 661–666.

25.

Neumann

Spies

(2003) Use of biomarkers for alcohol use disorders in clinical practice. Addiction 98(Suppl. 2): 81–91.

26.

Nguyen

Simpson

Gabbe

(2017) The prevalence of pre-existing mental health, drug and alcohol conditions in major trauma patients. Australian Health Review 41: 283–290.

27.

O’Donnell

Creamer

Elliott

(2009) Prior trauma and psychiatric history as risk factors for intentional and unintentional injury in Australia. Journal of Trauma Injury, Infection, and Critical Care 66: 470–476.

28.

Palmu

Partonen

Suominen

, et al. (2015) Return to work six months after burn: a prospective study at the Helsinki Burn Center. Burns 41: 1152–1160.

29.

Powell

Lim

Heller

(2001) Accuracy of administrative data to assess comorbidity in patients with heart disease: an Australian perspective. Journal of Clinical Epidemiology 54: 687–693.

30.

Preen

Holman

Lawrence

, et al. (2004) Hospital chart review provided more accurate comorbidity information than data from a general practitioner survey or an administrative database. Journal of Clinical Epidemiology 57: 1295–1304.

31.

Spitzer

(1983) Psychiatric diagnosis: are clinicians still necessary? Comprehensive Psychiatry 24: 399–411.

32.

Turner

Bombardier

Rimmele

(2003) A typology of alcohol use patterns among persons with recent traumatic brain injury or spinal cord injury: implications for treatment matching. Archives of Physical Medicine and Rehabilitation 84: 358–364.

33.

van der Westhuizen

Wyatt

Williams

, et al. (2014) Prevalence and predictors of mental disorders in intentionally and unintentionally injured emergency center patients. Journal of Nervous and Mental Disease 202: 638–646.

34.

Weinberg

Narayanan

Boden

, et al. (2016) Psychiatric illness is common among patients with orthopaedic polytrauma and is linked with poor outcomes. Journal of Bone and Joint Surgery (American Volume) 98: 341–348.

35.

World Health Organization (1992) The International Statistical Classification of Diseases and Related Health Problems, Tenth Revision. Geneva: World Health Organization.

36.

Yawn

Wollan

(2005) Interrater reliability: completing the methods description in medical records review studies. American Journal of Epidemiology 161: 974–977.

37.

Zatzick

Jurkovich

Russo

, et al. (2004) Posttraumatic distress, alcohol disorders, and recurrent trauma across level 1 trauma centers. Journal of Trauma Injury, Infection, and Critical Care 57: 360–366.