Medical record review (MRR) is often used in clinical research and evaluation, yet there is limited literature regarding best practices in conducting a MRR, and there are few studies reporting interrater reliability (IRR) from MRR data. The aim of this research was twofold: (a) to develop a MRR abstraction tool and standardize the MRR process and (b) to examine the IRR from MRR data. This study introduces the MRR-Conduction Model, which was used to implement a MRR, and examines the IRR between two abstractors who collected preinjury medical and psychiatric, incident-related medical and postinjury head symptom information from the medical records of 47 neurologically injured workers. Results showed that the percentage agreement was ≥85% and the unweighted κ statistic was ≥.60 for most variables, indicating substantial IRR. An effective and reliable MRR to abstract medical-related information requires planning and time. The MRR-Conduction Model is proposed to guide the process of creating a MRR.
Alamgir, H., Koehoorn, M., Ostry, A., Tompa, E., & Demers, P. ( 2006). An evaluation of hospital discharge records as a tool for serious work-related injury surveillance. Occupational and Environmental Medicine, 63, 290-296.
2.
Allison, J., Wall, T., Spettell, C., Calhoun, J., Fargason, C., Kobylinski, R., et al. (2000). The art & science of chart review. Joint Commission Journal on Quality Improvement, 26, 115-136.
3.
Banks, N. ( 1998). Designing medical record abstraction forms. International Journal of Quality in Health Care, 10, 163-167.
4.
Carroll, A., Tarczy-Hornoch, P., O’Reilly, E., & Christakis, D. (2003). Resident documentation discrepancies in a neonatal intensive care unit. Pediatrics , 111, 976-980.
5.
Eder, C., Fullerton, J., Benroth, R., & Lindsay, S. ( 2005). Pragmatic strategies that enhance the reliability of data abstracted from medical records. Applied Nursing Research , 18, 50-54.
6.
Engel, L., Henderson, C., & Colantonio, A. (2008). Eleven steps to improving data collection: Guidelines for a retrospective medical record review. Occupational Therapy Now, 10, 17-20.
7.
Gilbert, E., Lowenstein, S., Koziol-McLain, J., Barta, D., & Steiner, J. ( 1996). Chart reviews in emergency medicine research: Where are the methods? Annals of Emergency Medicine, 27, 305-308.
8.
Harris, H., Ellison, G., Holliday, M., & Lucassen, E. ( 1997). Methodological considerations in the design of an obstetric database abstracted from medical records. Methods of Information in Medicine, 36, 191-200.
9.
Hess, D. ( 2004). Retrospective studies and chart reviews. Respiratory Care, 49, 1171-1174.
Horwitz, R., & Yu, E. ( 1984). Assessing the reliability of epidemiologic data obtained from medical records. Journal of Chronic Diseases, 37, 825-831.
12.
Hunt, R. ( 1986). Percent agreement, Pearson’s correlation, and Kappa as measures of inter-examiner reliability. Journal of Dental Research, 65, 128-130.
13.
King, N., Crawford, S., Wenden, F., Moss, N., & Wade, N. ( 1995). The Rivermead post-concussion symptoms questionnaire: A measure of symptoms commonly experienced after head injury and its reliability . Journal of Neurology, 242, 587-592.
14.
Krinsley, K., Gallagher, J., Weathers, F., Kutter, C., & Kaloupek, D. ( 2003). Consistency of retrospective reporting about exposure to traumatic events. Journal of Traumatic Stress, 16, 399-409.
15.
Kung, H., Hanzlick, R., & Spitler, T. ( 2001). Abstracting data from medical examiner/coroner reports: Concordance among abstractors and implications for data reporting. Journal of Forensic Sciences, 46, 1126-1131.
16.
Llovera, I., Ward, M., Falitz, S., Miele, D., Sama, A., Trimarco, T., et al. (2004). Sports injuries, a common pediatric problem . Annals of Emergency Medicine, 44(4 Suppl.), S39.
17.
Lu, T., Tsai, C., Lee, C., Ko, P., Yen, Z., Yuan, A., et al. (2006). Preventable deaths in patients admitted from emergency department. Emergency Medicine Journal, 23, 452-455.
18.
Luck, J., Peabody, J., Dresselhaus, T., Lee, M., & Glassman, P. ( 2000). How well does chart abstraction measure quality? A prospective comparison of standardized patients with the medical record. The American Journal of Medicine, 108, 642-649.
19.
Nagurney, J., Brown, D., Sane, S., Weiner, J., Wang, A., & Chang, Y. ( 2005). The accuracy and completeness of data collected by prospective and retrospective methods. Academic Emergency Medicine, 12, 884-895.
20.
O’Campo, S., Colantonio, A., & Dawson, D. ( 1997). Outcomes after head injury: Level of agreement between subjects and their informants. Occupational Therapy International , 4, 163-179.
21.
Pan, L., Fergusson, S., Schweitzer, I., & Hebert, P. ( 2005). Ensuring high accuracy of data abstracted from patient charts: The use of a standardized record as a training tool. Journal of Clinical Epidemiology, 58, 918-923.
22.
Peabody, J., Luck, J., Glassman, P., Dresselhaus, T., & Lee, M. ( 2000). Comparison of vignettes, standardized patients, and chart abstraction. The Journal of American Medical Association, 283, 1715-1722.
23.
Portney, L. & Watkins, M. ( 2000). Foundations of clinical research: Applications to practice (2nd ed.). Upper Saddle River, NJ: Prentice Hall Health.
24.
Rutner, D., Kapoor, N., Ciuffreda, K., Craig, S., Han, M., & Suchoff, I. ( 2006). Occurrence of ocular disease in traumatic brain injury in a selected sample: A retrospective analysis. Brain Injury , 20, 1079-1086.
25.
Schwartz, R., & Panacek, E. ( 1996). Basics of research (Part 7): Archival data research. Air Medical Journal, 15, 119-124.
26.
Silfvast, T., Takkunen, O., Kolho, E., Andersson, L., & Rosenberg, P. ( 2003). Characteristics of discrepancies between clinical autopsy diagnoses in the intensive care unit: A 5-year review. Intensive Care Medicine, 29, 321-324.
27.
Stange, K., Zyzanski, S., Smith, T., Kelly, R., Langa, D., Flocke, S., et al. (1998). How valid are medical records and patient questionnaires for physician profiling and health services research? A comparison with direct observation of patient visits. Medical Care, 36, 851-867.
28.
Sullivan, T., Patton, J., Mun, Y., & Wallace, J. ( 2005). Advances in conducting retrospective chart review studies: Use of electronic report forms and databases in a community study in anemic patients with myelodysplastic syndrome (MDS). Oncology Nursing Forum, 32, 481-482.
29.
Williams, J., Furbee, P., Prescott, J., & Paulson, D. ( 1995). The emergency department log as a simple injury-surveillance tool. Annals of Emergency Medicine, 25, 686-691.
30.
Worster, A., Bledsoe, R., Cleve, P., & Eva, K. ( 2004). Reassessing the methods of medical record review (MRR) studies in emergency medicine research ten years later. Academic Emergency Medicine, 11, 467.
31.
Worster, A., & Haines, T. ( 2004). Advanced statistics: Understanding medical record review (MRR) studies. Academic Emergency Medicine, 11, 187-192.
32.
Wu, L., & Ashton, C. ( 1997). Chart review: A need for reappraisal. Evaluation and Health Professions, 20, 146-163.
33.
Yawn, B., & Wollan, P. ( 2005). Interrater reliability: Completing the methods description in medical records review studies. American Journal of Epidemiology , 161, 974-977.
