Abstract
Picture Archiving and Communication Systems (PACS) are said to improve patient quality of care through timely access to radiological images by clinicians. However, they are costly to be considered for hospital wide environment in low income countries. Ordinary core i3 computer systems (PCs) can provide an affordable and faster alternative solution for PACS workstations. This comparative study assessed the diagnostic accuracy, image quality of ordinary PC systems versus PACS workstations and patient turnaround time (PTAT). Forty images were randomly obtained and viewed by four raters from both PACS and PC. The findings showed modest agreement among raters (kappa 0.644 for PACS and 0.5164 PC) with acceptable diagnostic accuracy for PC (AUC = 0.7990), 97.5% reproduction of images on PC and significant reduction in PTAT after a switch to PC (4.8 min), p < 0.001, suggesting that PC display can improve quality of health care services through timely access to radiographic images.
Introduction
In recent decades, we have seen the growth of technological innovations in the IT domain aimed at addressing challenges faced by patients, clinicians, and administrators.1 The main drawback in healthcare service delivery has been linked to long patient waiting times. Long waiting times have been said to be indicators of poor health system performance. 2 For instance, during emergency or critical care where patients require acute medical care, waiting times have been confirmed to have damaging effect on patient survival rates and a greater risk of poor health outcomes.3,4
Radiology services account for the largest time (61%) spent in the hospital and significantly contributes to long patient turnaround time (TAT) and that affects quality of care.5,6
In radiology, TAT can be defined as “time from the physician’s request” for imaging until the “time the physician views the results”. 7 Now days, Diagnostic imaging systems are being designed to improve both quality of care and efficiency of clinical work processes. 8
Digital imaging is key in emergency care such as treatment of acute cases, since it allows quick access to diagnostic information that is essential for making clinical decisions9,10 and observes the Digital Imaging and Communication in Medicine (DICOM) standard. DICOM is one of the standards that is universally accepted for the management and communication of medical imaging data. 11
While digital imaging systems have been primarily implemented in countries with a higher share of resources, the World Health Organization (WHO), 12 observes that low income countries could significantly benefit from implementing digital imaging for radiological examinations.3,13 -16
However, digital imaging systems also have limitations such as high costs particularly the dedicated Picture archiving and communication systems (PACS), and their cost being a major obstacle for hospital wide implementation17,18 which has a bearing on several levels of health care delivery. Some studies show that PACS can be easily integrated with other systems and applications on ordinary PC-based viewing systems.19,20
In addition Digital images require an application (DICOM viewer) for their display on monitors 21 and may not display directly on ordinary operating systems such as windows. 22 Furthermore, DICOM images are in large files and occupy considerable storage space. Using compression, medical image size can be condensed, reducing on storage space, 23 Tingberg observes that an image with good quality is one that fulfills its diagnostic purpose. While, there is a general acknowledgment that compression techniques are associated with some degree of image data loss and the need to assess the diagnostic quality of compressed images, most common literature highlights JPEG compression as an industrial standard that facilitates compression and streaming with less effect to the original images.24,25
Sharing of digital images has been via the Picture archival and communication systems (PACS). 26 PACS have what is referred to as the PACS viewer, a computer program that receives and displays radiology images. 17 Further, PACS workstations support image networking on both the Local Area Networks (LAN) and Wide Area Network (WAN).8,16
Ordinary PC-based Viewing systems have been recommended for several years in different studies because of their cost effectiveness.19,27 A study by Wu et al. 27 found that ordinary PC-based systems were affordable especially for low-cost hospital wide PACS and they were easy to obtain both in terms of hardware and software support locally.
In our study, we compared PACS work stations with ordinary core i3 PC based viewing systems as affordable digital image display/viewing solution. Ordinary core i3 computers according to Indrajit and Alam, 28 comprise of mid-range microprocessors more powerful than entry level Celeron and Pentium processors. The purpose of this study was to explore the use of ordinary core i3 PC based viewing systems as existing low-cost digital infrastructure to streamline clinician’s viewing and interpretation of radiology images to improve delayed access of radiographic images to clinicians.
Materials and methods
The study was conducted at St. Francis Hospital Nsambya, Kampala Uganda. The hospital had recently installed Picture Archiving and Communication Systems (PACS) in radiology to reduce long waiting times, improve patient management, hospital workflows, and stay cost effective. The study population comprised of medical doctors from Emergency and ICU, radiologist and radiographer from Radiology. Using Yamane, (1967)’s29 formula for Sample sizes we obtained a sample size (n = 12). However, given the homogenous nature of population these units, we incorporated the cost-based theorem including only the sample population readily available to the study; giving a sample size of (n = 6). This included two clinicians from ICU, two clinicians from Emergency unit, one radiologist, and one radiographer. To measure Image diagnostic accuracy, a total of 40 images were randomly obtained using systematic random sampling and viewed on PACS Workstation and PC-based display system.
To measure patient turn-around time, a random sample of (n = 20) patients was used in an experimental exercise to define PTAT. The Sample size was calculated by Yamane (1967)’s 29 formula for Sample sizes. A 95% confidence level and p = 0.5 are used.
Study design
The study adopted a comparative study to collect quantitative data with in a case study research design.
We chose a comparative study because we wanted to elucidate the similarities and differences associated with viewing radiographic images on ordinary PC display system versus PACS workstation.
Data collection
Primary data were collected from Patient X-ray images, questionnaires and observations, and secondary data were obtained from the online journals and the Hospital internal documents. The “Test-Retest” method was used to test reliability of the instruments.
For image review to determine accuracy of the display systems sensitivity, specificity and ROC analysis were employed. Forty images were arranged in groups of ten and were randomly viewed by four clinicians on core i3 PC based display system; the same images were again viewed by the same clinicians on a PACS workstation after a period of 3 weeks.
During each viewing session, the clinicians indicated their diagnostic assessment of each image as either positive (with pathology) or negative (without pathology). The gold standard was determined from the outcomes of the same images reviewed by radiologists based on the services they provide while utilizing the PACS workstations. The representation of the raters (clinicians) was two male clinicians and two female clinicians. Also, two of the clinicians worked in ICU and two other clinicians worked in emergency unit. The mean number of years of experience was 2.5 years. The study also incorporated the Area under the ROC curve (AUC) to determine the distinctive power of the test as a measure for diagnostic accuracy.
The radiologist ensured all the 40 images were selected from a sample that fulfilled the image quality criteria (IC) guideline as developed by the European commission. 30 These same images were converted to JPEG format and viewed by the radiographer on core i3 PC based display system to see if there was deviation in quality. To observe patient turnaround time (PTAT), Pre- and post-intervention evaluations were observed against the target turnaround time of 10 min, that is, from the time of examination performance to the time the image was viewed by clinicians. The PTAT was recorded on a metric time sheet using time of acquisition seen on the image itself and the time the same patient was prescribed treatment or admitted or referred as recorded in the EMRS.
Data analysis
The study employed Kappa statistic to measure the interobserver reliability among the raters. The majority rule was employed to categorize the outcome of each image by the four raters. The majority rule was considered where more than three raters agreed on the image outcome. Where there were two raters in agreement, the image was dropped from this analysis. Data from image quality assessment forms was analyzed based on the European guidelines on quality criteria for diagnostic Radiographic images incorporating all images that fulfilled the image criteria. Using descriptive statistics, the mean PTAT, standard deviation (SD) and percentiles were determined when analyzing PTAT. Statistical software STATA (ver. 13.0) was utilized to conduct statistical analysis of the data.
Quality control
The observers were blinded on clinical history associated with the images to minimize observer bias and maximize validity of the results. A visual wash out period of three (3) weeks was incorporated to minimize observers visual recall bias. This period was reached upon based on data from previous studies involving intraobserver recall bias. Furthermore, guidance from the American FDA to reduce recall bias recommends sufficient time between intra rater reviews of the same images to reduce recall bias. However, it does not specify the period. However some studies recommend a period between 3 and 45 days. 31
To ensure some level of similarity in gray scale perception, basic appearance was used for each given image between different viewing systems. Ordinary core i3 PC-based display systems were corrected to acceptable brightness values of 80–100 cd/m2, 32 using the Windows Display Color Calibration software.
Ethical considerations
The Higher Degrees, Research and Ethics Committee (HDREC) of Makerere University School of Public Health and St. Francis Hospital Nsambya provided the ethical clearance and permission to conduct this study respectively. The purpose of the study was clearly explained to the respondents and consent for participating in the study sought from them. Participation in the study was voluntary with no coercion.
Results
Diagnostic accuracy
During the study, the raters (clinicians) showed modest agreement with kappa statistics of 0.644 and 0.516 for both PACS workstation and ordinary PC, all well above 0.5. With PC based display system; clinicians correctly identified 80.0% of the images, yielding a sensitivity of 83.3%, and a specificity of 76.4% (Table 1). Using PACS workstation, clinicians correctly identified 97.3% of the images, yielding 100% sensitivity, and 94.1% specificity. (Table 2). The accuracy rates between the two display systems were 80% and 97.3% for ordinary PC based display system and PACs workstation respectively.
Detailed report of sensitivity and specificity when using PC display.
Detailed report of sensitivity and specificity when using PACS workstation.
Accuracy rate = TP + TN ÷ TP + TN + FP + FN × 100. The difference in accuracy rate was not statistically significant (p = 0.66) (Figure 1).

X-ray image as viewed on PACS workstation and ordinary PC display at p = 0.66.
Diagnostic accuracy of the two systems was further assessed using the receiver operating characteristic (ROC) curve where the area under the curve (AUC) was estimated. AUC = 0.5 when the ROC curve corresponds to random chance and 1.0 for perfect diagnostic accuracy.
The AUC for ordinary PC (0.799) and PACS (0.971) significantly varied (p = 0.01) but were both above the acceptable AUC cut-off (0.7). (Figures 2 and 3).

Area under the curve for ordinary PC based display.

Area under the curve for PACS workstation.
Quality of images
The images were rated based on a 5 point scale (Table 3). Using ordinary PC-based display system 35 JPEG images fulfilled 97.5% of the IC compared to 100% for DICOM images using PACS workstation. The difference in image quality was not statistically significant (p = 0.66).
Compliance with European guidelines for 40 JPEG converted chest PA x-ray examinations Guidelines adopted from European commission, (1996).
Patient turnaround time (PTAT)
The study desired 10 min as the benchmark for PTAT. The minimum PTAT before ordinary PC implementation was 11 min (1% percentile) and a maximum of 35 min (99% percentile). The mean PTAT before was 22.65 min with a standard deviation of 6.49 min. The minimum PTAT after ordinary pc implemention was 3 min (1% percentile) and a maximum of 7 min (99% percentile). The mean PTAT after was 4.80 min with a standard deviation of 1.15. From the t statistic the mean difference before and after was 17.85 demonstrating a significant difference (p < 0.001).
Discussion
The main purpose of this study was to explore the use of existing low-cost digital infrastructure to streamline clinician’s viewing and interpretation of radiology images and improve delayed access to radiographic images. Ordinary PC display system as a low-cost digital infrastructure was compared with PACS workstations and the comparison mainly focused on the diagnostic accuracy and quality of images viewed on either of these systems. The effect of using ordinary computers on patient turnaround time was also assessed.
Diagnostic accuracy
From the findings, it is suggested that clinicians demonstrated better diagnostic outcomes while viewing images using PACS workstations compared to ordinary PC based display systems and analysis of the data showed significantly better discriminative ability for PACS workstations than ordinary PC based display system (AUC 0.97 vs 0.79 p = 0.01).
Using Kappa statistic, the interater agreement of the clinician outcomes for PACS Workstation was more substantial (kappa 0.644) compared to ordinary PC display systems (kappa 0.51). Although moderate, the level of agreement with ordinary PCs was still within the acceptable degree of agreement and is consistent with McHugh, 33 who stated that kappa agreement as low as 0.41 may be accepted for health related research.
Notwithstanding the ordinary PC weaknesses, their outcomes of diagnostic accuracy recorded good specificity (76.4%) and sensitivity (83.3%) with acceptable discriminative ability on the ROC (AUC = 0.79) at the score cut-offs utilized in the analysis, which was similar to what has been reported for PC systems and ROC analysis in other study settings34,35 and partly confirming findings in earlier research. 36
The findings from this study indicate that although PACS workstations are superior (100% sensitivity and 94.1 specificity), PC based display systems can as well be utilized to triage patients based on radiographic findings and promote rational use of these technologies in hospital settings with single or no PACS correlating with another study, 19 indicating that PC based display systems offers good diagnostic image accuracy.
Quality of images
Although the DICOM protocol for digital medical images is associated with superior quality, 37 our study indicated good quality consistency as per the image criteria in the recreated images after they were converted from DICOM to JPEG and viewed on ordinary computers. 97.5% of the total images passed the quality criteria. These findings are related to another study stating that while using the image criteria on ordinary PCs, most chest X-rays and lumber spine X-ray passed by 70% 38 and is supported by results in another study stating that diagnostic value of the radiographic images is highly dependent on the image quality. 39
Although the 2.5% of the images did not pass the quality criteria when viewed by the radiographers, the radiologists had considered them with similar diagnostic quality as the 97.5% before conversion. However, the difference in image quality between DICOM versus JPEG was not statistically significant (p = 0.66).
This study mainly considered the anatomical landmarks (image criteria) to determine the quality of the images. Future studies could incorporate other physical attributes such as image contrast, spatial resolution, and noise.
Patient turn around time and workflow processes
Our data further demonstrated good throughput attained by having radiological images shared directly on the network and made available on the ordinary PC based display systems at emergency unit resulting into a mean PTAT of 4.8 min.
The results of this study were impressive, marked by a great improvement in patient turnaround time from an average mean of 22.65 to 4.8 min after piloting the PC based display system. These changes are primarily due to the dramatic improvements of delivering the images from radiology to the clinician at emergency care points via electronic transmission compared to hand delivery of images to the clinicians before piloting PC display system. Electronic delivery of medical images has been seen to improve workflow process in the radiology department in similar studies. 40
Generally, the marked improvement in PTAT indicates a major positive impact of PC based display systems on radiology services and general emergency clinical practice. It represents an important milestone that can link affordable technological innovations to mass-use programs in low resource settings and is in agreement with insights from another study stating that sustainable innovative activities should be built based on availability and affordability measures from inception. 41
Study limitations
The major limitation to the study was that it focused on clinicians at emergency care points, that is, Emergency and Intensive Care Units; other points of care such as pediatrics and OPD were not considered in this study which affects generalization. The study worked on an assumption that all participants by virtue of their experience, were in good position to adequately read the images as displayed and give an accurate assessment. Therefore, we did not incorporate training as an input which could have affected outcomes of image interpretation.
Conclusion
Use of Ordinary core i3 PC based display systems may not replace PACS workstations for image visualization and interpretation. However, their utilization is possible in a low resource limited setting where PACS workstations may not be readily available and can provide adequate image evaluation and diagnosis.
Although the DICOM format is associated with better image quality, conversion to JPEG format for viewing on ordinary core i3 PC based display systems is not associated with significant loss in image quality and can provide reliable diagnostic information exhibited by radiographic images where image viewing in DICOM is not possible.
Electronic transfer and viewing of images on ordinary core i3 computer based display systems significantly reduces waiting time in a resource-limited setting and hence improves workflow processes in the delivery of radiology services.
Footnotes
Acknowledgements
We thank the management and staff of St. Francis hospital, Nsambya who participated in this study. We express our gratitude for the time and advice provided by Ms. Logose Jasmine.
Declaration of conflicting interests
The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding
The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This study was funded by HI-TRAIN. HI-TRAIN is a collaborative capacity building program between Moi University Kenya, University of Bergen Norway and Makerere University Uganda.
