Abstract
The existing three-dimensional (3D) x-ray reconstruction methods for lung cancer tissue reconstruct the investigated objects based on a series of two-dimensional (2D) image sections and a chosen 3D reconstruction algorithm. However, because these procedures apply the same segmentation method for all 2D image sections, they may not achieve the optimal segmentation for each section. As a result, the reconstructed 3D images have limited spatial resolution. Furthermore, the existing 3D reconstruction method is time-consuming and results in a limited time resolution. This research presents an innovation of 3D reconstruction by reformulating two main components of the method. First, a validity index for fuzzy clustering is used to obtain the optimal segmentations of any 2D x-ray image. The process is realized by automatically determining the optimal number of clusters for the image. Second, unlike the existing 3D reconstruction methods, a fast-FCM algorithm is used to speed up the 2D image segmenting process, thereby raising the time resolution of the 3D reconstruction process. With the aid of commonly used VTK software, the proposed method has been used to visualize four classes of typical lung cancer tissues: adenocarcinoma, large cell carcinoma, small cell carcinoma, and squamous cell carcinoma. Experimental results validate the effectiveness and efficiency of the proposed algorithm. Thus, the method contributes a useful tool for x-ray-based 3D image reconstruction.
Keywords
Introduction
X-ray computed tomography (XCT) is a widely-used imaging technique in medical applications [1, 2, 3]. In the existing methods of three-dimensional (3D) x-ray reconstruction of lung cancer tissue, the investigated objects are reconstructed from a series of two-dimensional (2D) image sections using a 3D reconstruction algorithm. Fast and efficient 3D reconstruction of human tissues can help doctors identify the investigated objects, and improve the accuracy and objectiveness of lung cancer diagnosis. Many 3D reconstruction methods have been proposed that apply the same segmenting procedure for all 2D image sections. However, for a given section, the procedure may not yield the optimal 2D image segmentation. This leads to the limited spatial resolution of the reconstructed 3D image. Furthermore, the existing methods are time-consuming and have a limited time resolution [4].
The segmentation quality of any 2D section will directly affect the spatial resolution of the corresponding 3D reconstruction of the investigated objects. Several hard and fuzzy clustering algorithms have been created to perform the 2D segmentation of medical images. For the diagnosis of lung cancer, fuzzy clustering is the most frequently used method [5, 6]. There are at least two reasons to choose fuzzy clustering. First, any 2D XCT image contains uncertain measurements due to limited spatial resolution and inevitable noisy data. Second, natural human tissues may lack clear edges and may have independently distributed areas. In addition, when tissues overlap, some organs of lung cancer patients are inaccessible for x-ray detection, and cannot be observed efficiently. Therefore, the measurement data may be inconsistent and incomplete. In such situations, fuzzy clustering can work better than other segmenting methods. But when fuzzy clustering is applied to segment a 2D image, it is generally assumed that the number of clusters is known, and this number is used to segment all of the 2D images. This procedure may fail to obtain the optimal 2D segmentation for all candidate 2D images for a particular section. When the 2D sections correspond to different parts of a human body, which differ in the number of tissue types, the same number of clusters cannot represent the natural structure of human tissue distribution. As a result, the reconstructed 3D image maybe less than optimal [7, 8]. This study presents an innovation of 3Dreconstruction, built on the foundation of two different reformulations. First, a validity index for fuzzy clustering was used to obtain the optimal segmentations of any 2D x-ray image. The process was realized by automatically determining the optimal number of clusters by a trial-and-error method. Second, a fast-FCM algorithm was used to speed up the 2D image segmenting process, thus raising the time resolution of the 3D reconstruction process [9].
The Visualization Tool Kit (VTK) is a shared, cross-platform, parallel processing supported graphics function library that is widely used in different areas. With the aid of VTK software, the method proposed in this paper has been applied to reconstruct 3D images of four typical lung cancer shapes. The VTK includes two standard 3D medical image reconstruction methods: surface reconstruction and volume reconstruction. Although surface reconstruction is much faster than volume reconstruction, the latter can present a deeper understanding of the investigated objects. Thus, in this study we applied a typical volume reconstruction Marching Cube (MC) algorithm in the VTK to validate our proposed method.
Proposed method
This section describes a two-part method. First, a fast fuzzy clustering algorithm was conducted to increase the time resolution for any 2D image. Then, two fuzzy indexes were introduced to improve the spatial resolution of a 2D image.
The application of fast fuzzy clustering to raise time resolution
One of the most effective algorithms for dealing with uncertain and inconsistent information is the fuzzy c-means (FCM) algorithm [10]. Consequently, different FCM derivative algorithms have been developed for different applications. Fast FCM (f-FCM) is one that can be used in the image processing field [11].
Suppose that a 2D image is composed of a set
where
and
The terminal condition of this algorithm is set when a user-specified threshold value is reached according to the following formulas:
The fast FCM function is performed based on a one-dimensional attribute such as the gray-scale value. Thus, its computational complexity is
If the number of clusters is not known, it can be calculated using a proper function called the cluster validity index [12, 13]. The two most commonly used fuzzy validity indexes are the partitioning entropy (PE) index [14] and the Xie-Beni index [15]. The PE index is defined as
Where
On the other hand, Xie and Beni et al. [15] defined a validity index as
where the value of
The proposed 3D XCT imaging algorithm includes the following six steps for handling a series of 2D image sections:
Partition the 2D XCT image into a group of pixels (rectangular or triangular units). The number of pixels is Segment all pixels in any 2D XCT image into Find the optimal 2D section for any 2D image by using the chosen clustering validity indexes. Perform Step2 and Step3 forall 2D sections that are candidates for 3D reconstruction. Reconstruct a 3D XCT image from a series of optimal 2D sections using a chosen 3D volume reconstruction algorithm. Explain the pathology characteristics of the obtained 3D images.
Hereafter, the optimal 2D section-based 3D XCT reconstruction method will be referred to as OP-3D-XCT.
Sampling distribution
The medical image 3D reconstruction system for VTK was developed with Visual C
Experimental samples of lung tissue were provided by the General Hospital of Tianjin Medical University. These samples consisted of tumor tissues and the surrounding normal parts. As shown in Table 1, there were a total of 109 lung tissues. After removal of the invalid data such as noise and error, only 91 groups of data were available. These samples were classified by pathological type into the following categories: 34 adenocarcinoma (AD), 11 large cell carcinoma (LA), 29 squamous cell carcinoma (SQ), 9 small cell carcinoma (SM), and 9 categorized as Other.
Description of lung cancer types
Based on diverse histopathology characteristics and shape distributions, there are four common lung cancer types, as shown in Fig. 1.
Pathological section of four types of typical lung cancer tissues (he, 50x).
Figure 1a shows SQ, which makes up about 40%
Adenocarcinoma
Figure 1b shows AD, which accounts for 25% of lung cancer carcinoma. Unlike SQ, AD is more likely to occur in women and non-smokers. AD is originated in the bronchial epithelium. Its incidence is lower than those of squamous carcinoma and undifferentiated carcinoma, and its onset age is relatively low [17].
Large cell carcinoma
Also known as large cell anaplastic carcinoma, LA is shown in Fig. 1c. It is a carcinoma that has no morphological features. The cancer cell is large and has polymorphism. Clinically rare, it accounts for about 1% of all lung cancer cases. LA commonly occurs in the upper lobe, and has a larger volume and clear boundaries. It has a high degree of malignancy, and a poor treatment effect and prognosis [18].
Small cell carcinoma
In Fig. 1d, it can be seen that the small, undifferentiated cells in an SM type of lung carcinoma are the most malignant. Most patients are already in advanced metastasis when their carcinoma is found. There currence rate is high. SM accounts for almost 20% of all lung carcinoma [19].
The optimal 2D sections
The 2D sections of musculoskeletal and viscera lung tissuesshown in Figs 2–4 were obtained by different numbers of clusters and the optimal segmentation identified by the f-FCM algorithm. Figures 2–4 clearly show that 2D segmentations under different numbers of clusters have various spatial resolutions, and that there is an optimal image for each type of tissue. These optimal images correspond to different numbers of clusters.
CT image of musculoskeletal tissues in different number of clusters.
CT image of Viscera tissues in different number of clusters.
CT image of Lung tissue in different number of clusters.
Figure 5 shows the selection process of 2D optimal sections for four typical lung cancer tissues by the PE index function; Fig. 6 refers to the Xie-Beni index. The index function has obvious most value from the figure, the best image is inconsistent to the optimal value of the validity index by the Xie-Bine index and has a small different by the PE index. This further demonstrates that we can distinguish the optimal 2D image from a series of candidate images by using the proper validity indexes.
Selection of the optimal 2D section for musculoskeletal tissues using PE index function in the OP-3D-XCT method.
Selection of the optimal 2D section for viscera tissues usingXie-Beni index function in the OP-3D-XCT method.
Figures 2 through 4 show that different numbers of clusters for different 2D images correspond to fuzzy partitions of differing quality. Cluster validity indexes can identify the optimal number of clusters, and thus can provide the basis for the reconstruction of higher quality 3D images.
Figure 7 shows the reconstructed 3D image by the OP-3D-XCT method, clearly representing the structure of a human chest. Additionally, the shape distribution of the four types of typical lung cancer and the difference between surrounding tissues can be accurately observed. For comparison, the reconstructed images of the four types of typical lung cancer by direct use of 3D volume reconstruction without optimized 2D sections are shown in Fig. 8. These 3D images contain many irrelevant tissues and trail, so the region of interest cannot be observed clearly. Consequently, the reconstructed 3D images are not optimal images.
Reconstructed 3D images of four types of typical lung cancer by OP-3D-XCT.
The proposed method was evaluated in terms of time resolution and spatial resolution. The time resolution was evaluated by the absolute runtime of a frame of a 3D image; the runtime was measured by the “tic” and “toc” functions in the Matlab toolbox. The spatial resolution can be evaluated by the relative error of all
where
To obtain the real gray values of all pixels, the anatomic parts were measured and recorded in the process of operating on the patient. However, only partial tissues could be observed; therefore, the comparison was performed on these observable tissues that correspond to partial pixels in each section.
Table 2 shows that the OP-3D-XCT method can improve time resolution and speed up the 3D reconstruction process by more than an order of magnitude. Please note that the computational complexity of f-FCM is independent of the number of clusters and is only related to the 256 gray levels. By comparison, the runtime of the FCM algorithm is directly proportional to the number of pixels; the more pixels the segmented images have, the longer the runtime of the segmenting process.
| C |
C |
C |
C |
|
|---|---|---|---|---|
| FCM | 3.57 s | 6.38 s | 15.7 s | 19.3 s |
|
|
0.74 s | 0.74 s | 0.74 s | 0.74 s |
Spatial resolution of optimal and non-optimal methods
Reconstructed 3D images of four types of typical lung cancer by the direct use of 3D volume reconstruction algorithms without optimal 2D possessing.
Table 3 shows that the OP-3D-XCT method can improve the spatial resolution, and offers advantages over the existing non-optimal method in four common types of lung cancer tissues. The average spatial resolution can be raised by an increment of over 8.6%.
This study reports a new 3D reconstruction method based on two different reformulations.
Several cluster validity indexes based on fuzzy clustering were used to partition an XCT image. These indexes can provide the optimal segmentations of each 2D image section. A fast-FCM algorithm, instead of the existing FCM algorithm, was applied to speed up the 2D image segmenting process. The runtime of the 3D reconstruction process can be reduced by at least an order of magnitude.
Full experimental analysis of the visually observed lung cancer tissues demonstrates that the proposed method offers advantages over existing methods. These research results can be a basis of further research on 3D reconstruction, and can introduce certain practical experiences and techniques for future medical imaging research. While the results are promising, the validity indexes need further evaluation and development to obtain more robust 3D reconstruction results.
Conflict of interest
None to report.
Footnotes
Acknowledgments
This work was supported by the National Science Foundation of China under Grant No. 61774014, 60772080 and the National Program of International S&T Cooperation (2013DFA11040).
