Needle visualization in the ultrasound image is essential to successfully perform the ultrasound-guided core needle biopsy. Automatic needle detection can significantly reduce the procedure time, false-negative rate, and highly improve the diagnosis. In this paper, we present a CNN-based, fully automatic method for detection of core needle in 2D ultrasound images. Adaptive moment estimation optimizer is proposed as CNN architecture. Radon transform is applied to locate the needle. The network’s model was trained and tested on the total of 619 2D images from 91 cases of breast cancer. The model has achieved an average weighted intersection over union (the weighted Jaccard Index) of 0.986, F1 Score of 0.768, and angle RMSE of 3.73°. The obtained results exceed the other solutions by at least 0.27 and 7° in case of F1 score and angle RMSE, respectively. Finally, the needle is detected in a single frame averagely in 21.6 ms on a modern PC.
Breast Cancer Facts & Figures 2019-2020. American Cancer Society. Atlanta: American Cancer Society, Inc.; 2019.
2.
AzamjahNSoltan-ZadehYZayeriF.Global trend of breast cancer mortality rate: a 25-year study. Asian Pac J Cancer Prev. 2019;20(7):2015-20. doi:10.31557/APJCP.2019.20.7.2015.
3.
DesantisCMaJGaudetMNewmanLAMillerKDGoding SauerA, et al. Breast cancer statistics, 2019. CA Cancer J Clin. 2019;69:438-51. doi:10.3322/caac.21583.
4.
SlubowskiTSlubowskaMWojciechowskiA.Diagnostic techniques in breast cancer detection. part II: Physical and biopsy methods. Ginekologia Polska. 2007;78:479-83.
5.
RochaRPintoRTavaresDGonçalvesCFA. Step-by-step of ultrasound-guided core-needle biopsy of the breast: review and technique. Radiologia Brasileira. 2013;46:234-41. doi:10.1590/S0100-39842013000400010.
6.
FattahiASTavassoliAKalantariMRNoorshafieeSRahmaniM.Evaluation of the value of core needle biopsy in the diagnosis of a breast mass. Arch Breast Cancer. 2016;3(2):56-61. doi:10.19187/abc.20163256-61.
7.
DancelRSchnobrichDPuriNFranco-SadudRChoJGrikisL, et al. Recommendations on the use of ultrasound guidance for adult thoracentesis: a position statement of the society of hospital medicine. J Hosp Med. 2018;13(2):126-35. doi:10.12788/jhm.2940.
8.
ChoJJensenTPReiersonKMathewsBKBhagraAFranco-SadudR, et al. Recommendations on the use of ultrasound guidance for adult abdominal paracentesis: a position statement of the society of hospital medicine. J Hosp Med. 2019;14:E7-15. doi:10.12788/jhm.3095.
9.
HuangJTriedmanJKVasilyevNVSuematsuYClevelandRODupontPE.Imaging artifacts of medical instruments in ultrasound-guided interventions. J Ultrasound Med. 2007;26(10):1303-22. doi:10.7863/jum.2007.26.10.1303.
10.
FranzAMHaideggerTBirkfellnerWClearyKPetersTMMaier-HeinL.Electromagnetic tracking in medicine–a review of technology, validation, and applications. IEEE Trans Med Imaging. 2014;33(8):1702-25. doi:10.1109/TMI.2014.2321777.
11.
LassoAHeffterTRankinAPinterCUngiTFichtingerG.PLUS: open-source toolkit for ultrasound-guided intervention systems. IEEE Trans Biomed Eng. 2014;61(10):2527-37. doi:10.1109/TBME.2014.2322864.
12.
XiaWWestSJFinlayMCMariJ-MOurselinSDavidAL, et al. Looking beyond the imaging plane: 3D needle tracking with a linear array ultrasound probe. Sci Rep. 2017;7(1):3674. doi:10.1038/s41598-017-03886-4.
13.
AgarwalNYadavAKGuptaAOrlandoMF.Real-time needle tip localization in 2D ultrasound images using Kalman filter. In: 2019 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (AIM), 2019, pp. 1008-12.
14.
GrovesLAVanBerloBPetersTMChenECS, et al. Deep learning approach for automatic out-of-plane needle localisation for semi-automatic ultrasound probe calibration. Healthc Technol Lett. 2019;6(6):204-9. doi:10.1049/htl.2019.0075.
15.
WijataARanoszŻGalińskaMJuszczykJCzajkowskaJ.Detection and tracking of the biopsy needle using ultrasound images. In: GzikMTkaczEPaszendaZPiętkaE, eds. Innovations in Biomedical Engineering. Cham: Springer International Publishing; 2018, pp. 33-41.
16.
HattCNgGParthasarathyV.Enhanced needle localization in ultrasound using beam steering and learning-based segmentation. Comput Med Imaging Graph. 2015;41:46-54. doi:10.1016/j.compmedimag.2014.06.016.
17.
LeeJYIslamMWohJRWasheemTSMNgohLYCWongWK, et al. Ultrasound needle segmentation and trajectory prediction using excitation network. Int J Comput Assist Radiol Surg. 2020;15:437-43. doi:10.1007/s11548-019-02113-x.
18.
MwikirizeCNosherJHacihalilogluI.Convolution neural networks for real-time needle detection and localization in 2D ultrasound. Int J Comput Assist Radiol Surg. 2018;13(5):647-57. doi:10.1007/s11548-018-1721-y.
19.
YangHShanCBouwmanAKolenAFde WithPHN. Efficient and robust instrument segmentation in 3D ultrasound using patch-of-interest-fusenet with hybrid loss. Med Image Anal. 2021;67:101842. doi:10.1016/j.media.2020.101842.
20.
ArifMMoelkerAvan WalsumT.Automatic needle detection and real-time bi-planar needle visualization during 3D ultrasound scanning of the liver. Med Image Anal. 2019;53:104-10. doi:10.1016/j.media.2019.02.002.
21.
PourtaherianAGhazvinian ZanjaniFZingerSMihajlovicNNgGCKorstenHHM, et al. Robust and semantic needle detection in 3D ultrasound using orthogonal-plane convolutional neural networks. Int J Comput Assist Radiol Surg. 2018;13(9):1321-33. doi:10.1007/s11548-018-1798-3.
22.
ZhaoYShenYBernardACachardCLiebgottH.Evaluation and comparison of current biopsy needle localization and tracking methods using 3D ultrasound. Ultrasonics. 2017;73:206-20. doi:10.1016/j.ultras.2016.09.006.
23.
CzajkowskaJPycinskiBPietkaE.HoG feature based detection of tissue deformations in ultrasound data. In: 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), 2015, pp. 6326-29.
24.
ZhaoYBernardACachardCLiebgottH.Biopsy needle localization and tracking using ROI-RK method. Abstr Appl Anal. 2014;2014:1-7. doi:10.1155/2014/973147.
Kirti, VirmaniJAgarwalR.Characterization of breast tumors using selected laws’ mask texture features. In: 2017 Fourth International Conference on Image Information Processing (ICIIP), 2017, pp. 1-6.
27.
PycińskiBJuszczykJWijataAGalinskaMCzajkowskaJPietkaE.Image guided core needle biopsy of the breast. In: PietkaEBaduraPKawaJWieclawekW, eds. Information Technology in Biomedicine, Advances in Intelligent Systems and Computing, volume 762. Cham: Springer International Publishing; 2019, pp. 160-71.
28.
WijataAAndrzejewskiJPycińskiB.A convolutional neural network for an automatic biopsy needle detection and segmentation on ultrasound images. Mendeley Data, 2021. doi:10.17632/zk6scwv52p.
29.
ToftPA.The Radon transform – theory and implementation. Technical University of Denmark, 1996.
