A guiding approach of Ultrasound scan for accurately obtaining standard diagnostic planes of fetal brain malformation

Abstract

BACKGROUND:

Standard planes (SPs) are crucial for the diagnosis of fetal brain malformation. However, it is very time-consuming and requires extensive experiences to acquire the SPs accurately due to the large difference in fetal posture and the complexity of SPs definitions.

OBJECTIVE:

This study aims to present a guiding approach that could assist sonographer to obtain the SPs more accurately and more quickly.

METHODS:

To begin with, sonographer uses the 3D probe to scan the fetal head to obtain 3D volume data, and then we used affine transformation to calibrate 3D volume data to the standard body position and established the corresponding 3D head model in ‘real time’. When the sonographer uses the 2D probe to scan a plane, the position of current plane can be clearly show in 3D head model by our RLNet (regression location network), which can conduct the sonographer to obtain the three SPs more accurately. When the three SPs are located, the sagittal plane and the coronal planes can be automatically generated according to the spatial relationship with the three SPs.

RESULTS:

Experimental results conducted on 3200 2D US images show that the RLNet achieves average angle error of the transthalamic plane was 3.91±2.86°, which has a obvious improvement compared other published data. The automatically generated coronal and sagittal SPs conform the diagnostic criteria and the diagnostic requirements of fetal brain malformation.

CONCLUSIONS:

A guiding scanning method based deep learning for ultrasonic brain malformation screening is firstly proposed and it has a pragmatic value for future clinical application.

Keywords

Guiding approach ultrasound scan fetal brain malformation standard planes regression location network

Get full access to this article

View all access options for this article.

References

Salomon

L.J.

, Alfirevic

, Berghella

et al., ISUOG practice guidelines (updated): Performance of the routine mid-trimester fetal ultrasound scan, Ultrasound Obstet Gynecol 59(6) (2022), 840–856.

Zhang

, Chen

, Chin

C.T.

et al., Intelligent scanning: Automated standard plane selection and biometric measurement of early gestational sac in routine ultrasound examination, Medical Physics 39(8) (2012), 5015–5027.

, Wen

, Tian.

Fetal brain ultrasound: Diagnostic thinking, Chinese Journal of Medical Ultrasound 12(008) (2015), 590–598.

, Xu

, Ding

et al., Deep learning-based methodology for recognition of fetal brain standard scan planes in 2D ultrasound images, IEEE Access (2020), 44443–44451.

, Xu

, Ding

et al., Standard plane identification in fetal brain ultrasound scans using a differential convolutional neural network, IEEE Access (2020), 83821–83830.

, Yang

, Chen

et al., Standard plane localization in ultrasound by radial component model and selective search, Ultrasound in Medicine & Biology 40(11) (2014), 2728–2742.

Yang

, Ni

, Qin

et al., Standard plane localization in ultrasound by radial component, 2014 IEEE 11th International Symposium on Biomedical Imaging, 2014, pp. 1180–1183.

Lei

, Liu

, Chen

et al., Automatic recognition of fetal standard plane in ultrasound image, 2014 IEEE 11th International Symposium on Biomedical Imaging (ISBI), 2014, pp. 85–88.

Yaqub

, Kelly

, Papageorghiou

A.T.

et al., A Deep learning solution for automatic fetal neurosonographic diagnostic plane verification using clinical standard constraints, Ultrasound in Medicine & Biology 43(12) (2017), 2925–2933.

10.

Chen.

, Wu

, Qi

et al., Ultrasound standard plane detection using a composite neural network framework, IEEE Transactions on Cybernetics 47(6) (2017), 1576–1586.

11.

, Cerrolaza

J.J.

, Sinclair

et al., Standard plane localisation in 3D fetal ultrasound using network with geometric and image loss, The 1st International Conference on Medical Imaging with Deep Learning, 2018.

12.

, Khanal

, Hou

et al., Standard plane detection in3Dfetal ultrasound using an iterative transformation network, International Conference on Medical Image Computing and Computer-Assisted Intervention, 2018, pp. 392–400.

13.

Hou

, Alansary

, Mcdonagh

et al., Predicting slice-to-volume transformation in presence of arbitrary subject motion, arXiv preprint (2017), arXiv:1702.08891.

14.

Yeung

, Aliasi

, Papageorghiou

A.T.

et al., Learning to map 2D ultrasound images into 3D space with minimal human annotation, Medical Image Analysis 70(10) (2021), 101998.

15.

Hou

, Khanal

, Alansary

et al., 3-D reconstruction in canonical co-ordinate space from arbitrarily oriented 2-D images, IEEE Transactions on Medical Imaging 37(8) (2018), 1737–1750.

16.

Di Vece

Dromey

, Vasconcelos

et al., Deep learning-based plane pose regression in obstetric ultrasound, International Journal of Computer Assisted Radiology and Surgery 17(5) (2022), 833–839.

17.

Yang

, Dou

, Huang

et al., Agent with warm start and adaptive dynamic termination for plane localization in 3D ultrasound, IEEE Transactions on Medical Imaging 40(7) (2021), 1950–1961.

18.

González.

Á.

Measurement of areas on a sphere using fibonacci and latitude–longitude lattices, Mathematical Geosciences 42(1) (2010), 49–64.

19.

Simonyan

, Zisserman

Very deep convolutional networks for large-scale image recognition, arXiv preprint (2015), arXiv:1409.1556.

20.

Vaswani

, Shazeer

, Parmar

et al., Attention is all you need, arXiv preprint (2017), arXiv:1706.03762.

21.

Wang

, Bovik

A.C.

, Sheikh

H.R.

et al., Image quality assessment: From error visibility to structural similarity, IEEE Transactions on Image Processing 13(4) (2004), 600–612.

22.

Yoo

, Han

T.H.

Fast normalized cross-correlation, Circuits Syst Signal Process 28(6) (2009), 819–843.

23.

Kingma

, Ba

Adam: A method for stochastic optimization, arXiv preprint (2017), arXiv:1412.6980.

24.

Dou

, Yang

, Qian

et al., Agent with warm start and active termination for plane localization in 3D ultrasound, arXiv preprint (2019), arXiv:1910.04331.

25.

Danala

, Desai

, Ray

et al., Applying quantitative radiographic image markers to predict clinical complications after aneurysmal subarachnoid hemorrhage: A pilot study, Annals of Biomedical Engineering 50(4) (2022), 413–425.

26.

Chen

, Wang

, Zhang

et al., Recent advances and clinical applications of deep learning in medical image analysis, Medical Imaging Analysis 79 (2022), 102444.

27.

Zhang

, Chen

, Zhuang

et al., Recognition of calcifications in thyroid nodules based on attention-gated collaborative supervision network of ultrasound images, Journal of X-Ray Science and Technology 28(6) (2020), 1123–1139.

28.

Zhang

, Zhuang

, Hua

et al., Automated location of thyroid nodules in ultrasound images with improved YOLOV3 network, Journal of X-Ray Science and Technology 29(1) (2021), 75–90.