Sage Journals: Discover world-class research

Abstract

Diagnosis and treatment of endometrial diseases are crucial for women's health. Over the past decade, ultrasound has emerged as a non-invasive, safe, and cost-effective imaging tool, significantly contributing to endometrial disease diagnosis and generating extensive datasets. The introduction of artificial intelligence has enabled the application of machine learning and deep learning to extract valuable information from these datasets, enhancing ultrasound diagnostic capabilities. This paper reviews the progress of artificial intelligence in ultrasound image analysis for endometrial diseases, focusing on applications in diagnosis, decision support, and prognosis analysis. We also summarize current research challenges and propose potential solutions and future directions to advance ultrasound artificial intelligence technology in endometrial disease diagnosis, ultimately improving women's health through digital tools.

Keywords

Artificial intelligence deep learning endometrium ultrasound images disease diagnosis

Introduction

Endometrial disease represents a significant cause of female infertility, and has garnered considerable attention due to its potential impact on fertility. Epidemiological studies of infertility have demonstrated that approximately 10–15% of couples in developed countries encounter fertility challenges. Among these couples, female infertility accounts for 37% of cases.¹ Endometrial disease represents a significant contributor to female infertility.² The epidemiological profile of typical endometrial diseases indicates that endometriosis is a prevalent gynecological disorder globally,³ affecting 10–15% of women of childbearing age and 35–50% of women with pelvic pain and infertility. The peak incidence of endometriosis occurs between the ages of 25 and 45 years, although both postmenopausal and adolescent women are at risk of developing this condition.⁴ Endometrial polyps are also a common endometrial disease, affecting up to 34.9% of women throughout their lives. More importantly, endometrial polyps are common in women with infertility, up to 32% in patients undergoing in vitro fertilization, and malignant transformation occurs in about 3.1% of patients.⁵ Endometrial cancer represents the sixth most common cancer in women globally, accounting for 2% of new cancer cases and 1% of deaths in 2020.⁶ Research has indicated that fertility factors, including the number of births, age at menarche, and timing of menopause, may be linked to inter-individual variations in unopposed estrogen exposure and may contribute to differing endometrial cancer risks.⁷ Other pathologies such as fibroids and endometrial inflammation should also not be ignored. The aforementioned endometrial diseases impact a range of pathological conditions pertaining to the structure and function of the endometrium. For example, endometriosis may result in the formation of pelvic adhesions, elicit an inflammatory response, and impair ovarian function. These changes may, in turn, affect the quality of eggs and the transport of sperm. Similarly, endometrial hyperplasia, endometrial polyps, and endometrial adhesions may result in alterations to the morphology of the uterine cavity, thereby affecting the environment in which the fertilized egg attaches. Furthermore, it is crucial to evaluate the influence of malignant tumors, such as endometrial cancer, on fertility, particularly in young women. The early detection and treatment of endometrial cancer is of the utmost importance in order to maintain fertility, despite the fact that it is a relatively uncommon cause of infertility. In light of the significant risks posed by endometrial disease to women's reproductive and physical wellbeing, the medical community has been engaged in efforts to identify more effective diagnostic and therapeutic approaches for conditions associated with the endometrium.

Diagnostic ultrasound technology is a non-invasive means of medical imaging that offers reproducible and safe characteristics.⁸ Patients can undergo multiple examinations without worrying about surgical risks or ionizing radiation. Additionally, ultrasound equipment is highly portable, relatively low cost, and simple to maintain, making it widely used in daily medical diagnosis, telemedicine, and emergency medical assistance. Ultrasound technology provides a range of imaging modalities that cover organ structure and hemodynamics.⁹ It is particularly effective in high-resolution soft tissue imaging.¹⁰ Ultrasound imaging has demonstrated unique cost-effectiveness and safety advantages in diagnosing specific areas, such as endometrial disease, compared to other imaging techniques like CT and MRI. Therefore, it is an essential tool for screening and diagnosis.

Although ultrasound technology has advantages in diagnosing endometrial disease due to its non-invasive, safe, and cost-effective nature, there are still several challenges and limitations. Expertise and clinical experience are required for interpreting ultrasound images. Furthermore, ultrasound images are rich in information and can contain intricate details, which may lead to the oversight of subtle lesions, particularly when the image quality is poor or the operator lacks experience. AI technologies, particularly deep learning, present novel solutions to the diagnostic challenges of ultrasound by enhancing the precision and efficiency of ultrasound image interpretation. AI-assisted diagnostic ultrasound not only reduces the physician's workload but also provides a more efficient approach to diagnosing endometrial diseases in resource-limited environments. As AI technology continues to advance, it is expected to further improve the process of endometrial disease detection and treatment, as well as the quality of medical services in resource-limited environments.

Despite the paucity of publicly available ultrasound datasets for analysis, AI algorithms have demonstrated a notable growth trend in the field of ultrasound endometrial disease diagnosis, as illustrated in Figure 1. The main areas of application include:

Disease classification: The utilization of AI algorithms to extract and analyze features from ultrasound images, with the objective of differentiating between various types of endometrial diseases, including the distinction between benign and malignant tumors.

Prognosis prediction: AI technology is employed to extract and analyze alterations in pivotal features derived from the images, thereby anticipating the trajectory or outcome of the disease. This facilitates more precise treatment recommendations for patients by enabling physicians to better assess the disease's progression.

Feature extraction: Artificial intelligence (AI) is employed to automatically identify salient features in an image, such as shape, texture, and size, for subsequent analysis.

Image segmentation is a process whereby the image is divided into distinct regions based on visual characteristics. AI algorithms are capable of automatically segmenting specific structures in ultrasound images, such as the boundaries of the endometrium, thereby enhancing diagnostic accuracy.

Endometrial tolerance assessment: To assess the ability of the endometrium to accept embryo implantation during a given menstrual cycle, AI technology can assess the thickness, morphology, and dynamic characteristics of the endometrium.

Figure 1.

Number of AI papers published on ultrasound endometrium per year.

In the field of gynecological health, our team has been engaged in research aimed at improving the diagnosis and management of endometrial diseases through the application of advanced technologies. For instance, our team examined the efficacy of four-dimensional hysterosalpingography (4D HyCoSy) in evaluating the patency of the fimbria of the fallopian tubes in women experiencing infertility.¹¹ Our findings revealed an overall accuracy of 92.9% and sensitivity and specificity exceeding 90%. Subsequently, our team conducted a pioneering pilot cohort study to develop a deep learning-based ultrasound radiomics model that integrated clinical data to predict clinical pregnancy following frozen embryo transfer.¹² The study's key innovation was the integration of ultrasound radiomics features with clinical parameters. The findings demonstrated that the proposed multi-modal fusion model exhibited superior efficacy in predicting the incidence of clinical pregnancy following FET compared to models utilizing images or quantitative variables alone.

Building upon the foundations of our previous work, we will examine the application of AI in ultrasound imaging analysis of endometrial diseases. A review of the paper on the subject was conducted and the findings were collated and summarized in the databases PubMed and Google Scholar. Subsequently, the collected literature was subjected to screening, the process of which is illustrated in Figure 2. The specific method is as follows: Firstly, a Python script was employed to identify and remove duplicate entries based on document titles. Specifically, the SequenceMatcher method from the difflib module was employed for the calculation of the similarity between file names. A similarity threshold of 90% was set, enabling the automatic identification and categorization of duplicates. Within each group of duplicates, only one document was retained, and the similarity between the retained file and the duplicates was recorded in order to ensure transparency and reproducibility of the screening process. Secondly, we read the article's title and abstract and delete any literature not related to the theme “Ultrasound endometrium combined with AI digital health research.” Thirdly, the remaining papers were read in full, and those with overly simplistic artificial intelligence model structures or research methods were excluded. Finally, the 46 English papers were read carefully. The screened paper was classified according to the type of disease studied and subsequently subdivided and summarized according to the application field of AI. The results were presented in tabular form. To the best of our knowledge, there is currently no extensive and comprehensive survey that provides a summary of the application and future trends of AI technology in the diagnosis of endometrial diseases. The objective of this article is to address this gap in the existing literature. This article makes the following contributions:

This paper provides a comprehensive review of the application and technological advancements of AI in ultrasound imaging, specifically focusing on traditional machine learning and deep learning methods for diagnosing endometrial diseases.

It compares the effectiveness of traditional machine learning techniques with deep learning approaches in key areas such as ultrasound image feature extraction, disease classification, and prognosis assessment, offering a scientific basis for selecting the most suitable technological path for these applications.

Additionally, the paper addresses unresolved challenges and existing methodologies in this field. It proposes potential solutions and outlines future development trends in response to the identified issues, emphasizing the ongoing progress of integrating AI with ultrasound technology for endometrial disease diagnosis.

Figure 2.

Paper screening process.

Ultrasound images for diagnosing endometrial diseases

Ultrasound image characteristics

Endometrial diseases are a group of conditions that can significantly impact women's reproductive and physical health. This group includes endometrial polyps, endometrial tuberculosis, endometrial cancer, and endometriosis. These conditions can cause menstrual disorders, dysmenorrhea, infertility, and even life-threatening complications. Therefore, it is crucial to diagnose endometrial diseases accurately and promptly to ensure effective treatment. In the field of ultrasound medicine, techniques such as B-mode ultrasound, vaginal ultrasound, 3D ultrasound, and color Doppler flow imaging provide crucial information for diagnosing endometrial diseases.

Although ultrasound techniques are commonly used in clinical practice, the development of deep learning algorithms is limited by the availability of sufficient image datasets. As demonstrated in Figure 3, color Doppler flow imaging is essential for diagnosis, but its application in deep learning is restricted due to the scarcity of datasets. In this paper, we will focus on introducing and analyzing medical images that are commonly used in ultrasound AI in order to advance practical technology development and clinical applications.

Figure 3.

Distribution of types of datasets used in research papers.

Abdominal B-mode ultrasound is a fundamental imaging technique that provides two-dimensional gray-scale images for assessing endometrial thickness, morphology, and potential growths and lesions. It is a crucial initial screening tool. The endometrium appears moderately bright on ultrasound images and is affected by various factors, including the menstrual cycle, thickness, and underlying lesions such as polyps, hyperplasia, and leiomyomas. If a lesion is present, the echo characteristics will vary depending on the type of lesion. It is important to note that subjective evaluations have been excluded from this description. However, image quality may be reduced and artefactual interference increased due to limitations in image resolution and abdominal wall fat in obese patients.

Vaginal ultrasound is the main data source for machine learning and deep learning analysis, as shown in Figure 4. It provides two-dimensional grey-scale images similar to those of abdominal ultrasound but with reduced interference from abdominal fat and intestinal gases due to the use of intra-vaginal probes. This result in a clearer image of the uterus. Vaginal ultrasound is a valuable diagnostic tool in gynecology and obstetrics as it can reveal abnormal echogenic features of the endometrium more clearly than abdominal ultrasound, especially in cases where abdominal ultrasound is not effective. Vaginal ultrasound is a valuable diagnostic tool in gynecology and obstetrics as it can reveal abnormal echogenic features of the endometrium more clearly than abdominal ultrasound, especially in cases where abdominal ultrasound is not effective. However, it may cause discomfort and is not applicable to certain patient groups.

Figure 4.

Endometrial vaginal ultrasound image.

Three-dimensional ultrasound technology creates a 3D model by combining multiple 2D images,¹³ as demonstrated in Figure 5. This method provides more comprehensive spatial information than conventional 2D ultrasound. This technique accurately reveals the localization, size, and morphology of lesions, enabling physicians to review the endometrial structure from multiple perspectives and depths. This allows for a more accurate assessment of its thickness, morphology, and potential for abnormal proliferation and lesions. Although the high cost and operational complexity of 3D ultrasound currently limit its widespread use, technological advances are expected to gradually reduce these barriers.

Figure 5.

3D multi planar ultrasound sonogram of unicornuate uterus.

The importance of ultrasound AI

Various ultrasound techniques provide a wealth of image information for the detection of endometrial disease. However, these techniques also pose challenges. The traditional method of relying on the physician for visual examination suffers from unavoidable problems:

The challenges in diagnosing various endometrial ultrasound image diseases include a lack of specialists with sufficient domain knowledge, differences in the level and number of specialists across regions, and the inexperience and long growth cycle of young doctors.

Prolonged traditional examination and diagnosis can lead to a decrease in doctors’ attention, increasing the risk of misdiagnosis and diagnosis time.

The diverse manifestations of endometrial diseases can complicate visual diagnosis.

The emergence of these problems increases the burden on patients. To improve the accuracy and efficiency of diagnosis, reduce the burden on specialists, and provide opportunities for young doctors to learn and improve, the field of medicine has been exploring integration with other fields. AI is undoubtedly one of the most promising applications in assisted diagnosis.^14–16 Compared to manual ultrasound image diagnosis, AI can process and analyze large amounts of data quickly, improving work efficiency. Its ability to process high-dimensional data helps to discover details that may be overlooked by human experts. As technology advances, AI will play an increasingly important role in future medical practice.

The use of AI in endometrial disease diagnosis via ultrasound

Figure 6 shows that AI techniques are divided into two main categories: traditional machine learning and deep learning. Traditional machine learning relies on manual feature extraction, which has the advantage of model interpretability and fast inference.¹⁷ In contrast, deep learning automatically learns complex features from data without the need for tedious feature engineering. Ultrasound image analysis presents several challenges, including high-dimensional data, dynamic changes, and noise interference. Efficient analysis methods capable of handling large numbers of pixels and capturing subtle time-varying patterns are required. Furthermore, the subjectivity and inconsistency of ultrasound image interpretation can increase diagnostic difficulty. In response to these challenges, deep learning has shown significant advantages due to its ability to automate feature extraction and process high-dimensional data. This paper will focus on deep learning, while traditional machine learning is preferred in some cases for its interpretability and efficiency.¹⁸ When applying AI techniques to ultrasound imaging, the appropriate method should be selected based on the task requirements and available resources.

Figure 6.

Categories of AI algorithms.

Applying conventional machine learning to endometrial disease imaging

Traditional machine learning, as a branch of AI, originated from the checkers program developed by Samuel in 1959.¹⁹ In the field of endometrial imaging, traditional machine learning methods face challenges, particularly when dealing with image data. Figure 7 illustrates that these methods typically require feature engineering to manually extract key features in the image,²⁰ such as regions, shapes, and textures. Subsequently, a feature selection algorithm filters the features most relevant to disease diagnosis.²¹ These features are then combined with the patient's clinical data to form the input for the machine learning model. This section evaluates these methods according to the algorithms’ objectives, which aim to address the problem of insufficient data for a single disease and explore the commonalities between different diseases to find a universal machine learning strategy.

Figure 7.

Schematic diagram of machine learning algorithm processing flowchart.

Traditional machine learning for prognostic analysis

Prognostic analysis enables the stratification of patients into different risk groups, aiding physicians in providing more precise treatment recommendations and improving treatment outcomes.²² Prognostic analyzes aim to assess the likely outcome or course of a disease. Research in this area can be categorized into four types as shown in Figure 8.

Figure 8.

Categories of prognostic analysis research.

In prognostic analysis of ultrasound endometrial images using traditional machine learning, it is essential to first perform feature extraction and feature screening on the images. This is because traditional machine learning algorithms typically handle numerical or tabular data, whereas images are complex collections of elements.²³ Upon completion of the feature extraction and screening process, the most suitable machine learning algorithm can be selected based on the specific application scenario. This selection process requires comprehensive consideration of factors such as model performance, complexity, training time, and adaptability to data to ensure that the selected algorithms can effectively solve real-world problems while maintaining high operational efficiency. Table 1 presents the research on machine learning in the field of prognostic analysis.

Table 1.

Machine learning algorithms for ultrasound endometrial prognostic analyses—development, strengths, and weaknesses.

Reference	Type	Feature extraction methods	Models	Advantage	Limitations
Eriksson et al.²⁴	RC	Manual	Logistic regression	Variable Interaction	Linear fitting only
Liro et al.²⁵	SP RC	Manual	Logistic regression	Integration of ultrasound properties	Inaccurate manual measurements; Normal normality hypothesis
Arezzo et al.²⁶	RC	RFE	Random Forest	Multi-parameter fusion; Handling of unbalanced data	More features computationally intensive
Visalax et al.²⁷	RC	CNN	Random Forest, SVM	Handling high-dimensional data; Suitable for small samples	Computationally intensive; Parameter tuning is complex
Moro et al.²⁸	RC PD	U-Net	Logistic regression, Random Forest	Adaptation to non-linear relationships	Suitable for small to medium-sized datasets only
Huang et al.²⁹	SP RC	U-Net	COX regression	Combining clinical parameters	Important features overlooked
Wang et al.³⁰	PD	ICA	AdaBoost	Combinatorial weak classifier; Highly interpretable	Noise sensitive; Increased complexity
Xu et al.³¹	RC PD	Decision Tree	Random Forest, SVM	Fast training speed	Lack of validation in clinical settings

SP: survival prediction; RC: risk classification; PD: predictor discovery.

The field of ultrasound endometrial prognostic analysis is increasingly utilizing machine learning techniques, with a shift towards multi-model integration. Previous studies have primarily employed single models, such as logistic regression, to analyze disease stages by combining ultrasound features with clinical data. As research progressed, researchers explored multi-model integration strategies such as Random Forest,³² Support Vector Machine (SVM),³³ and Hybrid AdaBoost.³⁴ These strategies enhance prediction accuracy and robustness due to their ability to effectively deal with data uncertainty and noise.

Furthermore, in prognostic analyzes, feature extraction methods for machine learning have shifted from traditional manual measurements to deep learning automated techniques. Convolutional neural networks (CNNs) and U-Net are examples of deep learning techniques that can automatically extract complex features from ultrasound images,³⁵ making them particularly effective for small sample datasets. The ability of feature extraction and generalization performance of deep learning models, such as variants of U-Net, deep convolutional networks, and migration learning, has been further improved.

The focus of research has shifted from utilizing a large number of features to identifying key features. Early studies extracted a large number of features through manual measurement or machine learning methods, but the model results were unsatisfactory. With the advancement of technology, researchers have begun to employ feature screening techniques, such as ANOVA,³⁶ ridge regression,³⁷ recursive feature elimination (RFE),³⁸ and Pearson's correlation coefficient,³⁹ to decrease the number of features and enhance model efficiency and generalization. These methods aid in identifying the features that have the most significant impact on the prediction results, constructing streamlined and efficient models, and enhancing the adaptability of non-linear relationships between features. This provides a more comprehensive perspective on endometrial prognostic analyzes.

Machine learning for endometrial disease recognition and diagnosis

Traditional machine learning methods are crucial in identifying and diagnosing endometrial diseases. These methods construct efficient diagnostic models by extracting features from ultrasound images and combining them with clinical data to determine whether a patient has the disease. Figure 9 shows the varied applications and effectiveness of machine learning techniques in diagnosing a wide range of endometrial diseases across different pathological conditions.

Figure 9.

Percentage of machine learning applications for endometrial disease diagnosis.

In the diagnosis of endometrial cancer, machine learning models are used to improve prediction accuracy. Guerriero et al. investigated single models such as k-NN and Naive Bayes.⁴⁰ They stated that Naive Bayes works well with low feature correlation, while k-NN is suitable for small data sizes. Wang et al. developed an integrated model, TJHPEC, which fuses logistic regression, gradient-boosted decision trees, and random forests.⁴¹ This model demonstrated high accuracy and AUC values but may increase computational cost. Studies on endometriosis have aimed to improve the sensitivity and specificity of diagnostic models. According to a systematic review by Sivajohan et al., the random forest model has diagnostic potential, particularly when symptoms are not evident.⁴² Logistic regression was found to perform well in the diagnosis of the disorder by Bendifallah et al.,⁴³ but selecting the model and feature engineering remain a challenge. He et al. investigated the use of machine learning to enhance the diagnostic efficiency of 3D transvaginal ultrasound imaging.⁴⁴ However, this approach may be restricted by equipment and expertise.

This development in technology has allowed for machine learning to be applied from a single model to multiple models. The integration of multiple models, such as Random Forest and Gradient Boosting Decision Tree,⁴⁵ has improved the accuracy and robustness of predictions for ultrasound endometrial disease diagnosis. Furthermore, researchers have started to consider factors beyond models, such as enhancing image quality. This implies that, in addition to selecting a model, other techniques like image processing and data preprocessing are equally crucial and deserving of attention in diagnosing endometrial disease.

Machine learning for endometrial disease classification

Machine learning has various applications in classification, including distinguishing between benign and malignant tissues of endometrial cancer (EC), classifying endometrial tuberculosis stages, and predicting pregnancy success. Conventional machine learning methods are crucial in improving the accuracy and efficiency of endometrial disease classification. These methods offer new insights for clinical diagnosis by analyzing ultrasound image features. Although there has been some progress, machine learning studies for other endometrial diseases are still relatively limited. This may be due to sample size, the complexity of disease features, or uneven allocation of research resources. Therefore, this paper will focus on the progress of machine learning classification research for these three diseases.

In studies on the classification of endometrial cancer, Capasso et al. achieved high AUC values by extracting radiomics features from ultrasound images and applying a support vector classifier.⁴⁶ Karahaliou et al. successfully distinguished between benign and malignant tissues by employing wavelet transform texture enhancement.⁴⁷ Bogani et al. combined radiomics and molecular characteristics to provide personalized treatment decisions for patients.⁴⁸ In a study on the classification of endometrial tuberculosis, Garg et al. used the gradient local autocorrelation covariance model (GLAC) and non-subsampled contour wavelet transform (NSCT) to extract texture features and improve classification accuracy.⁴⁹ Sahoo et al. compared various models and found that the NSCT-based GLCM model performed the best in terms of classification performance.⁵⁰ These studies demonstrate the benefits of using multiscale and multidirectional transforms for image feature extraction, providing new technical tools for image analysis. Li et al. developed a logistic regression model to predict pregnancy success by combining clinical indicators and ultrasound image features.⁵¹ Similarly, Mori et al. used local binary pattern (LBP) analysis of ultrasound image features to predict pregnancy outcomes.⁵²

These studies improve the accuracy of prediction and provide a precise basis for clinical decision-making. Texture feature extraction, enhancement, and multimodal data fusion have become key methods in the classification of endometrial diseases.⁵³ The combination of clinical and molecular genetic features can further improve classification accuracy and the development of personalized treatment plans. This provides new perspectives and directions for future research.

Application of deep learning algorithms

Deep learning algorithms are a type of machine learning algorithm that originated from artificial neural networks (ANN). They simulate the way the human brain processes information by building deep neural networks. In the context of diagnosing endometrial disease using ultrasound, deep learning has advantages over machine learning. It can automatically learn features from raw image data, eliminating the need for complex feature engineering, reducing data processing time, and enabling training on large-scale datasets.

Deep learning in endometrial cancer

Endometrial cancer is a prevalent gynecological malignancy. Early detection and treatment are crucial to improve patient survival rates and quality of life. Currently, most studies in this field focus on MRI and hysteroscopic images. Ultrasound images are still a minority of applications, and research on deep learning in endometrial cancer mainly centers on three key aspects: disease classification, development trend prediction, and diagnosis of the degree of myometrial infiltration.⁵⁴ Figure 10 shows the proportion of deep learning applications in endometrial cancer research in the existing Literature.

Figure 10.

Share of major applications of deep learning in endometrial cancer.

The use of deep learning in endometrial cancer classification involves analyzing data such as ultrasound images to identify the features that distinguish endometrial cancer from other gynecological diseases. This classification encompasses not only the determination of whether endometrial cancer is benign or malignant, but also the classification of a wide range of diseases that include endometrial cancer, depending on the study's objective. This classification aids doctors in making more precise diagnoses and providing more accurate treatment options for patients.

Predictive applications in deep learning are primarily used to forecast the development of endometrial cancer and the prognosis of patients. Deep learning models can predict the likelihood of cancer recurrence, metastatic trends, and the type of lesion by analyzing patients’ clinical data and ultrasound imaging features. Detecting myometrial infiltration is a crucial tool for evaluating the aggressiveness of endometrial cancer. Deep learning models can assist doctors in determining whether a tumor has invaded the myometrium and to what extent. The presence of myometrial infiltration typically indicates a more advanced stage of the disease. This information is crucial in deciding the extent of surgery and the treatment options available. Table 2 presents the utilization of deep learning in the diagnosis of endometrial cancer through ultrasound imaging. This research is categorized into three sections, each pertaining to a distinct diagnostic objective: classification, prediction, and myometrial invasion detection.

Table 2.

Deep learning in ultrasound for endometrial cancer.

Reference	Type	Models	Key results	Advantages	Limitations
Fang et al.⁵⁵	CL	DenseNet	Accuracy: 0.75 AUC: 0.87 F1: 0.74	Self-supervised integrated learning	Imbalance in data sets; Inability to preserve the lesion area
Xia et al.⁵⁶	CL	DPA-UNet	Accuracy: 0.80 Recall: 0.87	Improved recognition of small objects; Improvement of data imbalance	Structural complexity; Feature extraction biased spatial features
Qin et al.⁵⁷	CL	Inception+ ResnetV2	AUC: 0.926 Sensitivity:0.88 Specificity: 0.84	Integrated multi-scale information; Balanced Complexity	Insufficient capture of local details; Limited flexibility in adjustments
Luo et al.⁵⁸	PR	ResNet50+ Transformer	Accuracy:0.80 Macro-AUC:0.9	Multi-model fusion; Label smoothing ; Attention fusion	High computational complexity of the self-attention mechanism
Satya et al.⁵⁹	PR	LSTM Bi-LSTM	Accuracy: 0.97 Specificity: 0.98 Sensitivity: 0.97	Capturing long-term dependencies	Sexual bottlenecks in long sequence processing
Diletta et al.⁶⁰	PR	U-Net+ MobileNet	Dice: 0.71 AUC: 0.65	Multi-model optimisation of hyperparameters	Limited ability to process high-resolution images
Malarvizhi et al.⁶¹	PR	ResNet	Accuracy: 0.74	Probabilistic verification	Presence of hypothetical systematic
Liu et al.⁶²	MD	EfficientNet-B6	Accuracy:0.80 AUC: 0.814 Sensitivity: 0.62	Balancing network depth, width and resolution; Good performance and calculations	Slow training on large size images; Larger model parameters

CL: classification; PR: prediction; MD: myometrial infiltration detection.

In research on the classification of endometrial disease, deep learning techniques, particularly convolutional neural networks (CNNs), are commonly used for extracting image features and recognizing diseases. The research process typically involves two stages: first, deep learning models automatically extract features from ultrasound images; second, diseases are accurately classified based on these features. This approach enhances diagnosis accuracy and improves the efficiency of handling large data sets. In the field of lesion prediction and analysis, deep learning techniques demonstrate great potential to enhance prediction accuracy and segmentation efficiency. Researchers have explored a variety of model design and optimization strategies by combining various deep learning architectures, such as different types of CNNs, Transformer,⁶³ LSTM,⁶⁴ and Bi-LSTM.⁶⁵ Future research will aim to develop efficient algorithms to reduce computational burden, explore data augmentation and regularization techniques to enhance generalization, and utilize multimodal data and interdisciplinary approaches to improve prediction accuracy. In the field of muscle infiltration detection, automated detection research follows an image recognition plus extent assessment strategy. Deep learning techniques are utilized to precisely identify and analyze muscle infiltration features in transvaginal ultrasound images, followed by an assessment of the extent of infiltration. The main objective is to enhance the accuracy of the image recognition algorithm and the reliability of the extent assessment method. Future research will focus on the generalization ability and adaptability of deep learning models to different patient populations. Model training and validation using cross-center, multi-population large-scale datasets can effectively enhance the generalization ability of models.

Deep learning in endometriosis

Endometriosis is a prevalent gynecological condition that occurs when endometrial tissue, which typically grows inside the uterine cavity, appears outside the uterus. This ectopic tissue can grow in various locations, including the ovaries, fallopian tubes, and pelvic peritoneum, causing symptoms such as pain, irregular periods, and infertility. The use of deep learning techniques in this field concentrates on three primary areas: segmentation, classification, and assisted diagnosis of endometriosis. Figure 11 illustrates the percentage of each study in the surveyed literature.

Figure 11.

Deep learning research in endometriosis.

Deep learning segmentation methods accurately identify ectopic tissues from complex backgrounds, providing physicians with critical visual information to improve disease examination results. The classification of endometriosis is mainly based on the lesion's morphological characteristics and the precise classification of multiple diseases containing endometriosis. The use of deep learning for assisted diagnosis of endometriosis involves altering data representation methods, integrating additional images, and creating systems for multiple assisted diagnoses. Table 3 provides a detailed summary of the three primary research methods employed in the field of deep learning for endometriosis.

Table 3.

The use of deep learning in ultrasound for endometriosis.

Reference	Type	Models	Key results	Advantages	Limitations
Visalaxi et al.⁶⁶	SE	U-Net	IOU: 0.72 F1: 0.74	Pixel level classification; Transfer learning	Relying on high-quality annotations
Podda et al.⁶⁷	SE	U-Net +DenseNet	Dice :82% Jaccard :71%	Multi-scale; Training set size insensitivity	Dataset diversity limitations; 2D image analysis only
Li et al.⁶⁸	CL	Inception +Resnet	AUC:0.914	Multi-scale	High complexity; Numerous parameters
Hu et al.⁶⁹	CL	EfficientNet ResNet-152 DenseNe	AUC:0.986 Sensitivity:0.9 Specificity:1	Multi-model; Less computational complexity	Single center data mall sample size
Balica et al.⁷⁰	CL	DenseNe, Xception Inception-V4	AUC:0.90	Multiple network structure; Data augmentation	There is data bias; Overfitting risk
Zhang et al.⁷¹	CL	VGGNet-16	Accuracy:0.80 Sensitivity:0.84 Specificity:0.92	Recognition can be comparable to that of a doctor	Insufficient feature extraction ability
Yang et al.⁷²	AD	VGG-GAP IC3D	Accuracy:0.96 Recall:0.97 F1:0.97	Reduce the number of parameters; Simplified structure	Limited feature extraction capability; Long training time
Li et al.⁷³	AD	ResNet50+ Transformer	Accuracy:0.91 Dice:0,85	Attention binding; Feature fusion; Diagnostic system	Large number of parameters; Long sequence processing
Mansouri et al.⁷⁴	AD	Fusion model	New MR and US image fusion methods	Fusion of MR contrast and US spatial resolution	Registration error not considered; Dependent parameter selection
Kiranmai et al.⁷⁵	AD	3D CNN	Dice:0.9033 Specificity:0.98 Sensitivity:0.90	Combining machine learning; Capturing 3D structure	High demand for data; Large computational load
Zhang et al.⁷⁶	AD	ResNet(2 + 1)D + 3D ViT	US-AUC:0.96 MR-AUC:0.90	Knowledge Distillation; Pre-training	Interdisciplinary Differences; Need to design distillation strategy

SE: segmentation; CL: classification; AD: assisted diagnosis.

Image segmentation technology is crucial in diagnosing endometriosis. Its purpose is to accurately identify and locate diseased structures in images. Recent studies have shown that combining U-Net and its variants with convolutional neural networks like DenseNet has resulted in remarkable segmentation performance,⁷⁷ as evidenced by higher intersection ratios and Dice coefficients. Transfer learning and multi-scale feature extraction are effective in improving the accuracy of pixel-level classification.⁷⁸ However, success often depends on high-quality data annotation, which can be a limiting factor in clinical settings where data is scarce.

In medical image analysis, the focus of image classification technology is primarily on identifying and classifying diseases. Research indicates that models such as Inception,⁷⁹ ResNet,⁸⁰ and EfficientNet are advantageous in extracting multi-scale features and can produce rich classification results. By comparing multiple models and utilizing data augmentation, these models can improve their generalization capabilities and robustness. However, increasing model complexity and the number of parameters can lead to overfitting, particularly when the sample size is limited. Therefore, researchers must pay attention to data diversity and model regularization to address the risks of data bias and overfitting.

The evolution of auxiliary diagnosis technology is demonstrated by the transition from traditional CNN to Transformer architecture, and then to models that combine the two. Initially, CNN models like VGGNet-16 made significant strides in recognizing common lesions due to their strong feature extraction capabilities. Later, the Transformer architecture utilized the self-attention mechanism to capture global dependencies and enhance diagnostic accuracy. Hybrid models of CNN and Transformer are currently receiving attention. These models combine the local feature extraction of CNN with the global information processing capabilities of Transformer. The aim is to improve recognition and classification performance, reduce dependence on a large amount of high-quality annotated data, and reduce computational costs. Technologies such as knowledge distillation and image fusion can also help improve model performance.⁸¹

Application of deep learning in endometrial receptivity assessment

The assessment of endometrial receptivity refers to the ability of the endometrium to accept embryo implantation at specific times in the menstrual cycle. This is a complex biological process that involves the morphology of the endometrium, endometrial movement, and endometrial blood supply. It is important to note that this assessment involves not only ultrasound image data but also the design of clinical text data. Currently, there are few studies that use deep learning models to evaluate endometrial receptivity by ultrasound. Literature research suggests that receptivity assessment can be divided into thickness, morphology, dynamic characteristics, and comprehensive assessments. Figure 12 illustrates the distribution and proportion of tolerance assessment types in the literature.

Figure 12.

Distribution of tolerance assessment studies.

Endometrial thickness is a crucial factor in predicting the success of embryo implantation. Assessing endometrial thickness can aid in determining the optimal time for uterine reception and optimizing embryo transfer strategies. Additionally, for patients experiencing postmenopausal bleeding, measuring endometrial thickness is a vital screening method for diagnosing endometrial lesions, including endometrial cancer. Furthermore, the morphology of the endometrium, specifically whether it is leafed before ovulation or uniform after ovulation, has a significant impact on the success rates of pregnancy. Ultrasonography is used to quantify endometrial peristaltic characteristics, such as frequency, direction, intensity, and speed, which are crucial for sperm transport, menstrual excretion, and embryo implantation and development. Table 4 outlines the research models and methods of deep learning used in the personalized comprehensive assessment, which combines ultrasound data with clinical parameters to provide an in-depth understanding of endometrial receptivity.

Table 4.

Research methods for deep learning in endometrial receptivity assessment receptivity.

Reference	Type	Models	Key results	Advantages	Limitations
Singhal et al.⁸²	TE	U-Net	Promote:0.30 87% error < 2 mm	High-precision measurement; Automated process	Structure sensitive; Insufficient boundaries
Liu et al.⁸³	TE	SegNet+ ResNet50	Dice:0.82 89.3% error < 2 mm MAE :2.3 mm	Feature extraction; multi-scale features	Difficult to measure small thickness
Yiyang et al.⁸⁴	TE	DDRNets	Dice: 0.895 Recall: 0.884 Accuracy:0.998	Dual resolution; Semantic segmentation	Fusion optimization is difficult; Complex structure
Hu et al.⁸⁵	TE	U-Net	Dice:0.83 MAE: 1.38 mm RMSE:1.85 mm	Accurate locating; Contextual information	Boundary error is large; Deeper structure
Wang et al.⁸⁶	TE	3D U-Net	Dice: 90.83% Jaccard: 83.35% 94.2%error < 2 mm	Three-dimensional spatial information; Multi-scale	Large amount of calculation; Noise sensitive
He et al.⁸⁷	TE	U-Net	Dice:88.40% 94.2% error < 2 mm	Multitasking; Information complementation	Difficulty processing samples with unclear boundaries
Singhal et al.⁸⁸	ME	U-Net 3D point cloud	Measurement consistency: 0.89	3D information; High-precision point cloud	High resource consumption; Training time is long
Kentaro et al.⁸⁹	ME DC	VGG Optical flow method	Shape AUC: 0.65 Speed AUC: 0.72	Assess intimal morphology; Predict pregnancy	Manual image alignment
Wang et al.⁹⁰	DC	ResNet+ Optical flow method	Consistency: 0.96 Peristaltic speed: 0.14 (mm/s)	Multi-dimension; Automated analysis Multitasking	Image quality is less affected by
Liang et al.¹²	CE	Multi-modal model	AUC:0.825 Accuracy:0.96 Specificity:0.58	Information complementation; Personalized results	Exclude thin endometrium; There are challenges in aligning data from different modalities

TE: thickness evaluation; ME: morphology evaluation; DC: dynamic characterization evaluation; CE: comprehensive evaluation.

The measurement of endometrial thickness is automated using the “segmentation-measurement” framework. The accuracy of the image segmentation technology and the suitability of the measurement method are crucial. U-Net and its variants are highly effective in controlling errors, and 3D U-Net further enhances accuracy through multi-scale feature fusion. However, the model still encounters difficulties in dealing with fine thicknesses and boundaries. The assessment of endometrial morphology utilizes the “feature extraction-pattern recognition” strategy. The accuracy of feature extraction and the recognition power of the deep learning model are crucial. The combination of 3D point cloud with U-Net enhances the visualization accuracy of uterine structural abnormalities,⁹¹ but it has high computational requirements and is sensitive to noise. Future research will aim to improve model generalization, reduce reliance on large amounts of annotated data, and explore new data representations and network architectures. With regard to dynamic feature evaluation, deep learning technology is used to extract initial dynamic features, such as peristaltic waves, and analyze them through specific algorithms. The combination of CNN and the optical flow method demonstrated high consistency in assessing intimal peristalsis, highlighting the potential of the model for multi-dimensional assessment.⁹² Comprehensive evaluation involves combining clinical and ultrasound image data, which demonstrates the advantages of complementary multimodal information, despite challenges in modal data alignment. To enhance the model's generalization ability and evaluation accuracy, it is expected that a comprehensive analysis will be conducted using additional modal information.

Research on deep learning in the field of endometrial receptivity assessment is still in its early stages but is rapidly developing. Technological advancements are mainly seen in three areas: the transition from 2D to 3D, the evolution of deep learning models, and the exploration of multi-modal data fusion. These advancements offer the potential for more accurate endometrial assessment and can aid in improving the precision of clinical decision-making.

Application of deep learning in other endometrial diseases

The use of deep learning technology in diagnosing endometrial diseases has expanded. It has potential value for various endometrial-related diseases, including endometrial cancer, endometriosis, and endometrial receptivity. Although there have been few studies on conditions such as endometrial tuberculosis, adhesions, hyperplasia, and uterine fibroids, the clinical significance of these diseases cannot be ignored.

Endometrial tuberculosis is an infectious disease that can cause symptoms such as irregular menstruation, infertility, and lower abdominal pain. Endometrial adhesions, which are often caused by surgery, infection, or inflammation, can lead to problems such as light menstruation, dysmenorrhea, and infertility. Endometrial hyperplasia may manifest as irregular menstruation and abnormal uterine bleeding. Uterine fibroids, a common benign tumor, may cause symptoms such as menorrhagia, pelvic pain, and infertility. Through a comprehensive analysis of existing research results, deep learning technology offers new ideas and methods for the early diagnosis and treatment of diseases. Table 5 demonstrates the various aspects of deep learning application in ultrasound diagnosis, including identification and detection of endometrial tuberculosis and uterine fibroids, classification of endometrial hyperplasia, and diagnosis of endometrial adhesions. These advances offer clinicians more accurate diagnostic tools and lay the foundation for future research directions and clinical applications.

Table 5.

The research methods used for deep learning in ultrasound for endometrium and other diseases.

Reference	Type	Models	Key results	Advantages	Limitations
Varsha et al.⁹³	ET	NSCT+ ResNet50	Accuracy:0.88 F1:0.832 Sensitivity:0.86	Multi-scale; Multi-directional analysis; Edge preservation	Parameter selection for NSCT Professional knowledge required
Garg et al.⁹⁴	ET	Fusion model	F1:0.84 Accuracy :0.86	Enhance texture; Noise suppression	Insufficient classification performance
Fumagalli et al.⁶⁰	EY	U-Net+MobileNet	Dice:0.7 AUC:0.60–0.65	Automation; Segmentation consistency	There is data bias risk of overfitting
Fang et al.⁵⁵	EY	DenseNet VGGNet ResNet	Accuracy:0.75 AUC:87.3% Recall:73.4%	Distillation strategy; Voting strategy	Data imbalance; Loss of diseased area
Yang et al.⁹⁵	UF	YOLOv3+EfficientNet	F1:0.95 Accuracy:0.98 Speed:0.28/S	High speed; Strong scalability	Insufficient small object detection capability
Kaveramma et al.⁹⁶	UF	Vision Transformer	Accuracy:0.975 F1:0.97 AUC:0.97	Parallel processing; Self-attention mechanism	Sensitive to parameter selection; Insufficient local attention
Wu et al.⁹⁷	EA	Extreme learning machine	MSE:0.0071 Accuracy:0.90	Feature map	Limited expressive ability

ET: endometrial tuberculosis; EY: endometrial hyperplasia; UF: uterine fibroids; EA: endometrial adhesions.

In the field of endometrial lesion detection, the combination of deep learning technology and image feature enhancement algorithms has proven to be effective. For instance, the Region Proposal Network (RPN) combined with ResNet50 performs exceptionally well in detection performance,⁹⁸ highlighting its efficiency in candidate region generation and localization. The Non-subsampled Contourlet Transform combines the ResNet50 method to effectively retain image details through multi-scale analysis.⁹⁹ Furthermore, the model that combines geometric features with NSCT achieved an accuracy of 0.91 on ResNet50, highlighting the benefits of multi-scale analysis.

When it comes to the automatic segmentation and classification of endometrial hyperplasia, U-Net and its variants can be combined with different CNN backbone networks to improve segmentation accuracy and reduce the need for manual intervention. The ensemble learning method can enhance the model's generalization ability and robustness by fusing different network architectures. The YOLO series model combined with CNNs such as EfficientNet has excellent accuracy and detection speed for detecting uterine fibroids,¹⁰⁰ making it suitable for real-time clinical applications. Additionally, the Vision Transformer model provides a new perspective for feature extraction through its self-attention mechanism,¹⁰¹ but further optimization is needed for hyperparameter adjustment and local feature capture. The model demonstrated high accuracy in detecting endometrial adhesions. However, its limitations in model structure suggest the need for future research to explore more efficient network structures and feature extraction technologies. These research results provide a foundation for the application of deep learning in diagnosing endometrial diseases and point toward future technological development.

Research directions and challenges

Main research directions and model analysis of endometrial diseases combined with AI

The previous discussion explored the various applications of ultrasound AI in diagnosing endometrial diseases. This included an in-depth examination of the latest progress and specific practices of traditional machine learning and deep learning technologies for different disease types. In order to facilitate a more intuitive understanding of the research results and technical features, a summary of the principal research directions pertaining to endometrial diseases and the corresponding AI models is presented in Table 6. This summary is designed to assist in the comprehension of the relative advantages and limitations of the various technologies in practical applications.

Table 6.

Research on the application of AI in the diagnosis of endometrial diseases.

Type	Research direction	Main model	Key methods	Application potential
Endometrial cancer	Prognostic Analysis	Logistic regression; Random forest; LASSO; COX	RFE; ANOVA	Risk stratification; Personalized treatment
	Classification	DenseNet Inception Resnet	Multiscale; Feature fusion	Assist clinical decision-making
	Prediction	ResNet Transformer Bi-LSTM	Attention binding; Multi-model fusion	Forecast development trends
	Infiltration Testing	EfficientNet ResNet	Hidden Markov	Assess the extent of invasion
Endometriosis	Segmentation	U-Net DenseNet ResNet	Transfer learning; Multi-scale special	Improve recognition accuracy
	Classification	Inception ResNet DenseNet	Multi-scale; Data augmentation	Improve accuracy
	Auxiliary Diagnosis	ResNet VIT 3D CNN	Image fusion; Attention binding	Real-time diagnosis
Endometrial receptivity assessment	Thickness Assessment	U-Net SegnNe ResNet	Multi-scale; Dual resolution	Optimize embryo transfer timing
	Morphological Assessment	U-Net 3D point cloud	3D information; Morphological characteristics	Assessment of morphological and structural abnormalities
	Dynamic Assessment	ResNet VGG	Optical flow method	Sperm transport and embryo implantation analysis
	Comprehensive Evaluation	multimodal model	Information fusion	Personalized tolerance assessment
Endometrial tuberculosis	Identification detection	RPN ResNet DenseNet	Candidate area; Multi-scale; Contour preservation	Lesion detection speed and accuracy
Endometrial tuberculosis	Classification diagnosis	Efficientnet ResNet	Enhance texture; Multi-scale fusion	Improve classification accuracy

AI technology is becoming increasingly important in the research of ultrasound endometrial diseases. Its application covers key areas such as disease prognosis, classification, prediction, infiltration detection, auxiliary diagnosis, and receptivity assessment, providing a full range of clinical solutions. Deep learning models, including DenseNet, Inception, ResNet, Transformer, and Bi-LSTM, have been used by researchers to achieve outstanding results in image recognition, sequence data processing, and feature extraction. This has enabled accurate identification of disease characteristics and prediction of trends.

Although these models have achieved remarkable results in ultrasound diagnosis, researchers are constantly exploring new technologies and methods to further improve accuracy and practicality. These innovations not only target the optimization of model structure but also aim to enhance the model's ability to process complex data to meet diverse needs in clinical practice. In this process, the key to improving model performance is through the use of technologies such as multi-variable interaction analysis, multi-scale feature fusion, the combination of global and local attention mechanisms, and multi-model fusion strategies. By applying these technologies, the prospects for AI in the field of ultrasound endometrial diseases will be broader.

Existing challenges of endometrial disease combined with AI

Although deep learning models and key technologies have led to significant advancements in the field of ultrasound endometrial diseases, it is important to note that various diseases, such as endometrial cancer, endometriosis, and endometrial receptivity assessment, all use ultrasound endometrium datasets and face similar challenges. Therefore, it is crucial to develop effective solutions that can be applied across different diseases and applications. In order to facilitate a comprehensive examination of the challenges encountered by the diverse range of applications, as illustrated in Table 7, we have undertaken a systematic categorization and synthesis of the applications of AI in endometrial disease. Despite targeting different diseases, the technical challenges and solutions faced are largely interrelated. Next, we will provide an in-depth analysis of the challenges encountered and existing solutions in promoting the translation of technology into clinical practice in these application areas.

Table 7.

Challenges faced by common areas.

Area	Challenges	Existing solutions
ML-prognostic analysis	1) Feature engineering to screen key features 2) Lack of sufficient data	1) Automated feature selection algorithms reduce subjectivity 2) Model interpretation tool SHAP
ML-classification	1) Category imbalance; 2) High-dimensional features lead to complex calculations	1) Sampling, under sampling and ensemble learning to balance data sets 2) Feature selection algorithm reduces data dimensions
ML-diagnosis	1) Need to improve modelInterpretability 2) The model is sensitive to noisy data	1) Data preprocessing and multimodal model integration 2) Develop interpretable machine learning models such as decision trees 3) Introduce regularization methods to reduce overfitting
DL-classification	1) The image contains artifacts 2) The data set is smaller	1) Data enhancement and transfer learning 2) Multi-scale feature extraction capability
DL-segmentation	1) Precise recognition of boundaries and details; 2) Complexity of 3D image processing; 3) Endometrial morphology is diverse	1) Utilize multi-scale and multi-view data to improve accuracy 2) The attention mechanism enhances the recognition of key features
DL-detection	1) Speed challenge of real-time detection; 2) Small target detection accuracy	1) Feature pyramid improves small target detection performance. 2) Multi-scale detection and data fusion improve small target recognition 3) Texture enhancement
DL-tolerance assessment	1) The complexity of multimodal fusion 2) Dynamic assessment of cyclical changes 3) Intimal movement is slow and irregular	1) Multimodal fusion algorithm integrates different data sources 2) Use the attention mechanism 3) Optical flow method to evaluate dynamic characteristics 4) U-Net and point cloud evaluation of morphological features

ML: machine learning; DL: deep learning.

After discussing the application of AI in diagnosing endometrial disease using ultrasound, and analyzing the challenges and coping strategies, it has been observed that researchers and developers have successfully developed innovative technologies such as automated feature selection, multi-scale feature extraction, and attention mechanisms. These technologies have effectively improved the diagnostic performance and clinical applicability of the model.

Although these technologies have achieved initial results, it is necessary to continue optimizing and experimentally verifying them to ensure their stability and effectiveness in clinical practice. The rapid development of technology and the growing clinical needs indicate that this field has broad prospects for future development. The new directions and development trends of future research mainly include the following four aspects:

Scarce Dataset: Insufficient medical data limits the performance of the model.¹⁰² In the future, implicit data enhancement techniques (such as BatchFormer and BatchFormer V2^103,104) can be used to improve the diversity of ultrasound image data without modifying the original data. In addition, multimodal data fusion can make up for the shortcomings of single-modality information and enhance the accuracy of diagnosis. Feature Extraction Optimization: The dedicated extraction module for endometrial structural features needs to be further optimized. Use attention mechanism and deformable convolution (such as row, column convolution, and snake convolution¹⁰⁵) to extract linear features and improve diagnostic accuracy.¹⁰⁶ Model Lightweight: Combining lightweight Transformer models (such as MobileBERT and DistilBERT^107,108) with local attention mechanisms can reduce parameters while maintaining the efficiency of feature extraction and improving the application efficiency of the model. Multimodal data fusion and alignment: Strengthen the feature fusion and context alignment of different modal data, especially at the channel and spatial levels, optimize image segmentation and auxiliary diagnosis, and improve the recognition ability of complex lesions.

Conclusion

In conclusion, the implementation of AI in the diagnosis of endometrial diseases has notably enhanced the diagnostic precision of ultrasound imaging, reduced the workload of medical professionals, and facilitated expeditious and accurate decision-making through automated analysis and pattern recognition. In particular, AI technology has been shown to enhance the precision of lesion identification in the context of endometrial cancer and endometriosis. Additionally, it furnishes physicians with invaluable insights into disease progression and prognosis, thus aiding in the creation of bespoke treatment plans. Despite the considerable advances made by AI in the diagnosis of endometrial diseases, there is still a need to enhance the accuracy, relevance, and interpretability of the models in use. It is anticipated that through continued innovation and improvement, AI digital health technology will have a more profound positive impact on clinical practice, improve patient experience, reduce medical costs, improve the efficiency of medical services and ultimately benefit more patients.

Footnotes

Contributorship

Qiao Wei: writing—original draft, investigation, conceptualization, visualization. Zhang Xiao: writing –original draft, writing—review & editing, validation. Xiaowen Liang and Zhili Guo: writing—review & editing, visualization. Yanfen Zhang: visualization. Zhiyi Chen: conceptualization, writing—review & editing, visualization, supervision, funding acquisition.

Declaration of conflicting interests

The authors declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.

Funding

The authors disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This work was supported by the Clinical Research 4310 Program of the Affiliated Changsha Central Hospital of the University of South China, National Natural Science Foundation of China, Health Research Project of Hunan Provincial Health Commission (grant numbers 20214310NHYCG06, 82102054, 82402372, W20241010).

Guarantor

ZC.

ORCID iDs

Qiao Wei

Zhiyi Chen

References

Unuane

Tournaye

Velkeniers

, et al. Endocrine disorders & female infertility. Best Pract Res Clin Endocrinol Metab 2011; 25: 861–873.

Barbieri

RL.

Female infertility. In: Yen and Jaffe’s reproductive endocrinology. Philadelphia: Elsevier, 2019, pp. 556–581.e7.

Leone Roberti Maggiore

Ferrero

Mangili

, et al. A systematic review on endometriosis during pregnancy: diagnosis, misdiagnosis, complications and outcomes. Hum Reprod Update 2015; 22: 70–103.

Smolarz

Szyłło

Romanowicz

. Endometriosis: epidemiology, classification, pathogenesis, treatment and genetics (review of literature. Int J Mol Sci 2021; 22: 10554.

Vieira

MDC

Vitagliano

Rossette

, et al. Endometrial polyps: update overview on etiology, diagnosis, natural history and treatment. Clin Exp Obstet Gynecol 2022; 49: 22–27.

Katagiri

Iwasaki

Abe

, et al. Reproductive factors and endometrial cancer risk among women. JAMA Network Open 2023; 6: e2332296.

Akhmedkhanov

Zeleniuch-jacquotte

Toniolo

. Role of exogenous and endogenous hormones in endometrial cancer. Ann N Y Acad Sci 2001; 943: 296–315.

Rahim

Rahiman

MHF

Chan

, et al. Non-invasive imaging of liquid/gas flow using ultrasonic transmission-mode tomography. Sens Actuators, A 2007; 135: 337–345.

Spain

Smith

Grayburn

, et al. Quantitative assessment of mitral regurgitation by Doppler color flow imaging: angiographic and hemodynamic correlations. J Am Coll Cardiol 1989; 13: 585–590.

10.

Ophir

Alam

Garra

, et al. Elastography: imaging the elastic properties of soft tissues with ultrasound. J Med Ultrason 2002; 29: 155–171.

11.

Wang

Zhou

Gong

, et al. Assessment of fallopian tube fimbria patency with 4-dimensional hysterosalpingo-contrast sonography in infertile women. J Ultrasound Med 2017; 36: 2061–2069.

12.

Liang

, et al. An ultrasound-based deep learning radiomic model combined with clinical data to predict clinical pregnancy after frozen embryo transfer: a pilot cohort study. Reprod Biomed Online 2023; 47: 103204.

13.

Avola

Cinque

Fagioli

, et al. Ultrasound medical imaging techniques. ACM Comput Surv 2021; 54: 1–38.

14.

Jiang

Zhi

, et al. Artificial intelligence in healthcare: past, present and future. Stroke Vascular Neurol 2017; 2: 230–243.

15.

Topol

. High-performance medicine: the convergence of human and artificial intelligence. Nat Med 2019; 25: 44–56.

16.

Olveres

González

Torres

, et al. What is new in computer vision and artificial intelligence in medical image analysis applications. Quant Imaging Med Surg 2021; 11: 3830–3853.

17.

Janiesch

Zschech

Heinrich

. Machine learning and deep learning. Electron Mark 2021; 31: 685–695.

18.

Vellido

. The importance of interpretability and visualization in machine learning for applications in medicine and health care. Neural Comput Appl 2019; 32: 18069–18083.

19.

Jordan

Mitchell

. Machine learning: trends, perspectives, and prospects. Science 2015; 349: 255–260.

20.

Mugasa

Dua

Koh

JEW

, et al. An adaptive feature extraction model for classification of thyroid lesions in ultrasound images. Pattern Recognit Lett 2020; 131: 463–473.

21.

Cheng

Wang

, et al. Feature selection. ACM Comput Surv 2017; 50: 1–45.

22.

Concato

. Challenges in prognostic analysis. Cancer 2001; 91: 1607–1614.

23.

Jovic

Brkic

Bogunovic

A review of feature selection methods with applications. In: 2015 38th International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO). IEEE, pp. 1200–1205.

24.

Eriksson

LSE

Epstein

Testa

, et al. Ultrasound-based risk model for preoperative prediction of lymph-node metastases in women with endometrial cancer: model-development study. Ultrasound Obstet Gynecol 2020; 56: 443–452.

25.

Liro

Śniadecki

Wycinka

, et al. Ultrasound measurement of tumor-free distance from the serosal surface as the alternative to measuring the depth of myometrial invasion in predicting lymph node metastases in endometrial cancer. Diagnostics 2021; 11: 1472.

26.

Arezzo

Cormio

La Forgia

, et al. A machine learning approach applied to gynecological ultrasound to predict progression-free survival in ovarian cancer patients. Arch Gynecol Obstet 2022; 306: 2143–2154.

27.

Visalaxi

Punnoose

Muthu

. An analogy of endometriosis recognition using machine learning techniques. In: 2021 Third International Conference on Intelligent Communication Technologies and Virtual Mobile Networks (ICICV). IEEE, pp.739–746.

28.

Moro

Albanese

Boldrini

, et al. Developing and validating ultrasound-based radiomics models for predicting high-risk endometrial cancer. Ultrasound Obstet Gynecol 2022; 60: 256–268.

29.

Huang

Ding

Zheng

, et al. An ultrasound-based radiomics model for survival prediction in patients with endometrial cancer. J Med Ultrason 2023; 50: 501–510.

30.

Wang

Zhang

. Clinical value analysis of combined vaginal ultrasound, magnetic resonance dispersion weighted imaging, and multilayer spiral CT in the diagnosis of endometrial cancer using deep VGG-16 AdaBoost hybrid classifier. J Oncol 2022; 2022: 1–12.

31.

Zeng

, et al. Comparison of machine learning algorithms in the context of deep diagnosis of endometrial carcinoma with myometrial invasion. In: 2022 9th International Conference on Digital Home (ICDH). IEEE, pp.100–106.

32.

Random forest for bioinformatics. In: ensemble machine learning. New York, NY: Springer New York, 2012, pp.307–323.

33.

Huang

Cai

Pacheco

, et al. Applications of support vector machine (SVM) learning in cancer genomics. Cancer Genomics Proteomics 2018; 15: 41–51.

34.

Hastie

Rosset

Zhu

, et al. Multi-class AdaBoost. Stat Interface 2009; 2: 349–360.

35.

Siddique

Paheding

Elkin

, et al. U-Net and its variants for medical image segmentation: a review of theory and applications. IEEE Access 2021; 9: 82031–82057.

36.

Valentini

Dietterich

TG.

Bias–variance analysis and ensembles of SVM. In: Lecture notes in computer science. Berlin, Heidelberg: Springer Berlin Heidelberg, 2002, pp.222–231.

37.

Tsigler

Bartlett

. Benign overfitting in ridge regression. J Mach Learn Res 2023; 24: 1–76.

38.

Chen

Jeong

JC.

Enhanced recursive feature elimination. In: Sixth International Conference on Machine Learning and Applications (ICMLA 2007). IEEE, pp. 429–435.

39.

Mei

Tan

Yang

, et al. Modeling of feature selection based on random forest algorithm and Pearson correlation coefficient. J Phys: Conf Ser 2022; 2219: 012046.

40.

Guerriero

Pascual

Ajossa

, et al. Artificial intelligence (AI) in the detection of rectosigmoid deep endometriosis. Eur J Obstet Gynecol Reproductive Biol 2021; 261: 29–33.

41.

Wang

Yuan

, et al. Prediction of endometrial carcinoma using the combination of electronic health records and an ensemble machine learning method. Front Med 2022; 9: 851890.

42.

Sivajohan

Elgendi

Menon

, et al. Clinical use of artificial intelligence in endometriosis: a scoping review. npj Digital Medicine 2022; 5: 1–17.

43.

Bendifallah

Puchar

Suisse

, et al. Machine learning algorithms as new screening approach for patients with endometriosis. Sci Rep 2022; 12: 639.

44.

Sun

Sha

. Extreme learning machine denoising algorithm-based transvaginal three-dimensional ultrasound imaging on the diagnosis efficiency of intrauterine adhesions. Sci Program 2021; 2021: 1–9.

45.

Shi

Soukhavong

, et al. lightgbm: Light Gradient Boosting Machine. CRAN: Contributed Packages. Epub ahead of print September 21, 2020. DOI: 10.32614/cran.package.lightgbm.

46.

Capasso

Cucinella

Takahashi

, et al. #196 artificial intelligence-based model for transvaginal ultrasound early detection of endometrial atypical hyperplasia and endometrial cancer in women with postmenopausal bleeding. In: Young ivestigator session. London: BMJ Publishing Group Ltd, 2023, pp.A35.1–A3A35.

47.

Karahaliou

Skiadopoulos

Michail

, et al. Texture analysis for classification of endometrial tissue in gray scale transvaginal ultrasonography. In: IFIP International federation for information processing. Boston, MA: Springer US, 2006, pp.713–721.

48.

Bogani

Chiappa

Lopez

, et al. Radiomics and molecular classification in endometrial cancer (the ROME study): a step forward to a simplified precision medicine. Healthcare 2022; 10: 2464.

49.

Garg

Sahoo

Saxena

Gradient local auto correlation co-occurrence machine learning model for endometrial Tuberculosis identification. In: algorithms for intelligent systems. Singapore: Springer Singapore, 2021, pp.581–593.

50.

Garg

Sahoo

Saxena

. Enhanced textural analysis for endometrial tuberculosis identification from ultrasound images. Int J Inf Technol 2021; 13: 657–666.

51.

Zhu

Wang

, et al. ultrasound elastography to predict pregnancy outcoEvaluation of endometrial receptivity by me is a non-invasive and worthwhile method. Biotechnol Genet Eng Rev 2024: 40: 284–298.

52.

Mori

Kitaya

Ishikawa

, et al. Analysis of Endometrium Form by Using LBP for Female Infertility. In: 2018 International Conference on Machine Learning and Cybernetics (ICMLC). IEEE. (2018. accessed December 4, 2024).

53.

Lahat

Adali

Jutten

. Multimodal data fusion: an overview of methods, challenges, and prospects. Proc IEEE 2015; 103: 1449–1477.

54.

Weber

Merz

Bahlmann

, et al. Assessment of myometrial infiltration and preoperative staging by transvaginal ultrasound in patients with endometrial carcinoma. Ultrasound Obstet Gynecol 1995; 6: 362–367.

55.

Fang

Wei

Liu

, et al. A self-supervised classification model for endometrial diseases. J Cancer Res Clin Oncol 2023; 149: 17855–17863.

56.

Xia

Zhang

Liu

, et al. Deep learning-based hysteroscopic intelligent examination and ultrasound examination for diagnosis of endometrial carcinoma. J Supercomput 2021; 78: 11229–11244.

57.

Qin

Zhang

OC11

. 07: ultrasound-based predictive model for high-grade serous epithelial ovarian cancers: a cohort study. Ultrasound Obstet Gynecol 2022; 60: 33–34.

58.

Luo

Yang

Liu

, et al. DeepLearning-EndoCancer: A Data Enhancement Framework Improved Endometrial Cancer Diagnostic Accuracy. Research Square Platform (February 27, 2024; LLC. accessed December 4, 2024).

59.

Kiranmai

ProfL

. A novel whale optimized TGV-FCMS segmentation with modified LSTM classification for endometrium cancer prediction. Indian J Comput Sci Eng 2022; 13: 812–826.

60.

Fumagalli

Palmieri

Khan

, et al. 1291 Performance of an artificial intelligence model applied to transvaginal ultrasound images in detecting endometrial cancer and endometrial hyperplasia with atypia in patients with postmenopausal bleeding. In: Poster and E-posters. Hoboken, NJ: BMJ Publishing Group Ltd, 2024, pp.A234–A235.

61.

Malarvizhi

Dhanya

. Recurrence and non-recurrence prediction of uterus cancer using big data. In: 2019 IEEE International Conference on System, Computation, Automation and Networking (ICSCAN). IEEE, pp. 1–3.

62.

Liu

Qin

Luo

, et al. A transvaginal ultrasound-based deep learning model for the noninvasive diagnosis of myometrial invasion in patients with endometrial cancer: comparison with radiologists. Acad Radiol 2024; 31: 2818–2826.

63.

Han

Xiao

, et al. Transformer in transformer. Adv Neural Inf Process Syst 2021; 34: 15908–15919.

64.

Smagulova

James

. A survey on LSTM memristive neural network architectures and applications. Eur Phys J Special Top 2019; 228: 2313–2324.

65.

Shahid

Zameer

Muneeb

Predictions for COVID-19 with deep learning models of LSTM, GRU and bi-LSTM. Chaos, Solitons Fractals 2020; 140: 110212.

66.

Visalaxi

Sudalaimuthu

. Automated segmentation of endometriosis using transfer learning technique. F1000Res 2022; 11: 360.

67.

Podda

Balia

Barra

, et al. Multi-Scale Deep Learning Ensemble for Segmentation of Endometriotic Lesions. Research Square Platform (June 21, 2023; LLC. https://doi.org/10.21203/rs.3.rs-3082991/v1. accessed December 4, 2024).

68.

Chen

Zhang

, et al. A deep learning model system for diagnosis and management of adnexal masses. Cancers 2022; 14: 5291.

69.

Gao

Zhang

, et al. Ultrasound image-based deep learning to differentiate tubal-ovarian abscess from ovarian endometriosis cyst. Front Physiol 2023; 14: 1101810

70.

Balica

Dai

Piiwaa

, et al. Augmenting endometriosis analysis from ultrasound data using deep learning. In: Medical Imaging 2023: Ultrasonic Imaging and Tomography. SPIE. (2023. accessed December 4, 2024).

71.

Zhang

Wang

Zhang

, et al. Deep learning model for classifying endometrial lesions. J Transl Med 2021; 19: 1–13.

72.

Yang

Liu

Chen

, et al. Diagnostic efficacy of ultrasound combined with magnetic resonance imaging in diagnosis of deep pelvic endometriosis under deep learning. J Supercomput 2021; 77: 7598–7619.

73.

Zhao

Wen

, et al. Multi-purposed diagnostic system for ovarian endometrioma using CNN and transformer networks in ultrasound. Biomed Signal Process Control 2024; 91: 105923.

74.

El Mansouri

Vidal

Basarab

, et al. Fusion of magnetic resonance and ultrasound images for endometriosis detection. IEEE Trans Image Process 2020; 29: 5324–5335.

75.

Kiranmai

Lakshmi

. 3D convolution neural network based ensemble model to detect endometrium issues at early stages and enhance fertility chances in women. Des Eng 2021; 2021: 1032–1044.

76.

Zhang

Wang

Butler

, et al. Distilling missing modality knowledge from ultrasound for endometriosis diagnosis with magnetic resonance images. In: 2023 IEEE 20th International Symposium on Biomedical Imaging (ISBI). IEEE, pp. 1–5.

77.

Zhu

Newsam

DenseNet for dense flow. In: 2017 IEEE International Conference on Image Processing (ICIP). IEEE, (2017, accessed December 4, 2024).

78.

Pinheiro

Collobert

. From image-level to pixel-level labeling with Convolutional Networks. In: 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE. (2015. accessed December 4, 2024).

79.

Szegedy

Ioffe

Vanhoucke

, et al. Inception-v4, inception-ResNet and the impact of residual connections on learning. Proc AAAI Conf Artif Intell 2017; 31. Epub ahead of print February 12 2017. DOI: 10.1609/aaai.v31i1.11231.

80.

Tan

. Efficientnet: rethinking model scaling for convolutional neural networks. In International conference on machine learning 2019: pp. 6105–6114.

81.

Gou

Maybank

, et al. Knowledge distillation: a survey. Int J Comput Vision 2021; 129: 1789–1819.

82.

Singhal

Mukherjee

Perrey

Automated assessment of endometrium from transvaginal ultrasound using Deep Learned Snake. In: 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017). IEEE, https://doi.org/10.1109/isbi.2017.7950520 (2017, accessed December 4, 2024).

83.

Liu

Zhou

Peng

, et al.

Automatic measurement of endometrial thickness from transvaginal ultrasound images.

Front Bioeng Biotechnol 2022; 10: 853845.

84.

Liu

Peng

Zhu

, et al. Automatic endometrial segmentation in ultrasound images using deep learning. In: 2022 IEEE 15th International Symposium on Embedded Multicore/Many-core Systems-on-Chip (MCSoC). IEEE, pp. 67–71.

85.

S-Y

, et al. Deep learning-based automatic endometrium segmentation and thickness measurement for 2D transvaginal ultrasound. In: 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC). IEEE. pp. 993–997.

86.

Wang

Bao

Xin

, et al. Automatic evaluation of endometrial receptivity in three-dimensional transvaginal ultrasound images based on 3D U-net segmentation. Quant Imaging Med Surg 2022; 12: 4095–4108.

87.

Liang

, et al. Measurement of endometrial thickness using deep neural network with multi-task learning. In: Thirteenth International Conference on Graphics and Image Processing (ICGIP 2021). SPIE 3.

88.

Singhal

Kudavelly

Ramaraju

GA.

Deep learning based junctional zone quantification using 3D transvaginal ultrasound in assisted reproduction. In: 2020 42nd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC). IEEE, pp. 2133–2136.

89.

Mori

Kitaya

Ishikawa

, et al. A pregnancy prediction system based on uterine peristalsis from ultrasonic images. Intelligent Automation & Soft 2021; 29: 335–352.

90.

Wang

Wei

, et al. Automated measurement of endometrial peristalsis in cine transvaginal ultrasound images. Front Physiol 2022; 13: 983177

91.

Guo

Wang

, et al. Deep learning for 3D point clouds: a survey. IEEE Trans Pattern Anal Mach Intell 2021; 43: 4338–4364.

92.

Beauchemin

Barron

. The computation of optical flow. ACM Comput Surv 1995; 27: 433–466.

93.

Garg

Sahoo

Saxena

. Identification of endometrial tuberculosis in infertility using non-subsampled contourlet based convolution neural network. Expert Syst Appl 2022; 202: 117282.

94.

Garg

Sahoo

Saxena

Fusion framework for morphological and multispectral textural features for identification of endometrial Tuberculosis. In: 2021 thirteenth international conference on contemporary computing (IC3-2021). New York: ACM, 2021, pp.187–195.

95.

Yang

Yuan

, et al. Real-Time automatic assisted detection of uterine fibroid in ultrasound images using a deep learning detector. Ultrasound in Med & Biol 2023; 49: 1616–1626.

96.

Kaveramma

UPP

Snekhalatha

Karthik

, et al. Ultrasound-based machine learning-aided detection of uterine fibroids: Integrating vision transformer for improved analysis. Biomed Eng: Appl Basis Commun 2023; 35: 2350033.

97.

Zhang

. Extreme learning machine denoising algorithm based analysis of transvaginal 3-dimensional ultrasonic image for the diagnostic effect of intrauterine adhesion. Sci Program 2021; 2021: 1–7.

98.

Fan

Zhuo

Tang

C-K

, et al. Few-shot object detection with attention-RPN and multi-relation detector. In: 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, pp. 4012–4021.

99.

Bhatnagar

QMJ

Liu

. Directive contrast based multimodal medical image fusion in NSCT domain. IEEE Trans Multimed 2013; 15: 1014–1024.

100.

Jiang

Ergu

Liu

, et al. A review of yolo algorithm developments. Procedia Comput Sci 2022; 199: 1066–1073.

101.

Han

Wang

Chen

, et al. A survey on vision transformer. IEEE Trans Pattern Anal Mach Intell 2023; 45: 87–110.

102.

Liu

Jiao

Liu

. Artificial intelligence (AI)-aided disease prediction. BIO Integration 2020; 1: 130–136.

103.

Hou

Tao

Batchformer: learning to explore sample relationships for robust representation learning. In: 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, pp. 7246–7256.

104.

Hou

Wang

, et al. BatchFormerV2: Exploring Sample Relationships for Dense Representation Learning. arXiv.org, https://arxiv.org/abs/2204.01254 (2022).

105.

, et al. Dynamic snake convolution based on topological geometric constraints for tubular structure segmentation. In: 2023 IEEE/CVF International Conference on Computer Vision (ICCV). IEEE, pp. 6047–6056.

106.

Dai

Xiong

, et al. Deformable Convolutional Networks. In: 2017 IEEE International Conference on Computer Vision (ICCV). IEEE, (2017, accessed December 4, 2024).

107.

Sun

Song

, et al. MobileBERT: a compact task-agnostic BERT for resource-limited devices. In: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics. Stroudsburg, PA, USA: Association for Computational Linguistics, (2020, accessed December 4, 2024), pp. 2158–2170.

108.

Sanh

Debut

Chaumond

, et al. DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter. arXiv.org, https://arxiv.org/abs/1910.01108 (2019).

The application of ultrasound artificial intelligence in the diagnosis of endometrial diseases: Current practice and future development

Abstract

Keywords

Introduction

Ultrasound images for diagnosing endometrial diseases

Ultrasound image characteristics

The importance of ultrasound AI

The use of AI in endometrial disease diagnosis via ultrasound

Applying conventional machine learning to endometrial disease imaging

Traditional machine learning for prognostic analysis

Machine learning for endometrial disease recognition and diagnosis

Machine learning for endometrial disease classification

Application of deep learning algorithms

Deep learning in endometrial cancer

Deep learning in endometriosis

Application of deep learning in endometrial receptivity assessment

Application of deep learning in other endometrial diseases

Research directions and challenges

Main research directions and model analysis of endometrial diseases combined with AI

Existing challenges of endometrial disease combined with AI

Conclusion

Footnotes

Contributorship

Declaration of conflicting interests

Funding

Guarantor

ORCID iDs

References