1.Research on Diagnosis Model of Endometrial Lesions by Hysteroscopy Based on Deep Learning Algorithm Combined with Grad-CAM
Mingliang CAO ; Mi YIN ; Qingbin WANG ; Hanfeng ZHU ; Xing LI ; Jun ZHANG ; Lin MAO ; Xuefeng MU ; Min CAO ; Yutao MA ; Jian WANG ; Yan ZHANG
Journal of Practical Obstetrics and Gynecology 2024;40(5):409-413
Objective:To explore the effectiveness of a hysteroscopic endometrial lesion diagnosis model de-veloped based on deep learning(DL)algorithm combined with gradient-weighted class activation mapping(Grad-CAM)visualization technology.Methods:303 hysteroscopy videos(4781 images)of 291 patients who un-derwent hysteroscopy examination in the Department of Gynecology,Renmin Hospital of Wuhan University from June 1,2021 to December 31,2022 were selected.The dataset was divided into a training set(3703 images)and a test set(1078 images)by weight sampling method.After the training set was used for model learning and train-ing,two model architectures,residual neural network(ResNet18)and efficient neural network(EfficientNet-B0),were selected to verify the model in the test set by five-class and two-class classification tasks,respectively.Tak-ing histopathology as the gold standard,the diagnostic efficacy was evaluated to select the optimal model,and the Grad-CAM layer was embedded in the optimal model to output hysteroscopy images of Grad-CAM.Results:①In the five-class classification tasks,the accuracy of EfficientNet-B0 model(93.23%)was higher than that of Res-Net18 model(84.23%);the area under the curve(AUC)of EfficientNet-B0 model in the diagnosis of five disea-ses,including atypical endometrial hyperplasia,endometrial polyps,endometrial cancer,endometrial atypical hy-perplasia,and submucous myoma,was slightly higher than that of ResNet18 model,and the AUC of both models was almost above 0.980.②In the binary classification task of accuracy and the evaluation of specificity,the two models were similar,both above 93.00%,and the sensitivity of EfficientNet-B0 model(91.14%)was significantly better than that of ResNet18 model(77.22%).③EfficientNet-B0 model combined with Grad-CAM algorithm could identify the abnormal areas in the image.After biopsy and pathological examination,it was confirmed that about 95%of the marked areas in the model's output heatmap were lesion areas.Conclusions:The hysteroscopy di-agnostic model developed by EfficientNet-B0 model combined with Grad-CAM has high diagnostic accuracy,sen-sitivity,and specificity,and has application value in the diagnosis of endometrial lesions.
2.Research on Diagnosis Model of Endometrial Lesions by Hysteroscopy Based on Deep Learning Algorithm Combined with Grad-CAM
Mingliang CAO ; Mi YIN ; Qingbin WANG ; Hanfeng ZHU ; Xing LI ; Jun ZHANG ; Lin MAO ; Xuefeng MU ; Min CAO ; Yutao MA ; Jian WANG ; Yan ZHANG
Journal of Practical Obstetrics and Gynecology 2024;40(5):409-413
Objective:To explore the effectiveness of a hysteroscopic endometrial lesion diagnosis model de-veloped based on deep learning(DL)algorithm combined with gradient-weighted class activation mapping(Grad-CAM)visualization technology.Methods:303 hysteroscopy videos(4781 images)of 291 patients who un-derwent hysteroscopy examination in the Department of Gynecology,Renmin Hospital of Wuhan University from June 1,2021 to December 31,2022 were selected.The dataset was divided into a training set(3703 images)and a test set(1078 images)by weight sampling method.After the training set was used for model learning and train-ing,two model architectures,residual neural network(ResNet18)and efficient neural network(EfficientNet-B0),were selected to verify the model in the test set by five-class and two-class classification tasks,respectively.Tak-ing histopathology as the gold standard,the diagnostic efficacy was evaluated to select the optimal model,and the Grad-CAM layer was embedded in the optimal model to output hysteroscopy images of Grad-CAM.Results:①In the five-class classification tasks,the accuracy of EfficientNet-B0 model(93.23%)was higher than that of Res-Net18 model(84.23%);the area under the curve(AUC)of EfficientNet-B0 model in the diagnosis of five disea-ses,including atypical endometrial hyperplasia,endometrial polyps,endometrial cancer,endometrial atypical hy-perplasia,and submucous myoma,was slightly higher than that of ResNet18 model,and the AUC of both models was almost above 0.980.②In the binary classification task of accuracy and the evaluation of specificity,the two models were similar,both above 93.00%,and the sensitivity of EfficientNet-B0 model(91.14%)was significantly better than that of ResNet18 model(77.22%).③EfficientNet-B0 model combined with Grad-CAM algorithm could identify the abnormal areas in the image.After biopsy and pathological examination,it was confirmed that about 95%of the marked areas in the model's output heatmap were lesion areas.Conclusions:The hysteroscopy di-agnostic model developed by EfficientNet-B0 model combined with Grad-CAM has high diagnostic accuracy,sen-sitivity,and specificity,and has application value in the diagnosis of endometrial lesions.
3.Research on Diagnosis Model of Endometrial Lesions by Hysteroscopy Based on Deep Learning Algorithm Combined with Grad-CAM
Mingliang CAO ; Mi YIN ; Qingbin WANG ; Hanfeng ZHU ; Xing LI ; Jun ZHANG ; Lin MAO ; Xuefeng MU ; Min CAO ; Yutao MA ; Jian WANG ; Yan ZHANG
Journal of Practical Obstetrics and Gynecology 2024;40(5):409-413
Objective:To explore the effectiveness of a hysteroscopic endometrial lesion diagnosis model de-veloped based on deep learning(DL)algorithm combined with gradient-weighted class activation mapping(Grad-CAM)visualization technology.Methods:303 hysteroscopy videos(4781 images)of 291 patients who un-derwent hysteroscopy examination in the Department of Gynecology,Renmin Hospital of Wuhan University from June 1,2021 to December 31,2022 were selected.The dataset was divided into a training set(3703 images)and a test set(1078 images)by weight sampling method.After the training set was used for model learning and train-ing,two model architectures,residual neural network(ResNet18)and efficient neural network(EfficientNet-B0),were selected to verify the model in the test set by five-class and two-class classification tasks,respectively.Tak-ing histopathology as the gold standard,the diagnostic efficacy was evaluated to select the optimal model,and the Grad-CAM layer was embedded in the optimal model to output hysteroscopy images of Grad-CAM.Results:①In the five-class classification tasks,the accuracy of EfficientNet-B0 model(93.23%)was higher than that of Res-Net18 model(84.23%);the area under the curve(AUC)of EfficientNet-B0 model in the diagnosis of five disea-ses,including atypical endometrial hyperplasia,endometrial polyps,endometrial cancer,endometrial atypical hy-perplasia,and submucous myoma,was slightly higher than that of ResNet18 model,and the AUC of both models was almost above 0.980.②In the binary classification task of accuracy and the evaluation of specificity,the two models were similar,both above 93.00%,and the sensitivity of EfficientNet-B0 model(91.14%)was significantly better than that of ResNet18 model(77.22%).③EfficientNet-B0 model combined with Grad-CAM algorithm could identify the abnormal areas in the image.After biopsy and pathological examination,it was confirmed that about 95%of the marked areas in the model's output heatmap were lesion areas.Conclusions:The hysteroscopy di-agnostic model developed by EfficientNet-B0 model combined with Grad-CAM has high diagnostic accuracy,sen-sitivity,and specificity,and has application value in the diagnosis of endometrial lesions.
4.Research on Diagnosis Model of Endometrial Lesions by Hysteroscopy Based on Deep Learning Algorithm Combined with Grad-CAM
Mingliang CAO ; Mi YIN ; Qingbin WANG ; Hanfeng ZHU ; Xing LI ; Jun ZHANG ; Lin MAO ; Xuefeng MU ; Min CAO ; Yutao MA ; Jian WANG ; Yan ZHANG
Journal of Practical Obstetrics and Gynecology 2024;40(5):409-413
Objective:To explore the effectiveness of a hysteroscopic endometrial lesion diagnosis model de-veloped based on deep learning(DL)algorithm combined with gradient-weighted class activation mapping(Grad-CAM)visualization technology.Methods:303 hysteroscopy videos(4781 images)of 291 patients who un-derwent hysteroscopy examination in the Department of Gynecology,Renmin Hospital of Wuhan University from June 1,2021 to December 31,2022 were selected.The dataset was divided into a training set(3703 images)and a test set(1078 images)by weight sampling method.After the training set was used for model learning and train-ing,two model architectures,residual neural network(ResNet18)and efficient neural network(EfficientNet-B0),were selected to verify the model in the test set by five-class and two-class classification tasks,respectively.Tak-ing histopathology as the gold standard,the diagnostic efficacy was evaluated to select the optimal model,and the Grad-CAM layer was embedded in the optimal model to output hysteroscopy images of Grad-CAM.Results:①In the five-class classification tasks,the accuracy of EfficientNet-B0 model(93.23%)was higher than that of Res-Net18 model(84.23%);the area under the curve(AUC)of EfficientNet-B0 model in the diagnosis of five disea-ses,including atypical endometrial hyperplasia,endometrial polyps,endometrial cancer,endometrial atypical hy-perplasia,and submucous myoma,was slightly higher than that of ResNet18 model,and the AUC of both models was almost above 0.980.②In the binary classification task of accuracy and the evaluation of specificity,the two models were similar,both above 93.00%,and the sensitivity of EfficientNet-B0 model(91.14%)was significantly better than that of ResNet18 model(77.22%).③EfficientNet-B0 model combined with Grad-CAM algorithm could identify the abnormal areas in the image.After biopsy and pathological examination,it was confirmed that about 95%of the marked areas in the model's output heatmap were lesion areas.Conclusions:The hysteroscopy di-agnostic model developed by EfficientNet-B0 model combined with Grad-CAM has high diagnostic accuracy,sen-sitivity,and specificity,and has application value in the diagnosis of endometrial lesions.
5.Research on Diagnosis Model of Endometrial Lesions by Hysteroscopy Based on Deep Learning Algorithm Combined with Grad-CAM
Mingliang CAO ; Mi YIN ; Qingbin WANG ; Hanfeng ZHU ; Xing LI ; Jun ZHANG ; Lin MAO ; Xuefeng MU ; Min CAO ; Yutao MA ; Jian WANG ; Yan ZHANG
Journal of Practical Obstetrics and Gynecology 2024;40(5):409-413
Objective:To explore the effectiveness of a hysteroscopic endometrial lesion diagnosis model de-veloped based on deep learning(DL)algorithm combined with gradient-weighted class activation mapping(Grad-CAM)visualization technology.Methods:303 hysteroscopy videos(4781 images)of 291 patients who un-derwent hysteroscopy examination in the Department of Gynecology,Renmin Hospital of Wuhan University from June 1,2021 to December 31,2022 were selected.The dataset was divided into a training set(3703 images)and a test set(1078 images)by weight sampling method.After the training set was used for model learning and train-ing,two model architectures,residual neural network(ResNet18)and efficient neural network(EfficientNet-B0),were selected to verify the model in the test set by five-class and two-class classification tasks,respectively.Tak-ing histopathology as the gold standard,the diagnostic efficacy was evaluated to select the optimal model,and the Grad-CAM layer was embedded in the optimal model to output hysteroscopy images of Grad-CAM.Results:①In the five-class classification tasks,the accuracy of EfficientNet-B0 model(93.23%)was higher than that of Res-Net18 model(84.23%);the area under the curve(AUC)of EfficientNet-B0 model in the diagnosis of five disea-ses,including atypical endometrial hyperplasia,endometrial polyps,endometrial cancer,endometrial atypical hy-perplasia,and submucous myoma,was slightly higher than that of ResNet18 model,and the AUC of both models was almost above 0.980.②In the binary classification task of accuracy and the evaluation of specificity,the two models were similar,both above 93.00%,and the sensitivity of EfficientNet-B0 model(91.14%)was significantly better than that of ResNet18 model(77.22%).③EfficientNet-B0 model combined with Grad-CAM algorithm could identify the abnormal areas in the image.After biopsy and pathological examination,it was confirmed that about 95%of the marked areas in the model's output heatmap were lesion areas.Conclusions:The hysteroscopy di-agnostic model developed by EfficientNet-B0 model combined with Grad-CAM has high diagnostic accuracy,sen-sitivity,and specificity,and has application value in the diagnosis of endometrial lesions.
6.Research on Diagnosis Model of Endometrial Lesions by Hysteroscopy Based on Deep Learning Algorithm Combined with Grad-CAM
Mingliang CAO ; Mi YIN ; Qingbin WANG ; Hanfeng ZHU ; Xing LI ; Jun ZHANG ; Lin MAO ; Xuefeng MU ; Min CAO ; Yutao MA ; Jian WANG ; Yan ZHANG
Journal of Practical Obstetrics and Gynecology 2024;40(5):409-413
Objective:To explore the effectiveness of a hysteroscopic endometrial lesion diagnosis model de-veloped based on deep learning(DL)algorithm combined with gradient-weighted class activation mapping(Grad-CAM)visualization technology.Methods:303 hysteroscopy videos(4781 images)of 291 patients who un-derwent hysteroscopy examination in the Department of Gynecology,Renmin Hospital of Wuhan University from June 1,2021 to December 31,2022 were selected.The dataset was divided into a training set(3703 images)and a test set(1078 images)by weight sampling method.After the training set was used for model learning and train-ing,two model architectures,residual neural network(ResNet18)and efficient neural network(EfficientNet-B0),were selected to verify the model in the test set by five-class and two-class classification tasks,respectively.Tak-ing histopathology as the gold standard,the diagnostic efficacy was evaluated to select the optimal model,and the Grad-CAM layer was embedded in the optimal model to output hysteroscopy images of Grad-CAM.Results:①In the five-class classification tasks,the accuracy of EfficientNet-B0 model(93.23%)was higher than that of Res-Net18 model(84.23%);the area under the curve(AUC)of EfficientNet-B0 model in the diagnosis of five disea-ses,including atypical endometrial hyperplasia,endometrial polyps,endometrial cancer,endometrial atypical hy-perplasia,and submucous myoma,was slightly higher than that of ResNet18 model,and the AUC of both models was almost above 0.980.②In the binary classification task of accuracy and the evaluation of specificity,the two models were similar,both above 93.00%,and the sensitivity of EfficientNet-B0 model(91.14%)was significantly better than that of ResNet18 model(77.22%).③EfficientNet-B0 model combined with Grad-CAM algorithm could identify the abnormal areas in the image.After biopsy and pathological examination,it was confirmed that about 95%of the marked areas in the model's output heatmap were lesion areas.Conclusions:The hysteroscopy di-agnostic model developed by EfficientNet-B0 model combined with Grad-CAM has high diagnostic accuracy,sen-sitivity,and specificity,and has application value in the diagnosis of endometrial lesions.
7.Research on Diagnosis Model of Endometrial Lesions by Hysteroscopy Based on Deep Learning Algorithm Combined with Grad-CAM
Mingliang CAO ; Mi YIN ; Qingbin WANG ; Hanfeng ZHU ; Xing LI ; Jun ZHANG ; Lin MAO ; Xuefeng MU ; Min CAO ; Yutao MA ; Jian WANG ; Yan ZHANG
Journal of Practical Obstetrics and Gynecology 2024;40(5):409-413
Objective:To explore the effectiveness of a hysteroscopic endometrial lesion diagnosis model de-veloped based on deep learning(DL)algorithm combined with gradient-weighted class activation mapping(Grad-CAM)visualization technology.Methods:303 hysteroscopy videos(4781 images)of 291 patients who un-derwent hysteroscopy examination in the Department of Gynecology,Renmin Hospital of Wuhan University from June 1,2021 to December 31,2022 were selected.The dataset was divided into a training set(3703 images)and a test set(1078 images)by weight sampling method.After the training set was used for model learning and train-ing,two model architectures,residual neural network(ResNet18)and efficient neural network(EfficientNet-B0),were selected to verify the model in the test set by five-class and two-class classification tasks,respectively.Tak-ing histopathology as the gold standard,the diagnostic efficacy was evaluated to select the optimal model,and the Grad-CAM layer was embedded in the optimal model to output hysteroscopy images of Grad-CAM.Results:①In the five-class classification tasks,the accuracy of EfficientNet-B0 model(93.23%)was higher than that of Res-Net18 model(84.23%);the area under the curve(AUC)of EfficientNet-B0 model in the diagnosis of five disea-ses,including atypical endometrial hyperplasia,endometrial polyps,endometrial cancer,endometrial atypical hy-perplasia,and submucous myoma,was slightly higher than that of ResNet18 model,and the AUC of both models was almost above 0.980.②In the binary classification task of accuracy and the evaluation of specificity,the two models were similar,both above 93.00%,and the sensitivity of EfficientNet-B0 model(91.14%)was significantly better than that of ResNet18 model(77.22%).③EfficientNet-B0 model combined with Grad-CAM algorithm could identify the abnormal areas in the image.After biopsy and pathological examination,it was confirmed that about 95%of the marked areas in the model's output heatmap were lesion areas.Conclusions:The hysteroscopy di-agnostic model developed by EfficientNet-B0 model combined with Grad-CAM has high diagnostic accuracy,sen-sitivity,and specificity,and has application value in the diagnosis of endometrial lesions.
8.Research on Diagnosis Model of Endometrial Lesions by Hysteroscopy Based on Deep Learning Algorithm Combined with Grad-CAM
Mingliang CAO ; Mi YIN ; Qingbin WANG ; Hanfeng ZHU ; Xing LI ; Jun ZHANG ; Lin MAO ; Xuefeng MU ; Min CAO ; Yutao MA ; Jian WANG ; Yan ZHANG
Journal of Practical Obstetrics and Gynecology 2024;40(5):409-413
Objective:To explore the effectiveness of a hysteroscopic endometrial lesion diagnosis model de-veloped based on deep learning(DL)algorithm combined with gradient-weighted class activation mapping(Grad-CAM)visualization technology.Methods:303 hysteroscopy videos(4781 images)of 291 patients who un-derwent hysteroscopy examination in the Department of Gynecology,Renmin Hospital of Wuhan University from June 1,2021 to December 31,2022 were selected.The dataset was divided into a training set(3703 images)and a test set(1078 images)by weight sampling method.After the training set was used for model learning and train-ing,two model architectures,residual neural network(ResNet18)and efficient neural network(EfficientNet-B0),were selected to verify the model in the test set by five-class and two-class classification tasks,respectively.Tak-ing histopathology as the gold standard,the diagnostic efficacy was evaluated to select the optimal model,and the Grad-CAM layer was embedded in the optimal model to output hysteroscopy images of Grad-CAM.Results:①In the five-class classification tasks,the accuracy of EfficientNet-B0 model(93.23%)was higher than that of Res-Net18 model(84.23%);the area under the curve(AUC)of EfficientNet-B0 model in the diagnosis of five disea-ses,including atypical endometrial hyperplasia,endometrial polyps,endometrial cancer,endometrial atypical hy-perplasia,and submucous myoma,was slightly higher than that of ResNet18 model,and the AUC of both models was almost above 0.980.②In the binary classification task of accuracy and the evaluation of specificity,the two models were similar,both above 93.00%,and the sensitivity of EfficientNet-B0 model(91.14%)was significantly better than that of ResNet18 model(77.22%).③EfficientNet-B0 model combined with Grad-CAM algorithm could identify the abnormal areas in the image.After biopsy and pathological examination,it was confirmed that about 95%of the marked areas in the model's output heatmap were lesion areas.Conclusions:The hysteroscopy di-agnostic model developed by EfficientNet-B0 model combined with Grad-CAM has high diagnostic accuracy,sen-sitivity,and specificity,and has application value in the diagnosis of endometrial lesions.
9.Potential unreliability of ALK variant allele frequency in the efficacy prediction of targeted therapy in NSCLC.
Wei RAO ; Yutao LIU ; Yan LI ; Lei GUO ; Tian QIU ; Lin DONG ; Jianming YING ; Weihua LI
Frontiers of Medicine 2023;17(3):493-502
Anaplastic lymphoma kinase (ALK) is the most common fusion gene involved in non-small cell lung cancer (NSCLC), and remarkable response has been achieved with the use of ALK tyrosine kinase inhibitors (ALK-TKIs). However, the clinical efficacy is highly variable. Pre-existing intratumoral heterogeneity (ITH) has been proven to contribute to the poor treatment response and the resistance to targeted therapies. In this work, we investigated whether the variant allele frequencies (VAFs) of ALK fusions can help assess ITH and predict targeted therapy efficacy. Through the application of next-generation sequencing (NGS), 7.2% (326/4548) of patients were detected to be ALK positive. On the basis of the adjusted VAF (adjVAF, VAF normalization for tumor purity) of four different threshold values (adjVAF < 50%, 40%, 30%, or 20%), the association of ALK subclonality with crizotinib efficacy was assessed. Nonetheless, no statistical association was observed between median progression-free survival (PFS) and ALK subclonality assessed by adjVAF, and a poor correlation of adjVAF with PFS was found among the 85 patients who received first-line crizotinib. Results suggest that the ALK VAF determined by hybrid capture-based NGS is probably unreliable for ITH assessment and targeted therapy efficacy prediction in NSCLC.
Humans
;
Carcinoma, Non-Small-Cell Lung/pathology*
;
Anaplastic Lymphoma Kinase/therapeutic use*
;
Crizotinib/therapeutic use*
;
Lung Neoplasms/pathology*
;
Protein Kinase Inhibitors/pharmacology*
;
Gene Frequency
10.Comparison of clinical prognoses of anterior and posterior circulatory large vessel occlusive ischemic stroke after successful endovascular recanalization
Yutao SI ; Lin YIN ; Chunye MA ; Dapeng SUN
Chinese Journal of Neuromedicine 2023;22(10):1016-1022
Objective:To analyze the clinical characteristics of patients with anterior and posterior circulation large vessel occlusion ischemic stroke and clinical prognoses after successful endovascular recanalization.Methods:A retrospective analysis was performed; 170 patients with large vessel occlusive ischemic stroke, admitted to Stroke Center, Second Hospital of Dalian Medical University from January 2016 to September 2022 were chosen; these patients had modified Thrombolysis in Cerebral Infarction (mTICI) 2b or 3 after endovascular treatment. These patients were divided into anterior-circulation large vessel occlusion group ( n=138) and posterior-circulation large vessel occlusion group ( n=32) according to the locations of vessel occlusion. Clinical data, parameters related to endovascular treatment, and clinical prognoses of the 2 groups were collected and compared. Results:Posterior-circulation large vessel occlusion group had significantly higher percentages of male patients and patients with atherosclerotic type (81.3% vs. 61.6%; 78.1% vs. 47.1%), significantly higher ratio of neutrophil to lymphocyte and NIHSS scores (3.78 [1.93, 10.86] vs. 2.77[1.77, 4.72]; 20.50±8.96 vs. 14.83±4.67), significantly lower percentage of patients with atrial fibrillation (21.9% vs. 58%), and significantly longer times from onset to puncture, onset to recalculation, admission to puncture, and admission to recalculation (367.50 [246.25, 630.00] min vs. 240.00 [198.75, 330.00]; 515.00 [292.50, 701.25] vs. 345.50 [270.00, 425.75] min; 163.00 [123.25, 218.50] min vs. 125.50 [97.00, 161.00]; 258.00 [200.25,389.00] vs. 219.50 [178.00, 276.25]) than anterior-circulation large vessel occlusion group ( P<0.05). The NIHSS scores 24 h after endovascular treatment, NIHSS scores at discharge, and mortality within 90 d in posterior-circulation large vessel occlusion group were significantly higher than those in anterior-circulation large vessel occlusion group (21.31±9.23 vs. 15.74±6.53; 25.5 [4.25, 40.25] vs. 10.00 [4.00, 18.25]; 40.6% vs. 20.3%, P<0.05); however, no significant differences in symptomatic intracranial hemorrhage, incidence of intracranial hemorrhage, in-hospital mortality or 90-d good prognosis were noted between the 2 groups ( P>0.05). Conclusion:Posterior circulation large vessel occlusion ischemic stroke patients have higher neurological impairment at onset than anterior circulation acute large vessel occlusion ischemic stroke patients; both patients enjoy similar results in terms of 90-d good prognosis and complications, but 90-d mortality is higher than that in anterior ones.

Result Analysis
Print
Save
E-mail