1.Research on Diagnosis Model of Endometrial Lesions by Hysteroscopy Based on Deep Learning Algorithm Combined with Grad-CAM
Mingliang CAO ; Mi YIN ; Qingbin WANG ; Hanfeng ZHU ; Xing LI ; Jun ZHANG ; Lin MAO ; Xuefeng MU ; Min CAO ; Yutao MA ; Jian WANG ; Yan ZHANG
Journal of Practical Obstetrics and Gynecology 2024;40(5):409-413
Objective:To explore the effectiveness of a hysteroscopic endometrial lesion diagnosis model de-veloped based on deep learning(DL)algorithm combined with gradient-weighted class activation mapping(Grad-CAM)visualization technology.Methods:303 hysteroscopy videos(4781 images)of 291 patients who un-derwent hysteroscopy examination in the Department of Gynecology,Renmin Hospital of Wuhan University from June 1,2021 to December 31,2022 were selected.The dataset was divided into a training set(3703 images)and a test set(1078 images)by weight sampling method.After the training set was used for model learning and train-ing,two model architectures,residual neural network(ResNet18)and efficient neural network(EfficientNet-B0),were selected to verify the model in the test set by five-class and two-class classification tasks,respectively.Tak-ing histopathology as the gold standard,the diagnostic efficacy was evaluated to select the optimal model,and the Grad-CAM layer was embedded in the optimal model to output hysteroscopy images of Grad-CAM.Results:①In the five-class classification tasks,the accuracy of EfficientNet-B0 model(93.23%)was higher than that of Res-Net18 model(84.23%);the area under the curve(AUC)of EfficientNet-B0 model in the diagnosis of five disea-ses,including atypical endometrial hyperplasia,endometrial polyps,endometrial cancer,endometrial atypical hy-perplasia,and submucous myoma,was slightly higher than that of ResNet18 model,and the AUC of both models was almost above 0.980.②In the binary classification task of accuracy and the evaluation of specificity,the two models were similar,both above 93.00%,and the sensitivity of EfficientNet-B0 model(91.14%)was significantly better than that of ResNet18 model(77.22%).③EfficientNet-B0 model combined with Grad-CAM algorithm could identify the abnormal areas in the image.After biopsy and pathological examination,it was confirmed that about 95%of the marked areas in the model's output heatmap were lesion areas.Conclusions:The hysteroscopy di-agnostic model developed by EfficientNet-B0 model combined with Grad-CAM has high diagnostic accuracy,sen-sitivity,and specificity,and has application value in the diagnosis of endometrial lesions.
2.Research on Diagnosis Model of Endometrial Lesions by Hysteroscopy Based on Deep Learning Algorithm Combined with Grad-CAM
Mingliang CAO ; Mi YIN ; Qingbin WANG ; Hanfeng ZHU ; Xing LI ; Jun ZHANG ; Lin MAO ; Xuefeng MU ; Min CAO ; Yutao MA ; Jian WANG ; Yan ZHANG
Journal of Practical Obstetrics and Gynecology 2024;40(5):409-413
Objective:To explore the effectiveness of a hysteroscopic endometrial lesion diagnosis model de-veloped based on deep learning(DL)algorithm combined with gradient-weighted class activation mapping(Grad-CAM)visualization technology.Methods:303 hysteroscopy videos(4781 images)of 291 patients who un-derwent hysteroscopy examination in the Department of Gynecology,Renmin Hospital of Wuhan University from June 1,2021 to December 31,2022 were selected.The dataset was divided into a training set(3703 images)and a test set(1078 images)by weight sampling method.After the training set was used for model learning and train-ing,two model architectures,residual neural network(ResNet18)and efficient neural network(EfficientNet-B0),were selected to verify the model in the test set by five-class and two-class classification tasks,respectively.Tak-ing histopathology as the gold standard,the diagnostic efficacy was evaluated to select the optimal model,and the Grad-CAM layer was embedded in the optimal model to output hysteroscopy images of Grad-CAM.Results:①In the five-class classification tasks,the accuracy of EfficientNet-B0 model(93.23%)was higher than that of Res-Net18 model(84.23%);the area under the curve(AUC)of EfficientNet-B0 model in the diagnosis of five disea-ses,including atypical endometrial hyperplasia,endometrial polyps,endometrial cancer,endometrial atypical hy-perplasia,and submucous myoma,was slightly higher than that of ResNet18 model,and the AUC of both models was almost above 0.980.②In the binary classification task of accuracy and the evaluation of specificity,the two models were similar,both above 93.00%,and the sensitivity of EfficientNet-B0 model(91.14%)was significantly better than that of ResNet18 model(77.22%).③EfficientNet-B0 model combined with Grad-CAM algorithm could identify the abnormal areas in the image.After biopsy and pathological examination,it was confirmed that about 95%of the marked areas in the model's output heatmap were lesion areas.Conclusions:The hysteroscopy di-agnostic model developed by EfficientNet-B0 model combined with Grad-CAM has high diagnostic accuracy,sen-sitivity,and specificity,and has application value in the diagnosis of endometrial lesions.
3.Research on Diagnosis Model of Endometrial Lesions by Hysteroscopy Based on Deep Learning Algorithm Combined with Grad-CAM
Mingliang CAO ; Mi YIN ; Qingbin WANG ; Hanfeng ZHU ; Xing LI ; Jun ZHANG ; Lin MAO ; Xuefeng MU ; Min CAO ; Yutao MA ; Jian WANG ; Yan ZHANG
Journal of Practical Obstetrics and Gynecology 2024;40(5):409-413
Objective:To explore the effectiveness of a hysteroscopic endometrial lesion diagnosis model de-veloped based on deep learning(DL)algorithm combined with gradient-weighted class activation mapping(Grad-CAM)visualization technology.Methods:303 hysteroscopy videos(4781 images)of 291 patients who un-derwent hysteroscopy examination in the Department of Gynecology,Renmin Hospital of Wuhan University from June 1,2021 to December 31,2022 were selected.The dataset was divided into a training set(3703 images)and a test set(1078 images)by weight sampling method.After the training set was used for model learning and train-ing,two model architectures,residual neural network(ResNet18)and efficient neural network(EfficientNet-B0),were selected to verify the model in the test set by five-class and two-class classification tasks,respectively.Tak-ing histopathology as the gold standard,the diagnostic efficacy was evaluated to select the optimal model,and the Grad-CAM layer was embedded in the optimal model to output hysteroscopy images of Grad-CAM.Results:①In the five-class classification tasks,the accuracy of EfficientNet-B0 model(93.23%)was higher than that of Res-Net18 model(84.23%);the area under the curve(AUC)of EfficientNet-B0 model in the diagnosis of five disea-ses,including atypical endometrial hyperplasia,endometrial polyps,endometrial cancer,endometrial atypical hy-perplasia,and submucous myoma,was slightly higher than that of ResNet18 model,and the AUC of both models was almost above 0.980.②In the binary classification task of accuracy and the evaluation of specificity,the two models were similar,both above 93.00%,and the sensitivity of EfficientNet-B0 model(91.14%)was significantly better than that of ResNet18 model(77.22%).③EfficientNet-B0 model combined with Grad-CAM algorithm could identify the abnormal areas in the image.After biopsy and pathological examination,it was confirmed that about 95%of the marked areas in the model's output heatmap were lesion areas.Conclusions:The hysteroscopy di-agnostic model developed by EfficientNet-B0 model combined with Grad-CAM has high diagnostic accuracy,sen-sitivity,and specificity,and has application value in the diagnosis of endometrial lesions.
4.Research on Diagnosis Model of Endometrial Lesions by Hysteroscopy Based on Deep Learning Algorithm Combined with Grad-CAM
Mingliang CAO ; Mi YIN ; Qingbin WANG ; Hanfeng ZHU ; Xing LI ; Jun ZHANG ; Lin MAO ; Xuefeng MU ; Min CAO ; Yutao MA ; Jian WANG ; Yan ZHANG
Journal of Practical Obstetrics and Gynecology 2024;40(5):409-413
Objective:To explore the effectiveness of a hysteroscopic endometrial lesion diagnosis model de-veloped based on deep learning(DL)algorithm combined with gradient-weighted class activation mapping(Grad-CAM)visualization technology.Methods:303 hysteroscopy videos(4781 images)of 291 patients who un-derwent hysteroscopy examination in the Department of Gynecology,Renmin Hospital of Wuhan University from June 1,2021 to December 31,2022 were selected.The dataset was divided into a training set(3703 images)and a test set(1078 images)by weight sampling method.After the training set was used for model learning and train-ing,two model architectures,residual neural network(ResNet18)and efficient neural network(EfficientNet-B0),were selected to verify the model in the test set by five-class and two-class classification tasks,respectively.Tak-ing histopathology as the gold standard,the diagnostic efficacy was evaluated to select the optimal model,and the Grad-CAM layer was embedded in the optimal model to output hysteroscopy images of Grad-CAM.Results:①In the five-class classification tasks,the accuracy of EfficientNet-B0 model(93.23%)was higher than that of Res-Net18 model(84.23%);the area under the curve(AUC)of EfficientNet-B0 model in the diagnosis of five disea-ses,including atypical endometrial hyperplasia,endometrial polyps,endometrial cancer,endometrial atypical hy-perplasia,and submucous myoma,was slightly higher than that of ResNet18 model,and the AUC of both models was almost above 0.980.②In the binary classification task of accuracy and the evaluation of specificity,the two models were similar,both above 93.00%,and the sensitivity of EfficientNet-B0 model(91.14%)was significantly better than that of ResNet18 model(77.22%).③EfficientNet-B0 model combined with Grad-CAM algorithm could identify the abnormal areas in the image.After biopsy and pathological examination,it was confirmed that about 95%of the marked areas in the model's output heatmap were lesion areas.Conclusions:The hysteroscopy di-agnostic model developed by EfficientNet-B0 model combined with Grad-CAM has high diagnostic accuracy,sen-sitivity,and specificity,and has application value in the diagnosis of endometrial lesions.
5.Research on Diagnosis Model of Endometrial Lesions by Hysteroscopy Based on Deep Learning Algorithm Combined with Grad-CAM
Mingliang CAO ; Mi YIN ; Qingbin WANG ; Hanfeng ZHU ; Xing LI ; Jun ZHANG ; Lin MAO ; Xuefeng MU ; Min CAO ; Yutao MA ; Jian WANG ; Yan ZHANG
Journal of Practical Obstetrics and Gynecology 2024;40(5):409-413
Objective:To explore the effectiveness of a hysteroscopic endometrial lesion diagnosis model de-veloped based on deep learning(DL)algorithm combined with gradient-weighted class activation mapping(Grad-CAM)visualization technology.Methods:303 hysteroscopy videos(4781 images)of 291 patients who un-derwent hysteroscopy examination in the Department of Gynecology,Renmin Hospital of Wuhan University from June 1,2021 to December 31,2022 were selected.The dataset was divided into a training set(3703 images)and a test set(1078 images)by weight sampling method.After the training set was used for model learning and train-ing,two model architectures,residual neural network(ResNet18)and efficient neural network(EfficientNet-B0),were selected to verify the model in the test set by five-class and two-class classification tasks,respectively.Tak-ing histopathology as the gold standard,the diagnostic efficacy was evaluated to select the optimal model,and the Grad-CAM layer was embedded in the optimal model to output hysteroscopy images of Grad-CAM.Results:①In the five-class classification tasks,the accuracy of EfficientNet-B0 model(93.23%)was higher than that of Res-Net18 model(84.23%);the area under the curve(AUC)of EfficientNet-B0 model in the diagnosis of five disea-ses,including atypical endometrial hyperplasia,endometrial polyps,endometrial cancer,endometrial atypical hy-perplasia,and submucous myoma,was slightly higher than that of ResNet18 model,and the AUC of both models was almost above 0.980.②In the binary classification task of accuracy and the evaluation of specificity,the two models were similar,both above 93.00%,and the sensitivity of EfficientNet-B0 model(91.14%)was significantly better than that of ResNet18 model(77.22%).③EfficientNet-B0 model combined with Grad-CAM algorithm could identify the abnormal areas in the image.After biopsy and pathological examination,it was confirmed that about 95%of the marked areas in the model's output heatmap were lesion areas.Conclusions:The hysteroscopy di-agnostic model developed by EfficientNet-B0 model combined with Grad-CAM has high diagnostic accuracy,sen-sitivity,and specificity,and has application value in the diagnosis of endometrial lesions.
6.Research on Diagnosis Model of Endometrial Lesions by Hysteroscopy Based on Deep Learning Algorithm Combined with Grad-CAM
Mingliang CAO ; Mi YIN ; Qingbin WANG ; Hanfeng ZHU ; Xing LI ; Jun ZHANG ; Lin MAO ; Xuefeng MU ; Min CAO ; Yutao MA ; Jian WANG ; Yan ZHANG
Journal of Practical Obstetrics and Gynecology 2024;40(5):409-413
Objective:To explore the effectiveness of a hysteroscopic endometrial lesion diagnosis model de-veloped based on deep learning(DL)algorithm combined with gradient-weighted class activation mapping(Grad-CAM)visualization technology.Methods:303 hysteroscopy videos(4781 images)of 291 patients who un-derwent hysteroscopy examination in the Department of Gynecology,Renmin Hospital of Wuhan University from June 1,2021 to December 31,2022 were selected.The dataset was divided into a training set(3703 images)and a test set(1078 images)by weight sampling method.After the training set was used for model learning and train-ing,two model architectures,residual neural network(ResNet18)and efficient neural network(EfficientNet-B0),were selected to verify the model in the test set by five-class and two-class classification tasks,respectively.Tak-ing histopathology as the gold standard,the diagnostic efficacy was evaluated to select the optimal model,and the Grad-CAM layer was embedded in the optimal model to output hysteroscopy images of Grad-CAM.Results:①In the five-class classification tasks,the accuracy of EfficientNet-B0 model(93.23%)was higher than that of Res-Net18 model(84.23%);the area under the curve(AUC)of EfficientNet-B0 model in the diagnosis of five disea-ses,including atypical endometrial hyperplasia,endometrial polyps,endometrial cancer,endometrial atypical hy-perplasia,and submucous myoma,was slightly higher than that of ResNet18 model,and the AUC of both models was almost above 0.980.②In the binary classification task of accuracy and the evaluation of specificity,the two models were similar,both above 93.00%,and the sensitivity of EfficientNet-B0 model(91.14%)was significantly better than that of ResNet18 model(77.22%).③EfficientNet-B0 model combined with Grad-CAM algorithm could identify the abnormal areas in the image.After biopsy and pathological examination,it was confirmed that about 95%of the marked areas in the model's output heatmap were lesion areas.Conclusions:The hysteroscopy di-agnostic model developed by EfficientNet-B0 model combined with Grad-CAM has high diagnostic accuracy,sen-sitivity,and specificity,and has application value in the diagnosis of endometrial lesions.
7.Research on Diagnosis Model of Endometrial Lesions by Hysteroscopy Based on Deep Learning Algorithm Combined with Grad-CAM
Mingliang CAO ; Mi YIN ; Qingbin WANG ; Hanfeng ZHU ; Xing LI ; Jun ZHANG ; Lin MAO ; Xuefeng MU ; Min CAO ; Yutao MA ; Jian WANG ; Yan ZHANG
Journal of Practical Obstetrics and Gynecology 2024;40(5):409-413
Objective:To explore the effectiveness of a hysteroscopic endometrial lesion diagnosis model de-veloped based on deep learning(DL)algorithm combined with gradient-weighted class activation mapping(Grad-CAM)visualization technology.Methods:303 hysteroscopy videos(4781 images)of 291 patients who un-derwent hysteroscopy examination in the Department of Gynecology,Renmin Hospital of Wuhan University from June 1,2021 to December 31,2022 were selected.The dataset was divided into a training set(3703 images)and a test set(1078 images)by weight sampling method.After the training set was used for model learning and train-ing,two model architectures,residual neural network(ResNet18)and efficient neural network(EfficientNet-B0),were selected to verify the model in the test set by five-class and two-class classification tasks,respectively.Tak-ing histopathology as the gold standard,the diagnostic efficacy was evaluated to select the optimal model,and the Grad-CAM layer was embedded in the optimal model to output hysteroscopy images of Grad-CAM.Results:①In the five-class classification tasks,the accuracy of EfficientNet-B0 model(93.23%)was higher than that of Res-Net18 model(84.23%);the area under the curve(AUC)of EfficientNet-B0 model in the diagnosis of five disea-ses,including atypical endometrial hyperplasia,endometrial polyps,endometrial cancer,endometrial atypical hy-perplasia,and submucous myoma,was slightly higher than that of ResNet18 model,and the AUC of both models was almost above 0.980.②In the binary classification task of accuracy and the evaluation of specificity,the two models were similar,both above 93.00%,and the sensitivity of EfficientNet-B0 model(91.14%)was significantly better than that of ResNet18 model(77.22%).③EfficientNet-B0 model combined with Grad-CAM algorithm could identify the abnormal areas in the image.After biopsy and pathological examination,it was confirmed that about 95%of the marked areas in the model's output heatmap were lesion areas.Conclusions:The hysteroscopy di-agnostic model developed by EfficientNet-B0 model combined with Grad-CAM has high diagnostic accuracy,sen-sitivity,and specificity,and has application value in the diagnosis of endometrial lesions.
8.Research on Diagnosis Model of Endometrial Lesions by Hysteroscopy Based on Deep Learning Algorithm Combined with Grad-CAM
Mingliang CAO ; Mi YIN ; Qingbin WANG ; Hanfeng ZHU ; Xing LI ; Jun ZHANG ; Lin MAO ; Xuefeng MU ; Min CAO ; Yutao MA ; Jian WANG ; Yan ZHANG
Journal of Practical Obstetrics and Gynecology 2024;40(5):409-413
Objective:To explore the effectiveness of a hysteroscopic endometrial lesion diagnosis model de-veloped based on deep learning(DL)algorithm combined with gradient-weighted class activation mapping(Grad-CAM)visualization technology.Methods:303 hysteroscopy videos(4781 images)of 291 patients who un-derwent hysteroscopy examination in the Department of Gynecology,Renmin Hospital of Wuhan University from June 1,2021 to December 31,2022 were selected.The dataset was divided into a training set(3703 images)and a test set(1078 images)by weight sampling method.After the training set was used for model learning and train-ing,two model architectures,residual neural network(ResNet18)and efficient neural network(EfficientNet-B0),were selected to verify the model in the test set by five-class and two-class classification tasks,respectively.Tak-ing histopathology as the gold standard,the diagnostic efficacy was evaluated to select the optimal model,and the Grad-CAM layer was embedded in the optimal model to output hysteroscopy images of Grad-CAM.Results:①In the five-class classification tasks,the accuracy of EfficientNet-B0 model(93.23%)was higher than that of Res-Net18 model(84.23%);the area under the curve(AUC)of EfficientNet-B0 model in the diagnosis of five disea-ses,including atypical endometrial hyperplasia,endometrial polyps,endometrial cancer,endometrial atypical hy-perplasia,and submucous myoma,was slightly higher than that of ResNet18 model,and the AUC of both models was almost above 0.980.②In the binary classification task of accuracy and the evaluation of specificity,the two models were similar,both above 93.00%,and the sensitivity of EfficientNet-B0 model(91.14%)was significantly better than that of ResNet18 model(77.22%).③EfficientNet-B0 model combined with Grad-CAM algorithm could identify the abnormal areas in the image.After biopsy and pathological examination,it was confirmed that about 95%of the marked areas in the model's output heatmap were lesion areas.Conclusions:The hysteroscopy di-agnostic model developed by EfficientNet-B0 model combined with Grad-CAM has high diagnostic accuracy,sen-sitivity,and specificity,and has application value in the diagnosis of endometrial lesions.
9.Survey of the cognition of interventional radiology and employment intention in the students majoring in imaging technology in medical school
Yongming ZHANG ; Hanfeng YANG ; Jiayu SUN ; Yan FU ; Jingui LI ; Yuxi LIU ; Ruosu WANG ; Xiao LI
Journal of Interventional Radiology 2024;33(8):910-914
Objective To discuss the cognition of interventional radiology(IR)and employment intention in the students majoring in imaging technology in medical school.Methods From June 7 to July 31 of 2023,a voluntary and anonymous online questionnaire survey concerning the cognition of IR and employment intention was conducted in the students majoring in medical imaging technology in Sichuan University,North Sichuan Medical College,Harbin Medical University,Hebei Medical University,Changzhi Medical College and Sichuan Vocational College of Health and Rehabilitation.The data obtained from the survey were analyzed by descriptive analysis and chi-square test using SPSS 24.0 statistical software.Results A total of 126 valid questionnaires were received.Eighty-seven students(69.05%),94 students(74.61%)and 81(64.28%)students had no knowledge or just had a little bit knowledge about the medical position and current status of IR in the fields of cardiovascular diseases,neurological diseases,and tumor diagnosis and treatment respectively.The IR course was obligatory course for the medical imaging technology specialty in all the schools participating in this survey,and 112 students(91.8%)stated that the school curriculum is the main way to acquire knowledge of IR,and the internet platforms,television science popularization and academic conferences were the other ways to acquire knowledge of IR.Four students(3.17%),17 students(13.49%),57 students(45.24%),39 students(30.95%)and 9 students(7.14%)participating in this survey expressed that they had no intention,no willingness,neutral attitude,high willingness and high intention respectively to engage in IR work in future.The difference in the degree of willingness to engage in IR specialty in future between students of different gender as well as between students with different schooling level was not statistically significant,and the exposure to radiation,work-related high stress,and long working time were the main influencing factors for students to consider IR as their professional career.Conclusion At present,both the cognition of IR and the employment intention are not high in the students majoring in imaging technology in medical school.Therefore,it is very important to improve their cognition of IR and willingness to engage in IR profession.
10.Scientific Characterization of Traditional Softening Method of Corydalis Rhizoma
Xinrui ZHANG ; Jing YANG ; Yao ZHANG ; Ailing ZHANG ; Hanfeng YUAN ; Zhongming CAO ; Xiaojian LUO ; Feng WANG ; Xiaoyong RAO
Chinese Journal of Experimental Traditional Medical Formulae 2022;28(18):108-116
ObjectiveModern scientific methods and techniques were used to scientifically characterize the traditional softening process of Corydalis Rhizoma, so as to clarify the scientificity and rationality of the traditional process, and provide reference for inheriting the processing methods and experience of traditional Chinese medicine. MethodLow-field nuclear magnetic resonance imaging (LF-NMR/MRI) was used to characterize the water types and distribution in the softening process of Corydalis Rhizoma. Samples during the softening process was cut into thick slices and its section was observed by stereoscopic microscope. High performance liquid chromatography (HPLC) was employed to determine the content change of tetrahydropalmatine during the softening process with the mobile phase of methanol-0.1% phosphoric acid solution (60∶40, triethylamine regulated to pH 6.5) and detection wavelength at 280 nm. The determination method of softening endpoint of Corydalis Rhizoma was simulated by texture analyzer (hand pinch method), and the softening degree of the finished products was determined after optimizing the relevant parameters. ResultLF-NMR/MRI showed that the water could penetrate through the core and distribute evenly in Corydalis Rhizoma softened by Zhangbang method. The water first entered into the medicinal material from the epidermis and stem marks in the soaking stage as the form of free water, and then penetrated into the inner core to achieve redistribution in the moistening stage. Under stereoscopic microscope, it was observed that Corydalis Rhizoma softened by the Zhangbang method could be sliced well, but the core bursting slices were easy to appear if the softening time was not enough, and the softening of samples was caused by the keratine-like powder after absorbing water. HPLC measurement showed that the loss of tetrahydropalmatine in the softening method was small, its content decreased about 5% in the soaking process, and its content was almost unchanged during the moistening process. The softening degree of Corydalis Rhizoma could be quantified by the texture analyzer, and the optimum parameters were 2 mm·s-1 of speed before test, test speed and speed after test, 20 g of the trigger force, 20% of compression degree. The compressive force of the qualified softened Corydalis Rhizoma was 12.75-15.69 N with the relative standard deviation (RSD) of 6.8%. ConclusionModern scientific methods and techniques can characterize the scientificity and rationality of the traditional processing methods, and confirm that the Zhangbang softening method has the advantages of high efficiency, convenience and small loss of index components. The texture analyzer can simulate the softening endpoint judgment method (hand pinch method), and realize the goal from subjective experience judgment to objective technology quantification, which has a good demonstration role for the modern inheritance of traditional processing technology.

Result Analysis
Print
Save
E-mail