Application value of artificial intelligence model based on deep learning in Breast Ultrasound Imaging Reporting and Data System: breast nodules classification
10.3760/cma.j.cn115355-20220221-00100
- VernacularTitle:基于深度学习的人工智能模型在乳腺超声影像报告和数据系统乳腺结节分类中的应用价值
- Author:
Minghui LYU
1
;
Hongtao JI
;
Conggui GAN
;
Teng MA
;
Wei REN
;
Shuai ZHOU
;
Yun CHENG
;
Huilian HUANG
;
Mingchang ZHAO
;
Qiang ZHU
Author Information
1. 首都医科大学附属北京同仁医院超声诊断科，北京 100730
- Keywords:
Breast diseases;
Ultrasonography, mammary;
Artificial intelligence
- From:
Cancer Research and Clinic
2022;34(6):401-407
- CountryChina
- Language:Chinese
-
Abstract:
Objective:To explore the application value of artificial intelligence (AI) model based on deep learning in breast nodules classification of Breast Imaging Reporting and Data System of ultrasound (BI-RADS-US).Methods:The ultrasound images of 2 426 breast nodules from 1 558 female patients with breast diseases at Beijing Tongren Hospital, Capital Medical University between December 2006 and December 2019 were collected . The image data sets were divided into training (63%), verification (7%), and test (30%) subsets for the construction of AI model. The diagnostic efficiencies of AI model, doctors' arbitration results and doctors' diagnosis with or without AI model assistance were analyzed by using receiver operating characteristic (ROC) curve. The Cohen weighted Kappa statistic was used to compare the consistency of BI-RADS-US classification among 5 ultrasound doctors' diagnosis with or without AI model assistance. And the changes of BI-RADS-US classification were analyzed before and after each doctor adopted AI model assistance.Results:The differences in diagnostic efficiencies of AI model, doctors' arbitration results and doctors' diagnosis with or without AI model assistance were statistically significant (all P > 0.05). The consistency among 5 ultrasound doctors was improved due to AI model assistance and Kappa value was increased from 0.433 (category 3), 0.600 (category 4a), 0.614 (category 4b), 0.570 (category 4c) and 0.495 (category 5) to 0.812, 0.704, 0.823, 0.690 and 0.509 (all P < 0.05), respectively. The upgrade and downgrade of BI-RADS-US classification occurred in 5 doctors after the classification of AI model assistance. Downgrade from category 4 to 3 in benign nodules of 56.6% (47/76) and upgrade from category 4 to 5 in malignant nodules of 69.4% (34/49) were mostly observed. Conclusions:AI-assisted BI-RADS-US classification can effectively improve the consistency of classification among the doctors without reducing the diagnostic efficiency. AI model shows clinical values in reducing unnecessary biopsy of partial benign lesions and increasing diagnostic accuracy of partial malignant lesions through the adjustment of breast nodule classification.
