3.Development and Multicenter, Multiprotocol Validation of Neural Network for Aberrant Right Subclavian Artery Detection
So Yeon WON ; Ilah SHIN ; Eung Yeop KIM ; Seung-Koo LEE ; Youngno YOON ; Beomseok SOHN
Yonsei Medical Journal 2024;65(9):527-533
Purpose:
This study aimed to develop and validate a convolutional neural network (CNN) that automatically detects an aberrant right subclavian artery (ARSA) on preoperative computed tomography (CT) for thyroid cancer evaluation.
Materials and Methods:
A total of 556 CT with ARSA and 312 CT with normal aortic arch from one institution were used as the training set for model development. A deep learning model for the classification of patch images for ARSA was developed using two-dimension CNN from EfficientNet. The diagnostic performance of our model was evaluated using external test sets (112 and 126 CT) from two institutions. The performance of the model was compared with that of radiologists for detecting ARSA using an independent dataset of 1683 consecutive neck CT.
Results:
The performance of the model was achieved using two external datasets with an area under the curve of 0.97 and 0.99, and accuracy of 97% and 99%, respectively. In the temporal validation set, which included a total of 20 patients with ARSA and 1663 patients without ARSA, radiologists overlooked 13 ARSA cases. In contrast, the CNN model successfully detected all the 20 patients with ARSA.
Conclusion
We developed a CNN-based deep learning model that detects ARSA using CT. Our model showed high performance in the multicenter validation.
4.Development and Multicenter, Multiprotocol Validation of Neural Network for Aberrant Right Subclavian Artery Detection
So Yeon WON ; Ilah SHIN ; Eung Yeop KIM ; Seung-Koo LEE ; Youngno YOON ; Beomseok SOHN
Yonsei Medical Journal 2024;65(9):527-533
Purpose:
This study aimed to develop and validate a convolutional neural network (CNN) that automatically detects an aberrant right subclavian artery (ARSA) on preoperative computed tomography (CT) for thyroid cancer evaluation.
Materials and Methods:
A total of 556 CT with ARSA and 312 CT with normal aortic arch from one institution were used as the training set for model development. A deep learning model for the classification of patch images for ARSA was developed using two-dimension CNN from EfficientNet. The diagnostic performance of our model was evaluated using external test sets (112 and 126 CT) from two institutions. The performance of the model was compared with that of radiologists for detecting ARSA using an independent dataset of 1683 consecutive neck CT.
Results:
The performance of the model was achieved using two external datasets with an area under the curve of 0.97 and 0.99, and accuracy of 97% and 99%, respectively. In the temporal validation set, which included a total of 20 patients with ARSA and 1663 patients without ARSA, radiologists overlooked 13 ARSA cases. In contrast, the CNN model successfully detected all the 20 patients with ARSA.
Conclusion
We developed a CNN-based deep learning model that detects ARSA using CT. Our model showed high performance in the multicenter validation.
5.Development and Multicenter, Multiprotocol Validation of Neural Network for Aberrant Right Subclavian Artery Detection
So Yeon WON ; Ilah SHIN ; Eung Yeop KIM ; Seung-Koo LEE ; Youngno YOON ; Beomseok SOHN
Yonsei Medical Journal 2024;65(9):527-533
Purpose:
This study aimed to develop and validate a convolutional neural network (CNN) that automatically detects an aberrant right subclavian artery (ARSA) on preoperative computed tomography (CT) for thyroid cancer evaluation.
Materials and Methods:
A total of 556 CT with ARSA and 312 CT with normal aortic arch from one institution were used as the training set for model development. A deep learning model for the classification of patch images for ARSA was developed using two-dimension CNN from EfficientNet. The diagnostic performance of our model was evaluated using external test sets (112 and 126 CT) from two institutions. The performance of the model was compared with that of radiologists for detecting ARSA using an independent dataset of 1683 consecutive neck CT.
Results:
The performance of the model was achieved using two external datasets with an area under the curve of 0.97 and 0.99, and accuracy of 97% and 99%, respectively. In the temporal validation set, which included a total of 20 patients with ARSA and 1663 patients without ARSA, radiologists overlooked 13 ARSA cases. In contrast, the CNN model successfully detected all the 20 patients with ARSA.
Conclusion
We developed a CNN-based deep learning model that detects ARSA using CT. Our model showed high performance in the multicenter validation.
6.Development and Multicenter, Multiprotocol Validation of Neural Network for Aberrant Right Subclavian Artery Detection
So Yeon WON ; Ilah SHIN ; Eung Yeop KIM ; Seung-Koo LEE ; Youngno YOON ; Beomseok SOHN
Yonsei Medical Journal 2024;65(9):527-533
Purpose:
This study aimed to develop and validate a convolutional neural network (CNN) that automatically detects an aberrant right subclavian artery (ARSA) on preoperative computed tomography (CT) for thyroid cancer evaluation.
Materials and Methods:
A total of 556 CT with ARSA and 312 CT with normal aortic arch from one institution were used as the training set for model development. A deep learning model for the classification of patch images for ARSA was developed using two-dimension CNN from EfficientNet. The diagnostic performance of our model was evaluated using external test sets (112 and 126 CT) from two institutions. The performance of the model was compared with that of radiologists for detecting ARSA using an independent dataset of 1683 consecutive neck CT.
Results:
The performance of the model was achieved using two external datasets with an area under the curve of 0.97 and 0.99, and accuracy of 97% and 99%, respectively. In the temporal validation set, which included a total of 20 patients with ARSA and 1663 patients without ARSA, radiologists overlooked 13 ARSA cases. In contrast, the CNN model successfully detected all the 20 patients with ARSA.
Conclusion
We developed a CNN-based deep learning model that detects ARSA using CT. Our model showed high performance in the multicenter validation.
7.Application of machine learning to ultrasound images to differentiate follicular neoplasms of the thyroid gland
Ilah SHIN ; Young Jae KIM ; Kyunghwa HAN ; Eunjung LEE ; Hye Jung KIM ; Jung Hee SHIN ; Hee Jung MOON ; Ji Hyun YOUK ; Kwang Gi KIM ; Jin Young KWAK
Ultrasonography 2020;39(3):257-265
Purpose:
This study was conducted to evaluate the diagnostic performance of machine learning in differentiating follicular adenoma from carcinoma using preoperative ultrasonography (US).
Methods:
In this retrospective study, preoperative US images of 348 nodules from 340 patients were collected from two tertiary referral hospitals. Two experienced radiologists independently reviewed each image and categorized the nodules according to the 2015 American Thyroid Association guideline. Categorization of a nodule as highly suspicious was considered a positive diagnosis for malignancy. The nodules were manually segmented, and 96 radiomic features were extracted from each region of interest. Ten significant features were selected and used as final input variables in our in-house developed classifier models based on an artificial neural network (ANN) and support vector machine (SVM). The diagnostic performance of radiologists and both classifier models was calculated and compared.
Results:
In total, 252 nodules from 245 patients were confirmed as follicular adenoma and 96 nodules from 95 patients were diagnosed as follicular carcinoma. As measures of diagnostic performance, the average sensitivity, specificity, and accuracy of the two experienced radiologists in discriminating follicular adenoma from carcinoma on preoperative US images were 24.0%, 84.0%, and 64.8%, respectively. The sensitivity, specificity, and accuracy of the ANN and SVM-based models were 32.3%, 90.1%, and 74.1% and 41.7%, 79.4%, and 69.0%, respectively. The kappa value of the two radiologists was 0.076, corresponding to slight agreement.
Conclusion
Machine learning-based classifier models may aid in discriminating follicular adenoma from carcinoma using preoperative US.