1.Impact of User’s Background Knowledge and Polyp Characteristics in Colonoscopy with Computer-Aided Detection
Jooyoung LEE ; Woo Sang CHO ; Byeong Soo KIM ; Dan YOON ; Jung KIM ; Ji Hyun SONG ; Sun Young YANG ; Seon Hee LIM ; Goh Eun CHUNG ; Ji Min CHOI ; Yoo Min HAN ; Hyoun-Joong KONG ; Jung Chan LEE ; Sungwan KIM ; Jung Ho BAE
Gut and Liver 2024;18(5):857-866
Background/Aims:
We investigated how interactions between humans and computer-aided detection (CADe) systems are influenced by the user’s experience and polyp characteristics.
Methods:
We developed a CADe system using YOLOv4, trained on 16,996 polyp images from 1,914 patients and 1,800 synthesized sessile serrated lesion (SSL) images. The performance of polyp detection with CADe assistance was evaluated using a computerized test module. Eighteen participants were grouped by colonoscopy experience (nurses, fellows, and experts). The value added by CADe based on the histopathology and detection difficulty of polyps were analyzed.
Results:
The area under the curve for CADe was 0.87 (95% confidence interval [CI], 0.83 to 0.91). CADe assistance increased overall polyp detection accuracy from 69.7% to 77.7% (odds ratio [OR], 1.88; 95% CI, 1.69 to 2.09). However, accuracy decreased when CADe inaccurately detected a polyp (OR, 0.72; 95% CI, 0.58 to 0.87). The impact of CADe assistance was most and least prominent in the nurses (OR, 1.97; 95% CI, 1.71 to 2.27) and the experts (OR, 1.42; 95% CI, 1.15 to 1.74), respectively. Participants demonstrated better sensitivity with CADe assistance, achieving 81.7% for adenomas and 92.4% for easy-to-detect polyps, surpassing the standalone CADe performance of 79.7% and 89.8%, respectively. For SSLs and difficult-to-detect polyps, participants' sensitivities with CADe assistance (66.5% and 71.5%, respectively) were below those of standalone CADe (81.1% and 74.4%). Compared to the other two groups (56.1% and 61.7%), the expert group showed sensitivity closest to that of standalone CADe in detecting SSLs (79.7% vs 81.1%, respectively).
Conclusions
CADe assistance boosts polyp detection significantly, but its effectiveness depends on the user’s experience, particularly for challenging lesions.
2.Diagnostic Assessment of Deep Learning Algorithms for Frozen Tissue Section Analysis in Women with Breast Cancer
Young-Gon KIM ; In Hye SONG ; Seung Yeon CHO ; Sungchul KIM ; Milim KIM ; Soomin AHN ; Hyunna LEE ; Dong Hyun YANG ; Namkug KIM ; Sungwan KIM ; Taewoo KIM ; Daeyoung KIM ; Jonghyeon CHOI ; Ki-Sun LEE ; Minuk MA ; Minki JO ; So Yeon PARK ; Gyungyub GONG
Cancer Research and Treatment 2023;55(2):513-522
Purpose:
Assessing the metastasis status of the sentinel lymph nodes (SLNs) for hematoxylin and eosin–stained frozen tissue sections by pathologists is an essential but tedious and time-consuming task that contributes to accurate breast cancer staging. This study aimed to review a challenge competition (HeLP 2019) for the development of automated solutions for classifying the metastasis status of breast cancer patients.
Materials and Methods:
A total of 524 digital slides were obtained from frozen SLN sections: 297 (56.7%) from Asan Medical Center (AMC) and 227 (43.4%) from Seoul National University Bundang Hospital (SNUBH), South Korea. The slides were divided into training, development, and validation sets, where the development set comprised slides from both institutions and training and validation set included slides from only AMC and SNUBH, respectively. The algorithms were assessed for area under the receiver operating characteristic curve (AUC) and measurement of the longest metastatic tumor diameter. The final total scores were calculated as the mean of the two metrics, and the three teams with AUC values greater than 0.500 were selected for review and analysis in this study.
Results:
The top three teams showed AUC values of 0.891, 0.809, and 0.736 and major axis prediction scores of 0.525, 0.459, and 0.387 for the validation set. The major factor that lowered the diagnostic accuracy was micro-metastasis.
Conclusion
In this challenge competition, accurate deep learning algorithms were developed that can be helpful for making a diagnosis on intraoperative SLN biopsy. The clinical utility of this approach was evaluated by including an external validation set from SNUBH.
3.Exploring the Category and Use Cases on Digital Therapeutic Methodologies
Sunhee AN ; Jieun KO ; Kyung-Sang YU ; Hyuktae KWON ; Sungwan KIM ; Jeeyoung HONG ; Hyoun-Joong KONG
Healthcare Informatics Research 2023;29(3):190-198
Objectives:
As the Fourth Industrial Revolution advances, there is a growing interest in digital technology. In particular, the use of digital therapeutics (DTx) in healthcare is anticipated to reduce medical expenses. However, analytical research on DTx is still insufficient to fuel momentum for future DTx development. The purpose of this article is to analyze representative cases of different types of DTx from around the world and to propose a classification system.
Methods:
In this exploratory study examining DTx interaction types and representative cases, we conducted a literature review and selected seven interaction types that were utilized in a large number of cases. Then, we evaluated the specific characteristics of each DTx mechanism by reviewing the relevant literature, analyzing their indications and treatment components. A representative case for each mechanism was provided.
Results:
Cognitive behavioral therapy, distraction therapy, graded exposure therapy, reminiscence therapy, art therapy, therapeutic exercise, and gamification are the seven categories of DTx interaction types. Illustrative examples of each variety are provided.
Conclusions
Efforts from both the government and private sector are crucial for success, as standardization can decrease both the expense and the time required for government-led DTx development. The private sector should partner with medical facilities to stimulate potential demand, carry out clinical research, and produce scholarly evidence.
4.Current Status of Low-Density Lipoprotein Cholesterol Target Achievement in Patients with Type 2 Diabetes Mellitus in Korea Compared with Recent Guidelines
Soo Jin YUN ; In-Kyung JEONG ; Jin-Hye CHA ; Juneyoung LEE ; Ho Chan CHO ; Sung Hee CHOI ; SungWan CHUN ; Hyun Jeong JEON ; Ho-Cheol KANG ; Sang Soo KIM ; Seung-Hyun KO ; Gwanpyo KOH ; Su Kyoung KWON ; Jae Hyuk LEE ; Min Kyong MOON ; Junghyun NOH ; Cheol-Young PARK ; Sungrae KIM
Diabetes & Metabolism Journal 2022;46(3):464-475
Background:
We evaluated the achievement of low-density lipoprotein cholesterol (LDL-C) targets in patients with type 2 diabetes mellitus (T2DM) according to up-to-date Korean Diabetes Association (KDA), European Society of Cardiology (ESC)/European Atherosclerosis Society (EAS), and American Diabetes Association (ADA) guidelines.
Methods:
This retrospective cohort study collected electronic medical record data from patients with T2DM (≥20 years) managed by endocrinologists from 15 hospitals in Korea (January to December 2019). Patients were categorized according to guidelines to assess LDL-C target achievement. KDA (2019): Very High-I (atherosclerotic cardiovascular disease [ASCVD]) <70 mg/dL; Very High-II (target organ damage [TOD], or cardiovascular risk factors [CVRFs]) <70 mg/dL; high (others) <100 mg/dL. ESC/EAS (2019): Very High-I (ASCVD): <55 mg/dL; Very High-II (TOD or ≥3-CVRF) <55 mg/dL; high (diabetes ≥10 years without TOD plus any CVRF) <70 mg/dL; moderate (diabetes <10 years without CVRF) <100 mg/dL. ADA (2019): Very High-I (ASCVD); Very High-II (age ≥40+ TOD, or any CVRF), for high intensity statin or statin combined with ezetimibe.
Results:
Among 2,000 T2DM patients (mean age 62.6 years; male 55.9%; mean glycosylated hemoglobin 7.2%) ASCVD prevalence was 24.7%. Of 1,455 (72.8%) patients treated with statins, 73.9% received monotherapy. According to KDA guidelines, LDL-C target achievement rates were 55.2% in Very High-I and 34.9% in Very High-II patients. With ESC/EAS guidelines, target attainment rates were 26.6% in Very High-I, 15.7% in Very High-II, and 25.9% in high risk patients. Based on ADA guidelines, most patients (78.9%) were very-high risk; however, only 15.5% received high-intensity statin or combination therapy.
Conclusion
According to current dyslipidemia management guidelines, LDL-C goal achievement remains suboptimal in Korean patients with T2DM.
5.Review of Smart Hospital Services in Real Healthcare Environments
Hyuktae KWON ; Sunhee AN ; Ho-Young LEE ; Won Chul CHA ; Sungwan KIM ; Minwoo CHO ; Hyoun-Joong KONG
Healthcare Informatics Research 2022;28(1):3-15
Objectives:
Smart hospitals involve the application of recent information and communications technology (ICT) innovations to medical services; however, the concept of a smart hospital has not been rigorously defined. In this study, we aimed to derive the definition and service types of smart hospitals and investigate cases of each type.
Methods:
A literature review was conducted regarding the background and technical characteristics of smart hospitals. On this basis, we conducted a focus group interview with experts in hospital information systems, and ultimately derived eight smart hospital service types.
Results:
Smart hospital services can be classified into the following types: services based on location recognition and tracking technology that measures and monitors the location information of an object based on short-range communication technology; high-speed communication network-based services based on new wireless communication technology; Internet of Things-based services that connect objects embedded with sensors and communication functions to the internet; mobile health services such as mobile phones, tablets, and wearables; artificial intelligence-based services for the diagnosis and prediction of diseases; robot services provided on behalf of humans in various medical fields; extended reality services that apply hyper-realistic immersive technology to medical practice; and telehealth using ICT.
Conclusions
Smart hospitals can influence health and medical policies and create new medical value by defining and quantitatively measuring detailed indicators based on data collected from existing hospitals. Simultaneously, appropriate government incentives, consolidated interdisciplinary research, and active participation by industry are required to foster and facilitate smart hospitals.
6.Usage of the Internet of Things in Medical Institutions and its Implications
Hyoun-Joong KONG ; Sunhee AN ; Sohye LEE ; Sujin CHO ; Jeeyoung HONG ; Sungwan KIM ; Saram LEE
Healthcare Informatics Research 2022;28(4):287-296
Objectives:
The purpose of this study was to explore new ways of creating value in the medical field and to derive recommendations for the role of medical institutions and the government.
Methods:
In this paper, based on expert discussion, we classified Internet of Things (IoT) technologies into four categories according to the type of information they collect (location, environmental parameters, energy consumption, and biometrics), and investigated examples of application.
Results:
Biometric IoT diagnoses diseases accurately and offers appropriate and effective treatment. Environmental parameter measurement plays an important role in accurately identifying and controlling environmental factors that could be harmful to patients. The use of energy measurement and location tracking technology enabled optimal allocation of limited hospital resources and increased the efficiency of energy consumption. The resulting economic value has returned to patients, improving hospitals’ cost-effectiveness.
Conclusions
Introducing IoT-based technology to clinical sites, including medical institutions, will enhance the quality of medical services, increase patient safety, improve management efficiency, and promote patient-centered medical services. Moreover, the IoT is expected to play an active role in the five major tasks of facility hygiene in medical fields, which are all required to deal with the COVID-19 pandemic: social distancing, contact tracking, bed occupancy control, and air quality management. Ultimately, the IoT is expected to serve as a key element for hospitals to perform their original functions more effectively. Continuing investments, deregulation policies, information protection, and IT standardization activities should be carried out more actively for the IoT to fulfill its expectations.
7.2021 Clinical Practice Guidelines for Diabetes Mellitus in Korea
Kyu Yeon HUR ; Min Kyong MOON ; Jong Suk PARK ; Soo-Kyung KIM ; Seung-Hwan LEE ; Jae-Seung YUN ; Jong Ha BAEK ; Junghyun NOH ; Byung-Wan LEE ; Tae Jung OH ; Suk CHON ; Ye Seul YANG ; Jang Won SON ; Jong Han CHOI ; Kee Ho SONG ; Nam Hoon KIM ; Sang Yong KIM ; Jin Wha KIM ; Sang Youl RHEE ; You-Bin LEE ; Sang-Man JIN ; Jae Hyeon KIM ; Chong Hwa KIM ; Dae Jung KIM ; SungWan CHUN ; Eun-Jung RHEE ; Hyun Min KIM ; Hyun Jung KIM ; Donghyun JEE ; Jae Hyun KIM ; Won Seok CHOI ; Eun-Young LEE ; Kun-Ho YOON ; Seung-Hyun KO ;
Diabetes & Metabolism Journal 2021;45(4):461-481
The Committee of Clinical Practice Guidelines of the Korean Diabetes Association (KDA) updated the previous clinical practice guidelines for Korean adults with diabetes and prediabetes and published the seventh edition in May 2021. We performed a comprehensive systematic review of recent clinical trials and evidence that could be applicable in real-world practice and suitable for the Korean population. The guideline is provided for all healthcare providers including physicians, diabetes experts, and certified diabetes educators across the country who manage patients with diabetes or the individuals at the risk of developing diabetes mellitus. The recommendations for screening diabetes and glucose-lowering agents have been revised and updated. New sections for continuous glucose monitoring, insulin pump use, and non-alcoholic fatty liver disease in patients with diabetes mellitus have been added. The KDA recommends active vaccination for coronavirus disease 2019 in patients with diabetes during the pandemic. An abridgement that contains practical information for patient education and systematic management in the clinic was published separately.
8.Prediction of Neurological Outcomes in Out-of-hospital Cardiac Arrest Survivors Immediately after Return of Spontaneous Circulation: Ensemble Technique with Four Machine Learning Models
Ji Han HEO ; Taegyun KIM ; Jonghwan SHIN ; Gil Joon SUH ; Joonghee KIM ; Yoon Sun JUNG ; Seung Min PARK ; Sungwan KIM ;
Journal of Korean Medical Science 2021;36(28):e187-
Background:
We performed this study to establish a prediction model for 1-year neurological outcomes in out-of-hospital cardiac arrest (OHCA) patients who achieved return of spontaneous circulation (ROSC) immediately after ROSC using machine learning methods.
Methods:
We performed a retrospective analysis of an OHCA survivor registry. Patients aged ≥ 18 years were included. Study participants who had registered between March 31, 2013 and December 31, 2018 were divided into a develop dataset (80% of total) and an internal validation dataset (20% of total), and those who had registered between January 1, 2019 and December 31, 2019 were assigned to an external validation dataset. Four machine learning methods, including random forest, support vector machine, ElasticNet and extreme gradient boost, were implemented to establish prediction models with the develop dataset, and the ensemble technique was used to build the final prediction model. The prediction performance of the model in the internal validation and the external validation dataset was described with accuracy, area under the receiver-operating characteristic curve, area under the precision-recall curve, sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV). Futhermore, we established multivariable logistic regression models with the develop set and compared prediction performance with the ensemble models. The primary outcome was an unfavorable 1-year neurological outcome.
Results:
A total of 1,207 patients were included in the study. Among them, 631, 139, and 153were assigned to the develop, the internal validation and the external validation datasets, respectively. Prediction performance metrics for the ensemble prediction model in the internal validation dataset were as follows: accuracy, 0.9620 (95% confidence interval [CI],0.9352–0.9889); area under receiver-operator characteristics curve, 0.9800 (95% CI, 0.9612– 0.9988); area under precision-recall curve, 0.9950 (95% CI, 0.9860–1.0000); sensitivity, 0.9594 (95% CI, 0.9245–0.9943); specificity, 0.9714 (95% CI, 0.9162–1.0000); PPV, 0.9916 (95% CI, 0.9752–1.0000); NPV, 0.8718 (95% CI, 0.7669–0.9767). Prediction performance metrics for the model in the external validation dataset were as follows: accuracy, 0.8509 (95% CI, 0.7825–0.9192); area under receiver-operator characteristics curve, 0.9301 (95% CI, 0.8845–0.9756); area under precision-recall curve, 0.9476 (95% CI, 0.9087–0.9867); sensitivity, 0.9595 (95% CI, 0.9145–1.0000); specificity, 0.6500 (95% CI, 0.5022–0.7978); PPV, 0.8353 (95% CI, 0.7564–0.9142); NPV, 0.8966 (95% CI, 0.7857–1.0000). All the prediction metrics were higher in the ensemble models, except NPVs in both the internal and the external validation datasets.
Conclusion
We established an ensemble prediction model for prediction of unfavorable 1-year neurological outcomes in OHCA survivors using four machine learning methods. The prediction performance of the ensemble model was higher than the multivariable logistic regression model, while its performance was slightly decreased in the external validation dataset.
9.Codeless Deep Learning of COVID-19 Chest X-Ray Image Dataset with KNIME Analytics Platform
Jun Young AN ; Hoseok SEO ; Young-Gon KIM ; Kyu Eun LEE ; Sungwan KIM ; Hyoun-Joong KONG
Healthcare Informatics Research 2021;27(1):82-91
Objectives:
This paper proposes a method for computer-assisted diagnosis of coronavirus disease 2019 (COVID-19) through chest X-ray imaging using a deep learning model without writing a single line of code using the Konstanz Information Miner (KNIME) analytics platform.
Methods:
We obtained 155 samples of posteroanterior chest X-ray images from COVID-19 open dataset repositories to develop a classification model using a simple convolutional neural network (CNN). All of the images contained diagnostic information for COVID-19 and other diseases. The model would classify whether a patient was infected with COVID-19 or not. Eighty percent of the images were used for model training, and the rest were used for testing. The graphic user interface-based programming in the KNIME enabled class label annotation, data preprocessing, CNN model training and testing, performance evaluation, and so on.
Results:
1,000 epochs training were performed to test the simple CNN model. The lower and upper bounds of positive predictive value (precision), sensitivity (recall), specificity, and f-measure are 92.3% and 94.4%. Both bounds of the model’s accuracies were equal to 93.5% and 96.6% of the area under the receiver operating characteristic curve for the test set.
Conclusions
In this study, a researcher who does not have basic knowledge of python programming successfully performed deep learning analysis of chest x-ray image dataset using the KNIME independently. The KNIME will reduce the time spent and lower the threshold for deep learning research applied to healthcare.
10.2021 Clinical Practice Guidelines for Diabetes Mellitus in Korea
Kyu Yeon HUR ; Min Kyong MOON ; Jong Suk PARK ; Soo-Kyung KIM ; Seung-Hwan LEE ; Jae-Seung YUN ; Jong Ha BAEK ; Junghyun NOH ; Byung-Wan LEE ; Tae Jung OH ; Suk CHON ; Ye Seul YANG ; Jang Won SON ; Jong Han CHOI ; Kee Ho SONG ; Nam Hoon KIM ; Sang Yong KIM ; Jin Wha KIM ; Sang Youl RHEE ; You-Bin LEE ; Sang-Man JIN ; Jae Hyeon KIM ; Chong Hwa KIM ; Dae Jung KIM ; SungWan CHUN ; Eun-Jung RHEE ; Hyun Min KIM ; Hyun Jung KIM ; Donghyun JEE ; Jae Hyun KIM ; Won Seok CHOI ; Eun-Young LEE ; Kun-Ho YOON ; Seung-Hyun KO ;
Diabetes & Metabolism Journal 2021;45(4):461-481
The Committee of Clinical Practice Guidelines of the Korean Diabetes Association (KDA) updated the previous clinical practice guidelines for Korean adults with diabetes and prediabetes and published the seventh edition in May 2021. We performed a comprehensive systematic review of recent clinical trials and evidence that could be applicable in real-world practice and suitable for the Korean population. The guideline is provided for all healthcare providers including physicians, diabetes experts, and certified diabetes educators across the country who manage patients with diabetes or the individuals at the risk of developing diabetes mellitus. The recommendations for screening diabetes and glucose-lowering agents have been revised and updated. New sections for continuous glucose monitoring, insulin pump use, and non-alcoholic fatty liver disease in patients with diabetes mellitus have been added. The KDA recommends active vaccination for coronavirus disease 2019 in patients with diabetes during the pandemic. An abridgement that contains practical information for patient education and systematic management in the clinic was published separately.

Result Analysis
Print
Save
E-mail