1.Key Measures for Evaluating Diagnostic Accuracy in Multi-Class Classification: An Overview and Simulation-Based Comparison
Leeha RYU ; Kyunghwa HAN ; Inkyung JUNG ; Yae Won PARK ; Sung Soo AHN ; Dosik HWANG
Korean Journal of Radiology 2026;27(4):344-355
Recent advancements in artificial intelligence have led to increased interest in predictive modeling across various domains, including medicine. Although numerous metrics have been established for binary classification, the growing adoption of multi-class systems necessitates robust evaluation measures. However, comprehensive simulation studies comparing the performance of existing multi-class metrics under diverse data conditions remain limited. In this study, we first provide a concise overview of commonly used accuracy metrics for multi-class classification. Then, we report a simulation study that systematically evaluates several diagnostic accuracy measures under a wide range of scenarios, including three- and five-class settings, balanced and imbalanced sample sizes, and different distributional assumptions for predictors. We assessed each metric’s performance in terms of bias and 95% confidence interval coverage. Under balanced conditions, most metrics demonstrated stable and unbiased performance, closely approximating the true values. However, under imbalanced conditions, greater bias was observed, with the M-index and polytomous discrimination index exhibiting comparatively more stable performance across various scenarios. The micro-averaged receiver operating characteristic curve area consistently showed higher bias under class imbalance. Finally, we applied these metrics to a glioma tumor grading task using external datasets. This study provides a systematic comparison of commonly used metrics and offers practical guidance for selecting appropriate measures in multi-class classification tasks.
2.AFP-PIVKA-II score as a simplified quantifiable surrogate biomarker for hepatocellular carcinoma recurrence following living donor liver transplantation
Dae Hyeon WON ; Shin HWANG ; Chul-Soo AHN ; Deok-Bog MOON ; Tae-Yong HA ; Gi-Won SONG ; Dong-Hwan JUNG ; Gil-Chun PARK ; Woo-Hyoung KANG ; Young-In YOON ; Sung-Gyu LEE
Annals of Liver Transplantation 2026;6(1):25-32
Background:
We developed a simplified variant of the ADV score, the AFP-PIVKAII (AP) score for post-transplant hepatocellular carcinoma (HCC) prognosis, which considers only AFP and PIVKA-II levels excluding morphometric tumor size information from the ADV score. This study investigated the prognostic performance of the AP score in predicting HCC recurrence and overall survival (OS) after living donor liver transplantation (LDLT).
Methods:
We analyzed 843 patients with HCC who underwent LDLT between 2006 and 2015, assessing HCC recurrence and OS in relation to AP score.
Results:
The median pretransplant AFP and PIVKA-II levels were 12.8 ng/mL and 27 mAU/mL, respectively. The median and mean AP scores were 2.6 log (range: 0.6–9.2 log) and 2.9±1.1 log, respectively. The 5-year time-dependent area under the receiver operating characteristic curve for the AP score in predicting post-transplant HCC recurrence was 0.672 (p<0.001). HCC recurrence and OS curves along AP score intervals of 1.0 log showed statistical differences in accordance with the AP scores (both p<0.001). Using a Youden index J-derived AP score cutoff of 4.0 log, two-tiered groups (ADV <4.0 log vs. ADV ≥4.0 log) showed statistically significant differences in HCC recurrence and OS (both p<0.001). Harrell’s c-indices for AP score with cutoff of 4.0 log and ADV scores with cutoff of 5.0 log regarding HCC recurrence and OS were similar.
Conclusion
The AP score functions as an integrated surrogate marker for predicting post-transplant outcomes in patients with HCC undergoing LDLT. It may serve as a simplified alternative to the ADV score, particularly in patients with small HCCs.
3.Development of an artificial intelligence-based prediction platform for early recurrence of resectable pancreatic cancer after curative surgery–toward future use as an indication for neoadjuvant treatment: a retrospective multicenter cohort study
So Jeong YOON ; Sung Hyun KIM ; Hongbeom KIM ; Sang Hyun SHIN ; Jin Seok HEO ; Seung Soo HONG ; Chang Moo KANG ; Kyung Sik KIM ; Ho Kyoung HWANG ; In Woong HAN
Annals of Surgical Treatment and Research 2026;110(2):76-83
Purpose:
Neoadjuvant treatment (NAT) is now the standard for borderline resectable pancreatic cancer (RPC) and is being considered for RPC. Early recurrence after curative surgery in RPC is often seen as a treatment failure, prompting considerations for NAT. Our goal was to develop an artificial intelligence (AI)-based predictive model utilizing preoperatively available factors to forecast early recurrences of resected RPC.
Methods:
This study included 469 patients who underwent surgery for RPC between 2011 and 2019. Clinicopathologic and oncologic data were retrospectively reviewed. Preoperative variables, including laboratory data and imaging findings, were collected. Early recurrence was defined as recurrence occurring within a year after surgery. Deep neural networks were then used to select variables by assessing their importance. A new model predicting early recurrence of RPC was subsequently developed.
Results:
Of the patients evaluated, 199 (42.4%) experienced early recurrence. The predictive model included 14 preoperative variables: CA 19-9, preoperative pancreatitis, serum albumin, platelet count, lymphocyte count, the American Society of Anesthesiologists physical status classification, tumor size, monocyte count, age, body mass index, CRP, hemoglobin, WBC count, and CEA. The area under the curve for the model was 0.786 in the training set and 0.734 in the test set.
Conclusion
We developed an AI-based model to predict the early recurrence of RPC using preoperative parameters. By identifying patients at risk of early recurrence, optimal individualized treatments such as NAT can be considered. Future prospective studies are crucial to establish clear indications for NAT in RPC.
4.Molecular determinants of outcome to gemcitabine, cisplatin, and nab-paclitaxel in patients with advanced biliary tract cancer
Daeseong KIM ; Nam Suk SIM ; Seonjeong WOO ; Min Hwan KIM ; Choong-kun LEE ; Seung Soo HONG ; Sung Hyun KIM ; Ho Kyoung HWANG ; Chang Moo KANG ; Woo Jung LEE ; Jung Hyun JO ; Taek CHUNG ; Sohyun HWANG ; Beodeul KANG ; Jung Sun KIM ; Chang-Il KWON ; Sangwoo KIM ; Hong Jae CHON ; Chang Gon KIM ; Young Nyun PARK ; Hye Jin CHOI
Clinical and Molecular Hepatology 2026;32(2):721-736
Background/Aims:
Biliary tract cancer (BTC) is a rare malignancy with poor prognosis. We investigated genomic determinants of clinical benefit from gemcitabine, cisplatin, and nab-paclitaxel (GAP) versus gemcitabine and cisplatin (GC) in advanced BTC.
Methods:
Clinical and genomic data using TruSight Oncology 500 were analyzed from patients treated with GAP (N=198) or GC (N=89) as first-line therapy.
Results:
With a median follow-up of 33.0 months, GAP modestly improved progression-free survival (PFS) (hazard ratio [HR] 0.764; 95% confidence interval [CI] 0.591–0.989) without significant overall survival (OS) difference compared to GC. Genomic profiling revealed frequent alterations in TP53 (35.2%), KRAS (16.4%), SMAD4 (10.5%), and TNFRSF14 (10.5%), involving RTK/RAS (44.3%), TP53 (41.8%), and PI3K (20.2%) pathways. Single-gene mutations did not predict treatment benefit. However, pathway-level analysis identified PI3K pathway activation as significantly associated with inferior PFS (HR 2.148; 95% CI 1.478–3.124) and OS (HR 2.096; 95% CI 1.413–3.109) in patients receiving GAP, an effect not observed with GC. Importantly, GAP conferred clinical benefit only in patients without PI3K pathway activation, while no survival advantage was seen in those with such alterations (Pinteraction=0.023 for PFS, Pinteraction=0.003 for OS). Similar results were obtained in the independent validation cohort treated with GAP (N=103) or GC (N=64) for BTC.
Conclusions
Genomic profiling using next-generation sequencing identified PI3K pathway activation as key molecular determinant that differentiates patient outcomes between GAP and GC treatments in advanced BTC.
5.Donor-to-recipient sex match status has no prognostic effect on long-term survival following liver transplantation:a retrospective observational study
Woo-Hyoung KANG ; I-Ji JEONG ; Shin HWANG ; Chul-Soo AHN ; Deok-Bog MOON ; Tae-Yong HA ; Gi-Won SONG ; Dong-Hwan JUNG ; Gil-Chun PARK ; Young-In YOON ; Sung-Gyu LEE
Clinical Transplantation and Research 2026;40(1):76-86
Background:
Studies on whether donor-to-recipient sex match status affects long-term survival after liver transplantation (LT) have yielded contradictory results. This study evaluated whether donor-to-recipient sex match status influenced long-term survival after living donor liver transplantation (LDLT) or deceased donor liver transplantation (DDLT) at a high-volume center.
Methods:
The study included 6,664 patients who underwent primary LT between January 2000 and December 2022 at our institution. Patients were divided into four groups according to donor-to-recipient sex match status: male-to-male (n=3,427 [51.4%]), male-to-female (n=1,152 [17.3%]), female-to-male (n=1,385 [20.8%]), and female-to-female (n=700 [10.5%]).
Results:
Regarding clinical characteristics, the four groups differed significantly regarding background liver disease (P<0.001), model for end-stage liver disease score (P<0.001), serum protein induced by vitamin K absence or antagonist II level (P=0.003), presence of concurrent hepatocellular carcinoma (HCC; P<0.001), and type of LT (P=0.003). Overall survival (OS) of all LT recipients did not differ significantly among the groups (P=0.377). Donor-to-recipient sex match status did not affect long-term OS in either LDLT (P=0.176) or DDLT (P=0.220) groups. In addition, sex match status did not significantly influence posttransplant OS among patients who underwent LDLT without HCC (P=0.464), LDLT with HCC (P=0.236), DDLT without HCC (P=0.338), or DDLT with HCC (P=0.818).
Conclusions
Donor-to-recipient sex match status does not significantly affect posttransplant patient survival or HCC prognosis after LDLT or DDLT.
6.Is There a Potential Oncologic Role for Local Therapy on Hepatic Metastasis in Patients Who Undergo Curative Pancreatectomy for Pancreatic Cancer?
Jun Hyung KIM ; Seung Soo HONG ; Sung Hyun KIM ; Ho Kyung HWANG ; Chang Moo KANG
Yonsei Medical Journal 2025;66(6):329-336
Purpose:
In pancreatic cancer, therapeutic investigations targeting liver metastases could improve survival. However, the use of local treatment for oligometastasis in pancreatic cancer remains controversial. This study aimed to investigate the oncological role of local therapy in patients who underwent curative pancreatectomy and subsequently developed liver metastases.
Materials and Methods:
Data concerning patients who underwent curative pancreatectomy for pancreatic cancer at Severance Hospital in Seoul, South Korea between 2006 and 2018 were retrospectively reviewed. We included patients with one or two liver metastases, as confirmed on imaging. We excluded those with metastases in other organs. The patients were divided into two groups: the NT group, receiving conventional therapy without local treatment; and the LT group, receiving local treatments for liver metastases alongside standard therapy.
Results:
Of the 43 included patients (NT group, n=33; LT group, n=10), no significant differences were observed in overall survival (OS) [hazard ratio (HR) 0.846; 95% confidence interval (CI) 0.397–1.804; p=0.665] or post-recurrence survival (HR 0.932; 95% CI 0.437–1.985, p=0.855) between the two groups. In multivariate analysis, early recurrence within 6 months (p<0.001) and the use of 5-fluorouracil (FU)-based adjuvant chemotherapy (CTx) (p=0.011), as well as 5-FU-based CTx after liver metastasis (p=0.008) when compared with gemcitabine-based regimens, were significant predictors of poor OS.
Conclusion
The oncologic role of local treatment for hepatic metastasis remains controversial in patients with hepatic metastasis after radical pancreatectomy. In the era of potent chemotherapeutic regimens, further research is needed to clarify the efficacy of such regimens.
7.Early Administration of Nelonemdaz May Improve the Stroke Outcomes in Patients With Acute Stroke
Jin Soo LEE ; Ji Sung LEE ; Seong Hwan AHN ; Hyun Goo KANG ; Tae-Jin SONG ; Dong-Ick SHIN ; Hee-Joon BAE ; Chang Hun KIM ; Sung Hyuk HEO ; Jae-Kwan CHA ; Yeong Bae LEE ; Eung Gyu KIM ; Man Seok PARK ; Hee-Kwon PARK ; Jinkwon KIM ; Sungwook YU ; Heejung MO ; Sung Il SOHN ; Jee Hyun KWON ; Jae Guk KIM ; Young Seo KIM ; Jay Chol CHOI ; Yang-Ha HWANG ; Keun Hwa JUNG ; Soo-Kyoung KIM ; Woo Keun SEO ; Jung Hwa SEO ; Joonsang YOO ; Jun Young CHANG ; Mooseok PARK ; Kyu Sun YUM ; Chun San AN ; Byoung Joo GWAG ; Dennis W. CHOI ; Ji Man HONG ; Sun U. KWON ;
Journal of Stroke 2025;27(2):279-283
8.Complete or incomplete revascularization in patients with left main culprit lesion acute myocardial infarction with multivessel disease: a retrospective observational study
Sun Oh KIM ; Hong-Ju KIM ; Jong-Il PARK ; Kang-Un CHOI ; Jong-Ho NAM ; Chan-Hee LEE ; Jang-Won SON ; Jong-Seon PARK ; Sung-Ho HER ; Ki-Yuk CHANG ; Tae-Hoon AHN ; Myung-Ho JEONG ; Seung-Woon RHA ; Hyo-Soo KIM ; Hyeon-Cheol GWON ; In-Whan SEONG ; Kyung-Kuk HWANG ; Seung-Ho HUR ; Kwang-Soo CHA ; Seok-Kyu OH ; Jei-Keon CHAE ; Ung KIM
Journal of Yeungnam Medical Science 2025;42(1):18-
Background:
Complete revascularization has demonstrated better outcomes in patients with acute myocardial infarction (AMI) and multivessel disease. However, in the case of left main (LM) culprit lesion AMI with multivessel disease, there is limited evidence to suggest that complete revascularization is better.
Methods:
We reviewed 16,831 patients in the Korea Acute Myocardial Infarction Registry who were treated from July 2016 to June 2020, and 399 patients were enrolled with LM culprit lesion AMI treated with percutaneous coronary intervention. We categorized the patients as those treated with complete revascularization (n=295) or incomplete revascularization (n=104). The study endpoint was major adverse cardiac and cerebrovascular events (MACCE), a composite of all-cause death, myocardial infarction, ischemia-driven revascularization, stent thrombosis, and stroke. We performed propensity score matching (PSM) and analyzed the incidence of MACCE at 1 year.
Results:
After PSM, the two groups were well balanced. There was no significant difference between the two groups in MACCE at 1 year (12.1% vs. 15.2%; hazard ratio, 1.28; 95% confidence interval, 0.60–2.74; p=0.524) after PSM. The components of MACCE and major bleeding were also not significantly different.
Conclusion
There was no significant difference in clinical outcomes between the groups treated with complete or incomplete revascularization for LM culprit lesion AMI with multivessel disease.
9.Cost-effectiveness of Fractional Flow Reserve Versus Intravascular Ultrasound to Guide Percutaneous Coronary Intervention: Results From the FLAVOUR Study
Doyeon HWANG ; Hea-Lim KIM ; Jane KO ; HyunJin CHOI ; Hanna JEONG ; Sun-ae JANG ; Xinyang HU ; Jeehoon KANG ; Jinlong ZHANG ; Jun JIANG ; Joo-Yong HAHN ; Chang-Wook NAM ; Joon-Hyung DOH ; Bong-Ki LEE ; Weon KIM ; Jinyu HUANG ; Fan JIANG ; Hao ZHOU ; Peng CHEN ; Lijiang TANG ; Wenbing JIANG ; Xiaomin CHEN ; Wenming HE ; Sung Gyun AHN ; Ung KIM ; You-Jeong KI ; Eun-Seok SHIN ; Hyo-Soo KIM ; Seung-Jea TAHK ; JianAn WANG ; Tae-Jin LEE ; Bon-Kwon KOO ;
Korean Circulation Journal 2025;55(1):34-46
Background and Objectives:
The Fractional Flow Reserve and Intravascular UltrasoundGuided Intervention Strategy for Clinical Outcomes in Patients with Intermediate Stenosis (FLAVOUR) trial demonstrated non-inferiority of fractional flow reserve (FFR)-guided percutaneous coronary intervention (PCI) compared with intravascular ultrasound (IVUS)-guided PCI. We sought to investigate the cost-effectiveness of FFR-guided PCI compared to IVUS-guided PCI in Korea.
Methods:
A 2-part cost-effectiveness model, composed of a short-term decision tree model and a long-term Markov model, was developed for patients who underwent PCI to treat intermediate stenosis (40% to 70% stenosis by visual estimation on coronary angiography).The lifetime healthcare costs and quality-adjusted life-years (QALYs) were estimated from the healthcare system perspective. Transition probabilities were mainly referred from the FLAVOUR trial, and healthcare costs were mainly obtained through analysis of Korean National Health Insurance claims data. Health utilities were mainly obtained from the Seattle Angina Questionnaire responses of FLAVOUR trial participants mapped to EQ-5D.
Results:
From the Korean healthcare system perspective, the base-case analysis showed that FFR-guided PCI was 2,451 U.S. dollar lower in lifetime healthcare costs and 0.178 higher in QALYs compared to IVUS-guided PCI. FFR-guided PCI remained more likely to be cost-effective over a wide range of willingness-to-pay thresholds in the probabilistic sensitivity analysis.
Conclusions
Based on the results from the FLAVOUR trial, FFR-guided PCI is projected to decrease lifetime healthcare costs and increase QALYs compared with IVUS-guided PCI in intermediate coronary lesion, and it is a dominant strategy in Korea.
10.The KAPARD guidelines for atopic dermatitis in children and adolescents:Part II. Systemic treatment, novel therapeutics, and adjuvant therapy
Hwan Soo KIM ; Eun LEE ; Kyunghoon KIM ; Taek Ki MIN ; Dong In SUH ; Yoon Ha HWANG ; Sungsu JUNG ; Minyoung JUNG ; Young A PARK ; Minji KIM ; In Suk SOL ; You Hoon JEON ; Sung-Il WOO ; Yong Ju LEE ; Jong Deok KIM ; Hyeon-Jong YANG ; Gwang Cheon JANG ;
Allergy, Asthma & Respiratory Disease 2025;13(1):3-11
Atopic dermatitis is the most common chronic inflammatory skin disease in children and adolescents. The Korean Academy of Pediatric Allergy and Respiratory Disease published the Atopic Dermatitis Treatment Guideline in 2008, which has been helpful in atopic dermatitis treatment until now. Various reports on the development and effectiveness of new drugs have suggested that there is a need to develop and revise old treatment guidelines. Part 1 aimed to provide evidence-based recommendations for skin care management and topical treatment for atopic dermatitis. Part 2 focuses on systemic treatment, novel therapeutics, and adjuvant therapy. The goal of this guideline is intended to assist front-line doctors treating pediatric and adolescent atopic dermatitis patients make safer, more effective, and more rational decisions regarding systemic treatment, novel therapeutics, and adjuvant therapy by providing evidence-based recommendations with a clear level of evidence and benefit regarding treatment.

Result Analysis
Print
Save
E-mail