1.Key Measures for Evaluating Diagnostic Accuracy in Multi-Class Classification: An Overview and Simulation-Based Comparison
Leeha RYU ; Kyunghwa HAN ; Inkyung JUNG ; Yae Won PARK ; Sung Soo AHN ; Dosik HWANG
Korean Journal of Radiology 2026;27(4):344-355
Recent advancements in artificial intelligence have led to increased interest in predictive modeling across various domains, including medicine. Although numerous metrics have been established for binary classification, the growing adoption of multi-class systems necessitates robust evaluation measures. However, comprehensive simulation studies comparing the performance of existing multi-class metrics under diverse data conditions remain limited. In this study, we first provide a concise overview of commonly used accuracy metrics for multi-class classification. Then, we report a simulation study that systematically evaluates several diagnostic accuracy measures under a wide range of scenarios, including three- and five-class settings, balanced and imbalanced sample sizes, and different distributional assumptions for predictors. We assessed each metric’s performance in terms of bias and 95% confidence interval coverage. Under balanced conditions, most metrics demonstrated stable and unbiased performance, closely approximating the true values. However, under imbalanced conditions, greater bias was observed, with the M-index and polytomous discrimination index exhibiting comparatively more stable performance across various scenarios. The micro-averaged receiver operating characteristic curve area consistently showed higher bias under class imbalance. Finally, we applied these metrics to a glioma tumor grading task using external datasets. This study provides a systematic comparison of commonly used metrics and offers practical guidance for selecting appropriate measures in multi-class classification tasks.
2.AFP-PIVKA-II score as a simplified quantifiable surrogate biomarker for hepatocellular carcinoma recurrence following living donor liver transplantation
Dae Hyeon WON ; Shin HWANG ; Chul-Soo AHN ; Deok-Bog MOON ; Tae-Yong HA ; Gi-Won SONG ; Dong-Hwan JUNG ; Gil-Chun PARK ; Woo-Hyoung KANG ; Young-In YOON ; Sung-Gyu LEE
Annals of Liver Transplantation 2026;6(1):25-32
Background:
We developed a simplified variant of the ADV score, the AFP-PIVKAII (AP) score for post-transplant hepatocellular carcinoma (HCC) prognosis, which considers only AFP and PIVKA-II levels excluding morphometric tumor size information from the ADV score. This study investigated the prognostic performance of the AP score in predicting HCC recurrence and overall survival (OS) after living donor liver transplantation (LDLT).
Methods:
We analyzed 843 patients with HCC who underwent LDLT between 2006 and 2015, assessing HCC recurrence and OS in relation to AP score.
Results:
The median pretransplant AFP and PIVKA-II levels were 12.8 ng/mL and 27 mAU/mL, respectively. The median and mean AP scores were 2.6 log (range: 0.6–9.2 log) and 2.9±1.1 log, respectively. The 5-year time-dependent area under the receiver operating characteristic curve for the AP score in predicting post-transplant HCC recurrence was 0.672 (p<0.001). HCC recurrence and OS curves along AP score intervals of 1.0 log showed statistical differences in accordance with the AP scores (both p<0.001). Using a Youden index J-derived AP score cutoff of 4.0 log, two-tiered groups (ADV <4.0 log vs. ADV ≥4.0 log) showed statistically significant differences in HCC recurrence and OS (both p<0.001). Harrell’s c-indices for AP score with cutoff of 4.0 log and ADV scores with cutoff of 5.0 log regarding HCC recurrence and OS were similar.
Conclusion
The AP score functions as an integrated surrogate marker for predicting post-transplant outcomes in patients with HCC undergoing LDLT. It may serve as a simplified alternative to the ADV score, particularly in patients with small HCCs.
3.Development of an artificial intelligence-based prediction platform for early recurrence of resectable pancreatic cancer after curative surgery–toward future use as an indication for neoadjuvant treatment: a retrospective multicenter cohort study
So Jeong YOON ; Sung Hyun KIM ; Hongbeom KIM ; Sang Hyun SHIN ; Jin Seok HEO ; Seung Soo HONG ; Chang Moo KANG ; Kyung Sik KIM ; Ho Kyoung HWANG ; In Woong HAN
Annals of Surgical Treatment and Research 2026;110(2):76-83
Purpose:
Neoadjuvant treatment (NAT) is now the standard for borderline resectable pancreatic cancer (RPC) and is being considered for RPC. Early recurrence after curative surgery in RPC is often seen as a treatment failure, prompting considerations for NAT. Our goal was to develop an artificial intelligence (AI)-based predictive model utilizing preoperatively available factors to forecast early recurrences of resected RPC.
Methods:
This study included 469 patients who underwent surgery for RPC between 2011 and 2019. Clinicopathologic and oncologic data were retrospectively reviewed. Preoperative variables, including laboratory data and imaging findings, were collected. Early recurrence was defined as recurrence occurring within a year after surgery. Deep neural networks were then used to select variables by assessing their importance. A new model predicting early recurrence of RPC was subsequently developed.
Results:
Of the patients evaluated, 199 (42.4%) experienced early recurrence. The predictive model included 14 preoperative variables: CA 19-9, preoperative pancreatitis, serum albumin, platelet count, lymphocyte count, the American Society of Anesthesiologists physical status classification, tumor size, monocyte count, age, body mass index, CRP, hemoglobin, WBC count, and CEA. The area under the curve for the model was 0.786 in the training set and 0.734 in the test set.
Conclusion
We developed an AI-based model to predict the early recurrence of RPC using preoperative parameters. By identifying patients at risk of early recurrence, optimal individualized treatments such as NAT can be considered. Future prospective studies are crucial to establish clear indications for NAT in RPC.
4.Molecular determinants of outcome to gemcitabine, cisplatin, and nab-paclitaxel in patients with advanced biliary tract cancer
Daeseong KIM ; Nam Suk SIM ; Seonjeong WOO ; Min Hwan KIM ; Choong-kun LEE ; Seung Soo HONG ; Sung Hyun KIM ; Ho Kyoung HWANG ; Chang Moo KANG ; Woo Jung LEE ; Jung Hyun JO ; Taek CHUNG ; Sohyun HWANG ; Beodeul KANG ; Jung Sun KIM ; Chang-Il KWON ; Sangwoo KIM ; Hong Jae CHON ; Chang Gon KIM ; Young Nyun PARK ; Hye Jin CHOI
Clinical and Molecular Hepatology 2026;32(2):721-736
Background/Aims:
Biliary tract cancer (BTC) is a rare malignancy with poor prognosis. We investigated genomic determinants of clinical benefit from gemcitabine, cisplatin, and nab-paclitaxel (GAP) versus gemcitabine and cisplatin (GC) in advanced BTC.
Methods:
Clinical and genomic data using TruSight Oncology 500 were analyzed from patients treated with GAP (N=198) or GC (N=89) as first-line therapy.
Results:
With a median follow-up of 33.0 months, GAP modestly improved progression-free survival (PFS) (hazard ratio [HR] 0.764; 95% confidence interval [CI] 0.591–0.989) without significant overall survival (OS) difference compared to GC. Genomic profiling revealed frequent alterations in TP53 (35.2%), KRAS (16.4%), SMAD4 (10.5%), and TNFRSF14 (10.5%), involving RTK/RAS (44.3%), TP53 (41.8%), and PI3K (20.2%) pathways. Single-gene mutations did not predict treatment benefit. However, pathway-level analysis identified PI3K pathway activation as significantly associated with inferior PFS (HR 2.148; 95% CI 1.478–3.124) and OS (HR 2.096; 95% CI 1.413–3.109) in patients receiving GAP, an effect not observed with GC. Importantly, GAP conferred clinical benefit only in patients without PI3K pathway activation, while no survival advantage was seen in those with such alterations (Pinteraction=0.023 for PFS, Pinteraction=0.003 for OS). Similar results were obtained in the independent validation cohort treated with GAP (N=103) or GC (N=64) for BTC.
Conclusions
Genomic profiling using next-generation sequencing identified PI3K pathway activation as key molecular determinant that differentiates patient outcomes between GAP and GC treatments in advanced BTC.
5.Donor-to-recipient sex match status has no prognostic effect on long-term survival following liver transplantation:a retrospective observational study
Woo-Hyoung KANG ; I-Ji JEONG ; Shin HWANG ; Chul-Soo AHN ; Deok-Bog MOON ; Tae-Yong HA ; Gi-Won SONG ; Dong-Hwan JUNG ; Gil-Chun PARK ; Young-In YOON ; Sung-Gyu LEE
Clinical Transplantation and Research 2026;40(1):76-86
Background:
Studies on whether donor-to-recipient sex match status affects long-term survival after liver transplantation (LT) have yielded contradictory results. This study evaluated whether donor-to-recipient sex match status influenced long-term survival after living donor liver transplantation (LDLT) or deceased donor liver transplantation (DDLT) at a high-volume center.
Methods:
The study included 6,664 patients who underwent primary LT between January 2000 and December 2022 at our institution. Patients were divided into four groups according to donor-to-recipient sex match status: male-to-male (n=3,427 [51.4%]), male-to-female (n=1,152 [17.3%]), female-to-male (n=1,385 [20.8%]), and female-to-female (n=700 [10.5%]).
Results:
Regarding clinical characteristics, the four groups differed significantly regarding background liver disease (P<0.001), model for end-stage liver disease score (P<0.001), serum protein induced by vitamin K absence or antagonist II level (P=0.003), presence of concurrent hepatocellular carcinoma (HCC; P<0.001), and type of LT (P=0.003). Overall survival (OS) of all LT recipients did not differ significantly among the groups (P=0.377). Donor-to-recipient sex match status did not affect long-term OS in either LDLT (P=0.176) or DDLT (P=0.220) groups. In addition, sex match status did not significantly influence posttransplant OS among patients who underwent LDLT without HCC (P=0.464), LDLT with HCC (P=0.236), DDLT without HCC (P=0.338), or DDLT with HCC (P=0.818).
Conclusions
Donor-to-recipient sex match status does not significantly affect posttransplant patient survival or HCC prognosis after LDLT or DDLT.
6.Is There a Potential Oncologic Role for Local Therapy on Hepatic Metastasis in Patients Who Undergo Curative Pancreatectomy for Pancreatic Cancer?
Jun Hyung KIM ; Seung Soo HONG ; Sung Hyun KIM ; Ho Kyung HWANG ; Chang Moo KANG
Yonsei Medical Journal 2025;66(6):329-336
Purpose:
In pancreatic cancer, therapeutic investigations targeting liver metastases could improve survival. However, the use of local treatment for oligometastasis in pancreatic cancer remains controversial. This study aimed to investigate the oncological role of local therapy in patients who underwent curative pancreatectomy and subsequently developed liver metastases.
Materials and Methods:
Data concerning patients who underwent curative pancreatectomy for pancreatic cancer at Severance Hospital in Seoul, South Korea between 2006 and 2018 were retrospectively reviewed. We included patients with one or two liver metastases, as confirmed on imaging. We excluded those with metastases in other organs. The patients were divided into two groups: the NT group, receiving conventional therapy without local treatment; and the LT group, receiving local treatments for liver metastases alongside standard therapy.
Results:
Of the 43 included patients (NT group, n=33; LT group, n=10), no significant differences were observed in overall survival (OS) [hazard ratio (HR) 0.846; 95% confidence interval (CI) 0.397–1.804; p=0.665] or post-recurrence survival (HR 0.932; 95% CI 0.437–1.985, p=0.855) between the two groups. In multivariate analysis, early recurrence within 6 months (p<0.001) and the use of 5-fluorouracil (FU)-based adjuvant chemotherapy (CTx) (p=0.011), as well as 5-FU-based CTx after liver metastasis (p=0.008) when compared with gemcitabine-based regimens, were significant predictors of poor OS.
Conclusion
The oncologic role of local treatment for hepatic metastasis remains controversial in patients with hepatic metastasis after radical pancreatectomy. In the era of potent chemotherapeutic regimens, further research is needed to clarify the efficacy of such regimens.
7.Is There a Potential Oncologic Role for Local Therapy on Hepatic Metastasis in Patients Who Undergo Curative Pancreatectomy for Pancreatic Cancer?
Jun Hyung KIM ; Seung Soo HONG ; Sung Hyun KIM ; Ho Kyung HWANG ; Chang Moo KANG
Yonsei Medical Journal 2025;66(6):329-336
Purpose:
In pancreatic cancer, therapeutic investigations targeting liver metastases could improve survival. However, the use of local treatment for oligometastasis in pancreatic cancer remains controversial. This study aimed to investigate the oncological role of local therapy in patients who underwent curative pancreatectomy and subsequently developed liver metastases.
Materials and Methods:
Data concerning patients who underwent curative pancreatectomy for pancreatic cancer at Severance Hospital in Seoul, South Korea between 2006 and 2018 were retrospectively reviewed. We included patients with one or two liver metastases, as confirmed on imaging. We excluded those with metastases in other organs. The patients were divided into two groups: the NT group, receiving conventional therapy without local treatment; and the LT group, receiving local treatments for liver metastases alongside standard therapy.
Results:
Of the 43 included patients (NT group, n=33; LT group, n=10), no significant differences were observed in overall survival (OS) [hazard ratio (HR) 0.846; 95% confidence interval (CI) 0.397–1.804; p=0.665] or post-recurrence survival (HR 0.932; 95% CI 0.437–1.985, p=0.855) between the two groups. In multivariate analysis, early recurrence within 6 months (p<0.001) and the use of 5-fluorouracil (FU)-based adjuvant chemotherapy (CTx) (p=0.011), as well as 5-FU-based CTx after liver metastasis (p=0.008) when compared with gemcitabine-based regimens, were significant predictors of poor OS.
Conclusion
The oncologic role of local treatment for hepatic metastasis remains controversial in patients with hepatic metastasis after radical pancreatectomy. In the era of potent chemotherapeutic regimens, further research is needed to clarify the efficacy of such regimens.
8.The KAPARD guidelines for atopic dermatitis in children and adolescents:Part II. Systemic treatment, novel therapeutics, and adjuvant therapy
Hwan Soo KIM ; Eun LEE ; Kyunghoon KIM ; Taek Ki MIN ; Dong In SUH ; Yoon Ha HWANG ; Sungsu JUNG ; Minyoung JUNG ; Young A PARK ; Minji KIM ; In Suk SOL ; You Hoon JEON ; Sung-Il WOO ; Yong Ju LEE ; Jong Deok KIM ; Hyeon-Jong YANG ; Gwang Cheon JANG ;
Allergy, Asthma & Respiratory Disease 2025;13(1):3-11
Atopic dermatitis is the most common chronic inflammatory skin disease in children and adolescents. The Korean Academy of Pediatric Allergy and Respiratory Disease published the Atopic Dermatitis Treatment Guideline in 2008, which has been helpful in atopic dermatitis treatment until now. Various reports on the development and effectiveness of new drugs have suggested that there is a need to develop and revise old treatment guidelines. Part 1 aimed to provide evidence-based recommendations for skin care management and topical treatment for atopic dermatitis. Part 2 focuses on systemic treatment, novel therapeutics, and adjuvant therapy. The goal of this guideline is intended to assist front-line doctors treating pediatric and adolescent atopic dermatitis patients make safer, more effective, and more rational decisions regarding systemic treatment, novel therapeutics, and adjuvant therapy by providing evidence-based recommendations with a clear level of evidence and benefit regarding treatment.
9.A comprehensive study on postoperative complications and postoperative pancreatic fistula in sporadic non-functional pancreatic neuroendocrine tumors:A retrospective cohort study
Juwan KIM ; Seung Soo HONG ; Sung Hyun KIM ; Ho Kyoung HWANG ; Chang Moo KANG
Annals of Hepato-Biliary-Pancreatic Surgery 2025;29(2):168-176
Background:
s/Aims: Balancing surgical risks and benefits is crucial for managing non-functional pancreatic neuroendocrine tumors (NF-PNETs). Despite high postoperative pancreatic fistula (POPF) rates, studies on postoperative complications of sporadic NFPNETs are scarce. Thus, this study aimed to investigate postoperative complications and identify risk factors for POPF.
Methods:
A retrospective review of 166 NF-PNET surgeries performed at Severance Hospital between February 2000 and August 2023 was conducted.
Results:
Age > 65 years and higher American Society of Anesthesiology (ASA) grade were not significantly correlated with severe complications (odds ratio [OR]: 1.10, p = 0.871 and OR: 1.47, p = 0.491, respectively). Surgical procedures included enucleation (13.9%), distal pancreatectomy (50.0%), central pancreatectomy (4.8%), pancreaticoduodenectomy (PD) (26.5%), and total pancreatectomy (4.8%). Severe complications occurred in 12.05% of surgeries. The overall incidence of all POPFs including biochemical leaks was 53%, while clinically relevant POPF (grade B or C) occurred in 7.8% of patients. Logistic regression showed that PD (OR: 3.94, p = 0.092) tended to be risk factor for POPF and that diameter of the main pancreatic duct (MPD) ≤ 3 mm was a significant risk factor for POPF (OR: 0.22, p = 0.008). A pancreas thickness (PT)/MPD ratio > 4.47 on preoperative computed tomography predicted all POPFs in PD patients (OR: 11.70, p = 0.001).
Conclusions
Age and comorbidities had no significant impact on surgical outcomes. PD was associated with higher serious complications and POPF rates. The PT/MPD ratio is a valuable preoperative tool for predicting POPF risk in PD patients.
10.Is There a Potential Oncologic Role for Local Therapy on Hepatic Metastasis in Patients Who Undergo Curative Pancreatectomy for Pancreatic Cancer?
Jun Hyung KIM ; Seung Soo HONG ; Sung Hyun KIM ; Ho Kyung HWANG ; Chang Moo KANG
Yonsei Medical Journal 2025;66(6):329-336
Purpose:
In pancreatic cancer, therapeutic investigations targeting liver metastases could improve survival. However, the use of local treatment for oligometastasis in pancreatic cancer remains controversial. This study aimed to investigate the oncological role of local therapy in patients who underwent curative pancreatectomy and subsequently developed liver metastases.
Materials and Methods:
Data concerning patients who underwent curative pancreatectomy for pancreatic cancer at Severance Hospital in Seoul, South Korea between 2006 and 2018 were retrospectively reviewed. We included patients with one or two liver metastases, as confirmed on imaging. We excluded those with metastases in other organs. The patients were divided into two groups: the NT group, receiving conventional therapy without local treatment; and the LT group, receiving local treatments for liver metastases alongside standard therapy.
Results:
Of the 43 included patients (NT group, n=33; LT group, n=10), no significant differences were observed in overall survival (OS) [hazard ratio (HR) 0.846; 95% confidence interval (CI) 0.397–1.804; p=0.665] or post-recurrence survival (HR 0.932; 95% CI 0.437–1.985, p=0.855) between the two groups. In multivariate analysis, early recurrence within 6 months (p<0.001) and the use of 5-fluorouracil (FU)-based adjuvant chemotherapy (CTx) (p=0.011), as well as 5-FU-based CTx after liver metastasis (p=0.008) when compared with gemcitabine-based regimens, were significant predictors of poor OS.
Conclusion
The oncologic role of local treatment for hepatic metastasis remains controversial in patients with hepatic metastasis after radical pancreatectomy. In the era of potent chemotherapeutic regimens, further research is needed to clarify the efficacy of such regimens.

Result Analysis
Print
Save
E-mail