1.Key Measures for Evaluating Diagnostic Accuracy in Multi-Class Classification: An Overview and Simulation-Based Comparison
Leeha RYU ; Kyunghwa HAN ; Inkyung JUNG ; Yae Won PARK ; Sung Soo AHN ; Dosik HWANG
Korean Journal of Radiology 2026;27(4):344-355
Recent advancements in artificial intelligence have led to increased interest in predictive modeling across various domains, including medicine. Although numerous metrics have been established for binary classification, the growing adoption of multi-class systems necessitates robust evaluation measures. However, comprehensive simulation studies comparing the performance of existing multi-class metrics under diverse data conditions remain limited. In this study, we first provide a concise overview of commonly used accuracy metrics for multi-class classification. Then, we report a simulation study that systematically evaluates several diagnostic accuracy measures under a wide range of scenarios, including three- and five-class settings, balanced and imbalanced sample sizes, and different distributional assumptions for predictors. We assessed each metric’s performance in terms of bias and 95% confidence interval coverage. Under balanced conditions, most metrics demonstrated stable and unbiased performance, closely approximating the true values. However, under imbalanced conditions, greater bias was observed, with the M-index and polytomous discrimination index exhibiting comparatively more stable performance across various scenarios. The micro-averaged receiver operating characteristic curve area consistently showed higher bias under class imbalance. Finally, we applied these metrics to a glioma tumor grading task using external datasets. This study provides a systematic comparison of commonly used metrics and offers practical guidance for selecting appropriate measures in multi-class classification tasks.
2.Relationship between hand grip strength and lung function among older adults in Korea: Secondary analysis of the Korea National Health and Nutrition Examination Survey
Inkyung PARK ; Minjae LEE ; Kahyun KIM
Journal of Korean Gerontological Nursing 2025;27(3):285-294
South Korea is rapidly aging, with older adult care costs soaring and lung diseases prevalent among the older adults. The correlation between hand grip strength (HGS) and lung function is contested, demanding further research to assess its viability as a predictor of lung health in this growing demographic. In this study, explored the relationship between HGS and lung function. Methods: In this cross-sectional study, of 32,379 participants, we selected 3,362 aged 65 years or older, after exclusions. We assessed lung function through forced vital capacity (FVC) and forced expiratory volume (FEV1) measurements, and gauged HGS using a digital dynamometer. The analysis accounted for various covariates including medical history, lifestyle factors, and socioeconomic status, using complex sample analysis in SPSS. Results: Analysis of 3,362 participants revealed that, after adjusting for relevant covariates, HGS retained a statistically significant correlation with FVC and FEV1, with regression coefficients of 0.03 and 0.02, respectively. These findings indicate that HGS may serve as a reliable indicator of respiratory health in an aging population. Conclusion: Findings showed HGS independently aligned with FVC and FEV1, requiring a significant post-adjustment for confounders. Consistent with prior studies, results suggest HGS could indicate respiratory health in older adults. Despite divergent outcomes from earlier research, a persistent link between HGS and lung function underscores its value in geriatric screenings for early lung-decline detection.
3.Risk Factors of Postpartum Depression Among Korean Women:An Analysis Based on the Korean Pregnancy Outcome Study (KPOS)
So Hyun SHIM ; Su Young LEE ; Inkyung JUNG ; Seok-Jae HEO ; You Jung HAN ; Dong Wook KWAK ; Min Hyoung KIM ; Hee Jin PARK ; Jin Hoon CHUNG ; Ji Hyae LIM ; Moon Young KIM ; Dong Hyun CHA ; Sung Shin SHIM ; Hee Young CHO ; Hyun Mee RYU
Journal of Korean Medical Science 2024;39(3):e31-
Background:
Postpartum depression (PPD) can negatively affect infant well-being and child development. Although the frequency and risk factors of PPD symptoms might vary depending on the country and culture, there is limited research on these risk factors among Korean women. This study aimed to elucidate the potential risk factors of PPD throughout pregnancy to help improve PPD screening and prevention in Korean women.
Methods:
The pregnant women at 12 gestational weeks (GW) were enrolled from two obstetric specialized hospitals from March 2013 to November 2017. A questionnaire survey was administered at 12 GW, 24 GW, 36 GW, and 4 weeks postpartum. Depressive symptoms were assessed using the Edinburgh Postnatal Depression Scale, and PPD was defined as a score of ≥ 10.
Results:
PPD was prevalent in 16.3% (410/2,512) of the participants. Depressive feeling at 12 GW and postpartum factors of stress, relationship with children, depressive feeling, fear, sadness, and neonatal intensive care unit admission of baby were significantly associated with a higher risk of PPD. Meanwhile, high postpartum quality of life and marital satisfaction at postpartum period were significantly associated with a lower risk of PPD. We developed a model for predicting PPD using factors as mentioned above and it had an area under the curve of 0.871.
Conclusion
Depressive feeling at 12 GW and postpartum stress, fear, sadness, relationship with children, low quality of life, and low marital satisfaction increased the risk of PPD. A risk model that comprises significant factors can effectively predict PPD and can be helpful for its prevention and appropriate treatment.
4.Consumption of poly-γ-glutamate-vitamin B6 supplement and urinary microbiota profiles in Korean healthy adults: a randomized, double-blinded, placebo-controlled intervention study
Nutrition Research and Practice 2024;18(5):663-673
BACKGROUND/OBJECTIVES:
Poly-γ-glutamic acid (γ-PGA), a natural polymer found in fermented soybean products, has been reported to play a prebiotic role in the gut. This intervention study investigated the effects of γ-PGA-containing supplement consumption on urinary microbiota in healthy adults because of limited data on such investigation.
SUBJECTS/METHODS:
A 4-week parallel trial including 39 male and female Korean adults, who were free of chronic diseases and infection, was designed as a randomized, doubleblinded, placebo-controlled study. A total of 30 participants completed the study wherein the intervention group (n = 17) received a mixture supplement containing 600 mg/day of γ-PGA and 100 mg/day of vitamin B6, while the control group (n = 13) received a placebo.Paired datasets (baseline and endpoint data) of microbiota profiles, which were constructed via urinary assays of microbe-derived extracellular vesicles, were analyzed and compared between the two groups.
RESULTS:
Only the intervention group yielded significant results for the Bray-Curtis and Jaccard dissimilarity indices between baseline and endpoint data (P < 0.05). In the phylumlevel analysis of microbial composition, the Firmicutes to Bacteroidetes ratio (FB ratio) tended to decrease from baseline in the intervention group; however, it increased in the control group.Differences between the baseline and endpoint FB ratios were significant between the two groups (P < 0.05).
CONCLUSION
This study’s findings suggest that γ-PGA-vitamin B6 supplementation potentially alters the microbial community composition of a host. Further investigation into the biological consequences of commensal microbiota alteration by γ-PGA-containing supplement consumption is warranted.
5.Remodeling of Epidural Fluid Hematoma after Uniportal Lumbar Endoscopic Unilateral Laminotomy with Bilateral Decompression: Comparative Clinical and Radiological Outcomes with a Minimum Follow-up of 2 Years
Pang Hung WU ; Hyeun Sung KIM ; Giovanni GRASSO ; Jin Woo AN ; Myeonghun KIM ; Inkyung LEE ; Jong Seon PARK ; Jun Hyoung LEE ; Sangsoo KANG ; Jeongshik LEE ; Yeonjin YI ; Jun Hyung LEE ; Jun Hwan PARK ; Jae Hyeon LIM ; Il-Tae JANG
Asian Spine Journal 2023;17(1):118-129
Methods:
Magnetic resonance imaging (MRI) and clinical evaluation were performed for patients with single-level uniportal endoscopic lumbar decompression with a minimum follow-up of 2 years.
Results:
A total of 126 patients were recruited with a minimum follow-up of 26 months. The incidence of epidural fluid hematoma was 27%. Postoperative MRI revealed a significant improvement in the postoperative dura sac area at postoperative day 1 and at the upper endplate at 6 months in the hematoma cohort (39.69±15.72 and 26.89±16.58 mm2) as compared with the nonhematoma cohort (48.92±21.36 and 35.1±20.44 mm2), respectively (p <0.05); and at the lower endplate on postoperative 1 day in the hematoma cohort (51.18±24.69 mm2) compared to the nonhematoma cohort (63.91±27.92 mm2) (p <0.05). No significant difference was observed in the dura sac area at postoperative 1 year in both cohorts. The hematoma cohort had statistically significant higher postoperative 1-week Visual Analog Scale (VAS; 3.32±0.68) pain and Oswestry Disability Index (ODI; 32.65±5.56) scores than the nonhematoma cohort (2.99±0.50 and 30.02±4.84, respectively; p <0.05). No significant difference was found at the final follow-up VAS, ODI, and MRI dura sac area.
Conclusions
Epidural fluid hematoma is a common early postoperative MRI finding in lumbar endoscopic unilateral laminotomy with bilateral decompression. Conservative management is the preferred treatment option for patients who do not have a neurological deficit. Symptoms last only a few days and are self-limiting. A common endpoint is a remodeled fluid hematoma and the subsequent expansion of the dura sac area.
6.Prospective Cohort Study with a 2-Year Follow-up of Clinical Results, Fusion Rate, and Muscle Bulk for Uniportal Full Endoscopic Posterolateral Transforaminal Lumbar Interbody Fusion
Pang Hung WU ; Hyeun Sung KIM ; Jin Woo AN ; Myeonghun KIM ; Inkyung LEE ; Jong Seon PARK ; Jun Hyoung LEE ; Sangsoo KANG ; Jeongshik LEE ; Yeonjin YI ; Jun Hyung LEE ; Jun Hwan PARK ; Jae Hyeon LIM ; Il-Tae JANG
Asian Spine Journal 2023;17(2):373-381
Methods:
We evaluated patients who underwent EPTLIF with a minimum 24-month follow-up. Clinical parameters of the Visual Analog Scale (VAS) and Oswestry Disability Index (ODI) were measured at the preoperative, 1-week postoperative mark, postoperative 3-month mark, and final follow-up. Preoperative and 1-year postoperative magnetic resonance imaging measurement of preoperative and postoperative Kjaer grade, right and left psoas muscle mass area, and right and left paraspinal muscle mass area was performed.
Results:
EPTLIF with a minimum 24-month follow-up of 35 levels was included. The complication rate was 6%, and the mean Bridwell’s fusion grade was 1.37 (1–2). There was statistically significant improvement at 1 week, 3 months, and 2 years in VAS (4.11±1.23, 4.94±1.30, and 5.46±1.29) and in ODI (40.34±10.06, 46.69±9.14, and 49.63±8.68), respectively (p <0.05). Successful operation rate with excellent and good MacNab’s criteria at 2 years was 97%. There was an increment of statistically significant bilateral psoas muscle cross-sectional area, right side (70.03±149.1 mm²) and left side (67.59±113.2 mm²) (p <0.05).
Conclusions
Uniportal EPTLIF achieved good fusion and improved clinical outcomes with favorable paraspinal musculature bulk at the 2-year follow-up.
7.Safety and efficacy of nilotinib in adult patients with chronic myeloid leukemia: a post-marketing surveillance study in Korea
Seo-Yeon AHN ; Sang Kyun SON ; Gyu Hyung LEE ; Inho KIM ; June-Won CHEONG ; Won Sik LEE ; Byung Soo KIM ; Deog-Yeon JO ; Chul Won JUNG ; Chu Myoung SEONG ; Jae Hoon LEE ; Young Jin YUH ; Min Kyoung KIM ; Hun-Mo RYOO ; Moo-Rim PARK ; Su-Hee CHO ; Hoon-Gu KIM ; Dae Young ZANG ; Jinny PARK ; Hawk KIM ; Seryeon LEE ; Sung-Hyun KIM ; Myung Hee CHANG ; Ho Sup LEE ; Chul Won CHOI ; Jihyun KWON ; Sung-Nam LIM ; Suk-Joong OH ; Inkyung JOO ; Dong-Wook KIM
Blood Research 2022;57(2):144-151
Background:
Nilotinib is a tyrosine kinase inhibitor approved by the Ministry of Food and Drug Safety for frontline and 2nd line treatment of Philadelphia chromosome-positive chronic myeloid leukemia (Ph+ CML). This study aimed to confirm the safety and efficacy of nilotinib in routine clinical practice within South Korea.
Methods:
An open-label, multicenter, single-arm, 12-week observational post-marketing surveillance (PMS) study was conducted on 669 Korean adult patients with Ph + CML from December 24, 2010, to December 23, 2016. The patients received nilotinib treatment in routine clinical practice settings. Safety was evaluated by all types of adverse events (AEs) during the study period, and efficacy was evaluated by the complete hematological response (CHR) and cytogenetic response.
Results:
During the study period, AEs occurred in 61.3% (410 patients, 973 events), adverse drug reactions (ADRs) in 40.5% (271/669 patients, 559 events), serious AEs in 4.5% (30 patients, 37 events), and serious ADRs in 0.7% (5 patients, 8 events). Furthermore, unexpected AEs occurred at a rate of 6.9% (46 patients, 55 events) and unexpected ADRs at 1.2% (8 patients, 8 events). As for the efficacy results, CHR was achieved in 89.5% (442/494 patients), and minor cytogenetic response or major cytogenetic response was achieved in 85.8% (139/162 patients).
Conclusion
This PMS study shows consistent results in terms of safety and efficacy compared with previous studies. Nilotinib was well tolerated and efficacious in adult Korean patients with Ph + CML in routine clinical practice settings.
8.Revised Korean Antiviral Guideline Reduces the Hepatitis B-related Hepatocellular Carcinoma Risk in Cirrhotic Patients
David Sooik KIM ; Soo Young PARK ; Beom Kyung KIM ; Jun Yong PARK ; Do Young KIM ; Kwang-Hyub HAN ; Yu Rim LEE ; Won Young TAK ; Young Oh KWEON ; Inkyung JUNG ; Minkyung HAN ; Eun Hwa KIM ; Sang Hoon AHN ; Seung Up KIM
Journal of Korean Medical Science 2021;36(16):e105-
Background:
Since September 2015, the initiation of antiviral therapy (AVT) for patients with chronic hepatitis B (CHB)-related cirrhosis has been reimbursed according to the revised Korean Association for the Study of Liver (KASL) guideline, if the patient had hepatitis B virus DNA level ≥ 2,000 IU/L, regardless of aminotransferase or alanine aminotransferase levels. This study investigated whether the KASL guideline implementation reduced the risk of CHB-related hepatocellular carcinoma (HCC) in patients with cirrhosis in South Korea.
Methods:
A total of 429 patients with CHB-related cirrhosis who initiated AVT between 2014 and 2016 were recruited. The risk of HCC development was compared between patients who initiated AVT before and after September 2015 (pre-guideline [n = 196, 45.7%] vs. postguideline implementation [n = 233, 54.3%]).
Results:
Univariate analysis showed that AVT initiation before guideline implementation, older age, male gender, and diabetes significantly predicted increased risk of HCC development (all P < 0.05). Subsequent multivariate analysis showed that AVT initiation before guideline implementation (HR = 1.941), older age (HR = 5.762), male gender (HR = 2.555), and diabetes (HR = 1.568) independently predicted increased risk of HCC development (all P < 0.05). Additionally, multivariate analysis showed that AVT initiation before guideline implementation (HR = 2.309), male gender (HR = 3.058), and lower platelet count (HR = 0.989) independently predicted mortality (P < 0.05). The cumulative incidences of HCC and mortality were significantly higher in patients who initiated AVT before guideline implementation than in those who initiated AVT after guideline implementation (all P < 0.05, log-rank test).
Conclusion
The prognosis of patients with CHB-related cirrhosis who initiated AVT improved after guideline implementation according to the revised KASL guideline.
9.Revised Korean Antiviral Guideline Reduces the Hepatitis B-related Hepatocellular Carcinoma Risk in Cirrhotic Patients
David Sooik KIM ; Soo Young PARK ; Beom Kyung KIM ; Jun Yong PARK ; Do Young KIM ; Kwang-Hyub HAN ; Yu Rim LEE ; Won Young TAK ; Young Oh KWEON ; Inkyung JUNG ; Minkyung HAN ; Eun Hwa KIM ; Sang Hoon AHN ; Seung Up KIM
Journal of Korean Medical Science 2021;36(16):e105-
Background:
Since September 2015, the initiation of antiviral therapy (AVT) for patients with chronic hepatitis B (CHB)-related cirrhosis has been reimbursed according to the revised Korean Association for the Study of Liver (KASL) guideline, if the patient had hepatitis B virus DNA level ≥ 2,000 IU/L, regardless of aminotransferase or alanine aminotransferase levels. This study investigated whether the KASL guideline implementation reduced the risk of CHB-related hepatocellular carcinoma (HCC) in patients with cirrhosis in South Korea.
Methods:
A total of 429 patients with CHB-related cirrhosis who initiated AVT between 2014 and 2016 were recruited. The risk of HCC development was compared between patients who initiated AVT before and after September 2015 (pre-guideline [n = 196, 45.7%] vs. postguideline implementation [n = 233, 54.3%]).
Results:
Univariate analysis showed that AVT initiation before guideline implementation, older age, male gender, and diabetes significantly predicted increased risk of HCC development (all P < 0.05). Subsequent multivariate analysis showed that AVT initiation before guideline implementation (HR = 1.941), older age (HR = 5.762), male gender (HR = 2.555), and diabetes (HR = 1.568) independently predicted increased risk of HCC development (all P < 0.05). Additionally, multivariate analysis showed that AVT initiation before guideline implementation (HR = 2.309), male gender (HR = 3.058), and lower platelet count (HR = 0.989) independently predicted mortality (P < 0.05). The cumulative incidences of HCC and mortality were significantly higher in patients who initiated AVT before guideline implementation than in those who initiated AVT after guideline implementation (all P < 0.05, log-rank test).
Conclusion
The prognosis of patients with CHB-related cirrhosis who initiated AVT improved after guideline implementation according to the revised KASL guideline.
10.The Moderating Effect of Sleep Disturbance on the Association of Stress with Impulsivity and Depressed Mood
Inkyung PARK ; Seong Min OH ; Kyung Hwa LEE ; Soohyun KIM ; Jeong Eun JEON ; Ha Young LEE ; Sehyun JEON ; Seog Ju KIM ; Yu Jin LEE
Psychiatry Investigation 2020;17(3):243-248
Objective:
This study was performed to investigate the associations of life event stress with impulsivity, anxiety, and depressed mood as a function of the presence of a sleep disturbance.
Methods:
In total, 214 participants (age 38.96±10.53 years; 111 females) completed self-report questionnaires, including the Life Experience Survey (LES), Pittsburgh Sleep Quality Index (PSQI), Barratt’s Impulsivity Scale (BIS), Beck Anxiety Inventory (BAI), and Beck Depression Inventory (BDI). The presence of a sleep disturbance was defined as a PSQI score >5.
Results:
In total, 127 participants presented with a sleep disturbance (age 39.33±10.92 years; 64 females), whereas the remaining 87 did not (age 38.43±9.97 years; 47 females). Negative LES scores were significantly correlated with BIS (r=0.22, p=0.001), BAI (r=0.46, p< 0.001), and BDI (r=0.51, p<0.001) scores, and PSQI scores were significantly correlated with BAI (r=0.49, p<0.001) and BDI (r=0.60, p< 0.001) scores. Moderation analysis revealed statistically significant interactions between negative LES scores and the presence of a sleep disturbance on BIS (p=0.044) and BDI (p=0.014) but not on BAI (p=0.194) scores.
Conclusion
The findings of the present study suggest that life event stress has varying degrees of influence on mental health, especially impulsivity and depressed mood, depending on the presence or absence of a sleep disturbance.

Result Analysis
Print
Save
E-mail