1.Prospective external validation of a deep-learning-based early-warning system for major adverse events in general wards in South Korea
Taeyong SIM ; Eun Young CHO ; Ji-hyun KIM ; Kyung Hyun LEE ; Kwang Joon KIM ; Sangchul HAHN ; Eun Yeong HA ; Eunkyeong YUN ; In-Cheol KIM ; Sun Hyo PARK ; Chi-Heum CHO ; Gyeong Im YU ; Byung Eun AHN ; Yeeun JEONG ; Joo-Yun WON ; Hochan CHO ; Ki-Byung LEE
Acute and Critical Care 2025;40(2):197-208
Background:
Acute deterioration of patients in general wards often leads to major adverse events (MAEs), including unplanned intensive care unit transfers, cardiac arrest, or death. Traditional early warning scores (EWSs) have shown limited predictive accuracy, with frequent false positives. We conducted a prospective observational external validation study of an artificial intelligence (AI)-based EWS, the VitalCare - Major Adverse Event Score (VC-MAES), at a tertiary medical center in the Republic of Korea.
Methods:
Adult patients from general wards, including internal medicine (IM) and obstetrics and gynecology (OBGYN)—the latter were rarely investigated in prior AI-based EWS studies—were included. The VC-MAES predictions were compared with National Early Warning Score (NEWS) and Modified Early Warning Score (MEWS) predictions using the area under the receiver operating characteristic curve (AUROC), area under the precision-recall curve (AUPRC), and logistic regression for baseline EWS values. False-positives per true positive (FPpTP) were assessed based on the power threshold.
Results:
Of 6,039 encounters, 217 (3.6%) had MAEs (IM: 9.5%, OBGYN: 0.26%). Six hours prior to MAEs, the VC-MAES achieved an AUROC of 0.918 and an AUPRC of 0.352, including the OBGYN subgroup (AUROC, 0.964; AUPRC, 0.388), outperforming the NEWS (0.797 and 0.124) and MEWS (0.722 and 0.079). The FPpTP was reduced by up to 71%. Baseline VC-MAES was strongly associated with MAEs (P<0.001).
Conclusions
The VC-MAES significantly outperformed traditional EWSs in predicting adverse events in general ward patients. The robust performance and lower FPpTP suggest that broader adoption of the VC-MAES may improve clinical efficiency and resource allocation in general wards.
2.Relationship Between Sleep Quality and Depression Symptoms in Psychiatric Patients: Mediating Effect Interpretation Bias for Ambiguity and Anxiety Symptoms
Hyerin LEE ; Eunkyeong KIM ; Joonho CHOI ; Seon-Cheol PARK
Korean Journal of Psychosomatic Medicine 2022;30(2):137-144
Objectives:
:This study was designed to investigate the effect of sleep quality on depression symptoms and the mediating effect of interpretation bias and anxiety symptoms in psychiatric patients.
Methods:
:Data accumulated for outpatients and inpatients in the Department of Mental Health Medicine at Hanyang University Guri Hospital were used. The measurement tools were Pittsburgh Sleep Quality Index (PSQI), Ambiguous/Unambiguous Situations Diary-Extended Version (AUSD-EX), Beck Anxiety Inventory (BAI), Beck Depression Inventory-II (BDI-II). Correlation analysis and bootstrapping analysis were conducted using SPSS 25.0 and SPSS Macro based on 162 patient data.
Results:
:As a result of the study, the double mediating effect of interpretation bias for Ambiguity and anxiety symptoms was significant in the relationship between sleep quality and depression symptoms.
Conclusions
:In this study, it was confirmed that low sleep quality sequentially affects anxiety and depression symptoms through interpretation bias for ambiguity. Based on this, it is expected that the development of other psychiatric symptoms can be prevented by preferentially performing therapeutic intervention on preceding symptoms.
3.Temperament and Character of High Suicide Risk Group Among Psychiatric Patients
Kyungwon KIM ; Yongchon PARK ; Junho CHOI ; Daeho KIM ; Eunkyeong KIM
Psychiatry Investigation 2022;19(8):654-660
Objective:
The purpose of this study was to classify patients with suicidal tendencies into suicide attempts (SA), suicidal ideation (SI), and non-suicidal self-injury (NSSI) and to identify differences in temperaments and characters of the groups. It also aimed to identify difference between the groups and non-suicidal tendencies.
Methods:
Using psychiatric diagnostic data of 195 patients, temperaments and characters were measured with the Temperament and Character Inventory, and the level of depression was measured with the Beck Depression Inventory. The subjects were classified into SA, SI, NSSI, psychiatric patients without suicidal tendencies (PP), and non-patient (Normal) groups, and multivariate analysis of variance and multinomial logistic regression were conducted.
Results:
The NSSI group had higher novelty seeking compared to the SI group, while having higher harm avoidance, lower persistence, and lower self-directedness compared to the SA group. Furthermore, low persistence was a better predictor for the SA group between SA and NSSI groups, and low novelty seeking was found to be a better predictor for the SI group between the SI and NSSI groups.
Conclusion
As a result, the group differences in temperaments and characters were found, which would be useful to identify patients with suicidal tendencies and provide appropriate interventions tailored to the temperaments and characters of each group.
4.Network Analysis of Central Symptoms of Depression in Elderly Cognitive Disorder Patients
Dongju KIM ; Seon-Cheol PARK ; Il Bin KIM ; Eunkyeong KIM
Journal of Korean Neuropsychiatric Association 2022;61(1):38-44
Objectives:
This study aimed to identify central symptoms of depression in elderly cognitive disorder patients through network analysis.
Methods:
A total of 222 participants, 61 male and 104 female suffering from a cognitive disorder, participated in the dementia screening test and were given Mini-Mental Status Examination in the Korean Version of the CERAD Assessment Packet or Mini-Mental Status Examination for Dementia Screening and Korean Form of Geriatric Depression Scale (GDS-K) at a public health center in Gyeonggi-do, Korea. This study used network analysis to identify the centrality in the symptom network of depression among elderly cognitive disorder patients.
Results:
Among 30 nodes included in our network analysis, 435 edges were available, and 50 edges had a meaningful relationship. According to the centrality results of the study, we found that GDS-K item 16, “Do you feel depressed and discouraged?” item 3, “Do you feel like you’re living in vain?” and item 15, “Do you enjoy being alive?” were the key symptoms. Also, there was a difference in symptom correlations between cognitive disorder patients and normal participants.
Conclusion
The results suggest that depressive mood, discouragement, worthlessness and loss of pleasure should be the priority intervention goals in intervening in depressive symptoms of the elderly with cognitive disabilities.
5.Association Between Suggestive Symptom of Restless Legs Syndrome and COVID-19 Vaccination: A Pilot Study
Jin Myoung SEOK ; Eun Jin NA ; Seul Gi KIM ; Jongkyu PARK ; Eunkyeong PARK ; Pamela SONG ; Kwang Ik YANG
Journal of Sleep Medicine 2022;19(1):6-11
Objectives:
Various sensory symptoms have been recognized after COVID-19 vaccination. Here, we aimed to explore the association between the suggestive symptom of restless legs syndrome (RLSss) and COVID-19 vaccination using an online survey.
Methods:
We prospectively studied participants who were working in our hospital after at least the first dose of the ChAdOx1 or BNT162b2 mRNA vaccine. The participants were invited via smartphone messages and voluntarily filled out an online questionnaire that included adverse events after vaccination. We considered the participants as having RLSss if they reported that they had three or more symptoms in the restless legs syndrome (RLS) diagnostic criteria.
Results:
A total of 628 participants (506 female; mean age, 37.7±12.4 years) responded fully to our online survey. 588 participants (93.6%) received the first dose of the ChAdOx1 vaccine (BNT162b2 mRNA vaccine for 40 participants). A total of 44 out of the 628 participants (7.0%) reported that they had RLSss. Myalgia was more common in participants with RLSss than in those without RLSss (97.7% vs. 67.3%, p<0.001). Multivariate testing showed that age (odds ratio, 1.037 per 1 year increase; 95% CI, 1.004–1.071) and the presence of myalgia (odds ratio, 20.479; 95% CI, 4.266–368.206) were associated with the presence of RLSss.
Conclusions
This pilot study explored RLSss after COVID-19 vaccination and the results suggested that RLS might be one of the causes of adverse symptoms after COVID-19 vaccination. Further studies are required to confirm the relationship between RLS and COVID-19 vaccination.
6.Psychological Characteristics of Psychiatric outpatients with High Suicide Risk : Using MMPI-2-RF
Jisoo NAM ; Daeho KIM ; Eunkyeong KIM
Korean Journal of Psychosomatic Medicine 2020;28(1):8-19
Objectives:
:The purpose of this study was to examine whether the MMPI-2-RF serves as a useful tool to differentiate between the subtypes of high risk of suicide among psychiatric outpatients.
Methods:
:Patients were recruited from the department of psychiatry of university hospital. Participants were diagnosed using DSM-5 criteria by board certified psychiatrists. Their medical records were reviewed retrospectively. And participants were put into 4 groups (Suicide ideation, Suicide attempt, Non-suicidal self-injury, and general psychiatric diagnosis as a control group). For statistical comparison, the MANCOVA with gender as a covariate was used.
Results:
:The results indicated that as previous research with non-clinical sample suggested, psychiatric outpatients with high suicide risk also have significantly higher Emotional/Internalizing Dysfunction, Helplessness/ Hopelessness, Suicidal/Death Ideation, Demoralization, Cognitive complaints, Cynicism, Dysfunctional negative thoughts than general psychiatric patients group. But group differences within the high suicide risk patients have not been observed. However, suicide attempt group and NSSI group has higher Behavioral/Externalizing Dysfunction, RC4, AGG than general psychiatric patients group. But there was no difference between suicidal idea group and general psychiatric patients group.
Conclusions
:There was no group difference observed between all three subtypes, which mean the MMPI- 2-RF may not be the useful diagnostic tool to navigate high suicide risk subtypes. Even though there was no difference observed in the suicide ideation group, suicide attempt group and NSSI group have higher aggression and externalization. So those indexes could serve as a useful marker to investigate riskiness of suicide related symptoms.
7.Comparison of Clinical Characteristics among Anxiety Disorder, Depressive Disorder, and Co-morbid of Anxiety Disorder and Depressive Disorder with MMPI-2-RF
JuYeon LEE ; Junho CHOI ; Eunkyeong KIM
Korean Journal of Psychosomatic Medicine 2020;28(1):1-7
Objectives:
:The purpose of this study was to explore comparison of clinical characteristics among Anxiety disorder, Depressive disorder, and Co-morbid of Anxiety disorder and Depressive disorder.
Methods:
:Since January, 2017 to May, 2019, patients were recruited from the department of psychiatry of Hanyang University Guri Hospital. Participants were diagnosed Anxiety disorder, Depressive disorder, and Co-morbid of Anxiety disorder and Depressive disorder using DSM-5 criteria by board certified psychiatrists or clinical psychologists. And each of participants tested with MMPI-2 and clinical psychologists were converted MMPI-2 to MMPI-2-RF. The data were analyzed using SPSS 18.0.
Results:
:The results indicated EID, RC2, HLP, SAV, and INTR-r were the highest in Co-morbid of Anxiety disorder and Depressive disorder group. And BXD, RC4, JCP, and AGGR-r were the highest in Depressive disorder group.
Conclusions
:The results indicated that Co-morbid of Anxiety disorder and Depressive disorder group were more severe internalizing dysfunction like lower positive emotion, helplessness, social avoidance and discomfort than single-diagnosed group. Single Depressive disorder group were more serious externalizing dysfunction like anger and aggression than single Anxiety disorder and Co-morbid of Anxiety disorder and Depressive disorder. The implications and limitations were discussed.
8.The Relationships among MMPI-2-RF Validity Scales, Premature Termination and Treatment Duration in Psychiatric Outpatients
Kyungwon KIM ; Yong Chon PARK ; Eunkyeong KIM
Journal of the Korean Society of Biological Therapies in Psychiatry 2020;26(1):56-64
Objectives:
:This study aimed to examine the validity scales of Minnesota Multiphasic Personality Inventory–2 Restructured Form (MMPI-2-RF) in Predicting premature termination and treatment duration in psychiatric outpatients.
Methods:
:The MMPI–2 was administered to 202 patients with psychiatric medication, and its data converted to MMPI-2-RF was used for analysis. An independent t-test used to determine whether there was a difference in validity scales between premature termination group and treatment continued group. Then, logistic regression analysis was performed to determine the degree of effect on premature termination. Moreover, correlation analysis and multiple regression analysis were performed to confirm the relationship between treatment duration and validity scales.
Results:
:The premature termination group showed higher score in variable response inconsistency (Vrin-r), adjustment validity (K-r) and lower score in infrequent responses (F-r) compared to the treatment continued groups. In logistic regression analysis, however, none of MMPI-2-RF validity scales predicted premature termination. Also, it was found that higher K-r score was associated with shorter treatment duration.
Conclusion
:The study showed that the MMPI-2-RF validity scales can predict whether to continue medication and treatment. Therefore, it is expected that more thorough studies of the attitudes toward treatment with respect to the validity scales provides the opportunity to find patients at high risk of premature treatment prior to medication and to strengthen their motivation for treatment, thereby leading to more effective and lasting treatment.
9.Change of Temperament and Personality in Post-traumatic Stress Disorders
Hyosun CHOI ; Daeho KIM ; Eunkyeong KIM
Korean Journal of Psychosomatic Medicine 2020;28(2):155-160
Objectives:
:This study investigate to identify the stability of temperament and personality characteristics of patients including Posttraumatic Stress Disorder (PTSD) patients.
Methods:
:The number of subjects was 102, of which 33 were PTSD patients and 69 were non-PTSD patients. To demonstrate the change in individual temperament and personality characteristics, Temperament and Character Inventory (TCI) were administered repeatedly on the subjects. Repeated measures ANOVA and simple main effects analysis were conducted.
Results:
:When analysed by dividing the subjects into PTSD groups and non-PTSD groups, the differences between the primary and secondary tests did not appear in the non-PTSD groups, but the differences between the primary and secondary tests were significant in Harm Avoidance (HA), Reward Dependence (RD), Self-Directedness (SD), Cooperativeness (C). In addition, it was noted that the time and group interaction effects of HA, RD, SD and C were significant, and that the main effects of time of HA, RD, SD and C were significant.
Conclusions
:This study is meaningful in that in the course of experience and recovery of traumatic events,we have clinically confirmed that changes in the temperament, known as stable variables, are possible.
10.Differences in Cognitive and Psychological Characteristics of Psychiatric Patients with Military Service Issues versus General Psychiatric Outpatients
Seungyun SHIM ; Junho CHOI ; Eunkyeong KIM
Korean Journal of Psychosomatic Medicine 2020;28(2):143-154
Objectives:
:The purpose of this study was to examine cognitive and psychological characteristics of patients with military service suitability issues compared to the general psychiatric outpatients.
Methods:
:108 patients who visited psychiatric clinic center due to military service suitability issues and 80 general psychiatric patients were recruited from the Department of Psychiatry of university hospital. ANCOVA and chi-equare test were used to examine differences between two groups. Furthermore, we utilized paired t-test to compare the scrore within military group depending on when they performed the psychological assessment.
Results:
:There were no significant differences between military group and general outpatient group in WAIS-IV scores. However, military group scored remarkably higher than control group on validity scales, F-r andFp-r whereas they scored lower on validity scale, K-r. Furthermore, military group showed significantly higher on BDI and MMPI-2-RF, EID, RCd, RC2, RC3, COG, HLP, SFD, NFC, STW, SAVE, SHY, DSF, NEGE-r, INTR-r. As a result of comparison within the military group following the periods of assessment, military group did not show the significant differences on the overall scales of MMPI-2-RF.
Conclusions
:The present study showed that military group tends to report their psychological distress more exaggeratedly. In addition, they had significantly elevated not only emotional distress such as depression and anxiety but interpersonal problem. The implications and limitations were discussed along with some suggestions for the future studies.

Result Analysis
Print
Save
E-mail