1.Efficacy of large language models and their potential in Obstetrics and Gynecology education
Kyung Jin EOH ; Gu Yeun KWON ; Eun Jin LEE ; JoonHo LEE ; Inha LEE ; Young Tae KIM ; Eun Ji NAM
Obstetrics & Gynecology Science 2024;67(6):550-556
Objective:
The performance of large language models (LLMs) and their potential utility in obstetric and gynecological education are topics of ongoing debate. This study aimed to contribute to this discussion by examining the recent advancements in LLM technology and their transformative potential in artificial intelligence.
Methods:
This study assessed the performance of generative pre-trained transformer (GPT)-3.5 and -4 in understanding clinical information, as well as its potential implications for obstetric and gynecological education. Obstetrics and gynecology residents at three hospitals underwent an annual promotional examination, from which 116 of the 170 questions over 4 years (2020-2023) were analyzed, excluding 54 questions with images. The scores achieved by GPT-3.5, -4, and the 100 residents were compared.
Results:
The average scores across all 4 years for GPT-3.5 and -4 were 38.79 (standard deviation [SD], 5.65) and 79.31 (SD, 3.67), respectively. For groups first-year resident, second-year resident, and third-year resident, the cumulative annual average scores were 79.12 (SD, 9.00), 80.95 (SD, 5.86), and 83.60 (SD, 6.82), respectively. No statistically significant differences were observed between the scores of GPT-4.0 and those of the residents. When analyzing questions specific to obstetrics, the average scores for GPT-3.5 and -4.0 were 33.44 (SD, 10.18) and 90.22 (SD, 7.68), respectively.
Conclusion
GPT-4 demonstrated exceptional performance in obstetrics, different types of data interpretation, and problem solving, showcasing the potential utility of LLMs in these areas. However, acknowledging the constraints of LLMs is crucial and their utilization should augment human expertise and discernment.
2.Efficacy of large language models and their potential in Obstetrics and Gynecology education
Kyung Jin EOH ; Gu Yeun KWON ; Eun Jin LEE ; JoonHo LEE ; Inha LEE ; Young Tae KIM ; Eun Ji NAM
Obstetrics & Gynecology Science 2024;67(6):550-556
Objective:
The performance of large language models (LLMs) and their potential utility in obstetric and gynecological education are topics of ongoing debate. This study aimed to contribute to this discussion by examining the recent advancements in LLM technology and their transformative potential in artificial intelligence.
Methods:
This study assessed the performance of generative pre-trained transformer (GPT)-3.5 and -4 in understanding clinical information, as well as its potential implications for obstetric and gynecological education. Obstetrics and gynecology residents at three hospitals underwent an annual promotional examination, from which 116 of the 170 questions over 4 years (2020-2023) were analyzed, excluding 54 questions with images. The scores achieved by GPT-3.5, -4, and the 100 residents were compared.
Results:
The average scores across all 4 years for GPT-3.5 and -4 were 38.79 (standard deviation [SD], 5.65) and 79.31 (SD, 3.67), respectively. For groups first-year resident, second-year resident, and third-year resident, the cumulative annual average scores were 79.12 (SD, 9.00), 80.95 (SD, 5.86), and 83.60 (SD, 6.82), respectively. No statistically significant differences were observed between the scores of GPT-4.0 and those of the residents. When analyzing questions specific to obstetrics, the average scores for GPT-3.5 and -4.0 were 33.44 (SD, 10.18) and 90.22 (SD, 7.68), respectively.
Conclusion
GPT-4 demonstrated exceptional performance in obstetrics, different types of data interpretation, and problem solving, showcasing the potential utility of LLMs in these areas. However, acknowledging the constraints of LLMs is crucial and their utilization should augment human expertise and discernment.
3.Efficacy of large language models and their potential in Obstetrics and Gynecology education
Kyung Jin EOH ; Gu Yeun KWON ; Eun Jin LEE ; JoonHo LEE ; Inha LEE ; Young Tae KIM ; Eun Ji NAM
Obstetrics & Gynecology Science 2024;67(6):550-556
Objective:
The performance of large language models (LLMs) and their potential utility in obstetric and gynecological education are topics of ongoing debate. This study aimed to contribute to this discussion by examining the recent advancements in LLM technology and their transformative potential in artificial intelligence.
Methods:
This study assessed the performance of generative pre-trained transformer (GPT)-3.5 and -4 in understanding clinical information, as well as its potential implications for obstetric and gynecological education. Obstetrics and gynecology residents at three hospitals underwent an annual promotional examination, from which 116 of the 170 questions over 4 years (2020-2023) were analyzed, excluding 54 questions with images. The scores achieved by GPT-3.5, -4, and the 100 residents were compared.
Results:
The average scores across all 4 years for GPT-3.5 and -4 were 38.79 (standard deviation [SD], 5.65) and 79.31 (SD, 3.67), respectively. For groups first-year resident, second-year resident, and third-year resident, the cumulative annual average scores were 79.12 (SD, 9.00), 80.95 (SD, 5.86), and 83.60 (SD, 6.82), respectively. No statistically significant differences were observed between the scores of GPT-4.0 and those of the residents. When analyzing questions specific to obstetrics, the average scores for GPT-3.5 and -4.0 were 33.44 (SD, 10.18) and 90.22 (SD, 7.68), respectively.
Conclusion
GPT-4 demonstrated exceptional performance in obstetrics, different types of data interpretation, and problem solving, showcasing the potential utility of LLMs in these areas. However, acknowledging the constraints of LLMs is crucial and their utilization should augment human expertise and discernment.
4.Hyperperfusion Syndrome Following Tissue Plasminogen Activator Administration:A Case Report with Radiological Evidence
Nam Hee KOH ; Sam Soo KIM ; Ha Yeun OH ; Seongheon KIM ; Jae-Won JANG
Journal of the Korean Society of Radiology 2024;85(6):1200-1208
Cerebral hyperperfusion syndrome is a rare complication that can occur following carotid artery revascularization procedures in patients with chronic carotid artery stenosis. Cases of hyperperfusion syndrome resulting solely from intravenous tissue plasminogen activator administration, without a history of revascularization, are extremely rare. Only four of such cases have been reported with imaging evidence. This report presents a case of early neurological deterioration in acute ischemic stroke, identified as a form of hyperperfusion syndrome. Imaging evidence supports this diagnosis, and highlights the occurrence of hyperperfusion syndrome after intravenous tissue plasminogen activator administration.
5.Hyperperfusion Syndrome Following Tissue Plasminogen Activator Administration:A Case Report with Radiological Evidence
Nam Hee KOH ; Sam Soo KIM ; Ha Yeun OH ; Seongheon KIM ; Jae-Won JANG
Journal of the Korean Society of Radiology 2024;85(6):1200-1208
Cerebral hyperperfusion syndrome is a rare complication that can occur following carotid artery revascularization procedures in patients with chronic carotid artery stenosis. Cases of hyperperfusion syndrome resulting solely from intravenous tissue plasminogen activator administration, without a history of revascularization, are extremely rare. Only four of such cases have been reported with imaging evidence. This report presents a case of early neurological deterioration in acute ischemic stroke, identified as a form of hyperperfusion syndrome. Imaging evidence supports this diagnosis, and highlights the occurrence of hyperperfusion syndrome after intravenous tissue plasminogen activator administration.
6.Efficacy of large language models and their potential in Obstetrics and Gynecology education
Kyung Jin EOH ; Gu Yeun KWON ; Eun Jin LEE ; JoonHo LEE ; Inha LEE ; Young Tae KIM ; Eun Ji NAM
Obstetrics & Gynecology Science 2024;67(6):550-556
Objective:
The performance of large language models (LLMs) and their potential utility in obstetric and gynecological education are topics of ongoing debate. This study aimed to contribute to this discussion by examining the recent advancements in LLM technology and their transformative potential in artificial intelligence.
Methods:
This study assessed the performance of generative pre-trained transformer (GPT)-3.5 and -4 in understanding clinical information, as well as its potential implications for obstetric and gynecological education. Obstetrics and gynecology residents at three hospitals underwent an annual promotional examination, from which 116 of the 170 questions over 4 years (2020-2023) were analyzed, excluding 54 questions with images. The scores achieved by GPT-3.5, -4, and the 100 residents were compared.
Results:
The average scores across all 4 years for GPT-3.5 and -4 were 38.79 (standard deviation [SD], 5.65) and 79.31 (SD, 3.67), respectively. For groups first-year resident, second-year resident, and third-year resident, the cumulative annual average scores were 79.12 (SD, 9.00), 80.95 (SD, 5.86), and 83.60 (SD, 6.82), respectively. No statistically significant differences were observed between the scores of GPT-4.0 and those of the residents. When analyzing questions specific to obstetrics, the average scores for GPT-3.5 and -4.0 were 33.44 (SD, 10.18) and 90.22 (SD, 7.68), respectively.
Conclusion
GPT-4 demonstrated exceptional performance in obstetrics, different types of data interpretation, and problem solving, showcasing the potential utility of LLMs in these areas. However, acknowledging the constraints of LLMs is crucial and their utilization should augment human expertise and discernment.
7.Hyperperfusion Syndrome Following Tissue Plasminogen Activator Administration:A Case Report with Radiological Evidence
Nam Hee KOH ; Sam Soo KIM ; Ha Yeun OH ; Seongheon KIM ; Jae-Won JANG
Journal of the Korean Society of Radiology 2024;85(6):1200-1208
Cerebral hyperperfusion syndrome is a rare complication that can occur following carotid artery revascularization procedures in patients with chronic carotid artery stenosis. Cases of hyperperfusion syndrome resulting solely from intravenous tissue plasminogen activator administration, without a history of revascularization, are extremely rare. Only four of such cases have been reported with imaging evidence. This report presents a case of early neurological deterioration in acute ischemic stroke, identified as a form of hyperperfusion syndrome. Imaging evidence supports this diagnosis, and highlights the occurrence of hyperperfusion syndrome after intravenous tissue plasminogen activator administration.
8.Efficacy of large language models and their potential in Obstetrics and Gynecology education
Kyung Jin EOH ; Gu Yeun KWON ; Eun Jin LEE ; JoonHo LEE ; Inha LEE ; Young Tae KIM ; Eun Ji NAM
Obstetrics & Gynecology Science 2024;67(6):550-556
Objective:
The performance of large language models (LLMs) and their potential utility in obstetric and gynecological education are topics of ongoing debate. This study aimed to contribute to this discussion by examining the recent advancements in LLM technology and their transformative potential in artificial intelligence.
Methods:
This study assessed the performance of generative pre-trained transformer (GPT)-3.5 and -4 in understanding clinical information, as well as its potential implications for obstetric and gynecological education. Obstetrics and gynecology residents at three hospitals underwent an annual promotional examination, from which 116 of the 170 questions over 4 years (2020-2023) were analyzed, excluding 54 questions with images. The scores achieved by GPT-3.5, -4, and the 100 residents were compared.
Results:
The average scores across all 4 years for GPT-3.5 and -4 were 38.79 (standard deviation [SD], 5.65) and 79.31 (SD, 3.67), respectively. For groups first-year resident, second-year resident, and third-year resident, the cumulative annual average scores were 79.12 (SD, 9.00), 80.95 (SD, 5.86), and 83.60 (SD, 6.82), respectively. No statistically significant differences were observed between the scores of GPT-4.0 and those of the residents. When analyzing questions specific to obstetrics, the average scores for GPT-3.5 and -4.0 were 33.44 (SD, 10.18) and 90.22 (SD, 7.68), respectively.
Conclusion
GPT-4 demonstrated exceptional performance in obstetrics, different types of data interpretation, and problem solving, showcasing the potential utility of LLMs in these areas. However, acknowledging the constraints of LLMs is crucial and their utilization should augment human expertise and discernment.
9.Developing national level high alert medication lists for acute care setting in Korea
Ji Min HAN ; Kyu-Nam HEO ; Ah Young LEE ; Sang il MIN ; Hyun Jee KIM ; Jin-Hee BAEK ; Juhyun RHO ; Sue In KIM ; Ji yeon KIM ; Haewon LEE ; Eunju CHO ; Young-Mi AH ; Ju-Yeun LEE
Korean Journal of Clinical Pharmacy 2022;32(2):116-124
Background:
High-alert medications (HAMs) are medications that bear a heightened risk of causing significant patient harm if used in error. To facilitate safe use of HAMs, identifying specific HAM lists for clinical setting is necessary. We aimed to develop the national level HAM list for acute care setting.
Methods:
We used three-step process. First, we compiled the pre-existing lists referring HAMs. Second, we analyzed medication related incidents reported from national patient safety incident report data and adverse events indicating medication errors from the Korea Adverse Event Reporting System (KAERS).We also surveyed the assistant staffs to support patient safety tasks and pharmacist in charge of medication safety in acute care hospital. From findings from analysis and survey results we created additional candidate list of HAMs. Third, we derived the final list for HAMs in acute care settings through expert panel surveys.
Results:
From pre-existing HAM list, preliminary list consisting of 42 medication class/ingredients was derived. Eight assistant staff to support patient safety tasks and 39 pharmacists in charge of medication safety responded to the survey. Additional 44 medication were listed from national patient safety incident report data, KAERS data and common medications involved in prescribing errors and dispensing errors from survey data. A list of mandatory and optional HAMs consisting of 10 and 6 medication classes, respectively, was developed by consensus of the expert group.
Conclusion
We developed national level HAM list for Korean acute care setting from pre-existing lists, analyzing medication error data, survey and expert panel consensus.
10.Sonazoid-enhanced ultrasonography: comparison with CT/MRI Liver Imaging Reporting and Data System in patients with suspected hepatocellular carcinoma
Jeong Ah HWANG ; Woo Kyoung JEONG ; Ji Hye MIN ; Yeun-Yoon KIM ; Nam Hun HEO ; Hyo Keun LIM
Ultrasonography 2021;40(4):486-498
Purpose:
The aim of this study was to evaluate the association of contrast-enhanced ultrasound (CEUS) features using Sonazoid for liver nodules with Liver Imaging Reporting and Data System (LI-RADS) categories and to identify the usefulness of Kupffer-phase images.
Methods:
This retrospective study was conducted in 203 patients at high risk of hepatocellular carcinoma (HCC) who underwent CEUS with Sonazoid from 2013 to 2016. Nodule enhancement in the arterial, portal venous, late, and Kupffer phases; CEUS LI-RADS major features; and Kupffer-phase defects were evaluated. According to the computed tomography/magnetic resonance imaging (CT/MRI) LI-RADS v2018, all nodules were assigned an LR category (n=4/33/99/67 for LR-M/3/4/5) and comparisons across LR categories were made. We defined modified CEUS LI-RADS as using Kupffer-phase defects as an alternative to late and mild washout in CEUS LI-RADS and compared the diagnostic performance for HCC.
Results:
On CEUS of 203 nodules, 89.6% of CT/MRI LR-5 and 85.9% of LR-4 nodules showed hyperenhancement in the arterial phase, while 57.6% of LR-3 nodules showed hyperenhancement. Among the CT/MRI LR-5 nodules that showed arterial phase hyperenhancement or isoenhancement, 59.7% showed hypoenhancing changes from the portal venous phase, 23.9% from the late phase, and 13.4% additionally in the Kupffer phase. The modified CEUS LI-RADS showed higher sensitivity than CEUS LI-RADS (83.2% vs. 74.2%, P=0.008) without compromising specificity (63.6% vs. 69.7%, P=0.500).
Conclusion
The Kupffer phase best shows hypoenhancing changes in LR-5 lesions and is expected to improve the sensitivity for HCC in high-risk patients.

Result Analysis
Print
Save
E-mail