1.Evaluating the Accuracy and Diagnostic Reasoning of Multimodal Large Language Models in Interpreting Neuroradiology Cases From RadioGraphics
Pae Sun SUH ; Ji Su KO ; Woo Hyun SHIM ; Hwon HEO ; Chang-Yun WOO ; Hyungjun PARK ; Chong Hyun SUH
Korean Journal of Radiology 2026;27(3):214-226
Objective:
To evaluate the accuracy and reasoning capabilities of large multimodal language models compared with those of neuroradiology subspecialty-trained radiologists in neuroradiology case interpretation.
Materials and Methods:
This experimental study used custom-made 401 radiologic quizzes derived from articles published in RadioGraphics covering neuroradiology and head and neck topics (October 2020 to February 2024). We prompted the GPT-4 Turbo with Vision (GPT-4V), GPT-4 Omni, Gemini Flash, and Claude models to provide the top three differential diagnoses with a rationale and describe examination characteristics such as imaging modality, sequence, use of contrast, image plane, and body part. The temperature was adjusted to 0 and 1 (T1). Two neuroradiologists answered the same questions.The accuracies of the large language models (LLMs) and the neuroradiologists were compared using generalized estimating equations. Three neuroradiologists assessed the rationale provided by the LLMs for their differential diagnoses using four-point scales, separately for specific lesion locations and imaging findings, and evaluated the presence of hallucinations and the overall acceptability of the responses.
Results:
Top-3 accuracy (i.e., correct answers present among top-3 differential diagnoses) of LLMs ranged from 29.9% (120 of 401) to 49.4% (198 of 401, obtained with GPT-4V in the T1 setting), while radiologists achieved 80.3% (322 of 401) and 68.3% (274 of 401), respectively (P < 0.001). Regarding the rationale for differential diagnoses, GPT-4V (T1) accurately identified both the specific lesion location and imaging findings in 30.7% (123 of 401) and 12.9% (16 of 124) of cases without textual clinical history. Hallucinations occurred in 4.5% (18 of 401), and only 29.4% (118 of 401) of the LLM-generated analyses were deemed acceptable. GPT-4V (T1) demonstrated high accuracy in identifying the imaging modality (97.4% [800 of 821]) and scanned body parts (92.2% [756 of 820]).
Conclusion
LLMs remarkably underperformed compared with neuroradiologists and showed unsatisfactory reasoning for their differential diagnoses, with performance declining further in cases without textual input of clinical history. These findings highlight the limitations of current multimodal LLMs in neuroradiological interpretation and their reliance on text input.
3.Simultaneous Prostate Target Biopsy Integrated With Radical Prostatectomy: A Pilot Study Omitting Preoperative Systematic Biopsy
Tae Young PARK ; Jae Young HWANG ; Seong Woo YUN ; Chang Wan HYUN ; Sung Goo YOON ; Seung Bin KIM ; Tae Il NOH ; Ji Sung SHIM ; Min Goo PARK ; Seok Ho KANG ; Sung Gu KANG
Journal of Urologic Oncology 2024;22(3):196-200
Purpose:
This study evaluates the viability of a new method that employs transperineal targeted biopsy with frozen section analysis immediately followed by robot-assisted radical prostatectomy (RARP), bypassing the traditional systematic biopsy deemed essential by current guidelines.
Materials and Methods:
Patient selection was based on the following inclusion criteria: those who underwent magnetic resonance imaging (MRI)-ultrasound fusion-targeted biopsy with frozen section analysis and concurrent RARP. Eligibility also required features indicative of Prostate Imaging-Reporting and Data System (PI-RADS) 5 lesion on multiparametric MRI, along with one of these additional criteria: (1) MRI evidence suggesting extracapsular extension (ECE) with a prostate-specific antigen (PSA) level >10 ng/mL, or (2) a PSA level > 20 ng/mL.
Results:
Twelve patients were enrolled in this study according to inclusion criteria. The median age (interquartile range) was 73.5 (69.5–75.3) years and PSA was 22.9 (17.0–29.9) ng/mL. Three patients had PI-RADS 5 lesions, and 9 had PI-RADS 5 lesions with findings of ECE. In all cases, the diagnosis based on frozen sections confirmed adenocarcinoma. Following confirmation, each patient underwent immediate RARP. According to the final pathology report, 2 patients had International Society of Urological Pathology (ISUP) grade 2 disease, 7 patients had ISUP grade 3, 1 had ISUP grade 4, and 2 had ISUP grade 5 disease. Four patients had stage pT2 disease, 3 had stage pT3a, and 5 had stage pT3b. The median immediate reporting time of the target biopsy frozen section was 20 (19.3–24.5) minutes. No perioperative complications related to target biopsy were observed.
Conclusion
For patients with a strong suspicion of prostate cancer and a PI-RADS 5 lesion, integrating simultaneous prostate frozen target biopsy with radical prostatectomy may offer a feasible treatment alternative, obviating the necessity for a preoperative systematic biopsy.
4.Lymphadenectomy in clinically early epithelial ovarian cancer and survival analysis (LILAC): a Gynecologic Oncology Research Investigators Collaboration (GORILLA-3002) retrospective study
Eun Jung YANG ; A Jin LEE ; Woo Yeon HWANG ; Suk-Joon CHANG ; Hee Seung KIM ; Nam Kyeong KIM ; Yeorae KIM ; Tae Wook KONG ; Eun Ji LEE ; Soo Jin PARK ; Joo-Hyuk SON ; Dong Hoon SUH ; Dong Hee SON ; Seung-Hyuk SHIM
Journal of Gynecologic Oncology 2024;35(4):e75-
Objective:
This study aimed to evaluate the therapeutic role of lymphadenectomy in patients surgically treated for clinically early-stage epithelial ovarian cancer (EOC).
Methods:
This retrospective, multicenter study included patients with clinically earlystage EOC based on preoperative abdominal-pelvic computed tomography or magnetic resonance imaging findings between 2007 and 2021. Oncologic outcomes and perioperative complications were compared between the lymphadenectomy and non-lymphadenectomy groups. Independent prognostic factors were determined using Cox regression analysis.Disease-free survival (DFS) was the primary outcome. Overall survival (OS) and perioperative outcomes were the secondary outcomes.
Results:
In total, 586 patients (lymphadenectomy group, n=453 [77.3%]; nonlymphadenectomy groups, n=133 [22.7%]) were eligible. After surgical staging, upstaging was identified based on the presence of lymph node metastasis in 14 (3.1%) of 453 patients.No significant difference was found in the 5-year DFS (88.9% vs. 83.4%, p=0.203) and 5-year OS (97.2% vs. 97.7%, p=0.895) between the two groups. Using multivariable analysis, lymphadenectomy was not significantly associated with DFS or OS. However, using subgroup analysis, the lymphadenectomy group with serous histology had higher 5-year DFS rates than did the non-lymphadenectomy group (86.5% vs. 74.4%, p=0.048; adjusted hazard ratio=0.281; 95% confidence interval=0.107–0.735; p=0.010). The lymphadenectomy group had longer operating time (p<0.001), higher estimated blood loss (p<0.001), and higher perioperative complication rate (p=0.004) than did the non-lymphadenectomy group.
Conclusion
In patients with clinically early-stage EOC with serous histology, lymphadenectomy was associated with survival benefits. Considering its potential harm,
5.Simultaneous Prostate Target Biopsy Integrated With Radical Prostatectomy: A Pilot Study Omitting Preoperative Systematic Biopsy
Tae Young PARK ; Jae Young HWANG ; Seong Woo YUN ; Chang Wan HYUN ; Sung Goo YOON ; Seung Bin KIM ; Tae Il NOH ; Ji Sung SHIM ; Min Goo PARK ; Seok Ho KANG ; Sung Gu KANG
Journal of Urologic Oncology 2024;22(3):196-200
Purpose:
This study evaluates the viability of a new method that employs transperineal targeted biopsy with frozen section analysis immediately followed by robot-assisted radical prostatectomy (RARP), bypassing the traditional systematic biopsy deemed essential by current guidelines.
Materials and Methods:
Patient selection was based on the following inclusion criteria: those who underwent magnetic resonance imaging (MRI)-ultrasound fusion-targeted biopsy with frozen section analysis and concurrent RARP. Eligibility also required features indicative of Prostate Imaging-Reporting and Data System (PI-RADS) 5 lesion on multiparametric MRI, along with one of these additional criteria: (1) MRI evidence suggesting extracapsular extension (ECE) with a prostate-specific antigen (PSA) level >10 ng/mL, or (2) a PSA level > 20 ng/mL.
Results:
Twelve patients were enrolled in this study according to inclusion criteria. The median age (interquartile range) was 73.5 (69.5–75.3) years and PSA was 22.9 (17.0–29.9) ng/mL. Three patients had PI-RADS 5 lesions, and 9 had PI-RADS 5 lesions with findings of ECE. In all cases, the diagnosis based on frozen sections confirmed adenocarcinoma. Following confirmation, each patient underwent immediate RARP. According to the final pathology report, 2 patients had International Society of Urological Pathology (ISUP) grade 2 disease, 7 patients had ISUP grade 3, 1 had ISUP grade 4, and 2 had ISUP grade 5 disease. Four patients had stage pT2 disease, 3 had stage pT3a, and 5 had stage pT3b. The median immediate reporting time of the target biopsy frozen section was 20 (19.3–24.5) minutes. No perioperative complications related to target biopsy were observed.
Conclusion
For patients with a strong suspicion of prostate cancer and a PI-RADS 5 lesion, integrating simultaneous prostate frozen target biopsy with radical prostatectomy may offer a feasible treatment alternative, obviating the necessity for a preoperative systematic biopsy.
6.Long-term Outcomes of Protocol-Based Treatment for Newly Diagnosed Medulloblastoma
Won Kee AHN ; Seung Min HAHN ; Hong In YOON ; Jeongshim LEE ; Eun Kyung PARK ; Kyu Won SHIM ; Dong Seok KIM ; Chang-Ok SUH ; Se Hoon KIM ; Chuhl Joo LYU ; Jung Woo HAN
Cancer Research and Treatment 2024;56(2):652-664
Purpose:
The Korean Society of Pediatric Neuro-Oncology (KSPNO) conducted treatment strategies for children with medulloblastoma (MB) by using alkylating agents for maintenance chemotherapy or tandem high-dose chemotherapy (HDC) with autologous stem cell rescue (ASCR) according to the risk stratification. The purpose of the study was to assess treatment outcomes and complications based on risk-adapted treatment and HDC.
Materials and Methods:
Fifty-nine patients diagnosed with MB were enrolled in this study. Patients in the standard-risk (SR) group received radiotherapy (RT) after surgery and chemotherapy using the KSPNO M051 regimen. Patients in the high-risk (HR) group received two and four chemotherapy cycles according to the KSPNO S081 protocol before and after reduced RT for age following surgery and two cycles of tandem HDC with ASCR consolidation treatment.
Results:
In the SR group, 24 patients showed 5-year event-free survival (EFS) and overall survival (OS) estimates of 86.7% (95% confidence interval [CI], 73.6 to 100) and 95.8% (95% CI, 88.2 to 100), respectively. In the HR group, more infectious complications and mortality occurred during the second HDC than during the first. In the HR group, the 5-year EFS and OS estimates were 65.5% (95% CI, 51.4 to 83.4) and 72.3% (95% CI, 58.4 to 89.6), respectively.
Conclusion
High intensity of alkylating agents for SR resulted in similar outcomes but with a high incidence of hematologic toxicity. Tandem HDC with ASCR for HR induced favorable EFS and OS estimates compared to those reported previously. However, infectious complications and treatment-related mortalities suggest that a reduced chemotherapy dose is necessary, especially for the second HDC.
7.Comparative Study on the Immunogenicity of COVID-19 mRNA Vaccines in Patients Receiving Adjuvant and Palliative Chemotherapy
Hyun-Woo CHOI ; Younggon JUNG ; Uh Jin KIM ; Sang-Cheol LEE ; Jung Hye KWON ; Hyeonjong KIM ; Sarah KIM ; Yoonjung LEE ; Hyun-Jung SHIM ; Sang-Hee CHO ; Ik-Joo CHUNG ; Eu Chang HWANG ; Seung Ji KANG ; Woo Kyun BAE ; Seung-Jung KEE
Chonnam Medical Journal 2024;60(1):69-77
This study was conducted to investigate potential differences in vaccine efficacy between patients undergoing palliative chemotherapy and receiving adjuvant chemotherapy. Additionally, the study proved the influence of vaccination timing on vaccine efficacy during active chemotherapy. Anti-receptor-binding domain (RBD) IgG binding antibody assays and surrogate neutralizing antibody assays were performed after BNT162b2 or mRNA-1273 vaccination in 45 solid cancer patients (23 adjuvant and 22 palliative chemotherapy) and in 24 healthy controls before vaccination (baseline), at every two to four weeks after the first (post-dose 1) and the second vaccination (post-dose 2). The levels of anti-RBD IgG and neutralizing antibodies increased significantly from baseline through post-dose 1 to post-dose 2 in all three groups. At the post-dose 1, the anti-RBD IgG and neutralizing antibody levels were significantly lower in cancer patients than in healthy controls. However, by post-dose 2, the seropositivity of anti-RBD IgG and neutralizing antibodies uniformly reached 100% across all groups, with no significant disparity in antibody levels among the three groups. Moreover, the antibody titers were not significantly different between patients with a vaccine and chemotherapy interval of more than 14 days or those with less than 14 days. This study demonstrated that after second doses of mRNA COVID-19 vaccines, humoral immune responses in patients receiving chemotherapy were comparable to those of healthy controls, regardless of whether the purpose of the anti-cancer treatment was palliative or adjuvant. Furthermore, the timing of vaccination did not affect the level of humoral immunity after the second vaccination.
8.Lymphadenectomy in clinically early epithelial ovarian cancer and survival analysis (LILAC): a Gynecologic Oncology Research Investigators Collaboration (GORILLA-3002) retrospective study
Eun Jung YANG ; A Jin LEE ; Woo Yeon HWANG ; Suk-Joon CHANG ; Hee Seung KIM ; Nam Kyeong KIM ; Yeorae KIM ; Tae Wook KONG ; Eun Ji LEE ; Soo Jin PARK ; Joo-Hyuk SON ; Dong Hoon SUH ; Dong Hee SON ; Seung-Hyuk SHIM
Journal of Gynecologic Oncology 2024;35(4):e75-
Objective:
This study aimed to evaluate the therapeutic role of lymphadenectomy in patients surgically treated for clinically early-stage epithelial ovarian cancer (EOC).
Methods:
This retrospective, multicenter study included patients with clinically earlystage EOC based on preoperative abdominal-pelvic computed tomography or magnetic resonance imaging findings between 2007 and 2021. Oncologic outcomes and perioperative complications were compared between the lymphadenectomy and non-lymphadenectomy groups. Independent prognostic factors were determined using Cox regression analysis.Disease-free survival (DFS) was the primary outcome. Overall survival (OS) and perioperative outcomes were the secondary outcomes.
Results:
In total, 586 patients (lymphadenectomy group, n=453 [77.3%]; nonlymphadenectomy groups, n=133 [22.7%]) were eligible. After surgical staging, upstaging was identified based on the presence of lymph node metastasis in 14 (3.1%) of 453 patients.No significant difference was found in the 5-year DFS (88.9% vs. 83.4%, p=0.203) and 5-year OS (97.2% vs. 97.7%, p=0.895) between the two groups. Using multivariable analysis, lymphadenectomy was not significantly associated with DFS or OS. However, using subgroup analysis, the lymphadenectomy group with serous histology had higher 5-year DFS rates than did the non-lymphadenectomy group (86.5% vs. 74.4%, p=0.048; adjusted hazard ratio=0.281; 95% confidence interval=0.107–0.735; p=0.010). The lymphadenectomy group had longer operating time (p<0.001), higher estimated blood loss (p<0.001), and higher perioperative complication rate (p=0.004) than did the non-lymphadenectomy group.
Conclusion
In patients with clinically early-stage EOC with serous histology, lymphadenectomy was associated with survival benefits. Considering its potential harm,
9.Simultaneous Prostate Target Biopsy Integrated With Radical Prostatectomy: A Pilot Study Omitting Preoperative Systematic Biopsy
Tae Young PARK ; Jae Young HWANG ; Seong Woo YUN ; Chang Wan HYUN ; Sung Goo YOON ; Seung Bin KIM ; Tae Il NOH ; Ji Sung SHIM ; Min Goo PARK ; Seok Ho KANG ; Sung Gu KANG
Journal of Urologic Oncology 2024;22(3):196-200
Purpose:
This study evaluates the viability of a new method that employs transperineal targeted biopsy with frozen section analysis immediately followed by robot-assisted radical prostatectomy (RARP), bypassing the traditional systematic biopsy deemed essential by current guidelines.
Materials and Methods:
Patient selection was based on the following inclusion criteria: those who underwent magnetic resonance imaging (MRI)-ultrasound fusion-targeted biopsy with frozen section analysis and concurrent RARP. Eligibility also required features indicative of Prostate Imaging-Reporting and Data System (PI-RADS) 5 lesion on multiparametric MRI, along with one of these additional criteria: (1) MRI evidence suggesting extracapsular extension (ECE) with a prostate-specific antigen (PSA) level >10 ng/mL, or (2) a PSA level > 20 ng/mL.
Results:
Twelve patients were enrolled in this study according to inclusion criteria. The median age (interquartile range) was 73.5 (69.5–75.3) years and PSA was 22.9 (17.0–29.9) ng/mL. Three patients had PI-RADS 5 lesions, and 9 had PI-RADS 5 lesions with findings of ECE. In all cases, the diagnosis based on frozen sections confirmed adenocarcinoma. Following confirmation, each patient underwent immediate RARP. According to the final pathology report, 2 patients had International Society of Urological Pathology (ISUP) grade 2 disease, 7 patients had ISUP grade 3, 1 had ISUP grade 4, and 2 had ISUP grade 5 disease. Four patients had stage pT2 disease, 3 had stage pT3a, and 5 had stage pT3b. The median immediate reporting time of the target biopsy frozen section was 20 (19.3–24.5) minutes. No perioperative complications related to target biopsy were observed.
Conclusion
For patients with a strong suspicion of prostate cancer and a PI-RADS 5 lesion, integrating simultaneous prostate frozen target biopsy with radical prostatectomy may offer a feasible treatment alternative, obviating the necessity for a preoperative systematic biopsy.
10.Lymphadenectomy in clinically early epithelial ovarian cancer and survival analysis (LILAC): a Gynecologic Oncology Research Investigators Collaboration (GORILLA-3002) retrospective study
Eun Jung YANG ; A Jin LEE ; Woo Yeon HWANG ; Suk-Joon CHANG ; Hee Seung KIM ; Nam Kyeong KIM ; Yeorae KIM ; Tae Wook KONG ; Eun Ji LEE ; Soo Jin PARK ; Joo-Hyuk SON ; Dong Hoon SUH ; Dong Hee SON ; Seung-Hyuk SHIM
Journal of Gynecologic Oncology 2024;35(4):e75-
Objective:
This study aimed to evaluate the therapeutic role of lymphadenectomy in patients surgically treated for clinically early-stage epithelial ovarian cancer (EOC).
Methods:
This retrospective, multicenter study included patients with clinically earlystage EOC based on preoperative abdominal-pelvic computed tomography or magnetic resonance imaging findings between 2007 and 2021. Oncologic outcomes and perioperative complications were compared between the lymphadenectomy and non-lymphadenectomy groups. Independent prognostic factors were determined using Cox regression analysis.Disease-free survival (DFS) was the primary outcome. Overall survival (OS) and perioperative outcomes were the secondary outcomes.
Results:
In total, 586 patients (lymphadenectomy group, n=453 [77.3%]; nonlymphadenectomy groups, n=133 [22.7%]) were eligible. After surgical staging, upstaging was identified based on the presence of lymph node metastasis in 14 (3.1%) of 453 patients.No significant difference was found in the 5-year DFS (88.9% vs. 83.4%, p=0.203) and 5-year OS (97.2% vs. 97.7%, p=0.895) between the two groups. Using multivariable analysis, lymphadenectomy was not significantly associated with DFS or OS. However, using subgroup analysis, the lymphadenectomy group with serous histology had higher 5-year DFS rates than did the non-lymphadenectomy group (86.5% vs. 74.4%, p=0.048; adjusted hazard ratio=0.281; 95% confidence interval=0.107–0.735; p=0.010). The lymphadenectomy group had longer operating time (p<0.001), higher estimated blood loss (p<0.001), and higher perioperative complication rate (p=0.004) than did the non-lymphadenectomy group.
Conclusion
In patients with clinically early-stage EOC with serous histology, lymphadenectomy was associated with survival benefits. Considering its potential harm,

Result Analysis
Print
Save
E-mail