2.How to Develop, Validate, and Compare Clinical Prediction Models Involving Radiological Parameters: Study Design and Statistical Methods.
Kyunghwa HAN ; Kijun SONG ; Byoung Wook CHOI
Korean Journal of Radiology 2016;17(3):339-350
Clinical prediction models are developed to calculate estimates of the probability of the presence/occurrence or future course of a particular prognostic or diagnostic outcome from multiple clinical or non-clinical parameters. Radiologic imaging techniques are being developed for accurate detection and early diagnosis of disease, which will eventually affect patient outcomes. Hence, results obtained by radiological means, especially diagnostic imaging, are frequently incorporated into a clinical prediction model as important predictive parameters, and the performance of the prediction model may improve in both diagnostic and prognostic settings. This article explains in a conceptual manner the overall process of developing and validating a clinical prediction model involving radiological parameters in relation to the study design and statistical methods. Collection of a raw dataset; selection of an appropriate statistical model; predictor selection; evaluation of model performance using a calibration plot, Hosmer-Lemeshow test and c-index; internal and external validation; comparison of different models using c-index, net reclassification improvement, and integrated discrimination improvement; and a method to create an easy-to-use prediction score system will be addressed. This article may serve as a practical methodological reference for clinical researchers.
Calibration
;
Dataset
;
Diagnosis
;
Diagnostic Imaging
;
Discrimination (Psychology)
;
Early Diagnosis
;
Humans
;
Methods*
;
Models, Statistical
;
Prognosis
3.Research Designs and Statistical Methods Trends in the Annals of Rehabilitation Medicine.
Jinmo KIM ; Seihee YOON ; Jung Joong KANG ; Kyunghwa HAN ; Jong Moon KIM ; Shin Kyoung KIM
Annals of Rehabilitation Medicine 2017;41(3):475-482
OBJECTIVE: To investigate trends of the research designs and statistical methods in the Annals of Rehabilitation Medicine (ARM) published from 2005 to 2015 through a comparison of articles with the Archives of Physical Medicine and Rehabilitation (APMR). METHODS: The authors reviewed all articles published in ARM and APMR for the years 2005 and 2015 in order to determine their research designs as well as their statistical methods used in each article. RESULTS: In ARM, randomized controlled trials increased from 4.5% in 2005 to 6.5% in 2015. In APMR, randomized controlled trials increased from 8.1% in 2005 to 14.0% in 2015, meta-analyses increased to 5.3%, and systematic reviews increased to 6%. The number of studies using statistical methods increased in ARM from 1.9 to 2.6 per article and in APMR, from 2.7 to 3.1. Use of advanced methods in ARM also showed an increase from 2005 to 2015. CONCLUSION: This study concludes that there is a trend of increased awareness and attempts to use varied research approaches in ARM articles. There should also be more in-depth discussions and opportunities for researchers to share their experiences regarding statistical methods in the clinical field.
Arm
;
Evidence-Based Medicine
;
Methods*
;
Physical and Rehabilitation Medicine
;
Rehabilitation*
;
Research Design*
4.Anterior Optic Pathway Compression Due to Internal Carotid Artery Aneurysms: Neurosurgical Management and Outcomes.
Wonhyoung PARK ; Jung Cheol PARK ; Kyunghwa HAN ; Jae Sung AHN ; Byung Duk KWUN
Journal of Stroke 2015;17(3):344-353
BACKGROUND AND PURPOSE: Compression of the anterior optic pathway results in visual deficits that can lead to the detection of unruptured aneurysms in the internal carotid artery (ICA). The general types of treatment modalities for aneurysms and visual deficits include surgery and endosaccular coiling. This study retrospectively analyzed and compared the resolution of visual deficits following surgery or endosaccular coiling. METHODS: We reviewed data on 33 patients with unruptured ICA aneurysms who presented with visual field deficits caused by mass effects over the anterior optic pathway. Statistical analyses were performed to identify the variables associated with the recovery of visual symptoms. RESULTS: Eighteen patients underwent aneurysm clipping, 2 underwent bypass surgery with endovascular trapping, and 2 underwent endovascular trapping without bypass surgery (group A). Ten patients received endosaccular coiling (group B). The visual outcomes included the following: in group A, 17 patients (73.9%) demonstrated improvement and 6 patients (26.1%) demonstrated no changes or worse outcomes; in group B, 2 patients (20.0%) demonstrated improvement and 8 patients (80.0%) demonstrated no changes or worse outcomes. Group A was associated with a higher rate of favorable outcome than group B (P = 0.007). According to the multivariate analysis, treatment without endosaccular coiling (group A) was the only variable significantly associated with improvement of visual outcome (P = 0.005; OR = 28.523; 95% CI = 2.683-303.171). CONCLUSIONS: Treatment modality was the only predictor of improvement in visual deficits. Treatment without endosaccular coiling resulted in visual improvement significantly more often in comparison with endosaccular coiling.
Aneurysm*
;
Carotid Artery, Internal*
;
Humans
;
Multivariate Analysis
;
Retrospective Studies
;
Visual Fields
5.Reliability of Coronary Artery Calcium Severity Assessment on Non-Electrocardiogram-Gated CT:A Meta-Analysis
Jin Young KIM ; Young Joo SUH ; Kyunghwa HAN ; Byoung Wook CHOI
Korean Journal of Radiology 2021;22(7):1034-1043
Objective:
The purpose of this meta-analysis was to investigate the pooled agreements of the coronary artery calcium (CAC) severities assessed by electrocardiogram (ECG)-gated and non-ECG-gated CT and evaluate the impact of the scan parameters.
Materials and Methods:
PubMed, EMBASE, and the Cochrane library were systematically searched. A modified Quality Assessment of Diagnostic Accuracy Studies-2 tool was used to evaluate the quality of the studies. Meta-analytic methods were utilized to determine the pooled weighted bias, limits of agreement (LOA), and the correlation coefficient of the CAC scores or the weighted kappa for the categorization of the CAC severities detected by the two modalities. The heterogeneity among the studies was also assessed. Subgroup analyses were performed based on factors that could affect the measurement of the CAC score and severity: slice thickness, reconstruction kernel, and radiation dose for non-ECG-gated CT.
Results:
A total of 4000 patients from 16 studies were included. The pooled bias was 62.60, 95% LOA were -36.19 to 161.40, and the pooled correlation coefficient was 0.94 (95% confidence interval [CI] = 0.89–0.97) for the CAC score. The pooled weighted kappa of the CAC severity was 0.85 (95% CI = 0.79–0.91). Heterogeneity was observed in the studies (I2 > 50%, p < 0.1). In the subgroup analysis, the agreement between the CAC categorizations was better when the two CT examinations had reconstructions based on the same slice thickness and kernel.
Conclusion
The pooled agreement of the CAC severities assessed by the ECG-gated and non-ECG-gated CT was excellent; however, it was significantly affected by scan parameters, such as slice thickness and the reconstruction kernel.
6.Trends in statistical methods in articles published in Archives of Plastic Surgery between 2012 and 2017.
Archives of Plastic Surgery 2018;45(3):207-213
This review article presents an assessment of trends in statistical methods and an evaluation of their appropriateness in articles published in the Archives of Plastic Surgery (APS) from 2012 to 2017. We reviewed 388 original articles published in APS between 2012 and 2017. We categorized the articles that used statistical methods according to the type of statistical method, the number of statistical methods, and the type of statistical software used. We checked whether there were errors in the description of statistical methods and results. A total of 230 articles (59.3%) published in APS between 2012 and 2017 used one or more statistical method. Within these articles, there were 261 applications of statistical methods with continuous or ordinal outcomes, and 139 applications of statistical methods with categorical outcome. The Pearson chi-square test (17.4%) and the Mann-Whitney U test (14.4%) were the most frequently used methods. Errors in describing statistical methods and results were found in 133 of the 230 articles (57.8%). Inadequate description of P-values was the most common error (39.1%). Among the 230 articles that used statistical methods, 71.7% provided details about the statistical software programs used for the analyses. SPSS was predominantly used in the articles that presented statistical analyses. We found that the use of statistical methods in APS has increased over the last 6 years. It seems that researchers have been paying more attention to the proper use of statistics in recent years. It is expected that these positive trends will continue in APS.
Methods*
;
Plastics*
;
Surgery, Plastic*
7.Cardiac CT for Measurement of Right Ventricular Volume and Function in Comparison with Cardiac MRI: A Meta-Analysis
Jin Young KIM ; Young Joo SUH ; Kyunghwa HAN ; Young Jin KIM ; Byoung Wook CHOI
Korean Journal of Radiology 2020;21(4):450-461
OBJECTIVE: We performed a meta-analysis to evaluate the agreement of cardiac computed tomography (CT) with cardiac magnetic resonance imaging (CMRI) in the assessment of right ventricle (RV) volume and functional parameters.MATERIALS AND METHODS: PubMed, EMBASE, and Cochrane library were systematically searched for studies that compared CT with CMRI as the reference standard for measurement of the following RV parameters: end-diastolic volume (EDV), end-systolic volume (ESV), stroke volume (SV), or ejection fraction (EF). Meta-analytic methods were utilized to determine the pooled weighted bias, limits of agreement (LOA), and correlation coefficient (r) between CT and CMRI. Heterogeneity was also assessed. Subgroup analyses were performed based on the probable factors affecting measurement of RV volume: CT contrast protocol, number of CT slices, CT reconstruction interval, CT volumetry, and segmentation methods.RESULTS: A total of 766 patients from 20 studies were included. Pooled bias and LOA were 3.1 mL (−5.7 to 11.8 mL), 3.6 mL (−4.0 to 11.2 mL), −0.4 mL (5.7 to 5.0 mL), and −1.8% (−5.7 to 2.2%) for EDV, ESV, SV, and EF, respectively. Pooled correlation coefficients were very strong for the RV parameters (r = 0.87–0.93). Heterogeneity was observed in the studies (I2 > 50%, p < 0.1). In the subgroup analysis, an RV-dedicated contrast protocol, ≥ 64 CT slices, CT volumetry with the Simpson's method, and inclusion of the papillary muscle and trabeculation had a lower pooled bias and narrower LOA.CONCLUSION: Cardiac CT accurately measures RV volume and function, with an acceptable range of bias and LOA and strong correlation with CMRI findings. The RV-dedicated CT contrast protocol, ≥ 64 CT slices, and use of the same CT volumetry method as CMRI can improve agreement with CMRI.
8.Reliability of Coronary Artery Calcium Severity Assessment on Non-Electrocardiogram-Gated CT:A Meta-Analysis
Jin Young KIM ; Young Joo SUH ; Kyunghwa HAN ; Byoung Wook CHOI
Korean Journal of Radiology 2021;22(7):1034-1043
Objective:
The purpose of this meta-analysis was to investigate the pooled agreements of the coronary artery calcium (CAC) severities assessed by electrocardiogram (ECG)-gated and non-ECG-gated CT and evaluate the impact of the scan parameters.
Materials and Methods:
PubMed, EMBASE, and the Cochrane library were systematically searched. A modified Quality Assessment of Diagnostic Accuracy Studies-2 tool was used to evaluate the quality of the studies. Meta-analytic methods were utilized to determine the pooled weighted bias, limits of agreement (LOA), and the correlation coefficient of the CAC scores or the weighted kappa for the categorization of the CAC severities detected by the two modalities. The heterogeneity among the studies was also assessed. Subgroup analyses were performed based on factors that could affect the measurement of the CAC score and severity: slice thickness, reconstruction kernel, and radiation dose for non-ECG-gated CT.
Results:
A total of 4000 patients from 16 studies were included. The pooled bias was 62.60, 95% LOA were -36.19 to 161.40, and the pooled correlation coefficient was 0.94 (95% confidence interval [CI] = 0.89–0.97) for the CAC score. The pooled weighted kappa of the CAC severity was 0.85 (95% CI = 0.79–0.91). Heterogeneity was observed in the studies (I2 > 50%, p < 0.1). In the subgroup analysis, the agreement between the CAC categorizations was better when the two CT examinations had reconstructions based on the same slice thickness and kernel.
Conclusion
The pooled agreement of the CAC severities assessed by the ECG-gated and non-ECG-gated CT was excellent; however, it was significantly affected by scan parameters, such as slice thickness and the reconstruction kernel.
9.Regional Amyloid Burden Differences Evaluated Using Quantitative Cardiac MRI in Patients with Cardiac Amyloidosis
Jin Young KIM ; Yoo Jin HONG ; Kyunghwa HAN ; Hye-Jeong LEE ; Jin HUR ; Young Jin KIM ; Byoung Wook CHOI
Korean Journal of Radiology 2021;22(6):880-889
Objective:
This study aimed to investigate the regional amyloid burden and myocardial deformation using T1 mapping and strain values in patients with cardiac amyloidosis (CA) according to late gadolinium enhancement (LGE) patterns.
Materials and Methods:
Forty patients with CA were divided into 2 groups per LGE pattern, and 15 healthy subjects were enrolled. Global and regional native T1 and T2 mapping, extracellular volume (ECV), and cardiac magnetic resonance (CMR)-feature tracking strain values were compared in an intergroup and interregional manner.
Results:
Of the patients with CA, 32 had diffuse global LGE (group 2), and 8 had focal patchy or no LGE (group 1). Global native T1, T2, and ECV were significantly higher in groups 1 and 2 than in the control group (native T1: 1384.4 ms vs. 1466.8 ms vs. 1230.5 ms; T2: 53.8 ms vs. 54.2 ms vs. 48.9 ms; and ECV: 36.9% vs. 51.4% vs. 26.0%, respectively; all, p < 0.001). Basal ECV (53.7%) was significantly higher than the mid and apical ECVs (50.1% and 50.0%, respectively; p < 0.001) in group 2. Basal and mid peak radial strains (PRSs) and peak circumferential strains (PCSs) were significantly lower than the apical PRS and PCS, respectively (PRS, 15.6% vs. 16.7% vs. 26.9%; and PCS, -9.7% vs. -10.9% vs. -15.0%; all, p < 0.001). Basal ECV and basal strain (2-dimensional PRS) in group 2 showed a significant negative correlation (r = -0.623, p < 0.001). Group 1 showed no regional ECV differences (basal, 37.0%; mid, 35.9%; and apical, 38.3%; p = 0.184).
Conclusion
Quantitative T1 mapping parameters such as native T1 and ECV may help diagnose early CA. ECV, in particular, can reflect regional differences in the amyloid deposition in patients with advanced CA, and increased basal ECV is related to decreased basal strain. Therefore, quantitative CMR parameters may help diagnose CA and determine its severity in patients with or without LGE.