1.Explainability Enhanced Machine Learning Model for Classifying Intellectual Disability and AttentionDeficit/Hyperactivity Disorder With Psychological Test Reports
Tong Min KIM ; Young-Hoon KIM ; Sung-Hee SONG ; In-Young CHOI ; Dai-Jin KIM ; Taehoon KO
Journal of Korean Medical Science 2025;40(11):e26-
Background:
Psychological test reports are essential in assessing intellectual functioning, aiding in diagnosing and treating intellectual disability (ID) and attention-deficit/ hyperactivity disorder (ADHD). However, these reports can have several problems because they are diverse, unstructured, subjective, and involve human errors. Additionally, physicians often do not read the entire report, and the number of reports is lower than that of diagnoses.
Methods:
We developed explainable predictive models for classifying IDs and ADHDs based on written reports to address these issues. The reports of 1,475 patients with IDs and ADHDs who underwent intelligence tests were used for the models. These models were developed by analyzing reports using natural language processing (NLP) and incorporating the physician’s diagnosis for each report. We selected n-gram features from the models’ results by extracting important features using SHapley Additive exPlanations and permutation importance to make the models explainable. Developing the n-gram feature-based original text search system compensated for the lack of human readability caused by NLP and enabled the reconstruction of human-readable texts from the selected n-gram features.
Results:
The maximum model accuracy was 0.92, and the 80 human-readable texts were restored from four models.
Conclusion
The results showed that the models could accurately classify IDs and ADHDs, even with a few reports. The models were also able to explain their predictions. The explainability-enhanced model can help physicians understand the classification process of IDs and ADHDs and provide evidence-based insights.
2.Dementia Overdiagnosis in Younger, Higher Educated Individuals Based on MMSE Alone: Analysis Using Deep Learning Technology
Hye-Geum KIM ; Dai-Seg BAI ; Bon-Hoon KOO ; Eun-Jin CHEON ; Seokho YUN ; So Hye JO ; Byoungyoung GU
Journal of Korean Medical Science 2025;40(9):e20-
Background:
Dementia is a multifaceted disorder that affects cognitive function, necessitating accurate diagnosis for effective management and treatment. Although the Mini-Mental State Examination (MMSE) is widely used to assess cognitive impairment, its standalone efficacy is debated. This study examined the effectiveness of the MMSE alone versus in combination with other cognitive assessments in predicting dementia diagnosis, with the aim of refining the diagnostic accuracy for dementia.
Methods:
A total of 2,863 participants with subjective cognitive complaints who underwent comprehensive neuropsychological assessments were included. We developed two random forest models: one using only the MMSE and another incorporating additional cognitive tests.These models were evaluated based on their accuracy, precision, recall, F1-score, and area under the receiver operating characteristic curve (AUC) on a 70:30 training-to-testing split.
Results:
The MMSE-alone model predicted dementia with an accuracy of 86% and AUC of 0.872. The expanded model demonstrated increased accuracy (88%) and an AUC of 0.934.Notably, 17.46% of the cases were reclassified from dementia to non-dementia category upon including additional tests. Higher educational level and younger age were associated with these shifts.
Conclusion
The findings suggest that although the MMSE is a valuable screening tool, it should not be used in isolation to determine dementia severity. The addition of diverse cognitive assessments can significantly enhance diagnostic precision, particularly in younger and more educated populations. Future diagnostic protocols should integrate multifaceted cognitive evaluations to reflect the complexity of dementia accurately.
3.Explainability Enhanced Machine Learning Model for Classifying Intellectual Disability and AttentionDeficit/Hyperactivity Disorder With Psychological Test Reports
Tong Min KIM ; Young-Hoon KIM ; Sung-Hee SONG ; In-Young CHOI ; Dai-Jin KIM ; Taehoon KO
Journal of Korean Medical Science 2025;40(11):e26-
Background:
Psychological test reports are essential in assessing intellectual functioning, aiding in diagnosing and treating intellectual disability (ID) and attention-deficit/ hyperactivity disorder (ADHD). However, these reports can have several problems because they are diverse, unstructured, subjective, and involve human errors. Additionally, physicians often do not read the entire report, and the number of reports is lower than that of diagnoses.
Methods:
We developed explainable predictive models for classifying IDs and ADHDs based on written reports to address these issues. The reports of 1,475 patients with IDs and ADHDs who underwent intelligence tests were used for the models. These models were developed by analyzing reports using natural language processing (NLP) and incorporating the physician’s diagnosis for each report. We selected n-gram features from the models’ results by extracting important features using SHapley Additive exPlanations and permutation importance to make the models explainable. Developing the n-gram feature-based original text search system compensated for the lack of human readability caused by NLP and enabled the reconstruction of human-readable texts from the selected n-gram features.
Results:
The maximum model accuracy was 0.92, and the 80 human-readable texts were restored from four models.
Conclusion
The results showed that the models could accurately classify IDs and ADHDs, even with a few reports. The models were also able to explain their predictions. The explainability-enhanced model can help physicians understand the classification process of IDs and ADHDs and provide evidence-based insights.
4.Dementia Overdiagnosis in Younger, Higher Educated Individuals Based on MMSE Alone: Analysis Using Deep Learning Technology
Hye-Geum KIM ; Dai-Seg BAI ; Bon-Hoon KOO ; Eun-Jin CHEON ; Seokho YUN ; So Hye JO ; Byoungyoung GU
Journal of Korean Medical Science 2025;40(9):e20-
Background:
Dementia is a multifaceted disorder that affects cognitive function, necessitating accurate diagnosis for effective management and treatment. Although the Mini-Mental State Examination (MMSE) is widely used to assess cognitive impairment, its standalone efficacy is debated. This study examined the effectiveness of the MMSE alone versus in combination with other cognitive assessments in predicting dementia diagnosis, with the aim of refining the diagnostic accuracy for dementia.
Methods:
A total of 2,863 participants with subjective cognitive complaints who underwent comprehensive neuropsychological assessments were included. We developed two random forest models: one using only the MMSE and another incorporating additional cognitive tests.These models were evaluated based on their accuracy, precision, recall, F1-score, and area under the receiver operating characteristic curve (AUC) on a 70:30 training-to-testing split.
Results:
The MMSE-alone model predicted dementia with an accuracy of 86% and AUC of 0.872. The expanded model demonstrated increased accuracy (88%) and an AUC of 0.934.Notably, 17.46% of the cases were reclassified from dementia to non-dementia category upon including additional tests. Higher educational level and younger age were associated with these shifts.
Conclusion
The findings suggest that although the MMSE is a valuable screening tool, it should not be used in isolation to determine dementia severity. The addition of diverse cognitive assessments can significantly enhance diagnostic precision, particularly in younger and more educated populations. Future diagnostic protocols should integrate multifaceted cognitive evaluations to reflect the complexity of dementia accurately.
5.Explainability Enhanced Machine Learning Model for Classifying Intellectual Disability and AttentionDeficit/Hyperactivity Disorder With Psychological Test Reports
Tong Min KIM ; Young-Hoon KIM ; Sung-Hee SONG ; In-Young CHOI ; Dai-Jin KIM ; Taehoon KO
Journal of Korean Medical Science 2025;40(11):e26-
Background:
Psychological test reports are essential in assessing intellectual functioning, aiding in diagnosing and treating intellectual disability (ID) and attention-deficit/ hyperactivity disorder (ADHD). However, these reports can have several problems because they are diverse, unstructured, subjective, and involve human errors. Additionally, physicians often do not read the entire report, and the number of reports is lower than that of diagnoses.
Methods:
We developed explainable predictive models for classifying IDs and ADHDs based on written reports to address these issues. The reports of 1,475 patients with IDs and ADHDs who underwent intelligence tests were used for the models. These models were developed by analyzing reports using natural language processing (NLP) and incorporating the physician’s diagnosis for each report. We selected n-gram features from the models’ results by extracting important features using SHapley Additive exPlanations and permutation importance to make the models explainable. Developing the n-gram feature-based original text search system compensated for the lack of human readability caused by NLP and enabled the reconstruction of human-readable texts from the selected n-gram features.
Results:
The maximum model accuracy was 0.92, and the 80 human-readable texts were restored from four models.
Conclusion
The results showed that the models could accurately classify IDs and ADHDs, even with a few reports. The models were also able to explain their predictions. The explainability-enhanced model can help physicians understand the classification process of IDs and ADHDs and provide evidence-based insights.
6.Dementia Overdiagnosis in Younger, Higher Educated Individuals Based on MMSE Alone: Analysis Using Deep Learning Technology
Hye-Geum KIM ; Dai-Seg BAI ; Bon-Hoon KOO ; Eun-Jin CHEON ; Seokho YUN ; So Hye JO ; Byoungyoung GU
Journal of Korean Medical Science 2025;40(9):e20-
Background:
Dementia is a multifaceted disorder that affects cognitive function, necessitating accurate diagnosis for effective management and treatment. Although the Mini-Mental State Examination (MMSE) is widely used to assess cognitive impairment, its standalone efficacy is debated. This study examined the effectiveness of the MMSE alone versus in combination with other cognitive assessments in predicting dementia diagnosis, with the aim of refining the diagnostic accuracy for dementia.
Methods:
A total of 2,863 participants with subjective cognitive complaints who underwent comprehensive neuropsychological assessments were included. We developed two random forest models: one using only the MMSE and another incorporating additional cognitive tests.These models were evaluated based on their accuracy, precision, recall, F1-score, and area under the receiver operating characteristic curve (AUC) on a 70:30 training-to-testing split.
Results:
The MMSE-alone model predicted dementia with an accuracy of 86% and AUC of 0.872. The expanded model demonstrated increased accuracy (88%) and an AUC of 0.934.Notably, 17.46% of the cases were reclassified from dementia to non-dementia category upon including additional tests. Higher educational level and younger age were associated with these shifts.
Conclusion
The findings suggest that although the MMSE is a valuable screening tool, it should not be used in isolation to determine dementia severity. The addition of diverse cognitive assessments can significantly enhance diagnostic precision, particularly in younger and more educated populations. Future diagnostic protocols should integrate multifaceted cognitive evaluations to reflect the complexity of dementia accurately.
7.Explainability Enhanced Machine Learning Model for Classifying Intellectual Disability and AttentionDeficit/Hyperactivity Disorder With Psychological Test Reports
Tong Min KIM ; Young-Hoon KIM ; Sung-Hee SONG ; In-Young CHOI ; Dai-Jin KIM ; Taehoon KO
Journal of Korean Medical Science 2025;40(11):e26-
Background:
Psychological test reports are essential in assessing intellectual functioning, aiding in diagnosing and treating intellectual disability (ID) and attention-deficit/ hyperactivity disorder (ADHD). However, these reports can have several problems because they are diverse, unstructured, subjective, and involve human errors. Additionally, physicians often do not read the entire report, and the number of reports is lower than that of diagnoses.
Methods:
We developed explainable predictive models for classifying IDs and ADHDs based on written reports to address these issues. The reports of 1,475 patients with IDs and ADHDs who underwent intelligence tests were used for the models. These models were developed by analyzing reports using natural language processing (NLP) and incorporating the physician’s diagnosis for each report. We selected n-gram features from the models’ results by extracting important features using SHapley Additive exPlanations and permutation importance to make the models explainable. Developing the n-gram feature-based original text search system compensated for the lack of human readability caused by NLP and enabled the reconstruction of human-readable texts from the selected n-gram features.
Results:
The maximum model accuracy was 0.92, and the 80 human-readable texts were restored from four models.
Conclusion
The results showed that the models could accurately classify IDs and ADHDs, even with a few reports. The models were also able to explain their predictions. The explainability-enhanced model can help physicians understand the classification process of IDs and ADHDs and provide evidence-based insights.
8.Dementia Overdiagnosis in Younger, Higher Educated Individuals Based on MMSE Alone: Analysis Using Deep Learning Technology
Hye-Geum KIM ; Dai-Seg BAI ; Bon-Hoon KOO ; Eun-Jin CHEON ; Seokho YUN ; So Hye JO ; Byoungyoung GU
Journal of Korean Medical Science 2025;40(9):e20-
Background:
Dementia is a multifaceted disorder that affects cognitive function, necessitating accurate diagnosis for effective management and treatment. Although the Mini-Mental State Examination (MMSE) is widely used to assess cognitive impairment, its standalone efficacy is debated. This study examined the effectiveness of the MMSE alone versus in combination with other cognitive assessments in predicting dementia diagnosis, with the aim of refining the diagnostic accuracy for dementia.
Methods:
A total of 2,863 participants with subjective cognitive complaints who underwent comprehensive neuropsychological assessments were included. We developed two random forest models: one using only the MMSE and another incorporating additional cognitive tests.These models were evaluated based on their accuracy, precision, recall, F1-score, and area under the receiver operating characteristic curve (AUC) on a 70:30 training-to-testing split.
Results:
The MMSE-alone model predicted dementia with an accuracy of 86% and AUC of 0.872. The expanded model demonstrated increased accuracy (88%) and an AUC of 0.934.Notably, 17.46% of the cases were reclassified from dementia to non-dementia category upon including additional tests. Higher educational level and younger age were associated with these shifts.
Conclusion
The findings suggest that although the MMSE is a valuable screening tool, it should not be used in isolation to determine dementia severity. The addition of diverse cognitive assessments can significantly enhance diagnostic precision, particularly in younger and more educated populations. Future diagnostic protocols should integrate multifaceted cognitive evaluations to reflect the complexity of dementia accurately.
9.Predicting Treatment Response to Antidepressants in Patients with Major Depressive Disorder Based on Longitudinal Clinical Data Using Artificial Intelligence:A Pilot Study
Junhee LEE ; Seung-Hwan BAEK ; Min-Kyung JANG ; Hyeon-Hee SIM ; In Young CHOI ; Dai-Jin KIM
Mood and Emotion 2024;22(3):63-68
Background:
The diagnosis of major depressive disorder (MDD) relies primarily on clinical interviews, which can be subjective and time consuming. Thus, there is a need for more objective diagnostic tools. The aim of this study was to develop an artificial intelligence (AI) application that predicts the antidepressant drug response of individual patients with MDD based on longitudinal data.
Methods:
Longitudinal data from patient records, including sex, age, outpatient or inpatient status, medication type and dosage, and the Hamilton Depression Rating Scale (HAMD) scores, were used to train the Transformer model and the 1-dimensional convolutional neural network model. Individual patient records were allocated to training (80%), validation (10%), and testing (10%) datasets.
Results:
The AI model demonstrated 88% sensitivity and 92% specificity for predicting the treatment response. Significant factors independently associated with the antidepressant response included age, sex, history of depression, and baseline HAMD scores.
Conclusion
This AI-driven software application provides a clinically valuable tool for predicting treatment response.While promising, further research is needed to incorporate voice data into the AI model using the voice recording feature to further improve diagnostic accuracy.
10.Predicting Treatment Response to Antidepressants in Patients with Major Depressive Disorder Based on Longitudinal Clinical Data Using Artificial Intelligence:A Pilot Study
Junhee LEE ; Seung-Hwan BAEK ; Min-Kyung JANG ; Hyeon-Hee SIM ; In Young CHOI ; Dai-Jin KIM
Mood and Emotion 2024;22(3):63-68
Background:
The diagnosis of major depressive disorder (MDD) relies primarily on clinical interviews, which can be subjective and time consuming. Thus, there is a need for more objective diagnostic tools. The aim of this study was to develop an artificial intelligence (AI) application that predicts the antidepressant drug response of individual patients with MDD based on longitudinal data.
Methods:
Longitudinal data from patient records, including sex, age, outpatient or inpatient status, medication type and dosage, and the Hamilton Depression Rating Scale (HAMD) scores, were used to train the Transformer model and the 1-dimensional convolutional neural network model. Individual patient records were allocated to training (80%), validation (10%), and testing (10%) datasets.
Results:
The AI model demonstrated 88% sensitivity and 92% specificity for predicting the treatment response. Significant factors independently associated with the antidepressant response included age, sex, history of depression, and baseline HAMD scores.
Conclusion
This AI-driven software application provides a clinically valuable tool for predicting treatment response.While promising, further research is needed to incorporate voice data into the AI model using the voice recording feature to further improve diagnostic accuracy.

Result Analysis
Print
Save
E-mail