1.Performance evaluation of lightweight Chinese large language models integrated with retrieval-augmented generation technology in answering specialized lung cancer questions
Zhizhen REN ; Yile LI ; Yizhuo MA ; Qizhi CHEN ; Jili LI ; Siyi YANG ; Jianhao ZHANG ; Ke QIN ; Qiang PU ; Nan CHEN ; Lunxu LIU
Chinese Journal of Clinical Thoracic and Cardiovascular Surgery 2026;33(09):1403-1411
Objective To evaluate the performance of lightweight Chinese large language models (LLMs) in answering specialized lung cancer questions, and to explore the impact of retrieval-augmented generation (RAG) on model performance. Methods Eleven lightweight Chinese LLMs with parameter sizes ranging from 7B to 32B were included. A lung cancer-specific evaluation dataset consisting of 200 questions [100 A1-type (basic knowledge) and 100 A2-type (clinical case) questions], constructed based on clinical guidelines and thoracic surgery textbooks, was used for assessment. Model performance was evaluated under two conditions (with and without RAG). Accuracy was used to assess model performance, and response latency was recorded to reflect inference efficiency. An accuracy–latency scatter plot was constructed for descriptive analysis of overall model performance. Results All models successfully completed the evaluation. With the introduction of RAG, the overall average accuracy improved from 61.68% to 76.36%. Smaller models demonstrated the most significant improvement (e.g., the accuracy of DeepSeek-7B increased from 32.50% to 60.00%, P<0.001). The average response latency increased from 12.58 s to 13.80 s. The Qwen3 series showed the best overall performance, and Qwen3-32B achieved the highest accuracy under both conditions (76.50% and 84.00%, respectively). After RAG integration, performance differences among model families were markedly reduced. Based on the accuracy-latency trade-off, Qwen3-32B achieved the best balance between accuracy and response latency under the baseline condition, whereas Qwen3-14B demonstrated superior overall performance in terms of accuracy, latency, and computational cost after RAG integration. Conclusion The integration of RAG technology improves the ability of lightweight Chinese LLMs to answer specialized lung cancer questions. Under the dual practical constraints of limited computational resources and medical data security requirements, the "lightweight model+RAG" technical framework may represent a promising deployment solution.
2.Intelligent handheld ultrasound improving the ability of non-expert general practitioners in carotid examinations for community populations: a prospective and parallel controlled trial
Pei SUN ; Hong HAN ; Yi-Kang SUN ; Xi WANG ; Xiao-Chuan LIU ; Bo-Yang ZHOU ; Li-Fan WANG ; Ya-Qin ZHANG ; Zhi-Gang PAN ; Bei-Jian HUANG ; Hui-Xiong XU ; Chong-Ke ZHAO
Ultrasonography 2025;44(2):112-123
Purpose:
The aim of this study was to investigate the feasibility of an intelligent handheld ultrasound (US) device for assisting non-expert general practitioners (GPs) in detecting carotid plaques (CPs) in community populations.
Methods:
This prospective parallel controlled trial recruited 111 consecutive community residents. All of them underwent examinations by non-expert GPs and specialist doctors using handheld US devices (setting A, setting B, and setting C). The results of setting C with specialist doctors were considered the gold standard. Carotid intima-media thickness (CIMT) and the features of CPs were measured and recorded. The diagnostic performance of GPs in distinguishing CPs was evaluated using a receiver operating characteristic curve. Inter-observer agreement was compared using the intragroup correlation coefficient (ICC). Questionnaires were completed to evaluate clinical benefits.
Results:
Among the 111 community residents, 80, 96, and 112 CPs were detected in settings A, B, and C, respectively. Setting B exhibited better diagnostic performance than setting A for detecting CPs (area under the curve, 0.856 vs. 0.749; P<0.01). Setting B had better consistency with setting C than setting A in CIMT measurement and the assessment of CPs (ICC, 0.731 to 0.923). Moreover, measurements in setting B required less time than the other two settings (44.59 seconds vs. 108.87 seconds vs. 126.13 seconds, both P<0.01).
Conclusion
Using an intelligent handheld US device, GPs can perform CP screening and achieve a diagnostic capability comparable to that of specialist doctors.
3.Predicting Postoperative Progression of Ossification of the Posterior Longitudinal Ligament in the Cervical Spine Using Interpretable Radiomics Models
Siyuan QIN ; Ruomu QU ; Ke LIU ; Ruixin YAN ; Weili ZHAO ; Jun XU ; Enlong ZHANG ; Feifei ZHOU ; Ning LANG
Neurospine 2025;22(1):144-156
Objective:
This study investigates the potential of radiomics to predict postoperative progression of ossification of the posterior longitudinal ligament (OPLL) after posterior cervical spine surgery.
Methods:
This retrospective study included 473 patients diagnosed with OPLL at Peking University Third Hospital between October 2006 and September 2022. Patients underwent posterior spinal surgery and had at least 2 computed tomography (CT) examinations spaced at least 1 year apart. OPLL progression was defined as an annual growth rate exceeding 7.5%. Radiomic features were extracted from preoperative CT images of the OPLL lesions, followed by feature selection using correlation coefficient analysis and least absolute shrinkage and selection operator, and dimensionality reduction using principal component analysis. Univariable analysis identified significant clinical variables for constructing the clinical model. Logistic regression models, including the Rad-score model, clinical model, and combined model, were developed to predict OPLL progression.
Results:
Of the 473 patients, 191 (40.4%) experienced OPLL progression. On the testing set, the combined model, which incorporated the Rad-score and clinical variables (area under the receiver operating characteristic curve [AUC] = 0.751), outperformed both the radiomics-only model (AUC = 0.693) and the clinical model (AUC = 0.620). Calibration curves demonstrated good agreement between predicted probabilities and observed outcomes, and decision curve analysis confirmed the clinical utility of the combined model. SHAP (SHapley Additive exPlanations) analysis indicated that the Rad-score and age were key contributors to the model’s predictions, enhancing clinical interpretability.
Conclusion
Radiomics, combined with clinical variables, provides a valuable predictive tool for assessing the risk of postoperative progression in cervical OPLL, supporting more personalized treatment strategies. Prospective, multicenter validation is needed to confirm the utility of the model in broader clinical settings.
4.Predicting Postoperative Progression of Ossification of the Posterior Longitudinal Ligament in the Cervical Spine Using Interpretable Radiomics Models
Siyuan QIN ; Ruomu QU ; Ke LIU ; Ruixin YAN ; Weili ZHAO ; Jun XU ; Enlong ZHANG ; Feifei ZHOU ; Ning LANG
Neurospine 2025;22(1):144-156
Objective:
This study investigates the potential of radiomics to predict postoperative progression of ossification of the posterior longitudinal ligament (OPLL) after posterior cervical spine surgery.
Methods:
This retrospective study included 473 patients diagnosed with OPLL at Peking University Third Hospital between October 2006 and September 2022. Patients underwent posterior spinal surgery and had at least 2 computed tomography (CT) examinations spaced at least 1 year apart. OPLL progression was defined as an annual growth rate exceeding 7.5%. Radiomic features were extracted from preoperative CT images of the OPLL lesions, followed by feature selection using correlation coefficient analysis and least absolute shrinkage and selection operator, and dimensionality reduction using principal component analysis. Univariable analysis identified significant clinical variables for constructing the clinical model. Logistic regression models, including the Rad-score model, clinical model, and combined model, were developed to predict OPLL progression.
Results:
Of the 473 patients, 191 (40.4%) experienced OPLL progression. On the testing set, the combined model, which incorporated the Rad-score and clinical variables (area under the receiver operating characteristic curve [AUC] = 0.751), outperformed both the radiomics-only model (AUC = 0.693) and the clinical model (AUC = 0.620). Calibration curves demonstrated good agreement between predicted probabilities and observed outcomes, and decision curve analysis confirmed the clinical utility of the combined model. SHAP (SHapley Additive exPlanations) analysis indicated that the Rad-score and age were key contributors to the model’s predictions, enhancing clinical interpretability.
Conclusion
Radiomics, combined with clinical variables, provides a valuable predictive tool for assessing the risk of postoperative progression in cervical OPLL, supporting more personalized treatment strategies. Prospective, multicenter validation is needed to confirm the utility of the model in broader clinical settings.
5.Intelligent handheld ultrasound improving the ability of non-expert general practitioners in carotid examinations for community populations: a prospective and parallel controlled trial
Pei SUN ; Hong HAN ; Yi-Kang SUN ; Xi WANG ; Xiao-Chuan LIU ; Bo-Yang ZHOU ; Li-Fan WANG ; Ya-Qin ZHANG ; Zhi-Gang PAN ; Bei-Jian HUANG ; Hui-Xiong XU ; Chong-Ke ZHAO
Ultrasonography 2025;44(2):112-123
Purpose:
The aim of this study was to investigate the feasibility of an intelligent handheld ultrasound (US) device for assisting non-expert general practitioners (GPs) in detecting carotid plaques (CPs) in community populations.
Methods:
This prospective parallel controlled trial recruited 111 consecutive community residents. All of them underwent examinations by non-expert GPs and specialist doctors using handheld US devices (setting A, setting B, and setting C). The results of setting C with specialist doctors were considered the gold standard. Carotid intima-media thickness (CIMT) and the features of CPs were measured and recorded. The diagnostic performance of GPs in distinguishing CPs was evaluated using a receiver operating characteristic curve. Inter-observer agreement was compared using the intragroup correlation coefficient (ICC). Questionnaires were completed to evaluate clinical benefits.
Results:
Among the 111 community residents, 80, 96, and 112 CPs were detected in settings A, B, and C, respectively. Setting B exhibited better diagnostic performance than setting A for detecting CPs (area under the curve, 0.856 vs. 0.749; P<0.01). Setting B had better consistency with setting C than setting A in CIMT measurement and the assessment of CPs (ICC, 0.731 to 0.923). Moreover, measurements in setting B required less time than the other two settings (44.59 seconds vs. 108.87 seconds vs. 126.13 seconds, both P<0.01).
Conclusion
Using an intelligent handheld US device, GPs can perform CP screening and achieve a diagnostic capability comparable to that of specialist doctors.
6.Intelligent handheld ultrasound improving the ability of non-expert general practitioners in carotid examinations for community populations: a prospective and parallel controlled trial
Pei SUN ; Hong HAN ; Yi-Kang SUN ; Xi WANG ; Xiao-Chuan LIU ; Bo-Yang ZHOU ; Li-Fan WANG ; Ya-Qin ZHANG ; Zhi-Gang PAN ; Bei-Jian HUANG ; Hui-Xiong XU ; Chong-Ke ZHAO
Ultrasonography 2025;44(2):112-123
Purpose:
The aim of this study was to investigate the feasibility of an intelligent handheld ultrasound (US) device for assisting non-expert general practitioners (GPs) in detecting carotid plaques (CPs) in community populations.
Methods:
This prospective parallel controlled trial recruited 111 consecutive community residents. All of them underwent examinations by non-expert GPs and specialist doctors using handheld US devices (setting A, setting B, and setting C). The results of setting C with specialist doctors were considered the gold standard. Carotid intima-media thickness (CIMT) and the features of CPs were measured and recorded. The diagnostic performance of GPs in distinguishing CPs was evaluated using a receiver operating characteristic curve. Inter-observer agreement was compared using the intragroup correlation coefficient (ICC). Questionnaires were completed to evaluate clinical benefits.
Results:
Among the 111 community residents, 80, 96, and 112 CPs were detected in settings A, B, and C, respectively. Setting B exhibited better diagnostic performance than setting A for detecting CPs (area under the curve, 0.856 vs. 0.749; P<0.01). Setting B had better consistency with setting C than setting A in CIMT measurement and the assessment of CPs (ICC, 0.731 to 0.923). Moreover, measurements in setting B required less time than the other two settings (44.59 seconds vs. 108.87 seconds vs. 126.13 seconds, both P<0.01).
Conclusion
Using an intelligent handheld US device, GPs can perform CP screening and achieve a diagnostic capability comparable to that of specialist doctors.
7.Predicting Postoperative Progression of Ossification of the Posterior Longitudinal Ligament in the Cervical Spine Using Interpretable Radiomics Models
Siyuan QIN ; Ruomu QU ; Ke LIU ; Ruixin YAN ; Weili ZHAO ; Jun XU ; Enlong ZHANG ; Feifei ZHOU ; Ning LANG
Neurospine 2025;22(1):144-156
Objective:
This study investigates the potential of radiomics to predict postoperative progression of ossification of the posterior longitudinal ligament (OPLL) after posterior cervical spine surgery.
Methods:
This retrospective study included 473 patients diagnosed with OPLL at Peking University Third Hospital between October 2006 and September 2022. Patients underwent posterior spinal surgery and had at least 2 computed tomography (CT) examinations spaced at least 1 year apart. OPLL progression was defined as an annual growth rate exceeding 7.5%. Radiomic features were extracted from preoperative CT images of the OPLL lesions, followed by feature selection using correlation coefficient analysis and least absolute shrinkage and selection operator, and dimensionality reduction using principal component analysis. Univariable analysis identified significant clinical variables for constructing the clinical model. Logistic regression models, including the Rad-score model, clinical model, and combined model, were developed to predict OPLL progression.
Results:
Of the 473 patients, 191 (40.4%) experienced OPLL progression. On the testing set, the combined model, which incorporated the Rad-score and clinical variables (area under the receiver operating characteristic curve [AUC] = 0.751), outperformed both the radiomics-only model (AUC = 0.693) and the clinical model (AUC = 0.620). Calibration curves demonstrated good agreement between predicted probabilities and observed outcomes, and decision curve analysis confirmed the clinical utility of the combined model. SHAP (SHapley Additive exPlanations) analysis indicated that the Rad-score and age were key contributors to the model’s predictions, enhancing clinical interpretability.
Conclusion
Radiomics, combined with clinical variables, provides a valuable predictive tool for assessing the risk of postoperative progression in cervical OPLL, supporting more personalized treatment strategies. Prospective, multicenter validation is needed to confirm the utility of the model in broader clinical settings.
8.Intelligent handheld ultrasound improving the ability of non-expert general practitioners in carotid examinations for community populations: a prospective and parallel controlled trial
Pei SUN ; Hong HAN ; Yi-Kang SUN ; Xi WANG ; Xiao-Chuan LIU ; Bo-Yang ZHOU ; Li-Fan WANG ; Ya-Qin ZHANG ; Zhi-Gang PAN ; Bei-Jian HUANG ; Hui-Xiong XU ; Chong-Ke ZHAO
Ultrasonography 2025;44(2):112-123
Purpose:
The aim of this study was to investigate the feasibility of an intelligent handheld ultrasound (US) device for assisting non-expert general practitioners (GPs) in detecting carotid plaques (CPs) in community populations.
Methods:
This prospective parallel controlled trial recruited 111 consecutive community residents. All of them underwent examinations by non-expert GPs and specialist doctors using handheld US devices (setting A, setting B, and setting C). The results of setting C with specialist doctors were considered the gold standard. Carotid intima-media thickness (CIMT) and the features of CPs were measured and recorded. The diagnostic performance of GPs in distinguishing CPs was evaluated using a receiver operating characteristic curve. Inter-observer agreement was compared using the intragroup correlation coefficient (ICC). Questionnaires were completed to evaluate clinical benefits.
Results:
Among the 111 community residents, 80, 96, and 112 CPs were detected in settings A, B, and C, respectively. Setting B exhibited better diagnostic performance than setting A for detecting CPs (area under the curve, 0.856 vs. 0.749; P<0.01). Setting B had better consistency with setting C than setting A in CIMT measurement and the assessment of CPs (ICC, 0.731 to 0.923). Moreover, measurements in setting B required less time than the other two settings (44.59 seconds vs. 108.87 seconds vs. 126.13 seconds, both P<0.01).
Conclusion
Using an intelligent handheld US device, GPs can perform CP screening and achieve a diagnostic capability comparable to that of specialist doctors.
9.Predicting Postoperative Progression of Ossification of the Posterior Longitudinal Ligament in the Cervical Spine Using Interpretable Radiomics Models
Siyuan QIN ; Ruomu QU ; Ke LIU ; Ruixin YAN ; Weili ZHAO ; Jun XU ; Enlong ZHANG ; Feifei ZHOU ; Ning LANG
Neurospine 2025;22(1):144-156
Objective:
This study investigates the potential of radiomics to predict postoperative progression of ossification of the posterior longitudinal ligament (OPLL) after posterior cervical spine surgery.
Methods:
This retrospective study included 473 patients diagnosed with OPLL at Peking University Third Hospital between October 2006 and September 2022. Patients underwent posterior spinal surgery and had at least 2 computed tomography (CT) examinations spaced at least 1 year apart. OPLL progression was defined as an annual growth rate exceeding 7.5%. Radiomic features were extracted from preoperative CT images of the OPLL lesions, followed by feature selection using correlation coefficient analysis and least absolute shrinkage and selection operator, and dimensionality reduction using principal component analysis. Univariable analysis identified significant clinical variables for constructing the clinical model. Logistic regression models, including the Rad-score model, clinical model, and combined model, were developed to predict OPLL progression.
Results:
Of the 473 patients, 191 (40.4%) experienced OPLL progression. On the testing set, the combined model, which incorporated the Rad-score and clinical variables (area under the receiver operating characteristic curve [AUC] = 0.751), outperformed both the radiomics-only model (AUC = 0.693) and the clinical model (AUC = 0.620). Calibration curves demonstrated good agreement between predicted probabilities and observed outcomes, and decision curve analysis confirmed the clinical utility of the combined model. SHAP (SHapley Additive exPlanations) analysis indicated that the Rad-score and age were key contributors to the model’s predictions, enhancing clinical interpretability.
Conclusion
Radiomics, combined with clinical variables, provides a valuable predictive tool for assessing the risk of postoperative progression in cervical OPLL, supporting more personalized treatment strategies. Prospective, multicenter validation is needed to confirm the utility of the model in broader clinical settings.
10.Clinical Characteristics and Prognosis of Primary Pulmonary Lymphoma.
You-Fan FENG ; Yuan-Yuan ZHANG ; Xiao Fang WEI ; Qi-Ke ZHANG ; Li ZHAO ; Xiao-Qin LIANG ; Yuan FU ; Fei LIU ; Yang-Yang ZHAO ; Xiu-Juan HUANG ; Qing-Fen LI
Journal of Experimental Hematology 2025;33(2):387-392
OBJECTIVE:
To investigate the clinical characteristics and prognosis of primary pulmonary lymphoma (PPL).
METHODS:
The clinical data of 17 patients with PPL admitted to Gansu Provincial Hospital from January 2013 to June 2023 were collected, and their clinical characteristics and prognosis were retrospectively analyzed and summarized.
RESULTS:
The median age of the 17 patients was 56 (29-73) years old. There were 8 males and 9 females. According to Ann Arbor staging system, there were 9 patients with stage I-II and 8 patients with stage III-IV. There were 14 patients with IPI score of 0-2 and 3 patients with IPI score of 3-4. All 17 patients had symptoms at the initial diagnosis, most of the first symptoms were cough, and 6 patients had B symptoms.Among the 17 patients, there were 8 cases of diffuse large B-cell lymphoma (DLBCL), 5 cases of mucosa-associated lymphoid tissue (MALT) lymphoma, 1 case of gray zone lymphoma (GZL), and 3 cases of Hodgkin's lymphoma (HL). 15 patients received chemotherapy, of which 3 cases received autologous hematopoietic stem cell transplantation(ASCT) and 3 cases received radiotherapy; 2 patients did not receive treatment. The median number of chemotherapy courses was 6(2-8). The short-term efficacy was evaluated, 12 patients achieved complete remission (CR) and 3 patients achieved partial remission (PR). The age, pathological subtype, sex, Ann Arbor stage, β2-microglobulin(β2-MG) level, lactate dehydrogenase(LDH) level were not correlated with CR rate (P >0.05), while IPI score was correlated with recent CR rate (P < 0.05 ). The median follow-up time was 31(2-102) months. One of the 12 CR patients died of COVID-19, and the rest survived. Among the 3 patients who did not reach CR, 1 died after disease progression, while the other 2 survived. One of the 2 untreated patients died one year after diagnosis. Both the median progression-free survival (PFS) time and overall survival (OS) time of the 17 patients were both 31 (2-102) months.
CONCLUSION
The incidence of PPL is low, and the disease has no specific clinical manifestations, which is easily missed and misdiagnosed. The pathological subtypes are mainly MALT lymphoma and DLBCL, and the treatment is mainly combined chemotherapy. The IPI score is related to the treatment efficacy.
Humans
;
Middle Aged
;
Male
;
Female
;
Adult
;
Prognosis
;
Aged
;
Lung Neoplasms/therapy*
;
Retrospective Studies
;
Neoplasm Staging
;
Lymphoma/therapy*
;
Lymphoma, Large B-Cell, Diffuse

Result Analysis
Print
Save
E-mail