1.Performance evaluation of lightweight Chinese large language models integrated with retrieval-augmented generation technology in answering specialized lung cancer questions
Zhizhen REN ; Yile LI ; Yizhuo MA ; Qizhi CHEN ; Jili LI ; Siyi YANG ; Jianhao ZHANG ; Ke QIN ; Qiang PU ; Nan CHEN ; Lunxu LIU
Chinese Journal of Clinical Thoracic and Cardiovascular Surgery 2026;33(09):1403-1411
Objective To evaluate the performance of lightweight Chinese large language models (LLMs) in answering specialized lung cancer questions, and to explore the impact of retrieval-augmented generation (RAG) on model performance. Methods Eleven lightweight Chinese LLMs with parameter sizes ranging from 7B to 32B were included. A lung cancer-specific evaluation dataset consisting of 200 questions [100 A1-type (basic knowledge) and 100 A2-type (clinical case) questions], constructed based on clinical guidelines and thoracic surgery textbooks, was used for assessment. Model performance was evaluated under two conditions (with and without RAG). Accuracy was used to assess model performance, and response latency was recorded to reflect inference efficiency. An accuracy–latency scatter plot was constructed for descriptive analysis of overall model performance. Results All models successfully completed the evaluation. With the introduction of RAG, the overall average accuracy improved from 61.68% to 76.36%. Smaller models demonstrated the most significant improvement (e.g., the accuracy of DeepSeek-7B increased from 32.50% to 60.00%, P<0.001). The average response latency increased from 12.58 s to 13.80 s. The Qwen3 series showed the best overall performance, and Qwen3-32B achieved the highest accuracy under both conditions (76.50% and 84.00%, respectively). After RAG integration, performance differences among model families were markedly reduced. Based on the accuracy-latency trade-off, Qwen3-32B achieved the best balance between accuracy and response latency under the baseline condition, whereas Qwen3-14B demonstrated superior overall performance in terms of accuracy, latency, and computational cost after RAG integration. Conclusion The integration of RAG technology improves the ability of lightweight Chinese LLMs to answer specialized lung cancer questions. Under the dual practical constraints of limited computational resources and medical data security requirements, the "lightweight model+RAG" technical framework may represent a promising deployment solution.
2.Predicting Postoperative Progression of Ossification of the Posterior Longitudinal Ligament in the Cervical Spine Using Interpretable Radiomics Models
Siyuan QIN ; Ruomu QU ; Ke LIU ; Ruixin YAN ; Weili ZHAO ; Jun XU ; Enlong ZHANG ; Feifei ZHOU ; Ning LANG
Neurospine 2025;22(1):144-156
Objective:
This study investigates the potential of radiomics to predict postoperative progression of ossification of the posterior longitudinal ligament (OPLL) after posterior cervical spine surgery.
Methods:
This retrospective study included 473 patients diagnosed with OPLL at Peking University Third Hospital between October 2006 and September 2022. Patients underwent posterior spinal surgery and had at least 2 computed tomography (CT) examinations spaced at least 1 year apart. OPLL progression was defined as an annual growth rate exceeding 7.5%. Radiomic features were extracted from preoperative CT images of the OPLL lesions, followed by feature selection using correlation coefficient analysis and least absolute shrinkage and selection operator, and dimensionality reduction using principal component analysis. Univariable analysis identified significant clinical variables for constructing the clinical model. Logistic regression models, including the Rad-score model, clinical model, and combined model, were developed to predict OPLL progression.
Results:
Of the 473 patients, 191 (40.4%) experienced OPLL progression. On the testing set, the combined model, which incorporated the Rad-score and clinical variables (area under the receiver operating characteristic curve [AUC] = 0.751), outperformed both the radiomics-only model (AUC = 0.693) and the clinical model (AUC = 0.620). Calibration curves demonstrated good agreement between predicted probabilities and observed outcomes, and decision curve analysis confirmed the clinical utility of the combined model. SHAP (SHapley Additive exPlanations) analysis indicated that the Rad-score and age were key contributors to the model’s predictions, enhancing clinical interpretability.
Conclusion
Radiomics, combined with clinical variables, provides a valuable predictive tool for assessing the risk of postoperative progression in cervical OPLL, supporting more personalized treatment strategies. Prospective, multicenter validation is needed to confirm the utility of the model in broader clinical settings.
3.Intelligent handheld ultrasound improving the ability of non-expert general practitioners in carotid examinations for community populations: a prospective and parallel controlled trial
Pei SUN ; Hong HAN ; Yi-Kang SUN ; Xi WANG ; Xiao-Chuan LIU ; Bo-Yang ZHOU ; Li-Fan WANG ; Ya-Qin ZHANG ; Zhi-Gang PAN ; Bei-Jian HUANG ; Hui-Xiong XU ; Chong-Ke ZHAO
Ultrasonography 2025;44(2):112-123
Purpose:
The aim of this study was to investigate the feasibility of an intelligent handheld ultrasound (US) device for assisting non-expert general practitioners (GPs) in detecting carotid plaques (CPs) in community populations.
Methods:
This prospective parallel controlled trial recruited 111 consecutive community residents. All of them underwent examinations by non-expert GPs and specialist doctors using handheld US devices (setting A, setting B, and setting C). The results of setting C with specialist doctors were considered the gold standard. Carotid intima-media thickness (CIMT) and the features of CPs were measured and recorded. The diagnostic performance of GPs in distinguishing CPs was evaluated using a receiver operating characteristic curve. Inter-observer agreement was compared using the intragroup correlation coefficient (ICC). Questionnaires were completed to evaluate clinical benefits.
Results:
Among the 111 community residents, 80, 96, and 112 CPs were detected in settings A, B, and C, respectively. Setting B exhibited better diagnostic performance than setting A for detecting CPs (area under the curve, 0.856 vs. 0.749; P<0.01). Setting B had better consistency with setting C than setting A in CIMT measurement and the assessment of CPs (ICC, 0.731 to 0.923). Moreover, measurements in setting B required less time than the other two settings (44.59 seconds vs. 108.87 seconds vs. 126.13 seconds, both P<0.01).
Conclusion
Using an intelligent handheld US device, GPs can perform CP screening and achieve a diagnostic capability comparable to that of specialist doctors.
4.Intravenous delivery of STING agonists using acid-sensitive polycationic polymer-modified lipid nanoparticles for enhanced tumor immunotherapy.
Ying HE ; Ke ZHENG ; Xifeng QIN ; Siyu WANG ; Xuejing LI ; Huiwen LIU ; Mingyang LIU ; Ruizhe XU ; Shaojun PENG ; Zhiqing PANG
Acta Pharmaceutica Sinica B 2025;15(3):1211-1229
Although cancer immunotherapy has made great strides in the clinic, it is still hindered by the tumor immunosuppressive microenvironment (TIME). The stimulator of interferon genes (STING) pathway which can modulate TIME effectively has emerged as a promising therapeutic recently. However, the delivery of most STING agonists, specifically cyclic dinucleotides (CDNs), is performed intratumorally due to their insufficient pharmacological properties, such as weak permeability across cell membranes and vulnerability to nuclease degradation. To expand the clinical applicability of CDNs, a novel pH-sensitive polycationic polymer-modified lipid nanoparticle (LNP-B) system was developed for intravenous delivery of CDNs. LNP-B significantly extended the circulation of CDNs and enhanced the accumulation of CDNs within the tumor, spleen, and tumor-draining lymph nodes compared with free CDNs thereby triggering the STING pathway of dendritic cells and repolarizing pro-tumor macrophages. These events subsequently gave rise to potent anti-tumor immune reactions and substantial inhibition of tumors in CT26 colon cancer-bearing mouse models. In addition, due to the acid-sensitive property of the polycationic polymer, the delivery system of LNP-B was more biocompatible and safer compared with lipid nanoparticles formulated with an indissociable cationic DOTAP (LNP-D). These findings suggest that LNP-B has great potential in the intravenous delivery of CDNs for tumor immunotherapy.
5.Intranodal injection of neoantigen-bearing engineered Lactococcus lactis triggers epitope spreading and systemic tumor regressions.
Junmeng ZHU ; Yi SUN ; Xiaoping QIAN ; Lin LI ; Fangcen LIU ; Xiaonan WANG ; Yaohua KE ; Jie SHAO ; Lijing ZHU ; Lifeng WANG ; Qin LIU ; Baorui LIU
Acta Pharmaceutica Sinica B 2025;15(4):2217-2236
Probiotics are natural systems bridging synthetic biology, physical biotechnology, and immunology, initiating innate and adaptive anti-tumor immune activity. We previously constructed an all-in-one engineered food-grade probiotic Lactococcus lactis (FOLactis) which could boost the crosstalk among different immune cells such as dendritic cells (DCs), natural killer cells, and T cells. Herein, considering the limited clinical efficacy of naked personalized neoantigen peptide vaccines, we decorate FOLactis with tumor antigens by employing a Plug-and-Display system comprising membrane-inserted peptides. Intranodal injection of FOLactis coated with neoantigen peptides (Ag-FOLactis) induces robust DCs presentation and neoantigen-specific cellular immunity. Notably, Ag-FOLactis not only triggers a 45-fold rise in the quantity of locally reactive neoantigen-specific T cells but also induces epitope spreading in both subcutaneous and metastatic tumor-bearing models, leading to potent inhibition of tumor growth. These findings imply that Ag-FOLactis represents a powerful platform to rapidly and easily display antigens, facilitating the development of a bio-activated platform for personalized therapy.
6.Diagnostic Value of Intestinal Ultrasound for Patients With Chronic Abdominal Pain or Diarrhea.
Ke-Xin CHEN ; Min-Ying ZHONG ; Qin-Xue LIU ; Guo-Liang JIAN
Acta Academiae Medicinae Sinicae 2025;47(5):751-757
Objective To evaluate the diagnostic value of intestinal ultrasound (IUS) for organic lesions in the intestines of patients with chronic abdominal pain or diarrhea. Methods The IUS signs in 263 patients with chronic abdominal pain or diarrhea were retrospectively analyzed.With the endoscopic examination results as the gold standard,comparison was performed for the IUS signs between the groups with positive and negative endoscopic results,as well as between the inflammatory bowel disease group and the non-specific intestinal inflammation group of positive cases.Furthermore,the detection rates of IUS in different intestinal segments were analyzed to evaluate the accuracy of IUS in the diagnosis and localization of intestinal lesions. Results Among the 263 patients,194 (73.8%) and 69 (26.2%) patients were in the groups with positive and negative endoscopic results,respectively.The diagnosis sensitivity,specificity,and accuracy of IUS were 82.0%,71.0%,and 79.1%,respectively.The proportions of positive IUS signs in the group with positive endoscopic results were higher than that in the group with negative endoscopic results (all P<0.001).The proportions of positive IUS signs in the inflammatory bowel disease group were higher than those in the non-specific bowel inflammation group (all P<0.001).When the lesion was located in the ileum,ileocecal region,and colon,IUS demonstrated good consistency with endoscopic results in locating the lesion (kappa=0.642,0.686,and 0.601,respectively),with sensitivity and specificity of 82.7% (95%CI=75.4%-88.6%) and 81.5% (95%CI=73.5%-87.9%),73.7% (95%CI=62.3%-83.1%) and 93.0% (95%CI=88.4%-96.2%),and 68.9% (95%CI=58.3%-78.2%) and 89.6% (95%CI=84.1%-93.7%),respectively. Conclusions IUS can be used for screening the patients with chronic abdominal pain or diarrhea to detect organic lesions in the intestines. Moreover,it can effectively locate the affected intestinal segment,which is helpful for the monitoring and follow-up of intestinal diseases.
Humans
;
Diarrhea/diagnostic imaging*
;
Female
;
Male
;
Abdominal Pain/diagnostic imaging*
;
Middle Aged
;
Adult
;
Ultrasonography
;
Retrospective Studies
;
Aged
;
Young Adult
;
Intestines/diagnostic imaging*
;
Adolescent
;
Chronic Disease
;
Sensitivity and Specificity
;
Aged, 80 and over
7.Intelligent handheld ultrasound improving the ability of non-expert general practitioners in carotid examinations for community populations: a prospective and parallel controlled trial
Pei SUN ; Hong HAN ; Yi-Kang SUN ; Xi WANG ; Xiao-Chuan LIU ; Bo-Yang ZHOU ; Li-Fan WANG ; Ya-Qin ZHANG ; Zhi-Gang PAN ; Bei-Jian HUANG ; Hui-Xiong XU ; Chong-Ke ZHAO
Ultrasonography 2025;44(2):112-123
Purpose:
The aim of this study was to investigate the feasibility of an intelligent handheld ultrasound (US) device for assisting non-expert general practitioners (GPs) in detecting carotid plaques (CPs) in community populations.
Methods:
This prospective parallel controlled trial recruited 111 consecutive community residents. All of them underwent examinations by non-expert GPs and specialist doctors using handheld US devices (setting A, setting B, and setting C). The results of setting C with specialist doctors were considered the gold standard. Carotid intima-media thickness (CIMT) and the features of CPs were measured and recorded. The diagnostic performance of GPs in distinguishing CPs was evaluated using a receiver operating characteristic curve. Inter-observer agreement was compared using the intragroup correlation coefficient (ICC). Questionnaires were completed to evaluate clinical benefits.
Results:
Among the 111 community residents, 80, 96, and 112 CPs were detected in settings A, B, and C, respectively. Setting B exhibited better diagnostic performance than setting A for detecting CPs (area under the curve, 0.856 vs. 0.749; P<0.01). Setting B had better consistency with setting C than setting A in CIMT measurement and the assessment of CPs (ICC, 0.731 to 0.923). Moreover, measurements in setting B required less time than the other two settings (44.59 seconds vs. 108.87 seconds vs. 126.13 seconds, both P<0.01).
Conclusion
Using an intelligent handheld US device, GPs can perform CP screening and achieve a diagnostic capability comparable to that of specialist doctors.
8.Predicting Postoperative Progression of Ossification of the Posterior Longitudinal Ligament in the Cervical Spine Using Interpretable Radiomics Models
Siyuan QIN ; Ruomu QU ; Ke LIU ; Ruixin YAN ; Weili ZHAO ; Jun XU ; Enlong ZHANG ; Feifei ZHOU ; Ning LANG
Neurospine 2025;22(1):144-156
Objective:
This study investigates the potential of radiomics to predict postoperative progression of ossification of the posterior longitudinal ligament (OPLL) after posterior cervical spine surgery.
Methods:
This retrospective study included 473 patients diagnosed with OPLL at Peking University Third Hospital between October 2006 and September 2022. Patients underwent posterior spinal surgery and had at least 2 computed tomography (CT) examinations spaced at least 1 year apart. OPLL progression was defined as an annual growth rate exceeding 7.5%. Radiomic features were extracted from preoperative CT images of the OPLL lesions, followed by feature selection using correlation coefficient analysis and least absolute shrinkage and selection operator, and dimensionality reduction using principal component analysis. Univariable analysis identified significant clinical variables for constructing the clinical model. Logistic regression models, including the Rad-score model, clinical model, and combined model, were developed to predict OPLL progression.
Results:
Of the 473 patients, 191 (40.4%) experienced OPLL progression. On the testing set, the combined model, which incorporated the Rad-score and clinical variables (area under the receiver operating characteristic curve [AUC] = 0.751), outperformed both the radiomics-only model (AUC = 0.693) and the clinical model (AUC = 0.620). Calibration curves demonstrated good agreement between predicted probabilities and observed outcomes, and decision curve analysis confirmed the clinical utility of the combined model. SHAP (SHapley Additive exPlanations) analysis indicated that the Rad-score and age were key contributors to the model’s predictions, enhancing clinical interpretability.
Conclusion
Radiomics, combined with clinical variables, provides a valuable predictive tool for assessing the risk of postoperative progression in cervical OPLL, supporting more personalized treatment strategies. Prospective, multicenter validation is needed to confirm the utility of the model in broader clinical settings.
9.Intelligent handheld ultrasound improving the ability of non-expert general practitioners in carotid examinations for community populations: a prospective and parallel controlled trial
Pei SUN ; Hong HAN ; Yi-Kang SUN ; Xi WANG ; Xiao-Chuan LIU ; Bo-Yang ZHOU ; Li-Fan WANG ; Ya-Qin ZHANG ; Zhi-Gang PAN ; Bei-Jian HUANG ; Hui-Xiong XU ; Chong-Ke ZHAO
Ultrasonography 2025;44(2):112-123
Purpose:
The aim of this study was to investigate the feasibility of an intelligent handheld ultrasound (US) device for assisting non-expert general practitioners (GPs) in detecting carotid plaques (CPs) in community populations.
Methods:
This prospective parallel controlled trial recruited 111 consecutive community residents. All of them underwent examinations by non-expert GPs and specialist doctors using handheld US devices (setting A, setting B, and setting C). The results of setting C with specialist doctors were considered the gold standard. Carotid intima-media thickness (CIMT) and the features of CPs were measured and recorded. The diagnostic performance of GPs in distinguishing CPs was evaluated using a receiver operating characteristic curve. Inter-observer agreement was compared using the intragroup correlation coefficient (ICC). Questionnaires were completed to evaluate clinical benefits.
Results:
Among the 111 community residents, 80, 96, and 112 CPs were detected in settings A, B, and C, respectively. Setting B exhibited better diagnostic performance than setting A for detecting CPs (area under the curve, 0.856 vs. 0.749; P<0.01). Setting B had better consistency with setting C than setting A in CIMT measurement and the assessment of CPs (ICC, 0.731 to 0.923). Moreover, measurements in setting B required less time than the other two settings (44.59 seconds vs. 108.87 seconds vs. 126.13 seconds, both P<0.01).
Conclusion
Using an intelligent handheld US device, GPs can perform CP screening and achieve a diagnostic capability comparable to that of specialist doctors.
10.Predicting Postoperative Progression of Ossification of the Posterior Longitudinal Ligament in the Cervical Spine Using Interpretable Radiomics Models
Siyuan QIN ; Ruomu QU ; Ke LIU ; Ruixin YAN ; Weili ZHAO ; Jun XU ; Enlong ZHANG ; Feifei ZHOU ; Ning LANG
Neurospine 2025;22(1):144-156
Objective:
This study investigates the potential of radiomics to predict postoperative progression of ossification of the posterior longitudinal ligament (OPLL) after posterior cervical spine surgery.
Methods:
This retrospective study included 473 patients diagnosed with OPLL at Peking University Third Hospital between October 2006 and September 2022. Patients underwent posterior spinal surgery and had at least 2 computed tomography (CT) examinations spaced at least 1 year apart. OPLL progression was defined as an annual growth rate exceeding 7.5%. Radiomic features were extracted from preoperative CT images of the OPLL lesions, followed by feature selection using correlation coefficient analysis and least absolute shrinkage and selection operator, and dimensionality reduction using principal component analysis. Univariable analysis identified significant clinical variables for constructing the clinical model. Logistic regression models, including the Rad-score model, clinical model, and combined model, were developed to predict OPLL progression.
Results:
Of the 473 patients, 191 (40.4%) experienced OPLL progression. On the testing set, the combined model, which incorporated the Rad-score and clinical variables (area under the receiver operating characteristic curve [AUC] = 0.751), outperformed both the radiomics-only model (AUC = 0.693) and the clinical model (AUC = 0.620). Calibration curves demonstrated good agreement between predicted probabilities and observed outcomes, and decision curve analysis confirmed the clinical utility of the combined model. SHAP (SHapley Additive exPlanations) analysis indicated that the Rad-score and age were key contributors to the model’s predictions, enhancing clinical interpretability.
Conclusion
Radiomics, combined with clinical variables, provides a valuable predictive tool for assessing the risk of postoperative progression in cervical OPLL, supporting more personalized treatment strategies. Prospective, multicenter validation is needed to confirm the utility of the model in broader clinical settings.

Result Analysis
Print
Save
E-mail