Construction and Validation of a Large Language Model-Based Intelligent Pre-Consultation System for Traditional Chinese Medicine
10.13288/j.11-2166/r.2025.09.005
- VernacularTitle:基于大语言模型的中医智能预问诊系统的构建与验证
- Author:
Yiqing LIU
1
;
Ying LI
1
;
Hongjun YANG
1
;
Linjing PENG
1
;
Nanxing XIAN
1
;
Kunning LI
1
;
Qiwei SHI
1
;
Hengyi TIAN
1
;
Lifeng DONG
2
;
Lin WANG
3
;
Yuping ZHAO
4
Author Information
1. Experimental Research Center，China Academy of Chinese Medical Sciences，Beijing，100700
2. Institute of Automation，Chinese Academy of Sciences
3. Tianjin Wenge Technology Co.，Ltd
4. Institute of Basic Theory for Chinese Medicine，China Academy of Chinese Medical Sciences
- Publication Type:Journal Article
- Keywords:
consultation;
large language models;
intelligent pre-consultation system;
agent
- From:
Journal of Traditional Chinese Medicine
2025;66(9):895-900
- CountryChina
- Language:Chinese
-
Abstract:
ObjectiveTo construct a large language model （LLM）-based intelligent pre-consultation system for traditional Chinese medicine （TCM） to improve efficacy of clinical practice. MethodsA TCM large language model was fine-tuned using DeepSpeed ZeRO-3 distributed training strategy based on YAYI 2-30B. A weighted undirected graph network was designed and an agent-based syndrome differentiation model was established based on relationship data extracted from TCM literature and clinical records. An agent collaboration framework was developed to integrate the TCM LLM with the syndrome differentiation model. Model performance was comprehensively evaluated by Loss function， BLEU-4， and ROUGE-L metrics， through which training convergence， text generation quality， and language understanding capability were assessed. Professional knowledge test sets were developed to evaluate system proficiency in TCM physician licensure content， TCM pharmacist licensure content， TCM symptom terminology recognition， and meridian identification. Clinical tests were conducted to compare the system with attending physicians in terms of diagnostic accuracy， consultation rounds， and consultation duration. ResultsAfter 100 000 iterations， the training loss value was gradually stabilized at about 0.7±0.08， indicating that the TCM-LLM has been trained and has good generalization ability. The TCM-LLM scored 0.38 in BLEU-4 and 0.62 in ROUGE-L， suggesting that its natural language processing ability meets the standard. We obtained 2715 symptom terms， 505 relationships between diseases and syndromes， 1011 relationships between diseases and main symptoms， and 1 303 600 relationships among different symptoms， and constructed the Agent of syndrome differentiation model. The accuracy rates in the simulated tests for TCM practitioners， licensed pharmacists of Chinese materia medica， recognition of TCM symptom terminology， and meridian recognition were 94.09%， 78.00%， 87.50%， and 68.80%， respectively. In clinical tests， the syndrome differentiation accuracy of the system reached 88.33%， with fewer consultation rounds and shorter consultation time compared to the attending physicians （P＜0.01）， suggesting that the system has a certain pre- consultation ability. ConclusionThe LLM-based intelligent TCM pre-diagnosis system could simulate diagnostic thinking of TCM physicians to a certain extent. After understanding the patients' natural language， it collects all the patient's symptom through guided questioning， thereby enhancing the diagnostic and treatment efficiency of physicians as well as the consultation experience of the patients.
