1.Research on Lightweight Large Language Models for Ancient Traditional Chinese Medicine Texts Based on Lora Fine-Tuning
Jingxian CHAI ; Xufeng LANG ; Hongyan LI ; Zuojian ZHOU ; Yun LING ; Libin ZHAN ; Kongfa HU ; Xuebin QIAO
World Science and Technology-Modernization of Traditional Chinese Medicine 2025;27(3):823-831
Objective To address the challenges of constructing large language models for traditional Chinese medicine(TCM)classics,which are complex and expensive to fine-tune,this study explores a lightweight fine-tuning method for such models,aiming to develop a question-answering model centered on TCM classics,particularly various editions of Shang Han Lun through the ages.Methods Dataset construction involved designing prompts to guide GPT-4 in generating Q&A pairs based on Shang Han Lun and integrating them with the ShenNong_TCM_Dataset and cMedQA2 datasets.Five general-purpose large models were selected for Lora fine-tuning.The best model was chosen through evaluation,and the performance of multiple quantized versions was validated.Results After fine-tuning,the BLEU,ROUGE-1,ROUGE-2,and ROUGE-L metrics for the Qwen-7B-Chat model improved by 17.61,19.63,14.3,and 21.4,respectively,compared to the base model.Conclusion The selected model in this study is capable of effectively understanding and utilizing professional terms and concepts from TCM classics,such as Shang Han Lun,to provide accurate answers to user queries.Compared to similar models,it requires lower fine-tuning costs and computational power,contributing to the dissemination of TCM knowledge and the development of intelligent systems.
2.Research on Lightweight Large Language Models for Ancient Traditional Chinese Medicine Texts Based on Lora Fine-Tuning
Jingxian CHAI ; Xufeng LANG ; Hongyan LI ; Zuojian ZHOU ; Yun LING ; Libin ZHAN ; Kongfa HU ; Xuebin QIAO
World Science and Technology-Modernization of Traditional Chinese Medicine 2025;27(3):823-831
Objective To address the challenges of constructing large language models for traditional Chinese medicine(TCM)classics,which are complex and expensive to fine-tune,this study explores a lightweight fine-tuning method for such models,aiming to develop a question-answering model centered on TCM classics,particularly various editions of Shang Han Lun through the ages.Methods Dataset construction involved designing prompts to guide GPT-4 in generating Q&A pairs based on Shang Han Lun and integrating them with the ShenNong_TCM_Dataset and cMedQA2 datasets.Five general-purpose large models were selected for Lora fine-tuning.The best model was chosen through evaluation,and the performance of multiple quantized versions was validated.Results After fine-tuning,the BLEU,ROUGE-1,ROUGE-2,and ROUGE-L metrics for the Qwen-7B-Chat model improved by 17.61,19.63,14.3,and 21.4,respectively,compared to the base model.Conclusion The selected model in this study is capable of effectively understanding and utilizing professional terms and concepts from TCM classics,such as Shang Han Lun,to provide accurate answers to user queries.Compared to similar models,it requires lower fine-tuning costs and computational power,contributing to the dissemination of TCM knowledge and the development of intelligent systems.
3. Research progress of microRNAs in cardiovascular diseases
Gaoshang WANG ; Xuebin ZHAN ; Yujie ZHAO
Clinical Medicine of China 2020;36(1):92-96
Objective
MicroRNAs (miRNAs) are endogenous short stranded RNAs with a length of about 22 NT, which are highly conserved and have no coding function.Mature miRNAs play a role by specifically binding to the 3′untranslated region of the target gene, degrading the mRNA of the gene or hindering its translation at the post transcriptional level, so as to negatively regulate the expression of the target gene and play a biological role.In recent years, the research of miRNAs in cardiovascular diseases is increasingly in-depth.A large number of evidences show that miRNAs play a role in the pathogenesis of many cardiovascular diseases, and will become a potential marker and new treatment target for the diagnosis and prognosis evaluation of cardiovascular diseases.
4.Expression of interleukin-18 and interleuldn-18 receptor a chain of the peripheral white blood cells in immune thrombocytopeula
Qian WANG ; Fengxia ZHAN ; Ningning SHAN ; Ming HOU ; Xiaojing YANG ; Nan LU ; Hongchun WANG ; Xiaolin ZHANG ; Xuebin JI ; Chunyan JI
Chinese Journal of Internal Medicine 2010;49(4):316-319
Objective To detect the expression of interleukin (IL)-18 of the peripheral blood cells and IL-18 receptor α chain(IL-18Rα) on the surface of CD_3~+ cells in patients newly diagnosed as immune thrombocytopenia (ITP) before medication and to explore the roles of IL-18 and IL-18Rα in the development of ITP. Methods Eighteen out-patients or inpatients with acute ITP accepting treatment in Qilu Hospital were enrolled in this study and 15 matching healthy subjects were taken as control. Plasma IL-18 level was detected with enzyme linked immunosorbent assay (ELISA), the expression of IL-18Rα on CD_3~+ lymphocytes and total lymphoeytes were measured with flow cytometry; T-bet and GATA-3 mRNA were measured with reverse transcriptase polymcrase chain reaction (RT-PCR). Results The expression of IL-18 in acute ITP plasma was (468. 57 ± 141.62) ng/L and IL-18Rα on the surface of CD_3~+ cells and lymphocytes were (8.50 ±3. 16)% and (9. 16±2.98)% respectively. The levels of IL-18 and IL-18Rα were increased in active ITP patients as compared with those in the controls (P <0. 05). The levels of IL-18 mRNA (0. 12 ±0. 02) and T-bet mRNA (0. 07 ±0. 02) were significantly increased in patients with active ITP as compared with those in the controls (P <0.05), while GATA-3 mRNA (0.0039±0.0014) were significantly decreased in patients with active ITP (P < 0. 05). The balance between T-bet and GATA-3 was significantly disturbed in ITP. Conclusions Through the variation of the levels of gene and protein, our study showed that IL-18 and IL-18Rα might upregulate the expression of Th1-cytokines in ITP patients. It is also suggested that IL-18 has potential association with the development of ITP. Especially, it may provide a new treatment method for ITP by regulating the ratio of T-bet and GATA-3 and resuming the balance of Th1/ Th2.
5.Relevant factor analysis of chronic prostatitis and male infertility
Xuebin WEI ; Shiming HUANG ; Liuyi XU ; Qingli ZHAN ; Bo LI ; Shou LI ; Qing LI
Chinese Journal of Primary Medicine and Pharmacy 2009;16(9):1537-1538
Objective To investigate the relationship between chronic prostatitis (CP) and male infertility. Methods 120 cases of male infertility patients with chronic prostatitis and 120 cases of male infertility patients with-out chronic prostatitis were analyzed. Results The differences of sperm quality、sperm movement function, partial bio-chemical indicator in semen and sperm aggregation in the two groups are significant (P<0.05). Conclusion CP plays an important negative role in male infertility.
6.Effect of partial internal sphincterotomy on the pain after cutting seton treatment
Xuebin ZHAN ; Chaowen CHEN ; Lijun NIU
Chinese Journal of Minimally Invasive Surgery 2005;0(07):-
Objective To study the influence of partial internal sphincterotomy on the postoperative pain after cutting seton treatment in patients with perianal infection. Methods A controlled study was carried out on 40 cases of cutting seton insertion with (Group A) or without (Group B) partial internal sphincterotomy. The subjects reported their postoperative pain at defecation and at rest respectively using a visual analogue scale (VAS). The intensity of pain between the two groups was compared. Results All the 40 patients were cured, without recurrence or fecal incontinence. During the period of cutting seton treatment, the pain scores at defecation and at rest were lower in the Group A than in the Group B ( P 0.05). Conclusions Internal sphincterotomy can significantly relieve anal pain after cutting seton treatment, being an effective method.

Result Analysis
Print
Save
E-mail