1.Comparison of Automatic Evaluation Methods for Pattern Hallucinations of Large Language Models in Traditional Chinese Medicine Syndrome Differentiation
Qinwei WU ; Yuzhu GAO ; Xingyue GOU ; Junyu YAO ; Chuangan ZHOU ; Zhengchun XUE ; Zhirong XU ; Xinlin CHEN ; Dong CAO
Journal of Traditional Chinese Medicine 2026;67(17):1845-1852
ObjectiveTo compare the performance of different automatic evaluation methods for detecting pattern hallucinations generated by large language models (LLMs) in traditional Chinese medicine (TCM) syndrome differentiation and to identify a strategy with higher overall discriminative performance against expert manual judgment. MethodsA standardized TCM syndrome-differentiation dataset containing 598 cases was constructed from case reports published in Chinese core journals indexed by Peking University Core Journals or Chinese Science Citation Database. Each of the 598 cases was submitted to five Chinese LLMs, with each model generating one syndrome-pattern output per case, yielding 2990 outputs in total. The 598 outputs generated by Qwen3-Next-80B-A3B-Thinking were independently annotated for syndrome-pattern hallucinations by two licensed TCM physicians with intermediate or higher professional titles. Disagreements were adjudicated by a third licensed TCM physician with a senior associate professional title and more than 10 years of clinical experience. The resulting consensus annotations served as the reference labels for training and validating the automated evaluation method. Based on these reference labels, three categories of automated evaluation methods were developed and compared following a progressive strategy from text-level semantic similarity, to syndrome-element structural consistency, and finally multi-feature fusion. Method A employed sentence-embedding models based on semantic similarity between pattern texts. Method B adopted a rule-based threshold method using weighted Jaccard coefficients of disease-location and disease-nature syndrome elements. Method C utilized a machine-learning classifier integrating syndrome-element matching scores, missing and redundant syndrome-element counts, and multiple semantic-similarity features. Five-fold cross-validation was used to evaluate the discriminative performance of each method against manual judgment. The optimal method was then applied to uniformly assess the pattern hallucination rates of five LLMs. ResultsIn method A, text2vec-large-chinese showed best overall performance, with an area under the receiver operating characteristic curve (AUROC), area under the precision-recall curve (PR-AUC), F1-score, sensitivity, and specificity of 0.849, 0.884, 0.794, 0.801, and 0.691, respectively. In method B, the corresponding metrics of the rule-based syndrome-element Jaccard threshold method were 0.848, 0.851, 0.817, 0.845, and 0.684, respectively; those of the LLM-based syndrome-element Jaccard method were 0.872, 0.906, 0.795, 0.764, and 0.780, respectively. In method C, the multilayer perceptron (MLP) classifier showed the best overall performance, with AUROC, PR-AUC, F1-score, sensitivity, and specificity of 0.933, 0.951, 0.871, 0.857, and 0.846, respectively. Under the unified evaluation framework combining DeepSeek-R1 syndrome-element extraction and MLP classifier, the estimated pattern hallucination rates of the five LLMs ranged from 56.0% to 77.4%. ConclusionAmong the three automatic evaluation methods, Method C integrating syndrome-element discrepancy features and text semantic features using an MLP classifier showed the highest overall discriminative performance against manual judgment, and is more suitable for evaluating syndrome hallucinations in LLM-based TCM syndrome differentiation tasks.
2.Antisense molecules: A promising new therapy for atopic dermatitis.
Acta Pharmaceutica Sinica B 2025;15(11):5493-5514
Atopic dermatitis (AD) is a common chronic inflammatory skin disorder affecting all age groups, especially children, with a prevalence of up to 20% globally. AD remains burdensome and incurable with current therapeutic strategies-ranging from trigger avoidance and skincare to medication-primarily address symptoms rather than disease modification, underscoring the imperative for innovative therapeutic paradigms. RNA-targeted therapies, particularly antisense molecules, have emerged as a transformative approach in precision medicine, with proven clinical success in diseases such as spinal muscular atrophy and familial chylomicronemia syndrome. These therapeutics achieve post-transcriptional regulation unattainable by conventional therapies, enabling direct targeting of messenger RNA (mRNA) and regulatory non-coding RNAs (ncRNAs) implicated in disease pathogenesis. Furthermore, skin is better suited to the antisense modulation due to the relatively easy access to target cells. Numerous studies have explored antisense-based targeting of key drivers in AD progression, yielding promising proof-of-concept results and prompting several early-stage clinical trials. This modality represents a paradigm shift in AD management-one that aligns with the broader revolution in RNA therapeutics reshaping modern medicine. This review critically examines the evolving role of antisense technology in AD, addressing both its mechanistic rationale and the translational challenges that must be overcome to realize its full clinical potential.
3.Long-term outcomes after infliximab discontinuation in patients with Crohn's disease: a single-center retrospective observational study
Danping ZHENG ; Yun QIU ; Yingfan ZHANG ; Baili CHEN ; Yao HE ; Zhirong ZENG ; Minhu CHEN
Chinese Journal of Inflammatory Bowel Diseases 2025;09(4):297-302
Objective:To assess the long-term risk of relapse in patients with Crohn's disease (CD) who discontinued infliximab (IFX) monoclonal antibody and to identify risk factors associated with relapse.Methods:A single-center retrospective observational study was conducted from February 2006 to October 2016. The study included CD patients who were treated with scheduled IFX infusions at the First Affiliated Hospital of Sun Yat-sen University and assessed in corticosteroid-free clinical remission at the time of withdrawal were included. The primary outcome was clinical relapse. We evaluated the risk of relapse using Kaplan-Meier method. Factors associated with time to relapse was identified using the multiple Cox proportional hazards regression analysis.Results:We included 97 eligible patients, and 75 (77.3%) experienced a relapse after a median follow-up time of 124 months. Among them, 45 patients (46.4%) relapsed within 3 years after IFX withdrawal. The 1-, 2-, 3-, 5-, and 10-year relapse-free survival were 79.4%, 59.8%, 52.6%, 42.0% and 22.6%, respectively. Risk factors for relapse included age ≤ 16 ( HR = 2.62, 95% CI: 1.30-5.31; P = 0.007) and failure to achieve biological remission (CRP > 3 mg/L, HR = 2.37, 95% CI: 1.29-4.36; P = 0.006) at drug withdrawal. Induction with biologics or systemic steroids were both effective (89%-100% relieved) in relapsers. Conclusions:Nearly half of CD patients relapsed within 3 years after discontinuation of IFX treatment. Early age of discontinuation and failure to achieve serum biological remission at the time of discontinuation are independent predictors of clinical relapse.
4.Long-term outcomes after infliximab discontinuation in patients with Crohn's disease: a single-center retrospective observational study
Danping ZHENG ; Yun QIU ; Yingfan ZHANG ; Baili CHEN ; Yao HE ; Zhirong ZENG ; Minhu CHEN
Chinese Journal of Inflammatory Bowel Diseases 2025;09(4):297-302
Objective:To assess the long-term risk of relapse in patients with Crohn's disease (CD) who discontinued infliximab (IFX) monoclonal antibody and to identify risk factors associated with relapse.Methods:A single-center retrospective observational study was conducted from February 2006 to October 2016. The study included CD patients who were treated with scheduled IFX infusions at the First Affiliated Hospital of Sun Yat-sen University and assessed in corticosteroid-free clinical remission at the time of withdrawal were included. The primary outcome was clinical relapse. We evaluated the risk of relapse using Kaplan-Meier method. Factors associated with time to relapse was identified using the multiple Cox proportional hazards regression analysis.Results:We included 97 eligible patients, and 75 (77.3%) experienced a relapse after a median follow-up time of 124 months. Among them, 45 patients (46.4%) relapsed within 3 years after IFX withdrawal. The 1-, 2-, 3-, 5-, and 10-year relapse-free survival were 79.4%, 59.8%, 52.6%, 42.0% and 22.6%, respectively. Risk factors for relapse included age ≤ 16 ( HR = 2.62, 95% CI: 1.30-5.31; P = 0.007) and failure to achieve biological remission (CRP > 3 mg/L, HR = 2.37, 95% CI: 1.29-4.36; P = 0.006) at drug withdrawal. Induction with biologics or systemic steroids were both effective (89%-100% relieved) in relapsers. Conclusions:Nearly half of CD patients relapsed within 3 years after discontinuation of IFX treatment. Early age of discontinuation and failure to achieve serum biological remission at the time of discontinuation are independent predictors of clinical relapse.
5.Current research on UV-induced DNA damage and its role in promoting the development of skin malignancies
Journal of Shanghai Jiaotong University(Medical Science) 2025;45(2):228-232
Skin malignancies include non-melanoma skin cancers and melanoma,with high incidence rates that pose a significant burden on public health and healthcare systems.Research in this area is crucial.Ultraviolet radiation(UV)is recognized as the primary risk factor for skin malignancies,with its main carcinogenic mechanism involving UV-induced DNA damage,which leads to the accumulation of mutations in key oncogenes and tumor suppressor genes.This accumulation promotes malignant transformation of related cells,ultimately resulting in the formation of malignant tumors.Understanding the specific processes through which UV-induced DNA damage contributes to the development of skin malignancies is crucial for advancing related research.Therefore,this paper focuses on the mechanisms of UV-induced DNA damage,the repair mechanisms for UV-induced DNA damage,and the relationship between UV-induced DNA damage and the occurrence of the three major types of skin malignancies.
6.Research progress on the dual effects of autophagy in cutaneous melanoma and its role in drug resistance
Wen LUO ; Mingjun LÜ ; Zhen ZHANG ; Xue ZHANG ; Zhirong YAO
Journal of Shanghai Jiaotong University(Medical Science) 2025;45(2):233-240
Cutaneous melanoma(CM)is a highly malignant tumor caused by malignant proliferation of melanocytes,characterized by distant metastasis and high mortality.Although targeted therapy and immunotherapy have significantly improved the survival rates of advanced CM patients,tumor resistance remains a key barrier to further improving treatment outcomes.In recent years,significant progress has been made in the study of autophagy as a key regulatory cell death mode in the pathogenesis of CM.Autophagy is the main mechanism that mediates the degradation and recycling of various cellular components through lysosomes to maintain the homeostasis of the intracellular environment.A large number of studies have confirmed that the role of autophagy in CM is complex and controversial.In the early stages of CM development,autophagy may inhibit abnormal proliferation of tumor cells by removing damaged cell components.However,as the tumor progresses,autophagy may transform into a role that promotes tumor invasion and metastasis.In advanced CM,the activation of autophagy helps tumor cells survive in stressful environments.In particular,in CM with BRAF(V-Raf murine sarcoma viral oncogene homolog B1)mutations,autophagy activity is often enhanced,weakening the effectiveness of BRAF inhibitor-targeted therapy.This article provides an in-depth analysis of the dual effects of autophagy on the progression of CM and explores the role of autophagy in CM resistance,in order to provide insights for the development of new targeted therapy strategies for CM.
7.Benzoylaconine attenuates oxygen glucose deprivation/reoxyenation induced cardiomyocytic injury through the PI3K/Akt signaling pathway
Wuming ZHOU ; Shengkun LANG ; Xin GE ; Wei JIANG ; Di JIA ; Hao YAO ; Zhirong HUAN
Chinese Journal of Geriatric Heart Brain and Vessel Diseases 2025;27(2):211-216
Objective To investigate the protective effect of benzoylaconine(BAC)on H9c2 cardio-myocytes after oxygen glucose deprivation/reoxyenation(OGD/R)injury.Methods After an in vitro model of OGD/R injury was established in H9c2 cells,the cells were treated with BAC at different concentrations(0,25,50,75,100 μmol/L)to determine its optimal dose.Then,H9c2 cells were randomly divided into control group,OGD/R group,OGD/R+BAC group(75 μmol),OGD/R+LY294002 group(PI3K/Akt inhibitor),and OGD/R+LY294002+BAC group.Corre-sponding reagent kits were used to determine cell viability and LDH level,as well as the expres-sion levels of TNF-α,IL-6,IL-1β,MDA and GSH-Px in the cells.Western blotting was applied to detect the expression of the PI3K/Akt pathway proteins,as well as autophagic proteins such as LC3,Beclin1,and P62.Results Compared to the control group,the cell viability was significantly decreased,and LDH level was obviously increased in the OGD/R group(P<0.01).Treatment of 75 μmol/L BAC significantly increased the cell viability(0.87±0.06 vs 40.49±0.06,P<0.01)and decreased the LDH level(86.75±7.79 U/L vs 234.42±6.20 U/L,P<0.01)when compared to the levels of the OGD/R group.OGD/R injury induced notable increases in TNF-α,IL-6,IL-1β,and MDA expression levels,while decrease of GSH-Px expression level(P<0.01),and down-regulation of p-PI3K,p-Akt and P62 and up-regulation of LC3 Ⅱ/LC3 Ⅰ and Beclin-1(P<0.01)when compared with the control group.Treatment of 75 μmol/L BAC increased the levels of p-PI3K,p-Akt,and P62 proteins(0.90±0.07 vs 0.58±0.04,1.02±0.02 vs 0.49±0.01,1.48±0.05 vs 0.87±0.04)and decreased those of LC3 Ⅱ/LC3 Ⅰ and Beclin-1(0.52±0.01 vs 1.24±0.04,0.12±0.01 vs 0.32±0.02)when compared with the OGD/R group(P<0.01).Conclusions BAC attenu-ates the inflammatory response and oxidative stress of myocardial cells after OGD/R injury,regu-lates autophagy homeostasis,and reduces myocardial cell damage.Its regulatory effect on myocar-dial autophagy homeostasis may be related to the activation of the PI3K/Akt pathway.
8.Research progress on the dual effects of autophagy in cutaneous melanoma and its role in drug resistance
Wen LUO ; Mingjun LÜ ; Zhen ZHANG ; Xue ZHANG ; Zhirong YAO
Journal of Shanghai Jiaotong University(Medical Science) 2025;45(2):233-240
Cutaneous melanoma(CM)is a highly malignant tumor caused by malignant proliferation of melanocytes,characterized by distant metastasis and high mortality.Although targeted therapy and immunotherapy have significantly improved the survival rates of advanced CM patients,tumor resistance remains a key barrier to further improving treatment outcomes.In recent years,significant progress has been made in the study of autophagy as a key regulatory cell death mode in the pathogenesis of CM.Autophagy is the main mechanism that mediates the degradation and recycling of various cellular components through lysosomes to maintain the homeostasis of the intracellular environment.A large number of studies have confirmed that the role of autophagy in CM is complex and controversial.In the early stages of CM development,autophagy may inhibit abnormal proliferation of tumor cells by removing damaged cell components.However,as the tumor progresses,autophagy may transform into a role that promotes tumor invasion and metastasis.In advanced CM,the activation of autophagy helps tumor cells survive in stressful environments.In particular,in CM with BRAF(V-Raf murine sarcoma viral oncogene homolog B1)mutations,autophagy activity is often enhanced,weakening the effectiveness of BRAF inhibitor-targeted therapy.This article provides an in-depth analysis of the dual effects of autophagy on the progression of CM and explores the role of autophagy in CM resistance,in order to provide insights for the development of new targeted therapy strategies for CM.
9.Current research on UV-induced DNA damage and its role in promoting the development of skin malignancies
Journal of Shanghai Jiaotong University(Medical Science) 2025;45(2):228-232
Skin malignancies include non-melanoma skin cancers and melanoma,with high incidence rates that pose a significant burden on public health and healthcare systems.Research in this area is crucial.Ultraviolet radiation(UV)is recognized as the primary risk factor for skin malignancies,with its main carcinogenic mechanism involving UV-induced DNA damage,which leads to the accumulation of mutations in key oncogenes and tumor suppressor genes.This accumulation promotes malignant transformation of related cells,ultimately resulting in the formation of malignant tumors.Understanding the specific processes through which UV-induced DNA damage contributes to the development of skin malignancies is crucial for advancing related research.Therefore,this paper focuses on the mechanisms of UV-induced DNA damage,the repair mechanisms for UV-induced DNA damage,and the relationship between UV-induced DNA damage and the occurrence of the three major types of skin malignancies.
10.Benzoylaconine attenuates oxygen glucose deprivation/reoxyenation induced cardiomyocytic injury through the PI3K/Akt signaling pathway
Wuming ZHOU ; Shengkun LANG ; Xin GE ; Wei JIANG ; Di JIA ; Hao YAO ; Zhirong HUAN
Chinese Journal of Geriatric Heart Brain and Vessel Diseases 2025;27(2):211-216
Objective To investigate the protective effect of benzoylaconine(BAC)on H9c2 cardio-myocytes after oxygen glucose deprivation/reoxyenation(OGD/R)injury.Methods After an in vitro model of OGD/R injury was established in H9c2 cells,the cells were treated with BAC at different concentrations(0,25,50,75,100 μmol/L)to determine its optimal dose.Then,H9c2 cells were randomly divided into control group,OGD/R group,OGD/R+BAC group(75 μmol),OGD/R+LY294002 group(PI3K/Akt inhibitor),and OGD/R+LY294002+BAC group.Corre-sponding reagent kits were used to determine cell viability and LDH level,as well as the expres-sion levels of TNF-α,IL-6,IL-1β,MDA and GSH-Px in the cells.Western blotting was applied to detect the expression of the PI3K/Akt pathway proteins,as well as autophagic proteins such as LC3,Beclin1,and P62.Results Compared to the control group,the cell viability was significantly decreased,and LDH level was obviously increased in the OGD/R group(P<0.01).Treatment of 75 μmol/L BAC significantly increased the cell viability(0.87±0.06 vs 40.49±0.06,P<0.01)and decreased the LDH level(86.75±7.79 U/L vs 234.42±6.20 U/L,P<0.01)when compared to the levels of the OGD/R group.OGD/R injury induced notable increases in TNF-α,IL-6,IL-1β,and MDA expression levels,while decrease of GSH-Px expression level(P<0.01),and down-regulation of p-PI3K,p-Akt and P62 and up-regulation of LC3 Ⅱ/LC3 Ⅰ and Beclin-1(P<0.01)when compared with the control group.Treatment of 75 μmol/L BAC increased the levels of p-PI3K,p-Akt,and P62 proteins(0.90±0.07 vs 0.58±0.04,1.02±0.02 vs 0.49±0.01,1.48±0.05 vs 0.87±0.04)and decreased those of LC3 Ⅱ/LC3 Ⅰ and Beclin-1(0.52±0.01 vs 1.24±0.04,0.12±0.01 vs 0.32±0.02)when compared with the OGD/R group(P<0.01).Conclusions BAC attenu-ates the inflammatory response and oxidative stress of myocardial cells after OGD/R injury,regu-lates autophagy homeostasis,and reduces myocardial cell damage.Its regulatory effect on myocar-dial autophagy homeostasis may be related to the activation of the PI3K/Akt pathway.

Result Analysis
Print
Save
E-mail