1.ResNet-Vision Transformer based MRI-endoscopy fusion model for predicting treatment response to neoadjuvant chemoradiotherapy in locally advanced rectal cancer: A multicenter study.
Junhao ZHANG ; Ruiqing LIU ; Di HAO ; Guangye TIAN ; Shiwei ZHANG ; Sen ZHANG ; Yitong ZANG ; Kai PANG ; Xuhua HU ; Keyu REN ; Mingjuan CUI ; Shuhao LIU ; Jinhui WU ; Quan WANG ; Bo FENG ; Weidong TONG ; Yingchi YANG ; Guiying WANG ; Yun LU
Chinese Medical Journal 2025;138(21):2793-2803
BACKGROUND:
Neoadjuvant chemoradiotherapy followed by radical surgery has been a common practice for patients with locally advanced rectal cancer, but the response rate varies among patients. This study aimed to develop a ResNet-Vision Transformer based magnetic resonance imaging (MRI)-endoscopy fusion model to precisely predict treatment response and provide personalized treatment.
METHODS:
In this multicenter study, 366 eligible patients who had undergone neoadjuvant chemoradiotherapy followed by radical surgery at eight Chinese tertiary hospitals between January 2017 and June 2024 were recruited, with 2928 pretreatment colonic endoscopic images and 366 pelvic MRI images. An MRI-endoscopy fusion model was constructed based on the ResNet backbone and Transformer network using pretreatment MRI and endoscopic images. Treatment response was defined as good response or non-good response based on the tumor regression grade. The Delong test and the Hanley-McNeil test were utilized to compare prediction performance among different models and different subgroups, respectively. The predictive performance of the MRI-endoscopy fusion model was comprehensively validated in the test sets and was further compared to that of the single-modal MRI model and single-modal endoscopy model.
RESULTS:
The MRI-endoscopy fusion model demonstrated favorable prediction performance. In the internal validation set, the area under the curve (AUC) and accuracy were 0.852 (95% confidence interval [CI]: 0.744-0.940) and 0.737 (95% CI: 0.712-0.844), respectively. Moreover, the AUC and accuracy reached 0.769 (95% CI: 0.678-0.861) and 0.729 (95% CI: 0.628-0.821), respectively, in the external test set. In addition, the MRI-endoscopy fusion model outperformed the single-modal MRI model (AUC: 0.692 [95% CI: 0.609-0.783], accuracy: 0.659 [95% CI: 0.565-0.775]) and the single-modal endoscopy model (AUC: 0.720 [95% CI: 0.617-0.823], accuracy: 0.713 [95% CI: 0.612-0.809]) in the external test set.
CONCLUSION
The MRI-endoscopy fusion model based on ResNet-Vision Transformer achieved favorable performance in predicting treatment response to neoadjuvant chemoradiotherapy and holds tremendous potential for enabling personalized treatment regimens for locally advanced rectal cancer patients.
Humans
;
Rectal Neoplasms/diagnostic imaging*
;
Magnetic Resonance Imaging/methods*
;
Male
;
Female
;
Middle Aged
;
Neoadjuvant Therapy/methods*
;
Aged
;
Adult
;
Chemoradiotherapy/methods*
;
Endoscopy/methods*
;
Treatment Outcome
2.Treating primary hypotension using the tonifying qi and ascending yang method based on the"yang transforming qi and yin shaping up body"theory
Xuhua JIAO ; Yufeng LI ; Min XIAO
Journal of Beijing University of Traditional Chinese Medicine 2024;47(11):1591-1596
Primary hypotension is a common and frequently occurring blood vessel disease,characterized by insidious onset,lingering condition,complex etiology,and diverse symptoms.Its pathogenesis is primarily characterized by deficiency,and its onset involves multiple zang-fu organs.The"yang transforming qi and yin shaping up body"theory is derived from the Huangdi Neijing.This theory summarizes the fundamental laws of the movement and changes in yin and yang.From this perspective,the paper hypothesizes that the basic pathogenesis of primary hypotension stems from an insufficiency of yang in transforming qi and a malfunction of yin in shaping up body.The essence of the condition lies in an overall yang deficiency that fails to provide warmth and transformation,coupled with qi deficiency,which cannot control and regulate bodily functions.This leads to poor blood circulation and inadequate protection,causing yin to malfunction in forming the physical components of the body.As a result,normal physiological functions of the zang-fu organs are disrupted,the production of beneficial physiological substances is obstructed,and metabolic waste products accumulate.The primary therapeutic approach should be focused on tonifying qi and ascending yang;tonifying qi will provide the impetus for blood circulation,whereas ascending yang will facilitate yang transformation qi.The zang-fu organs should also be protected and nourished to ameliorate the internal environment of yang deficiency and yin excess,as well as to eliminate pathological product accumulation to dredge the channels of blood circulation.Using the"yang transforming qi and yin shaping up the body"theory to guide the treatment of primary hypotension can help deepen the understanding of the pathogenesis of this disease and broaden the clinical diagnosis and treatment strategies.
3.Treating primary hypotension using the tonifying qi and ascending yang method based on the"yang transforming qi and yin shaping up body"theory
Xuhua JIAO ; Yufeng LI ; Min XIAO
Journal of Beijing University of Traditional Chinese Medicine 2024;47(11):1591-1596
Primary hypotension is a common and frequently occurring blood vessel disease,characterized by insidious onset,lingering condition,complex etiology,and diverse symptoms.Its pathogenesis is primarily characterized by deficiency,and its onset involves multiple zang-fu organs.The"yang transforming qi and yin shaping up body"theory is derived from the Huangdi Neijing.This theory summarizes the fundamental laws of the movement and changes in yin and yang.From this perspective,the paper hypothesizes that the basic pathogenesis of primary hypotension stems from an insufficiency of yang in transforming qi and a malfunction of yin in shaping up body.The essence of the condition lies in an overall yang deficiency that fails to provide warmth and transformation,coupled with qi deficiency,which cannot control and regulate bodily functions.This leads to poor blood circulation and inadequate protection,causing yin to malfunction in forming the physical components of the body.As a result,normal physiological functions of the zang-fu organs are disrupted,the production of beneficial physiological substances is obstructed,and metabolic waste products accumulate.The primary therapeutic approach should be focused on tonifying qi and ascending yang;tonifying qi will provide the impetus for blood circulation,whereas ascending yang will facilitate yang transformation qi.The zang-fu organs should also be protected and nourished to ameliorate the internal environment of yang deficiency and yin excess,as well as to eliminate pathological product accumulation to dredge the channels of blood circulation.Using the"yang transforming qi and yin shaping up the body"theory to guide the treatment of primary hypotension can help deepen the understanding of the pathogenesis of this disease and broaden the clinical diagnosis and treatment strategies.
4.Treating primary hypotension using the tonifying qi and ascending yang method based on the"yang transforming qi and yin shaping up body"theory
Xuhua JIAO ; Yufeng LI ; Min XIAO
Journal of Beijing University of Traditional Chinese Medicine 2024;47(11):1591-1596
Primary hypotension is a common and frequently occurring blood vessel disease,characterized by insidious onset,lingering condition,complex etiology,and diverse symptoms.Its pathogenesis is primarily characterized by deficiency,and its onset involves multiple zang-fu organs.The"yang transforming qi and yin shaping up body"theory is derived from the Huangdi Neijing.This theory summarizes the fundamental laws of the movement and changes in yin and yang.From this perspective,the paper hypothesizes that the basic pathogenesis of primary hypotension stems from an insufficiency of yang in transforming qi and a malfunction of yin in shaping up body.The essence of the condition lies in an overall yang deficiency that fails to provide warmth and transformation,coupled with qi deficiency,which cannot control and regulate bodily functions.This leads to poor blood circulation and inadequate protection,causing yin to malfunction in forming the physical components of the body.As a result,normal physiological functions of the zang-fu organs are disrupted,the production of beneficial physiological substances is obstructed,and metabolic waste products accumulate.The primary therapeutic approach should be focused on tonifying qi and ascending yang;tonifying qi will provide the impetus for blood circulation,whereas ascending yang will facilitate yang transformation qi.The zang-fu organs should also be protected and nourished to ameliorate the internal environment of yang deficiency and yin excess,as well as to eliminate pathological product accumulation to dredge the channels of blood circulation.Using the"yang transforming qi and yin shaping up the body"theory to guide the treatment of primary hypotension can help deepen the understanding of the pathogenesis of this disease and broaden the clinical diagnosis and treatment strategies.
5.Treating primary hypotension using the tonifying qi and ascending yang method based on the"yang transforming qi and yin shaping up body"theory
Xuhua JIAO ; Yufeng LI ; Min XIAO
Journal of Beijing University of Traditional Chinese Medicine 2024;47(11):1591-1596
Primary hypotension is a common and frequently occurring blood vessel disease,characterized by insidious onset,lingering condition,complex etiology,and diverse symptoms.Its pathogenesis is primarily characterized by deficiency,and its onset involves multiple zang-fu organs.The"yang transforming qi and yin shaping up body"theory is derived from the Huangdi Neijing.This theory summarizes the fundamental laws of the movement and changes in yin and yang.From this perspective,the paper hypothesizes that the basic pathogenesis of primary hypotension stems from an insufficiency of yang in transforming qi and a malfunction of yin in shaping up body.The essence of the condition lies in an overall yang deficiency that fails to provide warmth and transformation,coupled with qi deficiency,which cannot control and regulate bodily functions.This leads to poor blood circulation and inadequate protection,causing yin to malfunction in forming the physical components of the body.As a result,normal physiological functions of the zang-fu organs are disrupted,the production of beneficial physiological substances is obstructed,and metabolic waste products accumulate.The primary therapeutic approach should be focused on tonifying qi and ascending yang;tonifying qi will provide the impetus for blood circulation,whereas ascending yang will facilitate yang transformation qi.The zang-fu organs should also be protected and nourished to ameliorate the internal environment of yang deficiency and yin excess,as well as to eliminate pathological product accumulation to dredge the channels of blood circulation.Using the"yang transforming qi and yin shaping up the body"theory to guide the treatment of primary hypotension can help deepen the understanding of the pathogenesis of this disease and broaden the clinical diagnosis and treatment strategies.
6.Treating primary hypotension using the tonifying qi and ascending yang method based on the"yang transforming qi and yin shaping up body"theory
Xuhua JIAO ; Yufeng LI ; Min XIAO
Journal of Beijing University of Traditional Chinese Medicine 2024;47(11):1591-1596
Primary hypotension is a common and frequently occurring blood vessel disease,characterized by insidious onset,lingering condition,complex etiology,and diverse symptoms.Its pathogenesis is primarily characterized by deficiency,and its onset involves multiple zang-fu organs.The"yang transforming qi and yin shaping up body"theory is derived from the Huangdi Neijing.This theory summarizes the fundamental laws of the movement and changes in yin and yang.From this perspective,the paper hypothesizes that the basic pathogenesis of primary hypotension stems from an insufficiency of yang in transforming qi and a malfunction of yin in shaping up body.The essence of the condition lies in an overall yang deficiency that fails to provide warmth and transformation,coupled with qi deficiency,which cannot control and regulate bodily functions.This leads to poor blood circulation and inadequate protection,causing yin to malfunction in forming the physical components of the body.As a result,normal physiological functions of the zang-fu organs are disrupted,the production of beneficial physiological substances is obstructed,and metabolic waste products accumulate.The primary therapeutic approach should be focused on tonifying qi and ascending yang;tonifying qi will provide the impetus for blood circulation,whereas ascending yang will facilitate yang transformation qi.The zang-fu organs should also be protected and nourished to ameliorate the internal environment of yang deficiency and yin excess,as well as to eliminate pathological product accumulation to dredge the channels of blood circulation.Using the"yang transforming qi and yin shaping up the body"theory to guide the treatment of primary hypotension can help deepen the understanding of the pathogenesis of this disease and broaden the clinical diagnosis and treatment strategies.
7.Treating primary hypotension using the tonifying qi and ascending yang method based on the"yang transforming qi and yin shaping up body"theory
Xuhua JIAO ; Yufeng LI ; Min XIAO
Journal of Beijing University of Traditional Chinese Medicine 2024;47(11):1591-1596
Primary hypotension is a common and frequently occurring blood vessel disease,characterized by insidious onset,lingering condition,complex etiology,and diverse symptoms.Its pathogenesis is primarily characterized by deficiency,and its onset involves multiple zang-fu organs.The"yang transforming qi and yin shaping up body"theory is derived from the Huangdi Neijing.This theory summarizes the fundamental laws of the movement and changes in yin and yang.From this perspective,the paper hypothesizes that the basic pathogenesis of primary hypotension stems from an insufficiency of yang in transforming qi and a malfunction of yin in shaping up body.The essence of the condition lies in an overall yang deficiency that fails to provide warmth and transformation,coupled with qi deficiency,which cannot control and regulate bodily functions.This leads to poor blood circulation and inadequate protection,causing yin to malfunction in forming the physical components of the body.As a result,normal physiological functions of the zang-fu organs are disrupted,the production of beneficial physiological substances is obstructed,and metabolic waste products accumulate.The primary therapeutic approach should be focused on tonifying qi and ascending yang;tonifying qi will provide the impetus for blood circulation,whereas ascending yang will facilitate yang transformation qi.The zang-fu organs should also be protected and nourished to ameliorate the internal environment of yang deficiency and yin excess,as well as to eliminate pathological product accumulation to dredge the channels of blood circulation.Using the"yang transforming qi and yin shaping up the body"theory to guide the treatment of primary hypotension can help deepen the understanding of the pathogenesis of this disease and broaden the clinical diagnosis and treatment strategies.
8.Treating primary hypotension using the tonifying qi and ascending yang method based on the"yang transforming qi and yin shaping up body"theory
Xuhua JIAO ; Yufeng LI ; Min XIAO
Journal of Beijing University of Traditional Chinese Medicine 2024;47(11):1591-1596
Primary hypotension is a common and frequently occurring blood vessel disease,characterized by insidious onset,lingering condition,complex etiology,and diverse symptoms.Its pathogenesis is primarily characterized by deficiency,and its onset involves multiple zang-fu organs.The"yang transforming qi and yin shaping up body"theory is derived from the Huangdi Neijing.This theory summarizes the fundamental laws of the movement and changes in yin and yang.From this perspective,the paper hypothesizes that the basic pathogenesis of primary hypotension stems from an insufficiency of yang in transforming qi and a malfunction of yin in shaping up body.The essence of the condition lies in an overall yang deficiency that fails to provide warmth and transformation,coupled with qi deficiency,which cannot control and regulate bodily functions.This leads to poor blood circulation and inadequate protection,causing yin to malfunction in forming the physical components of the body.As a result,normal physiological functions of the zang-fu organs are disrupted,the production of beneficial physiological substances is obstructed,and metabolic waste products accumulate.The primary therapeutic approach should be focused on tonifying qi and ascending yang;tonifying qi will provide the impetus for blood circulation,whereas ascending yang will facilitate yang transformation qi.The zang-fu organs should also be protected and nourished to ameliorate the internal environment of yang deficiency and yin excess,as well as to eliminate pathological product accumulation to dredge the channels of blood circulation.Using the"yang transforming qi and yin shaping up the body"theory to guide the treatment of primary hypotension can help deepen the understanding of the pathogenesis of this disease and broaden the clinical diagnosis and treatment strategies.
9.Treating primary hypotension using the tonifying qi and ascending yang method based on the"yang transforming qi and yin shaping up body"theory
Xuhua JIAO ; Yufeng LI ; Min XIAO
Journal of Beijing University of Traditional Chinese Medicine 2024;47(11):1591-1596
Primary hypotension is a common and frequently occurring blood vessel disease,characterized by insidious onset,lingering condition,complex etiology,and diverse symptoms.Its pathogenesis is primarily characterized by deficiency,and its onset involves multiple zang-fu organs.The"yang transforming qi and yin shaping up body"theory is derived from the Huangdi Neijing.This theory summarizes the fundamental laws of the movement and changes in yin and yang.From this perspective,the paper hypothesizes that the basic pathogenesis of primary hypotension stems from an insufficiency of yang in transforming qi and a malfunction of yin in shaping up body.The essence of the condition lies in an overall yang deficiency that fails to provide warmth and transformation,coupled with qi deficiency,which cannot control and regulate bodily functions.This leads to poor blood circulation and inadequate protection,causing yin to malfunction in forming the physical components of the body.As a result,normal physiological functions of the zang-fu organs are disrupted,the production of beneficial physiological substances is obstructed,and metabolic waste products accumulate.The primary therapeutic approach should be focused on tonifying qi and ascending yang;tonifying qi will provide the impetus for blood circulation,whereas ascending yang will facilitate yang transformation qi.The zang-fu organs should also be protected and nourished to ameliorate the internal environment of yang deficiency and yin excess,as well as to eliminate pathological product accumulation to dredge the channels of blood circulation.Using the"yang transforming qi and yin shaping up the body"theory to guide the treatment of primary hypotension can help deepen the understanding of the pathogenesis of this disease and broaden the clinical diagnosis and treatment strategies.
10. Artificial intelligence-based bone age assessment using deep learning of characteristic regions in digital hand radiograph
Ying WEN ; Xuhua REN ; Xiujun YANG ; Lihong LI ; Jun LAN ; Tingting LI ; Qian WANG ; Lili SHI
Chinese Journal of Radiology 2019;53(10):895-899
Objective:
To detect the feasibility and efficiency of bone age(BA) artificial intelligence(AI) estimation based on deep learning features from traditional regions of interest(ROI) in hand digital radiographs(DR).
Methods:
BA dataset of left hand DR with 11 858 subjects aged from 0 to 18 years in Children′s Hospital of Shanghai were split to training(80.0%) and validation (20.0%) set in this study. An improved regression convolutional neural networks and extreme gradient boosting decision tree method were utilized for the BA analysis based on traditional ROIs in the images. Another set of BA data with 1 229 subjects also in the hospital was adopted for test. Mean average precision(mAP) and mean absolute error(MAE) were used to assess model accuracy of detection and BA prediction, respectively.
Results:
The mAP of ROIs detection of the model was 0.91,and MAE of all male and female subjects was 0.461 and 0.431 years respectively in validation and test sets. The difference less than 1 year in test accounted for 90.07% between BA assessment of the model and of the peadiatric radiologists, with an accuracy rate of 96.67%.The difference over 1 year was 9.03% (with underestimation of 6.43% and overestimation of 2.60%), in which corresponding age data was of being less in training set or sesamoid nearby adductor pollicis or fusion of epiphysis appeared in test set.
Conclusion
An AI model based on deep learning of traditional ROIs′ features in hand DR images is initially achieved to automatically predict BA rapidly and effectively, yet it still needs further optimization.

Result Analysis
Print
Save
E-mail