OBJECTIVE: To construct a prediction model for fracture reduction fixator therapy using the multi-modal multi-label classification (MMC) method. METHODS: Medical record data of 818 orthopedic patients from 2019 to 2023 were collected. Medical image features were extracted using the VGG19 network, text features of TCM four diagnostic methods (Inspection, Auscultation & Olfaction, Inquiry, Palpation) were extracted via the MiniLM model, and clinical case features were extracted through a fully connected neural network. After fusing the multi-modal information, multi-label therapy prediction was achieved using a linear layer. RESULTS: Experimental results on the clinical multi-modal dataset showed that the MMC method performed excellently in terms of subset accuracy(SA), accuracy(Acc), precision, and F₁-score, reaching 0.661, 0.856, 0.897, and 0.899 respectively. When the image modality and text modality were removed, the model performance decreased by an average of 8.1% and 2.4% respectively, while the hamming loss(HL) increased by 21.1% and 5.6% respectively. CONCLUSION The fracture reduction fixator therapy prediction model constructed in this study can effectively fuse multi-modal data, accurately predict personalized treatment plans for patients, and significantly improve the accuracy and reliability of treatment decisions. It provides a new solution for the digitalization and intellectualization of Traditional Chinese Medicine(TCM) in fracture treatment and has important clinical application prospects.
Humans ; Female ; Male ; Middle Aged ; Fracture Fixation/methods* ; Adult ; Fractures, Bone/surgery* ; Neural Networks, Computer ; Medicine, Chinese Traditional ; Aged

OBJECTIVE: To propose a new protocol for personalized mandibular reconstruction assisted by three-dimensional (3D) retrieval model based on fully connected neural network (FCNN) and a database of mandibles, and to verify clinical feasibility of the protocol. METHODS: A database of mandibles of 300 normal northern Chinese Han people was established. On the basis of cephalometry, the mandible landmarks with good stability were further screened. Mandibular landmarks were selected and geometric features of the mandible were extracted. A 3D retrieval algorithm was developed, which could retrieve the mandible most similar to a given mandible from the database. A FCNN was built to train the algorithm to improve accuracy of the 3D retrieval model. Using Geomagic Control 2014 software, matching accuracy of the 3D retrieval model was based on aforementioned mandible database and algorithm. From December 2019 to March 2021, a total of 5 patients underwent personalized mandibular reconstruction assisted by a 3D retrieval model based on mandible database and FCNN in the Department of Oral and Maxillofacial Surgery, Peking University School and Hospital of Stomatology. The most similar mandible was retrieved from mandible database through 3D retrieval algorithm. It was used to restore the premorbid morphology of defect area and guide mandibular reconstruction. For the 5 patients, mandible was reconstructed with iliac flap. Virtual surgical plan was transformed using individual surgical guides. RESULTS: Through screening, mandibular landmarks with high reproducibility and stability were identified and composed of mandibular landmarker protocols. After training, the average deviation between most similar mandible retrieved from the 300-case mandible database through 3D retrieval model based on FCNN and given mandible was (1.77±0.44) mm. And the root-mean-square deviation between the most similar mandible retrieved from the database and given mandible was (2.58±0.86) mm. The mandibular reconstruction surgery was successful in all the 5 patients. Their facial symmetry and occlusion were restored. All the patients were satisfied with postoperative appearance. The mean deviation between postoperative mandible and preoperative design was (0.98±0.17) mm. The area with a deviation ≤1 mm accounted for 61.34%±14. 13%, ≤2 mm accounted for 83.82%±7.35%, and ≤3 mm accounted for 93.94%± 2.87%. CONCLUSION The personalized mandibular reconstruction assisted by 3D retrieval model based on the 300-case mandible database and FCNN is feasible clinically.
Humans ; Neural Networks, Computer ; Mandibular Reconstruction/methods* ; Mandible/diagnostic imaging* ; Imaging, Three-Dimensional/methods* ; Adult ; Databases, Factual ; Female ; Male ; Algorithms ; Middle Aged ; Cephalometry

To address the problem of large reconstruction errors in 3D pulse signals caused by excessively small out-of-plane displacement of the contact membrane in the existing traditional Chinese medicine fingertip tactile binocular vision detection technology, this study proposes a 3D pulse image detection method based on subtle motion magnification technology and explores its application in pulse pattern recognition. Firstly, a 3D pulse image detection system based on binocular vision to obtain pulse image signals is developed as experimental data. Then, the phase motion video magnification algorithm is used to amplify the original signals, and the amplified signals are reconstructed in three dimensions to obtain 3D pulse signals. On this basis, nine features are extracted from the 3D pulse signals and features selection is performed using a two-sample Kolmogorov-Smirnov test. Finally, machine learning algorithms such as decision trees and random forests are used to identify the five types of pulse conditions: deep pulse, intermittent pulse, flooding pulse, slippery pulse, and rapid pulse. The experimental results show that compared to the methods without subtle motion magnification technology, the proposed method significantly improves waveform clarity, amplitude stability, and periodic regularity. Meanwhile, the average accuracy in pulse pattern recognition reaches 96.29%±0.26%.
Algorithms ; Imaging, Three-Dimensional/methods* ; Pattern Recognition, Automated ; Medicine, Chinese Traditional ; Motion ; Humans ; Pulse ; Signal Processing, Computer-Assisted ; Machine Learning

Medical robotic arm often encounters multi-source and nonlinear errors during the calibration process, making it difficult for traditional mathematical modeling methods to fully characterize system error features, thereby limiting further improvement in calibration accuracy. In this study, a robotic arm parameter error identification model is established, and a calibration method based on an adaptive long short-term memory (ALSTM) neural network is proposed. The method incorporates a particle swarm optimization (PSO) algorithm to optimize the weights of each layer of the LSTM neural network, enabling more effective fitting of robotic arm kinematic errors and ultimately yielding more accurate Denavit-Hartenberg (D-H) parameters. To validate the proposed approach, 110 sets of experimental data are collected using the HSR-JR680 robotic arm calibration system. Experimental results demonstrate that the ALSTM model reduces the root mean square error (RMSE) by 23.07%-80.39% compared to traditional calibration methods, and shortens the convergence time by 32.44% compared to a standard LSTM model. The optimized D-H parameters obtained meet the high-precision calibration requirements of medical robotic arm, confirming the effectiveness of the proposed method.
Calibration ; Neural Networks, Computer ; Algorithms ; Robotics ; Robotic Surgical Procedures ; Models, Theoretical

OBJECTIVES: Non-small cell lung cancer (NSCLC) is associated with poor prognosis, with 30% of patients diagnosed at an advanced stage. Mutations in the EGFR and KRAS genes are important prognostic factors for NSCLC, and targeted therapies can significantly improve survival in these patients. Although tissue biopsy remains the gold standard for detecting gene mutations, it has limitations, including invasiveness, sampling errors due to tumor heterogeneity, and poor reproducibility. This study aims to develop machine learning models based on radiomic features to predict EGFR and KRAS gene mutation status in NSCLC patients, thereby providing a reference for precision oncology. METHODS: Imaging and mutation data from eligible NSCLC patients were obtained from the publicly available Lung-PET-CT-Dx dataset in The Cancer Imaging Archive (TCIA). A three-dimensional-convolutional neural network (3D-CNN) was used to extract imaging features from the regions of interest (ROI). The LightGBM algorithm was employed to build classification models for predicting EGFR and KRAS gene mutation status. Model performance was evaluated using 5-fold cross-validation, with receiver operator characteristic (ROC) curves, area under the curve (AUC), accuracy, sensitivity, and specificity used for validation. RESULTS: The models effectively predicted EGFR and KRAS mutations in NSCLC patients, achieving an AUC of 0.95 for EGFR mutations and 0.90 for KRAS. The models also demonstrated high accuracy (EGFR 89.66%; KRAS 87.10%), sensitivity (EGFR 93.33%; KRAS 87.50%), and specificity (EGFR 85.71%; KRAS 86.67%). CONCLUSIONS A radiogenomics-machine learning predictive model can serve as a non-invasive tool for anticipating EGFR and KRAS gene mutation status in NSCLC patients.
Humans ; Carcinoma, Non-Small-Cell Lung/diagnostic imaging* ; Lung Neoplasms/diagnostic imaging* ; Mutation ; Proto-Oncogene Proteins p21(ras)/genetics* ; ErbB Receptors/genetics* ; Machine Learning ; Positron Emission Tomography Computed Tomography ; Female ; Male ; Neural Networks, Computer ; Middle Aged ; Aged

OBJECTIVES: The presence of multi-scale skin lesion regions and image noise interference and limited resources of auxiliary diagnostic equipment affect the accuracy of skin disease detection in skin disease detection tasks. To solve these problems, we propose a highly efficient and lightweight skin disease detection model using an improved RT-DETR model. METHODS: A lightweight FasterNet was introduced as the backbone network and the FasterNetBlock module was parametrically refined. A Convolutional and Attention Fusion Module (CAFM) was used to replace the multi-head self-attention mechanism in the neck network to enhance the ability of the AIFI-CAFM module for capturing global dependencies and local detail information. The DRB-HSFPN feature pyramid network was designed to replace the Cross-Scale Feature Fusion Module (CCFM) to allow the integration of contextual information across different scales to improve the semantic feature expression capacity of the neck network. Finally, combining the advantages of Inner-IoU and EIoU, the Inner-EIoU was used to replace the original loss function GIOU to further enhance the model's inference accuracy and convergence speed. RESULTS: The experimental results on the HAM10000 dataset showed that the improved RT-DETR model, as compared with the original model, had increased mAP@50 and mAP@50:95 by 4.5% and 2.8%, respectively, with a detection speed of 59.1 frames per second (FPS). The improved model had a parameter count of 10.9 M and a computational load of 19.3 GFLOPs, which were reduced by 46.0% and 67.2% compared to those of the original model, validating the effectiveness of the improved model. CONCLUSIONS The proposed SD-DETR model significantly improves the performance of skin disease detection tasks by effectively extracting and integrating multi-scale features while reducing both parameter count and computational load.
Humans ; Skin Diseases/diagnosis* ; Skin/pathology* ; Neural Networks, Computer ; Algorithms

OBJECTIVES: We propose a novel deep learning segmentation algorithm (DSRF) based on multi-scale supervision and residual feedback strategy for precise segmentation of the optic chiasm and optic nerves in CT images of nasopharyngeal carcinoma (NPC) patients. METHODS: We collected 212 NPC CT images and their ground truth labels from SegRap2023, StructSeg2019 and HaN-Seg2023 datasets. Based on a hybrid pooling strategy, we designed a decoder (HPS) to reduce small organ feature loss during pooling in convolutional neural networks. This decoder uses adaptive and average pooling to refine high-level semantic features, which are integrated with primary semantic features to enable network learning of finer feature details. We employed multi-scale deep supervision layers to learn rich multi-scale and multi-level semantic features under deep supervision, thereby enhancing boundary identification of the optic chiasm and optic nerves. A residual feedback module that enables multiple iterations of the network was designed for contrast enhancement of the optic chiasm and optic nerves in CT images by utilizing information from fuzzy boundaries and easily confused regions to iteratively refine segmentation results under supervision. The entire segmentation framework was optimized with the loss from each iteration to enhance segmentation accuracy and boundary clarity. Ablation experiments and comparative experiments were conducted to evaluate the effectiveness of each component and the performance of the proposed model. RESULTS: The DSRF algorithm could effectively enhance feature representation of small organs to achieve accurate segmentation of the optic chiasm and optic nerves with an average DSC of 0.837 and an ASSD of 0.351. Ablation experiments further verified the contributions of each component in the DSRF method. CONCLUSIONS The proposed deep learning segmentation algorithm can effectively enhance feature representation to achieve accurate segmentation of the optic chiasm and optic nerves in CT images of NPC.
Humans ; Tomography, X-Ray Computed/methods* ; Optic Chiasm/diagnostic imaging* ; Optic Nerve/diagnostic imaging* ; Algorithms ; Nasopharyngeal Carcinoma ; Deep Learning ; Nasopharyngeal Neoplasms/diagnostic imaging* ; Neural Networks, Computer ; Image Processing, Computer-Assisted/methods*

OBJECTIVES: To design a deep learning model that balances model complexity and performance to enable its integration into wearable ECG monitoring devices for automated diagnosis of atrial fibrillation. METHODS: This study was performed based on data from 84 patients with atrial fibrillation, 25 patients with atrial fibrillation, and 18 subjects without obvious arrhythmia collected from the publicly available datasets LTAFDB, AFDB, and NSRDB, respectively. A lightweight attention network based on depthwise separable convolution and fusion of channel-spatial information, namely DSC-AttNet, was proposed. Depthwise separable convolution was introduced to replace standard convolution and reduce model parameters and computational complexity to realize high efficiency and light weight of the model. The multilayer hybrid attention mechanism was embedded to compute the attentional weights of the channels and spatial information at different scales to improve the feature expression ability of the model. Ten-fold cross-validation was performed on LTAFDB, and external independent testing was conducted on AFDB and NSRDB datasets. RESULTS: DSC-AttNet achieved a ten-fold average accuracy of 97.33% and a precision of 97.30% on the test set, both of which outperformed the other 4 comparison models as well as the 3 classical models. The accuracy of the model on the external test set reached 92.78%, better than those of the 3 classical models. The number of parameters of DSC-AttNet was 1.01M, and the computational volume was 27.19G, both smaller than the 3 classical models. CONCLUSIONS This proposed method has a smaller complexity, achieves better classification performance, and has a better generalization ability for atrial fibrillation classification.
Atrial Fibrillation/diagnosis* ; Humans ; Electrocardiography ; Deep Learning ; Wearable Electronic Devices ; Neural Networks, Computer

OBJECTIVES: To construct vocal recognition classification models using 6 machine learning algorithms and vocal emotional characteristics of individuals with subthreshold depression to facilitate early identification of subthreshold depression. METHODS: We collected voice data from both normal individuals and participants with subthreshold depression by asking them to read specifically chosen words and texts. From each voice sample, 384-dimensional vocal emotional feature variables were extracted, including energy feature, Meir frequency cepstrum coefficient, zero cross rate feature, sound probability feature, fundamental frequency feature, difference feature. The Recursive Feature Elimination (RFE) method was employed to select voice feature variables. Classification models were then built using the machine learning algorithms Adaptive Boosting (AdaBoost), Random Forest (RF), Linear Discriminant Analysis (LDA), Logistic Regression (LR), Lasso Regression (LRLasso), and Support Vector Machine (SVM), and the performance of these models was evaluated. To assess generalization capability of the models, we used real-world speech data to evaluate the best speech recognition classification model. RESULTS: The AdaBoost, RF, and LDA models achieved high prediction accuracies of 100%, 100%, and 93.3% on word-reading speech test set, respectively. In the text-reading speech test set, the accuracies of the AdaBoost, RF, and LDA models were 90%, 80%, and 90%, respectively, while the accuracies of the other 3 models were all below 80%. On real-world word-reading and text-reading speech data, the classification models using AdaBoost and Random Forest still achieved high predictive accuracies (91.7% and 80.6% for AdaBoost and 86.1% and 77.8% for Random, respectively). CONCLUSIONS Analyzing vocal emotional characteristics allows effective identification of individuals with subthreshold depression. The AdaBoost and RF models show excellent performance for classifying subthreshold depression individuals, and may thus potentially offer valuable assistance in the clinical and research settings.
Humans ; Machine Learning ; Emotions ; Depression/diagnosis* ; Algorithms ; Voice ; Support Vector Machine ; Male ; Female

OBJECTIVES: We propose a multi-scale jaw cyst segmentation model, AConvLSTM U-Net, which is based on bidirectional dense connections and attention mechanisms to achieve accurate automatic segmentation of mandibular cyst images. METHODS: A dataset consisting of 2592 jaw cyst images was used. AConvLSTM U-Net designs a MBC on the encoding path to enhance feature extraction capabilities. A DPD was used to connect the encoder and decoder, and a bidirectional ConvLSTM was introduced in the jump connection to obtain rich semantic information. A decoding block based on scSE was then used on the decoding path to enhance the focus on important information. Finally, a DS was designed, and the model was optimized by integrating a joint loss function to further improve the segmentation accuracy. RESULTS: The experiment with AConvLSTM U-Net for jaw cyst lesion segmentation showed a MCC of 93.8443%, a DSC of 93.9067%, and a JSC of 88.5133%, outperforming all the other comparison segmentation models. CONCLUSIONS The proposed algorithm shows a high accuracy and robustness on the jaw cyst dataset, demonstrating its superior performance over many existing methods for automatic segmentation of jaw cyst images and its potential to assist clinical diagnosis.
Humans ; Jaw Cysts/diagnostic imaging* ; Algorithms ; Image Processing, Computer-Assisted/methods* ; Neural Networks, Computer