OBJECTIVE: To construct a prediction model for fracture reduction fixator therapy using the multi-modal multi-label classification (MMC) method. METHODS: Medical record data of 818 orthopedic patients from 2019 to 2023 were collected. Medical image features were extracted using the VGG19 network, text features of TCM four diagnostic methods (Inspection, Auscultation & Olfaction, Inquiry, Palpation) were extracted via the MiniLM model, and clinical case features were extracted through a fully connected neural network. After fusing the multi-modal information, multi-label therapy prediction was achieved using a linear layer. RESULTS: Experimental results on the clinical multi-modal dataset showed that the MMC method performed excellently in terms of subset accuracy(SA), accuracy(Acc), precision, and F₁-score, reaching 0.661, 0.856, 0.897, and 0.899 respectively. When the image modality and text modality were removed, the model performance decreased by an average of 8.1% and 2.4% respectively, while the hamming loss(HL) increased by 21.1% and 5.6% respectively. CONCLUSION The fracture reduction fixator therapy prediction model constructed in this study can effectively fuse multi-modal data, accurately predict personalized treatment plans for patients, and significantly improve the accuracy and reliability of treatment decisions. It provides a new solution for the digitalization and intellectualization of Traditional Chinese Medicine(TCM) in fracture treatment and has important clinical application prospects.
Humans ; Female ; Male ; Middle Aged ; Fracture Fixation/methods* ; Adult ; Fractures, Bone/surgery* ; Neural Networks, Computer ; Medicine, Chinese Traditional ; Aged

OBJECTIVE: To propose a new protocol for personalized mandibular reconstruction assisted by three-dimensional (3D) retrieval model based on fully connected neural network (FCNN) and a database of mandibles, and to verify clinical feasibility of the protocol. METHODS: A database of mandibles of 300 normal northern Chinese Han people was established. On the basis of cephalometry, the mandible landmarks with good stability were further screened. Mandibular landmarks were selected and geometric features of the mandible were extracted. A 3D retrieval algorithm was developed, which could retrieve the mandible most similar to a given mandible from the database. A FCNN was built to train the algorithm to improve accuracy of the 3D retrieval model. Using Geomagic Control 2014 software, matching accuracy of the 3D retrieval model was based on aforementioned mandible database and algorithm. From December 2019 to March 2021, a total of 5 patients underwent personalized mandibular reconstruction assisted by a 3D retrieval model based on mandible database and FCNN in the Department of Oral and Maxillofacial Surgery, Peking University School and Hospital of Stomatology. The most similar mandible was retrieved from mandible database through 3D retrieval algorithm. It was used to restore the premorbid morphology of defect area and guide mandibular reconstruction. For the 5 patients, mandible was reconstructed with iliac flap. Virtual surgical plan was transformed using individual surgical guides. RESULTS: Through screening, mandibular landmarks with high reproducibility and stability were identified and composed of mandibular landmarker protocols. After training, the average deviation between most similar mandible retrieved from the 300-case mandible database through 3D retrieval model based on FCNN and given mandible was (1.77±0.44) mm. And the root-mean-square deviation between the most similar mandible retrieved from the database and given mandible was (2.58±0.86) mm. The mandibular reconstruction surgery was successful in all the 5 patients. Their facial symmetry and occlusion were restored. All the patients were satisfied with postoperative appearance. The mean deviation between postoperative mandible and preoperative design was (0.98±0.17) mm. The area with a deviation ≤1 mm accounted for 61.34%±14. 13%, ≤2 mm accounted for 83.82%±7.35%, and ≤3 mm accounted for 93.94%± 2.87%. CONCLUSION The personalized mandibular reconstruction assisted by 3D retrieval model based on the 300-case mandible database and FCNN is feasible clinically.
Humans ; Neural Networks, Computer ; Mandibular Reconstruction/methods* ; Mandible/diagnostic imaging* ; Imaging, Three-Dimensional/methods* ; Adult ; Databases, Factual ; Female ; Male ; Algorithms ; Middle Aged ; Cephalometry

Medical robotic arm often encounters multi-source and nonlinear errors during the calibration process, making it difficult for traditional mathematical modeling methods to fully characterize system error features, thereby limiting further improvement in calibration accuracy. In this study, a robotic arm parameter error identification model is established, and a calibration method based on an adaptive long short-term memory (ALSTM) neural network is proposed. The method incorporates a particle swarm optimization (PSO) algorithm to optimize the weights of each layer of the LSTM neural network, enabling more effective fitting of robotic arm kinematic errors and ultimately yielding more accurate Denavit-Hartenberg (D-H) parameters. To validate the proposed approach, 110 sets of experimental data are collected using the HSR-JR680 robotic arm calibration system. Experimental results demonstrate that the ALSTM model reduces the root mean square error (RMSE) by 23.07%-80.39% compared to traditional calibration methods, and shortens the convergence time by 32.44% compared to a standard LSTM model. The optimized D-H parameters obtained meet the high-precision calibration requirements of medical robotic arm, confirming the effectiveness of the proposed method.
Calibration ; Neural Networks, Computer ; Algorithms ; Robotics ; Robotic Surgical Procedures ; Models, Theoretical

OBJECTIVES: Non-small cell lung cancer (NSCLC) is associated with poor prognosis, with 30% of patients diagnosed at an advanced stage. Mutations in the EGFR and KRAS genes are important prognostic factors for NSCLC, and targeted therapies can significantly improve survival in these patients. Although tissue biopsy remains the gold standard for detecting gene mutations, it has limitations, including invasiveness, sampling errors due to tumor heterogeneity, and poor reproducibility. This study aims to develop machine learning models based on radiomic features to predict EGFR and KRAS gene mutation status in NSCLC patients, thereby providing a reference for precision oncology. METHODS: Imaging and mutation data from eligible NSCLC patients were obtained from the publicly available Lung-PET-CT-Dx dataset in The Cancer Imaging Archive (TCIA). A three-dimensional-convolutional neural network (3D-CNN) was used to extract imaging features from the regions of interest (ROI). The LightGBM algorithm was employed to build classification models for predicting EGFR and KRAS gene mutation status. Model performance was evaluated using 5-fold cross-validation, with receiver operator characteristic (ROC) curves, area under the curve (AUC), accuracy, sensitivity, and specificity used for validation. RESULTS: The models effectively predicted EGFR and KRAS mutations in NSCLC patients, achieving an AUC of 0.95 for EGFR mutations and 0.90 for KRAS. The models also demonstrated high accuracy (EGFR 89.66%; KRAS 87.10%), sensitivity (EGFR 93.33%; KRAS 87.50%), and specificity (EGFR 85.71%; KRAS 86.67%). CONCLUSIONS A radiogenomics-machine learning predictive model can serve as a non-invasive tool for anticipating EGFR and KRAS gene mutation status in NSCLC patients.
Humans ; Carcinoma, Non-Small-Cell Lung/diagnostic imaging* ; Lung Neoplasms/diagnostic imaging* ; Mutation ; Proto-Oncogene Proteins p21(ras)/genetics* ; ErbB Receptors/genetics* ; Machine Learning ; Positron Emission Tomography Computed Tomography ; Female ; Male ; Neural Networks, Computer ; Middle Aged ; Aged

OBJECTIVES: The presence of multi-scale skin lesion regions and image noise interference and limited resources of auxiliary diagnostic equipment affect the accuracy of skin disease detection in skin disease detection tasks. To solve these problems, we propose a highly efficient and lightweight skin disease detection model using an improved RT-DETR model. METHODS: A lightweight FasterNet was introduced as the backbone network and the FasterNetBlock module was parametrically refined. A Convolutional and Attention Fusion Module (CAFM) was used to replace the multi-head self-attention mechanism in the neck network to enhance the ability of the AIFI-CAFM module for capturing global dependencies and local detail information. The DRB-HSFPN feature pyramid network was designed to replace the Cross-Scale Feature Fusion Module (CCFM) to allow the integration of contextual information across different scales to improve the semantic feature expression capacity of the neck network. Finally, combining the advantages of Inner-IoU and EIoU, the Inner-EIoU was used to replace the original loss function GIOU to further enhance the model's inference accuracy and convergence speed. RESULTS: The experimental results on the HAM10000 dataset showed that the improved RT-DETR model, as compared with the original model, had increased mAP@50 and mAP@50:95 by 4.5% and 2.8%, respectively, with a detection speed of 59.1 frames per second (FPS). The improved model had a parameter count of 10.9 M and a computational load of 19.3 GFLOPs, which were reduced by 46.0% and 67.2% compared to those of the original model, validating the effectiveness of the improved model. CONCLUSIONS The proposed SD-DETR model significantly improves the performance of skin disease detection tasks by effectively extracting and integrating multi-scale features while reducing both parameter count and computational load.
Humans ; Skin Diseases/diagnosis* ; Skin/pathology* ; Neural Networks, Computer ; Algorithms

OBJECTIVES: We propose a novel deep learning segmentation algorithm (DSRF) based on multi-scale supervision and residual feedback strategy for precise segmentation of the optic chiasm and optic nerves in CT images of nasopharyngeal carcinoma (NPC) patients. METHODS: We collected 212 NPC CT images and their ground truth labels from SegRap2023, StructSeg2019 and HaN-Seg2023 datasets. Based on a hybrid pooling strategy, we designed a decoder (HPS) to reduce small organ feature loss during pooling in convolutional neural networks. This decoder uses adaptive and average pooling to refine high-level semantic features, which are integrated with primary semantic features to enable network learning of finer feature details. We employed multi-scale deep supervision layers to learn rich multi-scale and multi-level semantic features under deep supervision, thereby enhancing boundary identification of the optic chiasm and optic nerves. A residual feedback module that enables multiple iterations of the network was designed for contrast enhancement of the optic chiasm and optic nerves in CT images by utilizing information from fuzzy boundaries and easily confused regions to iteratively refine segmentation results under supervision. The entire segmentation framework was optimized with the loss from each iteration to enhance segmentation accuracy and boundary clarity. Ablation experiments and comparative experiments were conducted to evaluate the effectiveness of each component and the performance of the proposed model. RESULTS: The DSRF algorithm could effectively enhance feature representation of small organs to achieve accurate segmentation of the optic chiasm and optic nerves with an average DSC of 0.837 and an ASSD of 0.351. Ablation experiments further verified the contributions of each component in the DSRF method. CONCLUSIONS The proposed deep learning segmentation algorithm can effectively enhance feature representation to achieve accurate segmentation of the optic chiasm and optic nerves in CT images of NPC.
Humans ; Tomography, X-Ray Computed/methods* ; Optic Chiasm/diagnostic imaging* ; Optic Nerve/diagnostic imaging* ; Algorithms ; Nasopharyngeal Carcinoma ; Deep Learning ; Nasopharyngeal Neoplasms/diagnostic imaging* ; Neural Networks, Computer ; Image Processing, Computer-Assisted/methods*

OBJECTIVES: To design a deep learning model that balances model complexity and performance to enable its integration into wearable ECG monitoring devices for automated diagnosis of atrial fibrillation. METHODS: This study was performed based on data from 84 patients with atrial fibrillation, 25 patients with atrial fibrillation, and 18 subjects without obvious arrhythmia collected from the publicly available datasets LTAFDB, AFDB, and NSRDB, respectively. A lightweight attention network based on depthwise separable convolution and fusion of channel-spatial information, namely DSC-AttNet, was proposed. Depthwise separable convolution was introduced to replace standard convolution and reduce model parameters and computational complexity to realize high efficiency and light weight of the model. The multilayer hybrid attention mechanism was embedded to compute the attentional weights of the channels and spatial information at different scales to improve the feature expression ability of the model. Ten-fold cross-validation was performed on LTAFDB, and external independent testing was conducted on AFDB and NSRDB datasets. RESULTS: DSC-AttNet achieved a ten-fold average accuracy of 97.33% and a precision of 97.30% on the test set, both of which outperformed the other 4 comparison models as well as the 3 classical models. The accuracy of the model on the external test set reached 92.78%, better than those of the 3 classical models. The number of parameters of DSC-AttNet was 1.01M, and the computational volume was 27.19G, both smaller than the 3 classical models. CONCLUSIONS This proposed method has a smaller complexity, achieves better classification performance, and has a better generalization ability for atrial fibrillation classification.
Atrial Fibrillation/diagnosis* ; Humans ; Electrocardiography ; Deep Learning ; Wearable Electronic Devices ; Neural Networks, Computer

OBJECTIVES: We propose a multi-scale jaw cyst segmentation model, AConvLSTM U-Net, which is based on bidirectional dense connections and attention mechanisms to achieve accurate automatic segmentation of mandibular cyst images. METHODS: A dataset consisting of 2592 jaw cyst images was used. AConvLSTM U-Net designs a MBC on the encoding path to enhance feature extraction capabilities. A DPD was used to connect the encoder and decoder, and a bidirectional ConvLSTM was introduced in the jump connection to obtain rich semantic information. A decoding block based on scSE was then used on the decoding path to enhance the focus on important information. Finally, a DS was designed, and the model was optimized by integrating a joint loss function to further improve the segmentation accuracy. RESULTS: The experiment with AConvLSTM U-Net for jaw cyst lesion segmentation showed a MCC of 93.8443%, a DSC of 93.9067%, and a JSC of 88.5133%, outperforming all the other comparison segmentation models. CONCLUSIONS The proposed algorithm shows a high accuracy and robustness on the jaw cyst dataset, demonstrating its superior performance over many existing methods for automatic segmentation of jaw cyst images and its potential to assist clinical diagnosis.
Humans ; Jaw Cysts/diagnostic imaging* ; Algorithms ; Image Processing, Computer-Assisted/methods* ; Neural Networks, Computer

OBJECTIVES: We propose a new melanoma segmentation model, SG-UNet, to enhance the precision of melanoma segmentation in dermascopy images to facilitate early melanoma detection. METHODS: We utilized a U-shaped convolutional neural network, UNet, and made improvements to its backbone, skip connections, and downsampling pooling sections. In the backbone, with reference to the structure of VGG, we increased the number of convolutions from 10 to 13 in the downsampling part of UNet to achieve a deepened network hierarchy that allowed capture of more refined feature representations. To further enhance feature extraction and detail recognition, we replaced the traditional convolution the backbone section with self-calibrated convolution to enhance the model's ability to capture both spatial and channel dimensional features. In the pooling part, the original pooling layer was replaced by Haar wavelet downsampling to achieve more effective multi-scale feature fusion and reduce the spatial resolution of the feature map. The global attention mechanism was then incorporated into the skip connections at each layer to enhance the understanding of contextual information of the image. RESULTS: The experimental results showed that the SG-UNet model achieved significantly improved segmentation accuracy on ISIC 2017 and ISIC 2018 datasets as compared with other current state-of-the-art segmentation models, with Dice reached 92.41% and 86.62% and IoU reaching 92.31% and 86.48% on the two datasets, respectively. CONCLUSIONS The proposed model is capable of effective and accurate segmentation of melanoma from dermoscopy images.
Melanoma/diagnosis* ; Humans ; Neural Networks, Computer ; Dermoscopy/methods* ; Skin Neoplasms ; Image Processing, Computer-Assisted/methods* ; Calibration ; Algorithms

OBJECTIVES: To construct an intelligent analysis model for classifying fetal orientation during intrapartum ultrasound videos based on multi-feature fusion. METHODS: The proposed model consists of the Input, Backbone Network and Classification Head modules. The Input module carries out data augmentation to improve the sample quality and generalization ability of the model. The Backbone Network was responsible for feature extraction based on Yolov8 combined with CBAM, ECA, PSA attention mechanism and AIFI feature interaction module. The Classification Head consists of a convolutional layer and a softmax function to output the final probability value of each class. The images of the key structures (the eyes, face, head, thalamus, and spine) were annotated with frames by physicians for model training to improve the classification accuracy of the anterior occipital, posterior occipital, and transverse occipital orientations. RESULTS: The experimental results showed that the proposed model had excellent performance in the tire orientation classification task with the classification accuracy reaching 0.984, an area under the PR curve (average accuracy) of 0.993, and area under the ROC curve of 0.984, and a kappa consistency test score of 0.974. The prediction results by the deep learning model were highly consistent with the actual classification results. CONCLUSIONS The multi-feature fusion model proposed in this study can efficiently and accurately classify fetal orientation in intrapartum ultrasound videos.
Humans ; Female ; Ultrasonography, Prenatal/methods* ; Pregnancy ; Fetus/diagnostic imaging* ; Neural Networks, Computer ; Video Recording