1.A multi-behavior recognition method for macaques based on improved SlowFast network.
Weifeng ZHONG ; Zhe XU ; Xiangyu ZHU ; Xibo MA
Journal of Biomedical Engineering 2023;40(2):257-264
Macaque is a common animal model in drug safety assessment. Its behavior reflects its health condition before and after drug administration, which can effectively reveal the side effects of drugs. At present, researchers usually rely on artificial methods to observe the behavior of macaque, which cannot achieve uninterrupted 24-hour monitoring. Therefore, it is urgent to develop a system to realize 24-hour observation and recognition of macaque behavior. In order to solve this problem, this paper constructs a video dataset containing nine kinds of macaque behaviors (MBVD-9), and proposes a network called Transformer-augmented SlowFast for macaque behavior recognition (TAS-MBR) based on this dataset. Specifically, the TAS-MBR network converts the red, green and blue (RGB) color mode frame input by its fast branches into residual frames on the basis of SlowFast network and introduces the Transformer module after the convolution operation to obtain sports information more effectively. The results show that the average classification accuracy of TAS-MBR network for macaque behavior is 94.53%, which is significantly improved compared with the original SlowFast network, proving the effectiveness and superiority of the proposed method in macaque behavior recognition. This work provides a new idea for the continuous observation and recognition of the behavior of macaque, and lays the technical foundation for the calculation of monkey behaviors before and after medication in drug safety evaluation.
Animals
;
Electric Power Supplies
;
Macaca
;
Recognition, Psychology
2.A method of mental disorder recognition based on visibility graph.
Bingtao ZHANG ; Dan WEI ; Wenwen CHANG ; Zhifei YANG ; Yanlin LI
Journal of Biomedical Engineering 2023;40(3):442-449
The causes of mental disorders are complex, and early recognition and early intervention are recognized as effective way to avoid irreversible brain damage over time. The existing computer-aided recognition methods mostly focus on multimodal data fusion, ignoring the asynchronous acquisition problem of multimodal data. For this reason, this paper proposes a framework of mental disorder recognition based on visibility graph (VG) to solve the problem of asynchronous data acquisition. First, time series electroencephalograms (EEG) data are mapped to spatial visibility graph. Then, an improved auto regressive model is used to accurately calculate the temporal EEG data features, and reasonably select the spatial metric features by analyzing the spatiotemporal mapping relationship. Finally, on the basis of spatiotemporal information complementarity, different contribution coefficients are assigned to each spatiotemporal feature and to explore the maximum potential of feature so as to make decisions. The results of controlled experiments show that the method in this paper can effectively improve the recognition accuracy of mental disorders. Taking Alzheimer's disease and depression as examples, the highest recognition rates are 93.73% and 90.35%, respectively. In summary, the results of this paper provide an effective computer-aided tool for rapid clinical diagnosis of mental disorders.
Humans
;
Mental Disorders/diagnosis*
;
Alzheimer Disease/diagnosis*
;
Brain Injuries
;
Electroencephalography
;
Recognition, Psychology
3.A multimodal medical image contrastive learning algorithm with domain adaptive denormalization.
Han WEN ; Ying ZHAO ; Xiuding CAI ; Ailian LIU ; Yu YAO ; Zhongliang FU
Journal of Biomedical Engineering 2023;40(3):482-491
Recently, deep learning has achieved impressive results in medical image tasks. However, this method usually requires large-scale annotated data, and medical images are expensive to annotate, so it is a challenge to learn efficiently from the limited annotated data. Currently, the two commonly used methods are transfer learning and self-supervised learning. However, these two methods have been little studied in multimodal medical images, so this study proposes a contrastive learning method for multimodal medical images. The method takes images of different modalities of the same patient as positive samples, which effectively increases the number of positive samples in the training process and helps the model to fully learn the similarities and differences of lesions on images of different modalities, thus improving the model's understanding of medical images and diagnostic accuracy. The commonly used data augmentation methods are not suitable for multimodal images, so this paper proposes a domain adaptive denormalization method to transform the source domain images with the help of statistical information of the target domain. In this study, the method is validated with two different multimodal medical image classification tasks: in the microvascular infiltration recognition task, the method achieves an accuracy of (74.79 ± 0.74)% and an F1 score of (78.37 ± 1.94)%, which are improved as compared with other conventional learning methods; for the brain tumor pathology grading task, the method also achieves significant improvements. The results show that the method achieves good results on multimodal medical images and can provide a reference solution for pre-training multimodal medical images.
Humans
;
Algorithms
;
Brain/diagnostic imaging*
;
Brain Neoplasms/diagnostic imaging*
;
Recognition, Psychology
4.Microwave sensor for recognition of abnormal nodule tissue on body surface.
Chunxue LI ; Hongfu GUO ; Chen ZHOU ; Xinran WANG ; Junkai BAI
Journal of Biomedical Engineering 2023;40(1):149-154
For the detection and identification of abnormal nodular tissues on the body surface, a microwave sensor structure loaded with a spiral resonator is proposed in this paper, a sensor simulation model is established using HFSS software, the structural parameters are optimized, and the actual sensor is fabricated. The S21 parameters of the tissue were obtained when nodules appeared by simulation, and the characteristic relationship between the difference of S21 parameters with position was analyzed and tested experimentally. The results showed that when nodules were present in normal tissues, the curve of S21 parameter difference with position change had obvious inverted bimodal characteristics, and the extreme value of S21 parameter difference appeared when the sensor was directly above the nodules, which was easy to identify the position of nodules. It provides an objective detection tool for the identification of abnormal nodular tissues on the body surface.
Microwaves
;
Recognition, Psychology
;
Computer Simulation
;
Software
5.A review on intelligent auxiliary diagnosis methods based on electrocardiograms for myocardial infarction.
Chuang HAN ; Wenge QUE ; Zhizhong WANG ; Songwei WANG ; Yanting LI ; Li SHI
Journal of Biomedical Engineering 2023;40(5):1019-1026
Myocardial infarction (MI) has the characteristics of high mortality rate, strong suddenness and invisibility. There are problems such as the delayed diagnosis, misdiagnosis and missed diagnosis in clinical practice. Electrocardiogram (ECG) examination is the simplest and fastest way to diagnose MI. The research on MI intelligent auxiliary diagnosis based on ECG is of great significance. On the basis of the pathophysiological mechanism of MI and characteristic changes in ECG, feature point extraction and morphology recognition of ECG, along with intelligent auxiliary diagnosis method of MI based on machine learning and deep learning are all summarized. The models, datasets, the number of ECG, the number of leads, input modes, evaluation methods and effects of different methods are compared. Finally, future research directions and development trends are pointed out, including data enhancement of MI, feature points and dynamic features extraction of ECG, the generalization and clinical interpretability of models, which are expected to provide references for researchers in related fields of MI intelligent auxiliary diagnosis.
Humans
;
Electrocardiography
;
Myocardial Infarction/diagnosis*
;
Recognition, Psychology
6.A Virtual Reality Platform for Context-Dependent Cognitive Research in Rodents.
Xue-Tong QU ; Jin-Ni WU ; Yunqing WEN ; Long CHEN ; Shi-Lei LV ; Li LIU ; Li-Jie ZHAN ; Tian-Yi LIU ; Hua HE ; Yu LIU ; Chun XU
Neuroscience Bulletin 2023;39(5):717-730
Animal survival necessitates adaptive behaviors in volatile environmental contexts. Virtual reality (VR) technology is instrumental to study the neural mechanisms underlying behaviors modulated by environmental context by simulating the real world with maximized control of contextual elements. Yet current VR tools for rodents have limited flexibility and performance (e.g., frame rate) for context-dependent cognitive research. Here, we describe a high-performance VR platform with which to study contextual behaviors immersed in editable virtual contexts. This platform was assembled from modular hardware and custom-written software with flexibility and upgradability. Using this platform, we trained mice to perform context-dependent cognitive tasks with rules ranging from discrimination to delayed-sample-to-match while recording from thousands of hippocampal place cells. By precise manipulations of context elements, we found that the context recognition was intact with partial context elements, but impaired by exchanges of context elements. Collectively, our work establishes a configurable VR platform with which to investigate context-dependent cognition with large-scale neural recording.
Animals
;
Mice
;
Rodentia
;
Virtual Reality
;
Cognition
;
Recognition, Psychology
7.Research on depression recognition based on brain function network.
Bingtao ZHANG ; Wenying ZHOU ; Yanlin LI ; Wenwen CHANG ; Binbin XU
Journal of Biomedical Engineering 2022;39(1):47-55
Traditional depression research based on electroencephalogram (EEG) regards electrodes as isolated nodes and ignores the correlation between them. So it is difficult to discover abnormal brain topology alters in patients with depression. To resolve this problem, this paper proposes a framework for depression recognition based on brain function network (BFN). To avoid the volume conductor effect, the phase lag index is used to construct BFN. BFN indexes closely related to the characteristics of "small world" and specific brain regions of minimum spanning tree were selected based on the information complementarity of weighted and binary BFN and then potential biomarkers of depression recognition are found based on the progressive index analysis strategy. The resting state EEG data of 48 subjects was used to verify this scheme. The results showed that the synchronization between groups was significantly changed in the left temporal, right parietal occipital and right frontal, the shortest path length and clustering coefficient of weighted BFN, the leaf scores of left temporal and right frontal and the diameter of right parietal occipital of binary BFN were correlated with patient health questionnaire 9-items (PHQ-9), and the highest recognition rate was 94.11%. In addition, the study found that compared with healthy controls, the information processing ability of patients with depression reduced significantly. The results of this study provide a new idea for the construction and analysis of BFN and a new method for exploring the potential markers of depression recognition.
Brain
;
Brain Mapping
;
Depression/diagnosis*
;
Electroencephalography
;
Humans
;
Recognition, Psychology
8.Perception of Smile Aesthetics and Attractiveness among Saudi Females
Nozha Sawan ; Mamata Hebbal ; Abeer Alshami ; Afnan Ben Gassem ; Yara Alromaih ; Eman Alsagob
Archives of Orofacial Sciences 2022;17(1):113-122
ABSTRACT
Smile aesthetic, known as the static and dynamic relationship of the dentition and supporting
structures to the facial soft tissues, is one of the most important elements of facial attractiveness.
The objective of the study was to assess the perception of smile aesthetics and attractiveness through
digital image manipulation of aesthetic variables and to compare those perceptions according to
diverse sociodemographic data among female Saudi laypeople attending the dental clinic. A crosssectional study of 193 female Saudi participants were randomly selected and consented to answer the
study questionnaire. Nine smile photograph images were created to compare different smile aesthetic
perceptions. Two groups were recruited: 120 participants in the first group (under 30 years old) and
73 participants in the second group (30 years old or above). All participants in both groups were asked
to choose the attractiveness of each smile image using multiple-choice options. A statistically significant
finding showed that normal buccal corridors were chosen as the most attractive smile by 42.5%
of the participants in the younger group and by a significantly higher ratio of the participants with a
bachelor’s degree or higher level of education at 49% (p < 0.05). Laypeople’s preferences regarding smile
attractiveness vary, but a normal appearance was the ideal choice for the majority. Orthodontic treatment
should consider the general sociocultural understanding of smile perception.
Esthetics, Dental--psychology
;
Facial Recognition
;
Saudi Arabia
9.An improved Vision Transformer model for the recognition of blood cells.
Tianyu SUN ; Qingtao ZHU ; Jian YANG ; Liang ZENG
Journal of Biomedical Engineering 2022;39(6):1097-1107
Leukemia is a common, multiple and dangerous blood disease, whose early diagnosis and treatment are very important. At present, the diagnosis of leukemia heavily relies on morphological examination of blood cell images by pathologists, which is tedious and time-consuming. Meanwhile, the diagnostic results are highly subjective, which may lead to misdiagnosis and missed diagnosis. To address the gap above, we proposed an improved Vision Transformer model for blood cell recognition. First, a faster R-CNN network was used to locate and extract individual blood cell slices from original images. Then, we split the single-cell image into multiple image patches and put them into the encoder layer for feature extraction. Based on the self-attention mechanism of the Transformer, we proposed a sparse attention module which could focus on the discriminative parts of blood cell images and improve the fine-grained feature representation ability of the model. Finally, a contrastive loss function was adopted to further increase the inter-class difference and intra-class consistency of the extracted features. Experimental results showed that the proposed module outperformed the other approaches and significantly improved the accuracy to 91.96% on the Munich single-cell morphological dataset of leukocytes, which is expected to provide a reference for physicians' clinical diagnosis.
Humans
;
Blood Cells
;
Leukocytes
;
Leukemia
;
Electric Power Supplies
;
Recognition, Psychology
10.Research on muscle fatigue recognition model based on improved wavelet denoising and long short-term memory.
Junhong WANG ; Shaoming SUN ; Yining SUN ; Jingcheng CHEN ; Wei PENG ; Lei LI
Journal of Biomedical Engineering 2022;39(3):507-515
The automatic recognition technology of muscle fatigue has widespread application in the field of kinesiology and rehabilitation medicine. In this paper, we used surface electromyography (sEMG) to study the recognition of leg muscle fatigue during circuit resistance training. The purpose of this study was to solve the problem that the sEMG signals have a lot of noise interference and the recognition accuracy of the existing muscle fatigue recognition model is not high enough. First, we proposed an improved wavelet threshold function denoising algorithm to denoise the sEMG signal. Then, we build a muscle fatigue state recognition model based on long short-term memory (LSTM), and used the Holdout method to evaluate the performance of the model. Finally, the denoising effect of the improved wavelet threshold function denoising method proposed in this paper was compared with the denoising effect of the traditional wavelet threshold denoising method. We compared the performance of the proposed muscle fatigue recognition model with that of particle swarm optimization support vector machine (PSO-SVM) and convolutional neural network (CNN). The results showed that the new wavelet threshold function had better denoising performance than hard and soft threshold functions. The accuracy of LSTM network model in identifying muscle fatigue was 4.89% and 2.47% higher than that of PSO-SVM and CNN, respectively. The sEMG signal denoising method and muscle fatigue recognition model proposed in this paper have important implications for monitoring muscle fatigue during rehabilitation training and exercise.
Electromyography
;
Memory, Short-Term
;
Muscle Fatigue
;
Neural Networks, Computer
;
Recognition, Psychology


Result Analysis
Print
Save
E-mail