OBJECTIVES: To construct vocal recognition classification models using 6 machine learning algorithms and vocal emotional characteristics of individuals with subthreshold depression to facilitate early identification of subthreshold depression. METHODS: We collected voice data from both normal individuals and participants with subthreshold depression by asking them to read specifically chosen words and texts. From each voice sample, 384-dimensional vocal emotional feature variables were extracted, including energy feature, Meir frequency cepstrum coefficient, zero cross rate feature, sound probability feature, fundamental frequency feature, difference feature. The Recursive Feature Elimination (RFE) method was employed to select voice feature variables. Classification models were then built using the machine learning algorithms Adaptive Boosting (AdaBoost), Random Forest (RF), Linear Discriminant Analysis (LDA), Logistic Regression (LR), Lasso Regression (LRLasso), and Support Vector Machine (SVM), and the performance of these models was evaluated. To assess generalization capability of the models, we used real-world speech data to evaluate the best speech recognition classification model. RESULTS: The AdaBoost, RF, and LDA models achieved high prediction accuracies of 100%, 100%, and 93.3% on word-reading speech test set, respectively. In the text-reading speech test set, the accuracies of the AdaBoost, RF, and LDA models were 90%, 80%, and 90%, respectively, while the accuracies of the other 3 models were all below 80%. On real-world word-reading and text-reading speech data, the classification models using AdaBoost and Random Forest still achieved high predictive accuracies (91.7% and 80.6% for AdaBoost and 86.1% and 77.8% for Random, respectively). CONCLUSIONS Analyzing vocal emotional characteristics allows effective identification of individuals with subthreshold depression. The AdaBoost and RF models show excellent performance for classifying subthreshold depression individuals, and may thus potentially offer valuable assistance in the clinical and research settings.
Humans ; Machine Learning ; Emotions ; Depression/diagnosis* ; Algorithms ; Voice ; Support Vector Machine ; Male ; Female

Within the prefrontal-cingulate cortex, abnormalities in coupling between neuronal networks can disturb the emotion-cognition interactions, contributing to the development of mental disorders such as depression. Despite this understanding, the neural circuit mechanisms underlying this phenomenon remain elusive. In this study, we present a biophysical computational model encompassing three crucial regions, including the dorsolateral prefrontal cortex, subgenual anterior cingulate cortex, and ventromedial prefrontal cortex. The objective is to investigate the role of coupling relationships within the prefrontal-cingulate cortex networks in balancing emotions and cognitive processes. The numerical results confirm that coupled weights play a crucial role in the balance of emotional cognitive networks. Furthermore, our model predicts the pathogenic mechanism of depression resulting from abnormalities in the subgenual cortex, and network functionality was restored through intervention in the dorsolateral prefrontal cortex. This study utilizes computational modeling techniques to provide an insight explanation for the diagnosis and treatment of depression.
Prefrontal Cortex/physiology* ; Humans ; Emotions/physiology* ; Cognition/physiology* ; Gyrus Cinguli/physiology* ; Computer Simulation ; Models, Neurological ; Neural Pathways/physiology* ; Nerve Net/physiology*

In modern society, people are increasingly exposed to chronic stress, leading to various mental disorders. However, the activities of brain regions, especially neural firing patterns related to specific behaviors, remain unclear. In this study, we introduce a novel approach, NeuroSync, which integrates open-field behavioral testing with electrophysiological recordings from emotion-related brain regions, specifically the central amygdala and the paraventricular nucleus of the hypothalamus, to explore the mechanisms of negative emotions induced by chronic stress in mice. By applying machine vision techniques, we quantified behaviors in the open field, and signal processing algorithms elucidated the neural underpinnings of the observed behaviors. Synchronizing behavioral and electrophysiological data revealed significant correlations between neural firing patterns and stress-related behaviors, providing insights into real-time brain activity underlying behavioral responses. This research combines deep learning and machine learning to synchronize high-resolution video and electrophysiological data, offering new insights into neural-behavioral dynamics under chronic stress conditions.
Animals ; Mice ; Male ; Emotions/physiology* ; Stress, Psychological/physiopathology* ; Action Potentials/physiology* ; Mice, Inbred C57BL ; Behavior, Animal/physiology* ; Machine Learning ; Amygdala/physiopathology* ; Neurons/physiology* ; Paraventricular Hypothalamic Nucleus/physiopathology* ; Brain/physiology*

Premenstrual dysphoric disorder (PMDD) is considered a severe form of premenstrual syndrome (PMS). As a key brain region involved in emotional regulation and stress responses, the amygdala has been implicated in the pathogenesis of PMS/PMDD. The amygdala is composed of multiple subregions, each playing distinct roles in emotion, memory, and stress responses, and forms complex brain areas. Summarizing the interconnections among amygdala, subregions and their connectivity with external areas, and exploringt the neuroimaging characteristics of the amygdala, as well as changes in its neural circuits and brain networks in these patients, will help provide a theoretical foundation for targeted modulation of amygdala function in the treatment of PMS/PMDD.
Humans ; Amygdala/diagnostic imaging* ; Female ; Premenstrual Dysphoric Disorder/pathology* ; Premenstrual Syndrome/pathology* ; Emotions/physiology* ; Magnetic Resonance Imaging

OBJECTIVES: To investigate the chain mediating role of family care and emotional management in the relationship between social support and anxiety among rural primary school students. METHODS: A questionnaire survey was conducted among students in grades 4 to 6 from four counties in Hunan Province. Data were collected using the Social Support Rating Scale, Family Care Index Scale, Emotional Intelligence Scale, and Generalized Anxiety Disorder -7. Logistic regression analysis was used to explore the influencing factors of anxiety symptoms. Mediation analysis was conducted to assess the chain mediating effects of family care and emotional management between social support and anxiety. RESULTS: A total of 4 141 questionnaires were distributed, with 3 874 valid responses (effective response rate: 93.55%). The prevalence rate of anxiety symptoms among these students was 9.32% (95%CI: 8.40%-10.23%). Significant differences were observed in the prevalence rates of anxiety symptoms among groups with different levels of social support, family functioning, and emotional management ability (P<0.05). The total indirect effect of social support on anxiety symptoms via family care and emotional management was significant (β=-0.137, 95%CI: -0.167 to -0.109), and the direct effect of social support on anxiety symptoms remained significant (P<0.05). Family care and emotional management served as significant chain mediators in the relationship between social support and anxiety symptoms (β=-0.025,95%CI:-0.032 to -0.018), accounting for 14.5% of the total effect. CONCLUSIONS Social support can directly affect anxiety symptoms among rural primary school students and can also indirectly influence anxiety symptoms through the chain mediating effects of family care and emotional management. These findings provide scientific evidence for the prevention of anxiety in primary school students from multiple perspectives.
Humans ; Female ; Male ; Social Support ; Anxiety/etiology* ; Child ; Students/psychology* ; Emotions ; Logistic Models

Emotion classification and recognition is a crucial area in emotional computing. Physiological signals, such as electroencephalogram (EEG), provide an accurate reflection of emotions and are difficult to disguise. However, emotion recognition still faces challenges in single-modal signal feature extraction and multi-modal signal integration. This study collected EEG, electromyogram (EMG), and electrodermal activity (EDA) signals from participants under three emotional states: happiness, sadness, and fear. A feature-weighted fusion method was applied for integrating the signals, and both support vector machine (SVM) and extreme learning machine (ELM) were used for classification. The results showed that the classification accuracy was highest when the fusion weights were set to EEG 0.7, EMG 0.15, and EDA 0.15, achieving accuracy rates of 80.19% and 82.48% for SVM and ELM, respectively. These rates represented an improvement of 5.81% and 2.95% compared to using EEG alone. This study offers methodological support for emotion classification and recognition using multi-modal physiological signals.
Humans ; Emotions/physiology* ; Electroencephalography ; Support Vector Machine ; Electromyography ; Signal Processing, Computer-Assisted ; Galvanic Skin Response/physiology* ; Machine Learning ; Male

In audiovisual emotion recognition, representational learning is a research direction receiving considerable attention, and the key lies in constructing effective affective representations with both consistency and variability. However, there are still many challenges to accurately realize affective representations. For this reason, in this paper we proposed a cross-modal audiovisual recognition model based on a multi-head cross-attention mechanism. The model achieved fused feature and modality alignment through a multi-head cross-attention architecture, and adopted a segmented training strategy to cope with the modality missing problem. In addition, a unimodal auxiliary loss task was designed and shared parameters were used in order to preserve the independent information of each modality. Ultimately, the model achieved macro and micro F1 scores of 84.5% and 88.2%, respectively, on the crowdsourced annotated multimodal emotion dataset of actor performances (CREMA-D). The model in this paper can effectively capture intra- and inter-modal feature representations of audio and video modalities, and successfully solves the unity problem of the unimodal and multimodal emotion recognition frameworks, which provides a brand-new solution to the audiovisual emotion recognition.
Emotions ; Humans ; Attention ; Algorithms

Existing emotion recognition research is typically limited to static laboratory settings and has not fully handle the changes in emotional states in dynamic scenarios. To address this problem, this paper proposes a method for dynamic continuous emotion recognition based on electroencephalography (EEG) and eye movement signals. Firstly, an experimental paradigm was designed to cover six dynamic emotion transition scenarios including happy to calm, calm to happy, sad to calm, calm to sad, nervous to calm, and calm to nervous. EEG and eye movement data were collected simultaneously from 20 subjects to fill the gap in current multimodal dynamic continuous emotion datasets. In the valence-arousal two-dimensional space, emotion ratings for stimulus videos were performed every five seconds on a scale of 1 to 9, and dynamic continuous emotion labels were normalized. Subsequently, frequency band features were extracted from the preprocessed EEG and eye movement data. A cascade feature fusion approach was used to effectively combine EEG and eye movement features, generating an information-rich multimodal feature vector. This feature vector was input into four regression models including support vector regression with radial basis function kernel, decision tree, random forest, and K-nearest neighbors, to develop the dynamic continuous emotion recognition model. The results showed that the proposed method achieved the lowest mean square error for valence and arousal across the six dynamic continuous emotions. This approach can accurately recognize various emotion transitions in dynamic situations, offering higher accuracy and robustness compared to using either EEG or eye movement signals alone, making it well-suited for practical applications.
Humans ; Electroencephalography/methods* ; Emotions/physiology* ; Eye Movements/physiology* ; Signal Processing, Computer-Assisted ; Support Vector Machine ; Algorithms

Post-stroke aphasia is associated with a significantly elevated risk of depression, yet the underlying mechanisms remain unclear. This study recorded 64-channel electroencephalogram data and depression scale scores from 12 aphasic patients with depression, 8 aphasic patients without depression, and 12 healthy controls during resting state and an emotional Stroop task. Spectral and microstate analyses were conducted to examine brain activity patterns across conditions. Results showed that depression scores significantly negatively explained the occurrence of microstate class C and positively explained the transition probability from microstate class A to B. Furthermore, aphasic patients with depression exhibited increased alpha-band activation in the frontal region. These findings suggest distinct neural features in aphasic patients with depression and offer new insights into the mechanisms contributing to their heightened vulnerability to depression.
Humans ; Electroencephalography ; Aphasia/etiology* ; Stroop Test ; Emotions/physiology* ; Depression/etiology* ; Male ; Female ; Middle Aged ; Stroke/complications* ; Brain/physiopathology* ; Aged ; Adult ; Rest/physiology*

Emotion can reflect the psychological and physiological health of human beings, and the main expression of human emotion is voice and facial expression. How to extract and effectively integrate the two modes of emotion information is one of the main challenges faced by emotion recognition. In this paper, a multi-branch bidirectional multi-scale time perception model is proposed, which can detect the forward and reverse speech Mel-frequency spectrum coefficients in the time dimension. At the same time, the model uses causal convolution to obtain temporal correlation information between different scale features, and assigns attention maps to them according to the information, so as to obtain multi-scale fusion of speech emotion features. Secondly, this paper proposes a two-modal feature dynamic fusion algorithm, which combines the advantages of AlexNet and uses overlapping maximum pooling layers to obtain richer fusion features from different modal feature mosaic matrices. Experimental results show that the accuracy of the multi-branch bidirectional multi-scale time sensing dual-modal emotion recognition model proposed in this paper reaches 97.67% and 90.14% respectively on the two public audio and video emotion data sets, which is superior to other common methods, indicating that the proposed emotion recognition model can effectively capture emotion feature information and improve the accuracy of emotion recognition.
Humans ; Emotions ; Algorithms ; Facial Expression ; Time Perception ; Neural Networks, Computer ; Speech