Emotion can reflect the psychological and physiological health of human beings, and the main expression of human emotion is voice and facial expression. How to extract and effectively integrate the two modes of emotion information is one of the main challenges faced by emotion recognition. In this paper, a multi-branch bidirectional multi-scale time perception model is proposed, which can detect the forward and reverse speech Mel-frequency spectrum coefficients in the time dimension. At the same time, the model uses causal convolution to obtain temporal correlation information between different scale features, and assigns attention maps to them according to the information, so as to obtain multi-scale fusion of speech emotion features. Secondly, this paper proposes a two-modal feature dynamic fusion algorithm, which combines the advantages of AlexNet and uses overlapping maximum pooling layers to obtain richer fusion features from different modal feature mosaic matrices. Experimental results show that the accuracy of the multi-branch bidirectional multi-scale time sensing dual-modal emotion recognition model proposed in this paper reaches 97.67% and 90.14% respectively on the two public audio and video emotion data sets, which is superior to other common methods, indicating that the proposed emotion recognition model can effectively capture emotion feature information and improve the accuracy of emotion recognition.
Humans ; Emotions ; Algorithms ; Facial Expression ; Time Perception ; Neural Networks, Computer ; Speech

Rhythm, as a prominent characteristic of auditory experiences such as speech and music, is known to facilitate attention, yet its contribution to working memory (WM) remains unclear. Here, human participants temporarily retained a 12-tone sequence presented rhythmically or arrhythmically in WM and performed a pitch change-detection task. Behaviorally, while having comparable accuracy, rhythmic tone sequences showed a faster response time and lower response boundaries in decision-making. Electroencephalographic recordings revealed that rhythmic sequences elicited enhanced non-phase-locked beta-band (16 Hz-33 Hz) and theta-band (3 Hz-5 Hz) neural oscillations during sensory encoding and WM retention periods, respectively. Importantly, the two-stage neural signatures were correlated with each other and contributed to behavior. As beta-band and theta-band oscillations denote the engagement of motor systems and WM maintenance, respectively, our findings imply that rhythm facilitates auditory WM through intricate oscillation-based interactions between the motor and auditory systems that facilitate predictive attention to auditory sequences.
Humans ; Memory, Short-Term/physiology* ; Male ; Beta Rhythm/physiology* ; Female ; Theta Rhythm/physiology* ; Young Adult ; Auditory Perception/physiology* ; Adult ; Electroencephalography ; Acoustic Stimulation ; Reaction Time/physiology* ; Brain/physiology* ; Attention/physiology*

Objective. This study aims to determine time and motion in the operating room in emergent, urgent and scheduled cesarean section surgeries among pregnant COVID-19 patients. Methodology. A time and motion performance evaluation study was done by computing the following parameters: pre-induction time, pre-incision time, opening time, closing time, for both decision-to-delivery interval (DDI) and overall operative time. Results. During the study period, emergent DDI average was 2 hours and 38 minutes, emergent overall operative time was 1 hour and 31 minutes, urgent DDI average was 3 hours and 51 minutes, and urgent overall operative time of 1 hour and 57 minutes. However, in both urgent and emergent cases, the recommended DDI of 30 minutes, and the average duration of 44.3 minutes for CS were not feasible. Conclusion. The COVID-19 pandemic has negatively affected the provision of surgical obstetric care and OR utilization. Due to the new safety protocol for healthcare workers and patients, there was a significant delay in DDI and overall operative time. The causes were preparation, anesthesia factors or obstetrician factors. Identifying modifiable obstacles may improve the DDI, overall operative time, and the quality of maternal and child birth care during this pandemic.
Pregnancy ; Female ; Cesarean Section ; Time and Motion Studies ; COVID-19 ; Time Perception ; Motion

To extract the temporal structure of sensory inputs is of great significance to our adaptive functioning in the dynamic environment. Here we characterize three types of temporal structure information, and review behavioral and neural evidence bearing on the encoding and utilization of such information in visual and auditory perception. The evidence together supports a functional view that the brain not only tracks but also makes use of temporal structure from diverse sources for a broad range of cognitive processes, such as perception, attention, and unconscious information processing. These functions are implemented by brain mechanisms including neural entrainment, predictive coding, as well as more specific mechanisms that vary with the type of temporal regularity and sensory modality. This framework enriches our understanding of how the human brain promotes dynamic information processing by exploiting regularities in ubiquitous temporal structures.
Attention ; Auditory Perception ; Brain ; physiology ; Humans ; Time Perception ; Visual Perception

BACKGROUND AND OBJECTIVES: Depending on the kind of task and/or material, listeners sometimes need to pay attention to understand communication. The present study aimed to estimate a listener’s amount of effort needed to understand communication by using recognition score and response time as a function of signal-to-noise ratio (SNR) and to confirm his/ her task dependency for listening effort. SUBJECTS AND METHODS: Forty-eight young adults with normal hearing participated in the study. As stimuli, Korean Speech Perception in Noise test without a question tag and three consecutive digits were used for sentence recognition (or single-task) and arithmetic (or dual-task), respectively. Both tasks were measured in quiet and under four SNR (i.e., 0, -4, -8, -12 dB) conditions. Their outcomes were analyzed and compared in terms of percent correct and response time. RESULTS: Sentence recognition scores and arithmetic scores decreased as the level of noise increased. Response time for sentence recognition decreased as noise increased, whereas the response time for arithmetic increased as noise increased. In addition, there was a negative correlation between error percent and response time in the sentence recognition. Conversely, a positive correlation between error percent and response time appeared in the arithmetic test. CONCLUSIONS: Listening effort showed a different pattern based on the kind of task, single vs. dual, while the dual-task required greater effort from the listener.
Hearing ; Humans ; Noise ; Reaction Time ; Signal-To-Noise Ratio ; Speech Perception ; Young Adult

Background: In the classical psychological refractory period (PRP) paradigm, two stimuli are presented in brief succession, and participants are asked to make separate speeded responses to both stimuli. Due to a central cognitive bottleneck, responses to the second stimulus are delayed, especially at short stimulus-onset asynchrony (SOA) between the two stimuli. Although the mechanisms of dual-task interference in the classical PRP paradigm have been extensively investigated, specific mechanisms underlying the cross-modal PRP paradigm are not well understood. In particular, it remains unknown whether the dominance of vision over audition manifests in the cross-modal PRP tasks. The present study aimed to investigate whether the visual dominance effect manifests in the cross-modal PRP paradigm. Methods: We adapted the classical PRP paradigm by manipulating the order of a visual and an auditory task: the visual task could either precede the auditory task or vice versa, at either short or long SOAs. Twenty-five healthy participants took part in Experiment 1, and thirty-three new participants took part in Experiment 2. Reaction time and accuracy data were calculated and further analyzed by repeated-measures analysis of variance. Results: The results showed that visual precedence in the Visual-Auditory condition caused larger impairments to the subsequent auditory processing than vice versa in the Auditory-Visual condition: a larger delay of second response was revealed in the Visual-Auditory condition (135 ± 10 ms) than the Auditory-Visual condition (88 ± 9 ms). This effect was found only at the short SOAs under the existence of the central bottleneck, but not at the long SOAs. Moreover, this effect occurred both when the single visual and the single auditory task were of equal difficulty in Experiment 1 and when the single auditory task was more difficult than the single visual task in Experiment 2. Conclusion Results of the two experiments suggested that the visual dominance effect occurred under the central bottleneck of cognitive processing.
Acoustic Stimulation ; Adolescent ; Adult ; Attention ; Auditory Perception ; Female ; Humans ; Male ; Photic Stimulation ; Reaction Time ; Refractory Period, Psychological ; Young Adult

Human studies of brain stimulation have demonstrated modulatory effects on the perception of pain. However, whether the primary somatosensory cortical activity is associated with antinociceptive responses remains unknown. Therefore, we examined the antinociceptive effects of neuronal activity evoked by optogenetic stimulation of primary somatosensory cortex. Optogenetic transgenic mice were subjected to continuous or pulse-train optogenetic stimulation of the primary somatosensory cortex at frequencies of 15, 30, and 40 Hz, during a tail clip test. Reaction time was measured using a digital high-speed video camera. Pulse-train optogenetic stimulation of primary somatosensory cortex showed a delayed pain response with respect to a tail clip, whereas no significant change in reaction time was observed with continuous stimulation. In response to the pulse-train stimulation, video monitoring and local field potential recording revealed associated paw movement and sensorimotor rhythms, respectively. Our results show that optogenetic stimulation of primary somatosensory cortex at beta and gamma frequencies blocks transmission of pain signals in tail clip test.
Animals ; Brain ; Humans ; Mice ; Mice, Transgenic ; Neurons ; Optogenetics ; Pain Perception* ; Reaction Time ; Somatosensory Cortex* ; Tail*

OBJECTIVES: Children with attention-deficit hyperactivity disorder (ADHD) may have deficits in time perception, as assessed by the time estimation task and the time reproduction task, however its age-related trajectory is not yet determined. Therefore we examined the correlation between accuracy of time perception tasks and age, and the association between accuracy of estimation tasks and reproduction tasks. METHODS: Sixty-three patients with ADHD, aged 8 to 18 years tested the tasks for five time durations (2, 4, 12, 45, and 60 seconds). Accuracy of tasks was assumed differences (absolute values) between raw results of tasks and original time durations. Spearman's correlation analysis was performed to determine correlation between accuracy of time perception tasks and age. Multivariate regression was used to determine the association of accuracy of estimation tasks with accuracy of reproduction tasks. RESULTS: Age showed correlation with accuracy of estimation tasks, but not with that of reproduction tasks. We observed that the higher the accuracy in 12, 45, and 60 seconds duration time reproduction, the higher the accuracy in longer seconds duration time estimation. CONCLUSION: Age was correlated with time estimation accuracy whereas there was no impact on time reproduction accuracy. Association of each of the two time perception tasks, particularly in longer time duration, suggested specific impairments in time perception.
Adolescent* ; Age Factors ; Child* ; Humans ; Reproduction ; Time Perception*

Time is an important element for cognitive processes. Timing and time perception have been investigated by neuroscientists and psychologists for many years. It is well accepted that emotions could alter our experience of time. Previous studies of the emotional modulation on temporal perception focus primarily on behavioral and psychological experiments. In recent years, studies about the neurophysiological mechanisms of time perception have made some progress. Therefore, researchers started to explore how emotions influence our sense of time on the aspects of neural networks, neurotransmitters and synaptic plasticity. In this paper, we tried to review current studies about the effects of emotional regulation on time perception and the relevant neurophysiological mechanisms. This review will help us to deeply understand the neural mechanisms of time perception.
Emotions ; Neuronal Plasticity ; Time Perception

PURPOSE: Our objective was to estimate the maximum color contrast sensitivity (MCCS) thresholds in individuals with chiasma opticum damage. METHODS: The pilot study tested 41 people with pituitary adenoma (PA) and 100 age- and gender-matched controls. Patients were divided into two groups according to PA size, PA ≤1 cm or PA >1 cm. A new MCCS test program was used for color discrimination. RESULTS: The mean total error score (TES) of MCCS was 1.8 in the PA ≤1 cm group (standard deviation [SD], 0.38), 3.5 in the PA >1 cm group (SD, 0.96), and 1.4 in the control group (SD, 0.31; p < 0.001). There was a positive correlation between tumor size and MCCS result (r = 0.648, p < 0.01). In the group that had PA-producing hormones, the TES was 2.5 (SD, 1.09), compared to 4.2 value in the non-functioning PA group of patients that did not have clinically significant hormone excess (SD, 3.16; p < 0.01). In patients with normal visual acuity (VA) or visual field MCCS, the TES was 3.3 (SD, 1.8), while that in patients with VA <0.00 was 4.6 (SD, 2.9). CONCLUSIONS: Results of the MCCS test TES were 1.9 times better in patients with PA ≤1 cm compared to patients with PA >1 cm (p < 0.01). In PA patients with normal VA, the TES was 2.35 times worse than that of healthy persons (p < 0.01).
Adenoma/*complications/diagnosis ; Adolescent ; Adult ; Aged ; Color Perception/physiology ; Color Perception Tests/*methods ; Contrast Sensitivity/*physiology ; *Early Diagnosis ; Female ; Humans ; Male ; Middle Aged ; *Optic Chiasm ; Pilot Projects ; Pituitary Neoplasms/*complications/diagnosis ; Time Factors ; Vision Disorders/*diagnosis/etiology/physiopathology ; Visual Fields ; Young Adult