Existing emotion recognition research is typically limited to static laboratory settings and has not fully handle the changes in emotional states in dynamic scenarios. To address this problem, this paper proposes a method for dynamic continuous emotion recognition based on electroencephalography (EEG) and eye movement signals. Firstly, an experimental paradigm was designed to cover six dynamic emotion transition scenarios including happy to calm, calm to happy, sad to calm, calm to sad, nervous to calm, and calm to nervous. EEG and eye movement data were collected simultaneously from 20 subjects to fill the gap in current multimodal dynamic continuous emotion datasets. In the valence-arousal two-dimensional space, emotion ratings for stimulus videos were performed every five seconds on a scale of 1 to 9, and dynamic continuous emotion labels were normalized. Subsequently, frequency band features were extracted from the preprocessed EEG and eye movement data. A cascade feature fusion approach was used to effectively combine EEG and eye movement features, generating an information-rich multimodal feature vector. This feature vector was input into four regression models including support vector regression with radial basis function kernel, decision tree, random forest, and K-nearest neighbors, to develop the dynamic continuous emotion recognition model. The results showed that the proposed method achieved the lowest mean square error for valence and arousal across the six dynamic continuous emotions. This approach can accurately recognize various emotion transitions in dynamic situations, offering higher accuracy and robustness compared to using either EEG or eye movement signals alone, making it well-suited for practical applications.
Humans ; Electroencephalography/methods* ; Emotions/physiology* ; Eye Movements/physiology* ; Signal Processing, Computer-Assisted ; Support Vector Machine ; Algorithms

Current studies on electroencephalogram (EEG) emotion recognition primarily concentrate on discrete stimulus paradigms under controlled laboratory settings, which cannot adequately represent the dynamic transition characteristics of emotional states during multi-context interactions. To address this issue, this paper proposes a novel method for emotion transition recognition that leverages a cross-modal feature fusion and global perception network (CFGPN). Firstly, an experimental paradigm encompassing six types of emotion transition scenarios was designed, and EEG and eye movement data were simultaneously collected from 20 participants, each annotated with dynamic continuous emotion labels. Subsequently, deep canonical correlation analysis integrated with a cross-modal attention mechanism was employed to fuse features from EEG and eye movement signals, resulting in multimodal feature vectors enriched with highly discriminative emotional information. These vectors are then input into a parallel hybrid architecture that combines convolutional neural networks (CNNs) and Transformers. The CNN is employed to capture local time-series features, whereas the Transformer leverages its robust global perception capabilities to effectively model long-range temporal dependencies, enabling accurate dynamic emotion transition recognition. The results demonstrate that the proposed method achieves the lowest mean square error in both valence and arousal recognition tasks on the dynamic emotion transition dataset and a classic multimodal emotion dataset. It exhibits superior recognition accuracy and stability when compared with five existing unimodal and six multimodal deep learning models. The approach enhances both adaptability and robustness in recognizing emotional state transitions in real-world scenarios, showing promising potential for applications in the field of biomedical engineering.
Humans ; Emotions/physiology* ; Electroencephalography ; Neural Networks, Computer ; Eye Movements ; Perception

Transcranial temporal interference stimulation (tTIS) is a novel non-invasive neuromodulation technique with the potential to precisely target deep brain structures. This study explores the neural and behavioral effects of tTIS on the superior colliculus (SC), a region involved in eye movement control, in mice. Computational modeling revealed that tTIS delivers more focused stimulation to the SC than traditional transcranial alternating current stimulation. In vivo experiments, including Ca²⁺ signal recordings and eye movement tracking, showed that tTIS effectively modulates SC neural activity and induces eye movements. A significant correlation was found between stimulation frequency and saccade frequency, suggesting direct tTIS-induced modulation of SC activity. These results demonstrate the precision of tTIS in targeting deep brain regions and regulating eye movements, highlighting its potential for neuroscientific research and therapeutic applications.
Animals ; Superior Colliculi/physiology* ; Transcranial Direct Current Stimulation/methods* ; Eye Movements/physiology* ; Male ; Mice ; Mice, Inbred C57BL

Even though retinal images of objects change their locations following each eye movement, we perceive a stable and continuous world. One possible mechanism by which the brain achieves such visual stability is to construct a craniotopic coordinate by integrating retinal and extraretinal information. There have been several proposals on how this may be done, including eye-position modulation (gain fields) of retinotopic receptive fields (RFs) and craniotopic RFs. In the present study, we investigated coordinate systems used by RFs in the lateral intraparietal (LIP) cortex and frontal eye fields (FEF) and compared the two areas. We mapped the two-dimensional RFs of neurons in detail under two eye fixations and analyzed how the RF of a given neuron changes with eye position to determine its coordinate representation. The same recording and analysis procedures were applied to the two brain areas. We found that, in both areas, RFs were distributed from retinotopic to craniotopic representations. There was no significant difference between the distributions in the LIP and FEF. Only a small fraction of neurons was fully craniotopic, whereas most neurons were between the retinotopic and craniotopic representations. The distributions were strongly biased toward the retinotopic side but with significant craniotopic shifts. These results suggest that there is only weak evidence for craniotopic RFs in the LIP and FEF, and that transformation from retinotopic to craniotopic coordinates in these areas must rely on other factors such as gain fields.
Animals ; Macaca ; Visual Fields ; Frontal Lobe/physiology* ; Eye Movements ; Brain

Objective:Exploring the performance characteristics of spontaneous nystagmus（SN） in video-head impulse test（vHIT） and its possible effects on saccade. Methods:Vestibular function tests such as vHIT and SN were conducted in 48 patients with acute unilateral vestibulopathy（AUVP）. The saccade characteristics of vHIT in patients without SN and those with SN were analyzed, as well as the expression characteristics of SN in vHIT. Results:Among the 48 AUVP patients, there were 34 cases with SN, including 31 cases with saccade on the healthy side, 11 cases with both the same and opposite directions of eye movement, 19 with the opposite only, 1 with same direction only, and 3 cases without saccade. There were 14 patients without SN, of whom 10 showed saccade on the healthy side, including 4 with both eye movements in the same and opposite direction, 2 in the opposite direction only, 4 in the same direction only, and 4 without saccade. There is a correlation between reverse saccade on the healthy side and the presence of SN in patients. SN in vHIT can appear opposite to the direction of eye movement on the healthy side, while on the affected side it can appear the same as the direction of eye movement and may cause more discrete overt saccade. 32 patients in the acute phase（≤2 w）, 29 patients with SN, SN intensity of（6.7 ± 3.2） °/s, and 3 patients without SN. 16 cases in non acute phase（>2 w）, 5 cases with SN, SN intensity of（3.7 ± 2.1） °/s, and 11 cases without SN. In the acute phase there were 30 cases of saccade on the healthy side, 10 cases with both the same and opposite direction of eye movement, 18 cases with only the opposite direction, 2 cases with only the same direction and 2 cases without saccade. There is a correlation between the duration of the disease and the occurrence of reverse saccade on the healthy side. The intensity cut off point of SN for reverse saccade is 2.1 °/s in the healthy lateral semicircular canal vHIT. Conclusion:Compensatory saccades and SN waves with similar waveforms are mostly present in vHIT in AUVP patients. SN wave is in the opposite direction of the normal side and eye movement wave, and the affected side and dominant saccade direction are in the same direction and mixed together, which can affect the dispersion and amplitude of overt saccade in vHIT. Accurate identification of SN in vHIT of AUVP patients is not only the key factor to identify compensatory saccade, but also can provide help for the diagnosis and compensatory assessment of AUVP.
Humans ; Head Impulse Test/methods* ; Nystagmus, Pathologic/physiopathology* ; Saccades/physiology* ; Male ; Female ; Vestibular Diseases/physiopathology* ; Middle Aged ; Adult ; Eye Movements/physiology* ; Aged

Biomechanical Phenomena ; Eye Movements ; Neurons/physiology* ; Pursuit, Smooth ; Saccades

OBJECTIVES: To explore the difference of eye movement characteristics between uncooperative and cooperative subjects with mental disorder after cerebral trauma. METHODS: Thirty-nine subjects which needed psychiatric impairment assessment were selected. According to the binomial forced-choice digit memory test （BFDMT）, all subjects were divided into cooperative and uncooperative groups. The subjects were asked to take the image completion test from Wechsler adult intelligence scale. Meanwhile, the data of eye movement track, fixation, saccade, pupil and blink were recorded by the track system of eye movement. RESULTS: There were significantly differences （P<0.05） in the data of saccade between cooperative （10 cases） and uncooperative groups （29 cases）. The frequency, time, amplitude, acceleration of saccadic in uncooperative group were significantly higher than cooperation group. The saccade latencies of cooperation group increased more than uncooperative group. There was a significant difference （P<0.05） in total discrete distance, average distance and total time of fixation between two groups, while the average duration time, number and frequency of fixation had no significantly difference （P>0.05） between two groups. And the blink frequency of cooperation group was higher than uncooperative group. CONCLUSIONS Eye movement can be an objective index for the primary judgment of cooperation level.
Adult ; Eye Movement Measurements ; Eye Movements/physiology* ; Humans ; Intelligence Tests ; Saccades/physiology* ; Wechsler Scales

PURPOSE: To evaluate differences in self-identity in patients diagnosed with strabismus, patients who underwent strabismus surgery, and healthy control individuals. METHODS: Self-identity testing was done during a military service physical examination. There were three subject groups: subjects with strabismus (group 1), subjects who had undergone corrective strabismus surgery (group 2), and subjects free of strabismus (group 3). The self-identity test was comprised of six sub-sections (subjectivity, self-acceptance, future confidence, goal orientation, initiative, and familiarity). Statistical significance of the sub-sections was compared across the three groups. Correlations in age at the time of surgery and across the six sub-sections were investigated in group 2. RESULTS: A total of 351 subjects were enrolled in the study; 96 subjects were in group 1, 108 subjects were in group 2, and 147 subjects were in group 3. Significant differences were evident in subjectivity, self-acceptance, initiative and familiarity between groups 1 and 3. No significant differences were found between groups 2 and 3. In group 2, statistical significance was evident between age at surgery and initiative and familiarity (r = −0.333, p < 0.001; r = −0.433, p < 0.001, respectively). CONCLUSIONS: Self-identity is greater in non-strabismus subjects than strabismus subjects. Correction of strabismus may increase self-identity levels.
Adolescent ; Adult ; Eye Movements/*physiology ; *Facial Expression ; Female ; Humans ; Male ; Oculomotor Muscles/*physiopathology/surgery ; Ophthalmologic Surgical Procedures ; Retrospective Studies ; *Self Concept ; Strabismus/physiopathology/*psychology/surgery

No abstract available.
Child ; Eye Movements/*physiology ; Humans ; Male ; Oculomotor Muscles/physiopathology/*surgery ; Ophthalmologic Surgical Procedures/*methods ; Strabismus/physiopathology/*surgery ; Syndrome

PURPOSE: The purpose of this study is to compare the magnitude and axis of astigmatism induced by a combined inferior oblique (IO) anterior transposition procedure with lateral rectus (LR) recession versus LR recession alone. METHODS: Forty-six patients were retrospectively analyzed. The subjects were divided into two groups: those having concurrent inferior oblique muscle overaction (IOOA) and intermittent exotropia (group 1, 20 patients) and those having only intermittent exotropia as a control (group 2, 26 patients). Group 1 underwent combined anterior transposition of IO with LR recession and group 2 underwent LR recession alone. Induced astigmatism was defined as the difference between preoperative and postoperative astigmatism using double-angle vector analysis. Cylinder power, axis of induced astigmatism, and spherical equivalent were analyzed at 1 week, 1 month, and 3 months after surgery. RESULTS: Larger changes in the axis of induced astigmatism were observed in group 1, with 4.5° incyclotorsion, than in group 2 at 1 week after surgery (axis, 84.5° vs. 91°; p < 0.001). However, there was no statistically significant inter-group difference thereafter. Relaxation and rapid regression in the incyclotorsion of induced astigmatism were observed over-time. Spherical equivalent significantly decreased postoperatively at 1 month in both groups, indicating a myopic shift (p = 0.011 for group 1 and p = 0.019 for group 2) but did not show significant differences at 3 months after surgery (p = 0.107 for group 1 and p = 0.760 for group 2). CONCLUSIONS: Combined IO anterior transposition procedures caused an increased change in the axis of induced astigmatism, including temporary incyclotorsion, during the first week after surgery. However, this significant difference was not maintained thereafter. Thus, combined IO surgery with LR recession does not seem to produce a sustained astigmatic change, which can be a potential risk factor of postoperative amblyopia or diplopia compared with LR recession alone.
Astigmatism/diagnosis/*etiology/physiopathology ; Child ; Exotropia/diagnosis/physiopathology/*surgery ; Eye Movements/*physiology ; Female ; Follow-Up Studies ; Humans ; Male ; Oculomotor Muscles/*surgery ; Ophthalmologic Surgical Procedures/*methods ; Retrospective Studies ; Treatment Outcome ; Vision, Binocular/*physiology