Rapid serial visual presentation (RSVP) is a type of psychological visual stimulation experimental paradigm that requires participants to identify target stimuli presented continuously in a stream of stimuli composed of numbers, letters, words, images, and so on at the same spatial location, allowing them to discern a large amount of information in a short period of time. The RSVP-based brain-computer interface (BCI) can not only be widely used in scenarios such as assistive interaction and information reading, but also has the advantages of stability and high efficiency, which has become one of the common techniques for human-machine intelligence fusion. In recent years, brain-controlled spellers, image recognition and mind games are the most popular fields of RSVP-BCI research. Therefore, aiming to provide reference and new ideas for RSVP-BCI related research, this paper reviewed the paradigm design and system performance optimization of RSVP-BCI in these three fields. It also looks ahead to its potential applications in cutting-edge fields such as entertainment, clinical medicine, and special military operations.
Humans ; Brain-Computer Interfaces ; Electroencephalography/methods* ; Brain/physiology* ; Artificial Intelligence ; Photic Stimulation/methods*

During natural viewing, we often recognize multiple objects, detect their motion, and select one object as the target to track. It remains to be determined how such behavior is guided by the integration of visual form and motion perception. To address this, we studied how monkeys made a choice to track moving targets with different forms by smooth pursuit eye movements in a two-target task. We found that pursuit responses were biased toward the motion direction of a target with a hole. By computing the relative weighting, we found that the target with a hole exhibited a larger weight for vector computation. The global hole feature dominated other form properties. This dominance failed to account for changes in pursuit responses to a target with different forms moving singly. These findings suggest that the integration of visual form and motion perception can reshape the competition in sensorimotor networks to guide behavioral selection.
Animals ; Pursuit, Smooth ; Macaca mulatta ; Motion Perception/physiology* ; Photic Stimulation

Integrating multisensory inputs to generate accurate perception and guide behavior is among the most critical functions of the brain. Subcortical regions such as the amygdala are involved in sensory processing including vision and audition, yet their roles in multisensory integration remain unclear. In this study, we systematically investigated the function of neurons in the amygdala and adjacent regions in integrating audiovisual sensory inputs using a semi-chronic multi-electrode array and multiple combinations of audiovisual stimuli. From a sample of 332 neurons, we showed the diverse response patterns to audiovisual stimuli and the neural characteristics of bimodal over unimodal modulation, which could be classified into four types with differentiated regional origins. Using the hierarchical clustering method, neurons were further clustered into five groups and associated with different integrating functions and sub-regions. Finally, regions distinguishing congruent and incongruent bimodal sensory inputs were identified. Overall, visual processing dominates audiovisual integration in the amygdala and adjacent regions. Our findings shed new light on the neural mechanisms of multisensory integration in the primate brain.
Animals ; Macaca ; Acoustic Stimulation ; Auditory Perception/physiology* ; Visual Perception/physiology* ; Amygdala/physiology* ; Photic Stimulation

Accurate self-motion perception, which is critical for organisms to survive, is a process involving multiple sensory cues. The two most powerful cues are visual (optic flow) and vestibular (inertial motion). Psychophysical studies have indicated that humans and nonhuman primates integrate the two cues to improve the estimation of self-motion direction, often in a statistically Bayesian-optimal way. In the last decade, single-unit recordings in awake, behaving animals have provided valuable neurophysiological data with a high spatial and temporal resolution, giving insight into possible neural mechanisms underlying multisensory self-motion perception. Here, we review these findings, along with new evidence from the most recent studies focusing on the temporal dynamics of signals in different modalities. We show that, in light of new data, conventional thoughts about the cortical mechanisms underlying visuo-vestibular integration for linear self-motion are challenged. We propose that different temporal component signals may mediate different functions, a possibility that requires future studies.
Animals ; Humans ; Motion Perception/physiology* ; Bayes Theorem ; Optic Flow ; Cues ; Vestibule, Labyrinth/physiology* ; Photic Stimulation ; Visual Perception/physiology*

Recent work in decision neuroscience suggests that visual saliency can interact with reward-based choice, and the lateral intraparietal cortex (LIP) is implicated in this process. In this study, we recorded from LIP neurons while monkeys performed a two alternative choice task in which the reward and luminance associated with each offer were varied independently. We discovered that the animal's choice was dictated by the reward amount while the luminance had a marginal effect. In the LIP, neuronal activity corresponded well with the animal's choice pattern, in that a majority of reward-modulated neurons encoded the reward amount in the neuron's preferred hemifield with a positive slope. In contrast, compared to their responses to low luminance, an approximately equal proportion of luminance-sensitive neurons responded to high luminance with increased or decreased activity, leading to a much weaker population-level response. Meanwhile, in the non-preferred hemifield, the strength of encoding for reward amount and luminance was positively correlated, suggesting the integration of these two factors in the LIP. Moreover, neurons encoding reward and luminance were homogeneously distributed along the anterior-posterior axis of the LIP. Overall, our study provides further evidence supporting the neural instantiation of a priority map in the LIP in reward-based decisions.
Animals ; Macaca mulatta/physiology* ; Parietal Lobe ; Neurons/physiology* ; Saccades ; Reward ; Photic Stimulation

Steady-state visual evoked potential (SSVEP) is one of the commonly used control signals in brain-computer interface (BCI) systems. The SSVEP-based BCI has the advantages of high information transmission rate and short training time, which has become an important branch of BCI research field. In this review paper, the main progress on frequency recognition algorithm for SSVEP in past five years are summarized from three aspects, i.e., unsupervised learning algorithms, supervised learning algorithms and deep learning algorithms. Finally, some frontier topics and potential directions are explored.
Algorithms ; Brain-Computer Interfaces ; Electroencephalography/methods* ; Evoked Potentials, Visual ; Photic Stimulation

Brain-computer interface (BCI) systems based on steady-state visual evoked potential (SSVEP) have become one of the major paradigms in BCI research due to their high signal-to-noise ratio and short training time required by users. Fast and accurate decoding of SSVEP features is a crucial step in SSVEP-BCI research. However, the current researches lack a systematic overview of SSVEP decoding algorithms and analyses of the connections and differences between them, so it is difficult for researchers to choose the optimum algorithm under different situations. To address this problem, this paper focuses on the progress of SSVEP decoding algorithms in recent years and divides them into two categories-trained and non-trained-based on whether training data are needed. This paper also explains the fundamental theories and application scopes of decoding algorithms such as canonical correlation analysis (CCA), task-related component analysis (TRCA) and the extended algorithms, concludes the commonly used strategies for processing decoding algorithms, and discusses the challenges and opportunities in this field in the end.
Algorithms ; Brain-Computer Interfaces ; Electroencephalography ; Evoked Potentials, Visual ; Photic Stimulation

Studies have shown that spatial attention remarkably affects the trial-to-trial response variability shared between neurons. Difficulty in the attentional task adjusts how much concentration we maintain on what is currently important and what is filtered as irrelevant sensory information. However, how task difficulty mediates the interactions between neurons with separated receptive fields (RFs) that are attended to or attended away is still not clear. We examined spike count correlations between single-unit activities recorded simultaneously in the primary visual cortex (V1) while monkeys performed a spatial attention task with two levels of difficulty. Moreover, the RFs of the two neurons recorded were non-overlapping to allow us to study fluctuations in the correlated responses between competing visual inputs when the focus of attention was allocated to the RF of one neuron. While increasing difficulty in the spatial attention task, spike count correlations were either decreased to become negative between neuronal pairs, implying competition among them, with one neuron (or none) exhibiting attentional enhancement of firing rate, or increased to become positive, suggesting inter-neuronal cooperation, with one of the pair showing attentional suppression of spiking responses. Besides, the modulation of spike count correlations by task difficulty was independent of the attended locations. These findings provide evidence that task difficulty affects the functional interactions between different neuronal pools in V1 when selective attention resolves the spatial competition.
Animals ; Attention/physiology* ; Macaca mulatta ; Neurons/physiology* ; Photic Stimulation ; Primary Visual Cortex ; Visual Cortex/physiology*

How the brain perceives objects and classifies perceived objects is one of the important goals of visual cognitive neuroscience. Previous research has shown that when we see objects, the brain's ventral visual pathway recognizes and classifies them, leading to different ways of interacting with them. In this paper, we summarize the latest research progress of the ventral visual pathway related to the visual classification of objects. From the perspective of the neural representation of objects and its underlying mechanisms in the visual cortex, we summarize the current research status of the two important organizational dimensions of object animacy and real-world size, provide new insights, and point out the direction of further research.
Brain Mapping/methods* ; Magnetic Resonance Imaging ; Pattern Recognition, Visual ; Photic Stimulation ; Visual Cortex ; Visual Pathways

OBJECTIVES: To analyze the Nogo-P3 component of event-related potential (ERP) in the process of visual acuity processing, to provide electrophysiological evidence for objective evaluation of visual acuity. METHODS: Twenty-six subjects with no other ocular diseases except for ametropia were recruited, and all subjects had uncorrected visual acuity both eyes 1/10 (evaluated using Monoyer chart). Block letter E with different visual angles and directions were used as graphic stimuli. The Go/Nogo paradigm was used for ERP studies. The visual angle of Go stimulation angle was 1°15', Nogo stimuli were 1°15', 55', 24' and 15'. The visual acuity test was performed on each of the two naked eyes separately in all subjects, and the characteristics of the Nogo-P3 component were analyzed. RESULTS: The latency of Nogo-P3 showed no difference between the stimuli of 1°15' and 55', and between Nogo stimulation angle 24' and 15'. There was significant difference between Nogo stimulation angle 1°15' and 24', and between Nogo stimulation angle 1°15' and 15' (P<0.05). There was significant difference between Nogo stimulation angle 55' and 24', and between Nogo stimulation angle 55' and 15' (P<0.05). No significant differences were observed in the Nogo-P3 amplitude among Nogo stimulation. CONCLUSIONS In the Go/Nogo paradigm, Nogo-P3 can reflect the cognitive response of subjects to Nogo stimulation, which can be used for objective evaluation of visual acuity.
Electroencephalography ; Evoked Potentials/physiology* ; Humans ; Photic Stimulation ; Reaction Time/physiology* ; Refractive Errors ; Visual Acuity