The dorsal and ventral visual streams have been considered to play distinct roles in visual processing for action: the dorsal stream is assumed to support real-time actions, while the ventral stream facilitates memory-guided actions. However, recent evidence suggests a more integrated function of these streams. We investigated the neural dynamics and functional connectivity between them during memory-guided actions using intracranial EEG. We tracked neural activity in the inferior parietal lobule in the dorsal stream, and the ventral temporal cortex in the ventral stream as well as the hippocampus during a delayed action task involving object identity and location memory. We found increased alpha power in both streams during the delay, indicating their role in maintaining spatial visual information. In addition, we recorded increased alpha power in the hippocampus during the delay, but only when both object identity and location needed to be remembered. We also recorded an increase in theta band phase synchronization between the inferior parietal lobule and ventral temporal cortex and between the inferior parietal lobule and hippocampus during the encoding and delay. Granger causality analysis indicated dynamic and frequency-specific directional interactions among the inferior parietal lobule, ventral temporal cortex, and hippocampus that varied across task phases. Our study provides unique electrophysiological evidence for close interactions between dorsal and ventral streams, supporting an integrated processing model in which both streams contribute to memory-guided actions.
Humans ; Male ; Female ; Adult ; Young Adult ; Hippocampus/physiology* ; Memory/physiology* ; Parietal Lobe/physiology* ; Temporal Lobe/physiology* ; Visual Perception/physiology* ; Electrocorticography ; Visual Pathways/physiology* ; Electroencephalography

The thalamic reticular nucleus (TRN) plays a crucial role in regulating sensory encoding, even at the earliest stages of visual processing, as evidenced by numerous studies. Orientation selectivity, a vital neural response, is essential for detecting objects through edge perception. Here, we demonstrate that somatostatin (SOM)-expressing and parvalbumin (PV)-expressing neurons in the TRN project to the dorsal lateral geniculate nucleus and modulate orientation selectivity and the capacity for visual information processing in the primary visual cortex (V1). These findings show that SOM-positive and PV-positive neurons in the TRN are powerful modulators of visual information encoding in V1, revealing a novel role for this thalamic nucleus in influencing visual processing.
Animals ; Somatostatin/metabolism* ; Parvalbumins/metabolism* ; Neurons/physiology* ; Thalamic Nuclei/physiology* ; Visual Pathways/physiology* ; Mice ; Mice, Inbred C57BL ; Visual Perception/physiology* ; Male ; Mice, Transgenic ; Visual Cortex/physiology* ; Primary Visual Cortex/cytology*

Direct electrical stimulation of the human cortex can produce subjective visual sensations, yet these sensations are unstable. The underlying mechanisms may stem from differences in electrophysiological activity within the distributed network outside the stimulated site. To address this problem, we recruited 69 patients who experienced visual sensations during invasive electrical stimulation while intracranial electroencephalography (iEEG) data were recorded. We found significantly flattened power spectral slopes in distributed regions involving different brain networks and decreased integrated information during elicited visual sensations compared with the non-sensation condition. Further analysis based on minimum information partitions revealed that the reconfigured network interactions primarily involved the inferior frontal cortex, posterior superior temporal sulcus, and temporoparietal junction. The flattened power spectral slope in the inferior frontal gyrus was also correlated with integrated information. Taken together, this study indicates that the altered electrophysiological signatures provide insights into the neural mechanisms underlying subjective visual sensations.
Humans ; Male ; Female ; Adult ; Visual Perception/physiology* ; Electric Stimulation ; Middle Aged ; Young Adult ; Electrocorticography ; Electroencephalography ; Brain Mapping

Integrating multisensory inputs to generate accurate perception and guide behavior is among the most critical functions of the brain. Subcortical regions such as the amygdala are involved in sensory processing including vision and audition, yet their roles in multisensory integration remain unclear. In this study, we systematically investigated the function of neurons in the amygdala and adjacent regions in integrating audiovisual sensory inputs using a semi-chronic multi-electrode array and multiple combinations of audiovisual stimuli. From a sample of 332 neurons, we showed the diverse response patterns to audiovisual stimuli and the neural characteristics of bimodal over unimodal modulation, which could be classified into four types with differentiated regional origins. Using the hierarchical clustering method, neurons were further clustered into five groups and associated with different integrating functions and sub-regions. Finally, regions distinguishing congruent and incongruent bimodal sensory inputs were identified. Overall, visual processing dominates audiovisual integration in the amygdala and adjacent regions. Our findings shed new light on the neural mechanisms of multisensory integration in the primate brain.
Animals ; Macaca ; Acoustic Stimulation ; Auditory Perception/physiology* ; Visual Perception/physiology* ; Amygdala/physiology* ; Photic Stimulation

Accurate self-motion perception, which is critical for organisms to survive, is a process involving multiple sensory cues. The two most powerful cues are visual (optic flow) and vestibular (inertial motion). Psychophysical studies have indicated that humans and nonhuman primates integrate the two cues to improve the estimation of self-motion direction, often in a statistically Bayesian-optimal way. In the last decade, single-unit recordings in awake, behaving animals have provided valuable neurophysiological data with a high spatial and temporal resolution, giving insight into possible neural mechanisms underlying multisensory self-motion perception. Here, we review these findings, along with new evidence from the most recent studies focusing on the temporal dynamics of signals in different modalities. We show that, in light of new data, conventional thoughts about the cortical mechanisms underlying visuo-vestibular integration for linear self-motion are challenged. We propose that different temporal component signals may mediate different functions, a possibility that requires future studies.
Animals ; Humans ; Motion Perception/physiology* ; Bayes Theorem ; Optic Flow ; Cues ; Vestibule, Labyrinth/physiology* ; Photic Stimulation ; Visual Perception/physiology*

Evading or escaping from predators is one of the most crucial issues for survival across the animal kingdom. The timely detection of predators and the initiation of appropriate fight-or-flight responses are innate capabilities of the nervous system. Here we review recent progress in our understanding of innate visually-triggered defensive behaviors and the underlying neural circuit mechanisms, and a comparison among vinegar flies, zebrafish, and mice is included. This overview covers the anatomical and functional aspects of the neural circuits involved in this process, including visual threat processing and identification, the selection of appropriate behavioral responses, and the initiation of these innate defensive behaviors. The emphasis of this review is on the early stages of this pathway, namely, threat identification from complex visual inputs and how behavioral choices are influenced by differences in visual threats. We also briefly cover how the innate defensive response is processed centrally. Based on these summaries, we discuss coding strategies for visual threats and propose a common prototypical pathway for rapid innate defensive responses.
Mice ; Animals ; Zebrafish ; Neurons/physiology* ; Visual Perception/physiology*

To extract the temporal structure of sensory inputs is of great significance to our adaptive functioning in the dynamic environment. Here we characterize three types of temporal structure information, and review behavioral and neural evidence bearing on the encoding and utilization of such information in visual and auditory perception. The evidence together supports a functional view that the brain not only tracks but also makes use of temporal structure from diverse sources for a broad range of cognitive processes, such as perception, attention, and unconscious information processing. These functions are implemented by brain mechanisms including neural entrainment, predictive coding, as well as more specific mechanisms that vary with the type of temporal regularity and sensory modality. This framework enriches our understanding of how the human brain promotes dynamic information processing by exploiting regularities in ubiquitous temporal structures.
Attention ; Auditory Perception ; Brain ; physiology ; Humans ; Time Perception ; Visual Perception

Visual memory, mainly composed of visual long-term memory (VLTM) and visual working memory (VWM), is an important mechanism of human information storage. Since Baddeley proposed the multicomponent working memory model, the idea that VWM is independent of the VLTM system has been widely accepted. However, the new theoretical evidence suggested a close connection between VLTM and VWM. For instance, the three embedded components model describes the VLTM and VWM in the same framework, which suggests that VWM is only a distinct state of VLTM. On the one hand, the operating function of VWM is supported by the persistence of VLTM. On the other hand, the evidence from neuroimaging studies shows that VWM and VLTM tasks activate some same brain areas. In addition, the whole visual memory system shows a trend of processing from early visual cortex to prefrontal cortex. The present article not only reviews the current studies about the relationship between VLTM and VWM but also gives some forecasts for future studies.
Brain ; physiology ; Humans ; Memory, Long-Term ; Memory, Short-Term ; Visual Cortex ; physiology ; Visual Perception

The core of visual processing is the identification and recognition of the objects relevant to cognitive behaviors. In natural environment, visual input is often comprised of highly complex 3-dimensional signals involving multiple visual objects. One critical determinant of object recognition is visual contour. Despite substantial insights on visual contour processing gained from previous findings, these studies have focused on limited aspects or particular stages of contour processing. So far, a systematic perspective of contour processing that comprehensively incorporates previous evidence is still missing. We therefore propose an integrated framework of the cognitive and neural mechanisms of contour processing, which involves three mutually interacting cognitive stages: contour detection, border ownership assignment and contour integration. For each stage, we provide an elaborated discussion of the neural properties, processing mechanism, and its functional interaction with the other stages by summarizing the relevant electrophysiological and human cognitive neuroscience evidence. Finally, we present the major challenges for further unraveling the mechanisms of visual contour processing.
Cognition ; Form Perception ; Humans ; Visual Cortex ; physiology ; Visual Perception

The human visual system efficiently extracts local elements from cluttered backgrounds and integrates these elements into meaningful contour perception. This process is a critical step before object recognition, in which contours often play an important role in defining the shapes and borders of the to-be-recognized objects. However, the neural mechanism of the contour integration is still under debate. The investigation of the neural mechanism underlying contour integration could deepen our understanding of perceptual grouping in the human visual system and advance the development of the algorithms for image grouping and segmentation in computer vision. Here, we review two theoretical frameworks that were proposed over the past decades. The first framework is based on hardwired horizontal connection in primary visual cortex, while the second one emphasizes the role of recurrent connections within intra- and inter-areas. At the end of review, we also raise the unsolved issues that need to be addressed in future studies.
Form Perception ; Humans ; Models, Neurological ; Pattern Recognition, Visual ; Visual Cortex ; physiology ; Visual Perception