The dorsal and ventral visual streams have been considered to play distinct roles in visual processing for action: the dorsal stream is assumed to support real-time actions, while the ventral stream facilitates memory-guided actions. However, recent evidence suggests a more integrated function of these streams. We investigated the neural dynamics and functional connectivity between them during memory-guided actions using intracranial EEG. We tracked neural activity in the inferior parietal lobule in the dorsal stream, and the ventral temporal cortex in the ventral stream as well as the hippocampus during a delayed action task involving object identity and location memory. We found increased alpha power in both streams during the delay, indicating their role in maintaining spatial visual information. In addition, we recorded increased alpha power in the hippocampus during the delay, but only when both object identity and location needed to be remembered. We also recorded an increase in theta band phase synchronization between the inferior parietal lobule and ventral temporal cortex and between the inferior parietal lobule and hippocampus during the encoding and delay. Granger causality analysis indicated dynamic and frequency-specific directional interactions among the inferior parietal lobule, ventral temporal cortex, and hippocampus that varied across task phases. Our study provides unique electrophysiological evidence for close interactions between dorsal and ventral streams, supporting an integrated processing model in which both streams contribute to memory-guided actions.
Humans ; Male ; Female ; Adult ; Young Adult ; Hippocampus/physiology* ; Memory/physiology* ; Parietal Lobe/physiology* ; Temporal Lobe/physiology* ; Visual Perception/physiology* ; Electrocorticography ; Visual Pathways/physiology* ; Electroencephalography

The thalamic reticular nucleus (TRN) plays a crucial role in regulating sensory encoding, even at the earliest stages of visual processing, as evidenced by numerous studies. Orientation selectivity, a vital neural response, is essential for detecting objects through edge perception. Here, we demonstrate that somatostatin (SOM)-expressing and parvalbumin (PV)-expressing neurons in the TRN project to the dorsal lateral geniculate nucleus and modulate orientation selectivity and the capacity for visual information processing in the primary visual cortex (V1). These findings show that SOM-positive and PV-positive neurons in the TRN are powerful modulators of visual information encoding in V1, revealing a novel role for this thalamic nucleus in influencing visual processing.
Animals ; Somatostatin/metabolism* ; Parvalbumins/metabolism* ; Neurons/physiology* ; Thalamic Nuclei/physiology* ; Visual Pathways/physiology* ; Mice ; Mice, Inbred C57BL ; Visual Perception/physiology* ; Male ; Mice, Transgenic ; Visual Cortex/physiology* ; Primary Visual Cortex/cytology*

Direct electrical stimulation of the human cortex can produce subjective visual sensations, yet these sensations are unstable. The underlying mechanisms may stem from differences in electrophysiological activity within the distributed network outside the stimulated site. To address this problem, we recruited 69 patients who experienced visual sensations during invasive electrical stimulation while intracranial electroencephalography (iEEG) data were recorded. We found significantly flattened power spectral slopes in distributed regions involving different brain networks and decreased integrated information during elicited visual sensations compared with the non-sensation condition. Further analysis based on minimum information partitions revealed that the reconfigured network interactions primarily involved the inferior frontal cortex, posterior superior temporal sulcus, and temporoparietal junction. The flattened power spectral slope in the inferior frontal gyrus was also correlated with integrated information. Taken together, this study indicates that the altered electrophysiological signatures provide insights into the neural mechanisms underlying subjective visual sensations.
Humans ; Male ; Female ; Adult ; Visual Perception/physiology* ; Electric Stimulation ; Middle Aged ; Young Adult ; Electrocorticography ; Electroencephalography ; Brain Mapping

Accurate self-motion perception, which is critical for organisms to survive, is a process involving multiple sensory cues. The two most powerful cues are visual (optic flow) and vestibular (inertial motion). Psychophysical studies have indicated that humans and nonhuman primates integrate the two cues to improve the estimation of self-motion direction, often in a statistically Bayesian-optimal way. In the last decade, single-unit recordings in awake, behaving animals have provided valuable neurophysiological data with a high spatial and temporal resolution, giving insight into possible neural mechanisms underlying multisensory self-motion perception. Here, we review these findings, along with new evidence from the most recent studies focusing on the temporal dynamics of signals in different modalities. We show that, in light of new data, conventional thoughts about the cortical mechanisms underlying visuo-vestibular integration for linear self-motion are challenged. We propose that different temporal component signals may mediate different functions, a possibility that requires future studies.
Animals ; Humans ; Motion Perception/physiology* ; Bayes Theorem ; Optic Flow ; Cues ; Vestibule, Labyrinth/physiology* ; Photic Stimulation ; Visual Perception/physiology*

Evading or escaping from predators is one of the most crucial issues for survival across the animal kingdom. The timely detection of predators and the initiation of appropriate fight-or-flight responses are innate capabilities of the nervous system. Here we review recent progress in our understanding of innate visually-triggered defensive behaviors and the underlying neural circuit mechanisms, and a comparison among vinegar flies, zebrafish, and mice is included. This overview covers the anatomical and functional aspects of the neural circuits involved in this process, including visual threat processing and identification, the selection of appropriate behavioral responses, and the initiation of these innate defensive behaviors. The emphasis of this review is on the early stages of this pathway, namely, threat identification from complex visual inputs and how behavioral choices are influenced by differences in visual threats. We also briefly cover how the innate defensive response is processed centrally. Based on these summaries, we discuss coding strategies for visual threats and propose a common prototypical pathway for rapid innate defensive responses.
Mice ; Animals ; Zebrafish ; Neurons/physiology* ; Visual Perception/physiology*

With inherent sparse spike-based coding and asynchronous event-driven computation, spiking neural network (SNN) is naturally suitable for processing event stream data of event cameras. In order to improve the feature extraction and classification performance of bio-inspired hierarchical SNNs, in this paper an event camera object recognition system based on biological synaptic plasticity is proposed. In our system input event streams were firstly segmented adaptively using spiking neuron potential to improve computational efficiency of the system. Multi-layer feature learning and classification are implemented by our bio-inspired hierarchical SNN with synaptic plasticity. After Gabor filter-based event-driven convolution layer which extracted primary visual features of event streams, we used a feature learning layer with unsupervised spiking timing dependent plasticity (STDP) rule to help the network extract frequent salient features, and a feature learning layer with reward-modulated STDP rule to help the network learn diagnostic features. The classification accuracies of the network proposed in this paper on the four benchmark event stream datasets were better than the existing bio-inspired hierarchical SNNs. Moreover, our method showed good classification ability for short event stream input data, and was robust to input event stream noise. The results show that our method can improve the feature extraction and classification performance of this kind of SNNs for event camera object recognition.
Visual Perception ; Learning ; Action Potentials ; Neural Networks, Computer ; Neuronal Plasticity

Integrating multisensory inputs to generate accurate perception and guide behavior is among the most critical functions of the brain. Subcortical regions such as the amygdala are involved in sensory processing including vision and audition, yet their roles in multisensory integration remain unclear. In this study, we systematically investigated the function of neurons in the amygdala and adjacent regions in integrating audiovisual sensory inputs using a semi-chronic multi-electrode array and multiple combinations of audiovisual stimuli. From a sample of 332 neurons, we showed the diverse response patterns to audiovisual stimuli and the neural characteristics of bimodal over unimodal modulation, which could be classified into four types with differentiated regional origins. Using the hierarchical clustering method, neurons were further clustered into five groups and associated with different integrating functions and sub-regions. Finally, regions distinguishing congruent and incongruent bimodal sensory inputs were identified. Overall, visual processing dominates audiovisual integration in the amygdala and adjacent regions. Our findings shed new light on the neural mechanisms of multisensory integration in the primate brain.
Animals ; Macaca ; Acoustic Stimulation ; Auditory Perception/physiology* ; Visual Perception/physiology* ; Amygdala/physiology* ; Photic Stimulation

Neuroscientists have emphasized visceral influences on consciousness and attention, but the potential neurophysiological pathways remain under exploration. Here, we found two neurophysiological pathways of heart-brain interaction based on the relationship between oxygen-transport by red blood cells (RBCs) and consciousness/attention. To this end, we collected a dataset based on the routine physical examination, the breaking continuous flash suppression (b-CFS) paradigm, and an attention network test (ANT) in 140 immigrants under the hypoxic Tibetan environment. We combined electroencephalography and multilevel mediation analysis to investigate the relationship between RBC properties and consciousness/attention. The results showed that RBC function, via two independent neurophysiological pathways, not only triggered interoceptive re-representations in the insula and awareness connected to orienting attention but also induced an immune response corresponding to consciousness and executive control. Importantly, consciousness played a fundamental role in executive function which might be associated with the level of perceived stress. These results indicated the important role of oxygen-transport in heart-brain interactions, in which the related stress response affected consciousness and executive control. The findings provide new insights into the neurophysiological schema of heart-brain interactions.
Awareness ; Brain ; Consciousness ; Humans ; Oxygen ; Visual Perception

Visual object recognition in humans and nonhuman primates is achieved by the ventral visual pathway (ventral occipital-temporal cortex, VOTC), which shows a well-documented object domain structure. An on-going question is what type of information is processed in the higher-order VOTC that underlies such observations, with recent evidence suggesting effects of certain visual features. Combining computational vision models, fMRI experiment using a parametric-modulation approach, and natural image statistics of common objects, we depicted the neural distribution of a comprehensive set of visual features in the VOTC, identifying voxel sensitivities with specific feature sets across geometry/shape, Fourier power, and color. The visual feature combination pattern in the VOTC is significantly explained by their relationships to different types of response-action computation (fight-or-flight, navigation, and manipulation), as derived from behavioral ratings and natural image statistics. These results offer a comprehensive visual feature map in the VOTC and a plausible theoretical explanation as a mapping onto different types of downstream response-action systems.
Animals ; Brain Mapping ; Humans ; Magnetic Resonance Imaging ; Occipital Lobe ; Pattern Recognition, Visual ; Photic Stimulation ; Temporal Lobe ; Visual Pathways/diagnostic imaging* ; Visual Perception

BACKGROUND: No head to head comparison is available between surgical lip lifting and upper lip filler injections to decide which technique yields the best results in patients. Despite the growing popularity of upper lip augmentation, its effect on societal perceptions of attractiveness, successfulness and overall health in woman is unknown. METHODS: Blinded casual observers viewed three versions of independent images of 15 unique patient lower faces for a total of 45 images. Observers rated the attractiveness, perceived success, and perceived overall health for each patient image. Facial perception questions were answered on a visual analog scale from 0 to 100, where higher scores corresponded to more positive responses. RESULTS: Two hundred and seventeen random observers with an average age of 47 years (standard deviation, 15.9) rated the images. The majority of observers were females (n=183, 84%) of white race (n=174, 80%) and had at least some college education (n=202, 93%). The marginal mean score for perceived attractiveness from the natural condition was 1.5 points (95% confidence interval [CI], 0.9–2.18) higher than perceived attractiveness from the simulated upper lip filler injection condition, and 2.6 points higher (95% CI, 1.95–3.24) than the simulated upper lip lift condition. There was a moderate to strong correlation between the scores of the same observer. CONCLUSIONS: Simulated upper lip augmentation is amenable to social perception analysis. Scores of the same observer for attractiveness, successfulness, and overall health are strongly correlated. Overall, the natural condition had the highest scores in all categories, followed by simulated upper lip filler, and lastly simulated upper lip lift.
Continental Population Groups ; Education ; Female ; Head ; Humans ; Lifting ; Lip ; Photography ; Social Perception ; Surgery, Plastic ; Visual Analog Scale