Accurate self-motion perception, which is critical for organisms to survive, is a process involving multiple sensory cues. The two most powerful cues are visual (optic flow) and vestibular (inertial motion). Psychophysical studies have indicated that humans and nonhuman primates integrate the two cues to improve the estimation of self-motion direction, often in a statistically Bayesian-optimal way. In the last decade, single-unit recordings in awake, behaving animals have provided valuable neurophysiological data with a high spatial and temporal resolution, giving insight into possible neural mechanisms underlying multisensory self-motion perception. Here, we review these findings, along with new evidence from the most recent studies focusing on the temporal dynamics of signals in different modalities. We show that, in light of new data, conventional thoughts about the cortical mechanisms underlying visuo-vestibular integration for linear self-motion are challenged. We propose that different temporal component signals may mediate different functions, a possibility that requires future studies.
Animals ; Humans ; Motion Perception/physiology* ; Bayes Theorem ; Optic Flow ; Cues ; Vestibule, Labyrinth/physiology* ; Photic Stimulation ; Visual Perception/physiology*

Integrating multisensory inputs to generate accurate perception and guide behavior is among the most critical functions of the brain. Subcortical regions such as the amygdala are involved in sensory processing including vision and audition, yet their roles in multisensory integration remain unclear. In this study, we systematically investigated the function of neurons in the amygdala and adjacent regions in integrating audiovisual sensory inputs using a semi-chronic multi-electrode array and multiple combinations of audiovisual stimuli. From a sample of 332 neurons, we showed the diverse response patterns to audiovisual stimuli and the neural characteristics of bimodal over unimodal modulation, which could be classified into four types with differentiated regional origins. Using the hierarchical clustering method, neurons were further clustered into five groups and associated with different integrating functions and sub-regions. Finally, regions distinguishing congruent and incongruent bimodal sensory inputs were identified. Overall, visual processing dominates audiovisual integration in the amygdala and adjacent regions. Our findings shed new light on the neural mechanisms of multisensory integration in the primate brain.
Animals ; Macaca ; Acoustic Stimulation ; Auditory Perception/physiology* ; Visual Perception/physiology* ; Amygdala/physiology* ; Photic Stimulation

Evading or escaping from predators is one of the most crucial issues for survival across the animal kingdom. The timely detection of predators and the initiation of appropriate fight-or-flight responses are innate capabilities of the nervous system. Here we review recent progress in our understanding of innate visually-triggered defensive behaviors and the underlying neural circuit mechanisms, and a comparison among vinegar flies, zebrafish, and mice is included. This overview covers the anatomical and functional aspects of the neural circuits involved in this process, including visual threat processing and identification, the selection of appropriate behavioral responses, and the initiation of these innate defensive behaviors. The emphasis of this review is on the early stages of this pathway, namely, threat identification from complex visual inputs and how behavioral choices are influenced by differences in visual threats. We also briefly cover how the innate defensive response is processed centrally. Based on these summaries, we discuss coding strategies for visual threats and propose a common prototypical pathway for rapid innate defensive responses.
Mice ; Animals ; Zebrafish ; Neurons/physiology* ; Visual Perception/physiology*

With inherent sparse spike-based coding and asynchronous event-driven computation, spiking neural network (SNN) is naturally suitable for processing event stream data of event cameras. In order to improve the feature extraction and classification performance of bio-inspired hierarchical SNNs, in this paper an event camera object recognition system based on biological synaptic plasticity is proposed. In our system input event streams were firstly segmented adaptively using spiking neuron potential to improve computational efficiency of the system. Multi-layer feature learning and classification are implemented by our bio-inspired hierarchical SNN with synaptic plasticity. After Gabor filter-based event-driven convolution layer which extracted primary visual features of event streams, we used a feature learning layer with unsupervised spiking timing dependent plasticity (STDP) rule to help the network extract frequent salient features, and a feature learning layer with reward-modulated STDP rule to help the network learn diagnostic features. The classification accuracies of the network proposed in this paper on the four benchmark event stream datasets were better than the existing bio-inspired hierarchical SNNs. Moreover, our method showed good classification ability for short event stream input data, and was robust to input event stream noise. The results show that our method can improve the feature extraction and classification performance of this kind of SNNs for event camera object recognition.
Visual Perception ; Learning ; Action Potentials ; Neural Networks, Computer ; Neuronal Plasticity

Neuroscientists have emphasized visceral influences on consciousness and attention, but the potential neurophysiological pathways remain under exploration. Here, we found two neurophysiological pathways of heart-brain interaction based on the relationship between oxygen-transport by red blood cells (RBCs) and consciousness/attention. To this end, we collected a dataset based on the routine physical examination, the breaking continuous flash suppression (b-CFS) paradigm, and an attention network test (ANT) in 140 immigrants under the hypoxic Tibetan environment. We combined electroencephalography and multilevel mediation analysis to investigate the relationship between RBC properties and consciousness/attention. The results showed that RBC function, via two independent neurophysiological pathways, not only triggered interoceptive re-representations in the insula and awareness connected to orienting attention but also induced an immune response corresponding to consciousness and executive control. Importantly, consciousness played a fundamental role in executive function which might be associated with the level of perceived stress. These results indicated the important role of oxygen-transport in heart-brain interactions, in which the related stress response affected consciousness and executive control. The findings provide new insights into the neurophysiological schema of heart-brain interactions.
Awareness ; Brain ; Consciousness ; Humans ; Oxygen ; Visual Perception

Visual object recognition in humans and nonhuman primates is achieved by the ventral visual pathway (ventral occipital-temporal cortex, VOTC), which shows a well-documented object domain structure. An on-going question is what type of information is processed in the higher-order VOTC that underlies such observations, with recent evidence suggesting effects of certain visual features. Combining computational vision models, fMRI experiment using a parametric-modulation approach, and natural image statistics of common objects, we depicted the neural distribution of a comprehensive set of visual features in the VOTC, identifying voxel sensitivities with specific feature sets across geometry/shape, Fourier power, and color. The visual feature combination pattern in the VOTC is significantly explained by their relationships to different types of response-action computation (fight-or-flight, navigation, and manipulation), as derived from behavioral ratings and natural image statistics. These results offer a comprehensive visual feature map in the VOTC and a plausible theoretical explanation as a mapping onto different types of downstream response-action systems.
Animals ; Brain Mapping ; Humans ; Magnetic Resonance Imaging ; Occipital Lobe ; Pattern Recognition, Visual ; Photic Stimulation ; Temporal Lobe ; Visual Pathways/diagnostic imaging* ; Visual Perception

OBJECTIVES: The purpose of this study was to examine the combined effects of Prism Adaptation (PA) plus functional electrical stimulation (FES) on stroke patients with unilateral neglect, and suggest a new intervention method for acute-phase stroke patients. METHODS: There were 30 patients included in this study from April to October 2016 that had unilateral neglect whilst hospitalized following a stroke (diagnosed by a professional). The participants, who were patients receiving occupational therapy, understood the purpose of the study and agreed to participate. The patients were randomly divided into 3 groups: PA plus FES group (Group A), PA group (Group B), and FES group (Group C). Treatments lasted for 50 minutes per day, 5 times per week, for 3 weeks in total. Reevaluation was conducted after 3 weeks of intervention. RESULTS: All 3 groups showed unilateral neglect reduction after the intervention, but PA plus FES (complex intervention method) was more effective than PA or FES alone [effect size: Motor-free Visual Perception Test (0.80), Albert test (0.98), CBS (0.92)]. CONCLUSION: The results of this study support further studies to examine complex intervention for the treatment of unilateral neglect.
Electric Stimulation ; Humans ; Methods ; Occupational Therapy ; Stroke ; Visual Perception

BACKGROUND: No head to head comparison is available between surgical lip lifting and upper lip filler injections to decide which technique yields the best results in patients. Despite the growing popularity of upper lip augmentation, its effect on societal perceptions of attractiveness, successfulness and overall health in woman is unknown. METHODS: Blinded casual observers viewed three versions of independent images of 15 unique patient lower faces for a total of 45 images. Observers rated the attractiveness, perceived success, and perceived overall health for each patient image. Facial perception questions were answered on a visual analog scale from 0 to 100, where higher scores corresponded to more positive responses. RESULTS: Two hundred and seventeen random observers with an average age of 47 years (standard deviation, 15.9) rated the images. The majority of observers were females (n=183, 84%) of white race (n=174, 80%) and had at least some college education (n=202, 93%). The marginal mean score for perceived attractiveness from the natural condition was 1.5 points (95% confidence interval [CI], 0.9–2.18) higher than perceived attractiveness from the simulated upper lip filler injection condition, and 2.6 points higher (95% CI, 1.95–3.24) than the simulated upper lip lift condition. There was a moderate to strong correlation between the scores of the same observer. CONCLUSIONS: Simulated upper lip augmentation is amenable to social perception analysis. Scores of the same observer for attractiveness, successfulness, and overall health are strongly correlated. Overall, the natural condition had the highest scores in all categories, followed by simulated upper lip filler, and lastly simulated upper lip lift.
Continental Population Groups ; Education ; Female ; Head ; Humans ; Lifting ; Lip ; Photography ; Social Perception ; Surgery, Plastic ; Visual Analog Scale

BACKGROUND: This study evaluated the efficacy of virtual reality (VR) distraction and counter-stimulation (CS) on dental anxiety and pain perception to local anesthesia in children. METHODS: A prospective, randomized, single-blinded interventional clinical trial with a parallel design was used. Seventy children 7–11 years old who required local anesthesia (LA) for pulp therapy or tooth extraction were recruited and allocated to two groups with equal distribution based on the intervention. Group CS (n = 35) received CS and Group VR (n = 35) received VR distraction with ANTVR glasses. Anxiety levels (using pulse rate) were evaluated before, during, and after administration of local anesthesia, while pain perception was assessed immediately after the injection. Wong-Baker faces pain-rating scale (WBFPS), visual analog scale (VAS), and Venham's clinical anxiety rating scale (VCARS) were used for pain evaluation. Student's t-test was used to test the mean difference between groups, and repeated measures ANOVA was used to test the mean difference of pulse rates. RESULTS: Significant differences in mean pulse rates were observed in both groups, while children in the VR group had a higher reduction (P < 0.05), and the mean VCARS scores were significant in the VR group (P < 0.05). Mean WBFPS scores showed less pain perception to LA needle prick in the CS group while the same change was observed in the VR group with VAS scores. CONCLUSIONS: VR distraction is better than CS for reducing anxiety to injection in children undergoing extraction and pulpectomy.
Anesthesia, Local ; Anxiety ; Child ; Dental Anxiety ; Eyeglasses ; Glass ; Heart Rate ; Humans ; Needles ; Pain Perception ; Prospective Studies ; Pulpectomy ; Tooth Extraction ; Visual Analog Scale

PURPOSE: Patients with brain damage suffer from limitations in performing the activities of daily living (ADL) because of their motor function and visual perception impairment. The aim of this study was to help improve the motor function and visual perception ability of patients with brain damage by providing them with virtual reality-based contents. The usability results of the patients and specialists group were also evaluated. METHODS: The ADL contents consisted of living room, kitchen, veranda, and convenience store, similar to a real home environment, and these were organized by a rehabilitation specialist (e.g., neurologist, physiotherapist, and occupational therapist). The contents consisted of tasks, such as turning on the living room lights, organizing the drawers, organizing the kitchen, watering the plants on the veranda, and buying products at convenience stores. To evaluate the usability of the virtual reality-based visual cognitive rehabilitation service, general elderly subjects (n=11), stroke patients (n=7), stroke patients with visual impairment (n=4), and rehabilitation specialists (n=11) were selected. The questionnaires were distributed to the subjects who were using the service, and the subjective satisfaction of individual users was obtained as data. The data were analyzed using SPSS 21.0 software. The general characteristics of the users and the evaluation scores of the experts were analyzed using descriptive statistics. RESULTS: The usability test result of this study showed that the mean value of the questionnaire related to content understanding and difficulty was high, between 4–5 points. CONCLUSION: The virtual reality rehabilitation service of this study is an efficient service that can improve the function, interest, and motivation of stroke patients.
Activities of Daily Living ; Aged ; Brain ; Cognitive Therapy ; Humans ; Motivation ; Physical Therapists ; Rehabilitation ; Specialization ; Stroke ; Vision Disorders ; Visual Perception ; Water