To extract the temporal structure of sensory inputs is of great significance to our adaptive functioning in the dynamic environment. Here we characterize three types of temporal structure information, and review behavioral and neural evidence bearing on the encoding and utilization of such information in visual and auditory perception. The evidence together supports a functional view that the brain not only tracks but also makes use of temporal structure from diverse sources for a broad range of cognitive processes, such as perception, attention, and unconscious information processing. These functions are implemented by brain mechanisms including neural entrainment, predictive coding, as well as more specific mechanisms that vary with the type of temporal regularity and sensory modality. This framework enriches our understanding of how the human brain promotes dynamic information processing by exploiting regularities in ubiquitous temporal structures.
Attention ; Auditory Perception ; Brain ; physiology ; Humans ; Time Perception ; Visual Perception

The core of visual processing is the identification and recognition of the objects relevant to cognitive behaviors. In natural environment, visual input is often comprised of highly complex 3-dimensional signals involving multiple visual objects. One critical determinant of object recognition is visual contour. Despite substantial insights on visual contour processing gained from previous findings, these studies have focused on limited aspects or particular stages of contour processing. So far, a systematic perspective of contour processing that comprehensively incorporates previous evidence is still missing. We therefore propose an integrated framework of the cognitive and neural mechanisms of contour processing, which involves three mutually interacting cognitive stages: contour detection, border ownership assignment and contour integration. For each stage, we provide an elaborated discussion of the neural properties, processing mechanism, and its functional interaction with the other stages by summarizing the relevant electrophysiological and human cognitive neuroscience evidence. Finally, we present the major challenges for further unraveling the mechanisms of visual contour processing.
Cognition ; Form Perception ; Humans ; Visual Cortex ; physiology ; Visual Perception

Because of a limited capacity of information processing in the brain, the efficient processing of visual information requires selecting only a very small fraction of visual inputs at any given moment in time. Attention is the main mechanism that controls this selection process, namely selective attention. Selective attention is the mechanism by which the subset of incoming information is preferentially processed from the complex external environment. Research on selective attention has two key issues. One is what targets (inputs) are selected by attention. There are three different types of selective attention according to its selected target: space-based, feature-based, and object-based attention. Another issue is how selective attention is generated. There are two different types of selective attention according to its generating source: top-down and bottom-up attention. In this review, these two issues are introduced to systematically discuss the neural mechanism of visual selective attention.
Attention ; Brain ; physiology ; Cognition ; Humans ; Visual Perception

The human visual system efficiently extracts local elements from cluttered backgrounds and integrates these elements into meaningful contour perception. This process is a critical step before object recognition, in which contours often play an important role in defining the shapes and borders of the to-be-recognized objects. However, the neural mechanism of the contour integration is still under debate. The investigation of the neural mechanism underlying contour integration could deepen our understanding of perceptual grouping in the human visual system and advance the development of the algorithms for image grouping and segmentation in computer vision. Here, we review two theoretical frameworks that were proposed over the past decades. The first framework is based on hardwired horizontal connection in primary visual cortex, while the second one emphasizes the role of recurrent connections within intra- and inter-areas. At the end of review, we also raise the unsolved issues that need to be addressed in future studies.
Form Perception ; Humans ; Models, Neurological ; Pattern Recognition, Visual ; Visual Cortex ; physiology ; Visual Perception

Efficient coding theory proposes that sensory systems in the brain have been adapted to process natural scenes efficiently over the long history of evolution. Computational modeling the statistical regularities of natural images is therefore beneficial to our understanding of the mechanisms of visual information processing. In this paper, we briefly review the recent progress in using efficient coding approaches to study the encoding of natural images in the visual system.
Animals ; Evoked Potentials, Visual ; physiology ; Humans ; Models, Statistical ; Photic Stimulation ; Visual Cortex ; physiology ; Visual Perception ; physiology

Integrating multisensory inputs to generate accurate perception and guide behavior is among the most critical functions of the brain. Subcortical regions such as the amygdala are involved in sensory processing including vision and audition, yet their roles in multisensory integration remain unclear. In this study, we systematically investigated the function of neurons in the amygdala and adjacent regions in integrating audiovisual sensory inputs using a semi-chronic multi-electrode array and multiple combinations of audiovisual stimuli. From a sample of 332 neurons, we showed the diverse response patterns to audiovisual stimuli and the neural characteristics of bimodal over unimodal modulation, which could be classified into four types with differentiated regional origins. Using the hierarchical clustering method, neurons were further clustered into five groups and associated with different integrating functions and sub-regions. Finally, regions distinguishing congruent and incongruent bimodal sensory inputs were identified. Overall, visual processing dominates audiovisual integration in the amygdala and adjacent regions. Our findings shed new light on the neural mechanisms of multisensory integration in the primate brain.
Animals ; Macaca ; Acoustic Stimulation ; Auditory Perception/physiology* ; Visual Perception/physiology* ; Amygdala/physiology* ; Photic Stimulation

Evading or escaping from predators is one of the most crucial issues for survival across the animal kingdom. The timely detection of predators and the initiation of appropriate fight-or-flight responses are innate capabilities of the nervous system. Here we review recent progress in our understanding of innate visually-triggered defensive behaviors and the underlying neural circuit mechanisms, and a comparison among vinegar flies, zebrafish, and mice is included. This overview covers the anatomical and functional aspects of the neural circuits involved in this process, including visual threat processing and identification, the selection of appropriate behavioral responses, and the initiation of these innate defensive behaviors. The emphasis of this review is on the early stages of this pathway, namely, threat identification from complex visual inputs and how behavioral choices are influenced by differences in visual threats. We also briefly cover how the innate defensive response is processed centrally. Based on these summaries, we discuss coding strategies for visual threats and propose a common prototypical pathway for rapid innate defensive responses.
Mice ; Animals ; Zebrafish ; Neurons/physiology* ; Visual Perception/physiology*

Many applications in virtual reality and telerobot call for the implementation of displaying the human softness haptics on the object being touched. Although there are lots of literatures on discrimination threshold for displacement, force magnitude, shape and viscosity, there is still a lack of research on remembrance of softness haptic perception in human fingertips. Such research is needed in designing haptic rendering and display system. In this paper, a novel softness haptic display device based on deformable length of elastic element control was adopted as a test device to study the human fingertip's ability of remembrance of softness haptic perception. According to the recall experiment and recognition experiment, the softness haptic memory span and reaction time were discussed. From the experimental results, some important conclusions have been obtained: (1) human softness haptic memory span is 3 to 4 items, which is smaller than visual memory span and auditory memory span; (2) it is more difficult for people to remember hard objects than soft objects.
Adult ; Female ; Form Perception ; physiology ; Humans ; Male ; Mental Recall ; Touch ; physiology ; Visual Perception

Cross-modal stochastic resonance is a ubiquitous phenomenon, that is, a weak signal from one sensory pathway can be enhanced by the noise from a different sensory pathway. It is a special multisensory integration (MI) that can not be explained by the inverse-effectiveness rule. According to cross-modal stochastic resonance, the detection of signal is an inverted U-like function of the intensity of noise at different levels. In this paper, we reviewed the research of cross-modal stochastic resonance and put forward some possible explanations for it. These efforts raise a new idea for neural encoding and information processing of the brain.
Acoustic Stimulation ; Auditory Perception ; physiology ; Brain ; physiology ; Humans ; Mental Processes ; physiology ; Sensory Thresholds ; physiology ; Stochastic Processes ; Visual Perception ; physiology

Integrating different visual features into a coherent object is a central challenge for the visual system, which is referred as the binding problem. Firstly, this review introduces the conception of the binding problem and the theoretical and empirical controversies regarding whether and how the binding processes are implemented in visual system. Although many neurons throughout the visual hierarchy are known to code multiple features, feature binding is recruited by visual system. Feature misbinding (or illusory conjunction) is probably the most striking evidence for the existence of the binding mechanism. Next, this review summarizes some critical issues in feature binding literature, including early binding theories, late binding theories, neural synchrony theory, the feature integration theory and re-entry processing theory. Feature binding is not a fully automatic or bottom-up processing. Reentrant connection from higher visual areas to early visual cortex (top-down processes) plays a critical role in feature binding, especially in active feature binding (i.e. feature misbinding). In addition, with electrophysiology, electroencephalography (EEG), magnetoencephalography (MEG) and transcranial electric stimulation (tEs) approaches, recent studies explored both correlational and causal relations between brain oscillations and feature binding, suggesting that brain oscillations are of great importance for feature binding. Finally, this review discusses some potential problems and open questions associated with visual feature binding mechanisms which need to be addressed in future studies.
Brain ; physiology ; Electroencephalography ; Humans ; Magnetoencephalography ; Neurons ; physiology ; Transcranial Direct Current Stimulation ; Visual Cortex ; physiology ; Visual Perception