Facial Expression Enhances Emotion Perception Compared to Vocal Prosody: Behavioral and fMRI Studies.
10.1007/s12264-018-0231-9
- Author:
Heming ZHANG
1
;
Xuhai CHEN
2
;
Shengdong CHEN
1
;
Yansong LI
3
;
Changming CHEN
4
;
Quanshan LONG
1
;
Jiajin YUAN
5
Author Information
1. Key Laboratory of Cognition and Personality of the Ministry of Education, School of Psychology, Southwest University, Chongqing, 400715, China.
2. Key Laboratory of Behavior and Cognitive Psychology in Shaanxi Province, School of Psychology, Shaanxi Normal University, Xi'an, 710062, China.
3. Department of Psychology, School of Social and Behavioral Sciences, Nanjing University, Nanjing, 210023, China.
4. School of Educational Sciences, Xinyang Normal University, Xinyang, 464000, China.
5. Key Laboratory of Cognition and Personality of the Ministry of Education, School of Psychology, Southwest University, Chongqing, 400715, China. yuanjiajin168@126.com.
- Publication Type:Journal Article
- Keywords:
Emotion perception;
Facial expression;
Modality;
Vocal prosody;
fMRI
- MeSH:
Adult;
Brain Mapping;
methods;
Cerebral Cortex;
diagnostic imaging;
physiology;
Emotions;
physiology;
Facial Expression;
Facial Recognition;
physiology;
Female;
Humans;
Magnetic Resonance Imaging;
Psychomotor Performance;
physiology;
Social Perception;
Speech Perception;
physiology;
Young Adult
- From:
Neuroscience Bulletin
2018;34(5):801-815
- CountryChina
- Language:English
-
Abstract:
Facial and vocal expressions are essential modalities mediating the perception of emotion and social communication. Nonetheless, currently little is known about how emotion perception and its neural substrates differ across facial expression and vocal prosody. To clarify this issue, functional MRI scans were acquired in Study 1, in which participants were asked to discriminate the valence of emotional expression (angry, happy or neutral) from facial, vocal, or bimodal stimuli. In Study 2, we used an affective priming task (unimodal materials as primers and bimodal materials as target) and participants were asked to rate the intensity, valence, and arousal of the targets. Study 1 showed higher accuracy and shorter response latencies in the facial than in the vocal modality for a happy expression. Whole-brain analysis showed enhanced activation during facial compared to vocal emotions in the inferior temporal-occipital regions. Region of interest analysis showed a higher percentage signal change for facial than for vocal anger in the superior temporal sulcus. Study 2 showed that facial relative to vocal priming of anger had a greater influence on perceived emotion for bimodal targets, irrespective of the target valence. These findings suggest that facial expression is associated with enhanced emotion perception compared to equivalent vocal prosodies.
