Research on facial micro-expression analysis has been going on for decades. Micro-expression can reflect the true emotions of individuals, and it has important application value in assisting auxiliary diagnosis and disease monitoring of mental disorders. In recent years, the development of artificial intelligence and big data technology has made the automatic recognition of micro-expressions possible, which will make micro-expression analysis more convenient and more widely used. This paper reviews the development of facial micro-expression analysis and its application in forensic psychiatry, to look into further application prospects and development direction.
Humans ; Forensic Psychiatry ; Artificial Intelligence ; Mental Disorders/diagnosis* ; Facial Expression ; Emotions

OBJECTIVE: To assess the reproducibility of non-verbal facial expressions (smile lips closed, smile lips open, lip purse, cheek puff) in normal persons using dynamic three-dimensional (3D) imaging and provide reference data for future research. METHODS: In this study, 15 adults (7 males and 8 females) without facial asymmetry and facial nerve dysfunction were recruited. Each participant was seated upright in front of the 3D imaging system in natural head position. The whole face could be captured in all six cameras. The dynamic 3D system captured 60 3D images per second. Four facial expressions were included: smile lips closed, smile lips open, lip purse, and cheek puff. Before starting, we instructed the subjects to make facial expressions to develop muscle memory. During recording, each facial expression took about 3 to 4 seconds. At least 1 week later, the procedure was repeated. The rest position (T0) was considered as the base frame. The first quartile of expressions (T1), just after reaching the maximum state of expressions (T2), just before the end of maximum state of expressions (T3), the third quartile of expressions (T4), and the end of motion (T5) were selected as key frames. Using the stable part of face such as forehead, each key frame (T1-T5) of the different expressions was aligned on the corresponding frame at rest (T0). The root mean square (RMS) between each key frame and its corresponding frame at rest were calculated. The Wilcoxon signed ranks test was applied to assess statistical differences between the corresponding frames of the different facial expressions. RESULTS: Facial expressions like smile lips closed, smile lips open, and cheek puff were reproducible. Lip purse was not reproducible. The statistically significant differences were found on the T2 frame of the repeated lip purse movement. CONCLUSION The dynamic 3D imaging can be used to evaluate the reproducibility of facial expressions. Compared with the qualitative analysis and two-dimensions analysis, dynamic 3D images can be able to more truly represent the facial expressions which make the research more reliable.
Adult ; Face/diagnostic imaging* ; Facial Expression ; Female ; Humans ; Imaging, Three-Dimensional ; Lip/diagnostic imaging* ; Male ; Photogrammetry ; Reproducibility of Results ; Smiling

The recognition of emotional facial expressions is critical for our social interactions. While some prior studies have shown that a high anxiety level is associated with more sensitive recognition of emotion, there are also reports supporting that anxiety did not affect or reduce the sensitivity to the recognition of facial emotions. To reconcile these results, here we investigated whether the effect of individual anxiety on the recognition of facial emotions is dependent on the emotion category and the race of the target faces. We found that, first, there was a significant positive correlation between the individual anxiety level and the recognition sensitivity for angry faces but not for sad or happy faces. Second, while the correlation was significant for both low- and high-intensity angry faces during the recognition of the observer's own-race faces, there was significant correlation only for low-intensity angry faces during the recognition of other-race faces. Collectively, our results suggest that the influence of anxiety on the recognition of facial emotions is flexible depending on the characteristics of the target face stimuli including emotion category and race.
Anxiety ; Continental Population Groups ; Facial Expression ; Humans ; Interpersonal Relations

OBJECTIVE: To explore the curative effect of progressively integrated sandplay therapy on core symptoms and sleep management in preschool children with mild-to-moderate autism spectrum disorder (ASD). METHODS: A total of 50 mild-to-moderate ASD preschool children were randomly divided into an experimental group (n=25) and a control group (n=25). The control group was treated with structured teaching and auditory integration training (AIT). Based on these, the experimental group was treated with progressively integrated sandplay therapy. The Autism Behavior Checklist (ABC), Children Autism Rating Scale (CARS), Social Responsiveness Scale (SRS), Children's Sleep Habit Questionnaire (CSHQ) and emotion recognition tools were used to evaluate the overall curative effect before treatment and 3 months after treatment. RESULTS: The experimental group had significantly lower scores of feeling, social interaction, somatic motor, language factor, total ABC and total CARS than the control group (P<0.05). The experimental group had also significantly lower scores of social cognition, social communication, social motivation, autistic behavior factor and total SRS than the control group (P<0.05). The experimental group had a significantly higher accurate rate of recognition of the upper facial expression and lower facial expression than the control group (P<0.05). The experimental group had significantly lower scores of bedtime resistance, sleep onset, sleep duration, night waking, daytime sleepiness, and total CSHQ than the control group (P<0.05). The experimental group had significantly reduced themes of wounding and significantly increased themes of healing after sandplay therapy (P<0.05). CONCLUSIONS Progressively integrated sandplay therapy can effectively improve the core symptoms and sleep quality of preschool children with mild-to-moderate ASD, which can be used as an early rehabilitation measure.
Autism Spectrum Disorder ; Child, Preschool ; Facial Expression ; Humans ; Play Therapy ; Social Behavior

OBJECTIVE: To study the clinical effect of integrated sandplay therapy in preschool children with Asperger syndrome (AS). METHODS: A total of 44 preschool children with AS were randomly divided into an experimental group and a control group, with 22 children in each group. The children in the control group were given routine training, and those in the experimental group were given integrated sandplay therapy in addition to the routine training. The treatment response was assess by the Social Responsiveness Scale (SRS), emotional recognition tools and changes in sandplay theme characteristics after 6 months of treatment. RESULTS: Before intervention, there were no significant differences between the two groups in the total score of SRS, the score of each factor of SRS, and correct rates of facial expression recognition of the upright position, inverted position, upper face and lower face (P>0.05). After 6 months of intervention, both groups had significant reductions in the total score of SRS and the score of each factor of SRS (P<0.01); the control group had significant increases in the correct rates of facial expression recognition of all positions except the upright position (P<0.05), while the experimental group had significant increases in the correct rates of facial expression recognition of all positions (P<0.05). Compared with the control group after intervention, the experimental group had significantly lower total score of SRS and scores of all factors of SRS except social perception (P<0.01) and significantly higher correct rates of facial expression recognition of all positions (P<0.01). The experimental group had a significant change in the number of sandplay theme characteristics after intervention (P<0.01). CONCLUSIONS Integrated sandplay therapy can improve social responsiveness and emotion recognition ability in preschool children with AS.
Asperger Syndrome ; Child, Preschool ; Emotions ; Facial Expression ; Humans ; Play Therapy

Emotional information is critical for our social life, in which attentional bias is now a focus in the study on attention. However, the attentional bias processing mechanism of emotional faces still arouses huge controversy. Using similar experimental paradigms and stimuli, the published studies have yielded contradictory results. Some studies suggest that angry faces could automatically stimulate attention, that is, there is an anger superiority effect. On the contrary, lines of growing evidence support the existence of a happiness superiority effect, suggesting that the superiority effect is shown in happy faces rather than angry faces. In the present paper, the behavioral and neuroscience studies of anger and happiness superiority effects are combined. It is found that there are three major reasons for the debate over the two types of effects, which include the choice of stimulus materials, the difference of paradigm setting, and the different stages of emotional processing. By comparatively integrating the previous published results, we highlight that the future studies should further control the experimental materials and procedures, and investigate the processing mechanism of anger and happiness superiority effects by combining cognitive neurobiology means to resolve the disputes.
Anger ; Attentional Bias ; Facial Expression ; Happiness ; Humans

The purpose of the present paper was to review the processing mechanisms of social cues in faces. We summarized researches relative to social cues in faces and discussed the processing mechanism of these cues from the aspects of facial expression, facial attractiveness, gaze and face direction, and lipreading. First, we discussed the general neural mechanism of face information processing and summarized the functions of face areas in the fusiform gyrus, posterior superior temporal sulcus and inferior occipital gyrus. Next, the neural mechanism of emotional face perception was discussed. The processing of emotional faces consists of encodings of perceptual and emotional components. The amygdala plays an important role in the emotional processing of facial expressions. Furthermore, the neural responses to facial expressions may be influenced by multiple factors, such as the type of emotion, the dynamic presentation of the face and the consciousness of facial expressions. With respect to facial attractiveness processing, studies has shown that the reward circuitry is activated by highly attractive faces. However, the influence of facial attractiveness on neural responses remains elusive. It is proposed that the neural responses to facial attractiveness might be modulated by factors such as the task, observer's sex, expectation and other social cues in faces. Eye gaze perception and face view perception are related to visual attention, and the relevant neural circuitry has been found to include attention-related areas, such as the intraparietal sulcus. Finally, research on lipreading reveals its important role in language perception. The auditory cortex and language-related cortex have been shown to be activated by lipreading. In summary, the present evidence may support facial information processing theory. However, the theory could be further improved based on present and future findings. Furthermore, we discussed the deficits in the processing of social cues in individuals with mental disorders and proposed future research directions in this field.
Brain Mapping ; Cues ; Emotions ; Facial Expression ; Humans ; Magnetic Resonance Imaging ; Temporal Lobe ; physiology

Möbius syndrome is a rare congenital condition, characterized by abducens and facial nerve palsy, resulting in limitation of lateral gaze movement and facial diplegia. However, to our knowledge, there have been few studies on evaluation of cranial nerves, on MR imaging in Möbius syndrome. Herein, we describe a rare case of Möbius syndrome representing limitation of lateral gaze, and weakness of facial expression, since the neonatal period. In this case, high-resolution MR imaging played a key role in diagnosing Möbius syndrome, by direct visualization of corresponding cranial nerves abnormalities.
Cranial Nerves ; Facial Expression ; Facial Nerve ; Magnetic Resonance Imaging ; Paralysis

PURPOSE: The purpose of this qualitative study was to identify the nature of precocious puberty and to explore what it means in primary schools.METHODS: The participants of this phenomenological study were nine primary school girls who were diagnosed with precocious puberty and experienced hormone therapeutics, applying a convenience sampling method. Data were collected from July 2017 to January 2018 through individual in-depth interviews of the participants, including gestures, facial expressions and nonverbal means. The data analysis followed the method of Giorgi.RESULTS: The study identified 37 concepts, 12 clusters, and five themes from experiences of precocious puberty. The essential five themes were as follows: ‘ashamed and concealing experience’, ‘there is no therapeutics option’, ‘difficulties in the process of therapeutics’, ‘difficulties in daily life’, and ‘ambivalence toward therapeutics’.CONCLUSION: The findings of this study indicate physical, psychological and social difficulties faced by girls with precocious puberty. Based on this results of the study, it is necessary to develop nursing intervention programs focusing on healthy growth and development for children with precocious puberty.
Child ; Facial Expression ; Female ; Gestures ; Growth and Development ; Humans ; Methods ; Nursing ; Puberty, Precocious ; Qualitative Research ; Statistics as Topic

PURPOSE: Nonverbal communication (NVC) is important in the patient-physician relationship, but the effect of NVC education is not well kown. In this study, we try to identify if students' NVC abilities are improved through communication training. METHODS: First-year medical students conducted medical interviews, which were performed with standardized patients (SPs) before and after communication skill education, and recorded in video. Fifty-one students were enrolled for this study. Two researchers used the NVC checklist, which consists of 12 nonverbal behaviors, to analyze and compare the students' nonverbal expressions in the interviews recorded before and after the education. RESULTS: After the students participated in communication training, open body position and adequate facial expression were increased while unnecessary silence, un-purposive movements, and giggling were decreased. These results can be interpreted as positive effects of the education. However, hand gesture was increased as a negative effect of the education. The total NVC score of the 12 nonverbal behaviors in the NVC checklist improved significantly, rising from 8.56 to 10.03. CONCLUSION: Communication skill education using SPs can improve nonverbal behaviors of medical students, especially facial expression, un-purposive movement, body position, unnecessary silence, and giggle, but not hand gesture. Further research is needed on a variety of teaching methods to improve NVCs.
Checklist ; Education ; Education, Medical ; Facial Expression ; Gestures ; Hand ; Humans ; Nonverbal Communication ; Students, Medical* ; Teaching