Design and validation of a multimodal model integrating text and imaging data for intelligent assessment of psychological stress in college students.
10.12122/j.issn.1673-4254.2025.11.23
- Author:
Huirong XIE
1
;
Chaobin HU
1
;
Guohua LIANG
1
;
Hongzhe HAN
1
;
Mu HUANG
1
;
Qianjin FENG
1
Author Information
1. School of Biomedical Engineering, Southern Medical University, Guangzhou 510515, China.
- Publication Type:Journal Article
- Keywords:
automated assessment;
college students' psychological stress;
deep learning;
multimodal data fusion;
social media sentiment analysis
- MeSH:
Humans;
Stress, Psychological/diagnosis*;
Students/psychology*;
Universities;
Social Media;
Deep Learning
- From:
Journal of Southern Medical University
2025;45(11):2504-2510
- CountryChina
- Language:Chinese
-
Abstract:
OBJECTIVES:We propose a multimodal model integrating social media text and image data for automated assessment of psychological stress in college students to support the development of intelligent mental health services in higher education institutions.
METHODS:Based on deep learning technology, we designed an evaluation framework comprising a text sentiment modeling module, an image sentiment modeling module, and a multimodal fusion prediction module. Text sentiment features were extracted using Bi-LSTM, and image semantic cues were extracted via U-Net. A feature concatenation strategy was used to enable cross-modal semantic collaboration to achieve automatic identification of 3 psychological stress levels: mild, moderate, and severe. We constructed a multimodal annotated dataset using social platform data from 1577 students across multiple universities in Guangdong Province. After data cleaning, 252 samples were randomly selected for model training and testing.
RESULTS:In the 3-classification task, the model demonstrated outstanding performance on the test set, and achieved an accuracy of 92.86% and an F1 score of 0.9276, exhibiting excellent stability and consistency. Confusion matrix analysis further revealed the model's ability to effectively distinguish between different pressure levels.
CONCLUSIONS:The multimodal psychological stress assessment model developed in this study effectively integrates unstructured social behavior data to enhance the scientific rigor and practical applicability of psychological state recognition, and thus provides support for developing intelligent psychological service systems.
