Multi-tissue segmentation model of whole slide image of pancreatic cancer based on multi task and attention mechanism.
10.7507/1001-5515.202211003
- Author:
Wei GAO
1
;
Hui JIANG
2
;
Yiping JIAO
1
;
Xiangxue WANG
1
;
Jun XU
1
Author Information
1. Institute for AI in Medicine, School of Artificial Intelligence, Nanjing University of Information Science and Technology, Nanjing 210044, P. R. China.
2. Department of Pathology, Changhai Hospital Affiliated to Navy Medical University, Shanghai 200433. P.R.China.
- Publication Type:Journal Article
- Keywords:
Attention mechanism;
Multi-task learning;
Pancreatic cancer;
Tissue segmentation;
Whole slide image
- MeSH:
Humans;
China;
Pancreatic Neoplasms/diagnostic imaging*;
Learning
- From:
Journal of Biomedical Engineering
2023;40(1):70-78
- CountryChina
- Language:Chinese
-
Abstract:
Accurate segmentation of whole slide images is of great significance for the diagnosis of pancreatic cancer. However, developing an automatic model is challenging due to the complex content, limited samples, and high sample heterogeneity of pathological images. This paper presented a multi-tissue segmentation model for whole slide images of pancreatic cancer. We introduced an attention mechanism in building blocks, and designed a multi-task learning framework as well as proper auxiliary tasks to enhance model performance. The model was trained and tested with the pancreatic cancer pathological image dataset from Shanghai Changhai Hospital. And the data of TCGA, as an external independent validation cohort, was used for external validation. The F1 scores of the model exceeded 0.97 and 0.92 in the internal dataset and external dataset, respectively. Moreover, the generalization performance was also better than the baseline method significantly. These results demonstrate that the proposed model can accurately segment eight kinds of tissue regions in whole slide images of pancreatic cancer, which can provide reliable basis for clinical diagnosis.
