Glasses-free Three Dimensional Endoscopic Display System with Multi-face Detection.
10.3969/j.issn.1671-7104.2022.01.002
- Author:
Yilin LENG
1
;
Zhaohui XU
2
Author Information
1. School of Communication and Information Engineering, Shanghai University, Shanghai,
2. Aviation Industry Corporation of China Huadong Photoelectric (Shanghai), Shanghai,
- Publication Type:Journal Article
- Keywords:
endoscope;
face detection;
glasses-free three dimensional display;
surgery teaching
- MeSH:
Endoscopes;
Endoscopy;
Humans;
Imaging, Three-Dimensional;
Minimally Invasive Surgical Procedures;
Surgical Instruments
- From:
Chinese Journal of Medical Instrumentation
2022;46(1):5-9
- CountryChina
- Language:Chinese
-
Abstract:
The glasses-free three dimensional(3D) endoscopic display system provides the surgeon with the depth information of the minimally invasive surgery scene obtained from the binocular perspective, which can effectively relieve the surgeon's posture fatigue and visual fatigue during the long-term surgery, and assist in the operation of surgical instruments more accurately to reduce the damage to the surrounding tissues of the operation area. However, the glasses-free 3D display device currently has the problem of a narrow optimal viewing zone and easy crosstalk, especially in the surgical teaching application scenario, which performs poorly. In order to overcome the limitation of the narrower field of view, we introduce deep learning algorithms to detect and locate multiple faces, fine-tune the 3D display grating of the endoscope, rearrange pixels, and change the best view area, so that more people can get the best view. The experimental results show that the face detection accuracy of the method is 97.88%, and the detection time is 135 frames/ms, which achieves high accuracy while maintaining real-time performance.
