Obstacle avoidance in simulated prosthetic vision based on SOLOv2-RS
10.3969/j.issn.1005-202X.2024.03.007
- VernacularTitle:基于SOLOv2-RS的人工假体视觉避障研究
- Author:
Ning E
1
;
Jing WANG
;
Xianglong ZHOU
;
Rongfeng ZHAO
;
Haiyang HE
Author Information
1. 上海海洋大学信息学院,上海 201306
- Keywords:
visual prosthesis;
obstacle avoidance;
SOLOv2-RS;
ResNeSt;
hierarchical optimization processing
- From:
Chinese Journal of Medical Physics
2024;41(3):309-315
- CountryChina
- Language:Chinese
-
Abstract:
Aiming at the obstacle avoidance in simulated prosthetic vision,an improved instance segmentation model SOLOv2-RS is proposed for providing a basis for implant recipients to accurately perceive the relevant instance objects of navigation tasks in low-resolution prosthetic vision.According to the visual attention mechanism,the distance from the center of the visual field and the target scale are adopted as the importance calculation criteria for each instance,and the obtained importance score is used as the basis for the hierarchical representation of the obstacles to be avoided.Meanwhile,edge information is used to cue the tactile paving,and it is morphologically inflated for avoiding the edge information loss caused by the limited phosphene.The prosthetic vision simulation results demonstrate that the hierarchical optimization processing strategy for simulated prosthetic vision can effectively achieve the optimal representation of tactile paving and obstacles,thus facilitating the implant recipients to accomplish outdoor obstacle avoidance tasks more efficiently,and providing ideas for the research on the image processing of visual prosthetic devices.
