A comparative study on the efficiency of three human-computer interaction modes for flight interaction tasks
10.16289/j.cnki.1002-0837.2024.03004
- VernacularTitle:面向飞行交互任务的三种人机交互方式效率比较研究
- Author:
Duanqin XIONG
1
;
Naiming YAO
;
Rong LIN
;
Hanxiao GE
;
Jian DU
;
Yiwen HU
;
Lin DING
;
Xu WU
;
Guoqiang SUN
Author Information
1. 空军军医大学空军特色医学中心,北京 100142
- Keywords:
multi-modal human-computer interaction;
hand-touch control;
eye movement control;
voice control;
interaction efficiency
- From:Space Medicine & Medical Engineering
2024;35(3):156-161
- CountryChina
- Language:Chinese
-
Abstract:
Objective To compare the interaction efficiency of three human-machine interaction modes with hand-touch control,eye movement control and voice control,based on a multi-channel human-machine interaction system in flight mission scenarios.Methods 20 pilots took part in the study and completed the first level(relatively simple)and second level(relatively complex)interactive experimental tasks in three human-computer interaction modes based on specific flight mission scenarios.The interaction efficiency indicators included the system's interaction time,response time,fusion calculation time,and number of errors.After the experiment was completed,the pilots conducted a subjective evaluation,which included the suitability of the interaction mode to the task,consistency with expected usage,fault-tolerance,effective feedback,and the tendency of the interaction mode to be applied in future flight fields.Results There were generally significant differences in interaction efficiency between hand-touch control,voice control,and eye movement control in flight mission scenarios,but the differences differed in first-level and second-level interaction tasks.Based on the comprehensive interaction experimental tasks at all levels,the experimental results obtained included:(1)the interaction time of hand-touch control was the shortest,the interaction time of voice control was the longest,and the main effect of the interaction mode was significant(F=18.214,P<0.001,η2=0.565);(2)The response time of hand-touch control was the shortest,while the response time of eye movement control was the longest.The main effect of interaction mode was significant(F=153.085,P<0.001,η2=0.944);(3)The fusion calculation time for hand-touch control was the shortest,while the fusion calculation time for voice control was the longest.The main effect of the interaction mode was significant(F=41.702,P<0.001,η2=0.777);(4)The errors in voice control were the least,while those in eye movement control were the most.The main effect of interaction mode was significant(χ2=22.845,P<0.001,φ=1.097);(5)The subjective evaluation scores of pilots on voice control were higher than those on eye movement control,and all had statistical significance(P<0.001,P<0.01).Conclusions This study focuses on flight interaction tasks and compares the interaction efficiency of three interaction modes of hand-touch control,voice control,and eye movement control,through a combination of experiments and subjective evaluations.The differences in various interaction efficiency indicators among different interaction modes are found,and the interaction modes have a significant impact on interaction efficiency.Hand-touch control has a significant advantage in interaction time efficiency,voice control has an advantage in accuracy for simple tasks,while eye movement control has relatively weak time efficiency and accuracy;Compared to eye movement control,pilots exhibit higher evaluations and tendencies towards voice control.The research results can provide reference for the future design,evaluation,and application of multi-modal interaction systems.
