Application value of generative artificial intelligence in the field of stomatology
10.7518/hxkq.2024.2024144
- VernacularTitle:生成式人工智能在口腔医学领域应用价值的比较研究
- Author:
Yuanlong YE
1
;
Wei ZENG
;
Jinlong CHEN
;
Lei LIU
Author Information
1. 口腔疾病防治全国重点实验室 国家口腔医学中心 国家口腔疾病临床医学研究中心四川大学华西口腔医院创伤与整形外科,成都 610041
- Keywords:
generative artificial intelligence;
Gemini;
ERNIE Bot;
ChatGPT;
stomatology
- From:
West China Journal of Stomatology
2024;42(6):810-815
- CountryChina
- Language:Chinese
-
Abstract:
Objective This study aims to compare and analyze three types of generative artificial intelligence(GAI)and explore their application value and existing problems in the field of stomatology in the Chinese context.Methods A total of 36 questions were designed,covering all the professional areas of stomatology.The questions encompassed various aspects including medical records,professional knowledge,and translation and editing.These questions were submitted to ChatGPT4-turbo,Gemini(2024.2)and ERNIE Bot 4.0.After obtaining the answers,a blinded evaluation was conducted by three experienced oral medicine physicians using a four-point Likert scale.The value of GAI in vari-ous application scenarios was evaluated.Results Gemi-ni scored 45,ERNIE Bot scored 38,and ChatGPT scored 33 for clinical documentation and image production.For research assistance,Gemini achieved 45,ERNIE Bot had 39,and ChatGPT scored 35.Teaching assistance capabilities were rated at 54 for ERNIE Bot,50 for Gemini,and 48 for ChatGPT.In patient consultation and guidance,Gemini scored 78,ERNIE Bot scored 59,and ChatGPT scored 48.Over-all,the total scores were 218,190,and 164 for Gemini,ERNIE Bot,and ChatGPT,respectively.Among GAI applica-tions,the top scoring categories were article translation and polishing(26),patient-doctor communication documentation(23),and popular science content creation(23).The lowest scoring categories were literature search and reporting(13)and image generation(12).Conclusion In the Chinese context,the application value of GAI is the highest for Gemini,followed by ERNIE Bot and ChatGPT.GAI shows significant value in translation,patient-doctor communication,and popular science writing.However,its value in literature search,reporting,and image generation remains limited.
