Decision tree-enabled establishment and validation of intelligent verification rules for blood analysis results
10.3760/cma.j.cn114452-20240219-00079
- VernacularTitle:决策树赋能的血液分析结果智能审核规则的建立与验证
- Author:
Linlin QU
1
;
Xu ZHAO
;
Liang HE
;
Yehui TAN
;
Yingtong LI
;
Xianqiu CHEN
;
Zongxing YANG
;
Yue CAI
;
Beiying AN
;
Dan LI
;
Jin LIANG
;
Bing HE
;
Qiuwen SUN
;
Yibo ZHANG
;
Xin LYU
;
Shibo XIONG
;
Wei XU
Author Information
1. 吉林大学第一医院检验科，长春 130021
- Keywords:
Hematologic tests;
Blood analysis;
Artificial intelligence;
Verification rules;
Decision tree
- From:
Chinese Journal of Laboratory Medicine
2024;47(5):536-542
- CountryChina
- Language:Chinese
-
Abstract:
Objective:To establish a set of artificial intelligence (AI) verification rules for blood routine analysis.Methods:Blood routine analysis data of 18 474 hospitalized patients from the First Hospital of Jilin University during August 1st to 31st, 2019, were collected as training group for establishment of the AI verification rules,and the corresponding patient age, microscopic examination results, and clinical diagnosis information were collected. 92 laboratory parameters, including blood analysis report parameters, research parameters and alarm information, were used as candidate conditions for AI audit rules; manual verification combining microscopy was considered as standard, marked whether it was passed or blocked. Using decision tree algorithm, AI audit rules are initially established through high-intensity, multi-round and five-fold cross-validation and AI verification rules were optimized by setting important mandatory cases. The performance of AI verification rules was evaluated by comparing the false negative rate, precision rate, recall rate, F1 score, and pass rate with that of the current autoverification rules using Chi-square test. Another cohort of blood routine analysis data of 12 475 hospitalized patients in the First Hospital of Jilin University during November 1sr to 31st, 2023, were collected as validation group for validation of AI verification rules, which underwent simulated verification via the preliminary AI rules, thus performance of AI rules were analyzed by the above indicators. Results:AI verification rules consist of 15 rules and 17 parameters and do distinguish numeric and morphological abnormalities. Compared with auto-verification rules, the true positive rate, the false positive rate, the true negative rate, the false negative rate, the pass rate, the accuracy, the precision rate, the recall rate and F1 score of AI rules in training group were 22.7%, 1.6%, 74.5%, 1.3%, 75.7%, 97.2%, 93.5%, 94.7%, 94.1, respectively.All of them were better than auto-verification rules, and the difference was statistically significant ( P<0.001), and with no important case missed. In validation group, the true positive rate, the false positive rate, the true negative rate, the false negative rate, the pass rate, the accuracy, the precision rate, the recall rate and F1 score were 19.2%, 8.2%, 70.1%, 2.5%, 72.6%, 89.2%, 70.0%, 88.3%, 78.1, respectively, Compared with the auto-verification rules, The false negative rate was lower, the false positive rate and the recall rate were slightly higher, and the difference was statistically significant ( P<0.001). Conclusion:A set of the AI verification rules are established and verified by using decision tree algorithm of machine learning, which can identify, intercept and prompt abnormal results stably, and is moresimple, highly efficient and more accurate in the report of blood analysis test results compared with auto-vefication.
