TY - JOUR
T1 - Interpretable Machine Learning Model for Early Prediction of Mortality in ICU Patients with Rhabdomyolysis
AU - Liu, Chao
AU - Liu, Xiaoli
AU - Mao, Zhi
AU - Hu, Pan
AU - Li, Xiaoming
AU - Hu, Jie
AU - Hong, Quan
AU - Geng, Xiaodong
AU - Chi, Kun
AU - Zhou, Feihu
AU - Cai, Guangyan
AU - Chen, Xiangmei
AU - Sun, Xuefeng
N1 - Publisher Copyright:
© Lippincott Williams & Wilkins.
PY - 2021
Y1 - 2021
N2 - Purpose Rhabdomyolysis (RM) is a complex set of clinical syndromes that involves the rapid dissolution of skeletal muscles. Mortality from RM is approximately 10%. This study aimed to develop an interpretable and generalizable model for early mortality prediction in RM patients. Method Retrospective analyses were performed on two electronic medical record databases: the eICU Collaborative Research Database and the Medical Information Mart for Intensive Care III database. We extracted data from the first 24 h after patient ICU admission. Data from the two data sets were merged for further analysis. The merged data sets were randomly divided, with 70% used for training and 30% for validation. We used the machine learning model extreme gradient boosting (XGBoost) with the Shapley additive explanation method to conduct early and interpretable predictions of patient mortality. Five typical evaluation indexes were adopted to develop a generalizable model. Results In total, 938 patients with RM were eligible for this analysis. The area under the receiver operating characteristic curve (AUC) of the XGBoost model in predicting hospital mortality was 0.871, the sensitivity was 0.885, the specificity was 0.816, the accuracy was 0.915, and the F1 score was 0.624. The XGBoost model performance was superior to that of other models (logistic regression, AUC = 0.862; support vector machine, AUC = 0.843; random forest, AUC = 0.825; and naive Bayesian, AUC = 0.805) and clinical scores (Sequential Organ Failure Assessment, AUC = 0.747; Acute Physiology Score III, AUC = 0.721). Conclusions Although the XGBoost model is still not great from an absolute performance perspective, it provides better predictive performance than other models for estimating the mortality of patients with RM based on patient characteristics in the first 24 h of admission to the ICU.
AB - Purpose Rhabdomyolysis (RM) is a complex set of clinical syndromes that involves the rapid dissolution of skeletal muscles. Mortality from RM is approximately 10%. This study aimed to develop an interpretable and generalizable model for early mortality prediction in RM patients. Method Retrospective analyses were performed on two electronic medical record databases: the eICU Collaborative Research Database and the Medical Information Mart for Intensive Care III database. We extracted data from the first 24 h after patient ICU admission. Data from the two data sets were merged for further analysis. The merged data sets were randomly divided, with 70% used for training and 30% for validation. We used the machine learning model extreme gradient boosting (XGBoost) with the Shapley additive explanation method to conduct early and interpretable predictions of patient mortality. Five typical evaluation indexes were adopted to develop a generalizable model. Results In total, 938 patients with RM were eligible for this analysis. The area under the receiver operating characteristic curve (AUC) of the XGBoost model in predicting hospital mortality was 0.871, the sensitivity was 0.885, the specificity was 0.816, the accuracy was 0.915, and the F1 score was 0.624. The XGBoost model performance was superior to that of other models (logistic regression, AUC = 0.862; support vector machine, AUC = 0.843; random forest, AUC = 0.825; and naive Bayesian, AUC = 0.805) and clinical scores (Sequential Organ Failure Assessment, AUC = 0.747; Acute Physiology Score III, AUC = 0.721). Conclusions Although the XGBoost model is still not great from an absolute performance perspective, it provides better predictive performance than other models for estimating the mortality of patients with RM based on patient characteristics in the first 24 h of admission to the ICU.
KW - eICU-CRD
KW - MIMIC-III
KW - MORTALITY
KW - RHABDOMYOLYSIS
KW - XGBoost
UR - https://www.scopus.com/pages/publications/85113164639
U2 - 10.1249/MSS.0000000000002674
DO - 10.1249/MSS.0000000000002674
M3 - 文章
C2 - 33787533
AN - SCOPUS:85113164639
SN - 0195-9131
VL - 53
SP - 1826
EP - 1834
JO - Medicine and Science in Sports and Exercise
JF - Medicine and Science in Sports and Exercise
IS - 9
ER -