TY - JOUR
T1 - COVID-19 mortality risk assessment
T2 - An international multi-center study
AU - Hellenic COVID-19 Study Group
AU - Bertsimas, Dimitris
AU - Lukin, Galit
AU - Mingardi, Luca
AU - Nohadani, Omid
AU - Orfanoudaki, Agni
AU - Stellato, Bartolomeo
AU - Wiberg, Holly
AU - Gonzalez-Garcia, Sara
AU - Parra-Calderón, Carlos Luis
AU - Robinson, Kenneth
AU - Schneider, Michelle
AU - Stein, Barry
AU - Estirado, Alberto
AU - Beccara, Lia A.
AU - Canino, Rosario
AU - Bello, Martina Dal
AU - Pezzetti, Federica
AU - Pan, Angelo
AU - Akinosoglou, Karolina
AU - Antoniadou, Anastasia
AU - Argyraki, Katerina
AU - Dalekos, George N.
AU - Gaga, Mina
AU - Gatselis, Nikolaos K.
AU - Gogos, Charalambos
AU - Kalomenidis, Ioannis
AU - Kranidioti, Eleftheria
AU - Korompoki, Eleni
AU - Lourida, Giota
AU - Margellou, Evangelia
AU - Ntaios, Georgios
AU - Panagopoulos, Periklis
AU - Pefanis, Angelos
AU - Petrakis, Vasilis
AU - Psarrakis, Christos
AU - Sakka, Vissaria
AU - Thomas, Konstantinos
AU - Zervas, Eleftherios
N1 - Funding Information:
HW is supported by the National Science Foundation Graduate Research Fellowship under Grant No. 174530. Any opinion, findings, and conclusions or recommendations expressed in this material are those of the authors(s) and do not necessarily reflect the views of the National Science Foundation. This work was partially supported by a grant from c3.ai for COVID-19 related research; this organization played no role in the study design, data collection and analysis, decision to publish, or preparation of the manuscript. Benefits Science Technologies provided support in the form of salaries for ON, but did not have any additional role in the study design, data collection and analysis, decision to publish, or preparation of the manuscript. Hartford HealthCare provided support in the form of salaries for KN, MS, and BS, but did not have any additional role in the study design, data collection and analysis, decision to publish, or preparation of the manuscript. The specific roles of these authors are articulated in the ‘author contributions’ section. No further funding was provided for the study.
Publisher Copyright:
© 2020 Bertsimas et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
PY - 2020/12
Y1 - 2020/12
N2 - Timely identification of COVID-19 patients at high risk of mortality can significantly improve patient management and resource allocation within hospitals. This study seeks to develop and validate a data-driven personalized mortality risk calculator for hospitalized COVID-19 patients. De-identified data was obtained for 3,927 COVID-19 positive patients from six independent centers, comprising 33 different hospitals. Demographic, clinical, and laboratory variables were collected at hospital admission. The COVID-19 Mortality Risk (CMR) tool was developed using the XGBoost algorithm to predict mortality. Its discrimination performance was subsequently evaluated on three validation cohorts. The derivation cohort of 3,062 patients has an observed mortality rate of 26.84%. Increased age, decreased oxygen saturation (= 93%), elevated levels of C-reactive protein (= 130 mg/L), blood urea nitrogen (= 18 mg/dL), and blood creatinine (= 1.2 mg/dL) were identified as primary risk factors, validating clinical findings. The model obtains out-of-sample AUCs of 0.90 (95% CI, 0.87–0.94) on the derivation cohort. In the validation cohorts, the model obtains AUCs of 0.92 (95% CI, 0.88–0.95) on Seville patients, 0.87 (95% CI, 0.84–0.91) on Hellenic COVID-19 Study Group patients, and 0.81 (95% CI, 0.76–0.85) on Hartford Hospital patients. The CMR tool is available as an online application at covidanalytics.io/mortality_calculator and is currently in clinical use. The CMR model leverages machine learning to generate accurate mortality predictions using commonly available clinical features. This is the first risk score trained and validated on a cohort of COVID-19 patients from Europe and the United States.
AB - Timely identification of COVID-19 patients at high risk of mortality can significantly improve patient management and resource allocation within hospitals. This study seeks to develop and validate a data-driven personalized mortality risk calculator for hospitalized COVID-19 patients. De-identified data was obtained for 3,927 COVID-19 positive patients from six independent centers, comprising 33 different hospitals. Demographic, clinical, and laboratory variables were collected at hospital admission. The COVID-19 Mortality Risk (CMR) tool was developed using the XGBoost algorithm to predict mortality. Its discrimination performance was subsequently evaluated on three validation cohorts. The derivation cohort of 3,062 patients has an observed mortality rate of 26.84%. Increased age, decreased oxygen saturation (= 93%), elevated levels of C-reactive protein (= 130 mg/L), blood urea nitrogen (= 18 mg/dL), and blood creatinine (= 1.2 mg/dL) were identified as primary risk factors, validating clinical findings. The model obtains out-of-sample AUCs of 0.90 (95% CI, 0.87–0.94) on the derivation cohort. In the validation cohorts, the model obtains AUCs of 0.92 (95% CI, 0.88–0.95) on Seville patients, 0.87 (95% CI, 0.84–0.91) on Hellenic COVID-19 Study Group patients, and 0.81 (95% CI, 0.76–0.85) on Hartford Hospital patients. The CMR tool is available as an online application at covidanalytics.io/mortality_calculator and is currently in clinical use. The CMR model leverages machine learning to generate accurate mortality predictions using commonly available clinical features. This is the first risk score trained and validated on a cohort of COVID-19 patients from Europe and the United States.
UR - http://www.scopus.com/inward/record.url?scp=85097815383&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85097815383&partnerID=8YFLogxK
U2 - 10.1371/journal.pone.0243262
DO - 10.1371/journal.pone.0243262
M3 - Article
C2 - 33296405
AN - SCOPUS:85097815383
SN - 1932-6203
VL - 15
JO - PloS one
JF - PloS one
IS - 12 December
M1 - e0243262
ER -