- Research Letter
- Open access
- Published:
Machine learning to predict hemorrhage and thrombosis during extracorporeal membrane oxygenation
Critical Care volume 24, Article number: 689 (2020)
Hemorrhage and thrombosis are major causes of morbidity and mortality during extracorporeal membrane oxygenation (ECMO). Even in a controlled setting, bleeding occurs frequently—almost half (46%) of the patients randomized to ECMO in the EOLIA trial had hemorrhage requiring transfusion [1]. The pathophysiology of these complications during ECMO is complex, dynamic and not fully understood [2]. This may explain why standard approaches to monitor coagulation are imperfect and studies that employ traditional biostatistical methods do not consistently identify common risk factors. We applied machine learning to an ECMO dataset to predict hemorrhage and thrombosis. Our hypothesis was that machine learning would accurately predict these events and identify novel factors not anticipated clinically or identified by traditional biostatistical methods.
We used a preexisting, manually extracted, adult ECMO dataset established to study anticoagulation practices and ECMO complications [3]. The dataset was first cleaned. Data were condensed to one row per patient. The mean and range were used to create new variables from continuous variables. Categorical variables were encoded as binary variables using one-hot encoding. Missingness was handled by first dropping variables’ missing values for all patients. Some missing data were recovered by reviewing the electronic health record. Seven variables were dropped to limit the potential of reverse causation artificially enhancing outcome prediction. Remaining variables still missing values (thromboelastography, anti-factor Xa levels) were dropped. Hemorrhage was defined as bleeding during ECMO requiring a transfusion and/or intervention, thrombosis as deep vein thrombosis, pulmonary embolism, ischemic stroke during or following ECMO, or ECMO circuitry change.
The study cohort included 44 consecutive patients supported with ECMO. The average age was 42Â years; 66% were men. The most common indication for ECMO was acute respiratory distress syndrome (59%), and 66% were supported with veno-venous ECMO. There were a total of 19 hemorrhage events, most commonly cannulation site bleeding (42%), and 16 thrombotic events, most commonly deep vein thrombosis (81%).
We compared chi-square to five supervised classification and regression machine learning models: random forest, recursive feature elimination, decision trees, k-nearest neighbors and logistic regression. Leave-one-out cross-validation maximized the training cohort size, which allowed each patient to be used to train and test the models to minimize sample bias [4]. The models to predict hemorrhage performed better (accuracy of 58–80%) than the models for thrombosis (40–64%) (Fig. 1).
An ablation analysis ranked variables by importance to the model’s performance [5]. The rank lists for the random forest model differed from that of the chi-square model (Table 1). As expected, anticoagulation monitoring assays were most important in the chi-square model and the rank lists were identical for both outcomes. For the random forest model, the variables were more varied and included ECMO indications, cannulation strategies and duration. Rank lists for the random forest model differed between the two outcomes and could not be anticipated based on clinical intuition alone (e.g., race, body mass index, indication). These observations demonstrate an advantage of machine learning in its capacity to measure the correlations between combinations of variables and the outcome rather than correlation between the variable and outcome alone.
This is the first time machine learning has been applied to predict ECMO complications. The decision tree model predicted hemorrhage with promising accuracy despite the small sample size. A larger dataset would allow the use of deep learning models to potentially improve performance and validate our current models. Similar analyses using traditional biostatistical methods are infeasible. Machine learning provides an unbiased, robust and automated approach to handle and process the volume and variety of data generated by the provision of ECMO in order to elucidate factors that contribute to ECMO complications.
Availability of data and materials
Please contact the corresponding author to request the data.
Reference
Combes A, Hajage D, Capellier G, Demoule A, Lavoue S, Guervilly C, et al. Extracorporeal membrane oxygenation for severe acute respiratory distress syndrome. N Engl J Med. 2018;378(21):1965–75.
Annich GM. Extracorporeal life support: the precarious balance of hemostasis. J Thromb Haemost. 2015;13 Suppl 1:S336–42.
Chu DC, Abu-Samra AG, Baird GL, Devers C, Sweeney J, Levy MM, et al. Quantitative measurement of heparin in comparison with conventional anticoagulation monitoring and the risk of thrombotic events in adults on extracorporeal membrane oxygenation. Intensive Care Med. 2015;41(2):369–70.
Molinaro AM, Simon R, Pfeiffer RM. Prediction error estimation: a comparison of resampling methods. Bioinformatics. 2005;21(15):3301–7.
Fawcett C, Hoos HH. Analysing differences between algorithm configurations through ablation. J Heuristics. 2013;22:431–58.
Acknowledgements
The authors would like to thank Cynthia Devers for her contribution to this study.
Funding
This study was supported by HL134625 (A.A.) and HL141268 (C.E.V.).
Author information
Authors and Affiliations
Contributions
A.A and C.E.V wrote the IRB protocol. A.A., N.S., C.E. and C.E.V designed the study. A.A and Y.K conducted the data entry and cleaning. A.A., Y.K., C.L., C.E. and C.E.V conducted the data analysis and interpretation. A.A., C.E., and C.E.V drafted the manuscript, and all authors contributed to revisions of the manuscript and approved the final draft. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
The study was approved by our Institutional Review Board (IRB #413818). The study includes deidentified data; the IRB issued a waiver of informed consent (45 CFR 46.116).
Consent for publication
Yes.
Competing interests
Dr. Ventetuolo reports serving as a prior consultant for Acceleron Pharma and Maquet Cardiovascular and grants to her institution from United Therapeutics and Eiger for the conduct of research and a clinical trial, respectively. The remaining authors have no competing interests to disclose.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Abbasi, A., Karasu, Y., Li, C. et al. Machine learning to predict hemorrhage and thrombosis during extracorporeal membrane oxygenation. Crit Care 24, 689 (2020). https://doi.org/10.1186/s13054-020-03403-6
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s13054-020-03403-6