- Open Access
External validation of a prediction model for CPAP failure in COVID-19 patients with severe pneumonitis
Critical Care volume 26, Article number: 293 (2022)
Continuous positive airway pressure (CPAP) has been widely used as an intervention to attempt to avoid mechanical ventilation in patients with coronavirus disease 2019 (COVID-19) .
Whilst CPAP can be a useful tool, it is recognised that there are a group of patients for whom this treatment is ineffective . Arina et al. demonstrated that critical care admission biomarkers such as CRP and NT-proBNP may identify patients in whom CPAP is likely to fail (resulting in invasive mechanical ventilation (IMV) or death) . We used routinely collected healthcare records of COVID-19 patients treated on the intensive care unit (ICU) at Manchester Royal Infirmary to independently validate their findings. We assessed their model using a sub-cohort treated at the time the model was developed (prior to the introduction of dexamethasone as a routine treatment, 15 June 2020) and also using our entire cohort of patients (1 March 2020 to 31 October 2021) . Supplementary results are available in Additional file 1.
Our entire cohort included 336 patients with confirmed COVID pneumonitis, of whom 215 received at least six hours of CPAP in a 24-h window. 148 (69%) were CPAP failures. For model validation, there were 148 patients with sufficient data of whom 103 (70%) were CPAP failures. In the sub-cohort, there were 32 patients (24 (75%) failures). Additional file 1: Table S1 summarises the patient demographics.
We compared variables measured on ICU admission in CPAP successes and failures and found significant differences in CRP (p = 0.001), troponin T (p = 0.046), D-Dimer (p < 0.001), and age (p < 0.001). There was no significant difference in NT-proBNP (p = 0.190) or highest respiratory rate in the first 24 h of ICU admission (p = 0.417). Figure 1 summarises the difference in biomarkers across the whole cohort, and Additional file 1: Fig. S1 shows the differences in the sub-cohort.
In our sub-cohort, the model proposed by Arina had an AUC = 0.839. Calibration was acceptable although we observed a slightly higher failure rate than expected (Additional file 1: Fig. S2). The model performed poorly when extended to our entire cohort (AUC = 0.613). Our results suggest that although there is a simple biomarker-based model to predict CPAP failure in ICU patients in the early stages of the COVID-19 pandemic, it is unlikely to be helpful now. Later models have sought to predict CPAP failure by including variables which describe patients’ work of breathing .
Since the beginning of the pandemic, a range of factors have modified the course of the disease including vaccination, drug treatments and improved clinical experience. Disease-modifying agents used to treat COVID-19 deserve particular attention and may partly explain why predictive models based on markers of generalised inflammation now perform poorly. Further work is needed to characterise how predictors of CPAP failure in COVID-19 have changed over time. Understanding which patients now have a higher likelihood of CPAP failure may help focus resources and direct preparedness in planning for CPAP failure in this cohort. Further studies to understand the timing and role for mechanical ventilation in this group may assist in further improvements in the management of these challenging patients.
Availability of data and materials
Bertaina M, et al. Non-invasive ventilation for SARS-CoV-2 acute respiratory failure: a subanalysis from the HOPE COVID-19 registry. Emerg Med J. 2021;38(5):359–65. https://doi.org/10.1136/EMERMED-2020-210411.
A. Ashish et al., “CPAP management of COVID-19 respiratory failure: A first quantitative analysis from an inpatient service evaluation,” BMJ Open Respir. Res., vol. 7, no. 1, 2020, doi: https://doi.org/10.1136/bmjresp-2020-000692.
Arina P, Baso B, Moro V, Patel H, Ambler G. Discriminating between CPAP success and failure in COVID-19 patients with severe respiratory failure. Intensive Care Med. 2021;47:237–9. https://doi.org/10.1007/s00134-020-06304-y.
Horby P, et al. dexamethasone in hospitalized patients with Covid-19. N Engl J Med. 2021;384(8):693–704. https://doi.org/10.1056/nejmoa2021436.
Liu L, et al. A simple nomogram for predicting failure of non-invasive respiratory strategies in adults with COVID-19: a retrospective multicentre study. Artic Lancet Digit Heal. 2021;3:166–74. https://doi.org/10.1016/S2589-7500(20)30316-2.
The authors are grateful for the support of Mrs Cathie Forrest, ICNARC Data Manager and Dr Andrew Martin at Manchester Royal Infirmary. They would also like to express their thanks to Dr Pietro Arina, Prof Mervyn Singer and the wider University College London Critical Care COVID-19 Research Group.
Ethical approval consent to participate
Approval received from the Health Research Authority and Health and Care Research Wales (Rec Ref: 21/HRA/3518 and IRAS 300156) on 2 September 2021.
On behalf of all authors, the corresponding author states that there are no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Stokes, V., Goh, K.Y., Whiting, G. et al. External validation of a prediction model for CPAP failure in COVID-19 patients with severe pneumonitis. Crit Care 26, 293 (2022). https://doi.org/10.1186/s13054-022-04144-4