Skip to main content

External validation of a prediction model for CPAP failure in COVID-19 patients with severe pneumonitis

Dear Editor,

Continuous positive airway pressure (CPAP) has been widely used as an intervention to attempt to avoid mechanical ventilation in patients with coronavirus disease 2019 (COVID-19) [1].

Whilst CPAP can be a useful tool, it is recognised that there are a group of patients for whom this treatment is ineffective [2]. Arina et al. demonstrated that critical care admission biomarkers such as CRP and NT-proBNP may identify patients in whom CPAP is likely to fail (resulting in invasive mechanical ventilation (IMV) or death) [3]. We used routinely collected healthcare records of COVID-19 patients treated on the intensive care unit (ICU) at Manchester Royal Infirmary to independently validate their findings. We assessed their model using a sub-cohort treated at the time the model was developed (prior to the introduction of dexamethasone as a routine treatment, 15 June 2020) and also using our entire cohort of patients (1 March 2020 to 31 October 2021) [4]. Supplementary results are available in Additional file 1.

Our entire cohort included 336 patients with confirmed COVID pneumonitis, of whom 215 received at least six hours of CPAP in a 24-h window. 148 (69%) were CPAP failures. For model validation, there were 148 patients with sufficient data of whom 103 (70%) were CPAP failures. In the sub-cohort, there were 32 patients (24 (75%) failures). Additional file 1: Table S1 summarises the patient demographics.

We compared variables measured on ICU admission in CPAP successes and failures and found significant differences in CRP (p = 0.001), troponin T (p = 0.046), D-Dimer (p < 0.001), and age (p < 0.001). There was no significant difference in NT-proBNP (p = 0.190) or highest respiratory rate in the first 24 h of ICU admission (p = 0.417). Figure 1 summarises the difference in biomarkers across the whole cohort, and Additional file 1: Fig. S1 shows the differences in the sub-cohort.

Fig. 1
figure 1

Biomarkers and variables recorded in the COVID population on ICU admission in patients receiving CPAP. NT-proBNP N-terminal pro-B-type natriuretic peptide

In our sub-cohort, the model proposed by Arina had an AUC = 0.839. Calibration was acceptable although we observed a slightly higher failure rate than expected (Additional file 1: Fig. S2). The model performed poorly when extended to our entire cohort (AUC = 0.613). Our results suggest that although there is a simple biomarker-based model to predict CPAP failure in ICU patients in the early stages of the COVID-19 pandemic, it is unlikely to be helpful now. Later models have sought to predict CPAP failure by including variables which describe patients’ work of breathing [5].

Since the beginning of the pandemic, a range of factors have modified the course of the disease including vaccination, drug treatments and improved clinical experience. Disease-modifying agents used to treat COVID-19 deserve particular attention and may partly explain why predictive models based on markers of generalised inflammation now perform poorly. Further work is needed to characterise how predictors of CPAP failure in COVID-19 have changed over time. Understanding which patients now have a higher likelihood of CPAP failure may help focus resources and direct preparedness in planning for CPAP failure in this cohort. Further studies to understand the timing and role for mechanical ventilation in this group may assist in further improvements in the management of these challenging patients.

Availability of data and materials

Not applicable.


  1. Bertaina M, et al. Non-invasive ventilation for SARS-CoV-2 acute respiratory failure: a subanalysis from the HOPE COVID-19 registry. Emerg Med J. 2021;38(5):359–65.

    Article  PubMed  Google Scholar 

  2. A. Ashish et al., “CPAP management of COVID-19 respiratory failure: A first quantitative analysis from an inpatient service evaluation,” BMJ Open Respir. Res., vol. 7, no. 1, 2020, doi:

  3. Arina P, Baso B, Moro V, Patel H, Ambler G. Discriminating between CPAP success and failure in COVID-19 patients with severe respiratory failure. Intensive Care Med. 2021;47:237–9.

    Article  CAS  PubMed  Google Scholar 

  4. Horby P, et al. dexamethasone in hospitalized patients with Covid-19. N Engl J Med. 2021;384(8):693–704.

    Article  CAS  PubMed  Google Scholar 

  5. Liu L, et al. A simple nomogram for predicting failure of non-invasive respiratory strategies in adults with COVID-19: a retrospective multicentre study. Artic Lancet Digit Heal. 2021;3:166–74.

    Article  Google Scholar 

Download references


The authors are grateful for the support of Mrs Cathie Forrest, ICNARC Data Manager and Dr Andrew Martin at Manchester Royal Infirmary. They would also like to express their thanks to Dr Pietro Arina, Prof Mervyn Singer and the wider University College London Critical Care COVID-19 Research Group.


Not applicable.

Author information

Authors and Affiliations



VS, KG, GW and HG collected data. SB performed statistical analysis and prepared all figures. VS, SB, AW and AP wrote the main manuscript text. VS, SB, AW and AJP reviewed the manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Victoria Stokes.

Ethics declarations

Ethical approval consent to participate

Approval received from the Health Research Authority and Health and Care Research Wales (Rec Ref: 21/HRA/3518 and IRAS 300156) on 2 September 2021.

Competing interests

On behalf of all authors, the corresponding author states that there are no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1.

Supplementary figures and tables.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit The Creative Commons Public Domain Dedication waiver ( applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Stokes, V., Goh, K.Y., Whiting, G. et al. External validation of a prediction model for CPAP failure in COVID-19 patients with severe pneumonitis. Crit Care 26, 293 (2022).

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: