External validation of a prediction model for CPAP failure in COVID-19 patients with severe pneumonitis
Critical Care volume 26, Article number: 293 (2022)
Continuous positive airway pressure (CPAP) has been widely used as an intervention to attempt to avoid mechanical ventilation in patients with coronavirus disease 2019 (COVID-19) .
Whilst CPAP can be a useful tool, it is recognised that there are a group of patients for whom this treatment is ineffective . Arina et al. demonstrated that critical care admission biomarkers such as CRP and NT-proBNP may identify patients in whom CPAP is likely to fail (resulting in invasive mechanical ventilation (IMV) or death) . We used routinely collected healthcare records of COVID-19 patients treated on the intensive care unit (ICU) at Manchester Royal Infirmary to independently validate their findings. We assessed their model using a sub-cohort treated at the time the model was developed (prior to the introduction of dexamethasone as a routine treatment, 15 June 2020) and also using our entire cohort of patients (1 March 2020 to 31 October 2021) . Supplementary results are available in Additional file 1.
Our entire cohort included 336 patients with confirmed COVID pneumonitis, of whom 215 received at least six hours of CPAP in a 24-h window. 148 (69%) were CPAP failures. For model validation, there were 148 patients with sufficient data of whom 103 (70%) were CPAP failures. In the sub-cohort, there were 32 patients (24 (75%) failures). Additional file 1: Table S1 summarises the patient demographics.
We compared variables measured on ICU admission in CPAP successes and failures and found significant differences in CRP (p = 0.001), troponin T (p = 0.046), D-Dimer (p < 0.001), and age (p < 0.001). There was no significant difference in NT-proBNP (p = 0.190) or highest respiratory rate in the first 24 h of ICU admission (p = 0.417). Figure 1 summarises the difference in biomarkers across the whole cohort, and Additional file 1: Fig. S1 shows the differences in the sub-cohort.
In our sub-cohort, the model proposed by Arina had an AUC = 0.839. Calibration was acceptable although we observed a slightly higher failure rate than expected (Additional file 1: Fig. S2). The model performed poorly when extended to our entire cohort (AUC = 0.613). Our results suggest that although there is a simple biomarker-based model to predict CPAP failure in ICU patients in the early stages of the COVID-19 pandemic, it is unlikely to be helpful now. Later models have sought to predict CPAP failure by including variables which describe patients’ work of breathing .
Since the beginning of the pandemic, a range of factors have modified the course of the disease including vaccination, drug treatments and improved clinical experience. Disease-modifying agents used to treat COVID-19 deserve particular attention and may partly explain why predictive models based on markers of generalised inflammation now perform poorly. Further work is needed to characterise how predictors of CPAP failure in COVID-19 have changed over time. Understanding which patients now have a higher likelihood of CPAP failure may help focus resources and direct preparedness in planning for CPAP failure in this cohort. Further studies to understand the timing and role for mechanical ventilation in this group may assist in further improvements in the management of these challenging patients.
Availability of data and materials
Bertaina M, et al. Non-invasive ventilation for SARS-CoV-2 acute respiratory failure: a subanalysis from the HOPE COVID-19 registry. Emerg Med J. 2021;38(5):359–65. https://doi.org/10.1136/EMERMED-2020-210411.
A. Ashish et al., “CPAP management of COVID-19 respiratory failure: A first quantitative analysis from an inpatient service evaluation,” BMJ Open Respir. Res., vol. 7, no. 1, 2020, doi: https://doi.org/10.1136/bmjresp-2020-000692.
Arina P, Baso B, Moro V, Patel H, Ambler G. Discriminating between CPAP success and failure in COVID-19 patients with severe respiratory failure. Intensive Care Med. 2021;47:237–9. https://doi.org/10.1007/s00134-020-06304-y.
Horby P, et al. dexamethasone in hospitalized patients with Covid-19. N Engl J Med. 2021;384(8):693–704. https://doi.org/10.1056/nejmoa2021436.
Liu L, et al. A simple nomogram for predicting failure of non-invasive respiratory strategies in adults with COVID-19: a retrospective multicentre study. Artic Lancet Digit Heal. 2021;3:166–74. https://doi.org/10.1016/S2589-7500(20)30316-2.
The authors are grateful for the support of Mrs Cathie Forrest, ICNARC Data Manager and Dr Andrew Martin at Manchester Royal Infirmary. They would also like to express their thanks to Dr Pietro Arina, Prof Mervyn Singer and the wider University College London Critical Care COVID-19 Research Group.
Ethical approval consent to participate
Approval received from the Health Research Authority and Health and Care Research Wales (Rec Ref: 21/HRA/3518 and IRAS 300156) on 2 September 2021.
On behalf of all authors, the corresponding author states that there are no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Stokes, V., Goh, K.Y., Whiting, G. et al. External validation of a prediction model for CPAP failure in COVID-19 patients with severe pneumonitis. Crit Care 26, 293 (2022). https://doi.org/10.1186/s13054-022-04144-4