Skip to main content

Oxygenation thresholds for invasive ventilation in hypoxemic respiratory failure: a target trial emulation in two cohorts

Abstract

Background

The optimal thresholds for the initiation of invasive ventilation in patients with hypoxemic respiratory failure are unknown. Using the saturation-to-inspired oxygen ratio (SF), we compared lower versus higher hypoxemia severity thresholds for initiating invasive ventilation.

Methods

This target trial emulation included patients from the Medical Information Mart for Intensive Care (MIMIC-IV, 2008–2019) and the Amsterdam University Medical Centers (AmsterdamUMCdb, 2003–2016) databases admitted to intensive care and receiving inspired oxygen fraction ≥ 0.4 via non-rebreather mask, noninvasive ventilation, or high-flow nasal cannula. We compared the effect of using invasive ventilation initiation thresholds of SF < 110, < 98, and < 88 on 28-day mortality. MIMIC-IV was used for the primary analysis and AmsterdamUMCdb for the secondary analysis. We obtained posterior means and 95% credible intervals (CrI) with nonparametric Bayesian G-computation.

Results

We studied 3,357 patients in the primary analysis. For invasive ventilation initiation thresholds SF < 110, SF < 98, and SF < 88, the predicted 28-day probabilities of invasive ventilation were 72%, 47%, and 19%. Predicted 28-day mortality was lowest with threshold SF < 110 (22.2%, CrI 19.2 to 25.0), compared to SF < 98 (absolute risk increase 1.6%, CrI 0.6 to 2.6) or SF < 88 (absolute risk increase 3.5%, CrI 1.4 to 5.4). In the secondary analysis (1,279 patients), the predicted 28-day probability of invasive ventilation was 50% for initiation threshold SF < 110, 28% for SF < 98, and 19% for SF < 88. In contrast with the primary analysis, predicted mortality was highest with threshold SF < 110 (14.6%, CrI 7.7 to 22.3), compared to SF < 98 (absolute risk decrease 0.5%, CrI 0.0 to 0.9) or SF < 88 (absolute risk decrease 1.9%, CrI 0.9 to 2.8).

Conclusion

Initiating invasive ventilation at lower hypoxemia severity will increase the rate of invasive ventilation, but this can either increase or decrease the expected mortality, with the direction of effect likely depending on baseline mortality risk and clinical context.

Background

Acute hypoxemic respiratory failure affects 20–50% of patients admitted to an intensive care unit (ICU) [1,2,3]. Affected patients have a 20–40% mortality risk and survivors may experience decreased quality of life [1, 4,5,6]. Invasive ventilation is a potentially lifesaving intervention that restores compensated gas exchange [7, 8]. However, invasive ventilation exposes patients to the risks of peri-intubation cardiac arrest, ventilator-induced lung injury, pneumonia, delirium, and ICU-acquired weakness [9,10,11,12,13]. The best physiologic thresholds for the initiation of invasive ventilation are unknown [8].

Current practice varies. In qualitative research, clinicians factor multiple variables such as the degree of hypoxemia, work of breathing, and experience of the team into their decision for invasive ventilation [14, 15]. Randomized trials use multiple criteria incorporating hemodynamics, neurologic function, and respiratory status [16]. Observational cohorts show a low incidence of invasive ventilation after meeting various physiologic thresholds, including those used in trials [17], and profound inter-hospital variation in the use of invasive ventilation [18, 19]. Some of the observed practice patterns may cause harm through either overuse or delay in the initiation of invasive ventilation.

Relevant potential thresholds include the degree of hypoxemia, the criteria used in randomized trials, and thresholds that incorporate work of breathing, duration of respiratory failure, or clinical trajectory [20,21,22,23]. A randomized controlled trial would be the most robust design to compare outcomes according to threshold, but this trial is not feasible at present due to disagreement on the region of equipoise and uncertainty about which thresholds to test [24]. A target trial emulation is an observational study design for causal inference which strives to mirror the eligibility criteria and interventions of the corresponding randomized trial, when that trial cannot be easily performed [25, 26]. Using the saturation-to-inspired oxygen ratio (SF), we performed a target trial emulation to compare the effect of using invasive ventilation initiation thresholds of SF < 110, < 98, and < 88 on 28-day mortality.

Methods

Study design, setting, and oversight

This retrospective cohort study was structured as a target trial emulation (Additional file 1: Table e1). The study incorporated two deidentified patient-level databases of intensive care unit admissions: Medical Information Mart for Intensive Care IV (MIMIC-IV) [27, 29] and the Amsterdam University Medical Centers database (AmsterdamUMCdb) [30, 31]. MIMIC-IV includes 76,540 ICU admissions from Beth Israel Deaconess Medical Centre (BIDMC) in Boston, USA (2008–2019), and AmsterdamUMCdb includes 23,106 ICU admissions from Amsterdam University Medical Centers (Amsterdam UMC) in Amsterdam, The Netherlands (2003–2016). MIMIC-IV included more patients and a more comprehensive set of potential confounders, so it was used for the primary analysis while AmsterdamUMCdb was used for the secondary analysis. The University of Toronto research ethics board approved the protocol (#42,081). The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) checklist is in the Additional file 1: (§1) [32].

Cohort

Patients became eligible when they were first documented to be receiving oxygen with inspired oxygen fraction (FiO2) of 0.4 or more via non-rebreather mask, noninvasive positive pressure ventilation (NIV), or high-flow nasal cannula (HFNC), within 24 h of ICU admission. We excluded patients with prior invasive ventilation during the same ICU admission, goals of care precluding invasive ventilation, ICU admission from the operating room, or a tracheostomy. Patients were also excluded when equipoise was less certain at the moment of eligibility, defined as a Glasgow Coma Scale (GCS) motor component of less than 4, or a partial pressure of carbon dioxide (pCO2) of 60 or more with pH of 7.20 or less [33]. Patients were not excluded if these characteristics developed during the follow-up period, after initial inclusion. Wherever oxygen flow was available but FiO2 was not (for example, non-rebreather masks), FiO2 was estimated using the validated equation: FiO2 = 0.21 + (oxygen flow in liters per minute)*0.03 [34]. Further details are available in Additional file 1: (§4, Table e2).

Variables

Baseline variables were demographics (age, sex, race/ethnicity), ICU admission information (type of ICU, year of ICU admission), comorbidities, and baseline laboratory, clinical, and procedural data (Additional file 1: Figure e1) Time-varying covariates included heart rate, systolic blood pressure, vasopressor use, respiratory rate, peripheral oxygen saturation, inspired oxygen fraction (FiO2), oxygen device, GCS, abnormal work of breathing, pH, lactate, and partial pressure of carbon dioxide. HFNC was not used at Amsterdam UMC during the years of available data. AmsterdamUMCdb also lacked patient race/ethnicity, comorbidities, and work of breathing. Cohort extraction used Google BigQuery and R (https://doi.org/10.5281/zenodo.7314132).(35).

Thresholds

The main analysis compared three thresholds for initiation of invasive ventilation: saturation-to-inspired oxygen ratio (SF) of < 110, < 98, and < 88. We chose the SF ratio because it is a simple yet accurate measure of hypoxemia that is applicable to acute care settings worldwide, and can be measured without causing pain or discomfort to patients [36, 37]. Lower SF values indicate more severe hypoxemia. The three target values correspond to steeper parts of the oxyhemoglobin dissociation curve at high inspired oxygen fractions: SF < 88 reflects a patient unable to maintain oxygen saturation 88% on FiO2 1.0; SF < 98 reflects a patient unable to maintain saturation 88% on FiO2 0.9 or saturation 98% on FiO2 1.0, and SF < 110 reflects a patient unable to maintain saturation 88% on FiO2 0.8 or saturation 98% on FiO2 0.9.

As an exploratory analysis, we included six physiologic thresholds from four other measures of hypoxemic respiratory failure: respiratory rate, work of breathing, hypoxemia duration, and hypoxemia trajectory (Additional file 1). Based on the thresholds used in randomized trials, we included two thresholds requiring multi-organ involvement. We also included a usual care threshold, where treatment was assigned using the time-varying probability of invasive ventilation from the confounder model (Additional file 1: §8.1).

We reported invasive ventilation use for all thresholds. Invasive ventilation occurred either after meeting a threshold during the 96-h target trial period, or in the course of usual care following the 96-h period. This meant that all thresholds were evaluated on all patients, and we anticipated higher rates of invasive ventilation for lower severity thresholds (such as SF < 110) because whenever a patient attained SF < 88 or SF < 98 (higher degrees of hypoxemia severity), they also had SF < 110.

Note that the choice of threshold does not impact each patient’s SF ratios. Instead, each patient is modeled to either (1) receive invasive ventilation at the moment at which their SF ratio drops below the threshold under evaluation or (2) not receive invasive ventilation during the target trial period, if they get to the end of the 96-h target trial period without having an SF ratio below the threshold in question (Fig. 1).

Fig. 1
figure 1

Oxygenation thresholds for initiating invasive ventilation. This figure explains how the saturation-to-inspired oxygen ratio (SF) threshold work. We begin with a patient on non-invasive oxygen support (left). Every threshold is tested on this patient (three gray arrows). The patient has the same underlying progression of SF ratios, independent of the choice of threshold (each line graph of SF versus time is identical). Top (SF < 110): At the first observation of SF < 110 (hour 4, red), the patient is intubated. Subsequent SF are not observed (grey), Middle (SF < 98 ): SF ≥98 until hour 12 (red), at which point the patient is intubated. Subsequent SF are not observed (grey). Bottom (SF < 88): SF ratio remains 88 or greater, so the patient remains on non-invasive oxygen support. All SF are observed

Observation schedule and follow-up

The thresholds were active until the earliest of invasive ventilation, ICU discharge, death, or 96 h from eligibility. During the 96-h target trial period, patients were evaluated every 2 hours for meeting thresholds for invasive ventilation. Patients were followed until the earliest of death, hospital discharge, or 28 days from eligibility.

Outcomes and subgroup analyses

The primary outcome was 28-day mortality. We incorporated subgroup analyses according to sex, race/ethnicity, age, admission year, weight, initial oxygen device, and initial inspired oxygen fraction.

Statistical analysis

We used nonparametric Bayesian G-computation to predict the causal effect of each threshold on outcomes [38,39,40]. G-computation is an established method to calculate unbiased treatment effects in observational study designs with time-varying confounding [41]. It uses two-component models, known as the confounder model and the conditional outcome model. Like all models for causal inference from observational data, the validity of the results depends on meeting the assumptions of positivity (every patient could potentially receive invasive ventilation), no interference (one patient’s use of invasive ventilation does not affect another patient’s use), consistency (well-defined intervention), and no unmeasured confounding [41].

The confounder model estimated the relationship between previously observed and future values of time-varying confounding variables, for patients not invasively ventilated. For this model, we used a Hilbert space Gaussian process approximation (Additional file 1: §6) [42,43,44,45]. A Gaussian process is a nonparametric Bayesian model that allows covariance across time (the past can influence the future) and between variables (different variables, such as heart rate or respiratory rate, can influence each other). Modeling the data as a Gaussian process amounts to assuming that there is an underlying smooth process (disease trajectory) that is observed over time through each of the continuous and discrete clinical variables. This approach is desirable because it can model complex confounding relationships and account for the associations between covariates. We assessed the validity of the confounder model through the measurement of prediction error (continuous variables) and discrimination/precision (binary variables) on data not used to fit the model.

The conditional outcome model estimated the probability of 28-day mortality, conditional on observing a sequence of confounder variables and invasive ventilation status. We used Bayesian additive regression trees (BART), a nonparametric model that sums results from multiple classification trees. Prior distributions encourage small, simple trees with regularized leaf weights. BART can effectively describe nonlinear relationships and interactions between outcomes and confounders and has demonstrated success compared to other models in estimating confounded treatment effects [46,47,48,49,50]. We calculated the model’s discrimination, precision, and calibration using fivefold cross-validation.

The nonparametric G-formula combined the two models and treatment thresholds to generate predictions of the effects of the thresholds on mortality (Additional file 1). While in a true randomized trial, each participant is randomized to only one treatment, in this target trial emulation we predict outcomes for every threshold on every patient. For each threshold, we reported the probability of each outcome and an odds ratio for mortality in comparison with modeled usual care, all summarized by their means and 95% credible intervals (CrI). We calculated e-values to quantify the strength of unmeasured confounding required to negate the findings [51, 52]. We used 400 samples from the posterior distribution. Programming was done in R v4.0.3 [35] and Stan [53] using the Niagara computer cluster from the Digital Research Alliance Canada [54]. All code is available at https://doi.org/10.5281/zenodo.7314132.

Results

The primary analysis included 3,357 patients from MIMIC-IV (Additional file 1: Figure e9). The median age was 65 (interquartile range (IQR) 58 to 79) years and 45% (1,500) were women (Table 1). Most (63%) were admitted to a medical or surgical ICU. At eligibility, 16% (536) were using HFNC, 14% (483) NIV, and 70% (2,338) non-rebreather masks. The median baseline SF was 148 (IQR 136 to 174). Within 28 days, 896 patients (26.7%) received invasive ventilation and 745 patients (22.2%) died. Mortality was 17.7% in patients who did not receive invasive ventilation and 34.5% in patients who received invasive ventilation.

Table 1 Primary analysis cohort (MIMIC-IV) characteristics

Predicted probabilities of invasive ventilation by threshold

The predicted probabilities of invasive ventilation and mortality at 28 days were calculated using G-computation for all thresholds in all patients, and model diagnostics and cross-validation are available in Additional file 1. The mean predicted probability of invasive ventilation at 28 days was 71.8% with a threshold of SF < 110, 47.0% with a threshold of SF < 98, and 19.4% with a threshold of SF < 88.

Mortality by threshold

The mean predicted 28-day mortality according to invasive ventilation threshold was 22.2% with a threshold of SF < 110, 24.1% with a threshold of SF < 98, and 25.8% with a threshold of SF < 88 (Fig. 2). Compared to a threshold of SF < 110, the absolute risk increases were 1.6% (CrI 0.6 to 2.6) with a threshold of SF < 98 and 3.5% (CrI 1.4 to 5.4) with a threshold of SF < 88. Using a threshold of SF < 110 instead of a threshold of SF < 88 was associated with 1 additional survivor for every 15 (CrI 10 to 39) additional patients invasively ventilated.

Fig. 2
figure 2

Predicted 28-day probabilities of invasive ventilation and mortality by SF ratio threshold for initiating invasive ventilation. This figure shows the predicted 28-day probability (y-axis) of invasive ventilation (top) and mortality (bottom), for the primary (MIMIC-IV, left) and secondary (AmsterdamUMCdb, right) analyses, according to each threshold trigger for invasive ventilation (x-axis). The mean predicted probability is in black, 95% credible interval in white, and red lines show the mean predicted probability for each of the 3,357 (MIMIC-IV) or 1,279 (AmsterdamUMCdb) individual patients, allowing for inspection of results across thresholds for each patient. The predicted probability of invasive ventilation increases dramatically with higher SF ratio thresholds for invasive ventilation, while the predicted probability of mortality decreases slightly for MIMIC-IV and increases slightly for AmsterdamUMCdb. The variation between patients is greater than the variation between thresholds, especially for mortality

Comparison with usual care

The threshold based on usual care resulted in predicted 28-day probabilities of 31.5% for invasive ventilation and 25.1% for mortality. Compared to usual care, the odds ratio for 28-day mortality was 0.85 (0.78 to 0.95) with a threshold of SF < 110, 0.95 (CrI 0.91 to 0.99) with a threshold of SF < 98, and 1.04 (CrI 1.01 to 1.08) with a threshold of SF < 88 (Fig. 3). For all thresholds, it was very unlikely (probability 7% or less) that the odds ratio for mortality was less than 0.8 (Table 2).

Fig. 3
figure 3

Odds ratios for mortality of each threshold in comparison with usual care. For both primary analysis (MIMIC-IV) and secondary analysis (AmsterdamUMCdb), this figure shows the posterior odds ratios (mean and 95% credible interval) for 28-day mortality alongside the probabilities that the posterior odds ratio (OR) is less than 1 (P(OR < 1.0)), less than 0.9 (P(OR < 0.9)), and less than 0.8 (P(OR < 0.8)). The reference threshold is usual care (OR = 1). SF = saturation-to-inspired oxygen fraction ratio, RR = respiratory rate. Respiratory trial criteria were 2 of RR > 40, saturation < 90 on inspired oxygen 0.90 or higher, abnormal work of breathing, or pH < 7.35; hemodynamic criterion was use of vasopressors; neurologic criterion was Glasgow Coma Scale < 9. Predicted SF was calculated using linear extrapolation between the current and previous SF measurements (measurements occurred every 2 h)

Table 2 Secondary analysis cohort (AmsterdamUMCdb) characteristics

Additional thresholds

Across four additional dimensions of hypoxemic respiratory failure (respiratory rate, work of breathing, duration, trajectory), thresholds triggering invasive ventilation at a lower severity resulted in more predicted invasive ventilation and less predicted mortality (Table 3). The randomized trial criteria threshold requiring any respiratory, hemodynamic, or neurologic dysfunction resulted in predicted 28-day probabilities of 65.5% for invasive ventilation and 22.5% for mortality, while a threshold of respiratory dysfunction in combination with either hemodynamic or neurologic dysfunction resulted in predicted 28-day probabilities of 16.1% for invasive ventilation and 25.9% for mortality.

Table 3 Mean predicted 28-day probabilities of invasive ventilation and mortality

Subgroup analyses

Results for the primary analysis showed consistency between the SF thresholds across the subgroups of age, sex, race/ethnicity, admission year, weight, baseline inspired oxygen fraction, and baseline oxygen device (Fig. 4). In all subgroups, predicted probability of invasive ventilation was lowest with threshold SF < 88, and predicted mortality was lowest with threshold SF < 110.

Fig. 4
figure 4

Mean predicted 28-day probabilities of invasive ventilation and mortality by subgroup. This figure shows the posterior probability densities of the mean predicted probabilities (x-axis) of invasive ventilation (left column) and mortality (right column) at 28 days according to threshold (light, medium, or dark densities) and subgroup (row) for the primary (MIMIC-IV) analysis. The ordering of results by threshold is consistent across subgroup for both invasive ventilation and mortality. The predicted probabilities of invasive ventilation by threshold are relatively stable across subgroups, except for baseline fraction of inspired oxygen or oxygen device at eligibility. The predicted probabilities of mortality vary according to baseline characteristics, including increases with increasing age or decreases with weight 100 kg or more

Secondary analysis

The AmsterdamUMCdb cohort included 1,279 patients (Additional file 1: Figure e9); 39% (493) were women and the median age-group was 60–69 years (Table 3). Noninvasive ventilation was in use for 23% (296) at eligibility, while the remainder used non-rebreather masks. Within 28 days from eligibility, 470 patients (36.8%) received invasive ventilation and 222 patients (17.4%) died. Mortality was 14.6% in patients who did not receive invasive ventilation and 22.1% in patients who received invasive ventilation. Compared to the primary analysis, the secondary analysis incorporated fewer measured confounders and had worse discrimination, precision, and calibration (Additional file 1: Tables e3–e5, Figures e2–se8).

The mean predicted probability of 28-day invasive ventilation was 50.9% with a threshold of SF < 110, 27.7% with a threshold of SF < 98, and 19.0% with a threshold of SF < 110 (Table 2). The corresponding probabilities of 28-day mortality were 14.6%, 13.2%, and 12.7% (Fig. 2). Compared to a threshold of SF < 110, the absolute risk decrease was 0.5% (CrI 0.0 to 0.9) with a threshold of SF < 98 and 1.9% (CrI 0.9 to 2.8) with a threshold of SF < 88.

Modeled usual care resulted in a predicted 28-day invasive ventilation probability of 45.7% and a predicted 28-day mortality probability of 14.1%. The odds ratios of 28-day mortality for each threshold relative to usual care were 1.05 (CrI 0.99 to 1.15) with a threshold of SF < 110, 0.92 (CrI 0.88 to 0.98) with a threshold of SF < 98, and 0.88 (CrI 0.82 to 0.94) with a threshold of SF < 88 (Fig. 3).

Discussion

This target trial emulation of thresholds for initiating invasive ventilation in hypoxemic respiratory failure showed that using a threshold of SF < 110 as a trigger to initiate invasive ventilation resulted in more predicted 28-day invasive ventilation than thresholds of SF < 98 or SF < 88. In the primary analysis, the predicted 28-day mortality was lowest with a threshold of SF < 110. Across additional thresholds focused on respiratory rate, work of breathing, duration of hypoxemia, trajectory of hypoxemia, and multi-organ criteria from randomized trials, thresholds met at lower as opposed to higher severity led to lower predicted mortality. By contrast, in the secondary analysis, predicted mortality was highest with a threshold of SF < 110, and across the additional thresholds, those met at lower severity were associated with higher predicted mortality.

The different relationship between invasive ventilation thresholds and mortality comparing primary and secondary analyses might be explained by differences in internal validity or clinical context. Compared to the secondary analysis, the primary analysis had more patients, more measured confounding variables, better discrimination, better precision, and better calibration. The direction of residual bias was harder to predict because the target trial construction did not permit death before invasive ventilation during the 96-h target trial period, which favored higher severity thresholds, but the possible inclusion of patients with care limitations favored lower severity thresholds.

Differences in the clinical context of the two cohorts may also explain the findings. The two sites differed in terms of time period, healthcare system, ICU beds, patient population, oxygen device availability, and clinical practice. The secondary analysis encompasses an older observation period where contemporary approaches to ventilation, weaning, and sedation may not have been employed, potentially increasing the harms associated with invasive ventilation. In the secondary analysis, no patients used high-flow nasal cannula; however, this would be expected to bias results toward finding invasive ventilation more beneficial, the opposite direction from our findings. At BIDMC patients rely on private medical insurance and ICU beds comprise 11% of total hospital beds, while at Amsterdam UMC there is universal coverage for hospital care and ICU beds comprise only 4.4% of hospital beds [55, 56]. The impact of ICU bed availability on the results is harder to predict, but one potential impact is that the decision for invasive ventilation may be more commonly made prior to ICU admission in Amsterdam UMC as compared to BIDMC.

The results support the hypothesis that the benefit of invasive ventilation is related to underlying disease severity. Mortality was lower in the AmsterdamUMCdb cohort, implying a lower disease severity for non-intubated patients in that database. Other research also supports this hypothesis. In an observational study, ARDS patients with arterial-to-inspired oxygen ratio less than 150 mmHg managed using invasive as opposed to noninvasive ventilation had lower mortality [21]. In patients with COVID-19, higher baseline sequential organ failure assessment scores were associated with better outcomes when patients were managed with invasive ventilation as opposed to noninvasive oxygen strategies [57]. For patients with higher predicted mortality, invasive ventilation thresholds triggered at a lower severity of illness could confer benefits by avoiding catastrophic deteriorations, emergency intubations, or patient self-inflicted lung injury [58, 59]. By contrast, for patients with lower predicted mortality, the benefits of avoiding iatrogenic complications associated with intubation and invasive ventilation may predominate.

However, not all research accords with this conclusion. Two small randomized trials from 1998 and 2005 suggested benefits with a higher severity threshold for invasive ventilation among a population with severe hypoxemic respiratory failure [60, 61]. Options for noninvasive oxygen support, and the use of contemporary best practices for ventilation, weaning, and sedation may have been reduced in those studies, highlighting that the balance of benefit and harm associated with invasive ventilation will depend on the use of noninvasive oxygen strategies and best practices during invasive ventilation [11, 62,63,64,65].

This study has important limitations. Unmeasured confounding is present because the clinical decision for invasive ventilation incorporates information about the diagnosis, prognosis, and nuanced respiratory assessment that are not available in the data studied. Unavoidably, the methods involved many modeling decisions which may affect the results in unpredictable ways [66]. The study does not report functional outcomes, where the harms of excess invasive ventilation may be more evident [6, 67]. The choice of SF ratio for the primary thresholds is problematic for people with darker skin pigment in whom peripheral oximeters can overestimate arterial oxygen saturation; we recommend using arterial oxygen saturation when a discrepancy is possible [68]. The target trial duration of 96 h captures most but not all intubations for hypoxemic respiratory failure [20, 69]. Some of the data were gathered more than 10–15 years ago and may not reflect current clinical practice.

The study also has considerable strengths. The methods are novel, fully documented, and address many challenges in correlating treatment decisions with clinical outcomes from retrospective data, including immortal time bias, indication bias, and time-varying confounding [66, 67]. The predictive validity of the component models has been explicitly assessed and documented. The thresholds evaluated are simple and clinically applicable.

These results highlight many areas for future research. Optimal thresholds may additional physiologic data such as standardized dyspnea assessment, electrical impedance tomography, or esophageal manometry [22, 70, 71]. More complex thresholds could be found through reinforcement learning [72, 73]. More information is also needed to compare thresholds with respect to functional outcomes, cost-effectiveness, and patient preferences.

Conclusion

For patients with hypoxemic respiratory failure, initiating invasive ventilation at lower hypoxemia severity will increase the rate of invasive ventilation, but this can either increase or decrease the expected mortality, with the direction of effect likely depending on baseline mortality risk and clinical context.

Availability of data and materials

The data used in this study were deidentified and are available through Physionet (MIMIC-IV) or the Amsterdam Medical Data Sciences organization (AmsterdamUMCdb). Both are freely available to researchers who complete a free basic online research ethics course and sign a data use agreement. See https://doi.org/10.13026/rrgf-xw32 for MIMIC-IV data access and https://amsterdammedicaldatascience.nl/amsterdamumcdb/ for AmsterdamUMCdb access.

Abbreviations

ICU:

Intensive care unit

MIMIC-IV:

Medical information mart for intensive care version IV

AmsterdamUMCdb:

Amsterdam University Medical Centers Database

BIDMC:

Beth Israel Deaconess Medical Centre

Amsterdam UMC:

Amsterdam University Medical Centers

STROBE:

Strengthening The Reporting of Observational Studies in Epidemiology

NIV:

Noninvasive positive pressure ventilation

HFNC:

High-flow nasal cannula

GCS:

Glasgow coma scale

pCO2:

Partial pressure of carbon dioxide

FiO2:

Inspired oxygen fraction

SF:

Saturation-to-inspired oxygen ratio

BART:

Bayesian additive regression trees

CrI:

95% Credible interval

References

  1. Bellani G, Laffey JG, Pham T, Fan E, Brochard L, Esteban A, et al. Epidemiology, patterns of care, and mortality for patients with acute respiratory distress syndrome in intensive care units in 50 countries. JAMA. 2016;315(8):788.

    Article  CAS  PubMed  Google Scholar 

  2. Kopczynska M, Sharif B, Pugh R, Otahal I, Havalda P, Groblewski W, et al. Prevalence and outcomes of acute hypoxaemic respiratory failure in wales: the PANDORA-WALES study. J Clin Med. 2020;9(11):3521.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  3. Villar J, Mora-Ordoñez JM, Soler JA, Mosteiro F, Vidal A, Ambrós A, et al. The PANDORA study: prevalence and outcome of acute hypoxemic respiratory failure in the Pre-COVID-19 Era. Critical Care Explorations. 2022;4(5): e0684.

    Article  PubMed  PubMed Central  Google Scholar 

  4. Herridge MS, Tansey CM, Matté A, Tomlinson G, Diaz-Granados N, Cooper A, et al. Functional disability 5 years after acute respiratory distress syndrome. N Engl J Med. 2011;364(14):1293–304.

    Article  CAS  PubMed  Google Scholar 

  5. Cuthbertson BH, Roughton S, Jenkinson D, Maclennan G, Vale L. Quality of life in the five years after intensive care: a cohort study. Crit Care. 2010;14(1):R6.

    Article  PubMed  PubMed Central  Google Scholar 

  6. Herridge MS, Chu LM, Matte A, Tomlinson G, Chan L, Thomas C, et al. The RECOVER program: disability risk groups and 1-year outcome after 7 or more days of mechanical ventilation. Am J Respir Crit Care Med. 2016;194(7):831–44.

    Article  PubMed  Google Scholar 

  7. Tobin MJ. Principles and practice of mechanical ventilation. USA: McGraw-Hill Medical; 2013.

    Google Scholar 

  8. Telias I, Brochard LJ, Gattarello S, Wunsch H, Junhasavasdikul D, Bosma KJ, et al. The physiological underpinnings of life-saving respiratory support. Intensive Care Med. 2022;48(10):1274–86.

    Article  PubMed  PubMed Central  Google Scholar 

  9. Force AD, Ranieri VM, Rubenfeld GD, Thompson B, Ferguson N, Caldwell E, Fan E, Camporota L, Slutsky AS. Acute respiratory distress syndrome. JAMA. 2012;307(23):2526–33.

    Google Scholar 

  10. Russotto V, Myatra SN, Laffey JG, Tassistro E, Antolini L, Bauer P, et al. Intubation practices and adverse peri-intubation events in critically Ill patients from 29 countries. JAMA. 2021;325(12):1164–72.

    Article  PubMed  PubMed Central  Google Scholar 

  11. Devlin JW, Skrobik Y, Gélinas C, Needham DM, Slooter AJC, Pandharipande PP, et al. Clinical practice guidelines for the prevention and management of pain, agitation/sedation, delirium, immobility, and sleep disruption in adult patients in the ICU. Crit Care Med. 2018;46(9):e825–73.

    Article  PubMed  Google Scholar 

  12. Vanhorebeek I, Latronico N, Van den Berghe G. ICU-acquired weakness. Intensive Care Med. 2020;46(4):637–53.

    Article  PubMed  PubMed Central  Google Scholar 

  13. Papazian L, Klompas M, Luyt CE. Ventilator-associated pneumonia in adults: a narrative review. Intensive Care Med. 2020;46(5):888–906.

    Article  PubMed  PubMed Central  Google Scholar 

  14. de Montmollin E, Aboab J, Ferrer R, Azoulay E, Annane D. Criteria for initiation of invasive ventilation in septic shock: an international survey. J Crit Care. 2016;31(1):54–7.

    Article  PubMed  Google Scholar 

  15. Bauer PR, Kumbamu A, Wilson ME, Pannu JK, Egginton JS, Kashyap R, et al. Timing of intubation in acute respiratory failure associated with sepsis: a mixed methods study. Mayo Clin Proc. 2017;92(10):1502–10.

    Article  PubMed  Google Scholar 

  16. Hakim R, Watanabe-Tejada L, Sukhal S, Tulaimat A. Acute respiratory failure in randomized trials of noninvasive respiratory support: a systematic review of definitions, patient characteristics, and criteria for intubation. J Crit Care. 2020;57:141–7.

    Article  PubMed  Google Scholar 

  17. Yarnell CJ, Johnson A, Dam T, Jonkman A, Liu K, Wunsch H, et al. What thresholds for invasive ventilation in hypoxemic respiratory failure are used in routine clinical care? A retrospective cohort study. Intensive Care Med Exp. 2022;10(2):108.

    Google Scholar 

  18. Doidge JC, Gould DW, Ferrando-Vivas P, Mouncey PR, Thomas K, Shankar-Hari M, et al. Trends in intensive care for patients with COVID-19 in England, wales, and Northern Ireland. Am J Respir Crit Care Med. 2021;203(5):565–74.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  19. Darreau C, Martino F, Saint-Martin M, Jacquier S, Hamel JF, Nay MA, et al. Use, timing and factors associated with tracheal intubation in septic shock: a prospective multicentric observational study. Annals Inten Care. 2020;10(1):1–10.

    Google Scholar 

  20. Roca O, Caralt B, Messika J, Samper M, Sztrymf B, Hernández G, et al. An index combining respiratory rate and oxygenation to predict outcome of nasal high-flow therapy. Am J Respir Crit Care Med. 2019;199(11):1368–76.

    Article  PubMed  Google Scholar 

  21. Bellani G, Laffey JG, Pham T, Madotto F, Fan E, Brochard L, et al. Noninvasive ventilation of patients with acute respiratory distress syndrome: insights from the LUNG safe study. Am J Respir Crit Care Med. 2017;195(1):67–77.

    Article  PubMed  Google Scholar 

  22. Tonelli R, Fantini R, Tabbì L, Castaniere I, Pisani L, Pellegrino MR, et al. inspiratory effort assessment by esophageal manometry early predicts noninvasive ventilation outcome in de novo respiratory failure: a pilot study. Am J Respir Crit Care Med. 2020;202:558–67.

    Article  PubMed  PubMed Central  Google Scholar 

  23. Yamamoto R, Takemura R, Yamamoto A, Matsumura K, Kaito D, Homma K, et al. Threshold of increase in oxygen demand to predict mechanical ventilation use in novel coronavirus disease 2019: a retrospective cohort study incorporating restricted cubic spline regression. PLoS ONE. 2022;17(7): e0269876.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  24. Cain LE, Robins JM, Lanoy E, Logan R, Costagliola D, Hernán MA. When to start treatment? A systematic approach to the comparison of dynamic regimes using observational data. Int J Biostat 2010;6(2).

  25. Dickerman BA, García-Albéniz X, Logan RW, Denaxas S, Hernán MA. Avoidable flaws in observational analyses: an application to statins and cancer. Nat Med. 2019;25(10):1601–6.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  26. Hoffman KL, Schenck EJ, Satlin MJ, Whalen W, Pan D, Williams N, et al. Comparison of a target trial emulation framework vs Cox regression to estimate the association of corticosteroids with COVID-19 mortality. JAMA Netw Open. 2022;5(10): e2234425.

    Article  PubMed  PubMed Central  Google Scholar 

  27. Goldberger AL, Amaral LA, Glass L, Hausdorff JM, Ivanov PC, Mark RG, et al. PhysioBank, physiotoolkit, physionet: components of a new research resource for complex physiologic signals. Circulation. 2000;101(23):E215–20.

    Article  CAS  PubMed  Google Scholar 

  28. Johnson A, Bulgarelli L, Pollard T, Horng S, Celi LA, Mark R. MIMIC-IV (version 0.4) [Internet]. PhysioNet; 2020. Available from: https://doi.org/10.13026/a3wn-hq05

  29. Johnson AEW, Stone DJ, Celi LA, Pollard TJ. The MIMIC code repository: enabling reproducibility in critical care research. J Am Med Inform Assoc. 2018;25(1):32–9.

    Article  PubMed  Google Scholar 

  30. Sauer CM, Dam TA, Celi LA, Faltys M, de la Hoz MAA, Adhikari L, et al. Systematic review and comparison of publicly available ICU data sets-a decision guide for clinicians and data scientists. Crit Care Med. 2022. https://doi.org/10.1097/CCM.0000000000005517.

    Article  PubMed  Google Scholar 

  31. Thoral PJ, Peppink JM, Driessen RH, Sijbrands EJG, Kompanje EJO, Kaplan L, et al. Sharing ICU patient data responsibly under the society of critical care medicine/European society of intensive care medicine joint data science collaboration: the Amsterdam university medical centers database (AmsterdamUMCdb) example. Crit Care Med. 2021;49(6):e563–77.

    Article  PubMed  PubMed Central  Google Scholar 

  32. von Elm E, Altman DG, Egger M, Pocock SJ, Gøtzsche PC, Vandenbroucke JP. Strengthening the reporting of observational studies in epidemiology (STROBE) statement: guidelines for reporting observational studies. BMJ. 2007;335(7624):806–8.

    Article  Google Scholar 

  33. Healey C, Osler TM, Rogers FB, Healey MA, Glance LG, Kilgo PD, et al. Improving the glasgow coma scale score: motor score alone is a better predictor. J Trauma. 2003;54(4):671–80.

    Article  CAS  PubMed  Google Scholar 

  34. Coudroy R, Frat JP, Girault C, Thille AW. Reliability of methods to estimate the fraction of inspired oxygen in patients with acute respiratory failure breathing through non-rebreather reservoir bag oxygen mask. Thorax. 2020;75(9):805–7. https://doi.org/10.1136/thoraxjnl-2020-214863.

    Article  PubMed  Google Scholar 

  35. R Core Team. R: A Language and environment for statistical computing [Internet]. Vienna, Austria: R foundation for statistical computing; 2020. Available from: https://www.r-project.org

  36. Wick KD, Matthay MA, Ware LB. Pulse oximetry for the diagnosis and management of acute respiratory distress syndrome. Lancet Respir Med. 2022;10(11):1086–98. https://doi.org/10.1016/S2213-2600(22)00058-3.

    Article  PubMed  PubMed Central  Google Scholar 

  37. Riviello ED, Kiviri W, Twagirumugabe T, Mueller A, Banner-Goodspeed VM, Officer L, et al. Hospital incidence and outcomes of the acute respiratory distress syndrome using the Kigali modification of the berlin definition. Am J Respir Crit Care Med. 2016;193(1):52–9.

    Article  PubMed  Google Scholar 

  38. Snowden JM, Rose S, Mortimer KM. Implementation of G-computation on a simulated data set: demonstration of a causal inference technique. Am J Epidemiol. 2011;173(7):731–8.

    Article  PubMed  PubMed Central  Google Scholar 

  39. Saarela O, Stephens DA, Moodie EEM, Klein MB. On Bayesian estimation of marginal structural models. Biometrics. 2015;71(2):279–88.

    Article  PubMed  Google Scholar 

  40. Oganisian A, Roy JA. A practical introduction to Bayesian estimation of causal effects: parametric and nonparametric approaches. Stat Med. 2021;40(2):518–51.

    Article  PubMed  Google Scholar 

  41. Hernán M, Robins J. Causal inference: what if. [Internet]. Boca Raton: Chapman & Hall/CRC; 2020. Available from: https://cdn1.sph.harvard.edu/wp-content/uploads/sites/1268/2020/02/ci_hernanrobins_21feb20.pdf

  42. Riutort-Mayol G, Bürkner PC, Andersen MR, Solin A, Vehtari A. Practical Hilbert space approximate Bayesian Gaussian processes for probabilistic programming [Internet]. arXiv; 2022 Mar [cited 2022 May 17]. Report No.: arXiv:2004.11408. Available from: http://arxiv.org/abs/2004.11408

  43. Betancourt M. Robust Gaussian process modeling [Internet]. [cited 2021 Oct 9]. Available from: https://betanalpha.github.io/assets/case_studies/gaussian_processes.html#1_Modeling_Functional_Relationships

  44. Gelman A, Carlin JB, Stern HS, Dunson DB, Vehtari A, Rubin DB. Bayesian Data Analysis, Third Edition. CRC Press; 2013. 677 p.

  45. Cheng LF, Dumitrascu B, Darnell G, Chivers C, Draugelis M, Li K, et al. Sparse multi-output Gaussian processes for online medical time series prediction. BMC Med Inform Decis Mak. 2020;20(1):152.

    Article  PubMed  PubMed Central  Google Scholar 

  46. Hahn PR, Dorie V, Murray JS. Atlantic causal inference conference (ACIC) data analysis challenge 2017. arXiv [Internet]. 2019 May; Available from: http://arxiv.org/abs/1905.09515

  47. Hahn PR, Murray JS, Carvalho CM. Bayesian regression tree models for causal inference: regularization, confounding, and heterogeneous effects (with discussion). Bayesian Anal. 2020;15(3):965–1056.

    Article  Google Scholar 

  48. Hill JL. Bayesian nonparametric modeling for causal inference. J Comput Graph Stat. 2011;20(1):217–40.

    Article  Google Scholar 

  49. Chipman HA, George EI, McCulloch RE. BART: Bayesian additive regression trees. Ann Appl Stat. 2010;4(1):266–98.

    Article  Google Scholar 

  50. Hill J, Linero A, Murray J. Bayesian additive regression trees: a review and look forward. Annual Rev Stat Appl. 2020;7(1):251–78.

    Article  Google Scholar 

  51. Mathur MB, Ding P, Riddell CA, VanderWeele TJ. Website and R package for computing E-values. Epidemiology. 2018;29(5):e45–7.

    Article  PubMed  PubMed Central  Google Scholar 

  52. Ding P, VanderWeele TJ. Sensitivity analysis without assumptions. Epidemiology. 2016;27(3):368–77.

    Article  PubMed  PubMed Central  Google Scholar 

  53. Carpenter B, Gelman A, Hoffman MD, Lee D, Goodrich B, Betancourt M, et al. Stan: a probabilistic programming language. J Stat Softw. 2017;76(1):1–32.

    Article  PubMed  PubMed Central  Google Scholar 

  54. Ponce M, Van Zon R, Northrup S, Gruner D, Chen J, Ertinaz F, et al. Deploying a top-100 supercomputer for large parallel workloads: The Niagara supercomputer. In: ACM international conference proceeding series [Internet]. New York, USA: Association for computing machinery; 2019; p. 1–8. https://doi.org/10.1145/3332186.3332195

  55. About BIDMC [Internet]. [cited 2022 Sep 25]. Available from: https://www.bidmc.org/about-bidmc

  56. Adult intensive care at Amsterdam UMC [Internet]. VUmc.com. 2019 [cited 2022 Sep 25]. Available from: https://www.vumc.com/departments/adult-intensive-care.htm

  57. Krishnan JK, Rajan M, Baer BR, Hoffman KL, Alshak MN, Aronson KI, et al. Assessing mortality differences across acute respiratory failure management strategies in Covid-19. J Crit Care. 2022;1(70): 154045.

    Article  Google Scholar 

  58. Grieco DL, Menga LS, Eleuteri D, Antonelli M. Patient self-inflicted lung injury: implications for acute hypoxemic respiratory failure and ARDS patients on non-invasive support. Minerva Anestesiol. 2019;85(9):1014–23.

    Article  PubMed  Google Scholar 

  59. Brochard L, Slutsky A. Mechanical ventilation to minimize progression of lung injury in acute respiratory failure. Am Thoracic Soc. 2017;195(4):438–42.

    Google Scholar 

  60. Antonelli M, Conti G, Rocco M, Bufi M, De Blasi RA, Vivino G, et al. A comparison of noninvasive positive-pressure ventilation and conventional mechanical ventilation in patients with acute respiratory failure. N Engl J Med. 1998;339(7):429–35.

    Article  CAS  PubMed  Google Scholar 

  61. Honrubia T, García López FJ, Franco N, Mas M, Guevara M, Daguerre M, et al. Noninvasive vs conventional mechanical ventilation in acute respiratory failure: a multicenter, randomized controlled trial. Chest. 2005;128(6):3916–24.

    Article  PubMed  Google Scholar 

  62. Network ARDS. Ventilation with lower tidal volumes as compared with traditional tidal volumes for acute lung injury and the acute respiratory distress syndrome. N Engl J Med. 2000;342(18):1301–8.

    Article  Google Scholar 

  63. Fan E, Zakhary B, Amaral A, McCannon J, Girard TD, Morris PE, et al. Liberation from mechanical ventilation in critically Ill adults: an official ATS/ACCP clinical practice guideline. Ann Am Thorac Soc. 2017;14(3):441–3.

    Article  PubMed  Google Scholar 

  64. De Jong A, Myatra SN, Roca O, Jaber S. How to improve intubation in the intensive care unit. Update on knowledge and devices. Intensive Care Med. 2022;48(10):1287–98.

    Article  PubMed  PubMed Central  Google Scholar 

  65. Ferreyro BL, Angriman F, Munshi L, Del Sorbo L, Ferguson ND, Rochwerg B, et al. Association of noninvasive oxygenation strategies with all-cause mortality in adults with acute hypoxemic respiratory failure. JAMA [Internet]. 2020 Jun; Available from: https://jamanetwork.com/journals/jama/fullarticle/2767025

  66. Silberzahn R, Uhlmann EL, Martin DP, Anselmi P, Aust F, Awtrey E, et al. Many analysts, one data set: making transparent how variations in analytic choices affect results. Adv Methods Pract Psychol Sci. 2018;1(3):337–56.

    Article  Google Scholar 

  67. Bein T, Weber-Carstens S, Apfelbacher C. Long-term outcome after the acute respiratory distress syndrome: different from general critical illness? Curr Opin Crit Care. 2018;24(1):35–40.

    Article  PubMed  PubMed Central  Google Scholar 

  68. Sjoding MW, Dickson RP, Iwashyna TJ, Gay SE, Valley TS. Racial bias in pulse oximetry measurement. N Engl J Med. 2020;383(25):2477–8.

    Article  PubMed  PubMed Central  Google Scholar 

  69. Frat JP, Thille AW, Mercat A, Girault C, Ragot S, Perbet S, et al. High-flow oxygen through nasal cannula in acute hypoxemic respiratory failure. N Engl J Med. 2015;372(23):2185–96.

    Article  CAS  PubMed  Google Scholar 

  70. Gentzler ER, Derry H, Ouyang DJ, Lief L, Berlin DA, Xu CJ, et al. Underdetection and undertreatment of dyspnea in critically Ill patients. Am J Respir Crit Care Med. 2019;199(11):1377–84.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  71. Rauseo M, Mirabella L, Laforgia D, Lamanna A, Vetuschi P, Soriano E, et al. A pilot study on electrical impedance tomography during CPAP trial in patients with severe acute respiratory syndrome Coronavirus 2 pneumonia: the bright side of non-invasive ventilation. Front Physiol. 2022. https://doi.org/10.3389/fphys.2021.728243.

    Article  Google Scholar 

  72. Komorowski M, Celi LA, Badawi O, Gordon AC, Faisal AA. The artificial intelligence clinician learns optimal treatment strategies for sepsis in intensive care. Nat Med. 2018;24(11):1716–20.

    Article  CAS  PubMed  Google Scholar 

  73. Sutton RS, Barto AG. Reinforcement learning: an introduction. Cambridge: A Bradford Book; 2018.

    Google Scholar 

Download references

Acknowledgements

We thank the following for helpful comments: Mathieu Komorowski, Mireille Schnitzer. Computations were performed on the Niagara supercomputer at the SciNet HPC Consortium. SciNet is funded by: the Canada Foundation for Innovation; the Government of Ontario; Ontario Research Fund—Research Excellence; and the University of Toronto.

Funding

Dr Yarnell was funded by the Canadian Institutes for Health Research Vanier Scholar program, the Eliot Phillipson Clinician Scientist Training Program, and the Clinician Investigator Program of the University of Toronto. Dr Sung is supported by the Canada Research Chair in Pediatric Oncology Supportive Care. Dr Fowler is the H. Barrie Fairley Professor of Critical Care at the University Health Network, Interdepartmental Division of Critical Care Medicine, University of Toronto. Funders had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; nor in the decision to submit the manuscript for publication. The opinions, results, and conclusions reported in this paper are those of the authors and are independent of the funding sources. No endorsement by any of the funding agencies is intended or should be inferred.

Author information

Authors and Affiliations

Authors

Contributions

CJY and GT contributed to concept. CJY, FA, BLF, KL, RAF, LS, and GT designed the study. All authors analyzed and interpreted the data. LC, HJdG, PE, and PT performed data acquisition. All authors contributed to drafting, revising for important intellectual content, final approval, and agreement to be accountable. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Christopher J. Yarnell.

Ethics declarations

Ethics approval and consent to participate

The University of Toronto research ethics board approved the protocol (#42081). A waiver for patient consent was granted as the data are wholly deidentified and retrospective.

Consent for publication

Not applicable.

Competing interests

Dr Brochard’s laboratory received grants from Medtronic, Draeger, equipment from Philips, Sentec, Fisher Paykel and Air Liquide and lecture fees from Fisher Paykel. No other authors have competing interests to declare.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1.

Supplementary material including further details about study design, data processing, statistical analysis, and results.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Yarnell, C.J., Angriman, F., Ferreyro, B.L. et al. Oxygenation thresholds for invasive ventilation in hypoxemic respiratory failure: a target trial emulation in two cohorts. Crit Care 27, 67 (2023). https://doi.org/10.1186/s13054-023-04307-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13054-023-04307-x

Keywords