Skip to main content
Download PDF

Positive single-center randomized trials and subsequent multicenter randomized trials in critically ill patients: a systematic review

Critical Care volume 27, Article number: 465 (2023) Cite this article

Abstract

Background

It is unclear how often survival benefits observed in single-center randomized controlled trials (sRCTs) involving critically ill patients are confirmed by subsequent multicenter randomized controlled trials (mRCTs). We aimed to perform a systemic literature review of sRCTs with a statistically significant mortality reduction and to evaluate whether subsequent mRCTs confirmed such reduction.

Methods

We searched PubMed for sRCTs published in the New England Journal of Medicine, JAMA, or Lancet, from inception until December 31, 2016. We selected studies reporting a statistically significant mortality decrease using any intervention (drug, technique, or strategy) in adult critically ill patients. We then searched for subsequent mRCTs addressing the same research question tested by the sRCT. We compared the concordance of results between sRCTs and mRCTs when any mRCT was available. We registered this systematic review in the PROSPERO International Prospective Register of Systematic Reviews (CRD42023455362).

Results

We identified 19 sRCTs reporting a significant mortality reduction in adult critically ill patients. For 16 sRCTs, we identified at least one subsequent mRCT (24 trials in total), while the interventions from three sRCTs have not yet been addressed in a subsequent mRCT. Only one out of 16 sRCTs (6%) was followed by a mRCT replicating a significant mortality reduction; 14 (88%) were followed by mRCTs with no mortality difference. The positive finding of one sRCT (6%) on intensive glycemic control was contradicted by a subsequent mRCT showing a significant mortality increase. Of the 14 sRCTs referenced at least once in international guidelines, six (43%) have since been either removed or suggested against in the most recent versions of relevant guidelines.

Conclusion

Mortality reduction shown by sRCTs is typically not replicated by mRCTs. The findings of sRCTs should be considered hypothesis-generating and should not contribute to guidelines.

Background

Randomized controlled trials (RCTs) are widely accepted as the best available tools to provide scientific evidence, are considered integral to informed clinical decision-making [1] and have been and remain the gold standard for assessing the efficacy of therapeutic agents. However, despite their potential to generate robust evidence, the positive results of single-center randomized controlled trials (sRCTs) may not be replicated when subjected to large multicenter randomized controlled trials (mRCTs), particularly within the context of intensive care settings [2, 3]. The discrepancies in results are often attributed to the inherent limitations of sRCTs. These limitations typically include biases due to local effects, minimal heterogeneity among the enrolled patients, inadequate blinding of personnel and data analysis, and the temporal gap between enrollment completion and publication. In addition, many sRCTs conducted in intensive care settings are often characterized by a low fragility index, indicating that the positive findings of the study depend on a small number of events [4]. Therefore, clinicians should interpret the positive evidence from sRCTs with caution, as clinical practice based on such evidence carries a high risk of bias [2].

Despite the above considerations, no study has systematically evaluated the discrepancy between positive sRCTs and subsequent mRCTs in the intensive care setting to provide a detailed perspective on the reproducibly of sRCTs. Therefore, we conducted a systematic review to identify sRCTs showing a mortality increase or decrease with a statistically significant difference and to evaluate whether following mRCTs confirmed or refuted the positive findings of these sRCTs. The primary objective of this systematic review was to report if significant mortality reduction observed in sRCTs was replicated in subsequent mRCTs. The secondary objective was to observe how clinical guidelines have dealt with these positive sRCTs in their recommendations.

Methods

We performed a systematic review according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines [5] (see PRISMA checklist in Additional file 1). This systematic review was registered in PROSPERO International Prospective Register of Systematic Reviews (CRD42023455362).

Search strategy and selection criteria

Two investigators independently searched PubMed for all RCTs of any non-surgical intervention influencing unadjusted landmark mortality in critically ill patients (> 48 h after randomization), published in three medical journals (i.e., New England Journal of Medicine, JAMA, and Lancet) from inception to December 31st, 2016. We did not consider sRCTs published after 2017 considering the time lag between the publication of sRCTs and their corresponding mRCTs.

We considered a difference in mortality as statistically significant when present at a specific point (> 48 h after randomization) with simple statistical tests and without adjustment for baseline characteristics. We selected articles published in NEJM, JAMA, or the Lancet, with a randomized controlled trial design in a single-center setting, presenting a statistically significant reduction or increase in unadjusted landmark mortality in critically ill patients. A quasi-randomized or non-randomized methodology, multicentric trials, pediatric populations, and absence of data on mortality were considered exclusion criteria. The full PubMed search strategy is available in Additional file 1.

After identification of eligible sRCTs, two investigators independently searched for mRCTs addressing the same PICO (population, intervention, control, outcome) frameworks, which were published from inception to December 31st, 2022.

The risk of bias of each included sRCT was assessed using the Cochrane risk-of-bias tool for randomized trials version 2 (RoB 2) [6].

Data extraction

Two investigators extracted the following variables in a standardized data collection form: PubMed unique identifier, journal, first author, year of publication, study population, number of patients enrolled, intervention, control, mortality data with statistical significance, and timepoint of mortality assessment. If a subsequent mRCT was identified, we evaluated whether the mortality findings of the mRCT were consistent with those of the sRCT. Furthermore, we explored whether sRCTs were incorporated into international clinical practice guidelines. We further assessed whether and when guidelines stopped citing such RCTs or issued recommendations modified by the mRCTs findings.

Statistical analysis

First, positive sRCTs with at least one subsequent mRCT were classified into three groups based on the results of mRCTs: significant mortality reduction (positive mRCTs), no significant difference in mortality (neutral mRCTs), and significant mortality increase (negative mRCTs). The proportion of sRCTs within each group was reported accordingly.

Second, we categorized included sRCTs that were cited at least once in international clinical guidelines based on the current guideline recommendations: supporting the intervention shown to have survival benefits in the sRCT, withholding recommendation due to insufficient evidence, and opposing the intervention of interest or excluding the sRCT cited in the preceding version of the guidelines.

To confirm the robustness of our findings, we performed a sensitivity analysis including only recent positive sRCTs published after 2001 to describe the mortality results of subsequent mRCTs and the guideline recommendations regarding the intervention assessed in the included sRCTs.

Furthermore, the following data were summarized: the number of randomized patients (sRCTs and mRCTs), the number of participating centers (mRCTs), the duration between publications of the sRCT and subsequent mRCT, and the duration from the initial citation of the sRCTs in the guidelines to an alteration in recommendation against its use or removal from guidelines. Missing data were not imputed throughout this study. Continuous variables were described as median and interquartile range (IQR). Categorical variables were expressed as number (percentage). We used RStudio Version 2023.06.0+421 (RStudio Team, Boston, United States).

Results

We identified 19 sRCTs published in the three high impact factor journals (7 in New England Journal of Medicine, 7 in JAMA, or 5 in Lancet), which showed a statistically significant mortality difference in critically ill patients [7,8,9,10,11,12,13,14,15,16,17,18,19,20,21,22,23,24,25] (Fig. 1). Major exclusions and reasons for exclusion are detailed in Additional file 1: Table S1. These trials were published from 1984 to 2016. The median number of enrolled patients was 231 (IQR 90–430). Acute kidney injury was the most representative condition of interest (4 studies [18, 20, 22, 25]), followed by cardiac arrest (3 studies [11, 17, 21]) and sepsis (3 studies [14, 16, 19]). Standard care or conventional therapy was used as control in 7 studies [8, 9, 14, 16, 19, 21, 23]. The most common timing of significant mortality differences was hospital discharge (8 studies [9,10,11, 13, 17, 18, 21, 23]). The characteristics of the included sRCTs are described in Table 1. The vast majority of the sRCTs included in this study (18 out of 19) were assessed as having a low risk of bias, while the remaining trial was judged as having some concerns (see Additional file 1: Table S2).

Fig. 1
figure 1

Flow chart of study selection. NEJM New England Journal of Medicine

Full size image
Table 1 Single-center randomized trials with statistically significant survival benefits
Full size table

Most of the included sRCTs (16/19, 84%) [7, 9,10,11,12,13,14,15,16,17, 19, 20, 22,23,24,25] were followed by at least one subsequent mRCT (in total 24 studies [26,27,28,29,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44,45,46,47,48,49]), while no mRCT was available for the remaining three studies [8, 18, 21]. The mRCTs enrolled more patients (median, 1192 [IQR 488–3021] vs. 231 [IQR 90–430] in sRCTs). The median number of participating centers was 29 (IQR 8–37) and one-third of the studies involved multiple countries [27, 29, 32, 34, 40, 41, 45, 48]. The median interval between the publications of a sRCT and its relevant subsequent mRCT was 8 years (IQR 5–13 years). Survival or mortality was the primary outcome in the 10 sRCTs and 17 mRCTs (as listed in Additional file 1: Table S3).

The survival benefits of one intervention (epinephrine during out-of-hospital cardiac arrest [17]) were confirmed by a subsequent mRCT [46]. Fourteen studies [9,10,11,12,13, 16, 19, 22, 24, 25] were followed by neutral mRCTs (no statistically significant mortality difference between groups) [26,27,28,29,30,31,32,33, 35,36,37,38,39,40,41,42,43,44,45, 47,48,49]. One sRCT reporting survival benefit of intensive insulin therapy [23] was contradicted by a large mRCT documenting a statistically significant mortality increase in patients randomized to the intensive insulin therapy arm [34]. Figure 2 and Table 2 describes the mortality findings of these mRCTs.

Fig. 2
figure 2

Mortality findings in multicenter randomized trials following positive single-center trials. RCT randomized controlled trials, NEJM New England Journal of Medicine

Full size image
Table 2 Subsequent multicenter randomized trials and their mortality findings
Full size table

Figure 3 and Table 3 summarizes how clinical guidelines have considered survival benefits shown in sRCTs. Among the included 19 sRCTs, 14 were cited in clinical guidelines at least once (13 sRCTs with subsequent mRCTs and one without) [7, 9, 11,12,13, 15, 17, 19,20,21,22,23,24,25]. Among the 13 sRCTs followed by mRCTs, the guidelines initially provided recommendations or suggestions based on the positive results of seven sRCTs [7, 11, 13, 15, 19, 23, 24]. However, the current guidelines do not support applying two of these interventions anymore [19, 23]. Treatments assessed in the remaining five sRCTs [7, 11, 13, 15, 24] remained as suggestions for use in clinical guidelines. Such suggestions remained even after the publication of mRCTs, which reported neutral mortality findings.

Fig. 3
figure 3

Current guideline recommendations of positive single-center trials

Full size image
Table 3 Citation of single-center randomized trials in international clinical guidelines
Full size table

Of the remaining six sRCTs for which guidelines did not support the intervention investigated, five [9, 12, 17, 20, 22] were cited in the guidelines without a clear recommendation, primarily due to inadequate evidence. However, one intervention—epinephrine for cardiac arrest—that exhibited survival benefits in the sRCT [17] and subsequent mRCT [46] is currently recommended in guidelines. The remaining sRCT [25] was not endorsed by the initial relevant guideline as a result of other mRCTs that showed no significant mortality reduction.

Finally, among three sRCTs which has not had a subsequent mRCT, only one study [21] was cited in guidelines without any recommendation but is not referenced in the current guidelines.

Consequently, among 14 sRCTs originally referenced to in clinical guidelines, six (43%) are still cited to suggest for the intervention in current international guidelines [7, 11, 13, 15, 17, 24]. Conversely, six other sRCTs (43%) were either omitted or considered contraindicated in subsequent guideline versions [9, 19, 22, 23, 25]. Among these six studies, the median duration from the initial citation in the guidelines to an alteration in recommendation against its use or removal from guidelines was 9 years (IQR 6–12 years). Regarding the remaining two studies [12, 20], no recommendation was made due to insufficient evidence.

A sensitivity analysis restricted to recent sRCTs confirmed the overall results: survival benefits were infrequently replicated in subsequent mRCTs; half of the positive sRCTs were omitted or considered contraindicated in the current guidelines (detailed in Table S4 in the Additional file 1).

Discussion

Key findings

Our systematic review found 19 sRCTs with a statistically significant mortality decrease in critically ill adult patients. Most of these were followed by at least one subsequent mRCT. Survival benefits observed in sRCTs were rarely corroborated by mRCTs, with most mRCTs reporting neutral results on mortality, and one mRCT finding a significant mortality increase with intensive glucose control. Treatment recommendations based on the initial citation of sRCTs with survival benefits were included in international guidelines and typically remained unchanged for a decade before any revisions were made based on subsequent relevant mRCTs.

Relationship with previous literature

RCTs in intensive care medicine tend to deliver neutral results in terms of mortality for several reasons including heterogeneity of patient characteristics, underlying practice variation, insufficient power, and likely small treatment effects [3]. This fact poses an important challenge for clinicians because they must perform clinical practice without robust evidence supporting their decisions. As a result, positive trials, namely RCTs reporting statistically significant reductions in mortality attributable to the intervention of interest, look attractive and are often taken up by physicians to change their routine management. Unfortunately, however, such positive RCTs frequently suffer from methodological problems, which can limit the applicability of their findings. Furthermore, single-centric design itself carries many other limitations [2, 3].

One of the major challenges of sRCTs is that, to achieve an effect on mortality in the presence of a small sample size, they must achieve an implausibly large effect size. Single-center trials are typically conducted by advocates of the intervention under investigation [2]. The delivery of such interventions generally requires specialized expertise and dedication, which may not be readily transferable to other centers involved in subsequent large mRCTs. Such discrepancies may limit the feasibility of the interventions, potentially diminishing the magnitude of the treatment effects observed in mRCTs compared to sRCTs. In fact, a meta-epidemiological study evaluated the differences in treatment effects between sRCTs and multicenter RCTs and found that single-center trials showed a statistically significant larger treatment effects than multicenter trials (ratio of odds ratios, 0.73; 95% confidence interval 0.64–0.83) [68]. This finding was confirmed by a systematic review assessing treatment effects on mortality in critically ill settings [69]. By pooling 82 eligible RCTs, this systematic review found that a single-center design resulted in larger treatment effects than a multicenter design (ratio of odds ratios, 0.64; 95% confidence interval 0.47–0.87) [69]. Our selection criterion of sRCTs with significant mortality differences is a unique approach; nonetheless, the present systematic review was consistent with previous work showing that survival benefits in sRCTs were rarely replicated in mRCTs. Moreover, we identified one mRCT demonstrating a significant mortality increase by an intervention (intensive glucose control strategy) [34], which reduced mortality within the context of a previous single-center trial [23].

Nearly half of clinical guidelines that cite sRCTs, recommend the relevant intervention based on their positive results, despite some of these endorsements being subsequently refuted in light of accumulated evidence. In addition, a decade was typically required to amend such recommendations from clinical guidelines. Given the pervasive application of interventions examined in RCTs, these initial recommendations might have played a substantial role in the potential consequences on patient outcomes, healthcare resources, and economic costs. For example, early-goal directed therapy was recommended in the surviving sepsis campaign guidelines in 2004 [56]. However, later, three mRCTs found no benefits in clinically relevant outcomes [42, 45, 49]. Furthermore, economic evaluation using one of the mRCTs revealed that early-goal directed therapy was associated with increased health care costs without improving outcomes [70].

Despite these methodological challenges, positive sRCTs have made changes in clinical practice. The early goal-directed therapy for septic shock is a typical example. The initial sRCT [19] showed survival benefits of this protocolized management, which was not replicated in subsequent mRCTs [42, 45, 49]. However, given the difference in patient severity between the sRCT and subsequent mRCTs (e.g., reduced vs. normal central venous oxygen saturation [ScvO2]), clinicians now pay more attention to ScvO2 values than before the sRCT [71]. Furthermore, the lack of multicentric confirmation of survival benefits implies a restricted external validity of sRCTs rather than an indication of them producing false positive results.

As the intensive care community advances the methodology of randomized trial design and execution, there remains a notable lack of evidence demonstrating improved mortality from interventions. These disappointing results have been obtained by using frequentist statistics, where the conclusion is dichotomized to yes or no based on confidence intervals and p values. In contrast, Bayesian analysis provides a probabilistic assessment of the magnitude and direction of true treatment effects, which allows clinicians to augment the interpretation of the trial results. Interestingly, there are several intensive care trials where frequentist statistics denied significant mortality reduction, followed by a Bayesian reanalysis revealing a high probability of survival benefits [72, 73]. Therefore, the integration of Bayesian analysis in intensive care trials may offer a solution to the limitations commonly encountered with frequentist approaches.

Implications

This systematic review found mortality reduction was rarely replicated in mRCTs despite the existence of previous positive sRCTs. This implies that there are potential risks when incorporating novel interventions into routine practice based on positive sRCTs without mRCTs confirmation. Importantly, no intervention is free from complications. In addition, new interventions tested in randomized trials often consume more human resources and economic costs. Therefore, management change will inevitably result in complications, increased workload, and costs, all of which did not exist with previous usual care. Given the high likelihood of no mortality difference or even mortality increase in subsequent mRCTs, our findings imply that clinicians should wait for a large-scale trial prior to changing practice or at least be very careful in interpreting the results of positive sRCTs.

Strengths and limitations

This systematic review is the first study to comprehensively identify sRCTs reporting statistically significant reductions in mortality and their corresponding subsequent mRCTs in the field of intensive care medicine. The infrequent replicability of survival benefits in mRCTs corroborated the limited generalizability of sRCTs’ findings. Evaluating the impact of sRCTs on clinical guidelines may be a novel approach, but it yields important insights into the development and interpretation of guidelines.

We acknowledge several limitations. First, given our focus was solely on intensive care sRCTs, our findings may not translate to other medical disciplines. Nevertheless, the generic limitations of sRCTs are universal, regardless of the targeted population or intervention type. As such, sRCTs need to be perceived as hypothesis-generating and clinicians ought to assess the results of sRCTs with a balanced consideration of their strengths and weaknesses. Second, our study included only sRCTs published until 2016, thereby excluding more recent sRCTs. Despite this limitation, our primary objective was to compare the mortality findings of sRCTs with those of subsequent mRCTs, which necessitated an intervening period between them. In addition, the median duration between sRCT and mRCT publication was 8 years, providing justification for our inclusion criteria. Third, we included positive sRCTs published in the three renowned general medical journals, excluding those in intensive care specialty journals (as listed in Table S5: Additional file 1). As a result, the number of eligible studies was relatively small; nonetheless, we employed this strategy to evaluate whether subsequent mRCTs could replicate the survival benefits observed in sRCTs with rigorous methodologies. Given the high standards of the included studies and the concordance of the results with previous literature, it is plausible that our findings could be extrapolated to positive sRCTs reported in specialty journals. Finally, our search was confined to international guidelines to explore sRCTs’ citations. This approach was chosen to ensure the quality of evidence synthesis and generalized perspective.

Conclusions

Our systematic review found that the statistically significant survival improvement shown in sRCTs was rarely confirmed by multicenter randomized evidence in intensive care settings. Clinicians should be cautious in altering routine clinical practices until well-conducted multicenter randomized trials are available. Given their substantial implications for global clinical practice, international guidelines should refrain from issuing a clear recommendation based solely on the positive results of sRCTs.

Availability of data and materials

We collected the summary data from published randomized trials. This published article and its supplementary files include all the data generated or analyzed for this study. Further information is available from the corresponding authors upon reasonable request.

Abbreviations

ICU:

Intensive care unit

IQR:

Interquartile range

mRCT:

Multicenter randomized controlled trial

PRISMA:

Preferred reporting items for systematic reviews and meta-analyses

sRCT:

Single-center randomized controlled trial

RCT:

Randomized controlled trial

References

  1. A Medical Research Council Investigation. Streptomycin treatment of pulmonary tuberculosis. Br Med J. 1948;2:769–82.

    Article  Google Scholar 

  2. Bellomo R, Warrillow SJ, Reade MC. Why we should be wary of single-center trials. Crit Care Med. 2009;37:3114–9.

    Article  PubMed  Google Scholar 

  3. Landoni G, Pieri M, Young PJ, Bellomo R. Why do multicenter randomized controlled trials not confirm the positive findings of single center randomized controlled trials in acute care? Minerva Anestesiol. 2019;85:194–200. https://doi.org/10.23736/s0375-9393.18.13070-7.

    Article  PubMed  Google Scholar 

  4. Ridgeon EE, Young PJ, Bellomo R, Mucchetti M, Lembo R, Landoni G. The fragility index in multicenter randomized controlled critical care trials. Crit Care Med. 2016;44:1278–84. https://doi.org/10.1097/ccm.0000000000001670.

    Article  PubMed  Google Scholar 

  5. Page MJ, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ. 2021;372:n71.

    Article  PubMed  PubMed Central  Google Scholar 

  6. Sterne JAC, Savović J, Page MJ, Elbers RG, Blencowe NS, Boutron I, et al. RoB 2: a revised tool for assessing risk of bias in randomised trials. BMJ. 2019;366:l4898.

    Article  PubMed  Google Scholar 

  7. Antonelli M, Conti G, Bufi M, Costa MG, Lappa A, Rocco M, et al. Noninvasive ventilation for treatment of acute respiratory failure in patients undergoing solid organ transplantation: a randomized trial. JAMA. 2000;283:235–41. https://doi.org/10.1001/jama.283.2.235.

    Article  CAS  PubMed  Google Scholar 

  8. Boyd O, Grounds RM, Bennett ED. A randomized clinical trial of the effect of deliberate perioperative increase of oxygen delivery on mortality in high-risk surgical patients. JAMA. 1993;270:2699–707.

    Article  CAS  PubMed  Google Scholar 

  9. de Jonge E, Schultz MJ, Spanjaard L, Bossuyt PM, Vroom MB, Dankert J, et al. Effects of selective decontamination of digestive tract on mortality and acquisition of resistant bacteria in intensive care: a randomised controlled trial. Lancet. 2003;362:1011–6. https://doi.org/10.1016/s0140-6736(03)14409-1.

    Article  PubMed  Google Scholar 

  10. de Silva HA, Fonseka MM, Pathmeswaran A, Alahakone DG, Ratnatilake GA, Gunatilake SB, et al. Multiple-dose activated charcoal for treatment of yellow oleander poisoning: a single-blind, randomised, placebo-controlled trial. Lancet. 2003;361:1935–8. https://doi.org/10.1016/s0140-6736(03)13581-7.

    Article  PubMed  Google Scholar 

  11. Dorian P, Cass D, Schwartz B, Cooper R, Gelaznikas R, Barr A. Amiodarone as compared with lidocaine for shock-resistant ventricular fibrillation. N Engl J Med. 2002;346:884–90. https://doi.org/10.1056/NEJMoa013029.

    Article  CAS  PubMed  Google Scholar 

  12. Girardis M, Busani S, Damiani E, Donati A, Rinaldi L, Marudi A, et al. Effect of conservative vs conventional oxygen therapy on mortality among patients in an intensive care unit: the oxygen-ICU randomized clinical trial. JAMA. 2016;316:1583–9. https://doi.org/10.1001/jama.2016.11993.

    Article  CAS  PubMed  Google Scholar 

  13. Hilbert G, Gruson D, Vargas F, Valentino R, Gbikpi-Benissan G, Dupon M, et al. Noninvasive ventilation in immunosuppressed patients with pulmonary infiltrates, fever, and acute respiratory failure. N Engl J Med. 2001;344:481–7. https://doi.org/10.1056/nejm200102153440703.

    Article  CAS  PubMed  Google Scholar 

  14. Lachman E, Pitsoe SB, Gaffin SL. Anti-lipopolysaccharide immunotherapy in management of septic shock of obstetric and gynaecological origin. Lancet. 1984;1:981–3. https://doi.org/10.1016/s0140-6736(84)92324-9.

    Article  CAS  PubMed  Google Scholar 

  15. Levacher S, Letoumelin P, Pateron D, Blaise M, Lapandry C, Pourriat JL. Early administration of terlipressin plus glyceryl trinitrate to control active upper gastrointestinal bleeding in cirrhotic patients. Lancet. 1995;346:865–8. https://doi.org/10.1016/s0140-6736(95)92708-5.

    Article  CAS  PubMed  Google Scholar 

  16. Morelli A, Ertmer C, Westphal M, Rehberg S, Kampmeier T, Ligges S, et al. Effect of heart rate control with esmolol on hemodynamic and clinical outcomes in patients with septic shock: a randomized clinical trial. JAMA. 2013;310:1683–91. https://doi.org/10.1001/jama.2013.278477.

    Article  CAS  PubMed  Google Scholar 

  17. Olasveengen TM, Sunde K, Brunborg C, Thowsen J, Steen PA, Wik L. Intravenous drug administration during out-of-hospital cardiac arrest: a randomized trial. JAMA. 2009;302:2222–9. https://doi.org/10.1001/jama.2009.1729.

    Article  PubMed  Google Scholar 

  18. Phu NH, Hien TT, Mai NT, Chau TT, Chuong LV, Loc PP, et al. Hemofiltration and peritoneal dialysis in infection-associated acute renal failure in Vietnam. N Engl J Med. 2002;347:895–902. https://doi.org/10.1056/NEJMoa020074.

    Article  PubMed  Google Scholar 

  19. Rivers E, Nguyen B, Havstad S, Ressler J, Muzzin A, Knoblich B, et al. Early goal-directed therapy in the treatment of severe sepsis and septic shock. N Engl J Med. 2001;345:1368–77. https://doi.org/10.1056/NEJMoa010307.

    Article  CAS  PubMed  Google Scholar 

  20. Ronco C, Bellomo R, Homel P, Brendolan A, Dan M, Piccinni P, et al. Effects of different doses in continuous veno-venous haemofiltration on outcomes of acute renal failure: a prospective randomised trial. Lancet. 2000;356:26–30. https://doi.org/10.1016/s0140-6736(00)02430-2.

    Article  CAS  PubMed  Google Scholar 

  21. Sack JB, Kesselbrenner MB, Bregman D. Survival from in-hospital cardiac arrest with interposed abdominal counterpulsation during cardiopulmonary resuscitation. JAMA. 1992;267:379–85.

    Article  CAS  PubMed  Google Scholar 

  22. Schiffl H, Lang SM, Fischer R. Daily hemodialysis and the outcome of acute renal failure. N Engl J Med. 2002;346:305–10. https://doi.org/10.1056/NEJMoa010877.

    Article  PubMed  Google Scholar 

  23. van den Berghe G, Wouters P, Weekers F, Verwaest C, Bruyninckx F, Schetz M, et al. Intensive insulin therapy in critically ill patients. N Engl J Med. 2001;345:1359–67. https://doi.org/10.1056/NEJMoa011300.

    Article  PubMed  Google Scholar 

  24. Villanueva C, Colomo A, Bosch A, Concepción M, Hernandez-Gea V, Aracil C, et al. Transfusion strategies for acute upper gastrointestinal bleeding. N Engl J Med. 2013;368:11–21. https://doi.org/10.1056/NEJMoa1211801.

    Article  CAS  PubMed  Google Scholar 

  25. Zarbock A, Kellum JA, Schmidt C, Van Aken H, Wempe C, Pavenstädt H, et al. Effect of early vs delayed initiation of renal replacement therapy on mortality in critically ill patients with acute kidney injury: the ELAIN randomized clinical trial. JAMA. 2016;315:2190–9. https://doi.org/10.1001/jama.2016.5828.

    Article  CAS  PubMed  Google Scholar 

  26. Angus DC, Birmingham MC, Balk RA, Scannon PJ, Collins D, Kruse JA, et al. E5 murine monoclonal antiendotoxin antibody in gram-negative sepsis: a randomized controlled trial. E5 Study Investigators. JAMA. 2000;283:1723–30. https://doi.org/10.1001/jama.283.13.1723.

    Article  CAS  PubMed  Google Scholar 

  27. The STARRT-AKI Investigators, & for the Canadian Critical Care Trials Group, the Australian and New Zealand Intensive Care Society Clinical Trials Group, the United Kingdom Critical Care Research Group, the Canadian Nephrology Trials Network, and the Irish Critical Care Trials Group. Timing of initiation of renal-replacement therapy in acute kidney injury. N Engl J Med. 2020;383:240–51. https://doi.org/10.1056/NEJMoa2000741.

    Article  Google Scholar 

  28. Barbar SD, Clere-Jehl R, Bourredjem A, Hernu R, Montini F, Bruyère R, et al. Timing of renal-replacement therapy in patients with acute kidney injury and sepsis. N Engl J Med. 2018;379:1431–42. https://doi.org/10.1056/NEJMoa1803213.

    Article  CAS  PubMed  Google Scholar 

  29. Bellomo R, Cass A, Cole L, Finfer S, Gallagher M, Lo S, et al. Intensity of continuous renal-replacement therapy in critically ill patients. N Engl J Med. 2009;361:1627–38. https://doi.org/10.1056/NEJMoa0902413.

    Article  PubMed  Google Scholar 

  30. de Smet AM, Kluytmans JA, Cooper BS, Mascini EM, Benus RF, van der Werf TS, et al. Decontamination of the digestive tract and oropharynx in ICU patients. N Engl J Med. 2009;360:20–31. https://doi.org/10.1056/NEJMoa0800394.

    Article  PubMed  Google Scholar 

  31. Eddleston M, Juszczak E, Buckley NA, Senarathna L, Mohamed F, Dissanayake W, et al. Multiple-dose activated charcoal in acute self-poisoning: a randomised controlled trial. Lancet. 2008;371:579–87. https://doi.org/10.1016/s0140-6736(08)60270-6.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  32. Escorsell A, Ruiz del Arbol L, Planas R, Albillos A, Bañares R, Calès P, et al. Multicenter randomized controlled trial of terlipressin versus sclerotherapy in the treatment of acute variceal bleeding: the TEST study. Hepatology. 2000;32:471–6. https://doi.org/10.1053/jhep.2000.16601.

    Article  CAS  PubMed  Google Scholar 

  33. Feu F, Ruiz del Arbol L, Bañares R, Planas R, Bosch J. Double-blind randomized controlled trial comparing terlipressin and somatostatin for acute variceal hemorrhage. Variceal Bleeding Study Group. Gastroenterology. 1996;111:1291–9. https://doi.org/10.1053/gast.1996.v111.pm8898643.

    Article  CAS  PubMed  Google Scholar 

  34. Finfer S, Chittock DR, Su SY, Blair D, Foster D, Dhingra V, et al. Intensive versus conventional glucose control in critically ill patients. N Engl J Med. 2009;360:1283–97. https://doi.org/10.1056/NEJMoa0810625.

    Article  PubMed  Google Scholar 

  35. Gaudry S, Hajage D, Schortgen F, Martin-Lefevre L, Pons B, Boulet E, et al. Initiation strategies for renal-replacement therapy in the intensive care unit. N Engl J Med. 2016;375:122–33. https://doi.org/10.1056/NEJMoa1603017.

    Article  PubMed  Google Scholar 

  36. Gelissen H, de Grooth HJ, Smulders Y, Wils EJ, de Ruijter W, Vink R, et al. Effect of low-normal vs high-normal oxygenation targets on organ dysfunction in critically ill patients: a randomized clinical trial. JAMA. 2021;326:940–8. https://doi.org/10.1001/jama.2021.13011.

    Article  CAS  PubMed  Google Scholar 

  37. Greenman RL, Schein RM, Martin MA, Wenzel RP, MacIntyre NR, Emmanuel G, et al. A controlled clinical trial of E5 murine monoclonal IgM antibody to endotoxin in the treatment of gram-negative sepsis. The XOMA Sepsis Study Group. JAMA. 1991;266:1097–102.

    Article  CAS  PubMed  Google Scholar 

  38. Jairath V, Kahan BC, Gray A, Doré CJ, Mora A, James MW, et al. Restrictive versus liberal blood transfusion for acute upper gastrointestinal bleeding (TRIGGER): a pragmatic, open-label, cluster randomised feasibility trial. Lancet. 2015;386:137–44. https://doi.org/10.1016/s0140-6736(14)61999-1.

    Article  PubMed  Google Scholar 

  39. Kakihana Y, Nishida O, Taniguchi T, Okajima M, Morimatsu H, Ogura H, et al. Efficacy and safety of landiolol, an ultra-short-acting β1-selective antagonist, for treatment of sepsis-related tachyarrhythmia (J-Land 3S): a multicentre, open-label, randomised controlled trial. Lancet Respir Med. 2020;8:863–72. https://doi.org/10.1016/s2213-2600(20)30037-0.

    Article  CAS  PubMed  Google Scholar 

  40. Kudenchuk PJ, Brown SP, Daya M, Rea T, Nichol G, Morrison LJ, et al. Amiodarone, lidocaine, or placebo in out-of-hospital cardiac arrest. N Engl J Med. 2016;374:1711–22. https://doi.org/10.1056/NEJMoa1514204.

    Article  CAS  PubMed  Google Scholar 

  41. Lemiale V, Mokart D, Resche-Rigon M, Pène F, Mayaux J, Faucher E, et al. Effect of noninvasive ventilation vs oxygen therapy on mortality among immunocompromised patients with acute respiratory failure: a randomized clinical trial. JAMA. 2015;314:1711–9. https://doi.org/10.1001/jama.2015.12402.

    Article  CAS  PubMed  Google Scholar 

  42. Mouncey PR, Osborn TM, Power GS, Harrison DA, Sadique MZ, Grieve RD, et al. Trial of early, goal-directed resuscitation for septic shock. N Engl J Med. 2015;372:1301–11. https://doi.org/10.1056/NEJMoa1500896.

    Article  CAS  PubMed  Google Scholar 

  43. Myburgh JA, Seppelt IM, Goodman F, Billot L, Correa M, Davis JS, et al. Effect of selective decontamination of the digestive tract on hospital mortality in critically ill patients receiving mechanical ventilation: a randomized clinical trial. JAMA. 2022;328:1911–21. https://doi.org/10.1001/jama.2022.17927.

    Article  PubMed  PubMed Central  Google Scholar 

  44. Palevsky PM, Zhang JH, O’Connor TZ, Chertow GM, Crowley ST, Choudhury D, et al. Intensity of renal support in critically ill patients with acute kidney injury. N Engl J Med. 2008;359:7–20.

    Article  CAS  PubMed  Google Scholar 

  45. ARISE Investigators and the ANZICS Clinical Trials Group. Goal-directed resuscitation for patients with early septic shock. N Engl J Med. 2014;371:1496–506. https://doi.org/10.1056/NEJMoa1404380.

    Article  CAS  Google Scholar 

  46. Perkins GD, Ji C, Deakin CD, Quinn T, Nolan JP, Scomparin C, et al. A randomized trial of epinephrine in out-of-hospital cardiac arrest. N Engl J Med. 2018;379:711–21. https://doi.org/10.1056/NEJMoa1806842.

    Article  CAS  PubMed  Google Scholar 

  47. Ponce D, Berbel MN, Abrão JM, Goes CR, Balbi AL. A randomized clinical trial of high volume peritoneal dialysis versus extended daily hemodialysis for acute kidney injury patients. Int Urol Nephrol. 2013;45:869–78. https://doi.org/10.1007/s11255-012-0301-2.

    Article  CAS  PubMed  Google Scholar 

  48. Schjørring OL, Klitgaard TL, Perner A, Wetterslev J, Lange T, Siegemund M, et al. Lower or higher oxygenation targets for acute hypoxemic respiratory failure. N Engl J Med. 2021;384:1301–11. https://doi.org/10.1056/NEJMoa2032510.

    Article  PubMed  Google Scholar 

  49. Yealy DM, Kellum JA, Huang DT, Barnato AE, Weissfeld LA, Pike F, et al. A randomized trial of protocol-based care for early septic shock. N Engl J Med. 2014;370:1683–93. https://doi.org/10.1056/NEJMoa1401602.

    Article  CAS  PubMed  Google Scholar 

  50. European Association for the Study of the Liver, European Association for the Study of the Liver. EASL Clinical Practice Guidelines for the management of patients with decompensated cirrhosis. J Hepatol. 2018;69:406–60. https://doi.org/10.1016/j.jhep.2018.03.024.

    Article  Google Scholar 

  51. Beasley R, Chien J, Douglas J, Eastlake L, Farah C, King G, et al. Thoracic Society of Australia and New Zealand oxygen guidelines for acute oxygen use in adults: “Swimming between the flags.” Respirology. 2015;20:1182–91. https://doi.org/10.1111/resp.12620.

    Article  PubMed  PubMed Central  Google Scholar 

  52. Leone M, Einav S, Chiumello D, Constantin J-M, De Robertis E, De Abreu MG, et al. Noninvasive respiratory support in the hypoxaemic peri-operative/periprocedural patient: a joint ESA/ESICM guideline. Intensive Care Med. 2020;46:697–713. https://doi.org/10.1007/s00134-020-05948-0.

    Article  PubMed  PubMed Central  Google Scholar 

  53. Dellinger RP, Levy MM, Carlet JM, Bion J, Parker MM, Jaeschke R, et al. Surviving Sepsis Campaign: international guidelines for management of severe sepsis and septic shock: 2008. Intensive Care Med. 2008;34:17–60. https://doi.org/10.1007/s00134-007-0934-2.

    Article  PubMed  Google Scholar 

  54. Evans L, Rhodes A, Alhazzani W, Antonelli M, Coopersmith CM, French C, et al. Surviving sepsis campaign: international guidelines for management of sepsis and septic shock 2021. Intensive Care Med. 2021;47:1181–247.

    Article  PubMed  PubMed Central  Google Scholar 

  55. Martin-Loeches I, Torres A, Nagavci B, Aliberti S, Antonelli M, Bassetti M, et al. ERS/ESICM/ESCMID/ALAT guidelines for the management of severe community-acquired pneumonia. Eur Respir J. 2023. https://doi.org/10.1183/13993003.00735-2022.

    Article  PubMed  Google Scholar 

  56. Dellinger RP, Carlet JM, Masur H, Gerlach H, Calandra T, Cohen J, et al. Surviving Sepsis Campaign guidelines for management of severe sepsis and septic shock. Crit Care Med. 2004;32:858–73. https://doi.org/10.1097/01.ccm.0000117317.18092.e4.

    Article  PubMed  Google Scholar 

  57. Rhodes A, Evans LE, Alhazzani W, Levy MM, Antonelli M, Ferrer R, et al. Surviving Sepsis Campaign: international guidelines for management of sepsis and septic shock: 2016. Intensive Care Med. 2017;43:304–77. https://doi.org/10.1007/s00134-017-4683-6.pdf.

    Article  PubMed  Google Scholar 

  58. Dellinger RP, Levy MM, Rhodes A, Annane D, Gerlach H, Opal SM, et al. Surviving sepsis campaign: international guidelines for management of severe sepsis and septic shock: 2012. Intensive Care Med. 2013;41:580–637. https://doi.org/10.1097/CCM.0b013e31827e83af.

    Article  Google Scholar 

  59. Zipes DP, Camm AJ, Borggrefe M, Buxton AE, Chaitman B, Fromer M, et al. ACC/AHA/ESC 2006 guidelines for management of patients with ventricular arrhythmias and the prevention of sudden cardiac death: a report of the American College of Cardiology/American Heart Association Task Force and the European Society of Cardiology Committee for Practice Guidelines (writing committee to develop Guidelines for Management of Patients With Ventricular Arrhythmias and the Prevention of Sudden Cardiac Death): developed in collaboration with the European Heart Rhythm Association and the Heart Rhythm Society. Circulation. 2006;114:e385-484. https://doi.org/10.1161/CIRCULATIONAHA.106.178233.

    Article  PubMed  Google Scholar 

  60. Soar J, Maconochie I, Wyckoff MH, Olasveengen TM, Singletary EM, Greif R, et al. 2019 International consensus on cardiopulmonary resuscitation and emergency cardiovascular care science with treatment recommendations. Resuscitation. 2019;145:95–150. https://doi.org/10.1016/j.resuscitation.2019.10.016.

    Article  PubMed  Google Scholar 

  61. Soar J, Donnino MW, Maconochie I, Aickin R, Atkins DL, Andersen LW, et al. 2018 International consensus on cardiopulmonary resuscitation and emergency cardiovascular care science with treatment recommendations summary. Resuscitation. 2018;133:194–206. https://doi.org/10.1016/j.resuscitation.2018.10.017.

    Article  PubMed  Google Scholar 

  62. Deakin CD, Nolan JP, Soar J, Sunde K, Koster RW, Smith GB, et al. European Resuscitation Council guidelines for resuscitation 2010 @@@. Adult advanced life support. Resuscitation. 2010;81:1305–52. https://doi.org/10.1016/j.resuscitation.2010.08.017.

    Article  PubMed  Google Scholar 

  63. Monsieurs KG, Nolan JP, Bossaert LL, Greif R, Maconochie IK, Nikolaou NI, et al. European Resuscitation Council guidelines for resuscitation 2015: @@@. Executive summary. Resuscitation. 2015;95:1–80. https://doi.org/10.1016/j.resuscitation.2015.07.038.

    Article  PubMed  Google Scholar 

  64. Soar J, Böttiger BW, Carli P, Couper K, Deakin CD, Djärv T, et al. European Resuscitation Council guidelines 2021: adult advanced life support. Resuscitation. 2021;161:115–51. https://doi.org/10.1016/j.resuscitation.2021.02.010.

    Article  PubMed  Google Scholar 

  65. Rossaint R, Bouillon B, Cerny V, Coats TJ, Duranteau J, Fernández-Mondéjar E, et al. The European guideline on management of major bleeding and coagulopathy following trauma: fourth edition. Crit Care. 2016;20:100. https://doi.org/10.1186/s13054-016-1265-x.

    Article  PubMed  PubMed Central  Google Scholar 

  66. Vlaar APJ, Dionne JC, de Bruin S, Wijnberge M, Raasveld SJ, van Baarle FEHP, et al. Transfusion strategies in bleeding critically ill adults: a clinical practice guideline from the European Society of Intensive Care Medicine. Intensive Care Med. 2021;47:1368–92. https://doi.org/10.1007/s00134-021-06531-x.

    Article  PubMed  PubMed Central  Google Scholar 

  67. Nolan JP, Deakin CD, Soar J, Böttiger BW, Smith G. European Resuscitation Council guidelines for resuscitation 2005. @@@. Adult advanced life support. Resuscitation. 2005;67(Suppl 1):S39-86. https://doi.org/10.1016/j.resuscitation.2005.10.009.

    Article  PubMed  Google Scholar 

  68. Dechartres A, Boutron I, Trinquart L, Charles P, Ravaud P. Single-center trials show larger treatment effects than multicenter trials: evidence from a meta-epidemiologic study. Ann Intern Med. 2011;155:39–51. https://doi.org/10.7326/0003-4819-155-1-201107050-00006.

    Article  PubMed  Google Scholar 

  69. Unverzagt S, Prondzinsky R, Peinemann F. Single-center trials tend to provide larger treatment effects than multicenter trials: a systematic review. J Clin Epidemiol. 2013;66:1271–80. https://doi.org/10.1016/j.jclinepi.2013.05.016.

    Article  PubMed  Google Scholar 

  70. Higgins AM, Peake SL, Ao RB, Ao DJC, Delaney A, Howe BD, et al. The cost-effectiveness of early goal-directed therapy: an economic evaluation alongside the ARISE trial. Crit Care Resusc. 2021;23:329–36.

    Google Scholar 

  71. De Backer D, Vincent J-L. Early goal-directed therapy: Do we have a definitive answer? Intensive Care Med. 2016;42:1048–50. https://doi.org/10.1007/s00134-016-4295-6.

    Article  PubMed  Google Scholar 

  72. Zampieri FG, Damiani LP, Bakker J, Ospina-Tascón GA, Castro R, Cavalcanti AB, et al. Effects of a resuscitation strategy targeting peripheral perfusion status versus serum lactate levels among patients with septic shock. A Bayesian reanalysis of the ANDROMEDA-SHOCK Trial. Am J Respir Crit Care Med. 2020;201:423–9. https://doi.org/10.1164/rccm.201905-0968OC.

    Article  CAS  PubMed  Google Scholar 

  73. Granholm A, Munch MW, Myatra SN, Vijayaraghavan BKT, Cronhjort M, Wahlin RR, et al. Dexamethasone 12 mg versus 6 mg for patients with COVID-19 and severe hypoxaemia: a pre-planned, secondary Bayesian analysis of the COVID STEROID 2 trial. Intensive Care Med. 2022;48:45–55. https://doi.org/10.1007/s00134-021-06573-1.

    Article  CAS  PubMed  Google Scholar 

Download references

Acknowledgements

The authors wish to appreciate all the patients and investigators of the included trials.

The authors also wish to thank the following collaborators for their extensive data collection: Rosario Losiggio, Gaetano Lombardi, and Nicolò Maimeri.

Funding

No funding was received concerning this manuscript.

Author information

Authors and Affiliations

  1. Department of Anesthesia and Intensive Care, IRCCS San Raffaele Scientific Institute, Via Olgettina 60, 20132, Milan, Italy

    Yuki Kotani, Stefano Turi, Alessandro Ortalda, Martina Baiardo Redaelli, Cristiano Marchetti & Giovanni Landoni

  2. School of Medicine, Vita-Salute San Raffaele University, Via Olgettina 58, 20132, Milan, Italy

    Yuki Kotani & Giovanni Landoni

  3. Department of Intensive Care Medicine, Kameda Medical Center, 929 Higashi-cho, Kamogawa, Chiba, 296-8602, Japan

    Yuki Kotani

  4. Department of Critical Care, The University of Melbourne, Melbourne, Australia

    Rinaldo Bellomo

  5. Australian and New Zealand Intensive Care Research Centre, Monash University, Melbourne, Australia

    Rinaldo Bellomo

Authors
  1. Yuki Kotani
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Stefano Turi
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Alessandro Ortalda
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Martina Baiardo Redaelli
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Cristiano Marchetti
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Giovanni Landoni
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Rinaldo Bellomo
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

YK, ST, AO, MBR, CM, GL, and RB conceived the study. YK, ST, AO, MBR, CM, and GL designed the search strategy and did the literature search. YK, ST, AO, MBR, CM, GL, and RB did the statistical analysis. YK, ST, and GL wrote the initial protocol. YK, ST, AO, MBR, CM, GL, and RB wrote the manuscript. All authors shared the study data, gave a critical appraisal of the protocol, provided crucial revisions, and approved the final manuscript.

Corresponding author

Correspondence to Giovanni Landoni.

Ethics declarations

Ethics approval and consent to participate

Not applicable.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1. 

Search strategy, PRISMA checklist, Supplementary tables, and Supplementary references.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kotani, Y., Turi, S., Ortalda, A. et al. Positive single-center randomized trials and subsequent multicenter randomized trials in critically ill patients: a systematic review. Crit Care 27, 465 (2023). https://doi.org/10.1186/s13054-023-04755-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13054-023-04755-5

Keywords

Critical Care

ISSN: 1364-8535