Skip to main content

Early adoption of critical care interventions is unjustifiable without concomitant effectiveness study

In 1962, sociologist Everett Rogers created a framework to describe the diffusion of innovation in which he defined five groups by their enthusiasm to embrace new ideas—innovators, early adopters, the early majority, the late majority, and laggards [1]. As applied to medicine, we can consider innovators to be researchers and early adopters to be early implementers in the clinical setting. Those who are slower to embrace novelty may worry that early adoption before a robust evidence base exists might violate our oath to “first, do no harm.” Critical care will always have its early adopters, however, who are excited to try out new therapies which may save lives. Wherever each of us falls on Rogers’s continuum, as a community we must harness the potential of the early adopters’ enthusiasm to inform our future practice. Specifically, we must demand that all early adoption be accompanied by: (1) high-quality observational studies; (2) a commitment to results dissemination, whether they be positive or negative; and (3) a concerted effort to abandon strategies which, after such study, are found to be of low value (Fig. 1).

Fig. 1
figure1

Theoretical timelines for study and adoption/de-adoption of novel interventions. RCT randomized controlled trial. Blue line: no change in adoption over time; green line: increasing adoption with time; red line: decreasing adoption with time. *Rapid de-adoption assumed following unfavorable phase 4 trial results under the assumption that regulatory approval would be rescinded rendering the therapeutic/technology unavailable

Within critical care, there are numerous instances of significant early adoption based upon findings from imperfect studies (e.g., tight glucose control [2] or the utilization of hydrocortisone, high-dose ascorbic acid, and thiamine [HAT] for sepsis [3]). This may raise alarm in light of the frequency with which interventions initially thought to hold great promise have been found to be without efficacy (e.g., early goal-directed therapy for sepsis [4] or pulmonary artery catheters [5]) or even harmful (e.g., tight glycemic control [6]) when subjected to higher-quality study. In fact, in the face of COVID-19, many clinicians practiced early adoption of therapies with no evidence behind them; not surprisingly, in some instances, no benefit was found when properly evaluated (e.g., hydroxychloroquine [7]).

Effectiveness studies are of paramount importance to critical care both for therapies adopted early after scant evidence, but also to ensure findings from randomized controlled trials (RCTs) generalize well to the messy, heterogeneity of the real world. When conducted well, effectiveness studies can provide valuable insights which, frequently, are consistent with results from RCTs [8]. As an example, our recent retrospective cohort analysis of > 65,000 adults with septic shock found use of HAT was associated with a 17% increased odds of death, nearly identical in magnitude to the effect found in the VITAMINS RCT [9]. One of the biggest challenges for effectiveness studies is the issue of confounding by indication; however, when use is driven by provider personality rather than patient phenotype, the magnitude of this issue is substantially lessened. While results from observational studies may require confirmation by RCTs, associations suggestive of harm or benefit may alter further adoption and provide needed equipoise to compel trial initiation.

While imperfect, critical care registries can facilitate such study. Absent these, rigorous data collection on patients cared for by both the early adopters and their less-quick-to-act colleagues must be undertaken. With the proliferation of electronic medical records, much needed data may be ascertainable retrospectively; otherwise, prospective collection of, at least, a minimum dataset must be prioritized.

Even with these efforts, however, learning from our early adopters will be challenging as enthusiasm to publish “negative” study results will likely be low. Attempts to mediate publication bias in RCTs (e.g., the development of ClinicalTrials.gov) have not shown great success [10]. Given the absence of similar mandatory registration processes for observational studies, we can expect publication bias to be even greater in this context. Yet, this is an opportunity for the early adopters among us; by pushing yourselves to present the results of effectiveness studies of interventions you have embraced—be they favorable or not—you solidify the importance of your role in our collective betterment. Without early adopters, understanding both the benefits and the harms of novel therapies in the real-world setting before widespread adoption occurs would be retarded.

Finally, if study reveals interventions are without value or, worse, associated with harm, use must cease. This seems straightforward, yet evidence suggests it will not be. As context, the critical care community as a whole is notably poor at achieving widespread use of proven interventions. Take, for example, the case of low-tidal volume ventilation for acute respiratory distress syndrome, a therapy with mortality benefits proven by a high-quality RCT [11]. Nearly a decade after publication, compliance at multiple sites remained poor, with fewer than 3 in 10 patients receiving the intervention [12, 13]. De-adoption is even more challenged. In the face of new evidence suggesting non-value or even harm, critical care clinicians are slow and incompletely willing to abandon current paradigms of care [2, 14]. Early adopters—some found to be “impulsive”, but others, “reflexive” (cautiously evaluative of new technologies) [15]—may be differently primed to de-adopt than the critical care community at large. Together, we must push ourselves to aggressively implement what we know is useful and to actively give up that which we have learned is not.

Critical care clinicians are, in some ways, as diverse as the patients for whom we provide care. Our heterogeneity in enthusiasm for potential new therapies is often apparent even within individual intensive care units. This is reality. Sometimes it may cause tension, yet it also provides opportunity. To harness this potential, however, requires a commitment to high-quality effectiveness research, near-complete results dissemination, and concerted efforts to improve both implementation of effective therapies and de-adoption of all others. Without this, early adoption—especially without high-quality preliminary trial data—is unjustifiable.

Availability of supporting data

Not applicable.

References

  1. 1.

    Rogers EM. Diffusion of innovations. New York: Free Press of Glencoe; 1962.

    Google Scholar 

  2. 2.

    Niven DJ, Rubenfeld GD, Kramer AA, Stelfox HT. Effect of published scientific evidence on glycemic control in adult intensive care units. JAMA Intern Med. 2015;175(5):801–9.

    Article  Google Scholar 

  3. 3.

    Vail EA, Wunsch H, Pinto R, Bosch NA, Walkey AJ, Lindenauer PK, Gershengorn HB. Use of hydrocortisone, ascorbic acid, and thiamine in adults with septic shock. Am J Respir Crit Care Med. 2020. https://doi.org/10.1164/rccm.202005-1829OC.

    Article  PubMed  Google Scholar 

  4. 4.

    Angus DC, Barnato AE, Bell D, Bellomo R, Chong CR, Coats TJ, Davies A, Delaney A, Harrison DA, Holdgate A, et al. A systematic review and meta-analysis of early goal-directed therapy for septic shock: the ARISE, ProCESS and ProMISe Investigators. Intensive Care Med. 2015;41(9):1549–60.

    CAS  Article  Google Scholar 

  5. 5.

    Shah MR, Hasselblad V, Stevenson LW, Binanay C, O’Connor CM, Sopko G, Califf RM. Impact of the pulmonary artery catheter in critically ill patients: meta-analysis of randomized clinical trials. JAMA. 2005;294(13):1664–70.

    CAS  Article  Google Scholar 

  6. 6.

    Finfer S, Chittock DR, Su SY, Blair D, Foster D, Dhingra V, Bellomo R, Cook D, Dodek P, Henderson WR, et al. Intensive versus conventional glucose control in critically ill patients. N Engl J Med. 2009;360(13):1283–97.

    Article  Google Scholar 

  7. 7.

    Horby P, Mafham M, Linsell L, Bell JL, Staplin N, Emberson JR, Wiselka M, Ustianowski A, Elmahi E, Prudon B, et al. Effect of hydroxychloroquine in hospitalized patients with Covid-19. N Engl J Med. 2020. https://doi.org/10.1056/NEJMoa2022926.

    Article  PubMed  PubMed Central  Google Scholar 

  8. 8.

    Anglemyer A, Horvath HT, Bero L. Healthcare outcomes assessed with observational study designs compared with those assessed in randomized trials. Cochrane Database Syst Rev. 2014. https://doi.org/10.1002/14651858.MR000034.pub2.

    Article  PubMed  Google Scholar 

  9. 9.

    Fujii T, Luethi N, Young PJ, Frei DR, Eastwood GM, French CJ, Deane AM, Shehabi Y, Hajjar LA, Oliveira G, et al. Effect of vitamin C, hydrocortisone, and thiamine vs hydrocortisone alone on time alive and free of vasopressor support among patients with septic shock: the VITAMINS randomized clinical trial. JAMA. 2020;323(5):423–31.

    Article  Google Scholar 

  10. 10.

    Ross JS, Mulvey GK, Hines EM, Nissen SE, Krumholz HM. Trial publication after registration in ClinicalTrials.Gov: a cross-sectional analysis. PLoS Med. 2009;6(9):e1000144.

    Article  Google Scholar 

  11. 11.

    Brower RG, Matthay MA, Morris A, Schoenfeld D, Thompson BT, Wheeler A, Network ARDS. Ventilation with lower tidal volumes as compared with traditional tidal volumes for acute lung injury and the acute respiratory distress syndrome. N Engl J Med. 2000;342(18):1301–8.

    Article  Google Scholar 

  12. 12.

    Weiss CH, Baker DW, Weiner S, Bechel M, Ragland M, Rademaker A, Weitner BB, Agrawal A, Wunderink RG, Persell SD. Low tidal volume ventilation use in acute respiratory distress syndrome. Crit Care Med. 2016;44(8):1515–22.

    Article  Google Scholar 

  13. 13.

    Spece LJ, Mitchell KH, Caldwell ES, Gundel SJ, Jolley SE, Hough CL. Low tidal volume ventilation use remains low in patients with acute respiratory distress syndrome at a single center. J Crit Care. 2018;44:72–6.

    Article  Google Scholar 

  14. 14.

    Gershengorn HB, Wunsch H. Understanding changes in established practice: pulmonary artery catheter use in critically ill patients. Crit Care Med. 2013;41:2667–76.

    Article  Google Scholar 

  15. 15.

    Gracia Rodríguez-Brito M, Ramírez-Díaz AJ, Ramos-Real FJ, Perez Y. Psychosocial traits characterizing EV adopters’ profiles: the case of Tenerife (Canary Islands). Sustainability. 2018;10:2053–78.

    Article  Google Scholar 

Download references

Acknowledgements

None.

Funding

None.

Author information

Affiliations

Authors

Contributions

Dr. Gershengorn was solely responsible for drafting this editorial. The author read and approved the final manuscript

Corresponding author

Correspondence to Hayley B. Gershengorn.

Ethics declarations

Ethical approval and consent to participate

Not applicable.

Consent for publication

Not applicable.

Competing interests

Dr. Gershengorn has no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Gershengorn, H.B. Early adoption of critical care interventions is unjustifiable without concomitant effectiveness study. Crit Care 24, 649 (2020). https://doi.org/10.1186/s13054-020-03382-8

Download citation