- Open Access
Early adoption of critical care interventions is unjustifiable without concomitant effectiveness study
Critical Care volume 24, Article number: 649 (2020)
In 1962, sociologist Everett Rogers created a framework to describe the diffusion of innovation in which he defined five groups by their enthusiasm to embrace new ideas—innovators, early adopters, the early majority, the late majority, and laggards . As applied to medicine, we can consider innovators to be researchers and early adopters to be early implementers in the clinical setting. Those who are slower to embrace novelty may worry that early adoption before a robust evidence base exists might violate our oath to “first, do no harm.” Critical care will always have its early adopters, however, who are excited to try out new therapies which may save lives. Wherever each of us falls on Rogers’s continuum, as a community we must harness the potential of the early adopters’ enthusiasm to inform our future practice. Specifically, we must demand that all early adoption be accompanied by: (1) high-quality observational studies; (2) a commitment to results dissemination, whether they be positive or negative; and (3) a concerted effort to abandon strategies which, after such study, are found to be of low value (Fig. 1).
Within critical care, there are numerous instances of significant early adoption based upon findings from imperfect studies (e.g., tight glucose control  or the utilization of hydrocortisone, high-dose ascorbic acid, and thiamine [HAT] for sepsis ). This may raise alarm in light of the frequency with which interventions initially thought to hold great promise have been found to be without efficacy (e.g., early goal-directed therapy for sepsis  or pulmonary artery catheters ) or even harmful (e.g., tight glycemic control ) when subjected to higher-quality study. In fact, in the face of COVID-19, many clinicians practiced early adoption of therapies with no evidence behind them; not surprisingly, in some instances, no benefit was found when properly evaluated (e.g., hydroxychloroquine ).
Effectiveness studies are of paramount importance to critical care both for therapies adopted early after scant evidence, but also to ensure findings from randomized controlled trials (RCTs) generalize well to the messy, heterogeneity of the real world. When conducted well, effectiveness studies can provide valuable insights which, frequently, are consistent with results from RCTs . As an example, our recent retrospective cohort analysis of > 65,000 adults with septic shock found use of HAT was associated with a 17% increased odds of death, nearly identical in magnitude to the effect found in the VITAMINS RCT . One of the biggest challenges for effectiveness studies is the issue of confounding by indication; however, when use is driven by provider personality rather than patient phenotype, the magnitude of this issue is substantially lessened. While results from observational studies may require confirmation by RCTs, associations suggestive of harm or benefit may alter further adoption and provide needed equipoise to compel trial initiation.
While imperfect, critical care registries can facilitate such study. Absent these, rigorous data collection on patients cared for by both the early adopters and their less-quick-to-act colleagues must be undertaken. With the proliferation of electronic medical records, much needed data may be ascertainable retrospectively; otherwise, prospective collection of, at least, a minimum dataset must be prioritized.
Even with these efforts, however, learning from our early adopters will be challenging as enthusiasm to publish “negative” study results will likely be low. Attempts to mediate publication bias in RCTs (e.g., the development of ClinicalTrials.gov) have not shown great success . Given the absence of similar mandatory registration processes for observational studies, we can expect publication bias to be even greater in this context. Yet, this is an opportunity for the early adopters among us; by pushing yourselves to present the results of effectiveness studies of interventions you have embraced—be they favorable or not—you solidify the importance of your role in our collective betterment. Without early adopters, understanding both the benefits and the harms of novel therapies in the real-world setting before widespread adoption occurs would be retarded.
Finally, if study reveals interventions are without value or, worse, associated with harm, use must cease. This seems straightforward, yet evidence suggests it will not be. As context, the critical care community as a whole is notably poor at achieving widespread use of proven interventions. Take, for example, the case of low-tidal volume ventilation for acute respiratory distress syndrome, a therapy with mortality benefits proven by a high-quality RCT . Nearly a decade after publication, compliance at multiple sites remained poor, with fewer than 3 in 10 patients receiving the intervention [12, 13]. De-adoption is even more challenged. In the face of new evidence suggesting non-value or even harm, critical care clinicians are slow and incompletely willing to abandon current paradigms of care [2, 14]. Early adopters—some found to be “impulsive”, but others, “reflexive” (cautiously evaluative of new technologies) —may be differently primed to de-adopt than the critical care community at large. Together, we must push ourselves to aggressively implement what we know is useful and to actively give up that which we have learned is not.
Critical care clinicians are, in some ways, as diverse as the patients for whom we provide care. Our heterogeneity in enthusiasm for potential new therapies is often apparent even within individual intensive care units. This is reality. Sometimes it may cause tension, yet it also provides opportunity. To harness this potential, however, requires a commitment to high-quality effectiveness research, near-complete results dissemination, and concerted efforts to improve both implementation of effective therapies and de-adoption of all others. Without this, early adoption—especially without high-quality preliminary trial data—is unjustifiable.
Availability of supporting data
Rogers EM. Diffusion of innovations. New York: Free Press of Glencoe; 1962.
Niven DJ, Rubenfeld GD, Kramer AA, Stelfox HT. Effect of published scientific evidence on glycemic control in adult intensive care units. JAMA Intern Med. 2015;175(5):801–9.
Vail EA, Wunsch H, Pinto R, Bosch NA, Walkey AJ, Lindenauer PK, Gershengorn HB. Use of hydrocortisone, ascorbic acid, and thiamine in adults with septic shock. Am J Respir Crit Care Med. 2020. https://doi.org/10.1164/rccm.202005-1829OC.
Angus DC, Barnato AE, Bell D, Bellomo R, Chong CR, Coats TJ, Davies A, Delaney A, Harrison DA, Holdgate A, et al. A systematic review and meta-analysis of early goal-directed therapy for septic shock: the ARISE, ProCESS and ProMISe Investigators. Intensive Care Med. 2015;41(9):1549–60.
Shah MR, Hasselblad V, Stevenson LW, Binanay C, O’Connor CM, Sopko G, Califf RM. Impact of the pulmonary artery catheter in critically ill patients: meta-analysis of randomized clinical trials. JAMA. 2005;294(13):1664–70.
Finfer S, Chittock DR, Su SY, Blair D, Foster D, Dhingra V, Bellomo R, Cook D, Dodek P, Henderson WR, et al. Intensive versus conventional glucose control in critically ill patients. N Engl J Med. 2009;360(13):1283–97.
Horby P, Mafham M, Linsell L, Bell JL, Staplin N, Emberson JR, Wiselka M, Ustianowski A, Elmahi E, Prudon B, et al. Effect of hydroxychloroquine in hospitalized patients with Covid-19. N Engl J Med. 2020. https://doi.org/10.1056/NEJMoa2022926.
Anglemyer A, Horvath HT, Bero L. Healthcare outcomes assessed with observational study designs compared with those assessed in randomized trials. Cochrane Database Syst Rev. 2014. https://doi.org/10.1002/14651858.MR000034.pub2.
Fujii T, Luethi N, Young PJ, Frei DR, Eastwood GM, French CJ, Deane AM, Shehabi Y, Hajjar LA, Oliveira G, et al. Effect of vitamin C, hydrocortisone, and thiamine vs hydrocortisone alone on time alive and free of vasopressor support among patients with septic shock: the VITAMINS randomized clinical trial. JAMA. 2020;323(5):423–31.
Ross JS, Mulvey GK, Hines EM, Nissen SE, Krumholz HM. Trial publication after registration in ClinicalTrials.Gov: a cross-sectional analysis. PLoS Med. 2009;6(9):e1000144.
Brower RG, Matthay MA, Morris A, Schoenfeld D, Thompson BT, Wheeler A, Network ARDS. Ventilation with lower tidal volumes as compared with traditional tidal volumes for acute lung injury and the acute respiratory distress syndrome. N Engl J Med. 2000;342(18):1301–8.
Weiss CH, Baker DW, Weiner S, Bechel M, Ragland M, Rademaker A, Weitner BB, Agrawal A, Wunderink RG, Persell SD. Low tidal volume ventilation use in acute respiratory distress syndrome. Crit Care Med. 2016;44(8):1515–22.
Spece LJ, Mitchell KH, Caldwell ES, Gundel SJ, Jolley SE, Hough CL. Low tidal volume ventilation use remains low in patients with acute respiratory distress syndrome at a single center. J Crit Care. 2018;44:72–6.
Gershengorn HB, Wunsch H. Understanding changes in established practice: pulmonary artery catheter use in critically ill patients. Crit Care Med. 2013;41:2667–76.
Gracia Rodríguez-Brito M, Ramírez-Díaz AJ, Ramos-Real FJ, Perez Y. Psychosocial traits characterizing EV adopters’ profiles: the case of Tenerife (Canary Islands). Sustainability. 2018;10:2053–78.
Ethical approval and consent to participate
Consent for publication
Dr. Gershengorn has no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Gershengorn, H.B. Early adoption of critical care interventions is unjustifiable without concomitant effectiveness study. Crit Care 24, 649 (2020). https://doi.org/10.1186/s13054-020-03382-8