Abbreviations
- NIT:
-
Non-inferiority trial
- ScvO2 :
-
Central venous oxygen saturation
Critical Care volume 21, Article number: 101 (2017)
I read with great interest the article by Zhou et al. [1] aiming to test whether a lactate-decreasing resuscitation protocol (lactate strategy), compared with central venous oxygen saturation-oriented resuscitation therapy (ScvO2 strategy), would decrease mortality among septic shock patients.
It is not clear why the authors performed a non-inferiority trial (NIT) whereas the primary objective of the study was to establish whether the lactate strategy was “superior” to the ScvO2 strategy [1]. Even though evidence of superiority can be claimed from NITs, there are several fundamental differences between superiority trials and NITs [2]. Whereas superiority trials aim to determine whether a new intervention is superior to the best available one, NITs seek to demonstrate that the new intervention is no worse than the comparator by more than a pre-specified, small amount. This amount is known as the non-inferiority margin, or delta (Δ). The null hypothesis (H0) of superiority trials asserts that there is no true difference between the interventions, and the alternative hypothesis (H1) states that there is a difference between the interventions. A type I error is the error of rejecting H0 when it is actually true. A type II error is a failure to reject H0 when in fact H1 is true. NITs, by contrast, have a H0 that the new intervention is inferior or worse than the old by more than − Δ (it is inferior). The H1 to be proven is that the new intervention is inferior to the standard intervention by less than − Δ (it is not inferior; Fig. 1) [2]. Thus, the definitions of type I and type II errors are reversed for NIT.
In this study, the authors claimed the superiority of the lactate strategy over the ScvO2 strategy because the lactate group had a significantly lower mortality compared with the ScvO2 group (18.3 versus 27.9%, P = 0.033). However, the P value that is calculated in NITs is special and is called the P value for non-inferiority, which differs from the P value for superiority [3]. The finding that P value of the difference in mortality was 0.033 means only that H1 is accepted and the lactate strategy is not inferior to the ScvO2 strategy. To be able to claim superiority, the 95% confidence interval of the mortality difference, which is not provided in this study, should exclude zero (Fig. 1).
Moreover, the non-inferiority margin in this study was 15% [1]. However, the authors did not provide any justification as to why they chose 15 rather than 10% as used in a previous trial [4].
Non-inferiority trial
Central venous oxygen saturation
Zhou X, Liu D, Su L, Yao B, Long Y, Wang X, Chai W, Cui N, Wang H, Rui X. Use of stepwise lactate kinetics-oriented hemodynamic therapy could improve the clinical outcomes of patients with sepsis-associated hyperlactatemia. Crit Care. 2017;21(1):33.
D'Agostino Sr RB, Massaro JM, Sullivan LM. Non-inferiority trials: design concepts and issues – the encounters of academic consultants in statistics. Stat Med. 2003;22(2):169–86.
Ferreira-González I. Basis for the interpretation of noninferiority studies: considering the ROCKET–AF, RE-LY, and ARISTOTLE Studies. Rev Esp Cardiol (Engl Ed). 2014;67(6):432–5.
Jones AE, Shapiro NI, Trzeciak S, Arnold RC, Claremont HA, Kline JA. Emergency Medicine Shock Research Network (EMShockNet) Investigators. Lactate kinetics vs central venous oxygen saturation as goals of early sepsis therapy: a randomized clinical trial. JAMA. 2010;303(8):739–46.
Not applicable.
Not applicable.
Not applicable.
JM drafted, read, and approved the final manuscript.
The author declares that he has no competing interests.
Not applicable.
Not applicable.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
See related research by Zhou et al., http://ccforum.biomedcentral.com/articles/10.1186/s13054-017-1617-1
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
Mallat, J. Understanding the null hypothesis (H0) in non-inferiority trials. Crit Care 21, 101 (2017). https://doi.org/10.1186/s13054-017-1685-2
Published:
DOI: https://doi.org/10.1186/s13054-017-1685-2