- Open Access
Underpowered trials in critical care medicine: how to deal with them?
Critical Care volume 14, Article number: 423 (2010)
In their recently published article, Dr Aberegg and colleagues described interesting results of a literature search for randomized controlled trials comparing mortality of therapies for critically ill adults in five high impact journals over a 10 year period . The authors show that the predicted delta (the effect size of a therapy compared to control) used for power calculations was substantially larger than the observed delta in the majority of the included studies. They conclude that this finding, referred to as 'delta inflation', led to underpowered trials in the field of critical care medicine.
We agree that treatment effects are small in this field of medicine and that many critical care trials have been underpowered. This problem is particularly relevant to the field of neurocritical care after traumatic brain injury . The IMPACT (International Mission on Prognosis and Clinical Trial Design in Traumatic Brain Injury) Study Group extensively investigated possible causes and solutions and recently reported recommendations for improving the design and analysis of future clinical trials in traumatic brain injury to increase statistical power . These include the use of relatively broad enrolment criteria instead of strict patient selection , covariate adjustment for baseline patient characteristics , and ordinal rather than dichotomous outcome analysis . In our opinion these recommendations are also applicable to other fields of critical care research characterized by heterogeneous patient populations. We submit that adopting these recommendations in future trials will increase the chance of detecting small but clinically relevant treatment effects in critical care medicine.
Aberegg SK, Richards DR, O'Brien JM: Delta inflation: a bias in the design of randomized controlled trials in critical care medicine. Crit Care 2010, 14: R77. 10.1186/cc8990
Maas AI, Roozenbeek B, Manley GT: Clinical trials in traumatic brain injury: past experience and current developments. Neurotherapeutics 2010, 7: 115-126. 10.1016/j.nurt.2009.10.022
Maas AI, Steyerberg EW, Marmarou A, McHugh GS, Lingsma HF, Butcher I, Lu J, Weir J, Roozenbeek B, Murray GD: IMPACT recommendations for improving the design and analysis of clinical trials in moderate to severe traumatic brain injury. Neurotherapeutics 2010, 7: 127-134. 10.1016/j.nurt.2009.10.020
Roozenbeek B, Maas AI, Lingsma HF, Butcher I, Lu J, Marmarou A, McHugh GS, Weir J, Murray GD, Steyerberg EW: Baseline characteristics and statistical power in randomized controlled trials: selection, prognostic targeting, or covariate adjustment? Crit Care Med 2009, 37: 2683-2690. 10.1097/CCM.0b013e3181ab85ec
Hernández AV, Steyerberg EW, Butcher I, Mushkudiani N, Taylor GS, Murray GD, Marmarou A, Choi SC, Lu J, Habbema JD, Maas AI: Adjustment for strong predictors of outcome in traumatic brain injury trials: 25% reduction in sample size requirements in the IMPACT study. J Neurotrauma 2006, 23: 1295-1303. 10.1089/neu.2006.23.1295
McHugh GS, Butcher I, Steyerberg EW, Marmarou A, Lu J, Lingsma HF, Weir J, Maas AI, Murray GD: A simulation study evaluating approaches to the analysis of ordinal outcome data in randomized controlled trials in traumatic brain injury: results from the IMPACT Project. Clin Trials 2010, 7: 44-57. 10.1177/1740774509356580
All authors are members of the IMPACT Study Group. The work of the IMPACT Study Group is funded by a grant of the US National Institutes of Health (NS-042691).