Open Access

Faulty risk-of-bias assessment in a meta-analysis of hydroxyethyl starch for nonseptic ICU patients

Critical Care201519:357

Published: 8 October 2015

The Letter to this article has been published in Critical Care 2015 19:444

Evaluating 6 % hydroxyethyl starch (HES) of different molecular weight and substitution versus other fluids for nonseptic patients, He et al. [1] did not confirm the increased mortality, renal replacement therapy (RRT), bleeding and red blood cell transfusions seen in sepsis. A favourable safety profile for 6 % HES solutions was suggested.

He et al. stated that Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines were followed, yet the meta-analysis lacked tests of interaction to compare different HES solutions and pre-specified subgroup analyses. The discussed limitations of the meta-analysis included study quality, heterogeneity, and problematic use [2] of gelatin as a control fluid. The Cochrane Collaboration Risk-of-Bias Tool was cited for guidance in the assessment of study quality, where any use of scales for risk of bias is explicitly discouraged because summary scores have been shown to be unreliable. He et al. calculated summary scores using a nonvalidated modified Jadad scale [3] where the highest possible score is 8, but the highest possible summary score for He et al. was only 7; reasons for this difference are obscure. Information on how assessment of risk of bias was actually performed is missing. For selective outcome reporting, the study by James et al. was wrongly judged as ‘low risk’ although ‘high risk’ had been identified previously [4, 5].

The key message from He et al. that 6 % HES does not seem to increase mortality or RRT incidence in nonseptic ICU patients is speculative because assessment of the study quality is insufficient. HES should be considered unsafe in all ICU patients until proven contrary in high-quality studies.

Authors’ response

  • Bin He,
  • Bo Xu,
  • Xiaoxing Xu,
  • Lixia Li,
  • Rongrong Ren,
  • Zhiyu Chen,
  • Jian Xiao,
  • Yingwei Wang and
  • Bin Xu
  • We thank Dr Bayer and Dr Reinhart for their comments, which we would like to nuance.

    Recently, Myburgh et al. [6] reported that there was no significant difference in 90-day mortality between patients resuscitated with 6 % HES or saline. Another international multicentre large-sample randomised controlled trial (RCT) also reported the use of colloids (including HES, gelatin, dextran and albumin) versus any crystalloids for volume expansion therapy to decrease 90-day mortality [7]. In addition, two meta-analyses also showed that HES did not increase mortality or renal injury in subgroup analyses of nonseptic patients [8, 9]. Our meta-analysis also obtained similar results.

    We had pre-specified subgroup analyses by different molecular weight of 6 % HES, risk of bias assessment and different kinds of fluids, all of which were found with no significant difference in mortality. We also made a brief analysis about the limitations of the meta-analysis. The Cochrane Collaboration Risk-of-Bias Tool and the modified Jadad scale were both always used for assessing the risk of bias [3, 8]. We apologise for the clerical error regarding the highest possible score in the modified Jadad scale and the inappropriate judgement for selective outcome reporting of the study by James et al.

    Owing to the limitation of the current RCTs, our conclusion did not suggest using HES for these patients, and advised further RCTs of high quality for further study.




    Hydroxyethyl starch


    Preferred Reporting Items for Systematic Reviews and Meta-Analyses


    Randomised controlled trial


    Renal replacement therapy


    Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (, which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver ( applies to the data made available in this article, unless otherwise stated.

    Authors’ Affiliations

    Department of Anaesthesiology and Intensive Care, Jena University Hospital
    Department of Anaesthesiology and Intensive Care, Center for Sepsis Control and Care, Chairman Global Sepsis Alliance, Jena University Hospital


    1. He B, Xu B, Xu X, Li L, Ren R, Chen Z, et al. Hydroxyethyl starch versus other fluids for non-septic patients in the intensive care unit: a meta-analysis of randomized controlled trials. Crit Care. 2015;19:92.View ArticlePubMed CentralPubMedGoogle Scholar
    2. Thomas-Rueddel DO, Vlasakov V, Reinhart K, Jaeschke R, Rueddel H, Hutagalung R, et al. Safety of gelatin for volume resuscitation—a systematic review and meta-analysis. Intensive Care Med. 2012;38:1134–42.View ArticlePubMedGoogle Scholar
    3. Bañares R, Albillos A, Rincón D, Alonso S, González M, Ruiz-del-Arbol L, et al. Endoscopic treatment versus endoscopic plus pharmacologic treatment for acute variceal bleeding: a meta-analysis. Hepatology. 2002;35:609–15.View ArticlePubMedGoogle Scholar
    4. Finfer S. Hydroxyethyl starch in patients with trauma. Br J Anaesth. 2012;108:159–60.View ArticlePubMedGoogle Scholar
    5. Reinhart K, Hartog CS. Hydroxyethyl starch in patients with trauma. Br J Anaesth. 2012;108:321–2.View ArticlePubMedGoogle Scholar
    6. Myburgh JA, Finfer S, Bellomo R, Billot L, Cass A, Gattas D, et al. Hydroxyethyl starch or saline for fluid resuscitation in intensive care. N Engl J Med. 2012;367:1901–11.View ArticlePubMedGoogle Scholar
    7. Annane D, Siami S, Jaber S, Martin C, Elatrous S, Declère AD, et al. Effects of fluid resuscitation with colloids vs crystalloids on mortality in critically ill patients presenting with hypovolemic shock: the CRISTAL randomized trial. JAMA. 2013;310:1809–17.View ArticlePubMedGoogle Scholar
    8. Zarychanski R, Abou-Setta AM, Turgeon AF, Houston BL, McIntyre L, Marshall JC, et al. Association of hydroxyethyl starch administration with mortality and acute kidney injury in critically ill patients requiring volume resuscitation: a systematic review and meta-analysis. JAMA. 2013;309:678–88.View ArticlePubMedGoogle Scholar
    9. Mutter TC, Ruth CA, Dart AB. Hydroxyethyl starch (HES) versus other fluid therapies: effects on kidney function. Cochrane Database Syst Rev. 2013;7:CD007594.PubMedGoogle Scholar


    © Bayer and Reinhart. 2015