Skip to main content

Fallaces sunt rerum species et hominum spes fallunt (appearances are deceptive and betray the hopes of men)

We read with interest the study by Van den Akker and colleagues [1] on the association between mechanical ventilation, and renal failure. We consider it is a very interesting study, but feel some comments are needed.

The core of a meta-analysis is the combination of results across different studies. A major concern about meta-analysis is the range of the studies included in the sample because the trials included may introduce large inhomogeneity. The challenge consists in deciding which set of studies is ‘combinable’ [2].

In the meta-analysis by Van den Akker and colleagues [1] the risk of bias is very high due to sampling errors of the included studies. The authors selected trials that are completely different from each other: different diseases, different clinical severity, different therapeutic treatments. Besides this, the authors neglected the results of the statistical analysis, which showed great heterogeneity within the sample. To evaluate this heterogeneity the authors used Cochran’s Q statistic, and the I2 statistic. Both the Q test and I2 statistic of all included patients were indicative of high heterogeneity [3].

When the P-value (heterogeneity test) is significant, two approaches are possible: first, avoid summarizing the results and look for reasons for the heterogeneity; second, utilize ‘the random effects model’. Van den Akker and colleagues chose the latter approach, failing to check whether the heterogeneity was due to differences in the clinical studies, methodological issues, and/or publication bias. As stated by DerSimonian and Laird [4], the ‘random effects model is not a cure for difficulty in generalising the results of meta-analysis to the real-world situation’. From our point of view, the methodological errors of the meta-analysis of Van den Akker and colleagues produce misleading results.

References

  1. 1.

    Van den Akker JPC, Egal M, Groeneveld AB: Invasive mechanical ventilation as a risk factor for acute kidney injury in the critically ill: a systematic review and meta-analysis. Crit Care 2013, 17: R98. 10.1186/cc12743

    PubMed Central  Article  PubMed  Google Scholar 

  2. 2.

    Ades AE, Higgins JPT: The interpretation of random-effect meta-analysis in decision models. Med Decis Making 2005, 25: 646-654. 10.1177/0272989X05282643

    Article  CAS  PubMed  Google Scholar 

  3. 3.

    Higgins JPF, Thompson SG: Quantify heterogeneity in meta-analysis. Stat Med 2002, 21: 1539-1558. 10.1002/sim.1186

    Article  PubMed  Google Scholar 

  4. 4.

    DerSimonian R, Laird N: Meta-analysis in clinical trials. Contr Clin Trials 1986, 7: 177-188. 10.1016/0197-2456(86)90046-2

    Article  CAS  Google Scholar 

Download references

Author information

Affiliations

Authors

Corresponding author

Correspondence to Massimo Meco.

Additional information

Competing interests

The authors declare that they have no competing interests.

Rights and permissions

Reprints and Permissions

About this article

Cite this article

Meco, M., Giustiniano, E. Fallaces sunt rerum species et hominum spes fallunt (appearances are deceptive and betray the hopes of men). Crit Care 17, 451 (2013). https://doi.org/10.1186/cc12882

Download citation

Keywords

  • Renal Failure
  • Mechanical Ventilation
  • Emergency Medicine
  • Included Study
  • Therapeutic Treatment