Skip to main content
  • Commentary
  • Published:

Antimicrobial resistance and patient outcomes: the hazards of adjustment

Abstract

Outcomes studies of infections with resistant bacteria often do not account appropriately for intermediate variables – events in the causal pathway between the exposure and the outcome – when controlling for confounders. We discuss how failure to distinguish between confounders and intermediate variables can bias the analysis, and we address methods of approaching this issue.

Antimicrobial resistance in invasive infections is associated with adverse outcomes, including increased mortality, increased length of stay, and increased hospital costs [14]. A number of reasons have been suggested for this observation: a delay in institution of effective therapy, inferior definitive therapy as compared with that available for susceptible bacteria, and greater virulence of some resistant strains [35]. Pseudomonas aeruginosa, although inherently resistant to numerous antibiotics, appears to be no exception to this phenomenon: a number of studies have demonstrated an association between still broader resistance and mortality in infections caused by this pathogen [6, 7].

In the previous issue of Critical Care, Zavascki and colleagues report the results of a prospective cohort study of mortality associated with hospital-acquired pneumonia caused by P. aeruginosa [8]. The authors looked specifically at the effect on outcome of the production of metallo-β-lactamase (MBL), a group of carbapenamases that hydrolyze all β-lactam antibiotics with the exception of aztreonam. In crude analysis of 150 patients, MBL production was significantly associated with increased 30-day mortality, with a nearly twofold relative risk. In multivariable analysis, MBL production remained a significant predictor of mortality until inclusion of the variable 'appropriate antimicrobial therapy', which caused MBL production to lose its significance. The authors postulate that the collinearity between these two covariates demonstrates that MBL production leads to the administration of inappropriate therapy, which in turn increases mortality.

Another way to describe this phenomenon is that appropriateness of therapy is an intermediate variable; that is, a variable in the causative pathway between infection with a resistant organism (the exposure) and mortality (the outcome). Accordingly, infection with an MBL producer leads to inappropriate therapy, which in turn leads to increased mortality. This scenario is a prime example of how adjustment for intermediate variables may bias the association between exposure and outcome, often reducing its magnitude and even depriving it of statistical significance. In the case of inappropriate therapy and resistance, Zavascki and colleagues have correctly presented both models (with and without the variable appropriateness of therapy), and plausibly concluded that MBL production leads to increased mortality by causing a delay in appropriate therapy [8].

Zavascki and colleagues, however, do not account for adjustment for the variables 'severe sepsis/septic shock' and 'bacteremia' in the same manner. These are also intermediate variables, in the causative pathway between the exposure and the outcome. The methodologic flaw of adjusting for intermediate variables without accounting for them as such is common to many outcome studies of infections in seriously ill patients [911], and may bias the results [12, 13].

Control for confounding variables is crucial in analysis of outcomes studies, as factors such as the patient demographics, the severity of underlying illness, and the comorbid conditions may be closely associated with both the exposure (e.g. resistance, infection) and the outcome studied (e.g. death, length of stay, cost). Failure to adjust for such confounders will bias the results and may lead to erroneous conclusions. Adjustment for these confounders may be accomplished using validated tools such as the Acute Physiology and Chronic Health Evaluation (APACHE) score when studying the effect of intensive care unit events (such as acquisition of a resistant pathogen) on outcomes (such as mortality) [14].

Treating a confounder as an intermediate variable, or conversely, treating an intermediate variable as a confounder, may lead to false results. How, then, do we differentiate between the two? Both intermediate variables and confounders are associated with the outcome. The intermediate variable, however, unlike the confounder, is caused by the exposure. In the case of resistant hospital-acquired pneumonia, it is plausible that the natural course of the disease would entail pneumonia followed by bacteremia, leading to sepsis, septic shock, and consequent death. Nonintermediate variables such as the Charlson score, by contrast, predate the infection and are therefore not in the temporal pathway between infection and death.

A more subtle problem arises when an intermediate variable is itself a confounder. An example of this potential pitfall occurs when adjusting for physiological scores measured at the time of the onset of the infection. Recording the APACHE score at the onset of infection is problematic since the patient may already demonstrate signs of infection. In such a case, the APACHE score itself, utilized by the investigator to adjust for confounding, becomes an intermediate variable. The APACHE score should ideally be recorded before any signs of infection appear, but such data are often not available.

In constructing multivariable models in outcomes studies, the investigators must identify which of the included covariates are intermediate variables. These variables must be accounted for in the analysis in a way that accounts for their being intermediate [12, 15]. Our suggestion for a way to manage such analyses is to run the model with and without each intermediate variable, individually and together, in order to determine as accurately as possible the true independent predictors of the outcome under study.

Zavascki and colleagues, in the first reported outcomes study of MBL production in patients with hospital-acquired pneumonia, have appropriately accounted for the intermediate variable of inappropriate therapy, and thereby provided a plausible explanation for the effect of resistance on mortality via its effect on appropriateness of therapy [8]. We stand to gain even more insight into the effect of resistance on mortality if further analyses of these data take appropriate account of the additional intermediate variables of sepsis/septic shock and bacteremia. As multidrug resistance is an emerging threat among critically ill patients, future studies will be required to quantitate its effect in infections within this patient population. Analyses that deal appropriately with intermediate variables, including sepsis, shock, and physiological scores at time of infection, stand to provide the most valid information.

Abbreviations

APACHE:

APACHE = Acute Physiology and Chronic Health Evaluation

MBL =:

metallo-β-lactamase.

References

  1. Raymond DP, Pelletier SJ, Crabtree TD, Evans HL, Pruett TL, Sawyer RG: Impact of antibiotic-resistant Gram-negative bacilli infections on outcome in hospitalized patients. Crit Care Med 2003, 31: 1035-1041. 10.1097/01.CCM.0000060015.77443.31

    Article  PubMed  Google Scholar 

  2. Schwaber MJ, Navon-Venezia S, Kaye KS, Ben-Ami R, Schwartz D, Carmeli Y: Clinical and economic impact of bacteremia with extended-spectrum β-lactamase-producing Enterobacteriaceae . Antimicrob Agents Chemother 2006, 50: 1257-1262. 10.1128/AAC.50.4.1257-1262.2006

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  3. Cosgrove SE, Sakoulas G, Perencevich EN, Schwaber MJ, Karchmer AW, Carmeli Y: Comparison of mortality associated with methicillin-resistant and methicillin-susceptible Staphylococcus aureus bacteremia: a meta-analysis. Clin Infect Dis 2003, 36: 53-59. 10.1086/345476

    Article  PubMed  Google Scholar 

  4. DiazGranados CA, Zimmer SM, Klein M, Jernigan JA: Comparison of mortality associated with vancomycin-resistant and vancomycin-susceptible enterococcal bloodstream infections: a meta-analysis. Clin Infect Dis 2005, 41: 327-333. 10.1086/430909

    Article  PubMed  Google Scholar 

  5. Sahly H, Aucken H, Benedi VJ, Forestier C, Fussing V, Hansen DS, Ofek I, Podschun R, Sirot D, Tomas JM, et al.: Increased serum resistance in Klebsiella pneumoniae strains producing extended-spectrum β-lactamases. Antimicrob Agents Chemother 2004, 48: 3477-3482. 10.1128/AAC.48.9.3477-3482.2004

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  6. Laupland KB, Parkins MD, Church DL, Gregson DB, Louie TJ, Conly JM, Elsayed S, Pitout JD: Population-based epidemiological study of infections caused by carbapenem-resistant Pseudomonas aeruginosa in the Calgary Health Region: importance of metallo-β-lactamase (MBL)-producing strains. J Infect Dis 2005, 192: 1606-1612. 10.1086/444469

    Article  PubMed  Google Scholar 

  7. Gasink LB, Fishman NO, Weiner MG, Nachamkin I, Bilker WB, Lautenbach E: Fluoroquinolone-resistant Pseudomonas aeruginosa : assessment of risk factors and clinical impact. Am J Med 2006, 119: e19-e25. 10.1016/j.amjmed.2005.11.029

    Article  PubMed  Google Scholar 

  8. Zavascki AP, Barth AL, Fernandez JF, Moro ALD, Goncalves ALS, Goldani LZ: Reappraisal of Pseudomonas aeruginosa hospital-mediated pneumonia mortality in the era of metallo-β-lactamases-mediated multidrug resistance: a prospective observational study. Crit Care 2006, 10: R114. 10.1186/cc5006

    Article  PubMed Central  PubMed  Google Scholar 

  9. Soriano A, Martinez JA, Mensa J, Marco F, Almela M, Moreno-Martinez A, Sanchez F, Munoz I, Jimenez de Anta MT, Soriano E: Pathogenic significance of methicillin resistance for patients with Staphylococcus aureus bacteremia. Clin Infect Dis 2000, 30: 368-373. 10.1086/313650

    Article  CAS  PubMed  Google Scholar 

  10. Kang CI, Kim SH, Kim HB, Park SW, Choe YJ, Oh MD, Kim EC, Choe KW: Pseudomonas aeruginosa bacteremia: risk factors for mortality and influence of delayed receipt of effective antimicrobial therapy on clinical outcome. Clin Infect Dis 2003, 37: 745-751. 10.1086/377200

    Article  PubMed  Google Scholar 

  11. Micek ST, Lloyd AE, Ritchie DJ, Reichley RM, Fraser VJ, Kollef MH: Pseudomonas aeruginosa bloodstream infection: importance of appropriate initial antimicrobial treatment. Antimicrob Agents Chemother 2005, 49: 1306-1311. 10.1128/AAC.49.4.1306-1311.2005

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  12. Rothman KJ, Greenland S: Precision and validity in epidemiologic studies. In Modern Epidemiology. 2nd edition. Edited by: Rothman KJ, Greenland S. Philadelphia, PA: Lippincott Williams & Wilkins; 1998:120-125.

    Google Scholar 

  13. Perencevich EN: Excess shock and mortality in Staphylococcus aureus related to methicillin resistance. Clin Infect Dis 2000, 31: 1311-1313. 10.1086/317433

    Article  CAS  PubMed  Google Scholar 

  14. Zimmerman JE, Kramer AA, McNair DS, Malila FM: Acute Physiology and Chronic Health Evaluation (APACHE) IV: hospital mortality assessment for today's critically ill patients. Crit Care Med 2006, 34: 1297-1310. 10.1097/01.CCM.0000215112.84523.F0

    Article  PubMed  Google Scholar 

  15. Robins JM: The control of confounding by intermediate variables. Stat Med 1989, 8: 679-701.

    Article  CAS  PubMed  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Mitchell J Schwaber.

Additional information

Competing interests

The authors declare that they have no competing interests.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Schwaber, M.J., Carmeli, Y. Antimicrobial resistance and patient outcomes: the hazards of adjustment. Crit Care 10, 164 (2006). https://doi.org/10.1186/cc5019

Download citation

  • Published:

  • DOI: https://doi.org/10.1186/cc5019

Keywords