Skip to main content

Does ventilator-associated event surveillance detect ventilator-associated pneumonia in intensive care units? A systematic review and meta-analysis

Abstract

Background

Ventilator-associated event (VAE) is a new surveillance paradigm for monitoring complications in mechanically ventilated patients in intensive care units (ICUs). The National Healthcare Safety Network replaced traditional ventilator-associated pneumonia (VAP) surveillance with VAE surveillance in 2013. The objective of this study was to assess the consistency between VAE surveillance and traditional VAP surveillance.

Methods

We systematically searched electronic reference databases for articles describing VAE and VAP in ICUs. Pooled VAE prevalence, pooled estimates (sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV)) of VAE for the detection of VAP, and pooled estimates (weighted mean difference (WMD) and odds ratio ([OR)) of risk factors for VAE compared to VAP were calculated.

Results

From 2191 screened titles, 18 articles met our inclusion criteria, representing 61,489 patients receiving mechanical ventilation at ICUs in eight countries. The pooled prevalence rates of ventilator-associated conditions (VAC), infection-related VAC (IVAC), possible VAP, probable VAP, and traditional VAP were 13.8 %, 6.4 %, 1.1 %, 0.9 %, and 11.9 %, respectively. Pooled sensitivity and PPV of each VAE type for VAP detection did not exceed 50 %, while pooled specificity and NPV exceeded 80 %. Compared with VAP, pooled ORs of in-hospital death were 1.49 for VAC and 1.76 for IVAC; pooled WMDs of hospital length of stay were −4.27 days for VAC and −5.86 days for IVAC; and pooled WMDs of ventilation duration were −2.79 days for VAC and −2.89 days for IVAC.

Conclusions

VAE surveillance missed many cases of VAP, and the population characteristics identified by the two surveillance paradigms differed. VAE surveillance does not accurately detect cases of traditional VAP in ICUs.

Background

Mechanical ventilation (MV) is a widely used intervention for critically ill patients in intensive care units (ICUs). Ventilator-associated pneumonia (VAP) is a clinically important, potentially preventable complication of mechanical ventilation [1–3].

Prior to 2013, the National Healthcare Safety Network (NHSN) monitored MV complications by VAP surveillance. The clinical diagnosis of VAP is based on clinical signs, chest radiography, and microbiological data. Clinical signs include: changes in sputum or tracheal secretions in terms of purulence, color, and/or increasing production; cough; temperature >38 or <36 °C; rales or bronchial breath sounds on examination, and worsening oxygenation. Laboratory findings include non-specific indicators of infection including leukocytosis (>12 × 109 white blood cells (WBC)/L) or leukopenia (<4.0 × 109 WBC/L). Signs on chest radiography include the development of new infiltrates or the presence of persistent and/or worsening infiltrates [4].

However, VAP surveillance relying on clinical criteria has proven highly problematic in practice, because most of these diagnostic criteria are not objective or specific [5–7], leaving a wide margin in the surveillance of infection for subjective diagnosis of VAP. Under strong pressure on hospitals to minimize VAP, these subjective criteria have been applied with increasing stringency, resulting in progressively lower prevalence of VAP. Indeed, previous NHSN reports indicate zero prevalence of VAP in more than 50 % of non-teaching ICUs in the USA [8, 9]. To a certain extent, this decrease reflects artifacts of VAP surveillance methods rather than true improvements in care [10].

As VAP surveillance has limited accuracy, the Centers for Disease Control (CDC) recommended a new surveillance paradigm based on ventilation-associated events (VAE) to assess complications in patients receiving MV. The ventilator-associated event paradigm includes a hierarchy of surveillance targets - ventilation-associated condition (VAC), infection-related ventilated-associated condition (IVAC), and possible and probable VAP. VAC is defined as at least two calendar days of stable or decreasing daily minimum positive end-expiratory pressure (PEEP) or daily minimum fraction of inspired oxygen (FiO2) followed by an increase in daily minimum PEEP by at least 3 cm H2O sustained for at least two calendar days or an increase in daily minimum FiO2 by at least 20 points sustained for at least two calendar days. IVAC is the subset of VAC that may be infection-related based on concurrent inflammatory signs and at least 4 days of new antibiotics. Possible VAP requires either Gram stain evidence of purulence or a pathogenic culture; probable pneumonia requires Gram stain evidence of purulence and quantitative or semi-quantitative growth of a pathogenic organism beyond defined thresholds [11].

The VAE paradigm broadens the focus of surveillance beyond the infectious etiology of respiratory failure to other physiological changes associated with suboptimal ventilator care or progression of underlying diseases, such as pulmonary edema, acute respiratory distress syndrome (ARDS), atelectasis, mucus plugging, pulmonary embolus, and radiation pneumonitis [12].

The NHSN replaced VAP surveillance with VAE surveillance in 2013, because the VAE paradigm makes surveillance more objective to facilitate automation and comparability [10]. Although VAE surveillance shifts the focus away from pneumonia and toward common complications that occur in critically ill patients receiving mechanical ventilation, VAP continues to play a major role in morbidity and length of stay (LOS) and is an important component of VAE. However, whether there are differences between VAP identified by the new VAE surveillance method compared with conventional VAP surveillance remains controversial. Some researchers report good correlation between the two surveillance paradigms [13], while others have claim that VAE surveillance does not accurately reflect VAP [14, 15].

Understanding the difference between VAE and VAP surveillance is valuable, because the change of surveillance paradigm may ultimately affect strategies for VAP prevention and control. Accordingly, we conducted a systematic review and meta-analysis of studies reporting consistency between VAE and VAP. Our objectives were primarily to quantitatively determine the consistency of VAP identification between the two surveillance paradigms, and secondarily to explore the differences in population characteristics between VAE and VAP surveillance.

Methods

Selection of studies

We electronically searched literature that reported prevalence of or risk factors for VAE in the PubMed, EMBASE, ScienceDirect, and Cochrane Database on 2 February 2016 for original articles published after 1 January 2010 in peer-reviewed journals. Relevant articles were identified according to the following Boolean expression: (ventilator-associated events [Title/Abstract] OR ventilator-associated conditions [Title/Abstract] OR ventilator-associated complications [Title/Abstract]) AND (prevalence [Mesh] OR risk factors [Mesh]). A reference list of key reviews was also searched for additional studies.

Selection criteria

Studies that assessed VAE, including VAC, IVAC, possible VAP, and probable VAP, among adult patients who received mechanical ventilation in an ICU were included in our meta-analysis. We included eligible studies that met at least one of the following criteria:

  1. 1.

    Studies providing original data that could be used to calculate the prevalence rate of VAE, odds ratio (OR), or weighted mean difference (WMD) of risk factors for VAE compared to VAP.

  2. 2.

    Studies reporting VAE and VAP in the same population that could be used to calculate relevant indicators of VAE surveillance for the detection of VAP (sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV).

Studies of paediatric patients or patients from the emergency department were excluded in our analysis. Conference proceedings, reviews, editorials, commentaries, letters and publications in abstract form only were also excluded. In the case of duplicate studies involving the same subject, we chose the most recent one study.

Study identification

All titles and abstracts of the citations that were generated by the literature search were screened independently by two reviewers. Relevant publications were reviewed in their entirety, and the reviewers were blinded to the author and research institution of each study. Each reviewer made a judgment on the inclusion or exclusion of the study. In the event of disagreement, a third reviewer served as a consultant to resolve the issue.

Data extraction

For each included report, the following data were extracted: publication date, region, population, baseline period, hospital, type of ICU, prevalence of VAE with number of cases (n) or corresponding denominators (N), and risk factors (including age, gender, the acute physiology and chronic health evaluation (APACHE) score, hospital length of stay, ICU length of stay, duration of ventilation, in-hospital mortality, and ICU mortality).

Quality assessment

The quality of the studies was assessed independently, using the Newcastle–Otawa scale (NOS) for non-randomised observational studies [16], while the Jadad scale was used for randomised controlled trials (RCTs) [17]. The NOS scale allocates a maximum of nine stars to a study, judged on three broad perspectives: the selection of the study groups; the comparability of the groups; and the ascertainment of either the exposure or outcome of interest for case–control or cohort studies, respectively. Studies were defined as poor (0–3), fair (4–6), or good (7–9). The Jadad scale assesses the quality of RCTs relevant to random assignment, double-blinding, and the flow of patients. It allocates a maximum of 5 points to a study. Studies were defined as poor (0–1), fair (2–3), or good (4–5). Two assessors independently evaluated the methodological quality of included studies, and disagreement was resolved through discussion with a third assessor.

Outcome measures

The primary outcomes were pooled prevalence rate and pooled consistency between VAE and VAP (sensitivity, specificity, PPV, and NPV). The secondary outcomes were pooled ORs and WMDs of relevant factors for VAE compared with VAP (age, sex, APACHE score, LOS, ventilation duration, and mortality). The meta-analysis comparison between VAE and VAP was limited to studies that reported VAE and VAP simultaneously. Studies that reported VAE only were not included in the comparison analysis but were included in the prevalence analysis. In the comparison analysis, continuous data were expressed as WMD and dichotomous data as OR.

Statistical analyses

A random effects model was used to calculate pooled estimates and their 95 % confidence intervals (CIs) if there was significant heterogeneity among studies. Otherwise, a fixed effects model was chosen. The VAP detection capability was assessed by receiver operating characteristic (ROC) curves. A ROC curve was plotted using the sensitivity and 1− specificity of each study that reported original data. Heterogeneity was assessed by the Q test and I 2 statistic. Egger’s test was used to estimate publication bias in meta-analyses containing more than two individual studies.

Sensitivity analysis was performed by limiting the meta-analysis to studies that used the standard CDC/NHSN definition of VAE for diagnosing VAE and the CDC/NHSN criteria for VAP with quantitative culture results in the diagnosis of VAP, in order to test the impact of the diagnosis method on the pooled results. All tests were two-tailed and statistical significance was defined by a p value <0.05. All analyses were conducted using STATA software (version 11.0, Stata corp., College Station, TX, USA). The study was reviewed and approved by the ethical committee of Union Hospital, Tongji Medical College, Huazhong University of Science and Technology.

Results

Our search identified 2192 publications. A flow diagram of the selection process is presented in Fig. 1. A total of 888 duplicate publications were removed, and of the remaining 1304 original articles, 1237 were excluded as irrelevant to the study objectives based on their titles and abstracts. Two authors independently reviewed 67 full-text articles and excluded 49 articles that did not meet the selection criteria. Ultimately, 18 studies [18–35] (12 cohort studies, 2 nested case–control studies, 2 time-series analysis studies, 1 screening test, and 1 RCT) were selected for final analysis. One study reported a group of patients from collaborative units undergoing daily spontaneous awakening and spontaneous breathing trials and a group of patients from surveillance-only units [18], and another study reported a group of patients undergoing subglottic secretion suctioning and a group of patients not having subglottic secretion suctioning [19]. For the purpose of our analysis, these groups were treated as four separate studies. Table 1 presents a list of the included studies and their characteristics. In all, the meta-analysis included 61,489 patients who received mechanical ventilation in ICUs in eight countries. Most studies were of acceptable quality, apart from one that was rated as poor (Additional file 1: Table S1).

Fig. 1
figure 1

Flow diagram of the selection process

Table 1 Characteristics of studies included in the meta-analysis

The pooled prevalence rates of each type of VAE and VAP are shown in Table 2. Among mechanically ventilated patients, the pooled prevalence of VAC (13.8 %, 95 % CI 9.0, 18.6 %) was higher, and that of IVAC (6.4 %, 95 % CI 4.8, 8.1 %) lower, than that of VAP (11.9 %, 95 % CI 9.4, 14.4 %). VAE surveillance detected fewer cases of possible and probable VAP among ventilated patients, with pooled prevalence rates of 1.1 % (95 % CI 0.5, 1.7 %) and 0.9 % (95 % CI 0.6, 1.2 %), respectively. Additionally, the pooled prevalence of VAE and VAP increased with the prolongation of ventilation.

Table 2 The results of pooled prevalence of VAE and VAP in included studies

In consistency analysis of VAE and VAP, pooled sensitivity was the highest for VAC at 41.8 % (95 % CI 17.7, 65.9 %) and lowest for probable VAP at 1.6 % (95 % CI 0.1, 3.2 %). Pooled PPV was the highest for IVAC at 47.2 % (95 % CI 16.1, 78.3 %) and lowest for probable VAP at 6.5 % (95 % CI 0.3, 12.6 %). Overall, the pooled estimates of sensitivity and PPV of each VAE type for the detection of VAP did not exceed 50 %. By contrast, the pooled specificity and NPV of VAC and IVAC were greater than 80 %, and those of possible VAP and probable VAP were nearly 100 % (Table 3). The ROC curve for IVAC showed a better capability of VAP detection compared with that of VAC (Fig. 2). ROC curves for possible and probable VAP were not plotted, because studies that provided original sensitivity and specificity data were scarce.

Table 3 The results of pooled estimates of VAE criteria for the detection of VAP
Fig. 2
figure 2

The receiver operating characteristic (ROC) curves for ventilator-associated conditions (VAC) and infection-related VAC (IVAC) for the detection of ventilator-associated pneumonia (VAP). Scatter points were plotted by the pooled sensitivity and 1-specificity of each included study and trend lines were fitted by the log function. ROCs were not plotted for possible and probable VAP, because studies that provided original sensitivity and specificity data were scarce

The results of comparisons of population characteristics between VAE and VAP surveillance are shown in Table 4. In-hospital mortality in VAE was higher than that of VAP: the pooled OR of death in hospital was 1.49 (95 % CI 1.11, 2.01) for VAC and 1.76 (95 % CI 1.23, 2.52) for IVAC. Hospital LOS was shorter for VAE compared to VAP: the pooled WMD of hospital LOS was −4.27 days (95 % CI −7.00, −1.55 days) for VAC and −5.86 days (95 % CI −9.46, −2.25 days) for IVAC. Additionally, compared with VAP, the pooled WMD of ventilation duration was −2.79 days (95 % CI −4.79, −0.80 days) for VAC and −2.89 days (95 % CI −5.58, −0.20 days) for IVAC. On the other hand, VAE and VAP did not significantly differ by age, sex, APACHE score, or ICU LOS.

Table 4 Risk factors in patients with VAE compared with patients with VAP in all included studies

In sensitivity analysis, limiting the meta-analysis to studies that employed the standard CDC/NHSN criteria for VAE [18–21, 23–32, 35] and definite VAP identified by quantitative culture of specimens from patients [19, 21, 24, 28, 35], the pooled estimates were robust except for pooled prevalence (Additional file 1: Tables S2–S4). The pooled prevalence rates of each VAE type decreased but VAP increased after limiting the analyses to these studies. The new pooled prevalence of VAC (8.0 %, 95 % CI 6.5, 9.6 %) and IVAC (4.0 %, 95 % CI 3.1, 4.9 %) were lower than that of VAP (13.0 %, 95 % CI 6.3, 19.7 %).

Among all meta-analyses containing more than two individual studies, publication bias was detected only for pooled sensitivity (p < 0.01) and negative predictive value of VAC (p < 0.01), and pooled prevalence of VAP (p = 0.01).

Discussion

In our systematic review, the pooled VAE prevalence among patients who received mechanical ventilation in the ICU, 13.8 %, was higher than the observed 11.9 % pooled prevalence of VAP. This result is reasonable, because the VAE paradigm aims to identify a broader range of ventilator-associated complications, including both infectious complications (such as pneumonia, tracheitis, and tracheobronchitis) and non-infectious complications (such as atelectasis, pulmonary embolism, pulmonary oedema, and ventilator-induced lung injury) [36]. In a previous study VAP was estimated to be the most common complication, accounting for about 25–40 % of VAE, followed by fluid overload at 20–40 %, ARDS at 10–20 %, and atelectasis at 10–15 % [37]. Theoretically, by excluding non-infectious complications among VAE, IVAC should be more representative of VAP, and its prevalence should be closer to but still higher than VAP. However, in our meta-analysis, the pooled prevalence of IVAC was lower than that of VAP, and even in the sensitivity analysis, both VAC and IVAC were lower than VAP after limiting the evaluation to studies that used stricter diagnostic criteria. This result indicates that VAE surveillance might miss a certain number of cases of VAP.

Actually, among the 11 studies included in our meta-analysis that reported both VAC and VAP [19–22, 24–26, 28, 31, 32, 34], the pooled sensitivity of VAC for the detection of VAP was not satisfactory. Only 41.8 % of cases of VAP could be identified by using the VAC criteria; in other words, VAC surveillance missed about 60 % of ventilated patients who developed pneumonia. Similarly, the pooled PPV of VAC from nine studies [19, 21, 22, 24–26, 28, 32, 34] also indicated a poor capability for VAP detection. Only 23.2 % of patients who met the VAC criteria would be diagnosed as having VAP. Even excluding the non-infectious complications among VAE, the pooled sensitivity and PPV of IVAC, possible VAP and probable VAP for the detection of VAP were still low.

Most patients with VAP did not meet the VAE criteria, mainly because they did not meet the requirements for stable baseline mechanical ventilator settings or threshold levels of worsening gas exchange. In a study by Lilly et al., 70.8 % of patients with VAP did not have 2 days of stable oxygenation in the time frame required by the VAE criteria [26]. Moreover, this percentage was 82.6 % in a study by Annop at al., and only 17.4 % for insufficient levels of worsening gas exchange [35]. In contrast, in the study by Klouwenberg at al. [28], among VAP episodes that did not fulfil the criteria for VAE, those with no baseline period of stability accounted for only 24.0 % of the cohort, and those with insufficient increase in ventilator settings accounted for 76.0 % of the cohort. Similarly, in a study by Stoeppel et al., these rates were 39.4 % for insufficient period of stability followed by worsening oxygenation and 47.5 % for duration of respiratory deterioration less than 2 days [24].

Another explanation for the poor validity of VAE criteria for identifying VAP is that VAE criteria do not rely on chest radiography, which is the most sensitive indicator of pathologically diagnosed VAP [38, 39]. On the other hand, although the established diagnostic criteria for VAP are widely clinically accepted and applied, recent VAP criteria are seriously flawed in the subjectivity of clinical diagnosis, which might be another factor affecting the consistency of detection results between the two surveillance methods [40].

In our meta-analysis, although there were high rates of pooled specificity and high NPV for the VAE paradigm, the value of VAE for VAP detection was limited, given that negative screens are caused not only by cases in which the entity is absent, but also by those in which the entity is missed or not clear. In fact the VAP diagnostic criteria, which have been regarded as the gold standard for screening tests, are not objective or specific criteria, so high specificity or NPV for VAE does not indicate that an acceptable proportion of cases of VAP were detected by the screening test.

Some characteristics of the populations identified by VAE and VAP surveillance also significantly differed. Both VAE and VAP could prolong the length of ventilation and hospital stay, but the risk intensity was different in these two paradigms. By definition, VAE and VAP should differ in ventilation duration, because VAP requires the patient to receive mechanical ventilation for more than 2 days, while at least 4 days are required for VAE. However, interestingly, the pooled WMD of ventilation duration for VAE was about −3 days compared with VAP. This result implies that patients with VAE who did not meet VAP criteria such as fluid overload, ARDS, and atelectasis, tended to receive a shorter duration of mechanical ventilation. Similarly, the mean hospital LOS for VAC and IVAC was about 4–6 days shorter than that of VAP. These differences may have been due to discrepancies in the severity of comorbidities and differences in the timing of extubation.

Additionally, the in-hospital mortality of VAC and IVAC was approximately twofold higher than that of VAP. In fact, a sustained decrease in oxygenation is an independent risk factor for mortality in ventilated patients [41], and thus, higher mortality associated with VAE may due to the VAE criteria aiding in the detection of more severe patients with poorer oxygenation [20]. Only patients with complications severe enough to merit the threshold levels of worsening gas exchange met the VAE criteria, whereas patients with slight worsening of gas exchange could still be diagnosed with VAP [34]. Indeed, about 60 % of patients diagnosed with VAP did not meet the VAE criteria in our meta-analysis.

Overall, we found that patients’ duration of ventilation and hospital stay were shorter in the VAE paradigm than in the VAP paradigm, while in-hospital mortality was higher in the VAE paradigm than in the VAP paradigm. In other words, the characteristics of patients identified by VAP surveillance were not accurately reflected by VAE surveillance. Confounding complications in VAE cases could have an influence on the significance of risk factors. For example, ARDS was the most common complication in VAE (46.8 %) in the study of Lilly et al. [26] while it only accounted for 16.4 % of patients with VAE in the study of Boyer et al. [21]. Consequently, the OR of in-hospital death for VAE compared with VAP in the former study was 1.50 (95 % CI 0.88 ~ 2.56) with no statistical difference, whereas it was 2.29 (95 % CI 1.19 ~ 4.43) reflecting a statistical difference in the latter study. The difference in distributions of complications may affect the population characteristics of VAE surveillance, which aims to identify a broader spectrum of complications of mechanical ventilation.

VAE surveillance has several advantages. First, VAE diagnosis is less time-consuming than traditional VAP diagnosis. The VAE paradigm was designed to rely on objective measures that can be easily assessed by professionals in the detection of infection. A study conducted in two hospitals indicated that VAE reviewers required 12 h to manually diagnose 400 ventilated patients, while the traditional VAP reviewer required 260 hours [34]. Furthermore, objective measures can be easily coded into computerized programmes. Consequently, software-based automatic data collection processes can further reduce the time needed for VAE identification. In a previous study, automatic VAE surveillance required only 1 minute to assess 110 patients, compared to 60.7 minutes using manual surveillance [42].

Second, the VAE paradigm maximizes the objectivity of surveillance to improve comparability [10]. Quantitative measures of VAE are commonly available in every ICU; thus, the objective criteria enable different institutions to compare their rates with greater confidence, such that differences in rates reflect differences in patients and processes of care rather than subjective and unquantifiable surveillance biases.

Third, including a broader spectrum of complications is beneficial to identifying a population of patients with serious complications who have not been acknowledged previously [2]. In fact, the VAE paradigm is able to identify not only patients with complications of mechanical ventilation but also those with severe respiratory compromise or progressive underlying disease, despite optimal care. Therefore, the broader spectrum is beneficial to monitoring critically ill patients in the ICU, making it possible to prevent severe complications at an early stage.

Strengths of our study include the quantitative methodology of the systematic review, a large sample size for estimating the prevalence of each type of VAE, and the assessment of consistency between VAE and VAP surveillance. However, our meta-analysis also has limitations. First, heterogeneity is a common problem for meta-analyses of observational studies, particularly those that involve proportions [43–45]. We attempted to explain heterogeneity by performing subgroup analyses, but after an exploration of the factors that were likely to contribute to the variation, such as study design and population characteristics, the heterogeneity remained unexplained. Although objective measures were used as the criteria for VAE monitoring, they were implemented independently in different hospitals and ICUs. Therefore, it is difficult to ensure that all surveillance activities are homogeneous in clinical practice. These constraints and variations in setting, such as patients’ baseline characteristics, data collection methods, and surveillance systems, may account at least in part for the significant heterogeneity observed [28].

Second, not every study reported prevalence or the original number of cases of VAE within each ventilation duration group, which is why the number of included studies within each ventilation duration sub-group was not equal, particularly for the small number of studies in groups with MV ≥3 days, MV ≥4 days, and MV ≥5 days. The insufficient number of studies included in these groups led to an unstable pooled prevalence with a broader 95 % CI in the meta-analysis; even 95 % CIs in which the lower limit was negative were observed in several groups in our study. Therefore, the results in these groups should be interpreted with caution, and more high-quality studies with standardized ventilation duration groups are needed in the future.

Third, we did not conduct sub-group analysis in different types of ICU because of insufficient sub-group data within each type. The type of ICU type be a significant confounding factor affecting the prevalence and population characteristics of patients with VAE and VAP [26, 30]. Although the studies included in the meta-analysis reported their own ICU type, most provided the overall data from mixed ICU types rather than the sub-group data for each type. Consequently, it was difficult to separate total data into sub-group data according to ICU type in most included studies.

Finally, not all studies in our meta-analysis used the same diagnostic criteria. We included three studies that did not strictly meet CDC/NHSN criteria for VAE. A multicentre study in France slightly adapted the VAE definition, taking into account the change in PaO2/FiO2 with regard to the level of PEEP as a more reliable criterion for the assessment of worsening oxygenation [22]. Two studies used an early definition of VAE prior to the implementation of VAE surveillance by the NHSN in January 2013 [33, 34]. These early studies diagnosed VAE using looser criteria relative to the CDC/NHSN definition. In addition, our meta-analysis contains five studies that applied stricter VAP diagnostic criteria with quantitative culture of specimens [19, 21, 24, 28, 35]. After limiting the meta-analysis to these studies using stricter diagnostic criteria, the pooled estimates of each VAE type and of VAP changed, but these changes have limited effects on the relationship between VAE and VAP: the VAE paradigm still missed a certain number of cases of VAP, in-hospital mortality was still higher in patients with VAE than with VAP, and ventilation duration was still shorter in patients with VAE than with VAP.

Conclusions

Overall, the findings of the present study indicate that VAE surveillance may not be suitable for identifying patients with VAP. As each surveillance paradigm has its own advantages, we suggest that traditional VAP surveillance should not be replaced entirely by VAE surveillance, but rather for both VAE and VAP surveillance to be carried out in tandem according to the specific conditions of each hospital and ICU.

Abbreviations

APACHE:

acute physiology and chronic health evaluation

ARDS:

acute respiratory distress syndrome

CDC:

the Centers for Disease Control

CIs:

confidence intervals

CPIS:

the clinical pulmonary infection score

FiO2 :

fraction of inspired oxygen

ICU:

intensive care unit

IVAC:

infection-related ventilator-associated conditions

LOS:

length of stay

MV:

mechanical ventilation

NHSN:

the National Healthcare Safety Network

NPV:

negative predictive value

OR:

odds ratio

PEEP:

positive end-expiratory pressure

PPV:

positive predictive value

RCT:

randomized control trial

ROC:

receiver operating characteristic

VAC:

ventilator-associated conditions

VAE:

ventilator-associated event

VAP:

ventilator-associated pneumonia

WBC:

white blood cells

WMD:

weighted mean difference

References

  1. Vincent JL, Rello J, Marshall J, Silva E, Anzueto A, Martin CD, Moreno R, Lipman J, Gomersall C, Sakr Y, Reinhart K, Investigators EIGo. International study of the prevalence and outcomes of infection in intensive care units. JAMA. 2009;302:2323–9.

    Article  CAS  PubMed  Google Scholar 

  2. Chahoud J, Semaan A, Almoosa KF. Ventilator-associated events prevention, learning lessons from the past: a systematic review. Heart Lung. 2015;44:251–9.

    Article  PubMed  Google Scholar 

  3. Waters B, Muscedere J. A 2015 Update on ventilator-associated pneumonia: new insights on its prevention, diagnosis, and treatment. Curr Infect Dis Rep. 2015;17:496.

    Article  PubMed  Google Scholar 

  4. Klompas M. Does this patient have ventilator-associated pneumonia? JAMA. 2007;297:1583–93.

    Article  CAS  PubMed  Google Scholar 

  5. Nussenblatt V, Avdic E, Berenholtz S, Daugherty E, Hadhazy E, Lipsett PA, Maragakis LL, Perl TM, Speck K, Swoboda SM, Ziai W, Cosgrove SE. Ventilator-associated pneumonia: overdiagnosis and treatment are common in medical and surgical intensive care units. Infect Control Hosp Epidemiol. 2014;35:278–84.

    Article  PubMed  Google Scholar 

  6. Stevens JP, Kachniarz B, Wright SB, Gillis J, Talmor D, Clardy P, Howell MD. When policy gets it right: variability in U.S. hospitals’ diagnosis of ventilator-associated pneumonia. Crit Care Med. 2014;42:497–503.

    Article  PubMed  Google Scholar 

  7. Klein Klouwenberg PM, Ong DS, Bos LD, de Beer FM, van Hooijdonk RT, Huson MA, Straat M, van Vught LA, Wieske L, Horn J, Schultz MJ, van der Poll T, Bonten MJ, Cremer OL. Interobserver agreement of Centers for Disease Control and Prevention criteria for classifying infections in critically ill patients. Crit Care Med. 2013;41:2373–8.

    Article  PubMed  Google Scholar 

  8. Dudeck MA, Weiner LM, Allen-Bridson K, Malpiedi PJ, Peterson KD, Pollock DA, Sievert DM, Edwards JR. National Healthcare Safety Network (NHSN) report, data summary for 2012, device-associated module. Am J Infect Control. 2013;41:1148–66.

    Article  PubMed  PubMed Central  Google Scholar 

  9. Dudeck MA, Horan TC, Peterson KD, Allen-Bridson K, Morrell G, Pollock DA, Edwards JR. National Healthcare Safety Network (NHSN) Report, data summary for 2010, device-associated module. Am J Infect Control. 2011;39:798–816.

    Article  PubMed  Google Scholar 

  10. Klompas M. Complications of mechanical ventilation–the CDC’s new surveillance paradigm. N Engl J Med. 2013;368:1472–5.

    Article  CAS  PubMed  Google Scholar 

  11. Klompas M. Ventilator-associated events surveillance: a patient safety opportunity. Curr Opin Crit Care. 2013;19:424–31.

    Article  PubMed  Google Scholar 

  12. Hsu HY, Kung SC, Chang HC, Chao CM. Need more in-depth analysis of ventilator-associated events? Crit Care Med. 2014;42:e726.

    Article  PubMed  Google Scholar 

  13. Havaldar AA, Rajagopalan N, Gupta V, Manjunath PH. Do ventilator associated events (VAE) predict ventilator associated pneumonia (VAP)? Intensive Care Med. 2014;40:S54.

    Google Scholar 

  14. Klompas M, Berra L. Should ventilator-associated events become a quality indicator for ICUs? Respir Care. 2016;61:723–36.

    Article  PubMed  Google Scholar 

  15. Chang HC, Kung SC, Wang CM, Liu WL. Discordance between novel and traditional surveillance paradigms of ventilator-associated pneumonia. Infect Control Hosp Epidemiol. 2014;35:1195–6.

    Article  PubMed  Google Scholar 

  16. Stang A. Critical evaluation of the Newcastle-Ottawa scale for the assessment of the quality of nonrandomized studies in meta-analyses. Eur J Epidemiol. 2010;25:603–5.

    Article  PubMed  Google Scholar 

  17. Clark HD, Wells GA, Huet C, McAlister FA, Salmi LR, Fergusson D, Laupacis A. Assessing the quality of randomized trials: reliability of the Jadad scale. Control Clin Trials. 1999;20:448–52.

    Article  CAS  PubMed  Google Scholar 

  18. Klompas M, Anderson D, Trick W, Babcock H, Kerlin MP, Li L, Sinkowitz-Cochran R, Ely EW, Jernigan J, Magill S, Lyles R, O’Neil C, Kitch BT, Arrington E, Balas MC, Kleinman K, Bruce C, Lankiewicz J, Murphy MV, Cox CE, Lautenbach E, Sexton D, Fraser V, Weinstein RA, Platt R. The preventability of ventilator-associated events: the CDC Prevention Epicenters Wake Up and Breathe Collaborative. Am J Respir Crit Care Med. 2015;191:292–301.

    Article  PubMed  Google Scholar 

  19. Damas P, Frippiat F, Ancion A, Canivet JL, Lambermont B, Layios N, Massion P, Morimont P, Nys M, Piret S, Lancellotti P, Wiesen P, D’Orio V, Samalea N, Ledoux D. Prevention of ventilator-associated pneumonia and ventilator-associated conditions: a randomized controlled trial with subglottic secretion suctioning. Crit Care Med. 2015;43:22–30.

    Article  PubMed  Google Scholar 

  20. Chang H-C, Chen C-M, Kung S-C, Wang C-M, Liu W-L, Lai C-C. Differences between novel and conventional surveillance paradigms of ventilator-associated pneumonia. Am J Infect Control. 2015;43:133–6.

    Article  PubMed  Google Scholar 

  21. Boyer AF, Schoenberg N, Babcock H, McMullen KM, Micek ST, Kollef MH. A prospective evaluation of ventilator-associated conditions and infection-related ventilator-associated conditions. Chest. 2015;147:68–81.

    Article  PubMed  Google Scholar 

  22. Bouadma L, Sonneville R, Garrouste-Orgeas M, Darmon M, Souweine B, Voiriot G, Kallel H, Schwebel C, Goldgran-Toledano D, Dumenil AS, Argaud L, Ruckly S, Jamali S, Planquette B, Adrie C, Lucet JC, Azoulay E, Timsit JF. Ventilator-associated events: prevalence, outcome, and relationship with ventilator-associated pneumonia. Crit Care Med. 2015;43:1798–806.

    Article  PubMed  Google Scholar 

  23. Whiting JW, Edriss H, Ngo N, Nugent K. The frequency of ventilator-associated events in a medical intensive care unit. Am J Med Sci. 2015;350:453–7.

    Article  PubMed  Google Scholar 

  24. Stoeppel CM, Eriksson EA, Hawkins K, Eastman A, Wolf S, Minei J, Minshall CT. Applicability of the National Healthcare Safety Network’s surveillance definition of ventilator-associated events in the surgical intensive care unit: a 1-year review. J Trauma Acute Care Surg. 2014;77:934–7.

    Article  PubMed  Google Scholar 

  25. Stevens JP, Silva G, Gillis J, Novack V, Talmor D, Klompas M, Howell MD. Automated surveillance for ventilator-associated events. Chest. 2014;146:1612–8.

    Article  PubMed  PubMed Central  Google Scholar 

  26. Lilly CM, Landry KE, Sood RN, Dunnington CH, Ellison RT, Bagley PH, Baker SP, Cody S, Irwin RS. Prevalence and test characteristics of National Health Safety Network ventilator-associated events. Crit Care Med. 2014;42:2019–28.

    Article  PubMed  Google Scholar 

  27. Lewis SC, Li L, Murphy MV, Klompas M. Risk factors for ventilator-associated events: a case-control multivariable analysis. Crit Care Med. 2014;42:1839–48.

    Article  PubMed  PubMed Central  Google Scholar 

  28. Klouwenberg PMCK, Van Mourik MSM, Ong DSY, Horn J, Schultz MJ, Cremer OL, Bonten MJM. Electronic implementation of a novel surveillance paradigm for ventilator-associated events feasibility and validation. Am J Respir Crit Care Med. 2014;189:947–55.

    Article  Google Scholar 

  29. Klompas M, Li L, Szumita P, Kleinman K, Murphy M. Associations between different sedatives and ventilator-associated events, length of stay, and mortality in patients who were mechanically ventilated. Chest. 2014;149:1373–9.

    Article  Google Scholar 

  30. Klompas M, Kleinman K, Murphy MV. Descriptive epidemiology and attributable morbidity of ventilator-associated events. Infect Control Hosp Epidemiol. 2014;35:502–10.

    Article  PubMed  Google Scholar 

  31. Amaral AC, Holder MW. Timing of antimicrobial therapy after identification of ventilator-associated condition is not associated with mortality in patients with ventilator-associated pneumonia: a cohort study. PLoS One. 2014;9:e97575.

    Article  PubMed  PubMed Central  Google Scholar 

  32. Muscedere J, Sinuff T, Heyland DK, Dodek PM, Keenan SP, Wood G, Jiang X, Day AG, Laporta D, Klompas M. The clinical impact and preventability of ventilator-associated conditions in critically ill patients who are mechanically ventilated. Chest. 2013;144:1453–60.

    Article  PubMed  Google Scholar 

  33. Hayashi Y, Morisawa K, Klompas M, Jones M, Bandeshe H, Boots R, Lipman J, Paterson DL. Toward improved surveillance: the impact of ventilator-associated complications on length of stay and antibiotic use in patients in intensive care units. Clin Infect Dis. 2013;56:471–7.

    Article  CAS  PubMed  Google Scholar 

  34. Klompas M, Khan Y, Kleinman K, Evans RS, Lloyd JF, Stevenson K, Samore M, Platt R. Multicenter evaluation of a novel surveillance paradigm for complications of mechanical ventilation. PLoS One. 2011;6(3):e18062.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  35. Piriyapatsom A, Lin H, Pirrone M, De Pascale G, Corona De Lapuerta J, Bittner EA, Schmidt UH, De Moya M, Berra L. Evaluation of the infection-related ventilator-associated events algorithm for ventilator-associated pneumonia surveillance in a trauma population. Respir Care. 2016;61:269–76.

    Article  PubMed  Google Scholar 

  36. Raoof S, Baumann MH. Ventilator-associated events: the new definition. Am J Crit Care. 2014;23:7–9.

    Article  PubMed  Google Scholar 

  37. Klompas M. Potential strategies to prevent ventilator-associated events. Am J Respir Crit Care Med. 2015;192:1420–30.

    Article  PubMed  Google Scholar 

  38. Fabregas N, Ewig S, Torres A, El-Ebiary M, Ramirez J, de La Bellacasa JP, Bauer T, Cabello H. Clinical diagnosis of ventilator associated pneumonia revisited: comparative validation using immediate post-mortem lung biopsies. Thorax. 1999;54:867–73.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  39. Torres A, el-Ebiary M, Padro L, Gonzalez J, de la Bellacasa JP, Ramirez J, Xaubet A, Ferrer M, Rodriguez-Roisin R. Validation of different techniques for the diagnosis of ventilator-associated pneumonia. Comparison with immediate postmortem pulmonary biopsy. Am J Respir Crit Care Med. 1994;149:324–31.

    Article  CAS  PubMed  Google Scholar 

  40. Klompas M. Advancing the science of ventilator-associated pneumonia surveillance. Crit Care. 2012;16:165.

    Article  PubMed  PubMed Central  Google Scholar 

  41. Eastwood G, Bellomo R, Bailey M, Taori G, Pilcher D, Young P, Beasley R. Arterial oxygen tension and mortality in mechanically ventilated patients. Intensive Care Med. 2012;38:91–8.

    Article  CAS  PubMed  Google Scholar 

  42. Mann T, Ellsworth J, Huda N, Neelakanta A, Chevalier T, Sims KL, Dhar S, Robinson ME, Kaye KS. Building and validating a computerized algorithm for surveillance of ventilator-associated events. Infect Control Hosp Epidemiol. 2015;36:999–1003.

    Article  PubMed  Google Scholar 

  43. Allegranzi B, Bagheri Nejad S, Combescure C, Graafmans W, Attar H, Donaldson L, Pittet D. Burden of endemic health-care-associated infection in developing countries: systematic review and meta-analysis. Lancet. 2011;377:228–41.

    Article  PubMed  Google Scholar 

  44. Chen JJ, Yu CB, Du WB, Li LJ. Prevalence of hepatitis B and C in HIV-infected patients: a meta-analysis. Hepatobiliary Pancreat Dis Int. 2011;10:122–7.

    Article  PubMed  Google Scholar 

  45. Fan Y, Wei Z, Wang W, Tan L, Jiang H, Tian L, Cao Y, Nie S. The incidence and distribution of surgical site infection in mainland China: a meta-analysis of 84 prospective observational studies. Sci Rep. 2014;4:6783.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

We deeply appreciate the contribution to this manuscript made in various ways by all members (Junning Zou, Di Dai, Qian Wu, Ming Deng, Xianhua Cheng, Xiaohong Hu, Lin Lu) of the Department of Nosocomial Infection Management, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology.

Funding

We declare that no funding supports this article.

Availability of data and materials

All data generated or analyzed during this study are included in this article and its supplementary information files.

Authors’ contributions

YF conceived and designed the study, participated in the literature search, collected data, performed statistical analysis, interpreted the results, and drafted the manuscript. FG participated in the literature search, collecting data, and statistical analysis, and helped to draft the manuscript. YW participated in analysing the data, interpreted the results, and revised the manuscript. JZ participated in study design and coordination, helped to analyse the data, and revised the manuscript. MZ participated in coordination and revised the manuscript. LX made substantial contributions to reviewing the articles, interpreting data and drafting or critically revising the manuscript. All authors read and approved the final manuscript to be published.

Competing interests

The authors declare that they have no competing interests.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Lijuan Xiong.

Additional file

Additional file 1: Table S1.

Quality assessment of included studies. Table S2. Results for analysis of pooled prevalence of ventilator-associated events and ventilator-associated pneumonia in the sensitivity analysis. Table S3. Results of pooled estimates of ventilator-associated events criteria for the detection of ventilator-associated pneumonia in the sensitivity analysis. Table S4. Risk factors for patients with ventilator-associated events compared with patients with ventilator-associated pneumonia in the sensitivity analysis. (DOCX 32 kb)

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Fan, Y., Gao, F., Wu, Y. et al. Does ventilator-associated event surveillance detect ventilator-associated pneumonia in intensive care units? A systematic review and meta-analysis. Crit Care 20, 338 (2016). https://doi.org/10.1186/s13054-016-1506-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13054-016-1506-z

Keywords