Skip to main content

Evaluation of a minimal sedation protocol using ICU sedative consumption as a monitoring tool: a quality improvement multicenter project

Abstract

Introduction

Oversedation frequently occurs in ICUs. We aimed to evaluate a minimal sedation policy, using sedative consumption as a monitoring tool, in a network of ICUs targeting decrement of oversedation and mechanical ventilation (MV) duration.

Methods

A prospective quality improvement project was conducted in ten ICUs within a network of nonteaching hospitals in Brazil during a 2-year period (2010 to 2012). In the first 12 months (the preintervention period), we conducted an audit to identify sedation practice and barriers to current guideline-based practice regarding sedation. In the postintervention period, we implemented a multifaceted program, including multidisciplinary daily rounds, and monthly audits focusing on sedative consumption, feedback and benchmarking purposes. To analyze the effect of the campaign, we fit an interrupted time series (ITS). To account for variability among the network ICUs, we fit a hierarchical model.

Results

During the study period, 21% of patients received MV (4,851/22,963). In the postintervention period, the length of MV was lower (3.91 ± 6.2 days versus 3.15 ± 4.6 days; mean difference, -0.76 (95% CI, -1.10; -0.43), P <0.001) and 28 ventilator-free days were higher (16.07 ± 12.2 days versus 18.33 ± 11.6 days; mean difference, 2.30 (95% CI, 1.57; 3.00), P <0.001) than in the preintervention period. Midazolam consumption (in milligrams per day of MV) decreased from 329 ± 70 mg/day to 163 ± 115 mg/day (mean difference, -167 (95% CI, -246; -87), P <0.001). In contrast, consumption of propofol (P = 0.007), dexmedetomidine (P = 0.017) and haloperidol (P = 0.002) increased in the postintervention period, without changes in the consumption of fentanyl. Through ITS, age (P = 0.574) and Simplified Acute Physiology Score III (P = 0.176) remained stable. The length of MV showed a secular effect (secular trend β1β=-0.055, P = 0.012) and a strong decrease immediately after the intervention (intervention β2 = -0.976, P <0.001). The impact was maintained over the course of one year, despite the waning trend for the intervention’s effect (postintervention trend β3 = 0.039, P = 0.095).

Conclusions

By using a light sedation policy in a group of nonteaching hospitals, we reproduced the benefits that have previously been demonstrated in controlled settings. Furthermore, systematic monitoring of sedative consumption should be a feasible instrument for supporting the implementation of a protocol on a large scale.

Introduction

The pharmacologic control of analgesia and sedation is an almost ubiquitous routine in everyday practice in intensive care units (ICUs) worldwide, especially in the management of symptoms of mechanically ventilated patients [1],[2]. Sedation is used to relieve discomfort, control agitation and anxiety and help in the management of critical states. However, oversedating or maintaining redundant pharmacologic medications occurs frequently and is associated with short- and long-term adverse events [2]-[8]. Importantly, the degree of sedation and the use of certain types of medications, such as benzodiazepines, are associated with poor clinical outcomes, including augmented duration of mechanical ventilation (MV), increased length of stay in the hospital and even mortality [2]-[4],[9]-[12].

To overcome these problems, several authors have employed different methods to deliver a more suitable sedation regimen, such as goal-directed sedation [13]; daily interruption [5]; protocolized, nurse-driven sedation [14]; and minimized use of continuous infusions [6],[15]. These authors reported an improvement in the offered sedation and analgesia practice and a decrease in the incidence of adverse events compared to control groups. Nevertheless, controversy still exists because several other authors have reported neutral results [16]-[20]. In fact, even assuming the likelihood of benefits that might be associated with the reduction of sedatives, the current literature involving nonexperimental settings suggests that there are several barriers to implementing strategies aimed at improving the delivered sedation [21]-[25]. Additionally, the use of resources associated with this type of initiative cannot be neglected.

We developed a simple minimal sedation protocol and a reliable monitoring tool based on the consumption of sedatives in the entire ICU. During the course of 1 year, we employed this strategy in a group of ten ICUs in private nonteaching hospitals. The objective of our study was to verify whether this strategy results in benefits similar to those previously reported in more controlled scenarios.

Material and methods

The scenario

The Amil Critical Care Group consists of 12 ICUs (total of 200 ICU beds) in a group of 11 hospitals associated with a health maintenance organization (HMO) in Sao Paulo, Brazil. Two of the authors (DTN and ESS)—a doctor and a nurse who are responsible for the group’s policy making, implementation and monitoring of common routines—coordinate this group. The light sedation protocol was implemented earlier in two ICUs in the Amil Critical Care Group during a pilot phase coordinated by three of the authors (DTN, ESS and SBC). All of the data obtained from these two ICUs were excluded from the present analysis, resulting in ten ICUs ultimately being analyzed. Their main characteristics are provided in Table 1.

Table 1 General characteristics of ten intensive care units analyzed in the quality improvement project a

The Research and Ethics Committee of Hospital Pró-Cardíaco, which is the reference ethics committee designated by the National Research Ethics Committee, approved the retrospective analysis and publication of the data on behalf of the entire network under the number 387.388 and waived the need for informed consent.

Protocol development

Our intervention was conducted over the course of a 12-month period from October 2011 to October 2012 through multidisciplinary meetings. This protocol is part of our quality improvement (QI) program [26], which involves all of the care of acutely ill patients (for example, sepsis management [27], hospital-acquired infections).

We established a baseline period (October 2010 to October 2011) during which a monthly audit was conducted, and we retrieved information concerning installed sedation protocols, knowledge of the minimal sedation concept and barriers to implementation. In this period, we also reviewed the amount of sedative consumption.

Rather than detailing the definitive pathways for sedation, we chose to define comprehensive guidelines, which are summarized in Figure 1. These guidelines primarily state that a patient does not need to be continuously sedated unless patient discomfort persists after assessing and treating pain, delirium and after a trial of low-dose, intermittent sedation has been performed. The protocol includes a formal suggestion to practice daily sedation interruption, which was driven by the assistant nurse. If drugs were continuously infused, nurses assessed the patient sedation level hourly and whether it was outside the goal (Richmond Agitation Sedation Scale score of 0 or -1/Ramsay sedation scale score of 2 or 3), the dosage infusion was discussed with the attending physician.

Figure 1
figure1

The minimal sedation protocol algorithm.

The light sedation guidelines were not applied for patients during the acute phase of selected conditions (for example, traumatic brain injury), for patients receiving neuromuscular blocking agents or when the guidelines were not indicated by the attending physician.

Protocol implementation and monitoring

The overall design of the intervention was based on the model presented by previous authors (“knowledge-to-action”) [28]-[30], which describes the necessary steps for implementation of knowledge and discusses the nature of its barriers. The initial barrier assessment was performed by inputs from the multidisciplinary team in several participating ICUs. The successful experience of two units from our group was also taken into account to identify barriers and plan actions.

The components of the intervention are described in Table 2. The change strategies were common across participating sites (that is, audit and feedback, educational outreach, performance coaching, opinion leaders, networking meeting), even though they could differ in details; for example, the opinion leader could be the head of the ICU or one of the regular staff doctors. In brief, protocol implementation was started after a formal lecture session with the leaders of all the ICUs (doctors, nurses, respiratory therapists and clinical pharmacists). In the lecture session, the rationale of minimal sedation was described, the guidelines were presented and the results of our pilot experience were discussed. In this lecture and following meetings, the protocol (Figure 1) was shown and reinforced.

Table 2 Framework for a minimal sedation protocol implementation a

The leaders in each unit were responsible for implementing the routine. To empower the campaign of light sedation, we used the daily multidisciplinary rounds that had already taken place in all of the units, and we encouraged use of this structure to disseminate the protocol and discuss its implementation [26]. In the daily multidisciplinary rounds, we update a portion of the applied checklist to be dedicated to sedation and MV topics. (Is it possible to wean the patient from MV? Is the patient under continuous sedation? Is the target sedation achieved? If deeply sedated, was sedation interrupted this morning? Is there adequate control of pain and agitation?) There were monthly meetings with our team and the leaders of each unit, at which time the leaders were invited to present their results and share their experiences in overcoming barriers.

Considering that certain classes of medications, such as the benzodiazapines (for example, midazolam), are used primarily for sedating MV patients, we decided to use the entire ICU consumption of such medications as an indicator of protocol compliance, assuming that the lesser the amount of medication that is consumed, the higher the adherence to our minimal sedation guidelines. Furthermore, we used the total consumption in milligrams, corrected by both the number of patients who were admitted during the period and the mean duration of MV. This indicator has the following obvious advantages over the traditional processes (that is, direct observation of daily arousal or down-titration of sedatives): It is an observer-independent parameter, easy to obtain, not susceptible to the Hawthorne effect and potentially associated with the desired outcome. Although some case mix-related variation could occur, this effect would be minimized over time.

The results of the consumption of the primary sedatives and analgesics available were shared in every monthly meeting for each ICU in the group. As part of the QI project in the HMO, benchmarking between ICUs was used. Additionally, the duration of MV was presented and discussed for each ICU.

Data collection method

The data were retrieved from a clinical database that has been in place since 2009 in three ICUs and since 2010 in all of the units. This database was audited by a specialized private company (EPIMED solutions, Rio de Janeiro, Brazil) and maintained by a dedicated staff from the Amil Critical Care Group HMO. Each hospital had a case manager (nurse), who was committed exclusively to inputting data daily into a case report formulary (CRF) using the Epimed Monitor system software (EPIMED solutions). Each record was tagged using a unique identifier for each patient without releasing personal data to maintain patient anonymity.

The database maintains a myriad of controls to guarantee the quality of the recorded data. Definitions were clearly stated in the CRF and were also available in a sheet of guidelines. To ensure reasonable inspection and to avoid misspecifications and typographical errors, several variables were assigned a real range. Furthermore, general information was entered with no manual transcription using an electronic system employed in our ICUs.

Random continuous checks and audits of the ongoing data collection were meticulously screened by two investigators (DTN and ESS) for missing information, implausible and outlying values, logical errors and insufficient details. A third investigator (OTR) performed similar, frequent, retrospective offline audits of the exported data and provided feedback to the group.

The absolute consumption of prespecified sedoanalgesic medications (midazolam, propofol, dexmedetomidine, fentanyl and haloperidol) per unit per month was retrieved from the local pharmacy in each unit, which is the department responsible for all of the medications used in the unit. Each local pharmacy is under the management of a central pharmacy in each hospital.

Statistical analysis

The data were tested for normal distribution using histograms and the Kolmogorov-Smirnoff test or Shapiro-Wilk test as appropriate. The categorical and continuous data are presented as percentages and mean ± SD values (or medians and interquartile ranges (IQR), respectively. The categorical variables were compared using a χ2 test or Fisher’s exact test as appropriate. The quantitative continuous variables were compared using an unpaired t-test and the Mann-Whitney U test for normally and non-normally distributed variables, respectively.

To analyze the effect of the campaign, we planned a quasi-experimental design using interrupted time series (ITS) to control for secular trends [31]-[33]. The ITS design is the strongest quasi-experimental design for evaluating the effects of time-delimited interventions. The data were collected at multiple instances over time, before and after an intervention, to detect whether the intervention had a significantly greater effect than the underlying secular trend. An advantage of the ITS design is that it can adjust for time trends, estimate changes in time trends and account for autocorrelation. Furthermore, it allows the investigation of potential biases together with the secular trend, such as the duration of the intervention (that is, that the intervention might have an effect for the first 2 months only, rather than a sustained effect) and seasonal or cyclical effects.

To model the effect of the campaign, we run autoregressive integrated moving average (ARIMA) models. Two parameters define each segment (before and after the intervention) of a time series: level and trend. The level is the value of the series at the beginning of a given time interval. The trend is the rate of change of a measure (slope) during a segment. To examine the results, we might analyze whether there are changes in level and trend that follow an intervention. In general, a change in level constitutes an immediate intervention effect, and a change in trend represents a gradual variation in the outcome.

Multiple time series require different approaches, which consist of assessing not only the absolute value but also the shape of each series. To enhance our analysis while correctly addressing our multicenter data, we performed two approaches for our main outcomes (length of MV and midazolam consumption). First, patient data were aggregated by month. In one approach, we retrieved an average value per month representing the network, which was an arithmetic mean value per unit per month. In another approach, we fit a hierarchical time series [34] by using a bottom-up method. This approach involves first providing independent time series at the bottom level of the hierarchy (each ICU, level 1) and then aggregating the independent time series upward to produce a revised time series for the whole hierarchy (network, level 0). This method accounts for noise and variability between time series and provides additional information in comparison to a crude average.

To deal with variation in case mixes over time at two levels (patient and unit), we conducted a sensitivity analysis for our main outcome fitting a generalized linear mixed model, achieving the better fit for correlated responses, in particular for the analysis of our longitudinal and clustered data. The length of MV for each patient was the dependent variable. For the first level (patient level), we adjusted for (Simplified Acute Physiology Score III (SAPS III), Charlson index score and vasoactive drugs. For the second level (unit level), we fit random intercepts for each one of ten units and nested into the variable units random components for type of admission and reasons for admitting: sepsis syndrome, cardiac surgery and respiratory conditions. The model was built with a Poisson distribution with a log link function, and the covariance structure for the random effects was first-order autoregressive [35],[36].

We evaluated the association between midazolam consumption and length of MV fitting a linear mixed model. The monthly consumption of midazolam adjusted per number of mechanically ventilated patients per each ICU was the dependent variable. The length of MV per month per each ICU was the outcome evaluated. In the model, both variables were transformed with the use of their natural logarithms to reduce the influence of extreme outliers. To adjust for severity, we entered SAPS III score as a covariate. We used splines to allow nonlinear associations between midazolam and length of MV [9],[37].

P <0.05 was considered to be statistically significant for all of the analyses. The R free source statistical package version 2.15.2 ([38]; The R Project for Statistical Computing, Vienna Austria), CRAN ([39])-specific libraries and the SPSS 19.0 package for Windows software (IBM SPSS, Chicago, IL, USA) were used in all of the analyses.

Further information on the statistical analysis plan is available in Additional file 1.

Results

We analyzed all of the adult patients admitted to ten ICUs between October 2010 and October 2012. There were 22,963 admissions during this period, which included 11,256 between October 2010 and September 2011, defined as the preintervention period, and 11,709 admissions between October 2011 and October 2012, defined as the postintervention period.

Comparison between the pre- and postintervention periods

There were no significant differences in relation to sex or age between the two groups. There was a slight difference in SAPS III scores between periods, with higher severity in the preintervention period (42.5 ± 15 vs. 42.1 ± 15, P = 0.027). The types of admission were similar between the groups. There were predominantly medical admissions (74%), and cardiovascular was the most prevalent diagnostic category for both periods. Sepsis was more prevalent in the postintervention period (12.3% vs. 14.1%, P <0.001), whereas the respiratory category was more prevalent in the preintervention period (6.9% vs. 5.5%, P <0.001). Need MV during the ICU stay were slightly more frequent in the preintervention period (21.7% vs. 20.5%, P = 0.027), but the percentages of patients who were receiving MV at the time of admission were not significantly different (14.9% vs. 14.3%, P = 0.190) (Table 3).

Table 3 Characteristics of overall cohort a

In analyzing 4,851 patients (21%) who were under MV during their ICU stay (Table 4), we observed that the group characteristics were similar with regard to age and sex. However, we detected a minor difference in SAPS III scores; the less acutely ill patients were in the postintervention period (52.7 ± 19 vs. 51.4 ± 20, P = 0.031). Despite their lower mean SAPS III scores, the postintervention group had more patients who used vasopressors during their ICU stay (16.3% vs. 17.6%, P <0.001). Patients who underwent MV in the postintervention period had fewer days under ventilation (3.91 ± 6.2 vs. 3.15 ± 4.6; mean difference, -0.76 (95% CI, -1.10; -0.43); P <0.001), and more had 28 ventilator-free days (16.07 ± 12.2 vs. 18.33 ± 11.6; mean difference, 2.30 (95% CI, 1.57; 3.00); P <0.001), compared with patients who were mechanically ventilated in the preintervention period. Although patients in the postintervention period stayed fewer days in the ICU, they presented similar hospital lengths of stay compared with patients in the preintervention period. The ICU and in-hospital mortality rates were lower in the postintervention period (36.8% (95% CI, 35.0; 38.8) vs. 29.6% (95% CI, 27.8; 31.4), P <0.001; and 45.4% (95% CI, 43.5; 47.4) vs. 38.1% (95% CI, 36.2; 40.1), P <0.001, respectively) (Table 4).

Table 4 Characteristics of the mechanically ventilated patients a

The use of midazolam presented the largest decrease between both periods. Monthly midazolam consumption in milligrams per ICU decreased from 21,825 ± 3,835 to 8,297 ± 5,628 (mean difference, -13,528 (95% CI, -17,548; -9,508), P <0.001). The results were similar after the correction for MV duration (329 ± 70 vs. 163 ± 115; mean difference, -167 (95% CI, -246; -87), P <0.001). In contrast to midazolam, the average consumption per day of MV for propofol (P = 0.007), dexmedetomidine (P = 0.017) and haloperidol (P = 0.002) increased in the postintervention period, with no change observed in fentanyl consumption (P = 0.120) (Table 5, Figure 2 and Additional file 1: Figure S3).

Table 5 Sedative consumption and differences between periods a
Figure 2
figure2

Monthly consumption in mg of sedoanalgesic medications. (A) Midazolam. (B) Propofol. (C) Fentanyl. (D) Dexmedetomidine.

Comparison of length of mechanical ventilation and midazolam consumption among units

The mean length of MV decreased across the ten units, except for one during the before and after periods (Figure 3). The highest decrease was from 5.52 ± 3.1 vs. 2.95 ± 0.9 days (mean difference, -2.57 (95% CI, -4.56; -0.59), P = 0.015 (unit 6)). There was only one unit with an inclination toward an increase in the length of MV, which was from 3.39 ± 1.9 vs. 4.22 ± 2.7 days (mean difference, 0.83 (95% CI, -1.10; 2.76), P = 0.38 (unit 9)) (Figure 3, red line). Regarding crude and adjusted midazolam consumption, midazolam consumption decreased in all units in the postintervention period compared with the preintervention period (Figure 3).

Figure 3
figure3

Comparisons of length of mechanical ventilation and midazolam consumption among units in each of the ten units in the quality improvement project. (A) Length of mechanical ventilation. (B) Midazolam consumption. (C) Midazolam consumption per day of mechanical ventilation (MV). The red line denotes the only unit which showed an inclination toward increased length of mechanical ventilation in the period (mean difference, 0.83 (95% CI, -1.10; 2.76), P = 0.38).

Interrupted time series analysis

Patients’ characteristics

The analyses of age and SAPS III did not show any trend during the observed period. Both models for age and SAPS III demonstrated no signal (full model, P = 0.574 and P = 0.176, respectively) for the overall cohort and similar results for MV patients (full model, P = 0.308 and P = 0.462, respectively). The crude data for age and SAPS III over time are shown in Additional file 1: Figures S1 and S2. The use of MV (P = 0.621) among admitted patients and the hospital mortality rate (P = 0.204) over time did not exhibit any trend during the period (Additional file 1: Figure S4).

Length of mechanical ventilation

In analyzing our primary endpoint, we found that there was a secular trend associated with a natural decline of the time under MV (secular trend β1 = -0.055, P = 0.012). We also observed an immediate effect of the intervention (intervention β2 = -0.976, P <0.001) toward decreased length of MV. However, the trend (slope) in the postintervention period remained unchanged (postintervention trend β3 = 0.039, P = 0.095) (Table 6, Figure 4A and Additional file 1: Figure S5). Regarding the hierarchical time series analysis, it is important to note that the majority of units presented a similar and synchronized response to the intervention (crude time series, Figure 5A, level 1). Furthermore, the impact of the intervention could be reproduced by the hierarchical times series analysis (Table 6 and Figure 5A).

Table 6 Interrupted time series analysis for length of mechanical ventilation and midazolam consumption a
Figure 4
figure4

Interrupted time series from the autoregressive integrated moving average model. Length of mechanical ventilation (MV) (A) and adjusted midazolam consumption (B) over time. Solid black circles represent the average data per month. Solid black line represents the fitted line for the observed data after the protocol implementation. Gray dashed line represents the forecasted values from the model if the protocol was not implemented during the period. Yellow dashed line represents when the intervention began.

Figure 5
figure5

Results from the hierarchical time series model. Length of mechanical ventilation (MV) (A) and adjusted midazolam consumption (B) over time. Level 0 denotes the modeled time series using a bottom-up method for the entire network. Level 1 denotes the independent time series for each of the ten units analyzed. Dashed black lines represent when the intervention began.

The results for individual-level patient length of MV from the mixed model, which allowed adjustments for patient levels (SAPS III, Charlson score and vasoactive drugs) and unit levels (random component) showed similar results, despite the postintervention period. The secular trend was associated with a natural decline in the length of MV (secular trend β1 = -0.016, P <0.001). We also observed an immediate effect of the intervention (intervention β2 = -0.078, P = 0.020) toward decreasing length of MV and a significant positive slope in the postintervention period (postintervention trend β3 = 0.012, P = 0.011). The mixed model presented a better overall model fit when compared to a similar model without random components (P <0.001 by likelihood ratio test). We found that the random effects explained almost 10% of the mixed model variance. The random intercepts and their errors around each estimate are described Additional file 1: Figure S7. The figure reinforces that the variance explained by each unit is minor, because the majority of units are near the zero value.

Use of midazolam

There was already an effect in the secular trend (secular trend β1 = -8.585, p = 0.038) associated with a natural decrease in the use of midazolam per day of MV and no effect immediately after the intervention (intervention β2 = -0.045, P = 0.97). However, there was a clear significant effect of the QI project in the postintervention period (postintervention trend β3 = -1.946, P = 0.005), changing the slope of the natural decline in the rate of midazolam consumption (Table 6 and Figure 4B). Our sensitivity analysis using the hierarchical time series model showed similar results (Table 6 and Figure 5B). The hierarchical time series from the crude midazolam data consumption is shown in Additional file 1: Figure S6. The impact of the intervention also seemed to be simultaneous across the majority of the units (Figure 5B and Additional file 1: Figure S6, Level 1).

Midazolam consumption vs. length of mechanical ventilation

We found a positive, nonlinear association between midazolam consumption and length of MV (P = 0.022), adjusted for SAPS III score and taking account the effect of repeated and clustered data (Figure 6).

Figure 6
figure6

Association between midazolam consumption and length of mechanical ventilation. A positive, nonlinear association between midazolam and length of mechanical ventilation was found (P = 0.022) in a mixed linear model. Each point represent the variable per each intensive care unit per month. x- and y-axes are in natural logarithmic scale. Solid gray line represents the best fit between variables. Blue bands represent the 95% of confidence interval from the fit.

Other sedatives

For propofol and fentanyl, we did not observe any effect in secular trends during the observation period. The consumption of haloperidol showed no changes in the secular trend or postintervention; however, the consumption of haloperidol significantly increased immediately after intervention (intervention β2 = 0.869, P <0.001). The consumption of dexmedetomidine showed no changes in the secular trend or immediately after intervention; however, the consumption of dexmedetomidine increased in the postintervention period (postintervention trend β3 = 0.129, P = 0.046).

Discussion

In this multicenter QI project, we found that implementation of a minimal sedation policy in a group of nonteaching hospitals is feasible and that systematic monitoring of sedative consumption seems to be a useful instrument for supporting the accomplishment of a protocol on a large scale. Additionally, we could reproduce the clinical benefits that have been previously demonstrated in controlled settings.

Interestingly, the average consumption of midazolam decreased its slope following the campaign, but not immediately after the intervention. In contrast, the duration of MV changed importantly near the implementation, changing its level (negative coefficient for β2). This effect was maintained over a 1-year period, without reversing, although the positive slope after the intervention represented a waning trend for the initial effect of the campaign [31]. This finding could be attributable to the higher effect of our intervention in situations of oversedation, which should be less common following the campaign. Furthermore, we speculate that the important decrease in the duration of MV near the beginning of the intervention might be secondary to the implementation of daily sedation interruption practice (not systematically measured in our study), which is reflected in the pattern observed for the use of neuroleptic agents. Although the focus of the protocol was not exclusively on the aim of decreasing benzodiazepines, their use was greatly affected by the campaign. This finding is possibly based on the fact that midazolam was the main sedative drug used in our units in the baseline period and on current knowledge regarding the association between benzodiazepines and poor outcomes [4],[12]. The positive association between midazolam consumption and time under MV reinforces the link to sedative use as a monitoring tool for quality of sedation. Moreover, it is possible that the decrease in midazolam use was responsible for a part of the reduction in length of MV, aside from the QI project. Nevertheless, it is not possible to establish a causal association between these variables.

Pre-post studies are naturally predisposed to important changes in patient’s characteristics and natural improvement over time. To overcome this barrier, we applied an ITS analysis, which is the strongest quasi-experimental design for evaluating the effects of time-delimited interventions [32],[33]. Furthermore, we fit a multilevel sensitivity analysis to account for patient and unit characteristics, correctly addressing repeated and correlated data. In a crude analysis, our population changed slightly and presented low mortality rates in the postintervention period (Tables 3 and 4). However, crude analysis is underpowered to address the question properly, because the confounding due to secular trends is not taken into account. Indeed, the results from time series analysis demonstrated that important features of the population remained stable during the observed period (age, SAPS III, use of MV and in-hospital mortality), which ensures general stability of severity during the observational period and enhances our results.

The implementation of new routines of care has been studied extensively, and current knowledge indicates that the use of isolated traditional teaching tools, such as formal classes or the distribution of detailed written protocols, are consistently inefficacious [22],[28],[40],[41]. In contrast, the multifaceted intervention presented better results, applying continuous education, opinion leader development, reminders and permanent audit and feedback [27],[28],[30],[31],[41],[42]. We believe that our positive results are attributable to the proper use of these “new” tools in a multifaceted approach, which involved a multidisciplinary team. Indeed, nurses, clinical pharmacists and respiratory therapists were invited to participate in the development of local guidelines, as well as in the meetings and conferences. To ensure the involvement of the entire team, each unit had daily multidisciplinary rounds, which included a checklist concerning sedoanalgesia status for each patient and opportunities for the staff to participate actively in decision-making processes. Another important point to take from our QI project is the use of a simple and objective instrument for monitoring compliance relative to a task. We considered that the traditional measurement of an indicator of process, such as adherence to down-titration of sedatives, may be prone to several judgment biases and may not represent the ideal approach. Using sedative consumption per ICU per month, the coordinator could objectively measure compliance with light sedation policy, provide accurate feedback and perform benchmarking among the different units.

The primary strength of our study is the large number of patients involved and the use of reliable and accurate data. Additionally, because it was a multicenter QI project, the study has a chance of good external validity, in which the implementation of this policy and its benefit do not seem to be personnel-dependent. Indeed, the multilevel analysis raised insights that, for a range of units, the effect of the campaign was homogeneous. In fact, the unit-level response for the majority of units was uniform, and, although the random component introduced by multilevel analysis was significant, only 10% of the total variance in length under MV was accounted for by the clustering per each unit. We demonstrate that monitoring sedative consumption can be a useful tool for protocol implementation management on a large scale, mainly focusing on benzodiazepines, which was recently reported in another single-center study [43].

Nevertheless, the present study also has some weaknesses. Pre-post analyses are always prone to the concurrent effects of simultaneous initiatives. We tried to avoid such problems by employing a strict methodology that takes into consideration the secular trend, such as the ITS analysis through ARIMA models [32]. We did not evaluate individual patient consumption of sedatives; thus, all of our inferences regarding this information were derived from the ICU perspective, and we could not calculate true measurements of dispersion taking into consideration the individual patient unit of analysis. Accordingly, we cannot affirm that the reduction of sedative use was completely attributable to its reduction in mechanically ventilated patients, because these drugs can be used in spontaneously breathing patients as well. On the basis of our experience at the bedside, we are convinced that this last category of use is quantitatively less important and should have been kept constant during the study period, because the most important clinical characteristics remained the same. Although the HMO in Sao Paulo did not show any service change during the observed period and the referees and specialties available in the hospitals were maintained constant, we cannot guarantee that some case mix variation could have exerted influence in our analysis. Regarding the statistical plan, nonlinear methods could be an alternative to time series; however, our time series did not have enough data points for a reliable analysis. We did not systematically evaluate important markers of sedation policy, such as delirium incidence and nursing workload. In addition, we did not evaluate other sedoanalgesic drugs used in the study period.

The implications of our results are clear. In scenarios similar to ours in terms of sedative consumption and MV duration, we can affirm that the implementation of a simple sedation policy using a monitoring tool is feasible and provides clinical benefits. Considering the low incremental costs, we strongly suggest that this initiative is cost-effective, and most likely cost-saving as well, from the societal perspective. Our initiative was performed with continuous attention focused on keeping it sustainable concerning the amount of resources employed. We aimed to ensure that all of our tools (from teaching to monitoring) would facilitate the comprehension and implementation of the sedation policy and that complicated algorithms would be avoided. A laborious bedside audit process was replaced by a measurement of medication consumption that could still be used in feedback sessions with the leaders of each ICU. Considering a multicenter QI project, the local variation at each unit exerted an important role in the management and results. Indeed, a unit with a low volume of mechanically ventilated patients (3% to 5% per year) showed a wide variability in length of MV and sedative consumption per month, which did not allow us to draw inferences and make determinations of clear barriers to implementation. One other unit with a low number of beds challenged our project, probably because general guidelines are less applicable to customized settings.

Conclusion

The implementation of a light sedation policy is feasible in a group of nonteaching hospitals, and systematic monitoring of sedative consumption seems to be a simple and objective instrument for supporting the accomplishment of a protocol on a large scale. Furthermore, this QI project reproduced the clinical benefits that have previously been demonstrated in controlled settings.

Key messages

  • Currently, there is a gap between real-life practice and guidelines regarding sedation practice in ICUs. There is a tendency toward oversedation, which is associated with worse outcomes.

  • A multifaceted implementation approach improved the practice of light sedation in a network of nonteaching hospitals.

  • Sedative consumption seems to be a guiding tool to help managers to tailor a campaign and seems to be feasible in a large-scale program.

  • Decreases in benzodiazepine consumption are associated with shorter length of mechanical ventilation.

Authors’ contributions

OTR, ESS and DTN were responsible for the study conception and design. ESS and DTN were responsible for local visits, campaign coordination, audits and feedback. ESS, SBC and TBA were responsible for data collection. OTR performed the data analysis and was responsible for drafting the manuscript. OTR, ESS, TBA, SBC and DTN revised the manuscript for important intellectual content. All authors read and approved the final manuscript.

Additional file

Abbreviations

ARIMA:

Autoregressive integrated moving average

CRF:

Case report formulary

HMO:

Health maintenance organization

ICU:

Intensive care unit

IQR:

Interquartile range

ITS:

Interrupted time series

MV:

Mechanical ventilation

QI:

Quality improvement program

SAPS III:

Simplified Acute Physiology Score III

VAP:

Ventilator-associated pneumonia

References

  1. 1.

    Barr J, Fraser GL, Puntillo K, Ely EW, Gélinas C, Dasta JF, Davidson JE, Devlin JW, Kress JP, Joffe AM, Coursin DB, Herr DL, Tung A, Robinson BR, Fontaine DK, Ramsay MA, Riker RR, Sessler CN, Pun B, Skrobik Y, Jaeschke R: Clinical practice guidelines for the management of pain, agitation, and delirium in adult patients in the intensive care unit. Crit Care Med. 2013, 41: 263-306. 10.1097/CCM.0b013e3182783b72.

    Article  Google Scholar 

  2. 2.

    Jackson DL, Proudfoot CW, Cann KF, Walsh T: A systematic review of the impact of sedation practice in the ICU on resource use, costs and patient safety. Crit Care. 2010, 14: R59-10.1186/cc8956.

    Article  Google Scholar 

  3. 3.

    Salluh JI, Soares M, Teles JM, Ceraso D, Raimondi N, Nava VS, Blasquez P, Ugarte S, Ibanez-Guzman C, Centeno JV, Laca M, Grecco G, Jimenez E, Árias-Rivera S, Duenas C, Rocha MG: Delirium epidemiology in critical care (DECCA): an international study. Crit Care. 2010, 14: R210-10.1186/cc9333.

    Article  Google Scholar 

  4. 4.

    Pandharipande P, Shintani A, Peterson J, Pun BT, Wilkinson GR, Dittus RS, Bernard GR, Ely EW: Lorazepam is an independent risk factor for transitioning to delirium in intensive care unit patients. Anesthesiology. 2006, 104: 21-26. 10.1097/00000542-200601000-00005.

    CAS  Article  Google Scholar 

  5. 5.

    Kress JP, Pohlman AS, O’Connor MF, Hall JB: Daily interruption of sedative infusions in critically ill patients undergoing mechanical ventilation. N Engl J Med. 2000, 342: 1471-1477. 10.1056/NEJM200005183422002.

    CAS  Article  Google Scholar 

  6. 6.

    Strøm T, Martinussen T, Toft P: A protocol of no sedation for critically ill patients receiving mechanical ventilation: a randomised trial. Lancet. 2010, 375: 475-480. 10.1016/S0140-6736(09)62072-9.

    Article  Google Scholar 

  7. 7.

    Girard TD, Kress JP, Fuchs BD, Thomason JW, Schweickert WD, Pun BT, Taichman DB, Dunn JG, Pohlman AS, Kinniry PA, Jackson JC, Canonico AE, Light RW, Shintani AK, Thompson JL, Gordon SM, Hall JB, Dittus RS, Bernard GR, Ely EW: Efficacy and safety of a paired sedation and ventilator weaning protocol for mechanically ventilated patients in intensive care (Awakening and Breathing Controlled trial): a randomised controlled trial. Lancet. 2008, 371: 126-134. 10.1016/S0140-6736(08)60105-1.

    Article  Google Scholar 

  8. 8.

    Tanaka LM, Azevedo LC, Park M, Schettino G, Nassar AP, Réa-Neto A, Tannous L, de Souza-Dantas VC, Torelly A, Lisboa T, Piras C, Carvalho FB, de Oliveira MM, Giannini FP, Machado FR, Dal-Pizzol F, de Carvalho AG, Batista dos Santos R, Tierno PF, Soares M, Salluh JI: Early sedation and clinical outcomes of mechanically ventilated patients: a prospective multicenter cohort study. Crit Care. 2014, 18: R156-10.1186/cc13995.

    Article  Google Scholar 

  9. 9.

    Pandharipande PP, Girard TD, Ely EW: Long-term cognitive impairment after critical illness. N Engl J Med. 2014, 370: 185-186.

    Google Scholar 

  10. 10.

    Shehabi Y, Bellomo R, Reade MC, Bailey M, Bass F, Howe B, McArthur C, Seppelt IM, Webb S, Weisbrodt L: Early intensive care sedation predicts long-term mortality in ventilated critically ill patients. Am J Respir Crit Care Med. 2012, 186: 724-731. 10.1164/rccm.201203-0522OC.

    Article  Google Scholar 

  11. 11.

    Treggiari MM, Romand JA, Yanez ND, Deem SA, Goldberg J, Hudson L, Heidegger CP, Weiss NS: Randomized trial of light versus deep sedation on mental health after critical illness. Crit Care Med. 2009, 37: 2527-2534. 10.1097/CCM.0b013e3181a5689f.

    Article  Google Scholar 

  12. 12.

    Fraser GL, Devlin JW, Worby CP, Alhazzani W, Barr J, Dasta JF, Kress JP, Davidson JE, Spencer FA: Benzodiazepine versus nonbenzodiazepine-based sedation for mechanically ventilated, critically ill adults: a systematic review and meta-analysis of randomized trials. Crit Care Med. 2013, 41: S30-S38. 10.1097/CCM.0b013e3182a16898.

    CAS  Article  Google Scholar 

  13. 13.

    Shehabi Y, Bellomo R, Reade MC, Bailey M, Bass F, Howe B, McArthur C, Murray L, Seppelt IM, Webb S, Weisbrodt L: Early goal-directed sedation versus standard sedation in mechanically ventilated critically ill patients: a pilot study. Crit Care Med. 2013, 41: 1983-1991. 10.1097/CCM.0b013e31828a437d.

    CAS  Article  Google Scholar 

  14. 14.

    Brook AD, Ahrens TS, Schaiff R, Prentice D, Sherman G, Shannon W, Kollef MH: Effect of a nursing-implemented sedation protocol on the duration of mechanical ventilation. Crit Care Med. 1999, 27: 2609-2615. 10.1097/00003246-199912000-00001.

    CAS  Article  Google Scholar 

  15. 15.

    Nassar Junior AP, Park M: Daily sedative interruption versus intermittent sedation in mechanically ventilated critically ill patients: a randomized trial. Ann Intensive Care. 2014, 4: 14-10.1186/2110-5820-4-14.

    Article  Google Scholar 

  16. 16.

    Bucknall TK, Manias E, Presneill JJ: A randomized trial of protocol-directed sedation management for mechanical ventilation in an Australian intensive care unit. Crit Care Med. 2008, 36: 1444-1450. 10.1097/CCM.0b013e318168f82d.

    CAS  Article  Google Scholar 

  17. 17.

    Kher S, Roberts RJ, Garpestad E, Kunkel C, Howard W, Didominico D, Fergusson A, Devlin JW: Development, implementation, and evaluation of an institutional daily awakening and spontaneous breathing trial protocol: a quality improvement project. J Intensive Care Med. 2013, 28: 189-197. 10.1177/0885066612444255.

    Article  Google Scholar 

  18. 18.

    Bugedo G, Tobar E, Aguirre M, Gonzalez H, Godoy J, Lira MT, Lora P, Encalada E, Hernandez A, Tomicic V, Castro J, Jara J, Andresen M, Ugarte H: The implementation of an analgesia-based sedation protocol reduced deep sedation and proved to be safe and feasible in patients on mechanical ventilation. Rev Bras Ter Intensiva. 2013, 25: 188-196. 10.5935/0103-507X.20130034.

    Article  Google Scholar 

  19. 19.

    Duane TM, Riblet JL, Golay D, Cole FJ, Weireter LJ, Britt LD: Protocol-driven ventilator management in a trauma intensive care unit population. Arch Surg. 2002, 137: 1223-1227. 10.1001/archsurg.137.11.1223.

    Article  Google Scholar 

  20. 20.

    Elliott R, McKinley S, Aitken LM, Hendrikz J: The effect of an algorithm-based sedation guideline on the duration of mechanical ventilation in an Australian intensive care unit. Intensive Care Med. 2006, 32: 1506-1514. 10.1007/s00134-006-0309-0.

    Article  Google Scholar 

  21. 21.

    Tanios MA, de Wit M, Epstein SK, Devlin JW: Perceived barriers to the use of sedation protocols and daily sedation interruption: a multidisciplinary survey. J Crit Care. 2009, 24: 66-73. 10.1016/j.jcrc.2008.03.037.

    Article  Google Scholar 

  22. 22.

    Sneyers B, Laterre PF, Bricq E, Perreault MM, Wouters D, Spinewine A: What stops us from following sedation recommendations in intensive care units? A multicentric qualitative study. J Crit Care. 2014, 29: 291-297. 10.1016/j.jcrc.2013.11.004.

    Article  Google Scholar 

  23. 23.

    Salluh JI, Dal-Pizzol F, Mello PV, Friedman G, Silva E, Teles JM, Lobo SM, Bozza FA, Soares M: Delirium recognition and sedation practices in critically ill patients: a survey on the attitudes of 1015 Brazilian critical care physicians. J Crit Care. 2009, 24: 556-562. 10.1016/j.jcrc.2009.04.004.

    Article  Google Scholar 

  24. 24.

    Mehta S, McCullagh I, Burry L: Current sedation practices: lessons learned from international surveys. Crit Care Clin. 2009, 25: 471-488. 10.1016/j.ccc.2009.04.001.

    Article  Google Scholar 

  25. 25.

    Miller MA, Krein SL, George CT, Watson SR, Hyzy RC, Iwashyna TJ: Diverse attitudes to and understandings of spontaneous awakening trials: results from a statewide quality improvement collaborative. Crit Care Med. 2013, 41: 1976-1982. 10.1097/CCM.0b013e31828a40ba.

    Article  Google Scholar 

  26. 26.

    Noritomi DT, Pacheco ES, Dalben MF, Campos IP, Carrasco FR, Seixas-Junior JFG, Garcia CFP, Conejo S, Padua GO, Mazutti SRG, Vieira HP: Daily multidisciplinary rounds increase 20-day ICU-free days [Abstract]. Intensive Care Med. 2011, 37 (2): A0815-

    Google Scholar 

  27. 27.

    Noritomi DT, Ranzani OT, Monteiro MB, Ferreira EM, Santos SR, Leibel F, Machado FR: Implementation of a multifaceted sepsis education program in an emerging country setting: clinical outcomes and cost-effectiveness in a long-term follow-up study. Intensive Care Med. 2014, 40: 182-191. 10.1007/s00134-013-3131-5.

    Article  Google Scholar 

  28. 28.

    Cabana MD, Rand CS, Powe NR, Wu AW, Wilson MH, Abboud PA, Rubin HR: Why don’t physicians follow clinical practice guidelines? A framework for improvement. JAMA. 1999, 282: 1458-1465. 10.1001/jama.282.15.1458.

    CAS  Article  Google Scholar 

  29. 29.

    Graham ID, Logan J, Harrison MB, Straus SE, Tetroe J, Caswell W, Robinson N: Lost in knowledge translation: time for a map?. J Contin Educ Health Prof. 2006, 26: 13-24. 10.1002/chp.47.

    Article  Google Scholar 

  30. 30.

    Cahill NE, Murch L, Cook D, Heyland DK: Implementing a multifaceted tailored intervention to improve nutrition adequacy in critically ill patients: results of a multicenter feasibility study. Crit Care. 2014, 18: R96-10.1186/cc13867.

    Article  Google Scholar 

  31. 31.

    Amaral AC, Kure L, Jeffs A: Effects of increasing compliance with minimal sedation on duration of mechanical ventilation: a quality improvement intervention. Crit Care. 2012, 16: R78-10.1186/cc11335.

    Article  Google Scholar 

  32. 32.

    Wagner AK, Soumerai SB, Zhang F, Ross-Degnan D: Segmented regression analysis of interrupted time series studies in medication use research. J Clin Pharm Ther. 2002, 27: 299-309. 10.1046/j.1365-2710.2002.00430.x.

    CAS  Article  Google Scholar 

  33. 33.

    Shardell M, Harris AD, El-Kamary SS, Furuno JP, Miller RR, Perencevich EN: Statistical analysis and application of quasi experiments to antimicrobial resistance intervention studies. Clin Infect Dis. 2007, 45: 901-907. 10.1086/521255.

    Article  Google Scholar 

  34. 34.

    Hyndman RJ, Ahmed RA, Athanasopoulos G, Shang HL: Optimal combination forecasts for hierarchical time series. Comput Stat Data Anal. 2011, 55: 2579-2589. 10.1016/j.csda.2011.03.006.

    Article  Google Scholar 

  35. 35.

    Chan J, Choy S: Analysis of covariance structures in time series. J Data Sci. 2008, 6: 573-589.

    Google Scholar 

  36. 36.

    Szyszkowicz M: Use of generalized linear mixed models to examine the association between air pollution and health outcomes. Int J Occup Med Environ Health. 2006, 19: 224-227. 10.2478/v10001-006-0032-7.

    Article  Google Scholar 

  37. 37.

    Steyerberg EW: Clinical Prediction Models: A Practical Approach to Development, Validation, and Updating. 2009, Springer, New York

    Google Scholar 

  38. 38.

    The R Project for Statistical Computing, Vienna Austria.., [www.r-project.org]

  39. 39.

    CRAN.., [http://cran.r-project.org]

  40. 40.

    Wallace J, Nwosu B, Clarke M: Barriers to the uptake of evidence from systematic reviews and meta-analyses: a systematic review of decision makers’ perceptions. BMJ Open. 2012, 2: e001220-

    Google Scholar 

  41. 41.

    Black MD, Schorr C, Levy MM: Knowledge translation and the multifaceted intervention in the intensive care unit. Crit Care Med. 2012, 40: 1324-1328. 10.1097/CCM.0b013e3182431673.

    Article  Google Scholar 

  42. 42.

    Li Bassi G, Ranzani OT, Torres A: Systematic implementation of evidence-based guidelines in intensive care medicine: resistance to change is human nature. Crit Care Med. 2013, 41: 329-331. 10.1097/CCM.0b013e318270e234.

    Article  Google Scholar 

  43. 43.

    Dale CR, Kannas DA, Fan VS, Daniel SL, Deem S, Yanez ND, Hough CL, Dellit TH, Treggiari MM: Improved analgesia, sedation and delirium protocol associated with decreased duration of delirium and mechanical ventilation. Ann Am Thorac Soc. 2014, 11: 367-374. 10.1513/AnnalsATS.201306-210OC.

    Article  Google Scholar 

Download references

Acknowledgements

We thank all the physicians, nurses and respiratory therapists who are coordinators from the participating ICUs: Hospital ABC Cirúrgico, Santo André (Eduardo Vicente, Luciane Marques Bertoldo Viñas and Marcela Belchior); Hospital Alvorada Moema, São Paulo (Anna Paula S Machado, Céu Cordeiro Gonçalves Moura, Daniela Briano and Fernando Silva); Hospital de Clínicas Caieiras, Caieiras (Barbara Ortiz, Isabela Miranda Lopes, Jaqueline Muller and Jerusa Vasques); Hospital da Luz Santo Amaro, São Paulo (Bruno Toldo; Liliane Lemos and Mozart Guimarães); Hospital e Maternidade Ipiranga, Mogi das Cruzes (Fabrício Moraes, Fernanda F Cardoso, Graziela Ramiro and Manuel Leitão Neto); Hospital da Luz Vila Mariana, São Paulo (Laura Darriba Camargo, Soraia da Silva Maia and Vanessa Tota); Hospital Metropolitano Butantã, São Paulo (Antonio Claudomiro A Beneventti, Liliane Lemos and Sandra R Silva); Hospital Metropolitano Lapa, São Paulo (Flávia Folchini, Janete Oliveira, José Antônio Manetta and Silvana Macuco); Hospital Paulistano, São Paulo (Danilo Teixeira Noritomi, Helenice Vieira and Valquiria Corrêa); Hospital TotalCor, São Paulo (Antonio Claudio do Amaral Baruzzi, Maria Cristina A Barros and Paula Bernardo); Hospital Vitória, São Paulo (Patricia Corrêa, Ricardo Goulart Rodrigues and Wilton Oliveira). We thank Dr. André Miguel Japiassu for his suggestions regarding the manuscript. We also thank the Research and Education Institute, Rede Amil, São Paulo, Brazil. This research was supported by funding from the Research and Education Institute, Rede Amil, São Paulo, Brazil. The sponsor was responsible for providing all the resources needed for the implementation of the campaign. They had no role in the acquisition, analysis or interpretation of the data.

Author information

Affiliations

Authors

Corresponding author

Correspondence to Otavio T Ranzani.

Additional information

Competing interests

The authors declare that they have no competing interests.

Electronic supplementary material

Authors’ original submitted files for images

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Ranzani, O.T., Simpson, E.S., Augusto, T.B. et al. Evaluation of a minimal sedation protocol using ICU sedative consumption as a monitoring tool: a quality improvement multicenter project. Crit Care 18, 580 (2014). https://doi.org/10.1186/s13054-014-0580-3

Download citation

Keywords

  • Dexmedetomidine
  • Secular Trend
  • Quality Improvement Project
  • Interrupted Time Series
  • Nonteaching Hospital