- Open Access
Impact of nighttime Rapid Response Team activation on outcomes of hospitalized patients with acute deterioration
Critical Care volume 22, Article number: 67 (2018)
Rapid Response Teams (RRTs) are groups of healthcare providers that are used by many hospitals to respond to acutely deteriorating patients admitted to the wards. We sought to identify outcomes of patients assessed by RRTs outside standard working hours.
We used a prospectively collected registry from two hospitals within a single tertiary care-level hospital system between May 1, 2012, and May 31, 2016. Patient information, outcomes, and RRT activation information were stored in the hospital data warehouse. Comparisons were made between RRT activation during daytime hours (0800–1659) and nighttime hours (1700–0759). The primary outcome was in-hospital mortality, analyzed using a multivariable logistic regression model.
A total of 6023 RRT activations on discrete patients were analyzed, 3367 (55.9%) of which occurred during nighttime hours. Nighttime RRT activation was associated with increased odds of mortality, as compared with daytime RRT activation (adjusted OR 1.34, 95% CI 1.26–1.40, P = 0.02). The time periods associated with the highest odds of mortality were 0600–0700 (adjusted OR 1.30, 95% CI 1.09–1.61) and 2300–2400 (adjusted OR 1.34, 95% CI 1.01–1.56). Daytime RRT activation was associated with increased odds of intensive care unit admission (adjusted OR 1.40, 95% CI 1.31–1.50, P = 0.02). Time from onset of concerning symptoms to RRT activation was shorter among patients assessed during daytime hours (P < 0.001).
Acutely deteriorating ward patients assessed by an RRT at nighttime had a higher risk of in-hospital mortality. This work identifies important shortcomings in health service provision and quality of care outside daytime hours, highlighting an opportunity for quality improvement.
Patients admitted to the hospital wards are at risk of deterioration, and recognition of deterioration can be delayed [1, 2]. This puts these patients at increased risk of morbidity and mortality. Previous work has demonstrated that various adverse events, including cardiac arrest, unplanned intensive care unit (ICU) admission, and unexpected death, are usually preceded by objective signs of deterioration, often over the course of many hours . In order to monitor such cases, many hospitals have instituted Rapid Response Teams (RRTs), which are a group of interprofessional critical care providers, often led by an intensivist, who immediately respond to ward patients experiencing clinical deterioration [3, 4]. RRTs do not routinely patrol wards, but are rather summoned by physicians or other health professionals who are caring for these patients, or in some instances, by patients’ families. Common causes for activation include respiratory distress, vital sign abnormalities (such as hypotension), or decreased level of consciousness; but healthcare providers are encouraged to activate RRT assistance if they are at all concerned about a patient’s condition .
The existing literature on the use of RRTs in clinical practice highlights many potential benefits. Most consistently, RRT use has been shown to reduce the incidence of in-hospital cardiac arrest, which has been attributed to early identification and treatment of at-risk patients [6,7,8]. Furthermore, a dose-response relationship between increasing RRT review rates and decreasing in-hospital cardiac arrest rates has been demonstrated . Although the findings are less robust, RRTs have also been shown to improve overall hospital mortality, with particular benefit in reducing the incidence of unexpected in-hospital death . RRTs are also thought to be useful for early involvement in end-of-life care and ensuring that patient treatment occurs within patient-specific limits of care .
At most centers, RRT availability exists at all times during the day. However, there may be differences in the amount and level of training of staff who are available at night . Most hospital wards in Canada (including our centers) have reduced nursing-to-patient ratios at night, which has been shown to be associated with poorer performance in various quality-of-care indicators . Additionally, attending physicians are less likely to be in the hospital during nighttime hours [14, 15]. There is often diurnal variability in RRT staffing. Whereas during the day the RRT may be staffed by a single dedicated attending physician, during the night RRTs may be more commonly composed of residents or emergency department (ED) physicians who are on shift at the time. There is also diurnal variation in patient-physician ratios, as well as in patient throughput (namely patient discharge) in the ICU, with a higher ratio and greater throughput found during the day , as is the case at our center. It is also well-accepted that staffing levels and expertise have an inverse relationship with patient outcomes . We therefore attempted to determine whether nighttime RRT activation was associated with worse patient outcomes.
Ethics approval for this study was obtained from The Ottawa Health Science Network Research Ethics Board (protocol number 20170016-01H).
Study design, setting, and subjects
The study was performed at The Ottawa Hospital, a Canadian tertiary care hospital network that consists of two individual campuses, each with its own tertiary-level ICU. The Ottawa Hospital is a 1163-bed facility than handles over 160,000 emergency visits, 50,000 inpatients, and roughly 35,000 surgical cases annually. Each hospital has approximately 28–30 ICU beds. These are mixed medical and surgical ICUs. We analyzed prospectively collected data contained in the Ottawa Hospital Data Warehouse, which is a health administrative database widely used in previous research [18,19,20]. It contains information from several of the hospital’s information systems, including the patient registration system, clinical data repository, case-costing system, and patient discharge abstracts. Extensive assessments of data quality were performed during database development, and quality assurance initiatives to ensure completeness and accuracy of the data are conducted regularly .
We included all patients who met all of the following eligibility criteria: (a) over the age of 18 years; (b) admitted to either campus of The Ottawa Hospital; and (c) received RRT activation between May 1, 2012, and May 31, 2016. Patients with incomplete demographic or outcome data were excluded. We also excluded cases of routine scheduled RRT follow-up. We did not have data related to cases of cardiac arrest (because they involve a different response team). Patients were categorized by time of initial RRT activation. Patients with multiple activations during their admission were categorized on the basis of the time of their initial activation. Activations were classified as occurring during either daytime hours (0800–1659) or nighttime hours (1700–0759). At The Ottawa Hospital, RRTs during daytime hours are composed of an attending critical care specialist, a registered nurse, and a respiratory therapist. Nighttime RRT activations are managed by a resident physician on the critical care service, also with support from a registered nurse and respiratory therapist. An on-call intensivist is available but is not in-house. The same model is used at both sites. During daytime hours, most wards are under the direct supervision of an attending faculty physician. During nighttime hours, most hospital wards are under the supervision of resident physicians, with an attending physician available on-call. The RRT responds only to inpatients, outpatients experiencing distress (e.g., in radiology and endoscopy suites), or patients and family members requiring immediate care in hospital clinics or waiting rooms. The RRT does not respond to patients being assessed in the ED (who have not yet been admitted). Specific criteria for RRT activation at our center have been published previously . They include concerns surrounding airway patency, tachypnea, systolic blood pressure ≤ 90 mmHg or ≥ 200 mmHg, decreased level of consciousness, and hypoxia, but healthcare providers are encouraged to activate the RRT for any reason of concern, even in the absence of objective changes in vital signs or laboratory values.
Patient information, including demographic data, comorbidities, previous ED visits, previous hospital admissions, and previous ICU admissions in the year prior to the index admission, was collected by registration clerical staff at the time of admission and stored in the data warehouse . Information related to RRT activation is gathered by the RRT nursing staff at the time of patient assessment, and it is also stored in the data warehouse. This includes the most recent vital signs and laboratory values at the time of activation, reason for activation, admitting service, and whether the patient was admitted to the ICU. Data on latency time from onset of concerning symptoms or signs (e.g., hypotension, altered mental status) to RRT activation are also estimated by the RRT during assessment for quality improvement purposes. Outcome at hospital discharge (including death or disposition) and lengths of hospital and ICU stay are also stored in the data warehouse.
The primary outcome was in-hospital mortality, comparing patients assessed during daytime vs. nighttime hours. Secondary outcomes included ICU admission following RRT assessment and overall hospital length of stay.
All statistical analyses were performed with commercially available statistical software packages (R version 3.3.3 [R Foundation for Statistical Computing, Vienna, Austria] and IBM SPSS Statistics version 24.0 [IBM, Armonk, NY, USA]). Data are presented as mean values (with SD) or as medians (with IQR), where indicated. Descriptive statistics were employed for between-group comparisons between daytime and nighttime hours, using Student’s t test for continuous variables and the χ2 test for categorical variables. In evaluating the outcomes of in-hospital mortality and ICU admission after RRT activation, we used multivariable logistic regression modeling to adjust for potential confounders, including patient characteristics (age, sex, comorbidities, comorbidity index, previous ED visits in the past year, previous hospital admissions in the past year, and previous ICU admissions in the past year), number of RRT activations, latency to RRT activation, most recent laboratory investigations at the time of RRT activation, and vital signs at the time of RRT activation. We also performed a secondary analysis using time of day as the exposure variable (with 1200–1300 as a reference, as reported previously ) to evaluate changes in adjusted mortality over the course of the day. We analyzed disposition of survivors at hospital discharge using a similarly constructed multivariable logistic regression model but restricted to patients originally admitted from home, assuming that patients initially admitted from peripheral acute or long-term care centers were likely to return to those centers. Adjusted ORs with 95% CIs and adjusted P values are provided. A P value ≤ 0.05 was taken to represent statistical significance.
The RRT was activated for 6132 discrete patients during the study period. Of these, 109 patients were excluded because of incomplete data, leaving 6023 patients in the study. A total of 2656 patients (44.1%) had calls that occurred during daytime hours (0800–1659), and 3367 (55.9%) had calls that occurred during nighttime hours (1700–0759).
Characteristics of the included patients, along with between-group comparisons between daytime and nighttime RRT activation are depicted in Table 1. The mean age of patients with RRT activation during daytime hours was 67.3 years (SD 16.7), whereas the mean age of those with RRT activation during nighttime hours was 67.9 years (SD 16.7) (P = 0.18). There was no significant difference in admission source (home, acute care facility transfer, long-term care facility transfer) between groups. There were no significant differences between groups in the median number of previous ED visits, hospital admissions, or ICU admissions in the past year.
Characteristics of RRT activations
Between-group differences in characteristics of RRT activation calls are depicted in Table 2. There was a trend toward lower RRT use (number of RRT activations per 1000 hospital admissions, also termed the RRT “dose” ) during nighttime hours, though this difference was not statistically significant. Vital signs and laboratory values at the time of RRT activation are displayed. Reasons for RRT activation were significantly different between daytime and nighttime RRT calls (P < 0.001). Respiratory distress and tachycardia/arrhythmias were more common causes of activation at nighttime, whereas altered level of consciousness was more common during daytime hours. Calls arising from general nonspecific concerns about the patient were more common during the daytime. Nighttime RRT activation was associated with longer latency from symptom onset (P < 0.001). More RRT activations occurred within 1 h of symptom onset during daytime than during nighttime hours (81.0% vs. 73.2%, P < 0.001). There was no difference between groups in time to RRT response. A comparison of admitting services at the time of RRT activation is shown in Table 3. Some services (such as orthopedic surgery and hematology) more commonly requested RRT assistance during daytime hours, whereas others (such as neurosurgery and medical oncology) more often activated the RRT at nighttime.
Nighttime RRT activation and patient mortality
Logistic regression using multivariable models with adjustment for patient variables demonstrated that nighttime RRT activation was associated with significantly higher odds of in-hospital mortality (adjusted OR 1.34, 95% CI 1.26–1.40) (Table 4). The logistic regression model, including all covariables, is depicted in Additional file 1. Daytime RRT activation was associated with significantly higher odds of ICU admission (adjusted OR 1.40, 95% CI 1.30–1.48). No differences in overall hospital length of stay (P = 0.92) or disposition of survivors (P = 0.47) were found between groups. The frequency of RRT calls, with associated risk of mortality across the day, is depicted graphically in Fig. 1. Of note, the frequency of RRT activation increases dramatically at approximately 0800, shortly after the beginning of daytime hours. Two statistically significant time periods were associated with increased adjusted odds of in-hospital mortality: 0600–0700 (adjusted OR 1.30, 95% CI 1.09–1.61) and 2300–2400 (adjusted OR 1.34, 95% CI 1.01–1.56). A sensitivity analysis excluding patients admitted to the ICU was performed (Additional file 2). There were no differences in mortality or hospital length of stay between groups.
We found that RRT activation during nighttime hours (1700–0759) was associated with an increased risk of in-hospital mortality compared with daytime (0800–1659) activation. The two time periods associated with highest risk of in-hospital mortality were 0600–0700 and 2300–2400. These times correspond to workforce shift changes at our institution, particularly with regard to ward nursing care. Patients who were seen by the RRT during nighttime were less commonly admitted to the ICU. These findings were evident even when adjusted for many possible confounding patient factors. Nighttime RRT activations had increased latency from symptom onset compared with daytime RRT activations.
Our results demonstrate variability in outcomes with RRT activation over the course of the day. Our findings are consistent with a recent large database study in the United States  and a smaller study in Australia , which also found increased mortality with overnight RRT activation and an increased adjusted risk of mortality for activations between 0700 and 0800. These studies also found that the lowest frequency of calls occurred in the early morning (immediately preceding the time associated with the highest risk of mortality) and that the highest frequency of calls occurred between 0800 and 0900. They suggested that this may be due to workforce shift changes, and the investigators hypothesized that there may be increased delay to RRT activation overnight, but they did not have this data available to them. Our study adds to this work not only by supporting these findings but also by adjusting for more confounding variables. We found that nighttime RRT activation was in fact associated with prolonged delays to activation. There are likely many reasons for this, including reduced patient/nursing ratios, coupled with fewer and less-experienced physicians (on both the ward as well as the RRT), on hospital wards at night. Similar work has demonstrated that RRT activation more commonly occurs after nurse shift change and vital sign checks [25, 26], which may explain the dramatic increase in frequency after 0800.
Understanding why these differences in outcomes occur is paramount in identifying strategies for quality improvement in recognition of deteriorating patients on hospital wards, as well as for improvement in RRT function. Diurnal differences in patient outcomes have been reported in various disease processes, including cardiac arrest, trauma, and myocardial infarction [27,28,29]. As mentioned, this may be related to known differences in the amount and experience of staffing (both physicians and nurses) overnight, particularly in critical care settings [14, 16, 17, 30, 31]. Although we found no differences in patient characteristics or most recent vital signs or laboratory work between daytime and nighttime RRT activation, patients admitted to the ICU during early morning hours tend to be older and sicker than those admitted later in the day . We found that RRT activation during the daytime was more likely to result in ICU admission than activations occurring during nighttime. Because delayed ICU admission is a factor associated with worse outcomes in critically ill patients , moving these patients to a critical care setting may have partially accounted for the improved survival seen in activations during daytime hours. This may have been affected by bed availability because fewer ICU beds are available at night .
Importantly, we found that nighttime RRT activation was associated with prolonged latency from the onset of concerning symptoms and signs. Delays in RRT activation have been shown to be associated with worse outcomes [35, 36]. These increased delays may occur because of impaired recognition and/or monitoring of clinical deterioration. Diurnal variation in shift times and durations also influence staff performance, which has been shown to decline during the night . In tertiary care centers, most nighttime services are under the supervision of medical residents, who not only have less experience than their attending physician counterparts but also often work many consecutive hours, with concomitant sleep deprivation. These factors together result in poorer cognitive performance [38, 39] and may contribute to reduced recognition of clinical deterioration among admitted patients. Additionally, these residents may be busy performing other clinical duties, owing to a reduced number of personnel available during nighttime hours . In keeping with this, we found a trend toward lower “RRT dose” during nighttime hours, though the difference was not statistically significant. Increasing RRT dose has been associated with a reduction in adverse events among hospitalized patients , and lower dosing has previously been demonstrated during nighttime hours .
This study has several strengths, including a large sample size as well as data related to various patient and RRT activation variables. The main outcomes were assessed using logistic regression models to control for the influence of important patient factors. However, there are several limitations that hinder the generalizability of our results. First, the observational nature of our dataset allows detection of associations but does not reveal the causal pathways that lead to increased mortality risk after nighttime RRT activations. Second, although the data were gathered from two different hospitals, the hospitals are located within the same city and use the same RRT model, which may limit the generalizability of the results. However, as mentioned, our findings are similar to those of recent studies in the United States  and Australia . Although we attempted to control for many confounding patient and RRT factors, including laboratory values and vital signs, there are some factors that we were unable to include in the model, such as the degree of acute physiological derangement. We were also unable to compute the “Score to Door Time,” which is an indicator of quality of healthcare delivery, for patients requiring ICU admission . Finally, although we were able to gather data related to the latency of RRT response, we did not have data related to time until treatment, which may have been delayed during nighttime RRT activations.
We found that nighttime RRT activation was associated with increased mortality, decreased ICU admission, and increased latency to activation in hospitalized patients with acute deterioration. These findings underscore important shortcomings in both the recognition of these patients by ward staff and the function of RRTs, and they serve as an important avenue for future quality improvement.
Intensive care unit
International normalized ratio
Rapid Response Team
Kause J, Smith G, Prytherch D, et al. A comparison of antecedents to cardiac arrests, deaths and emergency intensive care admissions in Australia and New Zealand, and the United Kingdom—the ACADEMIA study. Resuscitation. 2004;62:275–82.
Sax FL, Charlson ME. Medical patients at high risk for catastrophic deterioration. Crit Care Med. 1987;15:510–5.
Jones DA, DeVita MA, Bellomo R. Rapid-response teams. N Engl J Med. 2011;365:139–46.
Jones D, Lippert A, DeVita M, et al. What’s new with rapid response systems? Intensive Care Med. 2015;41:315–7.
Amaral AC, McDonald A, Coburn NG, et al. Expanding the scope of Critical Care Rapid Response Teams: a feasible approach to identify adverse events: a prospective observational cohort. BMJ Qual Saf. 2015;24:764–8.
Chan PS, Jain R, Nallmothu BK, et al. Rapid Response Teams: a systematic review and meta-analysis. Arch Intern Med. 2010;170:18–26.
Winters BD, Weaver SJ, Pfoh ER, et al. Rapid-response systems as a patient safety strategy: a systematic review. Ann Intern Med. 2013;158:417–25.
Maharaj R, Raffaele I, Wendon J. Rapid response systems: a systematic review and meta-analysis. Crit Care. 2015;19:254.
Jones D, Bellomo R, Bates S, et al. Long term effect of a medical emergency team on cardiac arrests in a teaching hospital. Crit Care. 2005;9:R808–15.
De Jong A, Jung B, Daurat A, et al. Effect of rapid response systems on hospital mortality: a systematic review and meta-analysis. Intensive Care Med. 2016;42:615–7.
Jones D, Moran J, Winters B, et al. The rapid response system and end-of-life care. Curr Opin Crit Care. 2013;19:616–23.
Sundararajan K, Flabouris A, Thompson C. Diurnal variation in the performance of rapid response systems: the role of critical care services—a review article. J Intensive Care. 2016;4:15.
Stegenga J, Bell E, Matlow A. The role of nurse understaffing in nosocomial viral gastrointestinal infections on a general pediatrics ward. Infect Control Hosp Epidemiol. 2002;23:133–6.
Wallace DJ, Angus DC, Barnato AE, et al. Nighttime intensivist staffing and mortality among critically ill patients. N Engl J Med. 2012;366:2093–101.
Kerlin MP, Small DS, Cooney E, et al. A randomized trial of nighttime physician staffing in an intensive care unit. N Engl J Med. 2013;368:2201–9.
Neuraz A, Guerin C, Payet C, et al. Patient mortality is associated with staff resources and workload in the ICU: a multicenter observational study. Crit Care Med. 2015;43:1587–94.
Needleman J, Buerhaus P, Pankratz VS, et al. Nurse staffing and inpatient hospital mortality. N Engl J Med. 2011;364:1037–45.
Ronksley PE, McKay JA, Kobewka DM, et al. Patterns of health care use in a high-cost inpatient population in Ottawa, Ontario: a retrospective observational study. CMAJ Open. 2015;3:E111–8.
Kobewka DM, van Walraven C, Turnbull J, et al. Quality gaps identified through mortality review. BMJ Qual Saf. 2017;26:141–9.
McIsaac DI, Abdulla K, Yang H, et al. Association of delay of urgent or emergency surgery with mortality and use of health care resources: a propensity score-matched observational cohort study. CMAJ. 2017;189:E905–e912.
Baxter AD, Cardinal P, Hooper J, et al. Medical emergency teams at The Ottawa Hospital: the first two years. Can J Anaesth. 2008;55:223–31.
Churpek MM, Edelson DP, Lee JY, et al. Association between survival and time of day for rapid response team calls in a national registry. Crit Care Med. 2017;45:1677–82.
Jones D, Bellomo R, DeVita MA. Effectiveness of the Medical Emergency Team: the importance of dose. Crit Care. 2009;13:313.
Molloy J, Pratt N, Tiruvoipati R, et al. Relationship between diurnal patterns in Rapid Response Call activation and patient outcome. Aust Crit Care. 2018;31(1):42–6.
Medical Emergency Team End-of-Life Care investigators. The timing of Rapid-Response Team activations: a multicentre international study. Crit Care Resusc. 2013;15:15–20.
Jones D, Bates S, Warrillow S, et al. Circadian pattern of activation of the medical emergency team in a teaching hospital. Crit Care. 2005;9:R303–6.
Peberdy MA, Ornato JP, Larkin GL, et al. Survival from in-hospital cardiac arrest during nights and weekends. JAMA. 2008;299:785–92.
Dybdal B, Svane C, Hesselfeldt R, et al. Is there a diurnal difference in mortality of severely injured trauma patients? Emerg Med J. 2015;32:287–90.
Sorita A, Ahmed A, Starr SR, et al. Off-hour presentation and outcomes in patients with acute myocardial infarction: systematic review and meta-analysis. BMJ. 2014;348:f7393.
Pronovost PJ, Angus DC, Dorman T, et al. Physician staffing patterns and clinical outcomes in critically ill patients: a systematic review. JAMA. 2002;288:2151–62.
Parshuram CS, Kirpalani H, Mehta S, et al. In-house, overnight physician staffing: a cross-sectional survey of Canadian adult and pediatric intensive care units. Crit Care Med. 2006;34:1674–8.
Bisbal M, Pauly V, Gainnier M, et al. Does admission during morning rounds increase the mortality of patients in the medical ICU? Chest. 2012;142:1179–84.
Bing-Hua YU. Delayed admission to intensive care unit for critically surgical patients is associated with increased mortality. Am J Surg. 2014;208:268–74.
Stelfox HT, Hemmelgarn BR, Bagshaw SM, et al. Intensive care unit bed availability and outcomes for hospitalized patients with sudden clinical deterioration. Arch Intern Med. 2012;172:467–74.
Barwise A, Thongprayoon C, Gajic O, et al. Delayed rapid response team activation is associated with increased hospital mortality, morbidity, and length of stay in a tertiary care institution. Crit Care Med. 2016;44:54–63.
Chen J. Saving patients’ lives through activating a rapid response system: willing is not enough, we must do. Crit Care Med. 2016;44:239–40.
Amirian I, Andersen LT, Rosenberg J, et al. Working night shifts affects surgeons’ biological rhythm. Am J Surg. 2015;210:389–95.
Sharpe R, Koval V, Ronco JJ, et al. The impact of prolonged continuous wakefulness on resident clinical performance in the intensive care unit: a patient simulator study. Crit Care Med. 2010;38:766–70.
Olson EJ, Drage LA, Auger RR. Sleep deprivation, physician performance, and patient safety. Chest. 2009;136:1389–96.
Jones D, Bellomo R, Bates S, et al. Patient monitoring and the timing of cardiac arrests and medical emergency team calls in a teaching hospital. Intensive Care Med. 2006;32:1352–6.
Oglesby KJ, Durham L, Welch J, et al. ‘Score to Door Time’, a benchmarking tool for rapid response systems: a pilot multi-centre service evaluation. Crit Care. 2011;15:R180.
The authors thank Deanna Rothwell and Dr. Alan J. Forster (The Ottawa Hospital Data Warehouse) for assistance.
None to report.
Availability of data and materials
The datasets generated and analyzed are not publicly available, owing to patient privacy considerations, but they are available from the corresponding author on reasonable request.
Ethics approval and consent to participate
Ethics approval for this study was obtained from The Ottawa Health Science Network Research Ethics Board.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Multivariate logistic regression analysis of factors associated with in-hospital mortality (n = 6023). Multivariate logistic regression variables, with associated ORs and 95% CIs. (DOCX 136 kb)
Time of rapid response team activation and patient outcomes among patients not admitted to the intensive care unit. Subgroup analysis of outcomes among patients not admitted to the intensive care unit. (DOCX 77 kb)
About this article
Cite this article
Fernando, S.M., Reardon, P.M., Bagshaw, S.M. et al. Impact of nighttime Rapid Response Team activation on outcomes of hospitalized patients with acute deterioration. Crit Care 22, 67 (2018). https://doi.org/10.1186/s13054-018-2005-1
- Rapid Response Team
- Intensive care unit
- Critical care