Nurses’ worry or concern and early recognition of deteriorating patients on general wards in acute care hospitals: a systematic review
Critical Care volume 19, Article number: 230 (2015)
Nurses often recognize deterioration in patients through intuition rather than through routine measurement of vital signs. Adding the ‘worry or concern’ sign to the Rapid Response System provides opportunities for nurses to act upon their intuitive feelings. Identifying what triggers nurses to be worried or concerned might help to put intuition into words, and potentially empower nurses to act upon their intuitive feelings and obtain medical assistance in an early stage of deterioration. The aim of this systematic review is to identify the signs and symptoms that trigger nurses’ worry or concern about a patient’s condition.
We searched the databases PubMed, CINAHL, Psychinfo and Cochrane Library (Clinical Trials) using synonyms related to the three concepts: ‘nurses’, ‘worry/concern’ and ‘deterioration’. We included studies concerning adult patients on general wards in acute care hospitals. The search was performed from the start of the databases until 14 February 2014.
The search resulted in 4,006 records, and 18 studies (five quantitative, nine qualitative and four mixed-methods designs) were included in the review. A total of 37 signs and symptoms reflecting the nature of the criterion worry or concern emerged from the data and were summarized in 10 general indicators. The results showed that worry or concern can be present with or without change in vital signs.
The signs and symptoms we found in the literature reflect the nature of nurses’ worry or concern, and nurses may incorporate these signs in their assessment of the patient and their decision to call for assistance. The fact that it is present before changes in vital signs suggests potential for improving care in an early stage of deterioration.
Early recognition and treatment of critically ill patients in general wards is a key aspect of Rapid Response Systems (RRSs). The aim of RRSs is to reduce intensive care unit (ICU) admissions, length of ICU stay, hospital length of stay and mortality .
Nurses often recognize patients in the ward who are deteriorating through intuition rather than through routine measurement of vital signs . Intuition is an ability to understand or know something immediately based on feelings rather than facts . In nursing research, Benner et al.  define intuition as ‘a judgment without a rationale, a direct apprehension and response without recourse to calculative rationality’. Nurses develop this skill over time, and often anticipate a patient’s decline before any objective evidence of deterioration is present .
The activation of an RRS is usually based on the recording of vital signs that deviate from predetermined values [5, 6]. Respiratory rate, oxygen saturation, heart rate, blood pressure, temperature and consciousness are often included, but in addition to these objective criteria, the subjective criterion ‘nurses’ worry or concern’ may be important [7, 8]. It provides an opportunity for nurses to call assistance when they intuitively feel that something is wrong with a patient, even when vital signs do not (yet) meet RRS calling criteria. However, RRSs value this criterion differently. Worry or concern can be a single calling criterion, in which case the team can be activated based solely on worry or concern . This provides optimal opportunities for nurses to act upon their intuitive feelings and get assistance in an early stage of deterioration. In the combined approach, subjective criteria like worry or concern are added to objective criteria in an aggregated system . This reduces possibilities for nurses to activate an RRS in an early stage, since vital signs must also be deteriorating. In RRSs that do not include the worry or concern criterion, it can be harder for nurses to get assistance when objective evidence is lacking [11, 12].
So far it is unclear whether including worry or concern as a calling criterion results in better patient outcomes. We need a better understanding of its essence. Identifying what triggers nurses’ worry or concern might help nurses to put intuition into words, and potentially empower them to act upon their intuitive feelings and obtain medical assistance for the patient in an early stage of deterioration. The aim of this systematic review is to identify the signs and symptoms that trigger nurses’ worry or concern about a patient’s condition.
A systematic review of quantitative and qualitative studies was performed using the systematic review guidelines from the ‘Centre for Reviews and Dissemination’  as guidance to structure the review process.
We included full-text original studies (all designs and languages), performed on general wards (adult patients, aged 18 years and older) in acute care hospitals, addressing the worry or concern of nurses in the process of recognition of deterioration in patients, or preceding calling for assistance and/or activation of the Rapid Response Team (RRT). We excluded studies that focused solely on specialized wards, such as emergency departments, ICUs, medium care units, obstetrics wards, operating rooms, pediatric wards and psychiatry wards, or studies concerning homecare. We also excluded studies of low methodological quality (see Quality appraisal). A table with the selection criteria is presented in Additional file 1.
First, we searched the databases PubMed, CINAHL, Psychinfo and Cochrane Library (Clinical Trials) for original studies. We combined three major search terms: ‘nurses’, ‘worry/concern’ and ‘deterioration’. Synonyms for these search terms were also used, which can be found in the complete PubMed search presented in Additional file 2. We used a two-stage study selection for the database search: an initial screening of titles and abstracts against inclusion criteria and assessment of the full-text articles of potentially eligible studies. The search was performed from the start of the databases until 14 February 2014. Second, experts on the subject were asked for unpublished studies. Third, studies included for full-text reading were used to locate related articles using the ‘related citations’ link of the databases. Finally, references of included articles were examined for additional studies. Figure 1 gives a complete overview of the search strategy.
We used the Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) instrument  to assess quantitative study quality. Included items were: design, eligibility criteria, selection procedure, outcomes, risk of bias, study size, number and characteristics of participants, statistical methods, relevant subgroups and results. We valued items as positive, negative or unclear. Studies with between nine and 11 positive scores were considered to be of high methodological quality, those with between five and eight positive scores to be of moderate quality and those with less than five positive scores to be of low methodological quality.
Qualitative and mixed-methods studies were assessed using the National Institute for Health and Clinical Excellence Methodology checklist: qualitative studies . This tool has six sections: theoretical approach, study design, data collection, validity, analysis and ethics. An overall score of quality is not included as not all measurement domains are considered equally important . The assessment was used to gain understanding of relative strengths and weaknesses of eligible studies.
We extracted the following data: design, aim, data collection, sample, setting, RRS (calling) system and outcomes. Outcomes extracted were the signs and symptoms underlying worry or concern of nurses.
The database search (GD and LS), data selection (GD and LS), methodological quality assessment (TvA, GD and TH) and data extraction (GD and LS) were independently performed by two researchers. Disagreement was solved through discussion, and a third researcher (TvA or AvZ) was available in case of doubt.
We included heterogeneous studies and as such, a meta-analysis could not be performed. Since our aim is strictly explorative, analysis of the data from both quantitative and qualitative studies was undertaken. Two researchers (GD and TH) independently analyzed all signs and symptoms that were extracted from the literature and separately suggested the themes that emerged from the data. The indicators were determined (GD and TH) through discussion and presented to three researchers (LS, TvA and AvZ) for agreement. Disagreement was solved through discussion until consensus was reached.
The database search provided 4,006 records. One additional article and three abstracts of congress (poster) presentations were retrieved via experts. Additionally, three articles were retrieved via ‘related articles’ in the databases, and 10 articles via reference lists of the included studies. In total, 3,937 articles of the database search did not meet the inclusion criteria. Two articles from the reference lists were not available, and there were no articles on the three congress abstracts. The full-text of 81 publications was examined; 56 were excluded as they did not meet the selection criteria and three studies were excluded for low methodological quality [17–19]. Of the remaining 22 publications [11, 20–40], four additional studies were removed because of overlapping results in the same patient samples [25, 28, 29, 32]. This resulted in 18 studies included in the review (Fig. 1).
Quality assessment of the quantitative studies resulted in one high , four moderate [20–23] and three low quality studies [17–19]. The low quality studies were excluded. The qualitative studies [11, 26–40] had several limitations. However, as described in the methods section, they were all included. Detailed information of the quality assessment is presented in Tables 1 and 2.
Characteristics of included studies
We found large heterogeneity in the studies, including in design. Studies were conducted in Australia (n = 8), the US (n = 5), the UK (n = 4) and Brazil (n = 1), with hospital settings varying from peripheral (non) teaching hospitals to university hospitals. Six studies included all wards, four included general wards and four studies were performed on medical wards. Four studies that analyzed RRS calls did not specify wards, but were included since the description in the articles suggest that general wards were involved. Studies comprised data on nurses (n = 13), of which five studies also included physicians and/or other healthcare workers. Worry or concern was the primary endpoint in five studies [26, 27, 33, 34, 39].
Five studies had quantitative designs: one quasi-experimental design  and four observational studies [20, 21, 23, 24]. Nine studies had qualitative designs: two grounded theory [11, 35], one phenomenology , one interpretative  and five descriptive studies [26, 27, 30, 34, 40]. We retrieved four mixed-methods studies, of which the qualitative part was relevant for the review [31, 33, 37, 39].
A total of 12 studies reported on RRSs: seven Medical Emergency Teams (all in Australia), with single-parameter calling systems, of which six included worry as a calling criterion and one study did not specify; three outreach teams (all in the UK) with aggregated calling systems without worry as calling criterion; and two RRTs (in the US) (one nurse-led) made no mention of the type of calling system. A summary of study characteristics is shown as Additional file 3.
Signs and symptoms underlying worry or concern
A total of 170 signs and symptoms were extracted from the included articles that describe worry or concern (Table 3). For synonyms, one major term was chosen, reducing the 170 terms to 37 different signs and symptoms. These 37 signs and symptoms were categorized into 10 general indicators: change in respiration, change in circulation, rigors, change in mentation, agitation, pain, unexpected trajectory, patient indicating they are feeling unwell, subjective nurse observation and nurse convinced that something is wrong without a rationale (Table 4).
Qualitative studies described up to nine different indicators, that is, all except rigors [25–27, 30, 33–40]. The analysis of the worry calls yielded up to seven different indicators, that is, all except for the three indicators: patient, nurse observation and knowing without a rationale [20–24]. Table 5 presents an overview of the different indicators in the studies. Both qualitative and quantitative studies mention deteriorating vital signs, like a fall in SaO2, hypertension, arrhythmia and fever [11, 20, 23, 24, 26, 27, 34, 38], as triggers for worry or concern. The majority of these studies report worry or concern based on minor changes in vital signs [20, 26, 27, 34, 38]; this was also reported in two other studies [31, 35].
We examined signs and symptoms underlying worry or concern of nurses in relation to early recognition of deteriorating patients on general wards in acute care hospitals. Our most important finding is that 37 different signs and symptoms, summarized in 10 indicators, can alert nurses that a patient may rapidly deteriorate. Seven of the included studies reported the presence of worry or concern before vital signs worsened.
Signs and symptoms underlying worry or concern
Although nurses find it hard to put intuition into words, we extracted objective signs and symptoms underlying worry or concern, or intuitive knowing. The indicators change in breathing, change in circulation, rigors and change in mentation can be related or precede deviating vital signs. Others are not related to vital signs: agitation, pain, unexpected trajectory and patient indicates feeling unwell. The indicator subjective nurse observations might partly cover the inability to explain what is wrong (patient does not look good), on the other hand it covers subtle signs such as change in behavior or the look in the patient’s eyes, both appealing to the observation skills of nurses. The indicator knowing without a rationale comprises the intuitive knowing that something is wrong based on possible unconscious observations. Skilled judges are often unaware of the cues that guide them . Still, intuition plays an important and excepted role in nurses’ decision-making [42, 43]. Intuition is believed to develop over time , so less experienced nurses might have more problems or even not see or acknowledge the importance of signs. The overview of signs and symptoms can contribute to the awareness of the importance of the mentioned indicators, and either help make the unconscious awareness for expert nurses more objective, or help less experienced nurses to articulate their feelings. This will improve the communication regarding deteriorating patients who do not yet meet the RRS calling criteria.
The significance of some of the signs and symptoms we found as early signs of deterioration has already been demonstrated in other studies. Shortness of breath and chest pain were present before cardiac arrest (CA) . Buist et al.  found significantly lower rates of CA and mortality after implementation of an RRS with respiratory distress, difficulty speaking, agitation or delirium, uncontrolled pain and failure to respond to treatment included as RRS calling criteria. Another study found a significant association between the following: poor peripheral circulation and mortality and CA; new pain with mortality and ICU admission; alteration in mentation with mortality, CA and ICU admission; uncontrolled pain with CA; and chest pain with CA and ICU admission . The signs and symptoms underlying worry or concern that we found in the literature alert nurses, and as such motivate nurses to take action to verify their intuitive feelings, which makes them valuable as potential early indicators of deterioration. While the importance of these signs and symptoms has been highlighted in several studies, they are not included as such in most RRSs. The National Early Warning Score (NEWS), based on vital signs, discriminated more patients at risk of unplanned ICU admission or mortality than 33 other Track and Trigger Systems . As the authors discuss, the NEWS must be seen as the minimum in monitoring patients, and should be used alongside other triggers such as worry or concern of nurses and other criteria.
Implications for practice
The 10 indicators identified in our study might help nurses to articulate their worries or their intuition, and contribute to better communication on deterioration. Yet without a medical response, an opportunity would be missed to intervene in an early stage. The medical response indeed prevents patients from further deterioration. This implies that not only nurses should be aware of the importance of the indicators, but also that doctors should acknowledge their importance. RRSs that include worry as calling criterion do give nurses the opportunity to call, but still would benefit if nurses articulate their worries in objective words. The presence of worry or concern of nurses before vital signs deteriorate suggests that the signs underlying the worry or concern of nurses have potential as early indicators of deterioration, and could imply that in RRSs without the worry or concern criterion, the chances for early activation of the RRT are reduced.
This systematic literature review has several limitations. First, results from observational and qualitative designs are not considered strong in the hierarchy of evidence. However, due to the nature of research involved (exploratory or evaluating) more rigorous study designs would not have been appropriate. Second, the heterogeneity of studies prevented the conduct of another type of analysis other than a content analysis and thematic synthesis, reducing evidence strength; however we consider these studies valuable to initiate more rigorous research. Third, the majority of included studies did not focus primarily on worry or concern, therefore worry or concern could have been present more often than documented in these studies. Fourth, most studies included had quality weaknesses, but we feel that the recurrence of similar findings in both quantitative and qualitative studies support the observations, especially with regard to our proposed indicators. Last, the instrument for quality assessment of quantitative studies has not been validated, yet the items used for assessment were all relevant for internal validity.
We found 37 signs and symptoms summarized in 10 general indicators reflecting the nature of nurses’ worry or concern. Nurses may incorporate these signals in their assessment of patients and the decision to call for assistance. Nurses’ subjective feeling of worry or concern is valuable in the process of recognizing deteriorating patients in general wards. Its presence even before vital signs have changed suggests potential for improving care in an early stage of deterioration. However, the number of studies is limited. The evidence found in this review was merely from retrospective research, which might have biased the results. A prospective cohort study is warranted, with nurses recording the indicators and worry or concern systematically, to establish if and how worry or concern can improve the existing calling criteria in RRSs. Potentially, this may lead to earlier recognition and treatment of deteriorating patients and improve patient outcomes.
A total of 10 indicator domains describe the nature of worry or concern of nurses.
Variable incidences and combinations of indicator domains scored are encountered among deteriorating patients in general wards.
Nurses frequently describe worry or concern before changes in vital signs occur, suggesting potential relevance as early indicator of deterioration.
As study designs were merely retrospective, prospective evaluations are warranted to assess the value to clinical relevance of worry or concern of nurses
Intensive Care Unit
Rapid Response Systems
Rapid Response Team
Strengthening the Reporting of Observational Studies in Epidemiology
United States of America
Winters B, DeVita M. Rapid response systems history and terminology. In: DeVita M, Hillman K, Bellomo R, editors. Textbook of rapid response systems: concept and implementation. 1st ed. New York: Springer; 2011. p. 3–12.
Odell M, Victor C, Oliver D. Nurses’ role in detecting deterioration in ward patients: systematic literature review. J Adv Nurs. 2009;65:1992–2006.
Cambridge Dictionaries Online. Cambridge University Press. http://dictionary.cambridge.org/dictionary/american-english/intuition (2015). Accessed 28 May 2015.
Benner P, Tanner C, Chesla C. Expertise in nursing practice: caring, clinical judgment, and ethics. New York: Springer; 2009.
Franklin C, Mathew J. Developing strategies to prevent inhospital cardiac arrest: analyzing responses of physicians and nurses in the hours before the event. Crit Care Med. 1994;22:244–7.
Buist MD, Jarmolowski E, Burton PR, Bernard SA, Waxman BP, Anderson J. Recognising clinical instability in hospital patients before cardiac arrest or unplanned admission to intensive care. A pilot study in a tertiary-care hospital. Med J Aust. 1999;171:22–5.
Gao H, McDonnell A, Harrison DA, Moore T, Adam S, Daly K, et al. Systematic review and evaluation of physiological track and trigger warning systems for identifying at-risk patients on the ward. Intensive Care Med. 2007;33:667–79.
Winters BD, Pham JC, Hunt EA, Guallarm E, Berenholtzm S, Pronovost PJ. Rapid response systems: a systematic review. Crit Care Med. 2007;35:1238–43.
McArthur-Rouse F. Critical care outreach services and early warning scoring systems: a review of the literature. J Adv Nurs. 2001;36:696–704.
Hodgetts TJ, Kenward G, Vlachonikolis IG, Payne S, Castle N. The identification of risk factors for cardiac arrest and formulation of activation criteria to alert a medical emergency team. Resuscitation. 2002;54:125–31.
Andrews T, Waterman H. Packaging: a grounded theory of how to report physiological deterioration effectively. J Adv Nurs. 2005;52:473–81.
Mackintosh N, Rainey H, Sandall J. Understanding how rapid response systems may improve safety for the acutely ill patient: learning from the frontline. BMJ Qual Saf. 2012;21:135–44.
Centre for Reviews and Dissemination. Systematic reviews: CRDs guidance for undertaking reviews in health care. York: York Publishing Services Ltd; 2009.
Vandenbroucke JP, von Elm E, Altman DG, Gøtzsche PC, Mulrow CD, Pocock SJ, et al. Strengthening the Reporting of Observational Studies in Epidemiology (STROBE): explanation and elaboration. PLoS Med. 2007;4:1628–54.
The guidelines manual. Appendix I Methodology checklist: qualitative studies. National Institute for Health and Clinical Excellence. http://www.nice.org.uk/article/pmg6b/chapter/Appendix-H-Methodology-checklist-qualitative-studies Accessed 4 April 2011.
Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60:34–42.
Bertaut Y, Campbell A, Goodlett D. Implementing a rapid-response team using a nurse-to-nurse consult approach. J Vasc Nurs. 2008;26:37–42.
Offner PJ, Heit J, Roberts R. Implementation of a rapid response team decreases cardiac arrest outside of the intensive care unit. J Trauma. 2007;62:1223–7. discussion 1227–8.
Thomas K, VanOyen FM, Rasmussen D, Dodd D, Whildin S. Rapid response team; challenges, solutions, benefits. Crit Care Nurse. 2007;27:20–7.
Boniatti MM, Azzolini N, da Fonseca DL, Ribeiro BS, de Oliveira VM, Castilho RK, et al. Prognostic value of the calling criteria in patients receiving a medical emergency team review. Resuscitation. 2010;81:667–70.
Hourihan F, Bishop G, Hillman KM, Daffurn K, Lee A. The medical emergency team: a new strategy to identify and intervene in high-risk patients. Clin Intensive Care. 1995;6:269–72.
Laurens N, Dwyer T. The impact of medical emergency teams on ICU admission rates, cardiopulmonary arrests and mortality in a regional hospital. Resuscitation. 2011;82:707–12.
Parr MJ, Hadfield JH, Flabouris A, Bishop G, Hillman K. The medical emergency team: 12 month analysis of reasons for activation, immediate outcome and not-for-resuscitation orders. Resuscitation. 2001;50:39–44.
Santiano N, Young L, Hillman K, Parr M, Jayasinghe S, Baramy LS, et al. Analysis of medical emergency team calls comparing subjective to “objective” call criteria. Resuscitation. 2009;80:44–9.
Andrews T, Waterman H. Visualising deteriorating conditions. The Grounded Theory Review. 2005;4:63–93.
Cioffi J, Conway R, Everist L, Scott J, Senior J. Patients of concern’ to nurses in acute care settings: a descriptive study. Aust Crit Care. 2009;22:178–86.
Cioffi J. Nurses’ experiences of making decisions to call emergency assistance to their patients. J Adv Nurs. 2000;32:108–14.
Cioffi J. Recognition of patients who require emergency assistance: a descriptive study. Heart Lung. 2000;29:262–8.
Cioffi J. A study of the use of past experiences in clinical decision making in emergency situations. Int J Nurs Stud. 2001;38:591–9.
Cox H, James J, Hunt J. The experiences of trained nurses caring for critically ill patients within a general ward setting. Intensive Crit Care Nurs. 2006;22:283–93.
Donaldson N, Shapiro S, Scott M, Foley M, Spetz J. Leading successful rapid response teams: a multisite implementation evaluation. J Nurs Adm. 2009;39:176–81.
Shapiro SE, Donaldson NE, Scott MB. Rapid response teams seen through the eyes of the nurse. Am J Nurs. 2010;110:28–34.
Endacott R, Kidd T, Chaboyer W, Edington J. Recognition and communication of patient deterioration in a regional hospital: a multi-methods study. Aust Crit Care. 2007;20:100–5.
Gazarian PK, Henneman EA, Chandler GE. Nurse decision making in the prearrest period. Clin Nurs Res. 2010;19:21–37.
Leach LS, Mayo A, O’Rourke M. How RNs rescue patients: a qualitative study of RNs’ perceived involvement in rapid response teams. Qual Saf Health Care. 2010;19, e13.
Massey D, Chaboyer W, Aitken L. Nurses’ perceptions of accessing a medical emergency team: a qualitative study. Aust Crit Care. 2014;27:133–8.
McDonnell A, Tod A, Bray K, Bainbridge D, Adsetts D, Walters S. A before and after study assessing the impact of a new model for recognizing and responding to early signs of deterioration in an acute hospital. J Adv Nurs. 2013;69:41–52.
Minick P, Harvey S. The early recognition of patient problems among medical-surgical nurses. Med Surg Nurs. 2003;12:291–7.
Pattison N, Eastham E. Critical care outreach referrals: a mixed-method investigative study of outcomes and experiences. Nurs Crit Care. 2011;17:71–82.
Williams DJ, Newman A, Jones C, Woodard B. Nurses’ perceptions of how rapid response teams affect the nurse, team, and system. J Nurs Care Qual. 2011;26:265–72.
Kahneman D, Klein G. Conditions for intuitive expertise. A failure to disagree. Am Psychol. 2009;64:515–26.
Rew L, Barrow EM. State of the science: intuition in nursing, a generation of studying the phenomenon. Adv Nurs Sci. 2007;30:15–25.
Benner P, Tanner C. Clinical judgment: how expert nurses use intuition. Am J Nurs. 1987;87:23–31.
Buist MD, Moore GE, Bernard SA, Waxman BP, Anderson JN, Nguyen TV. Effects of a medical emergency team on reduction of incidence of and mortality from unexpected cardiac arrests in hospital: preliminary study. BMJ. 2002;324:1–6.
Jacques T, Harrison GA, McLaws ML, Kilborn G. Signs of critical conditions and emergency responses (SOCCER): a model for predicting adverse events in the inpatient setting. Resuscitation. 2006;69:175–83.
Smith GB, Prytherch DR, Meredith P, Schmidt PE, Featherstone PI. The ability of the National Early Warning Score (NEWS) to discriminate patients at risk of early cardiac arrest, unanticipated intensive care unit admission, and death. Resuscitation. 2013;84:465–70.
We thank Mrs Truus van der Hooft, MSc, for her advice on quality assessment of qualitative studies and Ms Anne Mary Harpe for the translation of the Danish article.
The authors declare that they have no competing interests.
GD carried out the database search, screening of the articles, quality assessment, analysis of the data and drafting of the manuscript. LS carried out the database search, screening of the articles, quality assessment, analysis of the data and drafting of the manuscript. TH contributed in the study quality assessment, the determining of the indicators and drafting of the manuscript. TvA participated in the study quality assessment and the drafting of the manuscript. GH contributed to the interpretation of the data and revision of the manuscript. AvZ contributed to the determining of the indicators, analysis of the data, and drafting and revision of the manuscript. HvdH contributed in the analysis of the data and helped to revise the manuscript. All authors read and approved the final manuscript.
About this article
Cite this article
Douw, G., Schoonhoven, L., Holwerda, T. et al. Nurses’ worry or concern and early recognition of deteriorating patients on general wards in acute care hospitals: a systematic review. Crit Care 19, 230 (2015). https://doi.org/10.1186/s13054-015-0950-5