- Open Access
Early psychological screening of intensive care unit survivors: a prospective cohort study
Critical Care volume 21, Article number: 273 (2017)
A majority of patients survive their episode of critical illness but up to 30% of patients suffer from psychological problems such as post-traumatic stress, anxiety and depression in the year after intensive care unit (ICU) stay. A method to identify discharged patients at risk for adverse psychological outcome would be helpful in the triage for ICU follow-up and could enable early intervention. The aim of this study was to evaluate whether early screening with validated questionnaires after ICU discharge can identify patients at risk for symptoms of post-traumatic stress, anxiety and depression 3 months after ICU stay.
We performed a prospective observational cohort study in the general ICU at the Karolinska University Hospital Solna, Stockholm, Sweden. All adult patients surviving ≥ 24 hours in the ICU in a 9-month period were eligible for inclusion. Patients with mental disability, serious auditory and visual disorder, aphasia or who were unable to understand Swedish were excluded. One hundred and thirty-two patients were included and visited by a follow-up nurse within 1 week after ICU discharge. The Hospital Anxiety and Depression Scale (HADS) and the Post-Traumatic Stress Symptoms Checklist-10 (PTSS-10) were administered. Three months after ICU discharge the patients received the same questionnaires by postal mail. We assessed the predictive values of the questionnaires using the area under the receiver operating characteristic curve (AUROC). For correlation calculations, we used Spearman’s rank correlation coefficient. Negative and positive predictive values for each questionnaire were calculated.
Eighty-two patients returned the follow-up questionnaires. We found correlation between early and late scores and reasonable predictive precision regarding 3-month outcomes, with an AUROC of 0.90 for PTSS-10 part B, 0.80 for the HADS anxiety subscale and 0.75 for the HADS depression subscale.
Symptoms of post-traumatic stress, anxiety and depression assessed 1 week after ICU stay correlate with 3-month psychological outcome. The HADS and PTSS-10 may be useful aids to identify ICU survivors at high risk for clinically significant symptoms of post-traumatic stress, anxiety and depression 3 months post ICU stay.
The majority of intensive care unit (ICU) patients are admitted to the ICU due to unexpected and life-threatening illness or injury, impacting physical and psychological recovery. ICU survivors suffer considerable long-term complications from critical illness and ICU stay , including psychological problems . In ICU follow-up studies, one in three ICU survivors has clinically significant symptoms of depression or post-traumatic stress disorder (PTSD) in the year after ICU stay [3, 4]. These problems usually persist for a long period of time and affect health-related quality of life [5, 6] but can potentially be managed if symptoms are recognised.
To facilitate the recovery of these patients, guidelines have been issued recommending ICUs to follow-up ICU survivors during the first year of critical illness. However, the evidence for such ICU follow-up is not consistent [7,8,9]. Yet, for vulnerable subgroups, follow-up has been found to improve patients’ psychological outcome [10, 11].
Ideally, follow-up would start during hospitalisation and also target specific anticipated problems in the individual patient . Despite suggestions of such early follow-up, there are no formal methods to assess ICU survivors at an early stage after ICU stay in order to anticipate the long-term psychological outcome.
The aim of this study was to evaluate whether symptoms of post-traumatic stress, anxiety and depression assessed with two questionnaires in the week after ICU discharge can predict symptoms 3 months later.
The study was approved by the Karolinska Institutet Regional Ethics Review Board in Stockholm, Sweden (approval number 2012/35-31/2).
This prospective cohort study included survivors from one ICU in a tertiary-care hospital in Sweden. Patients’ psychological status was evaluated with an early assessment during the first week of ICU discharge, and at follow-up 3 months after discharge.
All adult patients surviving to ICU discharge after more than 24 hours in the mixed surgical–medical general ICU at Karolinska University Hospital Solna during March 2012–March 2013, with a break during June and August, were eligible for inclusion. Patients were excluded if they were mentally disabled, had serious auditory or visual disorders, were unable to understand Swedish or suffered from aphasia.
An ICU follow-up nurse visited ICU survivors in the general ward within 1 week from discharge and gave them questionnaires assessing symptoms of PTSD, anxiety and depression. Patients filled out the questionnaires by pen and paper. In the few cases when patients were unable to write, the nurse read the questions and answer options out loud and filled out patients’ responses. Three months after ICU discharge the patients received the same questionnaires by postal mail. Non-responders received a reminder telephone call and a new set of questionnaires were sent 2 weeks after the first set. Data on patient characteristics were collected from the medical charts and patient data management system.
The Post-Traumatic Stress Symptoms Checklist-10 (PTSS-10) and the Hospital Anxiety and Depression Scale (HADS) questionnaires were used to evaluate symptoms of PTSD, anxiety and depression at both assessments. The PTSS-10 is a validated screening tool for the detection of PTSD-related symptoms among ICU survivors . Part A consists of four questions concerning memories of traumatic events and feelings while in the ICU, such as nightmares, anxiety or panic, pain or trouble to breathe. Questions can be answered yes or no. Part B consists of 10 questions concerning ongoing stress symptoms. Each item is scored from 1 (never) to 7 (always) with a total score range from 10 to 70 points. A score above 34 in PTSS-10 part B indicates clinically significant post-traumatic stress symptoms and is associated with a diagnosis of PTSD .
The HADS is a questionnaire consisting of two subscales measuring patients’ symptoms of anxiety and depression. Each subscale consists of seven items scored from 0 to 3, resulting in a subscale score range from 0 to 21. A subscale score above 7 suggests clinically significant problems . The questionnaire has been validated among general medical patients as well as critically ill patients [16, 17].
STATA version 12.1 (StataCorp LP, College Station, TX, USA) was used to analyse data. The alpha level was set to 5%. Median scores and interquartile ranges for the questionnaires were calculated. For calculation of monotonic correlations, we used Spearman’s rank correlation coefficient. We performed receiver operating characteristic (ROC) analyses to assess the predictive value of the early assessment with the area under the curve (AUROC). The ROC curves were also used to identify the optimal cut-off value for the early assessment with regard to sensitivity and specificity. Negative and positive predictive values for the questionnaires were calculated. The Mann–Whitney U test was used to compare continuous numerical variables of baseline characteristics and early questionnaire scores between responders and non-responders. For comparison of categorical variables, the chi-square test or Fisher’s exact test were used as appropriate.
A total of 132 patients were included, of whom 82 patients (62%) returned the follow-up questionnaires 3 months after discharge from the ICU (Fig. 1). Table 1 shows patients’ baseline characteristics. We found significant correlations between scores in the ward within 1 week after discharge and 3 months after discharge from the ICU in all three questionnaires (Table 2).
Predictive accuracy of post-traumatic stress symptoms
At 3 months, 11 patients (13%) had PTSS-10 part B scores > 34, implying clinically significant symptoms of post-traumatic stress. At this cut-off value for late symptoms of post-traumatic stress, the AUROC was 0.90 (Fig. 2). With a ward screening cut-off value > 29 points and caseness at 3 months defined as > 34 points, sensitivity was 91% and specificity was 86%. The positive predictive value (PPV) was 50% and the negative predictive value (NPV) was 98%.
Predictive accuracy of anxiety symptoms
Thirteen patients (16%) had a HADS anxiety subscale score of > 7, implying clinically significant symptoms of anxiety 3 months after discharge from the ICU. This cut-off value for late anxiety symptoms generated an AUROC of 0.80 (Fig. 3). An early screening cut-off value > 5 points and 3-month caseness defined as > 7 points yielded a sensitivity of 77%, with a specificity of 75%. The PPV was 37% and the NPV was 95%.
Predictive accuracy of depressive symptoms
Seventeen patients (21%) had scores implying clinically significant symptoms of depression, defined as HADS depression subscale score > 7, 3 months after ICU discharge. The AUROC for late depressive symptoms was 0.75 (Fig. 4). An early screening cut-off value > 4 points and 3-month caseness defined as > 7 points yielded a sensitivity of 76% and a specificity of 66%. The PPV was 37% and the NPV was 91%.
Association between early traumatic memories and late symptoms of post-traumatic stress
We performed a post-hoc analysis regarding the association between traumatic memories at the early assessment (PTSS-10 part A) and 3-month PTSS-10 part B scores. Fifty-one per cent of responders reported zero or one traumatic memory and 48% reported two to four traumatic memories. Twenty-eight per cent of patients reporting two or more traumatic memories scored above the predefined cut-off value in the 3-month PTSS-10 part B, while no patients reporting zero or one traumatic memories scored above the cut-off value (p < 0.001). The median score among patients with two to four traumatic events was 23 (IQR 16–35), while the median score among patients with zero or one traumatic events was 16 (IQR 12–23). The difference in median score between groups was also statistically significant (p < 0.001).
A total of 50 patients (38%) did not return follow-up questionnaires 3 months post ICU stay, despite reminder telephone calls. We did not find any demographic data differences between responders and non-responders.
Non-responders had higher early psychological scores than responders, indicating worse psychological well-being. Median PTSS-10 score among non-responders was 25 versus 20 among responders (p < 0.02), median HADS anxiety subscale score was 5.5 versus 3 (p < 0.02) and median HADS depression subscale score was 6 versus 4 (p < 0.01).
In this prospective follow-up study we found significant correlations between reported symptoms of post-traumatic stress, anxiety and depression in the week after ICU discharge and 3 months later. The predictive precision of early assessment was best for post-traumatic stress symptoms with an AUROC of 0.90 (Fig. 2).
Using the cut-off values based on our data, relatively few individuals who later suffered from clinically significant psychological symptoms would have remained unidentified as possible cases at the early screening. The negative predictive values were 91% for the HADS depression subscale, 95% for the HADS anxiety subscale and 98% for PTSS-10 part B, indicating that only 2–9% of patients scoring above a threshold of 29 (PTSD), 5 (anxiety) or 4 (depression) at the early assessment would have clinically significant symptoms of post-traumatic stress, anxiety or depression 3 months later. Psychological problems have been shown to be persistent within the first year after ICU stay, indicating long-term disability, with major potential benefit from early detection [6, 18].
Our results imply that psychological screening in the first week after ICU stay could generate high-risk cohorts, including most patients with clinically significant post-traumatic, anxiety or depressive symptoms 3 months post ICU stay. In parallel, many assessed patients could be ruled out as low-risk patients, less likely in need of psychological ICU follow-up. As stated, early post-ICU follow-up has been recommended [12, 19]. However, ICU follow-up resources are limited and supportive measures need to be concentrated on patients in need. With the suggested ward screening cut-off values, 48% of patients in our cohort would have been classified as low-risk patients with no need for further psychological follow-up (data not shown).
Methods for predicting or detecting psychological problems in ICU survivors have been called for [12, 19] and have been addressed in earlier studies [20,21,22,23,24]. The predictive value of PTSS-10 has been assessed before, but only in patients after prolonged mechanical ventilation . Wade et al.  developed and validated a new instrument, the intensive care psychological assessment tool (IPAT), to be used in patients with an ICU stay longer than 48 hours and who were awake and capable of answering the questions. The predictive values for later psychological morbidity were moderate, with lower sensitivity and specificity for both outcomes compared with those in this study.
While these and other earlier studies [20,21,22,23,24] indicate that psychological problems can be predicted or detected post ICU stay, patient selection has typically been limited to specific subgroups of ICU survivors. In contrast, our study assesses a wide spectrum of ICU patients with an ICU stay as short as 24 hours and without requiring mechanical ventilation. To our knowledge, this is the first study of early psychological screening of ICU survivors with such a general approach.
Assessing ICU survivors in the ward after ICU stay is becoming more common (personal communication, Stockholm County ICU Follow-up Network) and has been recommended [12, 19]. The HADS and PTSS-10 are fairly short compared with more extensive diagnostic tools and can be administered to patients without engaging a psychologist or psychiatrist. The short, questionnaire-based assessment with these instruments could be supportive in decision-making when considering further psychological follow-up. Such follow-up could be concentrated on patients at high risk for persisting psychological problems.
The early, protocolised psychological evaluation after ICU discharge may also be of value from a research perspective. The potential benefits of ICU follow-up have been difficult to substantiate in clinical trials [26, 27]. Typically, inclusion in such trials has been relatively broad and has not targeted ICU survivor populations with documented high risk for adverse outcome [11, 26]. The screening methods evaluated in our study could be used as a tool to enrich study populations in future intervention studies.
We further hypothesise that an initial first triage, followed by in-depth evaluation and interventions in patients with high early scores, could improve the longer-term psychological outcome in a mixed ICU survivor population. This needs to be investigated in studies combining early screening with early interventions.
In a post-hoc analysis we found that multiple traumatic memories from the ICU (PTSS-10 part A) were associated with a higher degree of post-traumatic stress (PTSS-10 part B) than none or one traumatic memory. This is consistent with earlier findings and strengthens the validity of the PTSS-10 .
We did not use interviews to assess diagnostic criteria for post-traumatic stress, anxiety or depression in our study, which is a limitation. Instead, patients returned questionnaires by postal mail.
Another limitation is the use of the PTSS-10 rather than the PTSS-14, a questionnaire with four additional questions developed to adhere to the Diagnostic and Statistical Manual of Mental Disorders-IV (DSM-IV) criteria for PTSD. The reason for using the PTSS-10 was that this was the questionnaire in clinical use at our ICU follow-up clinic at the time of data collection. Both the PTSS-10 and the PTSS-14 have shown good validity in detecting symptoms of PTSD in ICU survivors according to the DSM-IV criteria [13, 22]. The PTSS-10 and HADS questionnaires have been well studied and are considered clinically valuable tools in assessing the degree of post-traumatic stress, anxiety and depressive symptoms, and correlate fairly well with formal diagnostic evaluations. The short questionnaires can be regarded as screening instruments that lead to formal in-depth assessment in patients with high scores, rather than replacing such assessment.
Finally, the response rate was 62% despite reminder letters, a common response rate in ICU follow-up studies [21, 29]. Non-responders had significantly higher early scores for post-traumatic stress, anxiety and depression. Reasons for non-participation are unclear, but considering the high scores in the early assessment we cannot rule out that they may in part have been related to avoidance.
Screening with the Post-Traumatic Stress Symptoms Checklist-10 and the Hospital Anxiety and Depression Scale in the week after ICU discharge correlates with 3-month outcomes in a wide range of mixed ICU survivors, with fairly good predictive accuracy. The instruments are easily administered and can be of value for identifying ICU survivors at risk for symptoms of post-traumatic stress, anxiety and depression 3 months after ICU discharge. From an ICU follow-up resource allocation perspective, further psychological follow-up can be concentrated on smaller high-risk groups.
Area under the receiver operating characteristic curve
Hospital Anxiety and Depression Scale
Intensive care unit
Post-traumatic stress disorder
Post-Traumatic Stress Symptoms Checklist-10
Receiver operating characteristic
Oeyen SG, Vandijck DM, Benoit DD, Annemans L, Decruyenaere JM. Quality of life after intensive care: a systematic review of the literature. Crit Care Med. 2010;38(12):2386–400.
Rattray JE, Johnston M, Wildsmith JA. Predictors of emotional outcomes of intensive care. Anaesthesia. 2005;60(11):1085–92.
Parker AM, Sricharoenchai T, Raparla S, Schneck KW, Bienvenu OJ, Needham DM. Posttraumatic stress disorder in critical illness survivors: a metaanalysis. Crit Care Med. 2015;43(5):1121–9.
Rabiee A, Nikayin S, Hashem MD, Huang M, Dinglas VD, Bienvenu OJ, et al. Depressive symptoms after critical illness: a systematic review and meta-analysis. Crit Care Med. 2016;44(9):1744–53.
Cuthbertson BH, Scott J, Strachan M, Kilonzo M, Vale L. Quality of life before and after intensive care. Anaesthesia. 2005;60(4):332–9.
Hopkins RO, Weaver LK, Collingridge D, Parkinson RB, Chan KJ, Orme Jr JF. Two-year cognitive, emotional, and quality-of-life outcomes in acute respiratory distress syndrome. Am J Respir Crit Care Med. 2005;171(4):340–7.
Jensen JF, Thomsen T, Overgaard D, Bestle MH, Christensen D, Egerod I. Impact of follow-up consultations for ICU survivors on post-ICU syndrome: a systematic review and meta-analysis. Intensive Care Med. 2015;41(5):763–75.
Jones C, Skirrow P, Griffiths RD, Humphris GH, Ingleby S, Eddleston J, et al. Rehabilitation after critical illness: a randomized, controlled trial. Crit Care Med. 2003;31(10):2456–61.
Walsh TS, Salisbury LG, Merriweather JL, Boyd JA, Griffith DM, Huby G, et al. Increased hospital-based physical rehabilitation and information provision after intensive care unit discharge: the RECOVER Randomized Clinical Trial. JAMA Intern Med. 2015;175(6):901–10.
Jones C, Backman C, Capuzzo M, Egerod I, Flaatten H, Granja C, et al. Intensive care diaries reduce new onset post traumatic stress disorder following critical illness: a randomised, controlled trial. Crit Care. 2010;14(5):R168.
Schandl A, Bottai M, Hellgren E, Sundin O, Sackey P. Gender differences in psychological morbidity and treatment in intensive care survivors—a cohort study. Crit Care. 2012;16(3):R80.
NICE. Rehabilitation after critical illness in adults NICE Clinical guideline (CG83). 2017. https://www.nice.org.uk/guidance/CG83/chapter/introduction. Accessed 15 Dec 2016.
Stoll C, Kapfhammer HP, Rothenhausler HB, Haller M, Briegel J, Schmidt M, et al. Sensitivity and specificity of a screening test to document traumatic experiences and to diagnose post-traumatic stress disorder in ARDS patients after intensive care treatment. Intensive Care Med. 1999;25(7):697–704.
Nickel M, Leiberich P, Nickel C, Tritt K, Mitterlehner F, Rother W, et al. The occurrence of posttraumatic stress disorder in patients following intensive care treatment: a cross-sectional study in a random sample. J Intensive Care Med. 2004;19(5):285–90.
Zigmond AS, Snaith RP. The hospital anxiety and depression scale. Acta Psychiatr Scand. 1983;67(6):361–70.
Herrmann C. International experiences with the Hospital Anxiety and Depression Scale—a review of validation data and clinical results. J Psychosom Res. 1997;42(1):17–41.
Jutte JE, Needham DM, Pfoh ER, Bienvenu OJ. Psychometric evaluation of the Hospital Anxiety and Depression Scale 3 months after acute lung injury. J Crit Care. 2015;30(4):793–8.
Myhren H, Ekeberg O, Toien K, Karlsson S, Stokland O. Posttraumatic stress, anxiety and depression symptoms in patients during the first year post intensive care unit discharge. Crit Care. 2010;14(1):R14.
Elliott D, Davidson JE, Harvey MA, Bemis-Dougherty A, Hopkins RO, Iwashyna TJ, et al. Exploring the scope of post-intensive care syndrome therapy and care: engagement of non-critical care providers and survivors in a second stakeholders meeting. Crit Care Med. 2014;42(12):2518–26.
Boer KR, van Ruler O, van Emmerik AA, Sprangers MA, de Rooij SE, Vroom MB, et al. Factors associated with posttraumatic stress symptoms in a prospective cohort of patients after abdominal sepsis: a nomogram. Intensive Care Med. 2008;34(4):664–74.
Schandl A, Bottai M, Hellgren E, Sundin O, Sackey PV. Developing an early screening instrument for predicting psychological morbidity after critical illness. Crit Care. 2013;17(5):R210.
Twigg E, Humphris G, Jones C, Bramwell R, Griffiths RD. Use of a screening questionnaire for post-traumatic stress disorder (PTSD) on a sample of UK ICU patients. Acta Anaesthesiol Scand. 2008;52(2):202–8.
Wade DM, Hankins M, Smyth DA, Rhone EE, Mythen MG, Howell DC, et al. Detecting acute distress and risk of future psychological morbidity in critically ill patients: validation of the intensive care psychological assessment tool. Crit Care. 2014;18(5):519.
Warlan H, Howland L, Connelly C. Detection of posttraumatic stress symptoms in patients after discharge from intensive care. Am J Crit Care. 2016;25(6):509–15.
Jubran A, Lawm G, Duffner LA, Collins EG, Lanuza DM, Hoffman LA, et al. Post-traumatic stress disorder after weaning from prolonged mechanical ventilation. Intensive Care Med. 2010;36(12):2030–7.
Cuthbertson BH, Rattray J, Campbell MK, Gager M, Roughton S, Smith A, et al. The PRaCTICaL study of nurse led, intensive care follow-up programmes for improving long term outcomes from critical illness: a pragmatic randomised controlled trial. BMJ. 2009;339:b3723.
Herridge MS. The challenge of designing a post-critical illness rehabilitation intervention. Crit Care. 2011;15(5):1002.
Schelling G, Stoll C, Haller M, Briegel J, Manert W, Hummel T, et al. Health-related quality of life and posttraumatic stress disorder in survivors of the acute respiratory distress syndrome. Crit Care Med. 1998;26(4):651–9.
Strom T, Stylsvig M, Toft P. Long-term psychological effects of a no-sedation protocol in critically ill patients. Crit Care. 2011;15(6):R293.
Funding was supported by grants provided by the Stockholm County Council (ALF), the Olle Byggmästare Foundation and the Department of Perioperative Medicine and Intensive Care, Karolinska University Hospital Stockholm, Sweden. No funding sources were involved in the study design, the collection, analysis and interpretation of data or writing of the manuscript.
Availability of data and materials
The datasets used and analysed during the current study are available from the corresponding author on reasonable request.
Ethics approval and consent to participate
The study was approved by the Karolinska Institutet Regional Ethics Review Board in Stockholm, Sweden (approval number 2012/35-31/2). All participants gave informed consent.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Milton, A., Brück, E., Schandl, A. et al. Early psychological screening of intensive care unit survivors: a prospective cohort study. Crit Care 21, 273 (2017) doi:10.1186/s13054-017-1813-z
- Critical care
- Intensive care units
- Stress disorders
- Follow-up studies