Clinical review: Sleep measurement in critical care patients: research and clinical implications
Critical Care volume 11, Article number: 226 (2007)
Sleep disturbances are common in critically ill patients and have been characterised by numerous studies using polysomnography. Issues regarding patient populations, monitoring duration and timing (nocturnal versus continuous), as well as practical problems encountered in critical care studies using polysomnography are considered with regard to future interventional studies on sleep. Polysomnography is the gold standard in objectively measuring the quality and quantity of sleep. However, it is difficult to undertake, particularly in patients recovering from critical illness in an acute-care area. Therefore, other objective (actigraphy and bispectral index) and subjective (nurse or patient assessment) methods have been used in other critical care studies. Each of these techniques has its own particular advantages and disadvantages. We use data from an interventional study to compare agreement between four of these alternative techniques in the measurement of nocturnal sleep quantity. Recommendations for further developments in sleep monitoring techniques for research and clinical application are made. Also, methodological problems in studies validating various sleep measurement techniques are explored.Trial registration Current Controlled Trials ISRCTN47578325.
Sleep disturbances are common in critically ill patients and they contribute to patient morbidity. Polysomnography studies in both ventilated and non-ventilated critical care patients demonstrate that these sleep disturbances are characterised by severe fragmentation with frequent arousals and awakenings. Sleep architecture is disrupted with a dominance of stage-1 and -2 non-rapid eye movement (NREM) sleep with reduced deeper phases of sleep (slow-wave sleep [SWS] and rapid eye movement [REM]). Critical care patients' sleep traverses the day-night interface, with approximately half of total sleep time occurring in the daytime [1, 2]. Inter- and intra-patient variability also occurs; this is not surprising given the multiple causes of sleep disruption in this patient group. These include environmental factors [3, 4], medication , ventilator , stress response, inflammatory response, and circadian rhythm disturbance factors . To control for these co-variables, studies should involve relatively large patient numbers and be conducted over multiple days and nights. Polysomnography is the gold standard for monitoring the quantity and quality of a patient's sleep. However, polysomnography is technically difficult, especially in critical care (due to environmental and patient considerations). Also, there is clearly no role for polysomnography in the clinical evaluation of patients' sleep on a daily basis. Ultimately, we will rely on clinical evaluation methods to assess individual patients' sleep before deciding whether interventions such as hypnotic therapy are warranted and subsequently to review their efficacy. The Society of Critical Care Medicine guidelines on sedation monitoring recommend that sleep assessment be undertaken . The guidelines recommend patient self-report, but if this is not possible nurse observation could be used.
This review examines the variety of objective and subjective sleep monitoring techniques available for both research and clinical evaluation and discusses their merits and limitations. We complement this review by including comparisons of nocturnal sleep quantity data from a randomised clinical trial of exogenous melatonin in critical care patients which used a number of the techniques discussed.
Materials and methods
MEDLINE (1966 to April 2007), EMBASE (1974 to April 2007), and CINAHL (1982 to April 2007) databases were searched using the following terms, both as MeSH (Medical Subject Heading) headings and text words: 'sleep', 'sleep disorders', 'sleep deprivation', 'actigraphy', 'actimetry' and 'polysomnography', in combination with 'critical illness', 'intensive care', 'critical care', and 'intensive care unit'. Reference lists of all identified papers were also scanned for other relevant publications. Papers were restricted to those pertaining to sleep measurement in adult patients during their critical care admission and published in full in English.
Study comparing different sleep measurement techniques
In the context of a small randomised trial on the effect of melatonin on sleep in critical care patients (unpublished data), we investigated nocturnal sleep in 24 patients studied over the span of 4 nights who were being weaned from mechanical ventilation. The study design and patient characteristics are presented in the Appendix.
Due to the lack of the facilities required by polysomnography (in terms of both staff and equipment), sleep was measured using actigraphy (Actiwatch; Cambridge Neurotechnology Ltd., Cambridge, UK), bispectral index (BIS) (BIS XP, Quattro sensor; Aspect Medical Systems, Inc., Norwood, MA, USA), and nurse assessment and patient assessment (Richards-Campbell Sleep Questionnaire [RCSQ]). BIS data were downloaded every 5 seconds into a personal computer, and patients were recorded as asleep if BIS values were less than 80 . Actigraphy was continuously recorded over the whole study period from the non-dominant hand in 30-second epochs. Delirium-positive patients using the Confusion Assessment Method for the Intensive Care Unit  were excluded from RCSQ evaluation. Nurse assessment of nocturnal sleep was by direct observation using hourly epochs according to the critical care unit's routine sleep monitoring.
Results of the four techniques for nocturnal sleep were expressed using as a common measure the sleep efficiency index (SEI) (total sleep time expressed as a ratio of time available for nocturnal sleep) in order to compare them. We defined nocturnal sleep as the 9 hours between 10 p.m. and 7 a.m. These times coincided with the commencement of the nocturnal quiet time on the unit and ended with the morning nursing staff change over and lights on. Although the RCSQ provides a five-component rating of nocturnal sleep, a total score can be calculated from the mean of total scores in the five domains. This total score has been used as a measure of SEI and has been validated versus polysomnography .
A convenience sample of 12 of the 24 patients underwent dynamometric measurement of grip strength (Jamar hydraulic hand dynamometer; Asimov Engineering Company, Los Angeles, CA, USA) upon study completion to provide an indication of neuromuscular weakness. The mean of three recordings was used, and results were expressed as the percentage of normal values from age- and gender-matched controls .
Agreement between techniques was evaluated using the limits-of-agreement method . This approach compares two techniques at a time and consists of the following:
Drawing a simple scatterplot of the results of the two techniques for each patient with the line of equality (y = x). If the techniques have perfect agreement, all points should fall along this line.
Drawing a graph of the differences between the results of the two techniques plotted against the average measurement value (Bland-Altman plot). From this plot, it is possible not only to evaluate the magnitude of the differences and thus decide on its clinical acceptability, but also to see whether the magnitude of the differences varies with the magnitude of the measurements (for example, increase in the differences with increase in the average values).
From the mean and standard deviation (SD) of these differences, calculating the 95% limits of agreement (that is, the range within which 95% of the differences should lie: mean - 1.96 × SD, mean + 1.96 × SD).
Studies included in literature review
Both objective and subjective monitoring techniques have been used to study sleep in critical care patients. Objective techniques include polysomnography, processed electroencephalograms (EEGs), and actigraphy, whereas subjective assessment usually relies on methods of nurse observation or patient self-report. Individual monitoring techniques are summarised in Table 1.
Twenty-seven studies in critical care patients which used objective sleep measurement techniques were identified. These were predominantly polysomnography studies [4, 6, 11, 14–33] (Table 2); the remainder used actigraphy [34–36] and the BIS  (Table 3). There were 10 subjective sleep measurement studies [3, 38–46] and these used a variety of nurse and patient assessment techniques (Table 4).
Agreement between sleep measurement techniques in interventional study
On 91 nights, data were available for evaluation. Missing data from the four sleep measurement methods are summarised in Table 5. Patient grip strength was a mean of 23.0% (95% confidence interval [CI], 10.1% to 35.9%) compared to age-and gender-matched controls.
Agreement between sleep measurement techniques is graphically evaluated by scatterplots of the results of four different techniques used to measure nocturnal SEI in our intervention study (Figure 1) and Bland-Altman plots (Figure 2).
Limits of agreement (upper limit and lower limit) for SEI for selected sleep measurement techniques were the following:
Actigraphy versus BIS (Figure 2a):
–0.12 (95% CI, -0.22 to -0.02) and 0.97 (95% CI, 0.87 to 1.06).
Patient assessment versus BIS (Figure 2b):
–0.37 (95% CI, -0.46 to -0.28) and 0.65 (95% CI, 0.56 to 0.74).
Nurse assessment versus BIS (Figure 2c):
–0.28 (95% CI, -0.36 to -0.21) and 0.57 (95% CI, 0.50 to 0.65).
Nurse assessment versus patient assessment (Figure 2d):
–0.56 (95% CI, -0.66 to -0.46) and 0.57 (95% CI, 0.47 to 0.67).
Objective measurements of sleep
Polysomnography is the only method of sleep measurement that is capable of identifying individual sleep stages. It requires not only recording of the EEG but also polygraphic recording, including the electro-oculogram and electromyogram (EMG). With these recordings, it is possible to stage sleep using the Rechstaffen and Kales criteria into REM sleep and NREM or SWS (stages 1 to 4). However, the procedure is intensive on technician time and the equipment is costly. Precise and secure placement of the electrodes is required and normally takes a skilled technician approximately 1 hour. A trained physiological measurement technician should be available throughout the recording process to deal with technical problems, including replacing electrodes; interpretation and sleep staging of the recording can take up to 4 hours per sleep cycle. Computer programmes designed to perform time-saving sleep-stage analysis are commercially available. However, these programmes are generally considered inaccurate and manual sleep staging remains the preferred option. Even manual sleep staging may be subjective, particularly in identifying drowsiness and sleep onset in stage 1. All electrodes are glued to the skin with collodion, but the EMG electrodes (which are usually placed sub-mentally) are particularly vulnerable to dislodgement.
Reliability of the polysomnography recordings is reduced further in the hostile electrical environment of the critical care area. It can be difficult to eliminate 50-Hz electrical artifact caused by various essential items of electrical equipment being simultaneously used on the patient or indeed on other patients in the intensive care unit. Individuals subjected to polysomnography recording often find that the electrodes and recording equipment themselves have a disruptive effect on their sleep . This is overcome in sleep laboratories by having acclimatisation nights. The latter have not been used routinely in critical care studies, and it could be argued that polysomnography equipment introduces yet another potential environmental disruption in non-sedated critical care patients. Additionally, they may impact on some nursing activities (for example, patient turning).
Critically ill patients frequently experience delirium , and therefore removal of one or more of the electrodes during the recording is a significant risk and the amount of sedation or antipsychotic therapy required in these patients may be increased by their presence. The support and financing of polysomnography in terms of sleep laboratory equipment and skilled staff, as well as the practical difficulties, have led investigators to adopt other techniques in critical care. Indeed, some studies have used portable polysomnographic equipment capable of providing simplified sleep characteristics such as total sleep time . Such methods may provide a more feasible approach to future polysomnography studies in critical care patients. Since the advent of digital polygraphic recording, there is probably less variation in recording equipment used and modern equipment is less cumbersome than previously. The technical difficulties of undertaking polysomnography in critical care patients are frequently highlighted [1, 27, 36, 37, 46]. However, fewer than half of the studies using polysomnography identified any practical difficulties or loss of data (Table 2), which suggests that there is under-reporting of these difficulties in research studies.
The majority of polysomnography studies have been conducted in non-sedated critical care patients. Although there are some similarities between the states of sleep and sedation (for example, neurotransmitter pathways involved), there are also significant differences such as the lack of temporal or circadian cycling during sedation . Despite these differences, a review of polysomnography sleep studies in critical care patients found reports of similar sleep disturbances in sedated and non-sedated populations .
The limitations of conventional sleep staging have been identified as a particular problem in critical care patients who demonstrate significantly disrupted sleep phases with complex electrophysiological changes [27, 37]. The rapid fluctuations between EEG patterns of wakefulness, NREM 1 and 2 with REMs, and REM sleep without atonia are characteristic of status dissociaticus [31, 48]. Status dissociaticus represents a significant breakdown in the clinical and polysomnographic markers of the three states of being (that is, REM sleep, NREM sleep, and wakefulness) . It is possible that the combination of sleep disturbances and polypharmacy experienced by many critical care patients predisposes to this form of REM sleep behavioural disorder, which shares symptoms similar to delirium .
Studies published on the use of polysomnography in critical care patients tend to be very small, with only 1 out of 23 being completed in more than 25 critical care patients (published as three reports [11, 26, 29]) and the vast majority examining between 15 and 20 patients. In fact, only three polysomnography studies identified have examined the effect of an intervention [6, 26, 33]. The first large randomised controlled trial in 69 patients investigated back massage compared to standard nursing care  and suggested increased sleep quantity in the intervention group. A randomised crossover trial of 11 medical patients reported significant differences in the number of arousals and awakenings between pressure-support and assist-controlled ventilation modes within the same night . Recently, another randomised crossover study in 13 patients found an increase in the number of nocturnal sleep arousals as a consequence of patient-ventilator dysynchrony . The study by Bosma and colleagues  highlights the importance of study endpoint, as reduced ventilator dysynchrony improved sleep quality but had no effect on nocturnal sleep quantity.
Due to the known inter- and intra-patient variability in sleep, we are less clear as to the full benefits that might be observed if multiple nights were studied. In fact, less than half of the critical care studies reported multiple nights' data. Given the loss of the circadian rhythm of the sleep-wake cycle, continuous monitoring of sleep in these patients is important . When the full 24 hours is considered, critical care patients may not have reduced total sleep time . Five of the polysomnography studies [15, 16, 19, 24, 28] undertook continuous monitoring for 48 hours; only three studies [14, 15, 19] examined periods greater than this, totalling no more than 15 patients. Seven studies were undertaken in a single isolation room within the critical care unit [11, 18, 19, 22, 23, 26, 29] and may therefore be of limited applicability to general critical care practice.
In light of these studies, it is a significant challenge to design research studies examining the full effects of sleep interventions over multiple days, identifying appropriate endpoints and in a relatively large number of patients. Polysomnography is currently the definitive sleep monitoring technique, but it may not meet all our requirements for sleep research in critical care patients.
A number of processed EEG monitoring devices have been developed for monitoring sedation in the anaesthesia and critical care environments. Of these, the BIS is the most studied for the measurement of sleep. The BIS is calculated from multiple analysis of the raw EEG waveform, including power spectral analysis, bispectral analysis, and time-based analysis for suppression/non-suppression. Multivariate statistical modelling of these key EEG factors was used to define an algorithm providing a scaled BIS value (index), which correlated with clinical depth of anaesthesia in volunteers. BIS values near 100 represent an 'awake' clinical state, whereas 0 equals EEG silence.
Studies of sleep using the BIS demonstrate that the BIS values fall during physiological sleep and rise during arousal but that there is significant overlap of values for a given sleep stage [9, 51, 52]. One group progressed to use BIS to investigate sleep in critical care patients . They adopted BIS values from their previous study to classify patients as awake (more than 85), in light sleep (60 to 85), in SWS (less than 60), and in REM (BIS of more than 60 with reduced EMG). The study confirmed polysomnography findings that almost none of the intensive care patients displayed normal sleep. The sleep that did occur was reduced in quantity and that abnormal cyclical sleep occurred in approximately half of the patients studied .
BIS has been demonstrated to correlate with neurological status in non-sedated critically ill patients . In patients with better neurological function, BIS values were higher. Therefore, neurological abnormalities (for example, traumatic brain injury) would be expected to reduce BIS values and therefore potentially provide an inaccurate indication of the patients' sleep characteristics. Also in studies of patients with dementia  and delirium , there is a decrease in fast-wave activity in the EEG and BIS values are reduced. Residual effects of sedative agents that may have accumulated in patients with renal and/or hepatic failure would also potentially affect any EEG-based analysis technique.
An advantage of BIS quantification of sleep versus polysomnography is that a technician does not need to be in attendance to ensure good recording. However, there are still potential problems with the practical application of BIS for this indication. Similar to traditional EEG, BIS is subject to electrical interference, and in a group of non-sedated patients, movement and particularly increased EMG activity adversely affect the signal quality index (SQI). Patient removal of the sensor remains a risk, although unlike polysom-nography electrodes, the sensor does not require a skilled technician to replace it.
Our missing data record demonstrates that transient drops in the SQI below 15 result in loss of some, albeit minimal (2%), BIS data in most patients. Three patients had insufficient SQIs that resulted in the loss of more than 2 hours of data and were excluded from analysis. Patient removal, refusal, and hardware failure also accounted for data loss on some nights.
A recent review concluded that the BIS is capable of detecting sleep, but the spread of overlap of BIS values for a given sleep stage prevents its current use as a depth-of-sleep monitor . Nevertheless, it remains an attractive proposition as the continuous monitoring capabilities of BIS ultimately may better capture the dynamics of sleep . It must be highlighted that algorithm developments for the BIS have been based primarily on depth of sedation in patients undergoing general anaesthesia. As previously noted, there are some similarities between sleep and sedation states, but also important differences . Therefore, substantial algorithm development specifically in sleep monitoring is required before it can be used routinely in research studies for this purpose.
An actigraph is a small wristwatch device that is capable of both sensing and storing information regarding patient movement. An accelerometer detects movement in two or three planes, which are then translated into digital counts during predefined epoch periods. The epoch length is the period of time over which the actigraphy data are averaged. The actigraph is capable of collecting data over extended periods before data are downloaded into a personal computer. Computer software based on validated algorithms translates the movement data into sleep-wake periods, which then can be analysed to provide data on various parameters such as the total sleep time, number and frequency of awakenings, and SEI. However, it does not provide any information related to the stage/quality of a patient's sleep.
A variety of commercial products exist as do the accompanying algorithms. Results from one actigraph/algorithm are not necessarily translatable to another . Developments in actigraph hardware and software led the American Academy of Sleep Medicine to acknowledge its merit in measuring sleep variability over multiple nights and the efficacy of various interventions in insomniacs . In healthy individuals, actigraphy is more accurate in recording total sleep time compared to subjective sleep assessment . However, actigraphy still overestimates total sleep time compared to polysomnography, as it has a high sensitivity for detecting sleep, but is less reliable in detecting wakefulness (that is, reduced sleep specificity) . That actigraphy overestimates total sleep time is not unexpected as it commences at an earlier phase of the sleep-onset process compared to polysomnography .
Compared to polysomnography, there are relatively few studies of sleep in critical care patients using actigraphy. In common with polysomnography studies, one report found that sleep was fragmented and limited to short periods of naps throughout the 24 hours . Actigraphy also has been used to monitor the effects of a pharmacological intervention on the sleep characteristics of intensive care patients . No studies have compared actigraphy versus polysomnography in measuring sleep quantity in critical care patients. It seems reasonable to expect that technology that detects movement and uses a predefined algorithm to convert into various sleep parameters may be less accurate in critical care patients. In fact, intensive care-acquired abnormalities of the neuromuscular system are associated with sepsis, certain drugs such as steroids , neuromuscular blockers, and severity of illness. Although these abnormalities may affect nerves, muscles, or both, myopathy is probably the most important problem. The reported occurrence of neuromuscular abnormality varies widely, from 33% to 82% [62–68], probably due to the variability in the methods used to diagnose the problem. Clinical studies such as that of De Jonghe and colleagues  used the Medical Research Council scale to clinically evaluate weakness when the patients were awake and found severe weakness in 25% of patients. Similarly, 26% of patients with two-organ failure due to sepsis or systemic inflammatory response syndrome developed severe weakness . The incidence of mild or moderate weakness was far higher. Though limited, our grip strength data provided an estimate of the degree of neuromuscular weakness experienced by the critical care patients we studied. Hence, there is a significant risk that actigraphy will overestimate sleep quantity variables in the critical care population. We found that actigraphy overestimated the SEI compared to BIS, nurse, and patient assessments (data not shown). We therefore conclude that actigraphy should not be used with currently available technology to measure sleep in this population. However, actigraphy is particularly suited to patient rest-activity rhythm monitoring in this environment over protracted periods of time [59, 70], where we are interested primarily in movement timing as opposed to amplitude.
Subjective measurements of sleep
Compared to polysomnography studies, reports of sleep assessment in critical care patients using subjective methods have evaluated much larger patient numbers, over more prolonged periods, and studied more interventions. In clinical practice, they offer the only real means of assessing the efficacy of interventions in attempting to improve individual patients' sleep.
Using the patients' own assessment of their sleep during their critical care stay is attractive because the patient is best placed to be able to relate their chronic sleep quality and quantity with their acute illness. Indeed, sleep diaries are an important measure of many chronic sleep disturbances and their use in combination with actigraphy provides an assessment of sleep comparable to polysomnography . However, the use of sleep diaries in critically ill patients is limited by the cognitive and physical capabilities of the patient. For these reasons, sleep diaries have not been adopted for critical care assessment of sleep and other measures of subjective sleep such as those based on visual analogue scales (VASs) have been developed.
Patients using the Verran/Snyder-Halpern Sleep Scale demonstrated a comparable assessment of their total sleep time when compared to actigraphy , but another patient group was found to be able to reliably judge only their frequency of awakenings compared to polysomnography when wake periods in excess of 4 minutes were evaluated .
The RCSQ  comprises five VASs. These cover the sleep domains of depth, latency, awakenings, percentage time awake, and quality of sleep. There was a moderate correlation between RCSQ and polysomnography SEI in one critical care group .
Patient sleep perception has been used as the endpoint in three interventional studies in critical care patients [40, 41, 45]. Patients in a critical care area who received nocturnal ocean sounds (white noise) rated their sleep by the RCSQ significantly better than those exposed to ambient sounds . A comparison of overnight midazolam or propofol sedation reported no significant differences in sleep quality between the agents using the Hospital Anxiety and Depression Scale . A combination of a relaxation and guided imagery intervention did not demonstrate a statistically significant benefit on critical care patients' self-report of sleep quality .
A problem with RCSQ when used in a critical care setting is that patients might not be able to complete the questionnaire, with reported failing rates up to 50% . In our interventional study, almost 20% of patients were unable to complete the RCSQ primarily due to the presence of delirium. Also, some patients struggle to use VASs  and verbal descriptions have been adopted in another assessment of patients' sleep for this reason .
In our intervention study, we found that patient perception of sleep grossly differed from SEI by any other measures even when we excluded patients deemed unable to complete the RCSQ. Compared with BIS, RCSQ tended to overestimate nocturnal sleep efficiency. Patient assessment of sleep did not agree well with direct nurse observations either, which is in line with the findings of a previous report . Patient sleep misperception is encountered in chronic insomniacs, and even non-delirious critical care patients may be particularly prone to perceptual difficulties due to memory problems. The complex pharmacokinetics and pharmacodynamics of the sedative drug regimes these patients receive, in tandem with multiple organ failure, have the potential to adversely affect patient assessment. Critical care patients may have memory problems as a direct consequence of sedative exposure , and even in patients with memories, these may be delusional [72, 73]. Interestingly, memory processing appears to be sleep-dependent  and therefore critical care patients with their documented sleep disturbances may be particularly vulnerable to poor recall of their own sleep quality and quantity. Furthermore, patients may lack time cues for day and night and therefore struggle to identify when they actually slept. Finally, the circadian rhythm abnormalities these patients exhibit may further compound their difficulties in subjectively assessing their own nocturnal sleep.
Although patient assessment of sleep has been recommended , caution is required to exclude patients with acute cognitive dysfunction and obvious perceptual problems. This limits the application of tools such as the RCSQ in a significant number of critical care patients.
Nurse assessment of a patient's sleep is often the trigger used to identify patients with significant sleep disturbances in the clinical environment. Research studies in critical care have used direct nurse observation as well as a variety of scales and questionnaires. The frequency of sleep recording by direct observation has ranged from every 5 minutes to 8 times per day. Direct nurse observation has been used to assess sleep in two intervention studies [42, 46]. During periods of reduced environmental noise and disturbances, patients were reported to have increased sleep quantity . In the other study, exogenous melatonin was reported to have no effect on nocturnal or diurnal total sleep time . Another study found that even at 5-minute intervals, nursing staff observation of total sleep time was significantly different compared to polysomnography and provided an overestimate . In our study, we also found that direct nurse observation overestimated sleep efficiency in patients compared to BIS results. It is therefore possible that studies that purely rely on direct nurse observation may not be sensitive enough to detect some changes in sleep quantity due to a given intervention. In regard to the comparison of nurse assessment with patient RCSQ, there was no evidence of a tendency toward either overestimation or underestimation, but the agreement was poor (Figures 1d and 2d). Hourly sleep assessment by nurse observation forms part of our critical care unit's routine nocturnal observations. However, the reality of other direct and indirect nursing care activities will obviously affect the reliability of results. Due to frequent awakenings in these patients (particularly in those receiving mechanical ventilation), intensive observation is probably required for precise recording of sleep quantity . Also, as emphasised by our missing data, there are occasions when the nursing staff experience difficulties in judging the patients' sleep status. Compared to polysomnography, nurses have been shown to correctly assess patients' sleep status 82% of the time . However, this study also found that nurses were too busy or could not tell in almost 20% of the observations even over the relatively short period of the study (4 hours) . Having the nursing staff use a sleep assessment tool such as the RCSQ may well be a better indicator of sleep parameters than purely relying on approximations of sleep quantity. In a study in which RCSQ was used by both patients and nurses, nurses have been shown to rate the RCSQ slightly higher than patients do, but the difference was not statistically significant, although comparison was made in only 13 patients . The coefficient for reliability (Cronbach's alpha) for nurses using the RCSQ has been reported to be between 0.83 and 0.95 [44, 75]. Use of the RCSQ by nurses may avoid the common limitations that critical care patients have in undertaking the scale accurately and may improve nurse assessment, but further validation is necessary.
Methodological problems of reviewed studies
A methodological pitfall common to almost all method comparison studies we reviewed relates to the statistical approach used to compare different techniques, and in particular the use of correlation coefficients. Although in medical literature the correlation coefficient (r) between the results of two measurement methods is often chosen as a measure of agreement, this approach has been shown to be inappropriate for a number of reasons . First, r measures the strength of association between two variables and not their agreement. The hypothesis being tested is that there is no association, precisely no linear relationship (r = 0), between the measurements by the two methods, so that a very small p value indicates that indeed these measurements are related. However, it would be very surprising if they were not, given that they are designed to measure the same quantity, so that the statistical significance of their correlation is irrelevant to the question of agreement. Second, large values of r do not necessarily imply high agreement. As an extreme example, if a method tends to give values that are double those of the other method, the correlation between the measurements by the two methods would be very high but of course the agreement would not. Moreover, correlation depends on the range of the true quantity in the sample, with wide ranges giving greater correlations than narrow ranges, which has nothing to do with whether the true agreement is high or low.
What is the appropriate approach that should be taken when analysing results from method comparison studies on sleep? The answer mainly depends on the nature of the comparison, which can be either of the following:
Comparison of two methods for measuring sleep, neither of which can be regarded as providing the true value (that is, both methods provide an approximate measure of sleep). This is the case for the comparisons in our interventional study in which all four techniques were approximate measures of sleep, and the best analytical approach is that based on the limits-of-agreement method as described above. The calculation of the limits of agreement assumes approximate normal distribution of the differences, which can be assessed graphically by drawing a histogram of the differences. More importantly, this calculation assumes that the mean and SD of the differences are constant (that is, do not depend on the magnitude of the measurement, which can be assessed graphically in the Bland-Altman plots). If indeed a trend is present, alternative methods have to be used .
Comparison of a simpler approximate method with a very precise one, with the aim of assessing whether the two methods agree sufficiently for the simpler method to replace the precise one. In this case, the nature of the question is calibration of the simpler method against the 'exact' method rather than agreement. Standard regression analysis can be used to predict the measurement obtained by the reference method from the measurement obtained by the simpler method.
Polysomnography undoubtedly remains the gold standard for qualifying and quantifying sleep. However, the critical care environment provides many unique challenges and this has led to the use of alterative sleep assessment methods in research studies. All of these techniques have limitations and these should be anticipated in future interventional study designs. Of the alternative objective techniques, the BIS has particular advantages over actigraphy in this patient group. Further algorithm development of the BIS as a measure of sleep quantity may be a useful compromise and facilitate larger research studies over multiple days in critical care.
Clinically, patient self-assessment is attractive, though potentially misleading, and should be regarded with appropriate caution. Perhaps nurse assessment using a tool such as the RCSQ provides the most attractive way forward at this time. Clearly, there is room for further developments in the techniques for measuring sleep in the critical care patient. Concurrent assessment of sleep and delirium is particularly important if we are to appropriately guide pharmacological and non-pharmacological therapies.
The statistical methodology of future method comparison studies for sleep measurement should also be improved, and in particular the use of correlation coefficients should be avoided, in order to provide stronger evidence on the performance of difference methods.
Pharmacological intervention study design and patient characteristics
Randomised double-blind placebo-controlled trial in 24 intensive care patients. Patients were randomly assigned to melatonin 10 mg, administered enterally at 9 p.m. for 4 nights, or to matching placebo.
Patients admitted to the adult general intensive care unit with acute respiratory failure, requiring mechanical ventilation and a tracheostomy to assist weaning.
Expected length of stay of less than 5 further days, pre-admission treatment of sleep disturbances, not receiving target enteral feed volume or aspirates greater than 200 ml, previous history of convulsions or psychiatric or neurological disease, excessive alcohol consumption (more than or equal to 50 units per week), recreational drug use, sleep apnoea, and severe heart failure (New York Heart Association III/IV).
Sedative infusions were discontinued for at least 24 hours (propofol and alfentanil) or more than 36 hours (morphine and midazolam) with a Sedation Agitation Score (SAS) of greater than or equal to 4 . No hypnotics were allowed during the study period; however, haloperidol was administered in patients with an SAS of greater than or equal to 6 (very agitated). Ear plugs and eye masks were made available for use at the patients' discretion each night.
A locally derived scale was used to provide details of environmental disturbances, and nurses subjectively ranked the noise level each night. Staff meetings and posters were employed to encourage staff to minimise environmental, nursing, and clinical disturbances during the nocturnal study periods. Baseline nocturnal illuminance at the head of each patient bed when all lights were off was recorded using a light meter (Luxmeter PU150; Eagle International, Wembley, UK). Mode of ventilation was also recorded hourly and ranked as low-flow/high-flow oxygen, external continuous positive airway pressure (CPAP), CPAP assisted spontaneous breathing, and bi-level positive airway pressure. Baseline characteristics of the study population are reported in Table A1.
non-rapid eye movement
Richards-Campbell Sleep Questionnaire
rapid eye movement
sleep efficiency index
signal quality index
visual analogue scale.
Parthasarathy S, Tobin MJ: Sleep in the intensive care unit. Intensive Care Med 2004, 30: 197-206. 10.1007/s00134-003-2030-6
Weinhouse GL, Schwab RJ: Sleep in the critically ill patient. Sleep 2006, 29: 707-716.
Freedman NS, Kotzer N, Schwab RJ: Patient perception of sleep quality and etiology of sleep disruption in the intensive care unit. Am J Respir Crit Care Med 1999, 159: 1155-1162.
Gabor JY, Cooper AB, Crombach SA, Lee B, Kadikar N, Bettger HE, Hanly PJ: Contribution of the intensive care unit environment to sleep disruption in mechanically ventilated patients and healthy subjects. Am J Respir Crit Care Med 2003, 167: 708-715. 10.1164/rccm.2201090
Bourne RS, Mills GH: Sleep disruption in critically ill patients – pharmacological considerations. Anaesthesia 2004, 59: 374-384. 10.1111/j.1365-2044.2004.03664.x
Parthasarathy S, Tobin MJ: Effect of ventilator mode on sleep quality in critically ill patients. Am J Respir Crit Care Med 2002, 166: 1423-1429. 10.1164/rccm.200209-999OC
Jacobi J, Fraser GL, Coursin DB, Riker RR, Fontaine D, Wittbrodt ET, Chalfin DB, Masica MF, Bjerke HS, Coplin WM, et al.: Clinical practice guidelines for the sustained use of sedatives and analgesics in the critically ill adult. Crit Care Med 2002, 30: 119-141. 10.1097/00003246-200201000-00020
Riker RR, Picard JT, Fraser GL: Prospective evaluation of the Sedation-Agitation Scale for adult critically ill patients. Crit Care Med 1999, 27: 1325-1329. 10.1097/00003246-199907000-00022
Tung A, Lynch JP, Roizen MF: Use of the BIS monitor to detect onset of naturally occurring sleep. J Clin Monit Comput 2002, 17: 37-42. 10.1023/A:1015404803637
Ely EW, Margolin R, Francis J, May L, Truman B, Dittus R, Speroff T, Gautam S, Bernard GR, Inouye SK: Evaluation of delirium in critically ill patients: validation of the Confusion Assessment Method for the Intensive Care Unit (CAM-ICU). Crit Care Med 2001, 29: 1370-1379. 10.1097/00003246-200107000-00012
Richards KC, O'Sullivan PS, Phillips RL: Measurement of sleep in critically ill patients. J Nurs Meas 2000, 8: 131-144.
Mathiowetz V, Kashman N, Volland G, Weber K, Dowe M, Rogers S: Grip and pinch strength: normative data for adults. Arch Phys Med 1985, 66: 69-74.
Bland JM, Altman DG: Statistical methods for assessing agreement between two methods of clinical measurement. Lancet 1986, 1: 307-310.
Johns MW, Large AA, Masterton JP, Dudley HA: Sleep and delirium after open heart surgery. Br J Surg 1974, 61: 377-381. 10.1002/bjs.1800610513
Karacan I, Green JR Jr, Taylor WJ, Williams JC, Eliot RS, Williams RL, Thornby JI, Salis PJ: Sleep in post-myocardial infarction patients. In Stress and the Heart. Edited by: Eliot RS. New York, NY: Futura Publishing Co; 1974:163-195.
Hilton BA: Quantity and quality of patients' sleep and sleep-disturbing factors in a respiratory intensive care unit. J Adv Nurs 1976, 1: 453-468. 10.1111/j.1365-2648.1976.tb00932.x
Orr WC, Stahl ML: Sleep disturbances after open heart surgery. Am J Cardiol 1977, 39: 196-201. 10.1016/S0002-9149(77)80191-4
Broughton R, Baron R: Sleep patterns in the intensive care unit and on the ward after acute myocardial infarction. Electroencephalogr Clin Neurophysiol 1978, 45: 348-360. 10.1016/0013-4694(78)90187-6
Aurell J, Elmqvist D: Sleep in the surgical intensive care unit: continuous polygraphic recording of sleep in nine patients receiving postoperative care. Br Med J (Clin Res Ed) 1985, 290: 1029-1032.
Richards KC, Bairnsfather L: A description of night sleep patterns in the critical care unit. Heart Lung 1988, 17: 35-42.
Fontaine DK: Measurement of nocturnal sleep patterns in trauma patients. Heart Lung 1989, 18: 402-410.
Edwards GB, Schuring LM: Pilot study: validating staff nurses' observations of sleep and wake states among critically ill patients, using polysomnography. Am J Crit Care 1993, 2: 125-131.
Gottschlich MM, Jenkins ME, Mayes T, Khoury J, Kramer M, Warden GD, Kagan RJ: The 1994 Clinical Research Award. A prospective clinical study of the polysomnographic stages of sleep after burn injury. J Burn Care Rehabil 1994, 15: 486-492. 10.1097/00004630-199411000-00005
Aaron JN, Carlisle CC, Carskadon MA, Meyer TJ, Hill NS, Millman RP: Environmental noise as a cause of sleep disruption in an intermediate respiratory care unit. Sleep 1996, 19: 707-710.
Richards KC, Curry N, Lyons W, Todd B: Cardiac dysrhythmia during sleep in the critically ill: a pilot study. Am J Crit Care 1996, 5: 26-33.
Richards KC: Effect of a back massage and relaxation intervention on sleep in critically ill patients. Am J Crit Care 1998, 7: 288-299.
Cooper AB, Thornley KS, Young GB, Slutsky AS, Stewart TE, Hanly PJ: Sleep in critically ill patients requiring mechanical ventilation. Chest 2000, 117: 809-818. 10.1378/chest.117.3.809
Freedman NS, Gazendam J, Levan L, Pack AI, Schwab RJ: Abnormal sleep/wake cycles and the effect of environmental noise on sleep disruption in the intensive care unit. Am J Respir Crit Care Med 2001, 163: 451-457.
Richards KC, Anderson WM, Chesson AL Jr, Nagel CL: Sleep-related breathing disorders in patients who are critically ill. J Cardiovasc Nurs 2002, 17: 42-55. 10.1111/j.0889-7204.2002.00927.x
Valente M, Placidi F, Oliveira AJ, Bigagli A, Morghen I, Proietti R, Gigli GL: Sleep organization pattern as a prognostic marker at the subacute stage of post-traumatic coma. Clin Neurophysiol 2002, 113: 1798-1805. 10.1016/S1388-2457(02)00218-3
Cochen V, Arnulf I, Demeret S, Neulat ML, Gourlet V, Drouot X, Moutereau S, Derenne JP, Similowski T, Willer JC, et al.: Vivid dreams, hallucinations, psychosis and REM sleep in Guillain-Barre syndrome. Brain 2005, 128: 2535-2545. 10.1093/brain/awh585
Hardin KA, Seyal M, Stewart T, Bonekat HW: Sleep in critically ill chemically paralyzed patients requiring mechanical ventilation. Chest 2006, 129: 1468-1477. 10.1378/chest.129.6.1468
Bosma K, Ferreyra G, Ambrogio C, Pasero D, Mirabella L, Braghiroli A, Appendini L, Mascia L, Ranieri VM: Patient-ventilator interaction and sleep in mechanically ventilated patients: pressure support versus proportional assist ventilation. Crit Care Med 2007, 35: 1048-1054. 10.1097/01.CCM.0000260055.64235.7C
Shilo L, Dagan Y, Smorjik Y, Weinberg U, Dolev S, Komptel B, Balaum H, Shenkman L: Patients in the intensive care unit suffer from severe lack of sleep associated with loss of normal melatonin secretion pattern. Am J Med Sci 1999, 317: 278-281. 10.1097/00000441-199905000-00002
Shilo L, Dagan Y, Smorjik Y, Weinberg U, Dolev S, Komptel B, Shenkman L: Effect of melatonin on sleep quality of COPD intensive care patients: a pilot study. Chronobiol Int 2000, 17: 71-76. 10.1081/CBI-100101033
Kroon K, West S: 'Appears to have slept well': assessing sleep in an acute care setting. Contemp Nurse 2000, 9: 284-294.
Nicholson T, Patel J, Sleigh JW: Sleep patterns in intensive care unit patients: a study using the Bispectral Index. Crit Care Resusc 2001, 3: 86-91.
Woods NF: Patterns of sleep in postcardiotomy patients. Nurs Res 1972, 21: 347-352. 10.1097/00006199-197207000-00012
Helton MC, Gordon SH, Nunnery SL: The correlation between sleep deprivation and the intensive care unit syndrome. Heart Lung 1980, 9: 464-468.
Williamson J: The effects of ocean sounds on sleep after coronary artery bypass graft surgery. Am J Crit Care 1992, 1: 91-97.
Treggiari-Venzi M, Borgeat A, Fuchs-Buder T, Gachoud JP, Suter PM: Overnight sedation with midazolam or propofol in the ICU: effects on sleep quality, anxiety and depression. Intensive Care Med 1996, 22: 1186-1190.
Olson D, Borel C, Laskowitz D, Moore D, McConnell E: Quiet time: a nursing intervention to promote sleep in neurocritical care units. Am J Crit Care 2001, 10: 74-78.
Nelson JE, Meier DE, Oei EJ, Nierman DM, Senzel RS, Manfredi PL, Davis SM, Morrison RS: Self-reported symptom experience of critically ill cancer patients receiving intensive care. Crit Care Med 2001, 29: 277-282. 10.1097/00003246-200102000-00010
Frisk U, Nordstrom G: Patients' sleep in an intensive care unit – patients' and nurses' perception. Intensive Crit Care Nurs 2003, 19: 342-349. 10.1016/S0964-3397(03)00076-4
Richardson S: Effects of relaxation and imagery on the sleep of critically ill adults. Dimens Crit Care Nurs 2003, 22: 182-190. 10.1097/00003465-200307000-00009
Ibrahim MG, Bellomo R, Hart GK, Norman TR, Goldsmith D, Bates S, Egi M: A double-blind placebo-controlled randomised pilot study of nocturnal melatonin in tracheostomised patients. Crit Care Resusc 2006, 8: 187-191.
Resta O, Guido P, Foschino Barbaro MP, Picca V, Talamo S, Lamorgese V: Sleep-related breathing disorders in acute respiratory failure assisted by non-invasive ventilatory treatment: utility of portable polysomnographic system. Respir Med 2000, 94: 128-134. 10.1053/rmed.1999.0682
Mahowald MW, Schenck CH: Status dissociatus – A perspective on states of being. Sleep 1991, 14: 69-79.
Mahowald M, Schenck C: Dissociated states of wakefulness and sleep. Neurology 1992, 42: 44-51.
Mahowald MW: Parasomnias. Med Clin North Am 2004, 88: 669-678. 10.1016/j.mcna.2004.01.003
Sleigh JW, Andrzejowski J, Steyn Ross A, Steyn Ross M: The bispectral index: a measure of depth of sleep? Anesth Analg 1999, 88: 659-661. 10.1097/00000539-199903000-00035
Nieuwenhuijs D, Coleman EL, Douglas NJ, Drummond GB, Dahan A: Bispectral index values and spectral edge frequency at different stages of physiologic sleep. Anesth Analg 2002, 94: 125-129. 10.1097/00000539-200201000-00024
Gilbert TT, Wagner MR, Halukurike V, Paz HL, Garland A: Use of bispectral electroencephalogram monitoring to assess neurologic status in unsedated, critically ill patients. Crit Care Med 2001, 29: 1996-2000. 10.1097/00003246-200110000-00024
Renna M, Handy J, Shah A: Low baseline bispectral index of the electroencephalogram in patients with dementia. Anesth Analg 2003, 96: 1380-1385. 10.1213/01.ANE.0000059223.78879.0F
Ely EW, Truman B, Manzi DJ, Sigl JC, Shintani A, Bernard GR: Consciousness monitoring in ventilated patients: bispectral EEG monitors arousal not delirium. Intensive Care Med 2004, 30: 1537-1543. 10.1007/s00134-004-2298-1
Nieuwenhuijs DJF: Processed EEG in natural sleep. Baillieres Best Pract Res Clin Anaesthesiol 2006, 20: 49-56. 10.1016/j.bpa.2005.08.006
Lichstein KL, Stone KC, Donaldson J, Nau SD, Soeffing JP, Murray D, Lester KW, Aguillard RN: Actigraphy validation with insomnia. Sleep 2006, 29: 232-239.
Littner M, Kushida CA, Anderson WM, Bailey D, Berry RB, Davila DG, Hirshkowitz M, Kapen S, Kramer M, Loube D, et al.: Practice parameters for the role of actigraphy in the study of sleep and circadian rhythms: an update for 2002. Sleep 2003, 26: 337-341.
Ancoli IS, Cole R, Alessi C, Chambers M, Moorcroft W, Pollak CP: The role of actigraphy in the study of sleep and circadian rhythms. Sleep 2003, 26: 342-392.
Tryon WW: Issues of validity in actigraphic sleep assessment. Sleep 2004, 27: 158-165.
De Jonghe B, Sharshar T, Lefaucheur J-P, Authier F-J, Durand-Zaleski I, Boussarsar M, Cerf C, Renaud E, Mesrati F, Carlet J, et al.: Paresis acquired in the intensive care unit: a prospective multicenter study. JAMA 2002, 288: 2859-2867. 10.1001/jama.288.22.2859
Witt N, Zochodne D, Bolton C, Grand'Maison F, Wells G, Young G, Sibbald W: Peripheral nerve function in sepsis and multiple organ failure. Chest 1991, 99: 176-184.
Coakley JH, Nagendran K, Honavar M, Hinds CJ: Preliminary observations on the neuromuscular abnormalities in patients with organ failure and sepsis. Intensive Care Med 1993, 19: 323-328. 10.1007/BF01694705
Leijten FS, Harinck-de Weerd JE, Poortvliet DC, de Weerd AW: The role of polyneuropathy in motor convalescence after prolonged mechanical ventilation. JAMA 1995, 274: 1221-1225. 10.1001/jama.274.15.1221
Leijten FS, De Weerd AW, Poortvliet DC, De Ridder VA, Ulrich C, Harink-De Weerd JE: Critical illness polyneuropathy in multiple organ dysfunction syndrome and weaning from the ventilator. Intensive Care Med 1996, 22: 856-861.
Berek K, Margreiter J, Willeit J, Berek A, Schmutzhard E, Mutz NJ: Polyneuropathies in critically ill patients: a prospective evaluation. Intensive Care Med 1996, 22: 849-855.
Coakley JH, Nagendran K, Yarwood GD, Honavar M, Hinds CJ: Patterns of neurophysiological abnormality in prolonged critical illness. Intensive Care Med 1998, 24: 801-807. 10.1007/s001340050669
de Letter MA, Schmitz PI, Visser LH, Verheul FA, Schellens RL, Op de Coul DA, van der Meche FG: Risk factors for the development of polyneuropathy and myopathy in critically ill patients. Crit Care Med 2001, 29: 2281-2286. 10.1097/00003246-200112000-00008
Bednarik J, Lukas Z, Vondracek P: Critical illness polyneuromyopathy: the electrophysiological components of a complex entity. Intensive Care Med 2003, 29: 1505-1514. 10.1007/s00134-003-1858-0
Vinzio S, Ruellan A, Perrin AE, Schlienger JL, Goichot B: Actigraphic assessment of the circadian rest-activity rhythm in elderly patients hospitalized in an acute care unit. Psychiatry Clin Neurosci 2003, 57: 53-58. 10.1046/j.1440-1819.2003.01079.x
Simpson T, Lee ER: Individual factors that influence sleep after cardiac surgery. Am J Crit Care 1996, 5: 182-189.
Samuelson K, Lundberg D, Fridlund B: Memory in relation to depth of sedation in adult mechanically ventilated intensive care patients. Intensive Care Med 2006, 32: 660-667. 10.1007/s00134-006-0105-x
Jones C, Griffiths RD, Humphris G: Disturbed memory and amnesia related to intensive care. Memory 2000, 8: 79-94. 10.1080/096582100387632
Walker MP, Stickgold R: Sleep, memory, and plasticity. Annu Rev Psychol 2006, 57: 139-166. 10.1146/annurev.psych.56.091103.070307
Richards K: Techniques for measurement of sleep in critical care. Focus Crit Care 1987, 14: 34-40.
Bland JM, Altman DG: Measuring agreement in method comparison studies. Stat Methods Med Res 1999, 8: 135-160. 10.1191/096228099673819272
The randomised controlled trial was funded by the Sheffield Teaching Hospitals Department of Pharmacy and Medicines Management and Small Grants Scheme.
The authors declare that they have no competing interests.
RSB conceived the clinical study, enrolled patients, collated the data, analysed and interpreted results, and conceived and undertook the literature review. CM completed the statistical analysis and contributed to the planning of the review. GHM participated in design of the clinical study and data analysis. RK provided methodological advice regarding EEG monitoring. All authors contributed to, read, and approved the final manuscript.
About this article
Cite this article
Bourne, R.S., Minelli, C., Mills, G.H. et al. Clinical review: Sleep measurement in critical care patients: research and clinical implications. Crit Care 11, 226 (2007). https://doi.org/10.1186/cc5966
- Continuous Positive Airway Pressure
- Critical Care
- Total Sleep Time
- Nocturnal Sleep
- Sleep Diary