RIFLE criteria for acute kidney injury are associated with hospital mortality in critically ill patients: a cohort analysis

Abstract

Introduction

The lack of a standard definition for acute kidney injury has resulted in a large variation in the reported incidence and associated mortality. RIFLE, a newly developed international consensus classification for acute kidney injury, defines three grades of severity – risk (class R), injury (class I) and failure (class F) – but has not yet been evaluated in a clinical series.

Methods

We performed a retrospective cohort study, in seven intensive care units in a single tertiary care academic center, on 5,383 patients admitted during a one year period (1 July 2000–30 June 2001).

Results

Acute kidney injury occurred in 67% of intensive care unit admissions, with maximum RIFLE class R, class I and class F in 12%, 27% and 28%, respectively. Of the 1,510 patients (28%) that reached a level of risk, 840 (56%) progressed. Patients with maximum RIFLE class R, class I and class F had hospital mortality rates of 8.8%, 11.4% and 26.3%, respectively, compared with 5.5% for patients without acute kidney injury. Additionally, acute kidney injury (hazard ratio, 1.7; 95% confidence interval, 1.28–2.13; P < 0.001) and maximum RIFLE class I (hazard ratio, 1.4; 95% confidence interval, 1.02–1.88; P = 0.037) and class F (hazard ratio, 2.7; 95% confidence interval, 2.03–3.55; P < 0.001) were associated with hospital mortality after adjusting for multiple covariates.

Conclusion

In this general intensive care unit population, acute kidney 'risk, injury, failure', as defined by the newly developed RIFLE classification, is associated with increased hospital mortality and resource use. Patients with RIFLE class R are indeed at high risk of progression to class I or class F. Patients with RIFLE class I or class F incur a significantly increased length of stay and an increased risk of inhospital mortality compared with those who do not progress past class R or those who never develop acute kidney injury, even after adjusting for baseline severity of illness, case mix, race, gender and age.

Introduction

Acute kidney injury is well recognized for its impact on the outcome of patients admitted to the intensive care unit (ICU). Illness severity scores such as the Acute Physiology and Chronic Health Evaluation version III (APACHE III) scoring system [1] and the Sequential Organ Failure Assessment score (SOFA) [2] both weight kidney dysfunction heavily (20% and 16.6% of the total scores for acute physiology). Yet there is no consensus on the amount of dysfunction that defines acute kidney injury, with more than 30 definitions in use in the literature today [3]. The variety of definitions used in clinical studies may be partly responsible for the large variations in the reported incidence (1–31%) [4–6] and the associated mortality (19–83%) [3, 6–9] of acute kidney injury. Indeed, the lack of a uniform definition for acute kidney injury is believed to be a major impediment to research in the field [10]. Acute kidney injury is generally defined as 'an abrupt and sustained decrease in kidney function'. Until recently there has not been a consensus on how best to assess kidney function; namely, what markers best reflect kidney function, and what values of those markers discriminate normal from abnormal kidney function.

To establish a uniform definition for acute kidney injury, the Acute Dialysis Quality Initiative formulated the Risk, Injury, Failure, Loss, and End-stage Kidney (RIFLE) classification [11]. RIFLE defines three grades of increasing severity of acute kidney injury – risk (class R), injury (class I) and failure (class F) – and two outcome classes (loss and end-stage kidney disease) (see Table 1). A unique feature of the RIFLE classification is that it provides three grades of severity for acute kidney injury based on changes in either serum creatinine or urine output from the baseline condition. This allows classification of patients with acute kidney injury into one of the three RIFLE severity classes (Table 1).

RIFLE represents a new classification system issued from a process of formal evidence appraisal and expert opinion [11, 12]. Three studies were recently published that used the RIFLE classification to evaluate the occurrence rate and/or outcome of acute kidney injury in two relatively small cohorts (207 ICU patients treated with renal replacement therapy and 183 ICU patients with acute kidney injury) and one larger cohort (813 patients after cardiac surgery) [13–15]. The clinical characteristics and predictive ability of this classification have not, however, been clinically validated in a large general ICU population. The aims of this study were therefore to characterize acute kidney injury defined by the maximum RIFLE classification, to examine the progression between stages of the classification, and to relate this classification to the length of stay and mortality in a large cohort of critically ill patients.

Table 1 Risk, Injury, Failure, Loss, and End-stage Kidney (RIFLE) classification

Patients and methods

Study population

We constructed a retrospective cohort of all adult hospitalizations during a 12 month period (1 July 2000–30 June 2001) at the University of Pittsburgh Medical Center that were admitted to one of its seven ICUs during their hospital stay. We excluded patients receiving chronic hemodialysis (n = 146) from the study cohort, and we only considered the first admission for patients who were readmitted to the ICU during the study period (n = 327). The University of Pittsburgh Medical Center is a tertiary care academic medical center with seven ICUs and more than 120 ICU beds serving medical, surgical, neurological, trauma and solid organ transplant patients.

Data collection

The study was approved by the Institutional Review Board of the University of Pittsburgh Medical Center. Data from different sources were merged by a non-investigator data manager (such as, an honest broker) and were stripped of all identifying information to preserve patient anonymity and to comply with local and federal regulations. Demographic data were retrieved from the electronic hospital database, laboratory data were retrieved from the laboratory database, and patient data were retrieved from the electronic hospital records. After merging data from the different sources, we performed automated and manual data verification. The patient data included demographic, administrative, physiologic, laboratory and hospital outcome information. Ethnicity, reported as white, black or other, was reported by the admitting nurse, and was used to calculate the glomerular filtration rate assessed by the Modification of Diet in Renal Disease (MDRD) equation [16]. High-density (every two hours) physiologic data were only available while patients were in the ICU, while other data sources covered the entire hospitalization. Urine output was recorded at least once every two hours, and serum creatinine was measured at least once daily.

RIFLE criteria

We classified patients according to the maximum RIFLE class (class R, class I or class F) reached during their hospital stay. The RIFLE class was determined based on the worst of either glomerular filtration rate criteria or urine output criteria. We used the change in serum creatinine level and urine output to classify patients according to the RIFLE criteria.

Patients who met any of the criteria of the RIFLE classification were classified as acute kidney injury patients. For patients without chronic kidney insufficiency as reported in the medical history, we calculated a serum creatinine level using the MDRD equation [16] (Cr_MDRD) as recommended by the Acute Dialysis Quality Initiative, by solving the MDRD equation for serum creatinine assuming a glomerular filtration rate of 75 ml/minute/1.73 m². We then used the lowest creatinine value among the hospital admission creatinine, the ICU admission creatinine or the Cr_MDRD creatinine as the baseline value. Approximately one-half of patients were classified using the Cr_MDRD as a baseline. None of these values differed by very much, however (mean difference between creatinine on admission and Cr_MDRD = 0; interquartile range -0.3 to 0.3), and our results are not qualitatively different regardless of which baseline is used. For patients with a history of kidney insufficiency (but not on chronic dialysis) we used their hospital admission creatinine as their baseline. We did not evaluate the outcome classes of RIFLE (loss and end-stage kidney disease criteria) in this study.

Severity of illness

The APACHE III [1] and the SOFA [2] scores were calculated based on the worst variables recorded during the first 24 hours of ICU admission. The nonrenal total SOFA score was calculated from the total SOFA score minus the points for kidney insufficiency. In addition, we calculated the SOFA score and the nonrenal SOFA score on basis of the worst variables recorded during the 24 hours preceding the maximum RIFLE class.

Statistical analysis

The central tendency for continuous data is expressed as the mean ± standard deviation or the median (interquartile range). We tested continuous variables for normality by distribution plots. We compared means using the Student's t test when normally distributed, and the Mann-Whitney U test when not. Comparisons across multiple groups were performed using the F test, with Bonferroni correction for multiple comparisons [17]. When data were not normally distributed, we used the Kruskal-Wallis H analysis of variance test; significant changes over the observation period were tested with the Mann-Whitney U test.

We performed univariate and multivariable logistic regression to assess the impact of different baseline characteristics found to be significantly different over the four groups, on the occurrence of acute kidney injury and on maximum RIFLE class F. In the multivariable model, all covariates were entered simultaneously (enter method). We analyzed for collinearity by assessing correlation between covariates. For continuous variables we analyzed the relationship between the outcome and the variable with locally weighted scatterplot smoothing in order to assess whether categorization was necessary. Finally, the goodness of fit of the model was tested by means of the Hosmer-Lemeshow statistic.

We analyzed hospital survival across groups using the chi-square and the Kaplan-Meier methods, and we tested differences between groups using the log-rank test. Patients alive at hospital discharge were censored. We performed a Cox proportional hazards regression analysis to examine whether the maximum RIFLE class and the incidence of acute kidney injury (defined as patients who fulfilled one of the RIFLE classes) were associated with mortality.

To correct for differences in patient characteristics, we included simultaneously age, gender, race, the main reason for ICU admission, the medical or surgical admission category, and the nonrenal SOFA score on ICU admission or at the maximum RIFLE class in the model (enter method). The nonrenal SOFA score was chosen as a covariate to control for multicollinearity between the RIFLE classification and scoring systems that include points for kidney insufficiency such as the APACHE III and SOFA scores. Interactions between the 'main reason for admission' and the maximum RIFLE class were explored, and were found not to be significant.

We tested whether it was appropriate to treat continuous variables as continuous by a residuals plot. We tested the assumption of proportionality of hazards by plotting hazard rates against time for the four different categories, as well as by the numerical method proposed by Lin and colleagues [18] derived from cumulative sums of martingale residuals. We found no evidence of violating the proportional hazards assumption. Finally, we tested the qualitative goodness of fit of the model with residual plots. A double-sided P value less than 0.05 was considered significant. Analysis was performed with the statistical software package SPSS 11.0.1 (SPSS Inc., Chicago, IL, USA).

Results

Characteristics of patients with acute kidney injury

A total of 5,383 patients was evaluated. The baseline characteristics of the patient cohort are presented according to the maximum RIFLE class in Table 2. The four groups differed in age, race, pre-existing chronic kidney insufficiency, admission type, severity of illness on admission and at the time of maximum RIFLE class, APACHE III score, SOFA score and the nonrenal SOFA score, and the proportion of patients already admitted inhospital to another non-ICU ward.

Table 2 Baseline characteristics of patients classified according to the maximum Risk, Injury, Failure, Loss, and End-stage Kidney (RIFLE) class

Results of the regression analyses examining the impact of the different baseline characteristics on the appearance of acute kidney injury and maximum RIFLE class F are presented in Table 3. Increasing age, greater severity of illness (APACHE III, SOFA and nonrenal SOFA scores), pre-existing chronic kidney insufficiency and a preceding admission to a non-ICU ward in the hospital were associated with increased risk for occurrence of acute kidney injury and maximum RIFLE class F. In addition, black patients had increased risk for development of maximum RIFLE class F. Medical admissions were less likely to result in acute kidney injury or RIFLE class F compared with surgical admissions.

Table 3 Impact of baseline characteristics on the occurrence of acute kidney injury (multivariate logistic regression analysis)

Progression of acute kidney injury to maximum RIFLE class

The progression of acute kidney injury during the ICU stay to the maximum RIFLE class is shown in Figure 1. On the first day of ICU admission, 1,182 patients (21.9%) already had acute kidney injury, defined by the RIFLE criteria. During the entire ICU stay, 3,617 patients (67.2%) had an episode of acute kidney injury defined by RIFLE criteria. One-half of the patients reached the maximum RIFLE class within 2 days after ICU admission (Table 2).

Figure 1

Flow chart of the clinical course of patients until the maximum RIFLE class. Data expressed as patient numbers who were identified at each level, and the percentage of the total number of patients. Patients who appear to skip a grade (class risk or class injury) do so because they did not remain at a transition state for at least 24 hours. 'Ever Risk' and 'Ever Failure' refers to the number of patients who could be identified at this stage. AKI, acute kidney injury; ICU, intensive care unit; RIFLE, Risk, Injury, Failure, Loss, and End-stage Kidney Disease.

More than 50% of the patients with RIFLE class R progressed to RIFLE class I or class F, and more than one-third of the patients with RIFLE class I progressed to class F. The time to progress to class I was 1 (0.5–3.6) days and the time to progress to class F was 4 (1.4–9.5) days. Patients who progressed to a higher RIFLE class during the ICU stay were older compared to patients whose renal function did not deteriorate, (62.4 ± 16.6 years versus 58.5 ± 18.0 years, P < 0.001) and were already more severely ill on admission, as illustrated by the greater APACHE III score (47 (36–62) versus 41 (29–56), P < 0.001) and the greater nonrenal SOFA score (5.7 (3.6) versus 4.8 (3.4), P < 0.001).

Mortality, length of stay and renal replacement therapy

Less than 1% of patients with maximum RIFLE class I and 14.2% of patients with maximum RIFLE class F received renal replacement therapy (Table 4). Increasing severity of acute kidney injury was associated with an increasing length of ICU stay and hospital stay, and higher mortality (Table 5 and Figure 2). Patients with maximum RIFLE class R, class I and class F had hospital mortality rates of 8.8%, 11.4% and 26.3%, respectively, compared with 5.5% for patients without acute kidney injury. Patients with maximum RIFLE class F based on glomerular filtration rate criteria had a somewhat higher inhospital mortality compared with patients who had a maximum RIFLE class F on urine output criteria (27.9% versus 21.9%, P = 0.020). The unadjusted hazard ratios (95% confidence interval) for hospital mortality for acute kidney injury and RIFLE class R, class I and class F were, respectively, 2.1 (1.67–2.57, P < 0.001), 1.3 (0.91–1.93, P = 0.142), 1.9 (1.45–2.48, P < 0.001) and 3.4 (2.64–4.29, P < 0.001). After adjustment for covariates, acute kidney injury was still associated with an almost twofold increased hazard for hospital mortality (Table 5, panel A). Maximum RIFLE class I and class F were both associated with mortality in the covariate-adjusted Cox regression model (Table 5, panel B). These results were unchanged when the nonrenal SOFA at the time of maximum RIFLE class was substituted for the nonrenal SOFA at ICU admission.

Table 4 Outcomes for all patients and for patients classified according to the maximum Risk, Injury, Failure, Loss, and End-stage Kidney (RIFLE) class

Table 5 Association of Risk, Injury, Failure, Loss, and End-stage Kidney (RIFLE) criteria with mortality

Figure 2

Kaplan-Meier curves for survival (inhospital) by maximum RIFLE class. Patients discharged alive were censored. Log-rank statistic, P < 0.001. AKI, acute kidney injury; RIFLE_max, maximum Risk, Injury, Failure, Loss, and End-stage Kidney Disease (RIFLE) class during the intensive care unit stay (days).

Discussion

We found that acute kidney injury, defined by the RIFLE classification, had a high incidence (67.2%) and was associated with an increased risk for hospital mortality compared with those who never developed acute kidney injury. The incidence of almost 70% may appear at odds with the existing literature [5]. Even when limiting cases to those with RIFLE class F (28%) we found a higher rate for ICU patients than typically reported. Fourteen percent of class F patients received renal replacement therapy, however, leading to a rate of 4–5% among ICU patients, consistent with previous reports [9, 19]. Indeed, our study highlights the potential for under-reporting when renal replacement therapy is used to 'define' acute kidney injury. Importantly, even milder degrees of kidney dysfunction, RIFLE class R or class I, were still associated with excess mortality compared with patients who maintained normal function. RIFLE provided a well-balanced classification system for determination of patients with different severity of acute kidney injury, at least as far as risk of mortality or need for renal replacement therapy is concerned.

Not surprisingly, the occurrence of acute kidney injury and maximum RIFLE class F were associated with increased baseline severity of illness and older age (Tables 2 and 3). Patients developing acute kidney injury were slightly older and had higher APACHE III and SOFA scores, even when kidney dysfunction was not counted. However, the severity within acute kidney injury was not so affected by these factors. Patients progressing to RIFLE class I and class F were no older and their nonrenal SOFA scores no greater than patients remaining in RIFLE class R. Although, Herget-Rosenthal and colleagues have also described the progression of acute kidney injury in a selected cohort of 85 ICU patients [20], this is to our knowledge the first time that the progression of acute kidney injury has been examined in a large dataset of general ICU patients.

RIFLE class R would appear to be aptly named. More than one-half of the patients of class R progressed to more severe RIFLE classes, yet those that did not were not at increased risk of hospital mortality. Future studies could target this population for prevention. RIFLE class I may also have been fortuitously named, for this is the stage at which risk for hospital mortality increases even after controlling for covariates. It was commonly held until fairly recently that patients die 'with, and not of, acute renal failure'. Medication (for example, erythropoietin and diuretics) and renal replacement therapy were thought to 'replace' the loss of kidney function. It has already been demonstrated in critically ill patients that severe acute renal failure, defined as the need for renal replacement therapy or oliguria, is independently associated with mortality [4, 5, 19, 21]. In addition, in a cardiothoracic surgery population and in a cohort of hospitalized patients, both with a lower baseline mortality compared with general ICU patients, small changes in serum creatinine were associated with a worse outcome [22, 23]. In the present study we confirm the association of acute kidney injury with increased hospital mortality in a general ICU population. This is a remarkable finding considering how common this condition appears to be – 55% of all patients had RIFLE class I or class F. Furthermore, there was increasing mortality risk over RIFLE classes, despite the fact that these ICU patients had similar comorbidity, as reflected by the nonrenal SOFA score.

The finding that moderate degrees of kidney dysfunction pose a significant risk of death is particularly notable given that we know very little of why this should be. Acute kidney injury may simply be colinear with unmeasured elements of comorbidity, or it may be causally related to the increased mortality. Future studies should consider exploring whether alternative management of patients with mild degrees of kidney dysfunction could change the outcome. If the problem is actually the kidney, then possible mechanisms underlying the excess mortality associated with acute kidney injury are likely to be found in the pathophysiologic changes resulting from kidney insufficiency and adverse effects of renal replacement therapy [24, 25]. Salt and water retention resulting in volume overload, hyperkalemia and acid-base derangements [26], perhaps leading to decreased blood pressure, cardiac output, hepatic and renal blood flow [27], to insulin resistance and protein breakdown, and even to alterations in innate immunity [28], all may contribute to the excess mortality in this group of patients. Furthermore, patients with acute kidney injury have a high incidence of infectious complications [29–31] and frequently develop anemia. Finally, acute kidney injury itself can lead to a non-infectious, proinflammatory response with activation of leukocytes, secretion of proinflammatory cytokines and recruitment of neutrophils and macrophages with resultant lung injury, as has been demonstrated in animal models of ischemia-reperfusion-induced acute renal failure [32, 33]. All these changes may occur prior to, or even in, patients never receiving renal replacement therapy. These same mechanisms, however, may explain why patients who are treated with a lower dose of renal replacement therapy have a worse survival [34–36].

Our study has certain limitations. First, we did not attempt to compare RIFLE with other classification systems; nor did we compare urine output and creatinine criteria, but rather used the criteria as proposed by the Acute Dialysis Quality Initiative workgroup, as the worst classification by each criterion. It is possible that urine output and creatinine criteria provide complementary information, which is lost when these criteria are combined.

The Acute Dialysis Quality Initiative recommended the use of a baseline serum creatinine, yet a true baseline is often unknown for patients admitted to the ICU. Several possible baseline values existed for our patients (hospital admission, ICU admission, or a calculated baseline from the MDRD equation). Our use of the lowest of these values for any given patient may have lead to a higher estimate of change and therefore a higher estimate of the incidence of acute kidney injury. Although the MDRD equation was developed and validated on a large number of patients, conflicting results have been published regarding the validation of this equation in different patient populations. We acknowledge that this equation is only a substitute for the actual glomerular filtration rate, but validation of this equation or developing an alternative for the MDRD-derived baseline creatinine was beyond the scope of this study.

We also acknowledge that some members of our research group have contributed to the consensus process by which RIFLE was developed and by which MDRD recommendations were made. In addition, patient follow-up in our study was limited to hospital discharge information.

Some patients may have died shortly after hospital discharge. As shown in Figure 2, the curves continue to separate, particularly for those in the class F group. Longer follow-up would also be required to examine the RIFLE endpoints 'loss' and 'end-stage disease'. Early renal replacement therapy may theoretically influence the criteria, and patients that would have reached class F could be classified in our study as class R or class I. Only four class I patients were treated with renal replacement therapy, however, and reclassification of these patients to class F does not influence our results.

Although our study is relatively large and included seven ICUs, it was conducted at a single medical center whose case mix and referral patterns may not be representative of other centers. The case mix of this study cohort could have hindered the detection of specific conditions that influence the development of acute kidney injury. Finally, our retrospective study design, using existing medical records, limited our ability to look outside the ICU and to collect information on potential mechanisms of injury. Our design also prohibited the use of more sophisticated measures of kidney function. Indeed, our assessment of time to progression of acute kidney injury may have been artificially lengthened due to daily measurement of creatinine – some patients appeared to skip class R or class I because of this limitation.

Conclusion

In this general ICU population, acute kidney 'risk, injury, failure' as defined by the newly developed RIFLE classification is associated with increased hospital mortality and resource use. Patients with RIFLE class R are indeed at high risk of progression to class I or class F. Patients with RIFLE class I or class F incur a significantly increased length of stay and an increased risk of inhospital mortality compared with those who do not progress past class R or those who never develop acute kidney injury, even after adjusting for baseline severity of illness, case mix, race, gender and age.

Key messages

• The RIFLE classification is a very sensitive definition of acute kidney injury: acute kidney injury defined by the RIFLE classification occurred in two thirds of general ICU patients.

• RIFLE classes injury and failure are independently associated with increased risk for in-hospital dead.

• Patients who meet the very sensitive RIFLE "risk" criteria, are at significant risk for progression to injury or failure, and therefore in-hospital dead.