- Open Access
External validation of urinary C–C motif chemokine ligand 14 (CCL14) for prediction of persistent acute kidney injury
Critical Care volume 25, Article number: 185 (2021)
Persistent acute kidney injury (AKI) portends worse clinical outcomes and remains a therapeutic challenge for clinicians. A recent study found that urinary C–C motif chemokine ligand 14 (CCL14) can predict the development of persistent AKI. We aimed to externally validate urinary CCL14 for the prediction of persistent AKI in critically ill patients.
This was a secondary analysis of the prospective multi-center SAPPHIRE study. We evaluated critically ill patients with cardiac and/or respiratory dysfunction who developed Kidney Disease: Improving Global Outcomes (KDIGO) stage 2–3 AKI within one week of enrollment. The main exposure was the urinary concentration of CCL14 measured at the onset of AKI stage 2–3. The primary endpoint was the development of persistent severe AKI, defined as ≥ 72 h of KDIGO stage 3 AKI or death or renal-replacement therapy (RRT) prior to 72 h. The secondary endpoint was a composite of RRT and/or death by 90 days. We used receiver operating characteristic (ROC) curve analysis to assess discriminative ability of urinary CCL14 for the development of persistent severe AKI and multivariate analysis to compare tertiles of urinary CCL14 and outcomes.
We included 195 patients who developed KDIGO stage 2–3 AKI. Of these, 28 (14%) developed persistent severe AKI, of whom 15 had AKI ≥ 72 h, 12 received RRT and 1 died prior to ≥ 72 h of KDIGO stage 3 AKI. Persistent severe AKI was associated with chronic kidney disease, diabetes mellitus, higher non-renal APACHE III score, greater fluid balance, vasopressor use, and greater change in baseline serum creatinine. The AUC for urinary CCL14 to predict persistent severe AKI was 0.81 (95% CI, 0.72–0.89). The risk of persistent severe AKI increased with higher values of urinary CCL14. RRT and/or death at 90 days increased within tertiles of urinary CCL14 concentration.
This secondary analysis externally validates urinary CCL14 to predict persistent severe AKI in critically ill patients.
Acute kidney injury (AKI) is a common and vexing clinical challenge . For most patients, kidney dysfunction with AKI either resolves rapidly or improves along with resolution of their acute illness ; however, in up to one-third of patients, AKI fails to resolve . This persistent AKI has prognostic importance and portends high risk of long-term sequelae, including incident chronic kidney disease (CKD) and reduced survival . Unfortunately, there are no interventions proven to modify the clinical course for patients with persistent AKI . This is likely attributable to the inability to predict those at high risk for development of persistent AKI, a factor that has undoubtedly hampered suitable patient selection for clinical trials and contributed to therapeutic uncertainty for clinicians .
Recently, the RUBY study described the discovery of urinary C–C motif chemokine ligand-14 (CCL14) to predict the development of persistent severe AKI, defined as Kidney Disease: Improving Global Outcomes (KDIGO) stage 3 AKI for 72 h or greater, among 331 critically ill patients with KDIGO stage 2 or greater AKI (AUC 0.83) . In this study, urinary CCL14 was found to outperform several other AKI biomarkers to predict persistent severe AKI. CCL14 is a member of the chemokine family recognized for its role in macrophage trafficking and may contribute to the development of persistent kidney damage, maladaptive repair, and risk for non-recovery of kidney function [6, 7].
Knowledge of the risk for patients to develop persistent AKI would have important implications for bedside care, including decision making on the utilization of medications with potentially direct toxic or accumulative effects and the informed application of renal-replacement therapy (RRT) . Moreover, such knowledge would provide insights into the pathobiology and kinetics of kidney repair and recovery and further enable predictive enrichment in randomized trials of potential therapeutic targets . Accordingly, we aimed to externally validate the performance of the novel biomarker urinary CCL14 for the prediction of persistent severe AKI among an established, heterogenous cohort of critically ill patients.
The SAPPHIRE study protocol was approved by the Western Institutional Review Board (Olympia, Washington, USA) and by the investigational review boards/ethics committees as required by each participating institution . All enrolled patients or their legally authorized representatives provided written informed consent.
This was a secondary analysis of the previously described SAPPHIRE study, a multi-national prospective observational cohort study of heterogeneous critically ill patients at risk for development of AKI .
Patients enrolled in the SAPPHIRE study served as the source population for the current study . SAPPHIRE enrolled adult critically ill patients with cardiac or respiratory dysfunction without known stage 2–3 AKI at the time of enrollment. The subset of SAPPHIRE patients who developed stage 2–3 AKI within one week of enrollment were included in the present analysis. Aligned with the eligibility in the RUBY study, no patients in this SAPPHIRE cohort had received a kidney transplant, had prior receipt of RRT or had active HIV or hepatitis infection . Serial serum creatinine and urine output data, mortality, and RRT utilization were abstracted from the medical record for ascertainment of AKI stage, using the full KDIGO classification criteria (serum creatinine and urine output) and for endpoint determination. The reference (baseline) serum creatinine was obtained by priority in the following sequence: (1) if at least five values were available, the median of all values available from six months to six days prior to enrollment was used; (2) if not available, the lowest value in the five days prior to enrollment was used; and (3) if no pre-enrollment creatinine was available, the creatinine value at the time of enrollment was used .
The main exposure was the urinary concentration of CCL14, measured within 36 h of the onset of when stage 2 or greater AKI was first identified.
The primary endpoint was the development of persistent severe AKI, using both serum creatinine and urine output criteria, as previously defined in the RUBY study . Briefly, patients who developed 72 consecutive hours of stage 3 AKI or who died or received RRT prior to achieving 72 consecutive hours of stage 3 AKI were considered endpoint positive. Patients with stage 2 AKI at the time of sample collection for biomarker testing were considered endpoint positive if persistent stage 3 AKI started within 48 h of sample collection. This aligns with recent randomized trials evaluating timing of RRT initiation that integrated persistent AKI at 72 h as indications for starting RRT . The secondary endpoint was a composite of RRT and/or death by 90 days.
Sample, data collection and measurement
We collected urine samples twice daily for 4 days from enrollment and then once daily for 3 days. Supernatants from centrifuged urine samples were flash frozen, stored at or below − 70 °C, and thawed prior to analysis. To align with the inclusion criteria for the RUBY study, all urine samples within 36 h of onset of the first instance of stage 2 AKI (or stage 3 AKI if not preceded by stage 2) and prior to initiation of RRT were analyzed. An average of 2.5 urine samples per patient were included in the analysis. Technicians blinded to the clinical data measured CCL14 concentrations in the urine samples by immunoassay using the NEPHROCLEAR™ CCL14 Test on the Astute140® Meter (Astute Medical, San Diego, CA).
We used receiver operating characteristic (ROC) curve analysis to assess discriminative ability of urinary CCL14 for the development of persistent severe AKI. The empirical area under the ROC curve (AUC) was calculated, and corresponding confidence interval (CI) was determined using bootstrap sampling at the patient level to account for multiple samples analyzed per patient. The AUC from the SAPPHIRE analysis was compared to the AUC previously reported for the same endpoint in the RUBY study using a permutation test . We assessed the improvement of risk prediction when adding urinary CCL14 to a reference model consisting of baseline serum creatinine and non-renal Acute Physiology and Chronic Health Evaluation (APACHE) III score by integrated discrimination improvement (IDI), category-free net reclassification improvement (cfNRI), and AUC difference. Risk estimates for both the new and reference models were calculated using Generalized Estimating Equations (GEE) implemented in the geepack R package . To assess the relationship between risk of persistent severe AKI and urinary CCL14 concentration, we plotted risk as a function of the measured urinary CCL14 concentration. We defined risk as the proportion of patient samples that were positive for persistent severe AKI among all patient samples with a urinary CCL14 concentration above the measured value. Risk curves were simulated for different prevalence levels of persistent severe AKI based on the established relationship between positive predictive value and disease prevalence . We calculated hazard ratios for the composite endpoint of RRT and/or death within 90 days, both unadjusted and adjusted for baseline serum creatinine and non-renal APACHE III score, using Cox proportional hazards analysis with CCL14 concentrations as a time-dependent covariate. Probability (1–survival) of the composite of RRT and/or death within 90 days was plotted by CCL14 concentration of the first urine sample collected after onset of stage 2–3 AKI stratified into tertiles. We compared curves across tertiles using the log-rank test. Continuous and categorical baseline variables were compared between patients negative and positive for the primary endpoint using the Mann–Whitney U test and Fisher exact test, respectively. Continuous predictors in GEE and Cox regressions were standardized by subtracting the group mean and normalizing by the standard deviation. For all analyses, two-sided p values < 0.05 were considered statistically significant. We performed all analyses using R 4.0.2 (R Foundation for Statistical Computing. Vienna, Austria).
Of 723 patients enrolled in the SAPPHIRE study, 195 developed stage 2–3 AKI and were included in the analysis (Fig. 1). Of these, 28 (14%) developed the primary endpoint of persistent severe AKI, including 15 who had AKI ≥ 72 h, 12 who received RRT and 1 who died prior to achieving 72 consecutive hours in stage 3 AKI.
Patients who developed persistent severe AKI had greater prevalence of chronic kidney disease (CKD) and diabetes mellitus (DM) at baseline (Table 1). Persistent severe AKI was associated with higher non-renal APACHE III scores, greater positive fluid balance, and more vasopressor use at enrollment. Persistent severe AKI patients had higher baseline serum creatinine values, greater relative change and differences in serum creatinine compared with urine output and were more likely to have stage 3 AKI at enrollment compared to those with no persistent severe AKI (Additional file 1: S1 and S2).
CCL14 and persistent severe AKI
Urinary CCL14 showed good prediction for the occurrence of persistent severe AKI with an AUC 0.81 (95% CI, 0.72–0.89) (Fig. 2). The AUC was not significantly different from the AUC in the RUBY study . The risk for persistent severe AKI increased with greater values of urinary CCL14 (Fig. 3). This increased risk was consistent across simulated curves that modified the baseline prevalence of AKI in the SAPPHIRE population. Urinary CCL14 improved the predictive ability of clinical variables evaluated with GEE. The addition of urinary CCL14 to a baseline clinical model that included serum creatinine and non-renal APACHE III score for the development of persistent severe AKI provides incremental predictive information beyond clinical variables alone (Table 2). This was similarly shown in sensitivity analysis adjusting instead for trajectory in serum creatinine (Additional file 1: S3). In a further sensitivity analysis, we explored the effect of oliguria on the performance of urinary CCL14 to predict persistent severe AKI and found no evidence of significant interaction (Additional file 1: S4).
CCL14 and mortality and RRT
RRT use, death and a composite of RRT and/or death occurred in 29 (15%), 63 (32%) and 74 (38%) patients within 90 days, respectively (Additional file 1: S5). The probability of RRT and/or death within 90 days increased across tertiles of urinary CCL14 concentration (Fig. 4). This was shown in the unadjusted models for urinary CCL14 both as a continuous variable and by tertiles; as well as following adjustment for baseline serum creatinine and non-renal APACHE III score when comparing CCL14 values from tertile 3 to tertile 1 (Table 3).
We performed a secondary analysis using the multi-national prospective observational SAPPHIRE study to externally validate the ability of the novel biomarker urinary CCL14 to predict persistent severe AKI, defined as at least 72 h of stage 3 AKI, receipt of RRT or death, among a heterogeneous cohort of critically ill patients with stage 2–3 AKI. We found that urinary CCL14 had good predictive performance for the development of persistent severe AKI (AUC 0.81), was not modified by oliguria, and provided incremental value beyond commonly available clinical variables. We also found urinary CCL14 correlated with death and RRT use in unadjusted and in adjusted analysis when comparing CCL14 from the highest and lowest tertiles. Our analysis largely replicated the performance for urinary CCL14 with the findings of the RUBY study (AUC 0.83) and now provides added knowledge to extend our confidence in the validity and potential role urinary CCL14 can have in clinical practice . Furthermore, we have extended the findings of the RUBY study by validating the clinical assay using a commercially available analyzer and we have further investigated the relationship between CCL14 and persistent severe AKI by simulating different baseline prevalence rates. We submit that our findings provide a further foundation for evaluation of the application and use of urinary CCL14 in clinical practice.
CCL14 is hypothesized to be an important mediator of kidney tissue damage and may represent a novel indicator of the risk for maladaptive repair and kidney non-recovery . Prior work has shown CCL14 is one of a series of important “kidney risk inflammatory signature [KRIS]” inflammatory proteins circulating in patients with DM which may mediate the risk of progressing to end-stage kidney disease (ESKD) . The mechanisms by which CCL14 mediates persistent severe AKI are not yet completely understood. In AKI, CCL14 may be released from the injured tubular epithelial cells through the activation of inflammatory mediators (e.g., via stimulation of TNF-a receptor activity). However, we submit that further translational work is needed to better understand the role of CCL14 in potentially disrupting intrinsic kidney repair mechanisms following an episode of AKI, how this may contribute to persistent severe AKI and downstream risk of new or worsening CKD and ESKD.
Our external validation of urinary CCL14 to predict the occurrence of persistent severe AKI has several noteworthy implications. From a research standpoint, urinary CCL14 may represent an innovative mechanistic surrogate endpoint used to evaluate novel therapeutic targets for the prevention of persistent severe AKI and its sequelae . For example, CCL14 may be a critical chemokine for monocyte/macrophage recruitment and activation and may mediate kidney injury and accelerate kidney fibrosis [12, 13]. In this context, CCL14 may also be a target for modulation or inhibition in clinical trials. In addition, urinary CCL14 can further be used to discriminate eligibility thresholds to predictively enrich the target population in clinical trials that aim to evaluate therapeutic strategies in patients at high risk for experiencing persistent severe AKI and its sequelae .
From a clinical perspective, urinary CCL14 can provide incremental and valuable information for clinicians that can translate into improved quality of care at the bedside. For example, a positive urinary CCL14 test can better advise clinician’s expectations about the clinical course in a given patient and directly inform care processes, including triaging to a suitable level of monitoring (e.g., ICU or HDU; serial serum creatinine and urine output), augmented surveillance for and avoidance of complications (e.g., withholding potassium supplementation, modifications to enteric nutrition, fluid overload, etc.), and dose-modification of or overt avoidance of selected medications with potential toxic or cumulative adverse effects. Alternatively, a negative urinary CCL14 could provide reassurance about de-intensification of monitoring.
Similarly, knowledge of greater risk for persistent severe AKI should provoke nephrology consultation and planning for the potential receipt of RRT for those with further deterioration. Conversely, a negative urinary CCL14 could reinforce a “watch and wait strategy” and prompt reconsideration of early start to RRT unless absolute indications are present that are medically refractory and unavoidable .
Finally, a positive CCL14 should prompt consideration for the long-term implications of incomplete kidney recovery and risk of incident CKD, progression to ESKD and other complications associated with AKI [15,16,17,18,19]. Our data now reinforce existing recommendations in clinical practice guidelines that survivors of AKI have a routine assessment of kidney function at three months and as needed thereafter, whereby such risk and complications can be identified and potentially modified .
Our study has strengths. This study leveraged a high-fidelity international prospective observational cohort for external validation. The study integrated current consensus recommendations for the diagnosis and staging of AKI . The main study exposure, urinary CCL14, was blinded to clinicians during the study and was evaluated from high-quality stored samples. However, our study also has limitations. The number of patients experiencing the primary outcome in our validation study was small (14%); and as such, the study is certain to have limited statistical power. This is particularly true for analyses of secondary endpoints, which should be viewed as exploratory and hypothesis generating. Further, we recognize that the SAPPHIRE study was performed several years ago and acknowledge that temporal changes in clinical practice (e.g., indications and timing for RRT) may have evolved in response to new data [8, 21,22,23]. Additionally, the study did not further classify AKI events into sub-phenotypes which also may have important prognostic implications and consideration for case-mix selection for future clinical trials.
Our study externally validated urinary CCL14 to predict persistent severe AKI. The findings of an elevated urinary CCL14 in critically ill patients with AKI have relevance for clinical care and represent a mechanism of predictive enrichment for clinical trials.
Availability of data materials
Requests for access to the SAPPHIRE dataset can be made to Astute Medical.
Acute kidney injury
Acute Physiology and Chronic Health Evaluation
Area under receiver operating characteristic curve
C–C motif chemokine ligand 14
Chronic obstructive pulmonary disease
Category-free net reclassification improvement
Chronic kidney disease
End-stage kidney disease
Glomerular filtration rate
Intensive care unit
Integrated discrimination improvement
Kidney Disease: Improving Global Outcomes
Randomized controlled trial
Renal replacement therapy
Hoste EA, Bagshaw SM, Bellomo R, Cely CM, Colman R, Cruz DN, Edipidis K, Forni LG, Gomersall CD, Govil D, et al. Epidemiology of acute kidney injury in critically ill patients: the multinational AKI-EPI study. Intensive Care Med. 2015;41(8):1411–23.
Kellum JA, Sileanu FE, Bihorac A, Hoste EA, Chawla LS. Recovery after acute kidney injury. Am J Respir Crit Care Med. 2017;195(6):784–91.
Perinel S, Vincent F, Lautrette A, Dellamonica J, Mariat C, Zeni F, Cohen Y, Tardy B, Souweine B, Darmon M. Transient and persistent acute kidney injury and the risk of hospital mortality in critically ill patients: results of a multicenter cohort study. Crit Care Med. 2015;43(8):e269-275.
Chawla LS, Bellomo R, Bihorac A, Goldstein SL, Siew ED, Bagshaw SM, Bittleman D, Cruz D, Endre Z, Fitzgerald RL, et al. Acute kidney disease and renal recovery: consensus report of the Acute Disease Quality Initiative (ADQI) 16 Workgroup. Nat Rev Nephrol. 2017;13(4):241–57.
Billings FT, Shaw AD. Clinical trial endpoints in acute kidney injury. Nephron Clin Pract. 2014;127(1–4):89–93.
Hoste E, Bihorac A, Al-Khafaji A, Ortega LM, Ostermann M, Haase M, Zacharowski K, Wunderink R, Heung M, Lissauer M, et al. Identification and validation of biomarkers of persistent acute kidney injury: the RUBY study. Intensive Care Med. 2020;46(5):943–53.
Niewczas MA, Pavkov ME, Skupien J, Smiles A, Md Dom ZI, Wilson JM, Park J, Nair V, Schlafly A, Saulnier PJ, et al. A signature of circulating inflammatory proteins and development of end-stage renal disease in diabetes. Nat Med. 2019;25(5):805–13.
STARRT-AKI Investigators, Canadian Critical Care Trials Group tA, New Zealand Intensive Care Society Clinical Trials Group tUKCCRGtCNTN, the Irish Critical Care Trials G, Bagshaw SM, Wald R, Adhikari NKJ, Bellomo R, da Costa BR, Dreyfuss D et al. Timing of initiation of renal-replacement therapy in acute kidney injury. N Engl J Med. 2020; 383(3):240–51.
Kashani K, Al-Khafaji A, Ardiles T, Artigas A, Bagshaw SM, Bell M, Bihorac A, Birkhahn R, Cely CM, Chawla LS, et al. Discovery and validation of cell cycle arrest biomarkers in human acute kidney injury. Crit Care. 2013;17(1):R25.
Hojsgaard S, Halekoh U, Yan J. The R package geepack for generalized estimating equations. J Stat Softw. 2006;15(2):1–11.
Altman DG, Bland JM. Diagnostic tests 2: predictive values. BMJ. 1994;309(6947):102.
Meng XM, Mak TS, Lan HY. Macrophages in renal fibrosis. Adv Exp Med Biol. 2019;1165:285–303.
Meng XM, Tang PM, Li J, Lan HY. Macrophage phenotype in kidney injury and repair. Kidney Dis (Basel). 2015;1(2):138–46.
Stanski NL, Wong HR. Prognostic and predictive enrichment in sepsis. Nat Rev Nephrol. 2020;16(1):20–31.
Wang WJ, Chao CT, Huang YC, Wang CY, Chang CH, Huang TM, Lai CF, Huang HY, Shiao CC, Chu TS, et al. The impact of acute kidney injury with temporary dialysis on the risk of fracture. J Bone Miner Res. 2014;29(3):676–84.
Wu VC, Wang CY, Shiao CC, Chang CH, Huang HY, Huang TM, Lai CF, Lin MC, Ko WJ, Wu KD, et al. Increased risk of active tuberculosis following acute kidney injury: a nationwide, population-based study. PLoS ONE. 2013;8(7):e69556.
Wu VC, Wu PC, Wu CH, Huang TM, Chang CH, Tsai PR, Ko WJ, Chen L, Wang CY, Chu TS et al. The impact of acute kidney injury on the long-term risk of stroke. J Am Heart Assoc. 2014; 3(4).
Yang WS, Hu FC, Chen MK, Ko WJ, Chen L, Wu KD, Wu VC. High risk of herpes zoster among patients with advance acute kidney injury—a population-based study. Sci Rep. 2015;5:13747.
Chawla LS, Amdur RL, Shaw AD, Faselis C, Palant CE, Kimmel PL. Association between AKI and long-term renal and cardiovascular outcomes in United States veterans. Clin J Am Soc Nephrol. 2014;9(3):448–56.
KDIGO Clinical Practice Guideline for Acute Kidney Injury. https://kdigo.org/guidelines/acute-kidney-injury/
Barbar SD, Gaudry S, Dreyfuss D, Quenot JP. Renal replacement therapy: time to give up on early initiation? Yes Anaesth Crit Care Pain Med. 2018;37(6):501–3.
Gaudry S, Hajage D, Schortgen F, Martin-Lefevre L, Pons B, Boulet E, Boyer A, Chevrel G, Lerolle N, Carpentier D, et al. Initiation strategies for renal-replacement therapy in the intensive care unit. N Engl J Med. 2016;375(2):122–33.
Zarbock A, Kellum JA, Schmidt C, Van Aken H, Wempe C, Pavenstadt H, Boanta A, Gerss J, Meersch M. Effect of early vs delayed initiation of renal replacement therapy on mortality in critically ill patients with acute kidney injury: the ELAIN randomized clinical trial. JAMA. 2016;315(20):2190–9.
SMB is supported by a Canada Research Chair in Critical Care Nephrology.
Astute Medical/ bioMérieux.
Ethical approval and consent to participate.
The SAPPHIRE study protocol was approved by the Western Institutional Review Board (Olympia, Washington, USA) and by each investigational review/ethics boards/committees at each participating institution, as required. All enrolled patients or their legally authorized representatives provided written informed consent.
Consent for publication
SMB discloses consulting fees and grant support from Baxter and consulting fees from CNA Diagnostics. AAK, AA and DD have nothing to disclose. MH discloses consulting fees from Abbott outside the present analysis. ML discloses research grant funding from Prescient Healthcare, LLC as well as grant support from Astute Medical/ bioMérieux outside of the present analysis. KZ received grants from B. Braun Melsungen, CSL Behring, Fresenius Kabi, and Vifor Pharma for the implementation of Frankfurt's Patient Blood Management program and honoraria for scientific lectures from B. Braun Melsungen, Vifor Pharma, Ferring, CSL Behring, and Pharmacosmos outside the present analysis. LSC reports receiving consulting fees from Astute Medical/ bioMérieux. TK, JPK and PM are employees of Astute Medical/ bioMérieux. JAK discloses consulting fees and grant support from Astute Medical/bioMérieux outside the present analysis.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Bagshaw, S.M., Al-Khafaji, A., Artigas, A. et al. External validation of urinary C–C motif chemokine ligand 14 (CCL14) for prediction of persistent acute kidney injury. Crit Care 25, 185 (2021). https://doi.org/10.1186/s13054-021-03618-1
- Acute kidney injury
- Renal replacement therapy