Skip to main content
Download PDF

External validation of the 2020 ERC/ESICM prognostication strategy algorithm after cardiac arrest

Critical Care volume 26, Article number: 95 (2022) Cite this article

Abstract

Purpose

To assess the performance of the post-cardiac arrest (CA) prognostication strategy algorithm recommended by the European Resuscitation Council (ERC) and the European Society of Intensive Care Medicine (ESICM) in 2020.

Methods

This was a retrospective analysis of the Korean Hypothermia Network Prospective Registry 1.0. Unconscious patients without confounders at day 4 (72–96 h) after return of spontaneous circulation (ROSC) were included. The association between the prognostic factors included in the prognostication strategy algorithm, except status myoclonus and the neurological outcome, was investigated, and finally, the prognostic performance of the prognostication strategy algorithm was evaluated. Poor outcome was defined as cerebral performance categories 3–5 at 6 months after ROSC.

Results

A total of 660 patients were included in the final analysis. Of those, 108 (16.4%) patients had a good neurological outcome at 6 months after CA. The 2020 ERC/ESICM prognostication strategy algorithm identified patients with poor neurological outcome with 60.2% sensitivity (95% CI 55.9–64.4) and 100% specificity (95% CI 93.9–100) among patients who were unconscious or had a GCS_M score ≤ 3 and with 58.2% sensitivity (95% CI 53.9–62.3) and 100% specificity (95% CI 96.6–100) among unconscious patients. When two prognostic factors were combined, any combination of prognostic factors had a false positive rate (FPR) of 0 (95% CI 0–5.6 for combination of no PR/CR and poor CT, 0–30.8 for combination of No SSEP N20 and NSE 60).

Conclusion

The 2020 ERC/ESICM prognostication strategy algorithm predicted poor outcome without an FPR and with sensitivities of 58.2–60.2%. Any combinations of two predictors recommended by ERC/ESICM showed 0% of FPR.

Introduction

Due to hypoxic-ischemic brain injury, most patients are comatose following resuscitation from out-of-hospital cardiac arrest (OHCA) and are admitted to an intensive care unit (ICU) [1, 2]. Targeted temperature management (TTM) of 32–36 °C is the currently recommended treatment for brain injury after cardiac arrest (CA), but it may affect sedative drug metabolism and make accurate outcome prediction difficult [3,4,5,6]. Withdrawal of life-sustaining treatment (WLST) based on a predicted poor neurological outcome is the most common cause of death in patients undergoing TTM after CA [2, 7, 8]. Therefore, strategies for predicting outcome accurately and preventing inaccurate prognostication are critically needed.

The European Resuscitation Council (ERC) and the European Society of Intensive Care Medicine (ESICM) published a 4-step prognostication strategy algorithm in 2015 based on current scientific evidence and expert opinions to minimize the risk of erroneous prognostication [9]. According to two single-center studies and one multicenter study using TTM trial data, the 2015 ERC/ESICM algorithm showed 100% specificity and 18–42% sensitivity [10,11,12]. However, all of these studies were potentially biased by self-fulfilling prophecy because WLST was permitted for patients with a presumed poor prognosis and was the most common cause of death [13]. A new, more simplified prognostication strategy algorithm was published in 2020 [14]. The Korean Hypothermia Network Prospective Registry 1.0 (KORHN-PRO 1.0) is a web-based registry of OHCA patients treated with TTM between October 2015 and December 2018 [15]. KORHN-PRO 1.0 is an ideal source for validation of the proposed prognostication algorithm due to the minimal practice of WLST in Korean intensive care.

We hypothesized that the 2020 ERC/ESICM prognostication strategy algorithm would predict poor neurological outcome without false positive predictions in OHCA patients treated with TTM in a Korean setting. We performed a retrospective analysis of data to assess the performance of the post-cardiac arrest prognostication strategy algorithm recommended by the ERC/ESICM.

Methods

The Korean hypothermia network prospective registry 1.0

KORHN-PRO 1.0 is a multicenter, internet-based registry of OHCA patients treated with TTM irrespective of their initial rhythm between October 2015 and December 2018. The KORHN-PRO registry was registered under clinicaltrials.gov as protocol NCT02827422. Design, participation, data collection and results have previously been published [15]. Briefly, nontraumatic OHCA patients treated with TTM at each center were reported in KORHN-PRO 1.0. The patients with the following conditions were excluded from the registry: active intracranial bleeding, acute stroke, known limitations in therapy including do-not-attempt resuscitation orders, a known prearrest cerebral performance category (CPC) of 3 or 4 and body temperature < 30 °C on admission. Written informed consent was obtained from all patients’ legal surrogates at the participating hospital.

Definition of poor neurological outcome predictors

The screening criterion of the 2020 ERC/ESICM prognostication strategy algorithm was unconscious patients with a Glasgow Coma Scale Motor (GCS_M) score equal to or below 3 ≥ 72 h after return of spontaneous circulation (ROSC) without confounders. In this study, variables collected on day 4 (72–96 h after ROSC) in the KORHN-PRO 1.0 were considered representative of variables “ ≥ 72 h after ROSC" suggested in the guideline, being closest to the guideline recommendation. Accordingly, a GCS_M score ≤ 3 on day 4 was used as a screening criterion. We defined “awakening” as follows. (1) Eyes open spontaneously or in response to voice requests and followed commands or visually tracked moving objects. (2) GCS_M score is equal to 6 points [16]. Patients who did not meet these criteria were defined as unconsciousness. “Without confounders” is difficult to define due to the nature of a registry-based study. Patients receiving sedatives or NMBs on Day 4 were excluded as “sedated or paralyzed.”

The absence of both pupillary light reflex (PLR) and corneal reflex (CR) on day 4 was defined as no PR/CR [17]. Median nerve somatosensory evoked potentials (SSEPs) performed 24 h after ROSC were used for analysis [18]. A bilateral absence of N20 waves was used as a poor outcome predictor and defined as no SSEP N20.

Electroencephalography (EEG) performed 24 h after ROSC was used for analysis. A neurologist blinded to the patient's outcome retrospectively analyzed raw EEG data based on the terminology of the American Clinical Neurophysiology Society and classified them into highly malignant patterns, malignant patterns and benign patterns [19]. Suppressed background, suppressed background with continuous periodic discharges and burst-suppression background were defined as highly malignant EEG and used as poor outcome predictors [20].

Serum neuron-specific enolase (NSE) levels assessed at each participating hospital at 24, 48 and 72 h after CA were entered in the registry [21]. High NSE levels (NSE 60) were defined as NSE > 60 µg/L at 48 h and/or 72 h after ROSC according to the guidelines. Status myoclonus was not included in the KORHN-PRO 1.0. Most sites included in the KORHN start TTM in the emergency room, and almost all use neuromuscular blocking agents (NMBs) to control shivering. Therefore, it is very difficult to detect status myoclonus as defined in the guidelines.

The indication of neuroimaging was made at discretion of the responsible physicians with various time points. The date was entered into the registry if brain CT and MRI had been examined. However, the results of brain CT and DWI were not entered into the registry. Therefore, all brain CTs and DWIs were collected and additional qualitative analysis was performed. Briefly, neuroradiologist blinded to all clinical information reviewed brain CT and MRI (DW imaging and ADC maps) for each patient using a picture archiving and communication system. The first available brain CT within 72 h after ROSC and brain diffusion-weighted imaging (DWI) between 2 and 7 days after ROSC were analyzed in this study. A neuroradiologist visually assessed whether there was generalized edema in brain CT and brain DWI. In the case of generalized edema, it was judged that there was diffuse and extensive anoxic injury suggested in the 2020 ERC/ESICM guideline, and this was defined as poor CT and poor DWI.

Outcome

The primary outcome was a poor neurological outcome at 6 months after ROSC, defined as a cerebral performance categories (CPCs) 3–5. The CPC scale ranges from 1 to 5: 1 represents good cerebral performance or slight cerebral disability, 2 represents moderate disability, independence in activities of daily life, 3 represents severe disability, dependence on others for daily support, 4 represents a coma or vegetative state, and 5 represents death or brain death. Follow-up was performed either face-to-face or by telephone.

Statistical analysis

Categorical variables are presented as counts and percentages, and continuous variables are presented as medians (interquartile ranges, IQRs). To compare differences in patient characteristics and outcomes, a t-test, Fisher’s exact test and the Chi-square test were used.

Two different cohorts were analyzed. The first cohort consisted of unconscious patients ≥ 72 h after ROSC without confounders (N = 660) to test the GCS_M score as one variable in the algorithm. The second cohort consisted of the remaining unconscious patients with a GCS_M score ≤ 3 at ≥ 72 h after ROSC without confounders (N = 589) to test variables after screening.

The term "true" was defined when the predicted outcome and the reported outcome were the same, and "false" was defined when the predicted outcome was different from the reported outcome. A poor neurological outcome was defined as “positive,” and a good outcome was defined as “negative” [12]. Statistical analyses were performed using SPSS 20.0 (Chicago, IL) and MedCalc15.2.2 (MedCalc Software, Mariakerke, Belgium). P values ≤ 0.05 were considered indicative of statistical significance.

Results

Patients

Between October 2015 and December 2018, 1373 OHCA subjects were registered in the KORHN-PRO 1.0. Of those, 328 were excluded due to missing data on the primary outcome (n = 34), WLST (n = 12), missing data on the GCS_M at day 4 (n = 14), death before day 4 (n = 256) and discharge before day 4 (n = 12). The causes of death for patients who died before day 4 were as follows: cardiovascular (n = 92 (35.9%)), cerebral (n = 28 (10.9%)), multiorgan failure (n = 120 (46.9%)) and other or undetermined (n = 15 (5.9%)). Demographic characteristics of subjects who died before Day 4 and those who did not are presented in Additional file 1: Table S1. The length of stay and outcome predictors of 12 patients with WLST are shown in Additional file 1: Table S2.

Three hundred eighty-five subjects were further excluded because they were sedated, paralyzed (n = 136) or awakened on day 4 (n = 249). Thus, 660 subjects met the inclusion, but not the exclusion, criteria, and 108 (16.4%) of them had good outcomes (first cohort). Of the included subjects, 589 had a GCS_M score ≤ 3 on day 4 (second cohort) [Fig. 1].

Fig. 1
figure 1

Flow diagram of included patients. Unconscious patients ≥ 72 h after ROSC without confounders (N = 660) were defined as the first cohort to test the GCS_M score as one variable in the algorithm. Unconscious patients with a GCS_M score ≤ 3 at ≥ 72 h after ROSC without confounders (N = 589) were defined as the second cohort

Full size image

The demographic characteristics of the subjects according to the primary outcome are shown in Table 1. The prognostic investigations suggested in the guidelines were performed with the following results: 518 (78.5%) patients with both PLR and CR, 150 (22.7%) with median nerve SSEP, 363 (55.0%) with NSE, 249 (37.7%) with EEG, 602 (91.2%) with brain CT and 332 (50.3%) with brain DWI. There were no significant differences regarding time to SSEP, time to EEG, time to brain CT or time to brain DWI between the two outcome groups.

Table 1 Demographic characteristics of subjects according to neurological outcome
Full size table

Of 660 patients included in this study, 87 (13.2%) had CPC1, 21 (3.2%) had CPC2, 25 (3.8%) had CPC3, 76 (11.5%) had CPC4, and 451 (68.3%) had CPC5 at 6 months.

Prognostic values of single predictors

The areas under the receiver operating characteristic (ROC) curves, sensitivities and specificities of single predictors in the first cohort are shown in Table 2. No PR/CR, SSEP N20, highly malignant EEG and poor DWI all showed 100% specificity for poor neurological outcome, and among them, the sensitivity of poor DWI was the highest at 78.0% (95% CI 72.7–82.7). On the other hand, the specificities of NSE 60 and poor CT were 94.6% (95% CI 85.1–98.9) and 90.9% (95% CI 83.4–95.8), respectively, and the cutoff value to maintain 100% specificity was 88 for NSE.

Table 2 Prognostic performance of single prognostic methods as recommended by ERC/ESICM
Full size table

The areas under the ROC curves, sensitivities and specificities of single predictors in the second cohort are shown in Table 2. The specificities of all predictors except poor CT were 100%. The area under the ROC curve and sensitivity of NSE 60 were the highest among the predictors (AUC 0.905, sensitivity 81%, 95% CI 76.0–85.3).

Prognostic values of combined predictors

Table 3 shows the sensitivities and specificities for single and combinations of two predictors in the first cohort and the second cohort. All combinations of two predictors in the first cohort showed 100% specificity, and the sensitivity was 26.3–76.6%. The sensitivity of the combination of NSE 60 and poor DWI in the first cohort was the highest at 76.6% (95% CI 69.2–82.9).

Table 3 Sensitivities and specificities for single and combined predictors in the ERC/ESICM algorithm
Full size table

All combinations of two predictors in the second cohort showed 100% specificity, and the sensitivity was 27.2–79.6%. The sensitivity of the combination of NSE 60 and poor DWI in the second cohort was the highest at 79.6% (95% CI 72.3–85.7).

Prognostic performance of the 2020 ERC/ESICM prognostication strategy algorithm

Figure 2 shows the prognostic performance of the 2020 ERC/ESICM prognostication strategy algorithm in the first and second cohorts. The 2020 ERC/ESICM prognostication strategy algorithm predicted poor outcome without a false positive rate (FPR) and with sensitivities of 58.2% in first cohort and 60.2% in second cohort.

Fig. 2
figure 2

Prognostic performance of the 2020 ERC/ESICM prognostication strategy algorithm in cardiac arrest patients treated with targeted temperature management. A The 2020 ERC/ESICM prognostication strategy algorithm for the first cohort. The 2020 ERC/ESICM prognostication strategy algorithm predicted poor outcome without a false positive rate (FPR) and with sensitivities of 58.2%. B The 2020 ERC/ESICM prognostication strategy algorithm for the second cohort. The 2020 ERC/ESICM prognostication strategy algorithm predicted poor outcome without a false positive rate (FPR) and with sensitivities of 60.2%

Full size image

Discussion

The main finding of this study is that the 2020 ERC/ESICM prognostication strategy algorithm predicted poor outcome without false positive prediction and had sensitivities of 58.2–60.2% regardless of whether the GCS_M score was included in the algorithm. Additionally, the combination of SSEP N20 and poor DWI showed the highest sensitivity (76.6% (95% CI 69.2–82.9) in the first cohort, 79.6% (95% CI 72.3–85.7) in the second cohort) without false positive predictions in both cohorts.

Our study has several strengths compared with previous studies [10,11,12]. First, WLST is uncommon in Korea, which can minimize the self-fulfilling prophecy. There were 12 registered incidents of WLST in the KORHN-PRO 1.0, which accounted for 0.9% of all enrolled patients [Additional file 1: Table S2]. KORHN-PRO 1.0 has a high proportion of CPC4 patients. Of 1373 patients included in the KORHN-PRO 1.0, 132 (9.6%) had CPC3-4 at 6 months and 101 (15.3%) of 660 patients included in this study had CPC3-4 at 6 months. This is very different from studies such as TTM and TTM2 trial, which is clear evidence that WLST is not well implemented in Korea. So, WLST was not a major confounder for self-fulfilling prophecy in this study. Second, this study was conducted on an Asian population with CA with mixed etiologies not limited to cardiac causes of CA. Third, more neurological examinations and imaging tests for neurological outcome prediction were performed than in previous studies. This may be the reason why our study showed high sensitivity compared to previous studies.

Pouplet et al. reported that when neurofilament light chain was added to the ERC/ESICM algorithm using ISOCRATE trial data, the sensitivity was increased while maintaining the specificity at 1 [22]. Although the ISOCRATE trial only enrolled shockable cardiac arrest and had a relatively small sample size, the 2020 ERC/ESICM prognostication strategy algorithm showed 53% sensitivity and 100% specificity, which is consistent with the results of our study.

According to the 2020 ERC/ESICM prognostication strategy algorithm, prognostic assessment should start with an accurate clinical examination after excluding confounding factors such as residual sedation and the effect of muscle relaxants (Step 0) [14]. In Step 1, the patient’s best motor response to painful stimuli (GCS_M) is evaluated as an entry point. In Step 2, “poor outcome likely” will be considered if there are 2 or more pathological findings of the following 6 predictors: no pupillary and corneal reflexes at ≥ 72 h, bilaterally absent N20 SSEP wave, highly malignant EEG > 24 h, NSE > 60 μg/L at 48 h and/or 72 h, status myoclonus ≤ 72 h, diffuse and extensive anoxic injury on brain CT/MRI. Therefore, step 0 corresponds to the first cohort of this study, and step 2 corresponds to the second cohort.

The unconsciousness without confounders in PCAS patients is hard to define because most of the patients require the use of sedatives or NMBs for TTM. In addition, drug clearance varies depending on the patient’s clinical condition. Unconsciousness may be exhibited due to metabolic derangement without brain damage. The World Brain Death Project (WBDP) consensus group recommends that clinical examination be delayed until 5 elimination half-lives of the drug elimination with the longest half-life which is also recommended in 2020 ERC/ESICM guideline especially this is being used to make a WLST decision. Propofol has a half-life of 2.3–4.7 h, which implies the need to stop sedatives for at least 24 h in most cases. It is hard to define “Without confounders” due to the nature of a registry-based study. Therefore, patients who received sedatives or NMBs on Day 4 were excluded as “sedated or paralyzed.” A prospective study is needed to overcome these issues.

The Glasgow Coma Scale Motor Score is a screening criterion for the ERC/ESICM prognostication strategy algorithm due to its relatively high sensitivity for predicting poor neurological outcome. A GCS_M score ≤ 2 was the entry point of the 2015 prognostication algorithm [9]. However, it has been changed to a GCS_M score ≤ 3 (absent, abnormal extension or abnormal flexion) in the 2020 ERC/ESIC guideline because using a GCS_M score ≤ 3 as a screening criterion increases the sensitivity for the prediction of poor neurological outcome without reducing specificity [12, 23]. Our results confirm that a GCS_M score ≤ 3 has high sensitivity (89.9%, 95% CI 87.3–92.3) but low specificity (69.0%, 95% CI 56.9–79.5) for predicting poor neurological outcome. Therefore, the GCS_M score should not be used as a poor outcome predictor but only as a screening criterion.

Predicting neurological outcome with a single predictor can induce false positives, which was confirmed in our study. Our results provide further evidence that a multimodal approach could reduce erroneous prognostication [24, 25]. In particular, caution is required to predict the patient's outcome using NSE and brain CT because 3 patients with NSE 60 and 9 patients with poor CT were false positives in the first cohort.

NSE and EEG have been widely studied to predict neurological outcomes after CA [26, 27]. However, the cutoff values of NSE suggested for each study varied from 33 to 120 µg/L. In addition, the definition of the universally accepted poor outcome predictor using the EEG pattern was different for each study. The 2020 ERC/ESICM guideline presented new definitions of poor outcome predictors for NSE and EEG. In our study, NSE 60 had a specificity of 94.6% in the first cohort and a specificity of 100% in the second cohort. Highly malignant EEG showed 100% specificity in both the first and second cohorts. Moreover, both combinations of predictors using NSE 60 or highly malignant EEG showed 100% specificity. Therefore, our study supports the definition of poor outcome predictors for NSE and EEG presented in the 2020 ERC/ESICM guidelines.

Brain CT and DWI have also been studied extensively to date, but there is no universally accepted standard analysis technique [28]. Neuroimaging can be analyzed either qualitatively or quantitatively. Qualitative analysis has the disadvantage of providing subjective information. One qualitative study using multicenter registry data from brain DWI showed an FPR of 14% [29]. However, there is no cutoff value that is accepted worldwide in quantitative analysis of CT and DWI [30,31,32]. Therefore, we selected a qualitative analysis method for brain imaging. According to the substudy of the TTM trial, generalized edema according to the local radiologist’s reading at each site could predict poor outcome with sensitivity of 33.6% and specificity of 98.4% [33]. Moreover, CT after 24 h showed higher specificity than CT before 24 h. However, most of the CT scans in our study were performed within 24 h. So, poor CT showed a high FPR in both the first and second cohorts in this study. In contrast, poor DWI showed an FPR of 0% in both cohorts. Therefore, poor CT is not appropriate for diffuse and extensive anoxic injury on brain CT, as suggested in the guidelines, and a new definition is needed. This is an issue that needs to be addressed in future research.

Our study has several limitations. First, this is a retrospective study that should be confirmed by a prospective multicenter study. Second, as mentioned before, status myoclonus was not included from the analysis. Therefore, our study does not fully validate the 2020 ERC/ESICM prognostication strategy algorithm. Third, outcome predictors were not performed according to a prospective protocol but were performed by attending physicians at each institution as needed. Therefore, the possibility of selection bias cannot be excluded. Nevertheless, it is a clear limitation that neurological examination was only performed in 518 patients (78.5%). Fourth, outcome predictors were not blinded to physicians. Therefore, self-fulfilling prophecy cannot be completely ruled out. However, since WLST was minimally implemented, our study minimized the self-fulfilling prophecy. Finally, we used a qualitative analysis for neuroimaging, which may not be common at many institutions. Therefore, it may be difficult to apply our findings.

Conclusion

The 2020 ERC/ESICM prognostication strategy algorithm predicted poor outcome without an FPR and with sensitivities of 58.2–60.2%. Any combinations of two predictors recommended by ERC/ESICM showed 0% of FPR (95% CI 0–5.6 for combination of no PR/CR and poor CT, 0–30.8 for combination of No SSEP N20 and NSE 60).

Availability of data materials

The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.

References

  1. Laver S, Farrow C, Turner D, Nolan J. Mode of death after admission to an intensive care unit following cardiac arrest. Intensive Care Med. 2004;30:2126–8.

    Article  Google Scholar 

  2. Lemiale V, Dumas F, Mongardon N, Giovanetti O, Charpentier J, Chiche JD, Carli P, Mira JP, Nolan J, Cariou A. Intensive care unit mortality after cardiac arrest: the relative contribution of shock and brain injury in a large cohort. Intensive Care Med. 2013;39:1972–80.

    Article  Google Scholar 

  3. Hypothermia after Cardiac Arrest Study Group. Mild therapeutic hypothermia to improve the neurologic outcome after cardiac arrest. N Engl J Med. 2002;346:549–56.

    Article  Google Scholar 

  4. Nielsen N, Wetterslev J, Cronberg T, Erlinge D, Gasche Y, Hassager C, Horn J, Hovdenes J, Kjaergaard J, Kuiper M, et al. TTM Trial investigators. Targeted temperature management at 33°C versus 36°C after cardiac arrest. N Engl J Med. 2013;369:2197–206.

    Article  CAS  Google Scholar 

  5. Lascarrou JB, Merdji H, Le Gouge A, Colin G, Grillet G, Girardie P, Coupez E, Dequin PF, Cariou A, Boulain T, et al. CRICS-TRIGGERSEP group. Targeted temperature management for cardiac arrest with nonshockable rhythm. N Engl J Med. 2019;381:2327–37.

    Article  Google Scholar 

  6. Samaniego EA, Mlynash M, Caulfield AF, Eyngorn I, Wijman CA. Sedation confounds outcome prediction in cardiac arrest survivors treated with hypothermia. Neurocrit Care. 2011;15:113–9.

    Article  Google Scholar 

  7. Mulder M, Gibbs HG, Smith SW, Dhaliwal R, Scott NL, Sprenkle MD, Geocadin RG. Awakening and withdrawal of life-sustaining treatment in cardiac arrest survivors treated with therapeutic hypothermia. Crit Care Med. 2014;42:2493–9.

    Article  CAS  Google Scholar 

  8. Elmer J, Torres C, Aufderheide TP, Austin MA, Callaway CW, Golan E, Herren H, Jasti J, Kudenchuk PJ, Scales DC, et al. Resuscitation outcomes consortium: association of early withdrawal of life-sustaining therapy for perceived neurological prognosis with mortality after cardiac arrest. Resuscitation. 2016;102:127–35.

    Article  Google Scholar 

  9. Sandroni C, Cariou A, Cavallaro F, Cronberg T, Friberg H, Hoedemaekers C, Horn J, Nolan JP, Rossetti AO, Soar J. Prognostication in comatose survivors of cardiac arrest: an advisory statement from the European Resuscitation Council and the European Society of Intensive Care Medicine. Resuscitation. 2014;85:1779–89.

    Article  Google Scholar 

  10. Zhou SE, Maciel CB, Ormseth CH, Beekman R, Gilmore EJ, Greer DM. Distinct predictive values of current neuroprognostic guidelines in post-cardiac arrest patients. Resuscitation. 2019;139:343–50.

    Article  Google Scholar 

  11. Bongiovanni F, Romagnosi F, Barbella G, Di Rocco A, Rossetti AO, Taccone FS, Sandroni C, Oddo M. Standardized EEG analysis to reduce the uncertainty of outcome prognostication after cardiac arrest. Intensive Care Med. 2020;46:963–72.

    Article  CAS  Google Scholar 

  12. Moseby-Knappe M, Westhall E, Backman S, Mattsson-Carlgren N, Dragancea I, Lybeck A, Friberg H, Stammet P, Lilja G, Horn J, et al. Performance of a guideline-recommended algorithm for prognostication of poor neurological outcome after cardiac arrest. Intensive Care Med. 2020;46:1852–62.

    Article  Google Scholar 

  13. Dragancea I, Wise MP, Al-Subaie N, Cranshaw J, Friberg H, Glover G, Pellis T, Rylance R, Walden A, Nielsen N, et al. TTM trial investigators: protocol-driven neurological prognostication and withdrawal of life-sustaining therapy after cardiac arrest and targeted temperature management. Resuscitation. 2017;117:50–7.

    Article  Google Scholar 

  14. Nolan JP, Sandroni C, Böttiger BW, Cariou A, Cronberg T, Friberg H, Genbrugge C, Haywood K, Lilja G, Moulaert VRM, et al. European Resuscitation Council and European Society of intensive care medicine guidelines 2021: post-resuscitation care. Intensive Care Med. 2021;47:369–421.

    Article  Google Scholar 

  15. Kim SH, Park KN, Youn CS, Chae MK, Kim WY, Lee BK, Lee DH, Jang TC, Lee JH, Choi YH, et al. Korean hypothermia network investigators. Outcome and status of postcardiac arrest care in Korea: results from the Korean Hypothermia Network prospective registry. Clin Exp Emerg Med. 2020;7:250–8.

    Article  Google Scholar 

  16. Lee DH, Cho YS, Lee BK, Lee HY, Jeung KW, Jung YH, Park KN, Kim YJ, Chae MK, Seo DW. KORHN investigators. Late awakening is common in settings without withdrawal of life-sustaining therapy in out-of-hospital cardiac arrest survivors who undergo targeted temperature management. Crit Care Med. 2021. https://doi.org/10.1097/CCM.0000000000005274.

    Article  PubMed  PubMed Central  Google Scholar 

  17. Kim JH, Park I, Chung SP, Kim HY, Min IK, Kim SJ, Kim SH, Lee JH, Moon HJ, Park YS. Korean hypothermia network investigators. Optimal combination of clinical examinations for neurologic prognostication of out-of-hospital cardiac arrest patients. Resuscitation. 2020;155:91–9.

    Article  Google Scholar 

  18. Oh SH, Park KN, Choi SP, Oh JS, Youn CS, Jeong WJ, Ryoo SM, Lee DH, Lee KH. KORHN investigators. Prognostic value of somatosensory evoked potential in cardiac arrest patients without withdrawal of life-sustaining therapy. Resuscitation. 2020;150:154–61.

    Article  Google Scholar 

  19. Hirsch LJ, LaRoche SM, Gaspard N, Gerard E, Svoronos A, Herman ST, Mani R, Arif H, Jette N, Minazad Y, et al. American Clinical Neurophysiology Society’s standardized critical care EEG terminology: 2012 version. J Clin Neurophysiol. 2013;30:1–27.

    Article  CAS  Google Scholar 

  20. Westhall E, Rossetti AO, van Rootselaar AF, Wesenberg Kjaer T, Horn J, Ullén S, Friberg H, Nielsen N, Rosén I, Åneman A, et al. TTM-trial investigators. Standardized EEG interpretation accurately predicts prognosis after cardiac arrest. Neurology. 2016;86:1482–90.

    Article  Google Scholar 

  21. Lee JH, Kim YH, Lee JH, Lee DW, Hwang SY, Youn CS, Kim JH, Sim MS, Jeung KW. Combination of neuron-specific enolase measurement and initial neurological examination for the prediction of neurological outcomes after cardiac arrest. Sci Rep. 2021;11:15067.

    Article  CAS  Google Scholar 

  22. Pouplet C, Colin G, Guichard E, Reignier J, Le Gouge A, Martin S, Lacherade JC, Lascarrou JB. AfterROSC network. The accuracy of various neuro-prognostication algorithms and the added value of neurofilament light chain dosage for patients resuscitated from shockable cardiac arrest: an ancillary analysis of the ISOCRATE study. Resuscitation. 2021;171:1–7.

    Article  Google Scholar 

  23. Sandroni C, Grippo A, Nolan JP. ERC-ESICM guidelines for prognostication after cardiac arrest: time for an update. Intensive Care Med. 2020;46:1901–3.

    Article  Google Scholar 

  24. Roman-Pognuz E, Elmer J, Guyette FX, Poillucci G, Lucangelo U, Berlot G, Manganotti P, Peratoner A, Pellis T, Taccone F, et al. Multimodal long-term predictors of outcome in out of hospital cardiac arrest patients treated with targeted temperature management at 36 °C. J Clin Med. 2021;10:1331.

    Article  Google Scholar 

  25. Youn CS, Callaway CW, Rittenberger JC. Post Cardiac Arrest Service. Combination of initial neurologic examination, quantitative brain imaging and electroencephalography to predict outcome after cardiac arrest. Resuscitation. 2017;110:120–5.

    Article  Google Scholar 

  26. Sandroni C, Cavallaro F, Callaway CW, D’Arrigo S, Sanna T, Kuiper MA, Biancone M, Della Marca G, Farcomeni A, Nolan JP. Predictors of poor neurological outcome in adult comatose survivors of cardiac arrest: a systematic review and meta-analysis, part 2: patients treated with therapeutic hypothermia. Resuscitation. 2013;84:1324–38.

    Article  Google Scholar 

  27. Friberg H, Cronberg T, Dünser MW, Duranteau J, Horn J, Oddo M. Survey on current practices for neurological prognostication after cardiac arrest. Resuscitation. 2015;90:158–62.

    Article  Google Scholar 

  28. Lopez Soto C, Dragoi L, Heyn CC, Kramer A, Pinto R, Adhikari NKJ, Scales DC. Imaging for neuroprognostication after cardiac arrest: systematic review and meta-analysis. Neurocrit Care. 2020;32:206–16.

    Article  Google Scholar 

  29. Ryoo SM, Jeon SB, Sohn CH, Ahn S, Han C, Lee BK, Lee DH, Kim SH, Donnino MW, Kim WY. Korean hypothermia network investigators. Predicting outcome with diffusion-weighted imaging in cardiac arrest patients receiving hypothermia therapy: multicenter retrospective cohort study. Crit Care Med. 2015;43:2370–7.

    Article  CAS  Google Scholar 

  30. Hong JY, Lee DH, Oh JH, Lee SH, Choi YH, Kim SH, Min JH, Kim SJ, Park YS. Korean Hypothermia Network Investigators. Grey-white matter ratio measured using early unenhanced brain computed tomography shows no correlation with neurological outcomes in patients undergoing targeted temperature management after cardiac arrest. Resuscitation. 2019;140:161–9.

    Article  Google Scholar 

  31. Moon HK, Jang J, Park KN, Kim SH, Lee BK, Oh SH, Jeung KW, Choi SP, Cho IS, Youn CS. Quantitative analysis of relative volume of low apparent diffusion coefficient value can predict neurologic outcome after cardiac arrest. Resuscitation. 2018;126:36–42.

    Article  Google Scholar 

  32. Wu O, Sorensen AG, Benner T, Singhal AB, Furie KL, Greer DM. Comatose patients with cardiac arrest: predicting clinical outcome with diffusion-weighted MR imaging. Radiology. 2009;252:173–81.

    Article  Google Scholar 

  33. Moseby-Knappe M, Pellis T, Dragancea I, Friberg H, Nielsen N, Horn J, Kuiper M, Roncarati A, Siemund R, Undén J, et al. TTM-trial investigators. Head computed tomography for prognostication of poor outcome in comatose patients after cardiac arrest and targeted temperature management. Resuscitation. 2017;119:89–94.

    Article  Google Scholar 

Download references

Acknowledgements

The following investigators participated in the Korean Hypothermia Network: Network Chair: Seung Pill Choi (The Catholic University of Korea, Eunpyeong St. Mary’s Hospital, emvic98@catholic.ac.kr); Principal investigators of each hospital: Kyu Nam Park (The Catholic University of Korea, Seoul St. Mary’s Hospital), Minjung Kathy Chae (Ajou University Medical Center), Won Young Kim (Asan Medical Center), Byung Kook Lee (Chonnam National University Hospital), Dong Hoon Lee (Chung-Ang University Hospital), Tae Chang Jang (Daegu Catholic University Medical Center), Jae Hoon Lee (Dong-A University Hospital), Yoon Hee Choi (Ewha Womans University Mokdong Hospital), Je Sung You (Gangnam Severance Hospital), Young Hwan Lee (Hallym University Sacred Heart Hospital), In Soo Cho (Hanil General Hospital), Su Jin Kim (Korea University Anam Hospital), Jong-Seok Lee (Kyung Hee University Medical Center), Yong Hwan Kim (Samsung Changwon Hospital), Min Seob Sim (Samsung Medical Center), Jonghwan Shin (Seoul Metropolitan Government Seoul National University Boramae Medical Center), Yoo Seok Park (Severance Hospital), Hyung Jun Moon (Soonchunhyang University Hospital Cheonan), Won Jung Jeong (The Catholic University of Korea, St. Vincent’s Hospital), Joo Suk Oh (The Catholic University of Korea, Uijeongbu St. Mary’s Hospital), Seung Pill Choi (The Catholic University of Korea, Yeouido St. Mary’s Hospital) and Kyoung-Chul Cha (Wonju Severance Christian Hospital).

Funding

None.

Author information

Authors and Affiliations

  1. Department of Emergency Medicine, Seoul St. Mary’s Hospital, College of Medicine, The Catholic University of Korea, 222 Banpo-daero, Seocho-gu, Seoul, 137-701, Republic of Korea

    Chun Song Youn, Kyu Nam Park & Sang Hoon Oh

  2. Department of Emergency Medicine, Eunpyeong St. Mary Hospital, College of Medicine, The Catholic University of Korea, Seoul, 137-701, South Korea

    Soo Hyun Kim & Seung Pill Choi

  3. Department of Emergency Medicine, Chonnam National University Medical School, Gwangju, Korea

    Byung Kook Lee & Kyung Woon Jeung

  4. Department of Clinical Sciences, Neurology, Skåne University Hospital, Lund University, Lund, Sweden

    Tobias Cronberg

  5. Department of Emergency Medicine, Hanil General Hospital, Korea Electric Power Medical Corporation, Seoul, Korea

    In Soo Cho

  6. Department of Emergency Medicine, Seoul St. Mary’s Hospital, College of Medicine, The Catholic University of Korea, 222, Banpo-daero, Seocho-Gu, Seoul, 06591, Republic of Korea

    Kyu Nam Park

Authors
  1. Chun Song Youn
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Kyu Nam Park
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Soo Hyun Kim
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Byung Kook Lee
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Tobias Cronberg
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Sang Hoon Oh
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Kyung Woon Jeung
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. In Soo Cho
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Seung Pill Choi
    View author publications

    You can also search for this author in PubMed Google Scholar

Consortia

the Korean Hypothermia Network Investigators

Contributions

CSY, KNP, TC and SPC were involved in concept and design. SHK, BKL and ISC were involved in acquisition and cleaning of the data. CSY, SHO and KWJ were involved in analysis and interpretation of the data. CSY and BKL were involved in statistical analysis. CSY, KNP and TC were involved in drafting the manuscript. The authors would like to thank the KORHN investigators. All of the authors reviewed, discussed, and approved the final manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Kyu Nam Park.

Ethics declarations

Ethical approval and consent to participate

The study included an informed consent form approved by all participating hospitals including the institutional review board (IRB) of Seoul St. Mary’s Hospital (XC15OIMI0081K) and registered at the International Clinical Trials Registry Platform (NCT02827422). Written informed consent was obtained from all patients' legal surrogates.

Consent for publication

Not applicable.

Competing interests

None of the authors has declared a conflict of interest.

Take-home message

The 2020 ERC/ESICM algorithm reliably predicted poor outcome in patients treated with targeted temperature management after out-of-hospital cardiac arrest where withdrawal of life-sustaining therapy is uncommon. However, our results should be validated by prospective studies.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1: Supplementary Table 1.

Demographic characteristics of subjects who died before Day 4 and those who did not. Supplementary Table 2. Length of stay and outcome predictors of WLST patients.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Youn, C.S., Park, K.N., Kim, S.H. et al. External validation of the 2020 ERC/ESICM prognostication strategy algorithm after cardiac arrest. Crit Care 26, 95 (2022). https://doi.org/10.1186/s13054-022-03954-w

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13054-022-03954-w

Keywords

Critical Care

ISSN: 1364-8535