Skip to main content

Table 2 Model characteristics of model development and updating studies

From: Prognostic models for outcome prediction following in-hospital cardiac arrest using pre-arrest factors: a systematic review, meta-analysis and critical appraisal

Reference (first author, year of publication)

Type of factors in final model

Prognostic factors in final model

Model presentation

Evaluation of model performance

Validation

Calibration

Discrimination

Classification

Model development

Swindell et al. [18]

Pre + intra-arrest

Age, BMI, comorbidity (cancer or liver disease), days from admission to arrest

Scoring system

n.r.

AUC 0.581 (95% CI 0.577–0.585)

ABDC ≤ 2 sensitivity 96.8% (accuracy 33.6%), ABCD ≤ -1 specificity 82%

n.r.

Chan et al. [19]

Pre + intra-arrest

Age, initial rhythm, heart failure during admission, respiratory insufficiency, diabetes mellitus, metabolic disturbance, metastatic/haematologic malignancy, acute CNS non-stroke event, continuous IV vasopressor, mechanical ventilation

Logistic regression model with beta-coefficients estimates

D: R2 = 0.996  V: R2 = 0.990, Hosmer-Lemeshow GOF = 0.87

D: c-statistic 0.638 V: c-statistic 0.630

n.r.

Internal validation: split-sample

Harrison et al. [20]

Pre + intra-arrest

1. ROSC: age, sex, prior length of stay, reason for attendance, location of arrest, initial rhythm, interactions presenting rhythm and location

Online score calculator

Calibration plots

1. D: c-statistic = 0.727 V: c-index 0.73. Accuracy: R2 = 0.11–0.17

n.r.

External validation: temporal validation, geographical validation

2. Survival: age, prior length of stay, reason for attendance, location of arrest, initial rhythm, interactions presenting rhythm and location

2. D: c-statistic = 0.804. V: c-index 0.81. Accuracy: R2 = 0.21–0.24

Ebell et al. [21]

Pre-arrest

1: CPC-score, admitting location, sepsis, mechanical ventilation, age, metastatic/haematological malignancy, acute MI this admission

Algorithm

n.r.

AUC: Model 1 D: 0.76, V: 0.73

Classification table

External validation: temporal validation

2: Factors of model 1 + other configuration + acute stroke

AUC: Model 2 D: 0.74, V: 0.71

Ebell et al. [21]

Pre-arrest

Age, admission neurologically intact, major trauma, acute stroke, metastatic/haematological cancer, septicaemia, non-cardiac admission, hypotension/hypoperfusion, respiratory insufficiency, pneumonia, metastatic cancer, renal dialysis/insufficiency, hepatic insufficiency, admitted from nursing facility

Scoring system

Hosmer–Lemeshow statistic 11.39 (p = 0.18). HL graph is shown

C-statistic overall: 0.800. Derivation and training: 0.77, validation 0.78

Classification table

Internal validation: split-sample

Chan et al. [23]

Pre + intra

Age, initial arrest rhythm, hospital location, hypotension, septicemia, metastatic/haematological malignancy, hepatic insufficiency, mechanical ventilation before arrest, vasopressor before arrest

Logistic regression model with beta-coefficients estimates

R2 of 0.99 in derivation and validation cohorts

C-statistic: 0.734 in derivation and 0.737 in validation cohort

n.r.

Internal validation: split-sample

Larkin et al. [24]

Pre + intra-arrest

Code team present, age, race, illness category (medical cardiac, surgical cardiac, surgical non-cardiac and trauma, obstetrics), pre-existing conditions (MI, hypotension, hepatic insufficiency, baseline depression CNS function, acute stroke, infection/septicemia, metastatic/haematological malignancy, renal failure, major trauma), interventions in place (invasive airway, mechanical ventilation, anti-arrhythmics, vasopressors, vasodilators, chest tube), monitored outside ICU, monitored with arterial catheter, witnessed, pulseless when need for CPR recognized, event location (PACU/OR, general floor/telemetry, ED), initial pulseless rhythm (asystole vs VF, VT), admit time to event (in h)

Multivariate odds ratios

D: Hosmer-Lemeshow statistic 73.7 (p < 0.001) V: Hosmer-Lemeshow statistic 37.9 (p < 0.001)

D: AUC 0.78. V: AUC 0.77 (0.79–0.78). For data known at admission: AUC = 0.68, + pre-arrest admission known during admission AUC = 0.73

n.r.

Internal validation: split-sample

Danciu et al. [25]

Pre + intra-arrest

1, 2 3: Respiratory arrest, initial rhythm, chronic renal insufficiency, higher BMI, less days from admission to resuscitation attempt

Scoring system + logistic model equation

1. GOF p = 0.874

n.r.

Survival to discharge: sensitivity= 0.88 specificity = 0.32

n.r.

2. GOF p = 0.599

1 month: sensitivity = 0.89 specificity = 0.31

3. GOF p = 0.822

3 months: sensitivity = 0.91 specificity = 0.32

Cooper et al. [26]

Pre + intra-arrest

Age, initial rhythm, primary cardiac/respiratory arrest

Scoring system

n.r.

n.r.

Accuracy 90% for 24 h survival for cases lasting > 15 min

n.r.

Ambery et al. [27]

Pre-arrest

Cardiac history, COPD/asthma/respiratory failure, stroke, malignancy, renal insufficiency

Scoring system

n.r.

n.r.

(score of > 4) Under 75y sensitivity 83%, specificity 100%. Over 75y sensitivity 40%, specificity 85%, all sensitivity 52%, specificity 93%

n.r.

Dodek et al. [28]

Pre + intra-arrest

Higher probability of death: Age, female gender, no. Previous arrests, electrical–mechanical dissociation. Lower: underlying coronary artery disease/valvular heart disease, VT, period July–September

Estimates from logistic model

n.r.

AUC: D 0.81, V: 0.71

D: senitivitys + specificity: 0.75 (cut-off probability 0.75); V: sensitivity + specificity: 0.6 (cut-off probability 0.85)

External validation: temporal validation

Ebell et al. [29]

Pre-arrest

Age, sex, heart rate, respiratory rate, FiO2, reason for admission, cancer, acute renal failure, GCS, place of residence before admission, mode of transport to hospital, white blood count, sodium, potassium, creatinine, haematocrit, temperature, MAP, pH, and others

Neural network

n.r.

AUC: 0.765 (SE = 0.048)

Sensitivity 52.1%, PPV 97%

n.r.

Lawrence et al. [30]

Pre-arrest

Shock, abnormal BUN, abnormal PaO2, oliguria

Scoring system

n.r.

n.r.

Sensitivity 76%, specificity 65%

n.r.

Marwick et al. [31]

Pre + intra-arrest

1.Age, initial rhythm, CPR delay, defibrillation delay

Scoring system + regression coefficients

n.r.

AUC = 0.78

n.r.

n.r.

2.Age, initial rhythm, CPR delay

AUC = 0.71

3.Age, initial rhythm, defibrillation delay, defibrillated, intubated

AUC = 0.80

George et al. [32]

Pre-arrest

Hypotension, azotemia, malignancy, pneumonia, homebound lifestyle, angina pectoris, acute MI, heart failure (NYHA III or IV), S3 gallop, oliguria (< 300 ml/day), sepsis, mechanical ventilation, recent cerebrovascular event, coma, cirrhosis

Scoring system + nomogram

n.r.

n.r.

Linear correlation for ROSC: p < 0.02; survival to discharge p < 0.002; 3 month survival p < 0.002. PAM > 7: p < 0.0006 for in-hospital mortality

n.r.

Burns et al. [33]

Pre + intra-arrest

Age, surgery scheduled before arrest, intensive care admission pre-arrest, pO2 < 8 mmHg

Scoring system and model equation

n.r.

n.r.

Sensitivity 76%, specificity 61%, accuracy 69%

n.r.

Model updating

Hong et al. [34]

Pre-arrest

GO-FAR + albumin

Scoring system

n.r

AUC D = 0.848 (CI = 0.802–0.893) V = 0.799 (CI = 0.745–0.853)

Net reclassification index V = 0.072 (CI 0.013–0.132)

External validation: temporal validation

George et al. [35]

Pre-arrest

Age, admission CPC < 2, medical non-cardiac admission, surgical admission, hypotension/hypoperfusion, respiratory insufficiency, septicaemia, metastatic cancer, renal dialysis, hepatic insufficiency

Scoring system

Hosmer-Lemeshow test for calibration 21.43 (P = 0.006)

AUC training = 0.70 testing = 0.70 validation = 0.69

Classification table

Internal validation: split-sample

Piscator et al. [36]

Pre-arrest

Neurologically intact admission, sepsis, pneumonia, hypotension, respiratory insufficiency, medical non-cardiac admission, acute kidney injury, CCI, age

Scoring system

Calibration plot

V: AUC = 0.808 (CI 0.807–0.810)

For likelihood > 3% sensitivity = 99.4%, specificity = 8.4%

Internal validation: bootstrapping

Dautzenberg et al. [37]*

Pre-arrest

Hypotension, uremia, malignancy, pneumonia, homebound lifestyle, angina pectoris, acute MI after 2 days, heart failure (NYHA III or IV), S3 gallop, oliguria (< 300 ml/day), sepsis, mechanical ventilation, recent cerebrovascular event, coma, age, dementia

Scoring system

n.r

n.r

n.r

n.r

Ebell et al. [38]*

Pre-arrest

Malignancy (metastatic, non-metastatic), sepsis, dependent lifestyle, pneumonia, creatinine > 130 µmol/L, age > 70, acute MI (higher survival)

Scoring system

n.r

n.r

n.r

n.r

  1. *Studies do not formally fit the inclusion criteria due to lack of reporting model performance measures. They were nevertheless included as they were validated in external populations. They validated the scores for different end points but no formal process of model development has taken place. D Derivation, V Validation  n.r. not reported