Skip to main content

Table 4 Studies developing risk models or clinical decision rules

From: Risk factors for invasive fungal disease in critically ill adult patients: a systematic review

Study

Development

Validation

Models/rules

AUC

Sensitivity

Specificity

PPV

NPV

León et al., 2006 [27]

Risk factors significant (P < 0.05) on univariable analysis of full sample included in multivariable logistic regression model fitted in 65% development sample

Final model chosen by backward elimination; stopping criterion unclear

Simplified to bedside score by rounding coefficients.

ROC and sensitivity/specificity at cut-off values in 35% validation sample

0.908 × (total parenteral nutrition) + 0.997 × (surgery) + 1.112 × (multifocal Candida species colonisation) + 2.038 × (severe sepsis)

0.847 (0.800 to 0.894)

NA

NA

NA

NA

   

1 × (total parenteral nutrition) + 1 × (surgery) + 1 × (multifocal Candida species colonisation) + 2 × (severe sepsis)

NR

NA

NA

NA

NA

   

Bedside score ≥ 3, or, equivalently, severe sepsis plus at least one other risk factor or all three other risk factors

NA

81%

74%

NR

NR

Ostrosky-Zeichner et al., 2007 [37]

All rule development in 75% development sample

Univariable analysis of risk factors

Clinical decision rules constructed for 'all possible combinations of risk factors and time points' in 'several different formats (with different weights for the risk factors)'

'Best' rules selected on sensitivity, PPV, PPV/(1-NPV), and proportion of patients identified as high risk in development sample

χ2 test of association, sensitivity, specificity, PPV and NPV in 25% validation sample

Any antibiotic days 1 to 3 and CVC days 1 to 3

NA

89%

38%

4%

99%

   

Any antibiotic days 1 to 3) and CVC days 1 to 3 and at least one of the following:

Any surgery days -7 to 0

Immunosuppressive use days -7 to 0

Pancreatitis days -7 to 0

TPN day 1-3; dialysis day 1-3

Steroid use days -7 to 3

NA

66%

69%

6%

98%

   

Any antibiotic days 1 to 3 or CVC days 1 to 3 and at least two of the following:

Any surgery days -7 to 0

Immunosuppressive use days -7 to 0

Pancreatitis days -7 to 0

TPN days 1 to 3

Dialysis days 1 to 3

Steroid use days -7 to 3

NA

34%

90%

9%

97%

Paphitou et al., 2005 [35]

All rule development in full sample

Univariable analysis of risk factors; unclear whether used to select factors for multivariable model

Multivariable logistic regression model with stepwise procedure; unclear whether forward selection or backward elimination and unclear stopping criterion

Clinical decision rules constructed 'using a combination of inspection of the data and results of the multivariable analysis'

Sensitivity and PPV in full sample

NNT assuming 50% relative reduction in IFD associated with treatment

Cost to prevent one case assuming prophylaxis $100/day

At least one of the following:

Diabetes mellitus

TPN days -7 to 0

New-onset haemodialysis days -7 to 3

NA

39%

NR

17% to 26%

NR

   

At least one of the following:

Diabetes mellitus

TPN days -7 to 0

New-onset haemodialysis days -7 to 3

Broad-spectrum antibiotics days -7 to 3

NA

78% to 83%

NR

11% to 17%

NR

   

At least one of the following:

Diabetes mellitus

TPN days -7 to 0

New-onset haemodialysis days -7 to 3

and

Broad-spectrum antibiotics days -7 to 3

NA

30% to 33%

NR

20% to 34%

NR

Pittet et al., 1994 [33]

All rule development in full sample

Clinical decision rules constructed from colonisation parameters only (number of sites, colonisation index, corrected colonisation index derived post hoc); methods unclear

Risk factors with P < 0.15 on univariable analysis included in multivariable logistic regression model

Only those with P < 0.05 in multivariable model reported; unclear if stepwise procedure used

Clinical decision rules validated by sensitivity, specificity, PPV and NPV in full sample

Colonisation at two or more sites

NA

100%

22%

44%

100%

   

Colonisation at three or more sites

NA

73%

56%

50%

77%

   

Colonisation at four or more sites

NA

45%

72%

50%

68%

   

Candida colonisation index ≥ 0.5

NA

100%

69%

66%

100%

   

Candida corrected colonisation index ≥ 0.4

NA

100%

100%

100%

100%

  1. AUC = area under the receiver operating characteristic curve; CVC = central venous catheter; IFD = invasive fungal disease; NA = not applicable; NNT = number needed to treat to prevent one case; NPV = negative predictive value; NR = not reported; PPV = positive predictive value; ROC = receiver operating characteristic curve; TPN = total parenteral nutrition.