Skip to main content

Risk stratification and prognostic performance of the predisposition, infection, response, and organ dysfunction (PIRO) scoring system in septic patients in the emergency department: a cohort study

Abstract

Introduction

The predisposition, infection, response and organ dysfunction (PIRO) staging system was designed as a stratification tool to deal with the inherent heterogeneity of septic patients. The present study was conducted to assess the performance of PIRO in predicting multiple organ dysfunction (MOD), intensive care unit (ICU) admission, and 28-day mortality in septic patients in the emergency department (ED), and to compare this scoring system with the Mortality in Emergency Department Sepsis (MEDS) and Acute Physiology and Chronic Health Evaluation (APACHE II) scores.

Methods

Consecutive septic patients (n = 680) admitted to the ED of Beijing Chao-Yang Hospital were enrolled. PIRO, MEDS, and APACHE II scores were calculated for each patient on ED arrival. Organ function was reassessed within 3 days of enrollment. All patients were followed up for 28 days. Outcome criteria were the development of MOD within 3 days, ICU admission or death within 28 days after enrollment. The predictive ability of the four components of PIRO was analyzed separately. Receiver operating characteristic (ROC) curve and logistic regression analysis were used to assess the prognostic and risk stratification value of the scoring systems.

Results

Organ dysfunction independently predicted ICU admission, MOD, and 28-day mortality, with areas under the ROC curve (AUC) of 0.888, 0.851, and 0.816, respectively. The predictive value of predisposition, infection, and response was weaker than that of organ dysfunction. A negative correlation was found between the response component and MOD, as well as mortality. PIRO, MEDS, and APACHE II scores significantly differed between patients who did and did not meet the outcome criteria (P < 0.001). PIRO and APACHE II independently predicted ICU admission and MOD, but MEDS did not. All three systems were independent predictors of 28-day mortality with similar AUC values. The AUC of PIRO was 0.889 for ICU admission, 0.817 for MOD, and 0.744 for 28-day mortality. The AUCs of PIRO were significantly greater than those of APACHE II and MEDS (P < 0.05) in predicting ICU admission and MOD.

Conclusions

The study indicates that PIRO is helpful for risk stratification and prognostic determinations in septic patients in the ED.

Introduction

Sepsis, which can progress to severe sepsis and septic shock, is becoming a major healthcare problem and affects millions of people around the world each year [15]. The emergency department (ED) is a common location for the initial evaluation and management of septic patients. However, evaluation is complicated by the heterogeneity of clinical manifestations, sites of infection, comorbid conditions, and etiologic microorganisms [6]. Given the complexity of sepsis, biomarkers and mathematical models offer potential guidance once they have been carefully validated [7, 8].

The concept of the predisposition, infection, response, and organ dysfunction (PIRO) scoring system was recommended at the 2001 International Sepsis Definitions Conference to improve the traditional classification of sepsis [9]. The PIRO system is an ideal staging system that incorporates assessment of premorbid baseline susceptibility (predisposition), the specific disorder responsible for illness (infection), the response of the host to infection, and the resulting degree of organ dysfunction. The four components of the PIRO system cover multiple known independent factors that may influence the onset, development, and outcome of sepsis. The system was proposed not as a prognostic measure, but rather as a stratification tool to resolve the inherent heterogeneity of septic patients. The PIRO system was expected to be helpful for risk stratification and for enrollment criteria in clinical studies, and to differentiate patients who may benefit from certain types of therapeutic intervention.

The PIRO system is theoretically an ideal stratification tool, but it is difficult to translate into clinical practice. In 2008, the first clinical PIRO model was developed [10], followed by another three different PIRO systems over the next 5 years. The variables contained in these PIRO systems varied markedly, partly because of different enrollment populations. Three studies enrolled septic patients admitted to the ICU and another enrolled patients with suspected infection in the ED. The PIRO systems were based on ICU populations with ICU-specific variables, such as the location and length of stay prior to ICU admission, the reason for ICU admission, and the infective agents, so they were not very suitable for application in the ED [1013]. The PIRO system devised by Howell and colleagues was developed in patients in the ED with suspected infection and was designed for bedside use at clinical presentation [12]. The variables of this PIRO system were easily obtained in the ED, so its applicability was superior to others. Since the original study mainly focused on the prognostic value of PIRO, the system’s risk stratification ability needs further evaluation.

This study was designed to assess the predictive performance of the PIRO system for ICU admission, development of multiple organ dysfunction (MOD), and 28-day mortality in septic patients in the ED, and to compare this scoring system with the Acute Physiology and Chronic Health Evaluation (APACHE) II [14] and Mortality in Emergency Department Sepsis (MEDS) scores [7].

Materials and methods

Patients

We conducted a prospective observational clinical study in the ED of Beijing Chao-Yang Hospital, a teaching hospital of Capital Medical University with approximately 250,000 ED visits per year. The study was approved by the Beijing Chao-Yang hospital ethics committee, and written informed consent was obtained from every patient.

The enrollment criteria were age ≥ 18 years and fulfillment of the sepsis criteria as defined by the International Sepsis Definitions Conference [9]. The exclusion criteria were as follows: age < 18 years, terminal stage of disease (malignant cancer with metastases, AIDS, end-stage renal or hepatic disease, chronic heart failure), and refusal to participate in the study by patients or their relatives.

Data collection

Patients’ basic information, including age, gender, comorbidities, telephone number, and medical record number, was recorded at the time of enrollment. Vital signs, laboratory results, and imaging results obtained on ED arrival were documented, together with diagnoses. The PIRO [12], APACHE II [14], and MEDS [7] scores were calculated using data obtained on ED arrival. The criteria for the four PIRO domains are presented in Table 1.

Table 1 Criteria of the PIRO system

Outcome variables

All patients were followed up for 28 days through medical records or by telephone. Organ function was assessed at enrollment and was reassessed when deterioration occurred or on the third day of enrollment if the patient was relatively stable. ICU admission during follow-up, development of MOD within 3 days of enrollment, and 28-day mortality were considered as the outcome criteria. MOD was defined as fulfillment of two or more of the criteria of severe sepsis at any time within 3 days of enrollment, excluding organ dysfunction, which was induced by pre-existing disease.

Statistical analysis

All data were analyzed by SPSS version 16.0 (SPSS Inc., Chicago, IL, USA). Normally distributed data were expressed as the mean ± standard deviation and were compared using the independent-samples t test. Data with skewed distribution were expressed as the median and quartiles and were analyzed by the Mann–Whitney U test. The chi-square test was used for the comparison of frequencies. Logistic regression analysis was used to determine independent predictors of outcomes. Receiver operating characteristic (ROC) curves were constructed and the area under the ROC curves (AUC) was determined to assess predictive value. All statistical tests were two-tailed, and P < 0.05 was considered statistically significant.

Results

Characteristics of the study cohort

Eight hundred and thirty-seven consecutive septic patients were screened from November 2011 to October 2012. We excluded 153 patients with non-infectious disease and four patients with incomplete data, and thus included 680 septic patients in the study. The characteristics of the study cohort are presented in Table 2.

Table 2 Characteristics of the study cohort

The mean age was much higher in patients subsequently admitted to the ICU (76 (range, 67 to 78) years) versus those who were not (72 (59 to 79) years, P = 0.012), in patients who developed MOD (75 (66 to 81) years) versus those who did not (71 (51 to 78) years, P < 0.001), and in patients who died within 28 days (74 (65 to 81) years) versus survivors (73 (59 to 79) years, P = 0.012). The percentage of males did not differ between patients with different outcomes.

Risk stratification and prognostic performance of the PIRO system

The predictive ability of each of the four components of the PIRO system was analyzed separately. The results are presented in Table 3. Predisposition, infection, response, and organ dysfunction were all independent predictors of ICU admission. Predisposition, infection, and organ dysfunction independently predicted MOD, but response did not. For 28-day mortality, predisposition, response, and organ dysfunction were the independent predictors, but infection was not. The ROC curves are shown in Figure 1, and the AUCs are presented in Table 4. The predictive ability of organ dysfunction was the best among the four components. The AUCs of organ dysfunction in predicting ICU admission, MOD, and 28-day mortality were 0.888, 0.851, and 0.816, respectively. A negative correlation was found between response and MOD, as well as between response and 28-day mortality.

Table 3 Predictive ability of the four components of the PIRO system
Figure 1
figure1

Receiver operating characteristic curves of the PIRO, MEDS and APACHE II scores for predicting outcomes. (a) ICU admission. (b) Development of multiple organ dysfunction. (c) Twenty-eight-day mortality. APACHE, Acute Physiology and Chronic Health Evaluation; MEDS, Mortality in Emergency Department Sepsis; PIRO, predisposition (P), infection (I), response (R), and organ dysfunction (O).

Table 4 Areas under the receiver operating characteristic curves of predictors

Comparison of severity systems in patients with different outcomes

The average APACHE II, MEDS, and PIRO scores were significantly different between patients who did and did not meet the outcome criteria (P < 0.001). The results are shown in Figure 2. As shown in Table 5, both PIRO and APACHE II scores independently predicted ICU admission and MOD, but MEDS scores did not. All three scores were independent predictors of 28-day mortality and had similar AUC values.

Figure 2
figure2

Mean scores of severity systems between patients who did and did not meet the outcome criteria. (a) Acute Physiology and Chronic Health Evaluation (APACHE) II score. (b) Mortality in Emergency Department Sepsis (MEDS) score. (c) Predisposition, infection, response, and organ dysfunction (PIRO) score. No, patients did not meet the outcome criteria; yes, patients met the outcome criteria. MOD, multiple organ dysfunction.

Table 5 The independent predictors of outcomes

The ROC curves of APACHE II and MEDS scores are shown in Figure 1, and the AUCs are presented in Table 4. The predictive ability of the PIRO score for ICU admission (AUC: 0.889) was much better than that of MEDS (AUC: 0.774) and APACHE II (AUC: 0.789) (P < 0.01). The PIRO score was also better for predicting the development of MOD (AUC: 0.817) than MEDS (AUC: 0.758) and APACHE II (AUC: 0.764) scores (P < 0.05). The AUC values of the three systems for 28-day mortality were similar.

Discussion

It is important for the ED physician to identify high-risk septic patients who are likely to need aggressive resuscitation since significant physiologic changes from sepsis to severe sepsis and septic shock can occur rapidly in the early stages of sepsis. According to the 2012 International Guidelines for Management of Severe Sepsis and Septic Shock, resuscitation should be initiated in patients with sepsis-induced tissue hypoperfusion. In these guidelines, tissue hypoperfusion was defined as hypotension persisting after an initial fluid challenge, or a blood lactate concentration > 4 mmol/l [15]. In fact, most patients with elevated lactate are in the late stages of sepsis, and they experience high mortality despite aggressive resuscitation. Development of a more useful tool for risk stratification and prognosis in septic patients is thus still essential. For this purpose, the PIRO concept was proposed. The four components of the PIRO system cover almost all of the factors that may influence the onset, development, and outcome of sepsis. However, translating the PIRO concept into clinical practice is very difficult because of the extremely complex pathophysiologic changes of sepsis. In 2008, Moreno and colleagues developed the first PIRO score [10]. During the next 5 years, three additional clinical studies focusing on the PIRO system were published [1113]. The enrollment populations varied from patients with clinically suspected infections to patients with severe sepsis/septic shock admitted to the ICU. The illness severity of the enrollment cohort was significantly different in every study, and the in-hospital mortality ranged from 4.3% to 48.5%. The statistical methods of screening the variables also differed between studies. The PIRO systems developed in these studies were therefore very different. Additionally, these studies focused on the prognostic value of the PIRO system, and did not assess its performance in risk stratification.

The PIRO system assessed in the present investigation was developed from a study of 2,132 patients with suspected infections, and its prognostic value for in-hospital mortality was validated in an internal cohort (n = 4,618) and an external cohort (n = 1,004). In that initial study, the AUCs of the PIRO system in predicting in-hospital mortality were 0.90 in the derivation cohort, 0.86 in the internal validation cohort, and 0.83 in the external validation cohort [12]. This PIRO system incorporated 16 variables that were easily obtained in the ED and was superior to other PIRO systems for application in the ED. As the original PIRO enrollment cohort comprised patients with suspected infection who were relatively low risk (in-hospital mortality of 4.3%), its prognostic and risk stratification performance in septic patients required further assessment.

The present study assessed the predictive ability of the four components of the PIRO system separately and found that organ dysfunction was the best predictor of outcomes. The predictive value of each of the other three components was weaker. Some variables of the PIRO system (systolic blood pressure and lactate concentration) reflected established organ dysfunction and may partly account for the superior performance of organ dysfunction in predicting ICU admission and MOD. Another important result of our study is that response negatively correlated with MOD and 28-day mortality. As the criteria of response in the original PIRO were tachycardia, tachypnea, and elevated bands, patients who did not develop these symptoms were prone to adverse outcomes in the present study. Some septic patients manifest hypothermia and leucopenia instead of fever and leukocytosis, and their illness severity is more severe with poorer outcome [16]. This result suggests that adding hyporeactive variables in the PIRO system may be necessary.

Our study revealed that APACHE II, MEDS, and PIRO scores were much higher for patients admitted to the ICU than for those who were not. In binary logistic regression analysis, the independent predictors of ICU admission were the APACHE II and PIRO scores, but not the MEDS score. This may be because more organ dysfunction variables are used in the APACHE II and PIRO scores. Most patients were admitted to the ICU because they developed organ dysfunction that needed intensive therapy such as mechanical ventilation or continuous renal replacement therapy. The MEDS score incorporates fewer variables that reflect organ function, so its predictive ability for ICU admission is weaker. The superior predictive performance of the PIRO system for ICU admission may be helpful in establishing the disposition of septic patients in the ED.

MOD signals progressive deterioration and is associated with high short-term mortality [1, 3, 4]. In our study, both PIRO and APACHE II scores independently predicted the development of MOD within 3 days of ED arrival, but MEDS scores did not. The predictive value of the PIRO system was superior to that of APACHE II. The PIRO system incorporates both the high-risk factors of MOD, such as age, liver disease, malignancy, and residence in a nursing home, and variables reflecting established organ dysfunction, such as systolic blood pressure and lactate; therefore, its predictive value was found to be better. The APACHE II score contains organ dysfunction variables, such as mean artery pressure, creatinine, and oxygenation, but other variables did not reflect organ function, so its predictive value was weaker compared with the PIRO score.

The PIRO system was an independent predictor of 28-mortality in the present study. Its prognostic value was similar to that of MEDS and APACHE II scores. A previous study obtained analogous results [17]. The PIRO system may be able to replace MEDS and APACHE II scores as a prognostic scoring system after validation in larger cohorts in the future.

Limitations

Our study was limited by being a single-center study with a relatively small sample size. It is also important to recognize that the present study excluded 48 patients with terminal disease (malignant cancer with metastases, AIDS, end-stage renal or hepatic disease, chronic heart failure), which significantly influenced the short-term survival rate. Data for these patients were not recorded or analyzed. The absolute scores of MEDS, APACHE II, and PIRO may therefore be a little lower in the present study than in other studies that included terminal patients.

Conclusions

The PIRO system is valuable in predicting 28-day mortality, ICU admission, and the development of MOD in septic patients in the ED. The PIRO score is superior to the MEDS and APACHE II scores for risk stratification, and its prognostic value is similar to MEDS and APACHE II scores. Organ dysfunction is the best predictor of ICU admission, MOD, and 28-day mortality among the four components of the PIRO system. The response component negatively correlated with MOD and 28-day mortality.

Key messages

  • Organ dysfunction is the best predictor of ICU admission, MOD, and 28-day mortality among the four components of the PIRO system.

  • The predictive ability of predisposition, infection, and response components is weaker than that of organ dysfunction.

  • Response negatively correlates with MOD and 28-day mortality.

  • The PIRO score is superior to the APACHE II and MEDS scores for predicting ICU admission and MOD.

  • The prognostic performance of the PIRO system for 28-day mortality is similar to that of the MEDS and APACHE II scores.

Abbreviations

APACHE:

Acute Physiology and Chronic Health Evaluation

AUC:

area under the receiver operating characteristic curve

ED:

emergency department

ICU:

Intensive care unit

MEDS:

Mortality in Emergency Department Sepsis

MOD:

multiple organ dysfunction

PIRO:

predisposition, infection, response, and organ dysfunction

ROC:

receiver operating characteristic.

References

  1. 1.

    Lagu T, Rothberg MB, Shieh MS, Pekow PS, Steingrub JS, Lindenauer PK: Hospitalizations, costs, and outcomes of severe sepsis in the United States 2003 to 2007. Crit Care Med 2012, 40: 754-761. 10.1097/CCM.0b013e318232db65

    Article  PubMed  Google Scholar 

  2. 2.

    Vincent JL, Sakr Y, Sprung CL, Ranieri VM, Reinhart K, Gerlach H, Moreno R, Carlet J, Le Gall JR, Payen D, Sepsis Occurrence in Acutely Ill Patients Investigators: Sepsis in European intensive care units: results of the SOAP study. Crit Care Med 2006, 34: 344-353. 10.1097/01.CCM.0000194725.48928.3A

    Article  PubMed  Google Scholar 

  3. 3.

    Moerer O, Schmid A, Hofmann M, Herklotz A, Reinhart K, Werdan K, Schneider H, Burchardi H: Direct costs of severe sepsis in three German intensive care units based on retrospective electronic patient record analysis of resource use. Intensive Care Med 2002, 28: 1440-1446. 10.1007/s00134-002-1429-9

    Article  PubMed  Google Scholar 

  4. 4.

    Padkin A, Goldfrad C, Brady AR, Young D, Black N, Rowan K: Epidemiology of severe sepsis occurring in the first 24 hrs in intensive care units in England, Wales, and Northern Ireland. Crit Care Med 2003, 31: 2332-2338. 10.1097/01.CCM.0000085141.75513.2B

    Article  PubMed  Google Scholar 

  5. 5.

    Esteban A, Frutos-Vivar F, Ferguson ND, Peñuelas O, Lorente JA, Gordo F, Honrubia T, Algora A, Bustos A, García G, Diaz-Regañón IR, de Luna RR: Sepsis incidence and outcome: contrasting the intensive care unit with the hospital ward. Crit Care Med 2007, 35: 1284-1289. 10.1097/01.CCM.0000260960.94300.DE

    Article  PubMed  Google Scholar 

  6. 6.

    Iskander KN, Osuchowski MF, Stearns-Kurosawa DJ, Kurosawa S, Stepien D, Valentine C, Remick DG: Sepsis: multiple abnormalities, heterogeneous responses, and evolving understanding. Physiol Rev 2013, 93: 1247-1288. 10.1152/physrev.00037.2012

    PubMed Central  CAS  Article  PubMed  Google Scholar 

  7. 7.

    Shapiro NI, Wolfe RE, Moore RB, Smith E, Burdick E, Bates DW: Mortality in Emergency Department Sepsis (MEDS) score: a prospectively derived and validated clinical prediction rule. Crit Care Med 2003, 31: 670-675. 10.1097/01.CCM.0000054867.01688.D1

    Article  PubMed  Google Scholar 

  8. 8.

    Pierrakos C, Vincent JL: Sepsis biomarkers: a review. Crit Care 2010, 14: R15. 10.1186/cc8872

    PubMed Central  Article  PubMed  Google Scholar 

  9. 9.

    Levy MM, Fink MP, Marshall JC, Abraham E, Angus D, Cook D, Cohen J, Opal SM, Vincent JL, Ramsay G, International Sepsis Definitions Conference: 2001 SCCM/ESICM/ACCP/ATS/SIS International Sepsis Definitions Conference. Intensive Care Med 2003, 29: 530-538. 10.1007/s00134-003-1662-x

    Article  PubMed  Google Scholar 

  10. 10.

    Moreno RP, Metnitz B, Adler L, Hoechtl A, Bauer P, Metnitz PG: Sepsis mortality prediction based on predisposition, infection and response. Intensive Care Med 2008, 34: 496-504. 10.1007/s00134-007-0943-1

    Article  PubMed  Google Scholar 

  11. 11.

    Rubulotta F, Marshall JC, Ramsay G, Nelson D, Levy M, Williams M: Predisposition, insult/infection, response, and organ dysfunction: a new model for staging severe sepsis. Crit Care Med 2009, 37: 1329-1335. 10.1097/CCM.0b013e31819d5db1

    Article  PubMed  Google Scholar 

  12. 12.

    Howell MD, Talmor D, Schuetz P, Hunziker S, Jones AE, Shapiro NI: Proof of principle: the predisposition, infection, response, organ failure sepsis staging system. Crit Care Med 2011, 39: 322-327. 10.1097/CCM.0b013e3182037a8e

    Article  PubMed  Google Scholar 

  13. 13.

    Granja C, Póvoa P, Lobo C, Teixeira-Pinto A, Carneiro A, Costa-Pereira A: The predisposition, infection, response and organ failure (Piro) sepsis classification system: results of hospital mortality using a novel concept and methodological approach. PLoS One 2013, 8: e53885. 10.1371/journal.pone.0053885

    PubMed Central  CAS  Article  PubMed  Google Scholar 

  14. 14.

    Knaus WA, Draper EA, Wagner DP, Zimmerman JE: APACHE II: a severity of disease classification system. Crit Care Med 1985, 13: 818-829. 10.1097/00003246-198510000-00009

    CAS  Article  PubMed  Google Scholar 

  15. 15.

    Dellinger RP, Levy MM, Rhodes A, Annane D, Gerlach H, Opal SM, Sevransky JE, Sprung CL, Douglas IS, Jaeschke R, Osborn TM, Nunnally ME, Townsend SR, Reinhart K, Kleinpell RM, Angus DC, Deutschman CS, Machado FR, Rubenfeld GD, Webb S, Beale RJ, Vincent JL, Moreno R, Surviving Sepsis Campaign Guidelines Committee including The Pediatric Subgroup: Surviving Sepsis Campaign: international guidelines for management of severe sepsis and septic shock, 2012. Intensive Care Med 2013, 39: 165-228. 10.1007/s00134-012-2769-8

    CAS  Article  PubMed  Google Scholar 

  16. 16.

    Kushimoto S, Gando S, Saitoh D, Mayumi T, Ogura H, Fujishima S, Araki T, Ikeda H, Kotani J, Miki Y, Shiraishi SI, Suzuki K, Suzuki Y, Takeyama N, Takuma K, Tsuruta R, Yamaguchi Y, Yamashita N, Aikawa N: The impact of body temperature abnormalities on the disease severity and outcome in patients with severe sepsis: an analysis from a multicenter, prospective survey of severe sepsis. Crit Care 2013, 17: R271. 10.1186/cc13106

    PubMed Central  Article  PubMed  Google Scholar 

  17. 17.

    Nguyen HB, Van Ginkel C, Batech M, Banta J, Corbett SW: Comparison of Predisposition, Insult/Infection, Response, and Organ dysfunction, Acute Physiology And Chronic Health Evaluation II, and Mortality in Emergency Department Sepsis in patients meeting criteria for early goal-directed therapy and the severe sepsis resuscitation bundle. J Crit Care 2012, 27: 362-369. 10.1016/j.jcrc.2011.08.013

    Article  PubMed  Google Scholar 

Download references

Acknowledgments

The authors sincerely thank Bo Liu, Qin Yin, and Yun-Zhou Zhao for their excellent assistance. The authors also thank both the ED and Biochemistry Laboratory staff for their helpful contributions to the study. C-SL was supported by the Research Program for Supervisor of Excellent Doctorial Dissertation of Beijing (Grant Number 20121002501). This funding was not involved in the development of the manuscript, including study design, collection, analysis, interpretation of data, writing of the manuscript and the decision to submit the paper for publication.

Author information

Affiliations

Authors

Corresponding author

Correspondence to Chun-Sheng Li.

Additional information

Competing interest

The authors declare that they have no competing interests.

Authors’ contributions

Y-XC conceived and designed the research, acquired, analyzed and interpreted the data, drafted the manuscript and revised it critically for important intellectual content. C-SL conceived and designed the research, analyzed and interpreted the data, gave final approval of the version to be published, and was responsible for the overall content as guarantor. All authors read and approved the final manuscript.

Authors’ original submitted files for images

Below are the links to the authors’ original submitted files for images.

Authors’ original file for figure 1

Authors’ original file for figure 2

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Chen, YX., Li, CS. Risk stratification and prognostic performance of the predisposition, infection, response, and organ dysfunction (PIRO) scoring system in septic patients in the emergency department: a cohort study. Crit Care 18, R74 (2014). https://doi.org/10.1186/cc13832

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/cc13832

Keywords

  • Organ Dysfunction
  • Intensive Care Unit Admission
  • Septic Patient
  • Continuous Renal Replacement Therapy
  • Emergency Department Arrival