- Open Access
Daily estimation of the severity of organ dysfunctions in critically ill children by using the PELOD-2 score
Critical Care volume 19, Article number: 324 (2015)
Daily or serial evaluation of multiple organ dysfunction syndrome (MODS) scores may provide useful information. We aimed to validate the daily (d) PELOD-2 score using the set of seven days proposed with the previous version of the score.
In all consecutive patients admitted to nine pediatric intensive care units (PICUs) we prospectively measured the dPELOD-2 score at day 1, 2, 5, 8, 12, 16, and 18. PICU mortality was used as the outcome dependent variable. The discriminant power of the dPELOD-2 scores was estimated using the area under the ROC curve and the calibration using the Hosmer-Lemeshow chi-square test. We used a logistic regression to investigate the relationship between the dPELOD-2 scores and outcome, and between the change in PELOD-2 score from day1 and outcome.
We included 3669 patients (median age 15.5 months, mortality rate 6.1 %, median length of PICU stay 3 days). Median dPELOD-2 scores were significantly higher in nonsurvivors than in survivors (p < 0.0001). The dPELOD-2 score was available at least at day 2 in 2057 patients: among the 796 patients without MODS on day1, 186 (23.3 %) acquired the syndrome during their PICU stay (mortality 4.9 % vs. 0.3 % among the 610 who did not; p < 0.0001). Among the1261 patients with MODS on day1, the syndrome worsened in 157 (12.4 %) and remained unchanged or improved in 1104 (87.6 %) (mortality 22.9 % vs. 6.6 %; p < 0.0001). The AUC of the dPELOD-2 scores ranged from 0.75 (95 % CI: 0.67-0.83) to 0.89 (95 % CI: 0.86-0.91). The calibration was good with a chi-square test between 13.5 (p = 0.06) and 0.9 (p = 0.99). The PELOD-2 score on day1 was a significant prognostic factor; the serial evaluation of the change in the dPELOD-2 score from day1, adjusted for baseline value, demonstrated a significant odds ratio of death for each of the 7 days.
This study suggests that the progression of the severity of organ dysfunctions can be evaluated by measuring the dPELOD-2 score during a set of 7 days in PICU, providing useful information on outcome in critically ill children. Its external validation would be useful.
In the intensive care unit (ICU), almost all adult and pediatric patients present some organ dysfunction [1–5] and mortality rates increase with the number of organ dysfunctions [5–8]. Organ dysfunction scores were developed in critically ill adults and children to describe and quantify the severity of organ dysfunctions throughout the ICU stay. These scores are frequently used as an outcome variable in clinical trials [9–11]. In 2003 we developed and validated a multiple organ dysfunction syndrome (MODS) score for critically ill children: the pediatric logistic organ dysfunction (PELOD) score using the most abnormal value of each variable during the entire pediatric ICU (PICU) stay . In 2010, considering that measurements repeated daily may provide more useful information, we identified a set of 7 days as the optimal period for measurement of the daily PELOD score . In 2013, using a larger and more recent database, we developed and validated the PELOD-2 score, which, contrary to the first version, uses a continuous scale . The objective of this study was to validate the daily PELOD-2 (dPELOD-2) score using the set of 7 days proposed with the previous version of the PELOD score .
Materials and methods
All consecutive patients admitted between June 2006 and October 2007, to nine multidisciplinary, tertiary-care PICUs of university-affiliated hospitals (eight French and oneBelgian, all member of the Groupe Francophone de Réanimation et Urgences Pédiatriques-GFRUP) were prospectively included. Exclusion criteria were: age 18 years or older; premature at entry into PICU; pregnancy; total length of stay in PICU less than 4 h; admission in a state of continuous cardiopulmonary resuscitation without achieving stable vital signs for at least 2 h; transfer from another PICU; and admissions for scheduled procedures normally performed in other hospital locations. The study and its database were declared safe and were approved by the French authorities (Commission Nationale de l’Informatique et des Libertés) on 7 February 2007. The study design was approved by the ethics committee of the Société de Réanimation de Langue Française on 27 April 2007 for all the participating hospitals. The requirement for consent was waived because the study was strictly observational.
We collected baseline characteristics and calculated dPELOD-2 score at days 1, 2, 5, 8, 12, 16 and 18 in PICU. The PICU day 1 started from admission time to H24, and so on. Length of PICU stay was defined as the difference between admission day and discharge day plus 1. For each variable, the most abnormal value each day was used in calculating the dPELOD-2 score [12, 14]. Variables were measured only if requested by the attending physician (i.e., if justified by clinical status of patient). Every day, if a variable was not measured, we assumed that it was identical to the previous measurement (i.e., the physician considered that the value of the variable did not change) or normal (i.e., the physician considered that the value of the variable was normal) [12, 14]. Organ dysfunction was defined as a PELOD-2 score >0 for a given organ, and MODS as the simultaneous presence of two or more organ dysfunctions The PICU discharge status (death/survival) was used as the outcome dependent variable.
All statistical analyses were performed with SAS software (SAS institute Inc., Cary, NC, USA). A p value <0.05 was considered statistically significant. Results are expressed as frequencies and percentages for categorical variables and as median and interquartile range (IQR) for quantitative variables. The comparisons between the two groups of outcomes and the quantitative variables were performed using the Wilcoxon signed rank test. The relationships between the outcome and the categorical variables were analyzed using the chi-square test or Fischer’s exact probability test.
The discriminant power of the dPELOD-2 scores was estimated using the area under the receiver-operating characteristics curve (AUC) (with 95 % confidence interval) and the calibration was assessed using the Hosmer-Lemeshow chi-square test. We used logistic regression to investigate the relationship (1) between the dPELOD-2 scores and outcome, and (2) between the change in PELOD-2 score from day 1 and outcome.
The study included 3,669 patients, two patients of the original database  with incomplete data being excluded. Characteristics of the population are reported in Table 1. The mortality rate was 6.1 % (222 deaths). Administrative median length of stay in PICU was 3 days [2–6] in survivors and 4 days [2–12] in non survivors (p = 0.055).
Daily PELOD-2 score was measured on 7,983 days (Fig. 1). MODS was present on day 1 in 2,024 of the patients in the whole population (55.2 %). The dPELOD-2 score was available at least at day 2 in 2,057 patients (Fig. 1) allowing the identification of new and progressive MODS: among the 796 patients without MODS (one or no organ dysfunction) on day 1, 186 (23.3 %) acquired the syndrome during their PICU stay (new MODS); the mortality rate was 4.9 % among these children, as compared with 0.3 % among the 610 who did not acquire the syndrome during their stay (p <0.0001). Among the 1,261 patients with MODS on day 1, the syndrome worsened during PICU stay in 157 (12.4 %) (progressive MODS) and remained unchanged or improved in 1,104 (87.6 %); the mortality rate was 22.9 % among those in whom it worsened and 6.6 % among the other children; p <0.0001). New or progressive MODS was reported in 343 patients (9.3 % of the whole population).
The PELOD-2 score on day 1 was a significant prognostic factor; the serial evaluation of the change in the dPELOD-2 score from day 1, adjusted for baseline value, demonstrated a significant odds ratio of death for each of the 7 days (Table 2). Median (IQR) values of dPELOD-2 scores in survivors and non-survivors are given in Table 3. The median maximum PELOD-2 score was 5 (2–7) and differed between survivors and non-survivors (5 (2–7) and 15 (10–20), p <0.0001). The AUC of the dPELOD-2 scores at days 1, 2, 5, 8, 12, 16 and 18 in PICU, ranged from 0.75 (95 % CI 0.67, 0.83) to 0.89 (95 % CI 0.86, 0.91) indicating moderate to good discrimination (Table 3). The calibration assessed by the Hosmer-Lemeshow chi-square test ranged from a chi squared statistic of 13.5 (p = 0.06) to 0.9 (p = 0.99), indicating good calibration (Table 3). For each of the 7 days under evaluation, mortality significantly increased with the number of organ dysfunctions (Table 4).
In this study, we report that the dPELOD-2 scores calculated on the 7 days previously identified, had good discrimination and calibration. This study confirms that the progression of the severity of organ dysfunctions can be evaluated by measuring the dPELOD-2 scores during a specified set of days in PICU (admission and days 2, 5, 8, 12, 16 and 18). Our data not only showed that the PELOD-2 score on day 1 was a significant prognostic factor, but also that mortality was significantly higher in children in whom MODS worsened after day 1 as compared with those in whom MODS remained unchanged or improved. Thus, it makes sense to collect data daily on the severity of MODS in order to take into account this time factor [15, 16]. It has been suggested that MODS scores are effective in quantifying the severity of each organ failure during the first ICU days, in adults [17–19] as well as in children . Furthermore, there is increasing evidence that the duration and progression of MODS influence outcome, indicating that MODS is a dynamic process [15, 20–28].
One can question if it is useful to monitor dPELOD-2 scores during a predetermined set days. Many studies have demonstrated that daily organ dysfunction monitoring can be a useful measurement to estimate the response to therapy in a group of patients [29–32]. The model that we proposed in this study, which includes 7 days distributed over the PICU stay, may represent the best balance between the workload of assessing daily scores and the optimal association with prognosis throughout the PICU stay. There have indeed been a number of studies in critically ill adults that support such an approach [18, 21, 33]. Moreover, in studies of long-stay ICU patients, severity scores at admission fail to predict mortality [18, 34]. The late events cannot be predicted with admission or first-day predictive scores, and this suggest that for patients with prolonged ICU stay, the calculation of scores on later days, for example on days 8, 12, 16 and 18, may be useful.
What could be the practical applications of daily MODS scores? Some pediatric intensivists consider that an effective assessment of the severity of MODS, like the PELOD-2 score, is needed to correctly describe the clinical course in critically ill children . The MODS score can be used as an outcome measure in trials conducted in the ICU [35, 36] and PICU [11, 30, 37, 38]. A recent study reported that delayed or inappropriate antimicrobial administration beyond 3 h from recognition of sepsis is an independent risk factor for prolonged organ failure and mortality . Our study showed that the progression of the dPELOD-2 score added information to the PELOD-2 score for the whole PICU stay. All these data support the concept that the PELOD-2 score and its progression in the PICU can be outcome measures of interest in quality assessment activities and in clinical trials. New approaches, such as dynamic Bayesian networks, using the sequential organ failure assessment (SOFA) score, suggest that a sequence of organ dysfunctions can be predicted, which allows physicians to anticipate the development of MODS and help them undertake therapeutic decisions .
Strengths of this study include that it was prospective, and it was conducted in nine PICUs across two countries. It included a large number of critically ill children (3,669) and a huge number of days in PICU (more than 7,900 days). Indeed, we have taken into account the dynamics of organ dysfunctions throughout the entire PICU stay.
This study is not without limitations. First, the dataset was collected 8 years ago and the case mix and mortality rate may have changed over this time period. Second, it was conducted in only two European countries (France and Belgium); our population is different from the US and UK populations . Last, the number of deaths was quite low after 7 days in the PICU (there were 54 deaths in 557 patients with a length of stay in the PICU longer than 7 days), but higher than that in our previous study (33 deaths in 338 patients) . Therefore, a large prospective study that is not country-specific would be useful to evaluate external validity of the PELOD-2 score; it should include more critically ill children with a long-term PICU stay and consider two groups of patients, those with a short PICU stay (<7 days) and those with a long PICU stay (≥7 days), in order to collect a sufficient number of deaths in each group . Interestingly, a recent Portuguese study including 556 critically ill children admitted to PICU from January 2011 to December 2012 reported good discrimination (AUC 0.94) and calibration (after recalibration) of the PELOD-2 score .
This study shows that the progression of the severity of organ dysfunctions can be evaluated by measuring the dPELOD-2 score during a specified set of 7 days in the PICU. The serial evaluation of the change in the dPELOD-2 score from day 1, adjusted for the baseline value, demonstrated a significant odds ratio of death for each of the 7 days. The daily PELOD-2 score could be a helpful tool to stratify critically ill children enrolled in clinical trials, to describe their clinical course, to estimate therapeutic responses and to describe outcomes. It could also be used for epidemiologic and administrative purposes. External validation of the PELOD-2 score needs additional studies including more patients with a PICU stay ≥7 days.
Progression of the severity of MODS can be evaluated by measuring the dPELOD-2 score during a specified period of 7 days in the PICU
Daily PELOD-2 scores calculated on these days had good discrimination and calibration when used to predict short-term mortality
In children in the PICU, the PELOD-2 score on day 1 is a significant prognostic factor
New or progressive MODS during the PICU stay is associated with an increased risk of mortality
The serial evaluation of the change in the dPELOD-2 score from day 1, adjusted for baseline value, demonstrated a significant odds ratio of death for each day
area under the curve
daily pediatric logistic organ dysfunction
Groupe Francophone de Réanimation et Urgences Pédiatriques
Intensive care unit
multiple organ dysfunction syndrome
pediatric logistic organ dysfunction
pediatric intensive care unit
Ferreira AM, Sakr Y. Organ dysfunction: general approach, epidemiology, and organ failure scores. Semin Respir Crit Care Med. 2011;32:543–51.
Cengiz P, Zimmerman JJ. Prelude to pediatric multiple organ dysfunction syndrome: the golden hours concept revisited. Pediatr Crit Care Med. 2003;4:263–4.
Marshall JC, Vincent JL, Guyatt G, Angus DC, Abraham E, Bernard G, et al. Outcome measures for clinical research in sepsis: a report of the 2nd Cambridge Colloquium of the International Sepsis Forum. Crit Care Med. 2005;33:1708–16.
Proulx F, Gauthier M, Nadeau D, Lacroix J, Farrell CA. Timing and predictors of death in pediatric patients with multiple organ system failure. Crit Care Med. 1994;22:1025–31.
Wilkinson JD, Pollack MM, Glass NL, Kanter RK, Katz RW, Steinhart CM. Mortality associated with multiple organ system failure and sepsis in pediatric intensive care unit. J Pediatr. 1987;111:324–8.
Johnston J, Yi M, Britto M, Mrus J. Importance of organ dysfunction in determining hospital outcomes in children. J Pediatr. 2004;144:595–601.
Tantalean J, Leon R, Santos A, Sanchez E. Multiple organ dysfunction syndrome in children. Pediatr Crit Care Med. 2003;4:181–5.
Leclerc F, Leteurtre S, Duhamel A, Grandbastien B, Proulx F, Martinot A, et al. Cumulative influence of organ dysfunctions and septic state on mortality of critically ill children. Am J Respir Crit Care Med. 2005;171:348–53.
Vincent JL, Moreno R. Clinical review: scoring systems in the critically ill. Crit Care. 2010;14:207.
Lacroix J, Cotting J. Severity of illness and organ dysfunction scoring in children. Pediatr Crit Care Med. 2005;6:S126–34.
Sevketoglu E, Yildizdas D, Horoz OO, Kihtir HS, Kendirli T, Bayraktar S, et al. Use of therapeutic plasma exchange in children with thrombocytopenia-associated multiple organ failure in the Turkish thrombocytopenia-associated multiple organ failure network. Pediatr Crit Care Med. 2014;15:e354–9.
Leteurtre S, Duhamel A, Grandbastien B, Lacroix J, Leclerc F. Paediatric logistic organ dysfunction (PELOD) score. Lancet. 2006;367:897. author reply 900–892.
Leteurtre S, Duhamel A, Grandbastien B, Proulx F, Cotting J, Gottesman R, et al. Daily estimation of the severity of multiple organ dysfunction syndrome in critically ill children. CMAJ. 2010;182:1181–7.
Leteurtre S, Duhamel A, Salleron J, Grandbastien B, Lacroix J, Leclerc F, et al. PELOD-2: an update of the PEdiatric logistic organ dysfunction score. Crit Care Med. 2013;41:1761–73.
Ferreira FL, Bota DP, Bross A, Melot C, Vincent JL. Serial evaluation of the SOFA score to predict outcome in critically ill patients. JAMA. 2001;286:1754–8.
Zygun DA, Laupland KB, Fick GH, Sandham JD, Doig CJ. Limited ability of SOFA and MOD scores to discriminate outcome: a prospective evaluation in 1,436 patients. Can JAnaesth. 2005;52:302–8.
Metnitz PG, Lang T, Valentin A, Steltzer H, Krenn CG, Le Gall JR. Evaluation of the logistic organ dysfunction system for the assessment of organ dysfunction and mortality in critically ill patients. Intensive Care Med. 2001;27:992–8.
Timsit JF, Fosse JP, Troche G, De Lassence A, Alberti C, Garrouste-Orgeas M, et al. Calibration and discrimination by daily Logistic Organ Dysfunction scoring comparatively with daily Sequential Organ Failure Assessment scoring for predicting hospital mortality in critically ill patients. Crit Care Med. 2002;30:2003–13.
Vincent JL, de Mendonca A, Cantraine F, Moreno R, Takala J, Suter PM, et al. Use of the SOFA score to assess the incidence of organ dysfunction/failure in intensive care units: results of a multicenter, prospective study. Working group on “sepsis-related problems” of the European Society of Intensive Care Medicine. Crit Care Med. 1998;26:1793–800.
Leteurtre S, Martinot A, Duhamel A, Proulx F, Grandbastien B, Cotting J, et al. Validation of the paediatric logistic organ dysfunction (PELOD) score: prospective, observational, multicentre study. Lancet. 2003;362:192–7.
Cappi SB, Sakr Y, Vincent JL. Daily evaluation of organ function during renal replacement therapy in intensive care unit patients with acute renal failure. J Crit Care. 2006;21:179–83.
Cook R, Cook D, Tilley J, Lee K, Marshall J. Multiple organ dysfunction: baseline and serial component scores. Crit Care Med. 2001;29:2046–50.
Doig CJ, Zygun DA, Fick GH, Laupland KB, Boiteau PJ, Shahpori R, et al. Study of clinical course of organ dysfunction in intensive care. Crit Care Med. 2004;32:384–90.
Jacobs S, Zuleika M, Mphansa T. The Multiple Organ Dysfunction Score as a descriptor of patient outcome in septic shock compared with two other scoring systems. Crit Care Med. 1999;27:741–4.
Junger A, Engel J, Benson M, Bottger S, Grabow C, Hartmann B, et al. Discriminative power on mortality of a modified Sequential Organ Failure Assessment score for complete automatic computation in an operative intensive care unit. Crit Care Med. 2002;30:338–42.
Kilic YA, Yorganci K, Sayek I. Visualizing multiple organ failure: a method for analyzing temporal and dynamic relations between failing systems and interventions. Crit Care. 2007;11:417.
Moreno R, Vincent JL, Matos R, Mendonca A, Cantraine F, Thijs L, et al. The use of maximum SOFA score to quantify organ dysfunction/failure in intensive care. Results of a prospective, multicentre study. Working Group on Sepsis related Problems of the ESICM. Intensive Care Med. 1999;25:686–96.
Thandassery RB, Yadav TD, Dutta U, Appasani S, Singh K, Kochhar R. Dynamic nature of organ failure in severe acute pancreatitis: the impact of persistent and deteriorating organ failure. HPB. 2013;15:523–8.
Darmon M, Azoulay E, Thiery G, Ciroldi M, Galicier L, Parquet N, et al. Time course of organ dysfunction in thrombotic microangiopathy patients receiving either plasma perfusion or plasma exchange. Crit Care Med. 2006;34:2127–33.
Lacroix J, Hebert PC, Hutchison JS, Hume HA, Tucci M, Ducruet T, et al. Transfusion strategies for patients in pediatric intensive care units. N Engl J Med. 2007;356:1609–19.
Rivera-Fernandez R, Nap R, Vazquez-Mata G, Reis Miranda D. Analysis of physiologic alterations in intensive care unit patients and their relationship with mortality. J Crit Care. 2007;22:120–8.
Vincent JL, Baron JF, Reinhart K, Gattinoni L, Thijs L, Webb A, et al. Anemia and blood transfusion in critically ill patients. JAMA. 2002;288:1499–507.
Wagner DP, Knaus WA, Harrell FE, Zimmerman JE, Watts C. Daily prognostic estimates for critically ill adults in intensive care units: results from a prospective, multicenter, inception cohort analysis. Crit Care Med. 1994;22:1359–72.
Ferraris VA, Propp ME. Outcome in critical care patients: a multivariate study. Crit Care Med. 1992;20:967–76.
Marshall JC. Measuring organ dysfunction in the intensive care unit: why and how? Can J Anaesth. 2005;52:224–30.
Petros AJ, Marshall JC, van Saene HK. Should morbidity replace mortality as an endpoint for clinical trials in intensive care? Lancet. 1995;345:369–71.
Nguyen TC, Han YY, Kiss JE, Hall MW, Hassett AC, Jaffe R, et al. Intensive plasma exchange increases a disintegrin and metalloprotease with thrombospondin motifs-13 activity and reverses organ dysfunction in children with thrombocytopenia-associated multiple organ failure. Crit Care Med. 2008;36:2878–87.
Weiss SL, Fitzgerald JC, Balamuth F, Alpern ER, Lavelle J, Chilutti M, et al. Delayed antimicrobial therapy increases mortality and organ dysfunction duration in pediatric sepsis. Crit Care Med. 2014;42:2409–17.
Sandri M, Berchialla P, Baldi I, Gregori D, De Blasi RA. Dynamic Bayesian Networks to predict sequences of organ failures in patients admitted to ICU. J Biomed Inform. 2014;48:106–13.
Burns JP, Sellers DE, Meyer EC, Lewis-Newby M, Truog RD. Epidemiology of death in the PICU at five U.S. teaching hospitals*. Crit Care Med. 2014;42:2101–8.
Goncalves JP, Severo M, Rocha C, Jardim J, Mota T, Ribeiro A. Performance of PRISM III and PELOD-2 scores in a pediatric intensive care unit. Eur J Pediatr 2015 (ahead of print).
This study was supported by the French Ministry of Health (Programme Hospitalier de Recherche Clinique n°1,997/122). GFRUP collaborators were: D. Biarent (Bruxelles, Belgium), R. Cremer (Lille, France); S. Dauger (Robert Debré-Paris, France), M. Dobrzynski (Brest, France), G. Emériaud (Grenoble, France), S. Renolleau (Trousseau-Paris, France), M. Roque-Gineste (Toulouse, France), D. Stamm, N. Richard (Lyon, France), and I.Wroblewski (Besançon, France).
None of the authors has a financial relationship with a commercial entity that has an interest in the subject of this manuscript.
FL and SL obtained funding. SL and FL conceived of and designed the study. SL and VD acquired the data. SL, VD, AD, JL and FL analyzed and interpreted the data. AD, VD and SL performed the statistical analysis. FL drafted the manuscript, and FL, SL, JL, AD and VD revised the manuscript critically for important intellectual content. All authors have given final approval of the version to be published. All authors agree to be accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved.
About this article
Cite this article
Leteurtre, S., Duhamel, A., Deken, V. et al. Daily estimation of the severity of organ dysfunctions in critically ill children by using the PELOD-2 score. Crit Care 19, 324 (2015). https://doi.org/10.1186/s13054-015-1054-y
- Organ Dysfunction
- Sequential Organ Failure Assessment
- Intensive Care Unit Stay
- Serial Evaluation
- Significant Prognostic Factor