- Open Access
Derivation and validation of an easy-to-compute trauma score that improves prognostication of mortality or the Trauma Rating Index in Age, Glasgow Coma Scale, Respiratory rate and Systolic blood pressure (TRIAGES) score
Critical Care volume 23, Article number: 365 (2019)
Multiple trauma scores have been developed and validated, including the Revised Trauma Score (RTS) and the Mechanism, Glasgow Coma Scale, Age, and Arterial Pressure (MGAP) score. However, these scores are complex to calculate or have low prognostic abilities for trauma mortality. Therefore, we aimed to develop and validate a trauma score that is easier to calculate and more accurate than the RTS and the MGAP score.
The study was a retrospective prognostic study. Data from patients registered in the Japan Trauma Databank (JTDB) were dichotomized into derivation and validation cohorts. Patients’ data from the Clinical Randomisation of an Antifibrinolytic in Significant Haemorrhage-2 (CRASH-2) trial were assigned to another validation cohort. We obtained age and physiological variables at baseline, created ordinal variables from continuous variables, and defined integer weighting coefficients. Score performance to predict all-cause in-hospital death was assessed using the area under the curve in receiver operating characteristics (AUROC) analyses.
Based on the JTDB derivation cohort (n = 99,867 with 12.5% mortality), the novel score ranged from 0 to 14 points, including 0–2 points for age, 0–6 points for the Glasgow Coma Scale, 0–4 points for systolic blood pressure, and 0–2 points for respiratory rate. The AUROC of the novel score was 0.932 for the JTDB validation cohort (n = 76,762 with 10.1% mortality) and 0.814 for the CRASH-2 cohort (n = 19,740 with 14.6% mortality), which was superior to RTS (0.907 and 0.808, respectively) and MGAP score (0.918 and 0.774, respectively) results.
We report an easy-to-use trauma score with better prognostication ability for in-hospital mortality compared to the RTS and MGAP score. Further studies to test clinical applicability of the novel score are warranted.
A prognostic score aims to provide standardized severity metrics for a specific medical condition and to stratify patients into groups according to the probability of the prognosis . A trauma score could be useful in improving the quality of care and in assisting with prognostication in the patient group . In this context, stratification by a trauma score classifies patients into low, moderate, or high risk for outcome  and can be applicable as a triage tool in disasters, mass casualty incidents, or military settings .
Over time, multiple trauma scores have been developed. These include trauma scores based on the patient’s information obtained in the early trauma care, anatomical trauma scores based on the distribution and severity of the injury, and combined trauma scores based on early, anatomical, and laboratory information . Trauma scores in the early trauma care typically include several predictors, such as age, mechanism of injury, and physiological status; such scores include the Revised Trauma Score (RTS) [5, 6] and the Mechanism, Glasgow Coma Scale (GCS), Age, and Arterial Pressure (MGAP) score . To calculate the RTS, GCS, systolic blood pressure, and respiratory rate are assigned one of five categories from 0 to 4 points; this score is multiplied by the weighting coefficients of 0.9368 for GCS, 0.7326 for systolic blood pressure, and 0.2908 for respiratory rate. The total of these three items is then calculated . Although using RTS in early trauma care provides an acceptable prediction of trauma mortality [6, 8, 9], its computation is complex, and its weighting coefficients are reportedly out of date [10,11,12]. Therefore, the MGAP score was developed as the simple sum of the categorized values without using the weighting coefficients . Although the MGAP score is easy to compute, its prognostic ability for trauma mortality is not superior to that of the RTS .
This study aimed to develop and validate a novel, easy-to-calculate trauma score with improved prognostication ability for trauma mortality compared with the RTS and MGAP scores.
Study design and setting
This retrospective prognostic study aimed to develop and validate a prognostic model for in-hospital mortality in adult trauma patients. Reporting of this study adhered to the Transparent Reporting of a Multivariable Prediction Model for Individual Prognosis or Diagnosis (TRIPOD) guideline  and was approved by the medical ethics committee of the Tokyo Medical and Dental University (reference number 2192).
Data was obtained from patients’ all-available data of the nationwide trauma registry in Japan (the Japan Trauma Databank [JTDB]) from the year 2004 to 2015 and that of the Clinical Randomisation of an Antifibrinolytic in Significant Haemorrhage-2 (CRASH-2) trial from the year 2005 to 2010 [14,15,16]. The JTDB was established in 2004 and involved 256 hospitals in Japan by 2015 [14, 17]. Participating hospitals in the JTDB voluntarily register trauma patients with an Injury Severity Score (ISS) ≥ 9 and burn patients and include information on demographics, the situation and mechanism of injury, the physiological status before and after arrival at the emergency room (ER), procedures before and after arrival at the ER, surgeries in the ER and/or operation theater, the Abbreviated Injury Scale (AIS) value, ISS, death, and length of hospitalization [14, 17].
CRASH-2 was a randomized controlled trial aimed at assessing the effects of tranexamic acid in bleeding trauma patients in 40 countries, mainly developing countries [15, 16]. CRASH-2 also collected the following data from trauma patients: demographics, physiological status after arrival at the ER, death during hospitalization, and length of hospitalization [15, 16].
Selection of participants
The present study included patients with documented blunt or penetrating trauma, but without a burn. The study exclusion criterion was defined as the exclusion of patients aged < 16 years or unreported. This exclusion criterion was determined based on the available information before the outlier removal and multiple imputation and applied to the multiply imputed datasets after the outlier removal and multiple imputation.
We randomly dichotomized the JTDB cases into derivation and validation cohorts according to a unique identification number provided to each participating institute. Patients from institutes with an even unique identification number were allocated to the JTDB derivation cohort, and the remaining patients were allocated to the JTDB validation cohort. All patients from CRASH-2 were allocated to the other validation cohort. The JTDB derivation cohort was used for score development, and the JTDB and CRASH-2 validation cohorts were used for validation of the developed scoring system.
Study predictor variables included the mechanism of injury (blunt or penetrating) as a nominal variable and age (years), respiratory rate (1/min), systolic blood pressure (mmHg), and GCS as the continuous variables. These variables were obtained at the initial contact with a trauma patient in the ER and upon entering the study according to the JTDB and CRASH-2 definition, respectively. Other variables (e.g., prehospital vital signs or the ISS) were also included and used for multiple imputation, sensitivity analyses, and/or explanatory subgroup analysis.
To preserve statistical power and appropriately assess the association between predictor variables and outcome while minimizing selection bias, the JTDB derivation cohort datasets underwent a 2-step data preparation before statistical analyses. The validation datasets did not undergo this process to simulate “real-world” conditions. The first step included the detection and removal of outliers from the numeric variables, using robust linear regression analyses , followed by multiple imputation by chained equation (MICE) with 20 iterations that generated 25 datasets with imputed missing values . The Box-Cox transformation method was used to transform the distribution of all numerical variables into normal distribution prior to imputation, and to transform them back into the original distribution after imputation. For GCS, MICE imputed 3 different elements of GCS (eye, verbal, and motor responses) as ordered variables separately. Verbal GCS subscore was recorded as if the patient was intubated. The total GCS was recalculated as the sum of the 3 different elements of GCS after imputation. An AIS code of 9 in any section was regarded as a missing value and was multiply imputed.
We defined the study reference standard as in-hospital death from any cause.
A logistic regression analysis, with age and physiological status including GCS, systolic blood pressure, and respiratory rate on arrival at the ER as explanatory variables, was used to predict in-hospital mortality. Relations between several predictors and outcomes did not assure linear and monotonic function. Therefore, in addition to the ordinal logistic regression analysis, a multivariable generalized additive model was used for visual assessment of non-linear and non-monotonic functions between the predictors and study outcome . In reference to the magnitudes of the regression coefficients of the logistic regression analysis and the results of the generalized additive model, the ranges for all predictors were partitioned, assigned simple integers, and included in the prediction model, which was then developed into a novel trauma score. A detailed method for partitioning numeric data into integerized score points for the novel score is provided (Additional file 1).
The primary and secondary analyses compared the prediction of in-hospital mortality with the novel score versus RTS or MGAP score, in both the JTDB validation and the CRASH-2 cohorts. The primary analysis involved the use of receiver operating characteristic (ROC) analyses to evaluate the prognostic accuracy of the scores in terms of the area under the ROC curve (AUROC). A Hosmer-Lemeshow plot was used to assess the calibration of the predicted and observed in-hospital mortality, estimated on both the JTDB validation and CRASH-2 cohorts. The two best thresholds of tested scores to predict in-hospital mortality were estimated in the JTDB derivation cohort using Youden’s index and a sensitivity > 0.9. These thresholds were further used to determine sensitivity, specificity, and positive and negative predictive values of the scores predicting in-hospital mortality in the ROC curves in the primary analysis of validation cohorts. The required sample size for the study’s primary analysis was estimated based on the parameters obtained from the ROC analysis, comparing the novel score to RTS or MGAP score in the JTDB derivation cohort, and the given power of 0.8 and P value of 0.025, after Bonferroni modification of multiple comparisons . The secondary analyses included partial AUROC analysis with restriction for a sensitivity of ≥ 0.9 and a reclassification improvement analysis. Integration of the point estimation and variances across the multiply imputed datasets were based on a 20,000-time bootstrapping in the ROC, partial ROC, and reclassification improvement analyses or Rubin’s rule, in all other analyses .
To test the robustness of the primary analysis, sensitivity analyses to reassess the primary analysis were performed on the validation datasets after outlier removal and multiple imputation and on validation datasets where the mechanism of trauma and physiological variables were imputed as “blunt” and normal values, respectively. To test for the applicability of scores in prehospital settings, a separate sensitivity analysis was performed using prehospital variables instead of hospital variables. Furthermore, explanatory subgroup analyses assessed the prediction for in-hospital mortality with scores in the subgroups stratified by age.
All statistical analyses were performed using “R 3.5.1” for statistical computing (R Foundation for Statistical Computing, Vienna, Austria) with several add-on packages.
Characteristics of patients enrolled in the study
This study selected 210,752 cases from among 225,616 trauma patients from the JTDB (JTDB derivation cohort, 107 hospitals, n = 99,867; JTDB validation cohort, 114 hospitals, n = 110,885; Fig. 1). Similarly, 20,197 of 20,207 patients from the CRASH-2 were assigned to the CRASH-2 validation cohort (Fig. 1). Patients in the JTDB derivation and validation cohorts were similar, whereas patients in the CRASH-2 cohort were younger, more frequently had a penetrating injury, and were more hemodynamically unstable, with lower systolic blood pressure and a higher heart rate at presentation than those in the JTDB cohorts (Table 1, details provided in Additional file 2: Table S1).
In the JTDB derivation cohort, 12,473/99,867 (12.5%) patients died in the hospital. The logistic regression generalized additive model used to predict in-hospital mortality for the JTDB derivation cohort demonstrated approximately monotonic positive and negative correlations for age and GCS, respectively, and curvilinear U-shaped correlations with respiratory rate and systolic blood pressure (Fig. 2). Based on the logistic regression analysis to predict in-hospital mortality, after assignment of simple integers to the categorized ranges in the predictor values, we defined a novel score that summed these 4-digit integers (the Trauma Rating Index in Age, Glasgow Coma Scale, Respiratory rate and Systolic blood pressure [TRIAGES] score, Additional file 1). The TRIAGES score ranges from 0 to 14 points: 0–2 points for age, 0–6 points for GCS, 0–2 points for respiratory rate, and 0–4 points for systolic blood pressure (Table 2, Additional file 3: Table S2). The required sample size for the test validation was estimated at 8237 or 13,623 for the comparison of the TRIAGES score to RTS or MGAP score, respectively.
In the JTDB validation and CRASH-2 cohorts, 9877/97,428 (10.1%) and 3085/20,197 (15.3%) patients died in the hospital, respectively. From the AUROC analysis, the TRIAGES score showed the best prediction of in-hospital mortality for both the JTDB validation and CRASH-2 cohorts (Table 3, Additional file 4: Figure S1). The TRIAGES score also showed the best calibration of predicted and observed in-hospital mortality in terms of the Pearson chi-square statistic estimated for both the JTDB validation and CRASH-2 cohorts (Additional file 5: Figure S2). For the tested scores across the validation cohorts, sensitivity, specificity, and positive and negative predictive values at the selected thresholds were also assessed (Additional file 6: Table S3). In secondary analyses, the partial ROC analysis demonstrated that the TRIAGES score had the best partial AUROC if the given sensitivity was restricted to > 0.9 (Table 3). Another secondary analysis or a reclassification improvement analysis demonstrated that the TRIAGES score improved the reclassification, compared with both the RTS for the CRASH-2 cohort and the MGAP score for the JTDB validation and CRASH-2 cohorts (Table 3). Results of sensitivity analyses to reassess the primary analysis in multiply imputed or single-imputed-by-the-best-value datasets were consistent with those of the primary analyses (Table 3). Sensitivity analysis to assess the prediction of the outcome using prehospital variables was also consistent with that of the primary analysis (Table 3). In the explanatory subgroup analyses stratified by age groups, the prognostic accuracy of the tested scores was relatively worse in elderly patients in the JTDB validation cohort (Additional file 7: Table S4). This association was most obvious for RTS.
Our novel trauma score is easy to calculate and improves the predictive accuracy compared with the RTS and MGAP scores, based on AUROC analyses, partial AUROC analysis, and reclassification improvement analysis, for both the JTDB validation cohort and CRASH-2 cohort.
The Trauma Injury Severity Score (TRISS) and Revised Injury Severity Classification version II (RISC-II) integrate the early information and delayed information from radiological images and/or laboratory tests to achieve the most accurate prognostication [22, 23]. However, the collection of late information requires considerable delays during this critical period for trauma patients. Furthermore, late information regarding radiological images usually involves a CT scan; therefore, a combined trauma score is often missed or miscalculated if a CT scan lacks. Trauma scores in the early trauma care are calculated based on the patients’ age, mechanisms of injury, and physiological status, for which information is easily collected during early trauma care and within minutes after initial patient contact with fewer missing [5,6,7, 9]. This facilitates the use of the score by healthcare professionals and is expected to be useful for triage in disasters, mass casualty incidents, and military settings . In addition, the ease of calculating the score is an indispensable feature of a trauma score [10, 12]. Calculation of complex equations using weighted coefficients generally requires electrical devices that narrow the applicability to various situations. In contrast, simplifying the score design may potentially reduce the accuracy of outcome prediction.
The RTS is not easy to use at the bedside or in a prehospital setting because of its difficult categorization and relative complexity [5, 6]. Categorization of the parameters to compute the RTS requires discrimination between 0 and 1–49 mmHg for systolic blood pressure and between 0 and 1–5 breaths/min for respiratory rate which can be difficult to complete at the bedside within a period of seconds. Moreover, many modern prediction scores no longer use weighting coefficients with a decimal point, as they can complicate score computation in the absence of technological assistance. The TRIAGES and MGAP scores both avoid the discrimination of systolic blood pressure and respiratory rate values close to 0 and the use of weighting coefficients with a decimal point.
Generally, in trauma care, trauma scores can be adjusted for trauma severity for outcome research and international or institutional benchmarking . Improving the accuracy and usability of trauma scores could also improve the quality of observational studies. In specific situations, such as disaster medicine or military medicine, a good trauma triage tool should allow the extraction of patients with less severe trauma, who need urgent treatment, as well as dying trauma patients, who no longer require treatment. Fulfilling these requirements can help develop a good triage trauma score, capable of extracting the smaller portion of the target population whose prognosis is modifiable, thereby saving medical resources.
The current study has several limitations. First, the use of a trauma database consisting of retrospectively recruited, non-consecutive trauma patients (JTDB) is not ideal for developing a prediction model. Second, the advantages of the TRIAGES score including simplicity and good prognostic accuracy are theoretically suitable in disaster or military settings, however not tested in the present study. Third, the use of in-hospital mortality as the study outcome is not appropriate for predicting long-term mortality in trauma patients. Fourth, the CRASH-2 dataset, which consists of participants outside of Japan, acted as an external validation dataset for this model to test the external validity of the trauma scores. However, CRASH-2 was a randomized controlled trial involving hemodynamically unstable trauma patients; therefore, the study did not include patients with critical or less-severe trauma. To account for the drawback of the CRASH-2 cohort as an external validation cohort, we also used a JTDB validation cohort.
A novel trauma score that is easy to calculate and that improves prognostication was developed and validated.
Availability of data and materials
The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.
Abbreviated Injury Scale
Area under the curve in receiver operating characteristics
Clinical Randomisation of an Antifibrinolytic in Significant Haemorrhage-2
Glasgow Coma Scale
Injury Severity Score
Japan Trauma Databank
Mechanism, Glasgow Coma Scale, Age, and Arterial Pressure
Multiple imputation by chained equation
Revised Injury Severity Classification version II
Receiver operating characteristics
Revised Trauma Score
Trauma Rating Index in Age, Glasgow Coma Scale, Respiratory rate and Systolic blood pressure
Trauma Injury Severity Score
Laupacis A, Sekar N, Stiell IG. Clinical prediction rules. A review and suggested modifications of methodological standards. JAMA. 1997;277:488–94. https://doi.org/10.1001/jama.1997.03540300056034.
Champion H, Moore L, Vickers RR. Injury severity scoring and outcomes research. In: Moore EE, Feliciano DV, Mattox KL, editors. Trauma, 8. New York: McGraw-Hill; 2017. pp. 71–95.
Vincent JL, Opal SM, Marshall JC. Ten reasons why we should NOT use severity scores as entry criteria for clinical trials or in our treatment decisions. Crit Care Med. 2010;38:283–7. https://doi.org/10.1097/CCM.0b013e3181b785a2.
Jenkins JL, McCarthy ML, Sauer LM, Green GB, Stuart S, Thomas TL, et al. Mass-casualty triage: time for an evidence-based approach. Prehosp Disaster Med. 2008;23:3–8. https://doi.org/10.1017/S1049023X00005471.
Champion HR, Sacco WJ, Carnazzo AJ, Copes W, Fouty WJ. Trauma score. Crit Care Med. 1981;9:672–6.
Champion HR, Sacco WJ, Copes WS, Gann DS, Gennarelli TA, Flanagan ME. A revision of the trauma score. J Trauma. 1989;29:623–9.
Sartorius D, Le Manach Y, David JS, Rancurel E, Smail N, Thicoipe M, et al. Mechanism, Glasgow Coma Scale, Age, and Arterial Pressure (MGAP): a new simple prehospital triage score to predict mortality in trauma patients. Crit Care Med. 2010;38:831–7. https://doi.org/10.1097/CCM.0b013e3181cc4a67.
Kuhls DA, Malone DL, McCarter RJ, Napolitano LM. Predictors of mortality in adult trauma patients: the Physiologic Trauma Score is equivalent to the Trauma and Injury Severity Score. J Am Coll Surg. 2002;194:695–704. https://doi.org/10.1016/S1072-7515(02)01211-5.
Kondo Y, Abe T, Kohshi K, Tokuda Y, Cook EF, Kukita I. Revised trauma scoring system to predict in-hospital mortality in the emergency department: Glasgow Coma Scale, Age, and Systolic Blood Pressure score. Crit Care. 2011;15:R191. https://doi.org/10.1186/cc10348.
Gabbe BJ, Cameron PA, Finch CF. Is the Revised Trauma Score still useful? ANZ J Surg. 2003;73:944–8. https://doi.org/10.1046/j.1445-1433.2003.02833.x.
Moore L, Lavoie A, LeSage N, Abdous B, Bergeron E, Liberman M, et al. Statistical validation of the Revised Trauma Score. J Trauma. 2006;60:305–11. https://doi.org/10.1097/01.ta.0000200840.89685.b0.
Sasser SM, Hunt RC, Faul M, Sugerman D, Pearson WS, Dulski T, et al. Guidelines for field triage of injured patients: recommendations of the National Expert Panel on Field Triage. MMWR Recomm Rev. 2009;58:1–35.
Collins GS, Reitsma JB, Altman DG, Moons KG. Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): the TRIPOD statement. BMJ. 2015;350:g7594. https://doi.org/10.1136/bmj.g7594.
Japan Trauma Care and Research. Japan Trauma Data Bank Report 2016 (2010–2015). https://www.jtcr-jatec.org/traumabank/dataroom/data/JTDB2016e.pdf. Accessed 16 Oct 2017.
CRASH-2 trial collaborators, Shakur H, Roberts I, Bautista R, Caballero J, Coats T, et al. Effects of tranexamic acid on death, vascular occlusive events, and blood transfusion in trauma patients with significant haemorrhage (CRASH-2): a randomised, placebo-controlled trial. Lancet. 2010;376:23–32. https://doi.org/10.1016/S0140-6736(10)60835-5.
CRASH-2 collaborators, Roberts I, Shakur H, Afolabi A, Brohi K, Coats T, et al. The importance of early treatment with tranexamic acid in bleeding trauma patients: an exploratory analysis of the CRASH-2 randomised controlled trial. Lancet. 2011;377:1096–101. https://doi.org/10.1016/S0140-6736(11)60278-X.
Tohira H, Jacobs I, Mountain D, Gibson N, Yeo A. International comparison of regional trauma registries. Injury. 2012;43:1924–30. https://doi.org/10.1016/j.injury.2012.08.024.
Venables WN, Ripley BD. Modern applied statistics with S. 4th ed. New York: Springer; 2002.
Rubin DB. Multiple imputation for nonresponse in surveys. New York: Wiley; 2004.
Wood SN. Fast stable restricted maximum likelihood and marginal likelihood estimation of semiparametric generalized linear models. J Royal Stat Soc B. 2011;73:3–36. https://doi.org/10.1111/j.1467-9868.2010.00749.x.
Obuchowski NA, McClish DK. Sample size determination for diagnostic accuracy studies involving binormal ROC curve indices. Stat Med. 1997;16:1529–42. https://doi.org/10.1002/(SICI)1097-0258(19970715)16:13<1529::AID-SIM565>3.0.CO;2-H.
Boyd CR, Tolson MA, Copes WS. Evaluating trauma care: the TRISS method. Trauma Score and the Injury Severity Score. J Trauma. 1987;27:370–8.
Lefering R, Huber-Wagner S, Nienaber U, Maegele M, Bouillon B. Update of the trauma risk adjustment model of the Trauma Register DGU™: the Revised Injury Severity Classification, version II. Crit Care. 2014;18:476. https://doi.org/10.1186/s13054-014-0476-2.
The authors acknowledge the support of all the trauma physicians in JTDB participating hospitals.
This work was supported in part by the Japan Society for the Promotion of Science (#24592731). Dr. Shiraishi received funding from the Japan Society for the Promotion of Science. Dr. Matsui’s institution received funding from grants from the Ministry of Education, Culture, Sports, Science and Technology, Japan 17H04141 and 17H05077.
Ethics approval and consent to participate
The current study was approved by the medical ethics committee of the Tokyo Medical and Dental University (reference number 2192).
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Shiraishi, A., Otomo, Y., Yoshikawa, S. et al. Derivation and validation of an easy-to-compute trauma score that improves prognostication of mortality or the Trauma Rating Index in Age, Glasgow Coma Scale, Respiratory rate and Systolic blood pressure (TRIAGES) score. Crit Care 23, 365 (2019) doi:10.1186/s13054-019-2636-x
- Trauma score
- Revised Trauma Score
- MGAP score
- Prognostic accuracy study
- Trauma registry
- In-hospital mortality