- Open Access
Intermediate-risk pulmonary embolism: echocardiography predictors of clinical deterioration
Critical Care volume 26, Article number: 160 (2022)
We determine the predictive value of transthoracic echocardiographic (TTE) metrics for clinical deterioration within 5 days in adults with intermediate-risk pulmonary embolism (PE).
This was a prospective observational study of intermediate-risk PE patients. To determine associations of TTE and clinical predictors with clinical deterioration, we used univariable analysis, Youden’s index for optimal thresholds, and multivariable analyses to report odds ratios (ORs) or area under the curve (AUC).
Of 306 intermediate-risk PE patients, 115 (37.6%) experienced clinical deterioration. PE patients who had clinical deterioration within 5 days had greater baseline right ventricle (RV) dilatation and worse systolic function than the group without clinical deterioration as indicated by the following: RV basal diameter 4.46 ± 0.77 versus 4.20 ± 0.77 cm; RV/LV basal width ratio 1.14 ± 0.29 versus 1.02 ± 0.24; tricuspid annular plane systolic excursion (TAPSE) 1.56 ± 0.55 versus 1.80 ± 0.52 cm; and RV systolic excursion velocity 10.40 ± 3.58 versus 12.1 ± 12.5 cm/s, respectively. Optimal thresholds for predicting clinical deterioration were: RV basal width 3.9 cm (OR 2.85 [1.64, 4.97]), RV-to-left ventricle (RV/LV) ratio 1.08 (OR 3.32 [2.07, 5.33]), TAPSE 1.98 cm (OR 3.3 [2.06, 5.3]), systolic excursion velocity 10.10 cm/s (OR 2.85 [1.75, 4.63]), and natriuretic peptide 190 pg/mL (OR 2.89 [1.81, 4.62]). Significant independent predictors were: transient hypotension 6.1 (2.2, 18.9), highest heart rate 1.02 (1.00, 1.03), highest respiratory rate 1.02 (1.00, 1.04), and RV/LV ratio 1.29 (1.14, 1.47). By logistic regression and random forest analyses, AUCs were 0.80 (0.73, 0.87) and 0.78 (0.70, 0.85), respectively.
Basal RV, RV/LV ratio, and RV systolic function measurements were significantly different between intermediate-risk PE patients grouped by subsequent clinical deterioration.
Acute pulmonary embolism (PE) can cause an abnormal right ventricle (RV) to develop, which may cause clinical deterioration. Because there are no consistent definitions or assessments of abnormal RV (abnlRV), reports on abnlRV associations with clinical outcomes and prognostic performance vary [1,2,3,4,5,6,7,8,9,10,11]. With PE-provoked disruptions, RV dilatation precedes abnormal RV systolic function. Serum cardiac biomarkers, such as brain natriuretic peptide (BNP) and troponin, are commonly used as surrogates of myocardial dilatation and injury; however, neither provides definitive evidence of acute RV dilatation or RV injury. Although chest computed tomography (CT) provides information on abnlRV, reports are mixed on its diagnostic and prognostic accuracy compared to transthoracic echocardiography (TTE) [2, 4, 10, 12,13,14,15]. Although TTE can qualitatively and quantitatively assess RV size and systolic function, there is no consensus on which of many different TTE metrics define the standard for establishing the presence of clinically impactful RV abnormality [1, 11]. In addition, it is unlikely the different laboratory and image assessments or definitions of RV abnormality can be used interchangeably.
Although the American Society of Echocardiography (ASE) provides guidelines for RV chamber size and systolic function measurements for adults without cardiac or pulmonary disease, there are no disease-specific reference ranges for RV to grade disease severity [16,17,18]. The heterogeneity of abnlRV definitions in PE may impact study inclusion criteria, decisions for escalated intervention, and the components of prognostic models [3, 5, 6, 19, 20]. Physicians using different risk stratification models for determining abnlRV may arrive at different disposition decisions, clinical management considerations, and intervention decisions on any given PE patient. Meta-analyses, systematic reviews, and expert panels have identified this heterogeneity to be a problem [1,2,3, 8, 11]. A report from a large multinational registry shows that TTE findings of RV hypokinesis, enlarged right atrium, and intracardiac thrombus (rare) were associated with increased risk for 30-day mortality, but RV size and pressure variables were not studied and TTE was performed within 3 days . RV size or systolic function is included as dichotomous predictors in some PE triaging strategies (e.g., Bova score and European Society of Cardiology guidelines); however, those strategies do not link the severity of RV abnormalities with their associated probability of immediate clinical deterioration [3, 10, 20, 22]. Early risk stratification remains important as the options for escalated PE intervention increase and definitions of therapeutic efficacy need clarification [5, 6, 9, 23,24,25,26].
Our primary goal was to identify TTE metrics that distinguish intermediate-risk PE patients at risk for clinical deterioration from those who do not experience death or clinical deterioration within 5 days. Our secondary goal was to compare the prognostic value of different TTE metrics with clinical predictors. Potential benefits of this pilot study include future development of prognostic models with a larger database of intermediate-risk PE patients to determine clinical usefulness.
Study design and setting
This was a prospective observational study within an integrated healthcare system that uses a multidisciplinary approach to the identification of intermediate- and high-risk PE patients, which triggers “Code PE” notifications to clinicians on duty. The research was approved by the institutional review board with a waiver of written informed consent. Study sites included eight Atrium Health emergency departments (EDs) in North Carolina (NC).
Selection of participants
We used a prospective cohort design to identify and study adult patients (≥ 18 years) presenting to a participating ED, who had: (1) acute symptomatic PE as the primary ED diagnosis (by positive CT, high-probability ventilation/perfusion nuclear imaging, or point-of-care TTE findings highly suspicious of PE [e.g., RV dilatation on point-of-care, DVT findings]), (2) intermediate-risk PE classification, and (3) comprehensive TTE with RV-focused measurements completed within 24 h of PE diagnosis. PE risk stratification was based on review of vital signs, CT findings, natriuretic peptide, troponin, and bedside TTE findings at presentation. Patients classified as intermediate-risk PE were normotensive, with suspected or confirmed RV abnormalities. RV abnormalities were defined by either RV/LV ratio ≥ 1.0 on CT, abnormal cardiac biomarkers (either troponin elevation or BNP > 90 pg/mL), or abnormal point-of-care TTE (visual assessment of RV dilatation with or without RV systolic dysfunction or septal flattening or leftward bowing) .
Patients were excluded from this study if any of the following were true: (1) PE was not the primary diagnosis, (2) PE diagnosis was made > 12 h after admission, (3) PE was treated with anticoagulation before ED presentation, (4) recurrent PE after previous enrollment, (5) chronic PE resolving or unchanged in comparison with previous CT if available, (6) presence of an unstable rhythm at presentation or between measurements, (7) ongoing resuscitation or escalated PE interventions before TTE measurements, and (8) limited or no RV-focused measurements performed.
To create a quasi-control group, we randomly selected 25 PE patients from a previously reported PE registry (clinicaltrials.gov NCT03915925) , who had comprehensive TTE performed at Atrium Health and were not classified as intermediate or high risk.
Research coordinators at the main study site [Atrium Health’s Carolinas Medical Center] maintained logs of CTs ordered to follow up on PE-positive results. In addition, electronic order entry power plans with orders for comprehensive TTE were initiated for patients categorized at presentation as intermediate- and high-risk PE.
Data collection and processing
We predefined variables during pre-enrollment meetings and specified locations of data within source documents in the EMR. In addition, our institutional informatics and analytics department provided reports on Code PE activations, including automated electronic medical record (EMR) data extraction for demographics and initial and worst vital signs within the first 3 h of ED stays. Examples include transient hypotension (systolic blood pressure < 90 mmHg for less than 15 min), highest heart rate (beats per minute), highest respiratory rate (breaths per minute), and lowest systolic blood pressure (mmHg) within 3 h of presentation. Lowest O2 saturation is the lowest oxygen saturation on room air oxygen within 3 h of initial vital signs. Manual data extraction from EMR was performed for PE risk factors, comorbidities, and clinical outcomes by trained study staff. Study data were entered into a standard electronic form managed within Research Electronic Data Capture (REDCap) tools hosted at Atrium Health’s Carolinas Medical Center (Charlotte, NC).
Laboratory cardiac biomarker testing was obtained for patients with dyspnea or chest pain as per usual medical care or upon confirmation of PE during ED evaluation. We used a troponin i-STAT cardiac troponin test cartridge (Abbott Point of Care, Abbott Park, IL) measured in ng/mL for troponin I or high-sensitivity troponin assay. We used the i-STAT BNP test cartridge (Abbott Point of Care, Abbott Park, IL) measured in pg/mL. We evaluated laboratory values in two ways: continuous and binary. For the binary evaluations, normal point-of-care BNP measurements were considered to be below 90 ng/mL. Normal values for troponin I were less than 0.07 ng/mL. Normal values for high-sensitivity troponin were less than 12 for females and less than 20 for males.
Cardiac sonographers, certified by the American Registry of Diagnostic Medical Sonographers, performed all comprehensive TTE within the institution's echocardiography laboratory accredited by Intersocietal Commission for the Accreditation of Echocardiography Laboratories. Trained sonographers followed a protocol and standards established and operationalized by the Code PE scientific advisory committee, cardiology leaders, and echocardiography managers of the participating hospitals [16, 27]. The RV-focused view was used to measure RV end-diastolic internal diameter at the base, mid-section, and at its major axis (RV base to apex or length). LV basal end-diastolic measurements were performed in the parasternal long axis. RV systolic function measurements of tricuspid annular plane systolic excursion (TAPSE) and RV annulus peak systolic velocity (S’) were performed using M mode at the RV free wall annulus and tissue Doppler of the basal segment, respectively. RV systolic pressure (RVSP) was determined by tricuspid regurgitation peak velocity using continuous Doppler. RV/LV basal diameter ratio (RV/LV) was calculated. TTE images were saved as digital files, wirelessly transmitted, and archived in the secure local server and portal system, Merge Cardio™ (IBM Watson Health). Staff cardiologists interpreted TTE images and measurements and were blind to the study and patient clinical outcomes.
The primary composite outcome consisted of death, circulatory or respiratory deterioration (including cardiac arrest, respiratory failure, new unstable dysrhythmia, sustained hypotension treated with either fluid or adrenergic agents), or escalated PE intervention within 5 days of PE diagnosis. The secondary outcome extended the time frame to 30 days after PE and included all components of the primary outcome in addition to major bleeding episodes, recurrence of venous thromboembolism (VTE), and subsequent hospitalization. Detailed definitions of our previously reported clinical deterioration events and secondary outcomes are available as an appendix accompanying the online article [15, 28].
Study staff monitored enrolled patients during the hospitalization for clinical deterioration endpoints described above. The clinical status of patients who were discharged directly from the ED (or early discharge from the hospital) were ascertained by review of EMR for subsequent hospitalizations for reasons explicitly documented as related to PE. Finally, we monitored for major bleeding within 5 and 30 days of hospital admission. We used the International Society on Thrombosis and Hemostasis definition of major bleeding, which is defined as symptomatic bleeding in a critical organ area, bleeding causing a decrease in hemoglobin level of greater than 2 g/dL, or fatal bleeding .
Primary data analysis
We used Peduzzi’s rule for logistic regression (outcome dichotomous yes/no) to justify our determination of the appropriate sample size . This rule states that the maximum number of independent variables is no more than N/10, where N is the number of observations (subjects) in the smaller of the two groups (outcome yes or outcome no). According to this formula, 120 subjects were needed in the smaller subgroup (clinical deterioration = yes): 120 subjects/10 = 12 variables. Based on prior studies at our institution, we conservatively estimated a 40% occurrence of the primary outcome in our subjects with intermediate-risk PE or worse. Thus, we selected a sample size of 260 to detect a correlation of 0.2 between any of the TTE metrics with an alpha 0.05 and power of 0.9. We aimed to enroll 300 patients to exceed the desired sample size and allow for missing data and loss to follow-up, while providing robust analyses for our two study objectives.
In addition to TTE metrics, we evaluated patient demographics, comorbidities, and standard clinical factors (e.g., blood pressure, body mass index) as predictors. For summary statistics, continuous variables were described by their means with standard deviations or medians with interquartile ranges. Categorical variables were summarized by frequency counts and percentages. We used Student’s t tests for continuous data and chi-square tests for categorical data for univariable tests of each variable by our primary and secondary endpoints. All statistical analyses were two-tailed and conducted at alpha level of 0.05.
To investigate the prognostic performance of TTE and laboratory measurements for clinical deterioration within days, we generated statistical inferences while assembling two tiers of prognostic models: (1) Youden’s index for optimal cutoff values, and (2) both logistic regression and random forest methods of prognostic model development.
As the first tier, for each continuous TTE variable and its respective univariable logistic regression model, we obtained an optimal cut-point for prognosis of 5-day clinical deterioration based on Youden’s index (maximizing sensitivity and specificity).
For the second tier, we used the process of prognostic model development and testing for clinical deterioration with multivariable logistic regression and random forest analyses. While the dataset available was not large enough for developing a prediction model ready for clinical use or implementation, we sought to assess the feasibility, performance, and utility such a model may provide in practice. We assessed two methods for prediction model development: logistic regression and random forest, using the “final” logistic model from the logistic regression analysis.
To assess associations between the clinical predictors and outcomes, we performed a series of logistic regression (LR) analyses. For both primary and secondary outcomes, we first fit an “abnlRV only” model with clinical deterioration as a function of only our defined abnlRV predictors of interest. Given issues with multicollinearity due to high correlation among several abnlRV variables, we developed a “reduced abnlRV” model from the full abnlRV model using backward selection based on Akaike’s information criterion (AIC). Next, we defined our “full” model to include the significant abnlRV predictors from the reduced abnlRV model and all significant clinical (non-abnlRV) predictors based on univariable associations. From our “full” model, we developed our final logistic model via backward selection based on AIC. Statistical significance was defined by p < 0.05.
First, we fit a random forest (RF) model using a full dataset (i.e., without splitting into test and training datasets) for both primary and secondary outcomes. We assessed variable importance plots based on mean decrease in accuracy to investigate the most important predictors of clinical deterioration and used “out-of-bag” prediction estimates to evaluate model fit in terms of F1 score, sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV).
RF out-of-bag estimates have been shown to demonstrate consistent and unbiased results of model performance, without the requirement of needing separate test and training datasets . This artifact of RFs is advantageous in our prediction model development given the limited dataset from which we were building. Next, we compared LR and RF prediction metrics. (Detailed methods are available in the Appendix accompanying the online article.)
We used RF imputation to impute missing values across all predictors, except for tricuspid regurgitation jet velocity and RVSP, which when attempted or performed were classified as derived variables for trace or undetectable measurements [32, 33]. We conducted a sensitivity analysis by comparing prediction models based on imputed datasets with those based on complete case datasets.
Characteristics of study subjects
Between March 2019 and March 2021, we screened 501 Code PE patients; 306 intermediate-risk patients met criteria for complete analysis as shown in Fig. 1, 303 (98%) of whom had CT with RV/LV ratios reported. Of the remaining 3 patients without CT, two (0.6%) had high-probability ventilation/perfusion mismatch findings, and two had RV dilatation by point-of-care TTE (one with coexisting lower extremity DVT and one patient had clot in transit on point-of-care TTE as the confirmatory study). All 306 PE patients had troponin measurements and 191 (62.4%) had troponin elevations. Of the 306, 293 patients (95.7%) had BNP measurements, 192 of whom (65.5%) had BNP elevation. Of the 303 with CT, 237 (78.2%) had CT with RV/LV ratio ≥ 1.0.
Additional file 2: Table S1 shows clinical characteristics of the 306 intermediate-risk patients at ED presentation (mean age 60.5 [SD 16.2] years; 50.3% female). Sixty-two percent of patients identified as Caucasian, while 36% identified as African-American. Approximately 20% of patients had oxygen saturations ≤ 92%; 77 patients (25.1%) had shock index ≥ 1.0 at presentation; and 28 (9.2%) had systolic blood pressure ≤ 90 mmHg within 3 h of initial presentation. Twenty-six of the 306 patients (8.5%) were considered to have active bleeding or high risk of bleeding, including high-risk postoperative state. Anticoagulation was administered to 294 (96.1%) of 306 patients during the ED course. Of the 294 receiving anticoagulation, 194 (66%) received low molecular weight heparin, 101 (34.4%) received unfractionated heparin, and 1 patient (0.3%) was given oral factor Xa inhibitor in the ED.
Of the intermediate-risk PE patients without anticoagulation initiated within the ED course, seven were transported to inpatient units and received early thrombolysis, and one had anticoagulation delayed until head CT was completed before thrombolysis was administered. Two of the acute PE patients had active bleeding while already on anticoagulation (with therapeutic levels). The proportion with CT RV/LV ratio ≥ 1.0 was not significant between outcome groups.
Table 1 and Additional file 3: Table S2 show assessed RV variables overall and as stratified by primary outcome and secondary outcomes, respectively. Within 5 days, 115 (37.6%) patients experienced one or more clinical deterioration events or required an emergent in-hospital intervention. There were 3 (1.0%) deaths; 66 patients (21.6%) had one or more escalated PE interventions; 43 (14.1%) had symptomatic sustained hypotension addressed with intravenous fluid boluses; 31 (10.1%) had respiratory failure; 31 (10.1%) had new dysrhythmia requiring treatment; 20 (6.5%) had sustained hypotension treated with adrenergic agents; and 12 patients (3.3%) had cardiac arrest. There were no clinical deterioration events among the quasi-control group.
As shown in Table 1, intermediate-risk PE patients with clinical deterioration within 5 days had greater RV dilatation and worse systolic function than those without clinical deterioration as indicated by the following: RV basal diameter 4.46 ± 0.77 versus 4.20 ± 0.77 cm; RV/LV basal width ratio 1.14 ± 0.29 versus 1.02 ± 0.24; TAPSE 1.56 ± 0.55 versus 1.80 ± 0.52 cm; and RV systolic excursion velocity 10.4 ± 3.58 versus 12.1 ± 12.5 cm/s, respectively. In comparison with the intermediate-risk group, the quasi-control group of PE patients had less RV dilatation and better systolic function (mean RV basal diameter 3.8 ± 0.7 cm, RV/LV ratio 0.84 ± 0.12, TAPSE 2.06 ± 0.49 cm, systolic excursion velocity 14.0 ± 3.04 cm/s); their values were close to or within the normal range of values published by the ASE [11, 16,17,18, 34,35,36].
To address a trade-off of false positives and false negatives, we used Youden’s index to determine the optimal thresholds for predicting clinical deterioration. Optimal thresholds were: RV basal width 3.9 cm (OR 2.85 [1.64, 4.97]), RV-to-left ventricle (RV/LV) ratio 1.08 (OR 3.32 [2.07, 5.33]), TAPSE 1.98 cm (OR 3.3 [2.06, 5.3]), systolic excursion velocity 10.10 cm/s (OR 2.85 [1.75, 4.63]), and natriuretic peptide 190 pg/mL (OR 2.89 [1.81, 4.62]). However, the corresponding receiver operating characteristic (ROC) curves and AUC shown in Fig. 2 and Table 2 are modest. For example, based on our data, a TAPSE < 1.83 cm results in the optimal threshold for predicting higher risk of clinical deterioration based on TAPSE alone, such that patients with TAPSE < 1.83 had 3.35 times greater odds of clinical deterioration than those with TAPSE ≥ 1.83 cm. Using this threshold for prediction of clinical deterioration results in 57% sensitivity, 71% specificity, 52% PPV, and 76% NPV. Similar values for the other variables are given in Table 2.
Table 3 shows significant differences in TTE measurements between those with (N = 66) and without (N = 240) reperfusion interventions within 5 days. At baseline, the group receiving reperfusion interventions had larger RV size (RV basal diastolic width 4.53 [0.807] versus 4.24 [0.757] cm and RV/LV ratio 1.16 [0.30] versus 1.04 [0.26]), lower TAPSE (1.52 [0.41] versus 1.76 [0.56] cm), and a greater proportion with higher RV pressure and troponin elevation than those without reperfusion interventions.
The significant abnlRV variables from the best fitting abnlRV model were troponin, BNP, tricuspid regurgitant peak velocity, RV/LV basal width ratio, and TAPSE. These abnlRV variables were included with all other patient factors, from which we developed our final, best fitting logistic regression model through backward selection as described in the Methods section. Table 4 shows the estimated odds ratios, 95% confidence intervals, and p values for our best fitting logistic regression model for 5-day clinical deterioration. Significant independent predictors were: transient hypotension 6.1 (2.2, 18.9), highest heart rate within the initial 3 h 1.02 (1.00, 1.03), highest respiratory rate within initial 3 h 1.02 (1.00, 1.04), and RV/LV ratio 1.29 (1.14, 1.47). [Given an OR of 1.02, a patient whose maximum heart rate was 121 beats per minute (bpm) had a 2% greater odds of clinical deterioration than a patient whose maximum heart rate was 120 bpm. For initial O2 saturation, we observed a significant OR of 0.94. Patients with lower O2 had higher odds of clinical deterioration. For every percentage point decrease in maximum O2 within 3 h, a patient's odds of clinical deterioration increased by 6%.]
Among the abnlRV variables, BNP (p = 0.008) and RV/LV basal width ratio (p < 0.001) were statistically significantly related to increased odds of clinical deterioration, while tricuspid regurgitant peak velocity was marginally significant (p = 0.062). TAPSE and elevated troponin were not independent predictors and were dropped from the model. Additional files 4 and 5: Tables S3 and S4 show reduced and full LR models for 30-day outcomes, respectively.
Random forest analysis
We used out-of-bag error rates to estimate performance metrics and fit an RF prediction model for 5-day clinical deterioration (a binary outcome) and 30-day clinical deterioration. For both outcomes, we found multiple TTE metrics among the top 20 predictors (Fig. 3, Additional file 7: Fig. S1). Each of the selected components of our final LR model in the previous section was within the top 20 predictors in the RF model.
We achieved relatively good prediction metrics for both 5-day and 30-day clinical deterioration with correct prediction of 69% of clinical deterioration cases and 74% of non-clinical deterioration cases. Combined, this translates to a PPV of 59% and NPV of 82%. Comparing 5-day with 30-day prediction performance, there was similar sensitivity; however, the 5-day clinical deterioration model had slightly higher specificity and NPV, while the 30-day clinical deterioration predictive model had slightly higher PPV.
The full RF model performance metrics included AUC 0.78 (0.73, 0.83) for 5-day outcomes (Table 5). Calibration was not estimated from the full dataset RF models due to the inability to calculate predicted probabilities from out-of-bag estimates.
LR versus RF
In over 500 random data splits comparing LR and RF prediction models, both models performed about equally well in the test datasets. The mean AUC for prediction in the test dataset was 0.80 (95% confidence interval 0.73–0.87) and 0.78 (95% confidence interval 0.70–0.85) for the LR and RF models, respectively (Additional files 6: Table S5). Delong’s significance test of AUCs between the two models was not statistically significant for any of the 500 random test–validation data splits (mean p value = 0.66) . Assuming classification thresholds of 0.50 for both models, the RF model was more sensitive on average (73% vs. 54%), with the trade-off of reduced specificity (69% vs. 87%). Similarly, the RF model demonstrated lower PPV (56% vs. 70%) and slightly higher NPV (83% vs. 78%) compared with the LR model. Given the clinical implications and negative consequences for failing to capture true cases of clinical deterioration, we investigated varying classification thresholds for predicting clinical deterioration. Thus, it may be beneficial to sacrifice specificity for better sensitivity. Investigating the prediction metrics in this context, we find that to achieve sensitivity of > 90%, we can use a classification threshold of 30%. Doing so yields a sensitivity of 91.6%, specificity of 45.1%, PPV of 42.2%, and NPV of 92.4%.
This prospective study investigated the ability to stratify several common TTE metrics in intermediate-risk PE patients by associating them with clinical deterioration or subsequent use of escalated PE interventions. In line with our primary goal, univariable analyses showed that intermediate-risk PE patients experiencing subsequent clinical deterioration had significantly greater RV chamber size and lower systolic function measurements compared to those not experiencing clinical deterioration. Overall, TTE metrics of RV dilatation and systolic dysfunction were worse in our intermediate-risk PE patients than in the quasi-control group. In turn, TTE metrics of the intermediate-risk group were outside the normal range of values published by the ASE, whereas those of the quasi-control group were close to or within the normal range [11, 16,17,18, 34,35,36]. Patients receiving reperfusion interventions had significantly larger RV diameter and lower (worse) RV systolic function metrics than patients not receiving reperfusion interventions.
Our secondary goal involved using multivariable analyses to compare the prognostic performance of TTE metrics with clinical predictors. We discovered clinical predictors (transient hypotension and highest heart rate and respiratory rate within 3 h) ranked higher as independent predictors than RV/LV ratio. Predicting clinical deterioration (risk stratification) remains important in this challenging group of PE patients because there are now more options for escalated PE intervention (other than full-dose thrombolysis) that do not compromise therapeutic efficacy or safety outcomes. The clinical implication is that more stringent risk classifications of severity of RV dilation and systolic function using TTE metrics are possible and may identify intermediate-risk PE patients at increased risk for clinical deterioration, who would benefit from increased consideration for escalated PE interventions.
We compared our findings with previous related reports. After using Youden’s index to acknowledge the trade-off of false positives and false negatives for subsequent clinical deterioration, we noted that our optimal thresholds for RV basal diameter (3.9 cm) and RV/LV ratio (1.02) were higher than thresholds used by Bova et al. to define abnormal RV in the Bova score (TTE RV/LV ratio > 0.9, RV diastolic diameter > 3.0 cm, RV dilatation, pressure > 30 mmHg) . Compared to the report by Zanobetti et al. on TTE metrics in 120 consecutive PE patients at ED presentation , TTE metrics in our intermediate-risk PE patients had greater RV basal diameter (4.30 vs. 3.6 cm) and RV/LV ratio (1.07 vs. 0.75) and lower LV basal diameter (4.15 vs. 4.9 cm). For RV systolic function, previous reports found that TAPSE greater than 1.8–2.0 cm was associated with very low risk of deterioration or death, whereas TAPSE less than 1.5–1.6 cm was associated with 30-day mortality or need for escalated thrombolysis [39,40,41]. Our optimal cutoff for TAPSE (1.98 cm) was within the upper cutoff of normal ranges in previous reports focused on PE-related death at 30 days [40,41,42,43]. However, our study’s mean TAPSE measurement was less than 1.6 cm for those experiencing one or more clinical deterioration endpoints within 5 days and even worse (1.52 cm) for those with reperfusion interventions.
We observed increased RV/LV ratio and decreased LV basal diameter in our intermediate-risk PE cohort compared to the normal reference range, and significant measurement differences between those with clinical deterioration and those without [16, 17]. Decreased RV systolic function represents a more advanced pathophysiological stage of PE than having RV dilatation alone. RV dilatation and RV systolic dysfunction were determined to be distinct variables of importance.
Our report addresses recently identified high priority knowledge gaps and research opportunities by the 2018 American Thoracic Society Research Statement . Few studies on acute pulmonary hypertension syndromes systematically compare TTE metrics to inform our decisions on prognosis or therapeutic efficacy . Reports use TTE metrics for study inclusion, prognosis, and therapeutic efficacy, but criteria and definitions vary, at times with discordance [1,2,3,4,5,6, 9, 11, 23]. In some, the definitions involve qualitative assessments or unstated definitions of RV dilatation or abnormal RV systolic function [6, 19, 20, 44]. In many of the composite abnlRV studies, there was no rationale for the choice of metrics . In some studies, there was discordance between TTE metrics . Khemasuwan et al. studied the association of a wide array of TTE metrics with clinical outcomes in 211 critically ill PE patients in the intensive care unit and found RV/LV ratio, RVSP, and TAPSE were independently associated with hospital mortality . In our study, RV/LV ratio and TAPSE were also found to be associated with clinical deterioration events within 5 days, but RVSP was not (p = 0.74). The implications for clinical research include recommendation that TTE metrics of RV size and systolic function should not be used interchangeably to define abnlRV either as inclusion criteria or as efficacy endpoints.
A report from the Pulmonary Embolism Response Team Consortium registry used four previously validated PE risk tools for 7-day mortality and generated modest AUCs between 0.62 and 0.67 . For our study’s multivariable analyses, RF and LR prognostic models for 5-day clinical deterioration had similar mean AUC (0.78 and 0.80, respectively), which were not statistically different from Delong's test (p > 0.5) . We recognize that eventual implementation of a clinically useful prognostic model will require more training data with independent validation sets. Our study method capitalized on the process of developing a prognostic model by contemporaneously stratifying TTE metrics and important clinical variables that determined statistical association with clinical outcomes of interest. Nevertheless, our results demonstrate that an accurate prediction model for predicting clinical deterioration is feasible and may provide clinically helpful patient care information. When applied to intermediate-risk PE, our results provided good evidence to support the continuation of this research using a larger dataset to develop a “final'' prediction model for clinical use in practice. The similar predictive performance between LR and RF is noteworthy because an equally accurate LR model would be more easily implemented in clinical practice than a machine learning RF model . However, the prediction metrics of the RF model using the full dataset showed better performance than the average fit statistics of the LR model across 500 data splits.
The baseline model we have described uses a classification threshold of 0.5. (Predicted probability > 0.5 results in positive prediction.) False negatives may be costly and risky. Adjusting the “classification threshold” effectively allows one to tune the prediction model developed to a desired level of sensitivity and address overtriage and undertriage targets for clinical practice.
One of the strengths of our study is that we analyzed TTE metrics stratified by clinical outcomes. Our findings may be helpful in classifying the degree of abnormality (e.g., mild, moderate, severe) for measurements outside the normal range. These PE-focused TTE metrics can be obtained at bedside by emergency medicine or critical care physicians and may be considered (in combination with vital sign abnormalities, comorbidities, and elevated cardiac biomarkers) to further risk-stratify intermediate-risk PE and predict probability of subsequent clinical deterioration. Furthermore, these values may aid decision-making regarding preferred level of inpatient monitoring and considerations for emergent reperfusion if risk of clinical deterioration is felt to be high. Ultimately, more data are needed to further delineate acceptable cutoffs for these metrics in predicting deterioration.
Our study had several limitations, including the sample size, demographic limitations of a regional study, and unchallenged generalizability based on practice variation between physicians and facilities, the latter of which affected the decision to perform a reperfusion intervention (one component of our composite primary outcome). We predefined clinical deterioration endpoints to minimize variation in interpretation. We defined the endpoint of respiratory failure as the use of high-flow nasal cannula, bilevel positive airway pressure, or intubation, which would have the least disagreements among abstractors. It is also worth noting that not all TTE metrics were recorded for every enrolled patient. The LR odds ratio and coefficient results for RVSP go against conventional wisdom and experience. It is plausible that RV pressure does not linearly increase as PE severity worsens or that RVSP may have complex interactions with the onset, or progressive worsening, of RV systolic dysfunction. PE patients with missing values (not performed, technically difficult, or not possible) may have had qualitatively enlarged RV measurements that were clinically significant.
One of the independent predictors of clinical deterioration was not having initial anticoagulation administered in the ED. This was a statistical association without a causative association. The involved patients in our database were adequately treated. In these cases, the explanation for increased risk for primary outcome was not inadequate PE treatment. The lack of anticoagulation in the ED was due to recognition of the PE in the unique individual patients as being complex and high acuity. Those cases involved early decisions for escalated PE interventions or restraint due to concurrent bleeding or preexisting anticoagulation.
It is plausible that TTE cardiac output metrics, which we did not study, may have greater prognostic value and relevance than RV measurements for subsequent hemodynamic deterioration . In addition, although we reported on single early TTE metrics, the direction and magnitude of acute changes may be important predictors of clinical deterioration [5, 7, 9, 23].
In conclusion, intermediate-risk PE patients with 5-day clinical deterioration had significantly increased BNP and troponin, increased RV/LV ratio and RV basal diameter, and decreased LV basal diameter and RV systolic function (TAPSE and S’) measurements. TTE metrics were important in the RF prediction model, and the LR model had good prognostic performance. Although further work is needed to better understand the relationships between these variables and their independent prognostic ability, our results suggest that variables we identified (e.g., TAPSE, RV/LV basal width ratio, BNP) may provide simple, but useful criteria for assessing patient risk of 5-day clinical deterioration in intermediate-risk PE patients. Further development on a larger database and subsequent validation will allow optimization of lower and higher risk classification thresholds for prognostic modeling in intermediate-risk PE patients.
Availability of data and materials
The datasets used or analyzed during the current study are available from the corresponding author on reasonable request.
Apical 4-chamber window
Abnormal right ventricle features
Akaike’s information criterion
American Society of Echocardiography
Area under the curve
Body mass index
Brain natriuretic peptide
Deep venous thrombosis
Electronic medical record
Negative predictive value
Positive predictive value
Receiver operating characteristic
Right ventricle-to-left ventricle basal diameter ratio
Right ventricle systolic pressure
Right ventricle free wall systolic excursion velocity
Tricuspid annular planar systolic excursion
Cho JH, Kutti Sridharan G, Kim SH, Kaw R, Abburi T, Irfan A, et al. Right ventricular dysfunction as an echocardiographic prognostic factor in hemodynamically stable patients with acute pulmonary embolism: a meta-analysis. BMC Cardiovasc Disord. 2014;14:64.
Sanchez O, Trinquart L, Colombet I, Durieux P, Huisman MV, Chatellier G, et al. Prognostic value of right ventricular dysfunction in patients with haemodynamically stable pulmonary embolism: a systematic review. Eur Heart J. 2008;29(12):1569–77.
Elias A, Mallett S, Daoud-Elias M, Poggi J-N, Clarke M. Prognostic models in acute pulmonary embolism: a systematic review and meta-analysis. BMJ Open. 2016;6(4): e010324.
Coutance G, Cauderlier E, Ehtisham J, Hamon M, Hamon M. The prognostic value of markers of right ventricular dysfunction in pulmonary embolism: a meta-analysis. Crit Care. 2011;15(2):R103.
Wang C, Zhai Z, Yang Y, Wu Q, Cheng Z, Liang L, et al. Efficacy and safety of low dose recombinant tissue-type plasminogen activator for the treatment of acute pulmonary thromboembolism: a randomized, multicenter, controlled trial. Chest. 2010;137(2):254–62.
Sharifi M, Bay C, Skrocki L, Rahimi F, Mehdipour M. Moderate pulmonary embolism treated with thrombolysis (from the “MOPETT” Trial). Am J Cardiol. 2013;111(2):273–7.
Sharifi M, Vajo Z, Freeman W, Bay C, Sharifi M, Schwartz F. Transforming and simplifying the treatment of pulmonary embolism: “Safe Dose” thrombolysis plus new oral anticoagulants. Lung. 2015;193(3):369–74.
Lahm T, Douglas IS, Archer SL, Bogaard HJ, Chesler NC, Haddad F, et al. Assessment of right ventricular function in the research setting: knowledge gaps and pathways forward. An Official American Thoracic Society Research Statement. Am J Respir Crit Care Med. 2018;198(4):e15-43.
Kucher N, Boekstegers P, Muller OJ, Kupatt C, Beyer-Westendorf J, Heitzer T, et al. Randomized, controlled trial of ultrasound-assisted catheter-directed thrombolysis for acute intermediate-risk pulmonary embolism. Circulation. 2014;129(4):479–86.
Konstantinides S, Meyer G, Becattini C. 2019 ESC Guidelines for the diagnosis and management of acute pulmonary embolism developed in collaboration with the European Respiratory Society (ERS). Eur Heart J [Internet] 2020; Available from: https://researchportal.helsinki.fi/en/publications/2019-esc-guidelines-for-the-dignosis-and-management-of-acute-pulm
Huang SJ, Nalos M, Smith L, Rajamani A, McLean AS. The use of echocardiographic indices in defining and assessing right ventricular systolic function in critical care research. Intensive Care Med. 2018. https://doi.org/10.1007/s00134-018-5211-z.
Wake N, Kumamaru KK, George E, Bedayat A, Ghosh N, Quesada CG, et al. Computed tomography and echocardiography in patients with acute pulmonary embolism. J Thorac Imaging. 2014;29:W1-6. https://doi.org/10.1097/rti.0000000000000047.
Dudzinski DM, Hariharan P, Parry BA, Chang Y, Kabrhel C. Assessment of right ventricular strain by computed tomography versus echocardiography in acute pulmonary embolism. Acad Emerg Med. 2017;24(3):337–43.
Weekes AJ, Thacker G, Troha D, Johnson AK, Chanler-Berat J, Norton HJ, et al. Diagnostic accuracy of right ventricular dysfunction markers in normotensive emergency department patients with acute pulmonary embolism. Ann Emerg Med. 2016. https://doi.org/10.1016/j.annemergmed.2016.01.027.
Weekes AJ, Raper JD, Lupez K, Thomas AM, Cox CA, Esener D, et al. Development and validation of a prognostic tool: pulmonary embolism short-term clinical outcomes risk estimation (PE-SCORE). PLoS ONE. 2021;16(11): e0260036.
Lang RM, Badano LP, Mor-Avi V, Afilalo J, Armstrong A, Ernande L, et al. Recommendations for cardiac chamber quantification by echocardiography in adults: an update from the American Society of Echocardiography and the European Association of Cardiovascular Imaging. J Am Soc Echocardiogr. 2015;28(1):1-39.e14.
Addetia K, Miyoshi T, Citro R, Daimon M, Fajardo PG, Kasliwal RR, et al. Two-dimensional echocardiographic right ventricular size and systolic function measurements stratified by sex, age, and ethnicity: results of the World Alliance of Societies of Echocardiography Study. J Am Soc Echocardiogr. 2021. https://doi.org/10.1016/j.echo.2021.06.013.
Rudski LG, Lai WW, Afilalo J, Hua L, Handschumacher MD, Chandrasekaran K, et al. Guidelines for the echocardiographic assessment of the right heart in adults: a report from the American Society of Echocardiography endorsed by the European Association of Echocardiography, a registered branch of the European Society of Cardiology, and the Canadian Society of Echocardiography. J Am Soc Echocardiogr. 2010;23(7):685–713 (quiz 786–8).
Jiménez D, Kopecna D, Tapson V, Briese B, Schreiber D, Lobo JL, et al. Derivation and validation of multimarker prognostication for normotensive patients with acute symptomatic pulmonary embolism. Am J Respir Crit Care Med. 2014;189(6):718–26.
Bova C, Sanchez O, Prandoni P, Lankeit M, Konstantinides S, Vanni S, et al. Identification of intermediate-risk patients with acute symptomatic pulmonary embolism. Eur Respir J. 2014;44(3):694–703.
Bikdeli B, Lobo JL, Jiménez D, Green P, Fernández-Capitán C, Bura-Riviere A, et al. Early use of echocardiography in patients with acute pulmonary embolism: findings from the RIETE registry. J Am Heart Assoc. 2018. https://doi.org/10.1161/jaha.118.009042.
Bova C, Pesavento R, Marchiori A, Palla A, Enea I, Pengo V, et al. Risk stratification and outcomes in hemodynamically stable patients with acute pulmonary embolism: a prospective, multicentre, cohort study with three months of follow-up. J Thromb Haemost. 2009;7(6):938–44.
Tapson VF, Sterling K, Jones N, Elder M, Tripathy U, Brower J, et al. A randomized trial of the optimum duration of acoustic pulse thrombolysis procedure in acute intermediate-risk pulmonary embolism: the OPTALYSE PE trial. JACC Cardiovasc Interv. 2018;11(14):1401–10.
Sharifi M, Bay C, Schwartz F, Skrocki L. Safe-dose thrombolysis plus rivaroxaban for moderate and severe pulmonary embolism: drip, drug, and discharge. Clin Cardiol. 2014;37(2):78–82.
Liu Y, Lu Y, Song J, Li D, Liu H, Yang J, et al. Recombinant tissue plasminogen activator for hemodynamically stable patients experiencing an acute pulmonary embolism: a meta-analysis. Thromb Res. 2014;134(1):50–6.
Kline JA, Puskarich MA, Jones AE, Mastouri RA, Hall CL, Perkins A, et al. Inhaled nitric oxide to treat intermediate risk pulmonary embolism: A multicenter randomized controlled trial. Nitric Oxide. 2019;84:60–8.
Genovese D, Mor-Avi V, Palermo C, Muraru D, Volpato V, Kruse E, et al. Comparison between four-chamber and right ventricular-focused views for the quantitative evaluation of right ventricular size and function. J Am Soc Echocardiogr. 2019;32(4):484–94.
Weekes AJ, Johnson AK, Troha D, Thacker G, Chanler-Berat J, Runyon M. Prognostic value of right ventricular dysfunction markers for serious adverse events in acute normotensive pulmonary embolism. J Emerg Med. 2017;52(2):137–50.
Schulman S, Kearon C, Subcommittee on Control of Anticoagulation of the Scientific and Standardization Committee of the International Society on Thrombosis and Haemostasis. Definition of major bleeding in clinical investigations of antihemostatic medicinal products in non-surgical patients. J Thromb Haemost. 2005;3(4):692–4.
Peduzzi P, Concato J, Kemper E, Holford TR, Feinstein AR. A simulation study of the number of events per variable in logistic regression analysis. J Clin Epidemiol. 1996;49(12):1373–9.
Breiman L. Mach Learn. 2001;45:5–32. https://doi.org/10.1023/a:1010933404324.
Stekhoven DJ. missForest: Nonparametric missing value imputation using random forest [Internet]. Astrophysics Source Code Library. 2015. p. ascl:1505.011. Available from: https://ui.adsabs.harvard.edu/abs/2015ascl.soft05011S
Stekhoven DJ, Buhlmann P. MissForest-non-parametric missing value imputation for mixed-type data. Bioinformatics. 2012;28:112–8. https://doi.org/10.1093/bioinformatics/btr597.
Ghio S, Klersy C, Magrini G, D’Armini AM, Scelsi L, Raineri C, et al. Prognostic relevance of the echocardiographic assessment of right ventricular function in patients with idiopathic pulmonary arterial hypertension. Int J Cardiol. 2010;140(3):272–8.
Daquarti G, March Vecchio N, Mitrione CS, Furmento J, Ametrano MC, Dominguez Pace MP, et al. High-sensitivity troponin and right ventricular function in acute pulmonary embolism. Am J Emerg Med. 2016;34(8):1579–82.
Alerhand S, Hickey SM. Tricuspid Annular Plane Systolic Excursion (TAPSE) for risk stratification and prognostication of patients with pulmonary embolism. J Emerg Med. 2020;58(3):449–56.
DeLong ER, DeLong DM, Clarke-Pearson DL. Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics. 1988;44(3):837–45.
Zanobetti M, Converti C, Conti A, Viviani G, Guerrini E, Boni V, et al. Prognostic value of emergency physician performed echocardiography in patients with acute pulmonary thromboembolism. West J Emerg Med. 2013;14:509–17. https://doi.org/10.5811/westjem.2013.4.12690.
Pruszczyk P, Goliszek S, Lichodziejewska B, Kostrubiec M, Ciurzynski M, Kurnicka K, et al. Prognostic value of echocardiography in normotensive patients with acute pulmonary embolism. JACC Cardiovasc Imaging. 2014;7(6):553–60.
Paczyńska M, Sobieraj P, Burzyński Ł, Kostrubiec M, Wiśniewska M, Bienias P, et al. Tricuspid annulus plane systolic excursion (TAPSE) has superior predictive value compared to right ventricular to left ventricular ratio in normotensive patients with acute pulmonary embolism. Arch Med Sci. 2016;12(5):1008–14.
Lobo JL, Holley A, Tapson V, Moores L, Oribe M, Barrón M, et al. Prognostic significance of tricuspid annular displacement in normotensive patients with acute symptomatic pulmonary embolism. J Thromb Haemost. 2014;12(7):1020–7.
Larrauri AG, Lobo JL, Alonso A, Parraza N, Morillo R, Barrios D, et al. TAPSE associated to RV/LV index in patients with moderate-high risk pulmonary embolism. Eur Respir J. 2016. 48(suppl 60). https://erj.ersjournals.com/content/48/suppl_60/PA2454.abstract
Schmid E, Hilberath JN, Blumenstock G, Shekar PS, Kling S, Shernan SK, et al. Tricuspid annular plane systolic excursion (TAPSE) predicts poor outcome in patients undergoing acute pulmonary embolectomy. Heart Lung Vessel. 2015;7(2):151–8.
Barco S, Mahmoudpour SH, Planquette B, Sanchez O, Konstantinides SV, Meyer G. Prognostic value of right ventricular dysfunction or elevated cardiac biomarkers in patients with low-risk pulmonary embolism: a systematic review and meta-analysis. Eur Heart J. 2019;40(11):902–10.
Khemasuwan D, Yingchoncharoen T, Tunsupon P, Kusunose K, Moghekar A, Klein A, et al. Right Ventricular Echocardiographic Parameters Are Associated with Mortality after Acute Pulmonary Embolism. J Am Soc Echocardiogr [Internet]. 2015; Available from: http://www.onlinejase.com/article/S0894-7317(14)00856-6/pdf
Barnes GD, Muzikansky A, Cameron S, Giri J, Heresi GA, Jaber W, et al. Comparison of 4 acute pulmonary embolism mortality risk scores in patients evaluated by pulmonary embolism response teams. JAMA Netw Open. 2020;3(8): e2010779.
Taylor RA, Haimovich AD. Machine learning in emergency medicine: keys to future success. Acad Emerg Med. 2021;28(2):263–7.
Prosperi-Porta G, Solverson K, Fine N, Humphreys CJ, Ferland A, Weatherald J. Echocardiography-derived stroke volume index is associated with adverse in-hospital outcomes in intermediate-risk acute pulmonary embolism: a retrospective cohort study. Chest. 2020;158(3):1132–42.
The authors would like to thank Daniel R. Troha MD (director of CODE PE program) and Thomas V. Johnson, MD (former Director of Echocardiography for Sanger Heart and Vascular Institute) for initial administrative support, and Scott Lurie and Judith Keller (Atrium Health Information and Analytic Services) for assistance with data acquisition.
Ethics approval and consent to participate
This research was approved by the Atrium Health Institutional Review Board with a waiver of written informed consent.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Additional file 1: Methods supplement.
Definitions of outcomes; Statistical methods. Logistic regression model training and validation and comparison of models.
Additional file 2: Table S1.
Summary statistics and univariable analyses for all predictor variables.
Additional file 3: Table S2.
Echocardiography metrics by secondary outcome.
Additional file 4: Table S3.
Reduced right ventricle assessment logistic regression model for 30-day clinical deterioration.
Additional file 5: Table S4.
Final logistic model for 30-day clinical deterioration.
Additional file 6: Table S5.
Comparison of random forest and logistic regression on 5-day clinical deterioration over 500 random test-validation data splits (mean metrics with 95% coverage intervals*)**.
Additional file 7: Fig. S1.
Variable importance plot for random forest prognostic model for the secondary outcome. Abbreviations: A4 = apical 4-chamber window, BMI = body mass index, BP = blood pressure, CT = computed tomography, HR = heart rate, LV = left ventricle, Min = minimum, Max = maximum, RR = respiratory rate, RV = right ventricle, RVD = right ventricle abnormality, RVSP cat = right ventricle systolic pressure category, SD = standard deviation, TAPSE = tricuspid annular planar systolic excursion.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Weekes, A.J., Fraga, D.N., Belyshev, V. et al. Intermediate-risk pulmonary embolism: echocardiography predictors of clinical deterioration. Crit Care 26, 160 (2022). https://doi.org/10.1186/s13054-022-04030-z
- Pulmonary embolism
- Right ventricle
- Risk stratification