Thoracic ultrasonography versus chest radiography for detection of pneumothoraces: challenges in deriving and interpreting summary diagnostic accuracy estimates
Critical Care volume 18, Article number: 416 (2014)
Alrajab and colleagues recently conducted a meta-analysis examining the diagnostic accuracy of thoracic ultrasonography (US) or chest radiography (CXR) versus a reference standard of thoracic computed tomography for detection of pneumothoraces . They reported that while the pooled specificity of US (98%) was similar to CXR (99%), the pooled sensitivity (79%) was substantially higher (40%) . They also found that, although US performance was inferior when conducted on trauma or nonconsecutively sampled patients, it improved when performed by emergency physicians or using a linear probe . We highlight two important issues exemplified.
First, when inter-study threshold variation exists, two novel meta-analytic methods are available that consider the correlation between sensitivity and specificity across studies . Interestingly, using one of these methods (bivariate random-effects models ) instead of the classical approach utilized by Alrajab and colleagues  may affect some of the inferences drawn from their results. In support of this, only patient type (trauma versus nontrauma), and not whether the study was performed by emergency physicians, on consecutively sampled patients, or using a linear probe, was significantly associated with differences in US performance in univariate meta-regression using bivariate random-effects models (Table 1).
Second, as most patients included in the meta-analysis by Alrajab and colleagues were supine trauma patients , the majority of pneumothoraces missed by CXR may have been occult. Occult pneumothoraces are those not seen on initial supine anteroposterior CXR that are subsequently identified on computed tomography . Occult pneumothoraces are associated with a different clinical course and frequently may not require pleural drainage . As tube thoracostomy is not a benign procedure , the immediate adoption of US for pneumothorax diagnosis based on the findings of existing diagnostic accuracy meta-analyses, followed by more widespread treatment of occult pneumothoraces, may result in unintended harm. Thus, further research is required to demonstrate that US can differentiate between occult and overt pneumothoraces and provide a net patient benefit before contemplating replacement of CXR with US.
Saadah Alrajab, Gloria Caldito and Asser M Youssef
We thank Dr Roberts and his colleagues for their interest in our meta-analysis . With regards to the heterogeneity found in our analysis after data synthesis, Borenstein and colleagues  suggested the performance of meta-regression or subgroup analysis to explain heterogeneity between studies. We utilized both methods. In our supplemental files we provided tables for meta-regression, finding that some factors mentioned were significant, specifically trauma versus nontrauma studies and consecutive versus convenience sampling (eTable3 in ). However, in subgroup analyses of all subgroups mentioned (emergency physician-performed US, consecutively sampled patients, and using a linear probe), the confidence intervals were significant. In comparison with the previous meta-analyses (which also used similar regression methods), our analysis included more studies, standardized testing on all patients, minimized bias, and provided better explanation to the heterogeneity.
The issue of supine CXR in majority trauma patients was addressed in detail in the discussion section of our paper . We agree that the adoption of US over CXR without taking into consideration the volume of pneumothorax and the patients’ clinical status is wrong and may lead to unnecessary and possibly harmful interventions. US can be used instead of CXR to identify the size of incomplete pneumothorax if the clinician can identify the lung point in a supine position [7, 8]. We suggested further research applied to different clinical settings to evaluate the downstream effects (subsequent tests, procedures, patient outcome and condition-related cost of care) of two testing strategies – one that utilizes US and another for CXR.
Based on current evidence, we believe that US can safely replace CXR in certain clinical circumstances as an initial step to evaluate pneumothorax with a potential for cost saving and reduction in radiation exposure – specifically, when the question is the presence or absence of pneumothorax and no additional information is sought from CXR. An example is a negative US for pneumothorax after post-transbronchial or post-transthoracic lung biopsy eliminates the need for CXR.
DJR is a Surgery and Clinician Investigator Program Resident who is presently conducting a Doctor of Philosophy (Epidemiology) degree with a thesis on trauma damage control surgery at the University of Calgary. DJN and MTJ are academic critical care/nephrology physicians while CGB and AWK are academic trauma/acute care/hepatopancreaticobilary and trauma/acute care surgeons at the University of Calgary.
Alrajab S, Youssef A, Akkus N, Caldito G: Pleural ultrasonography versus chest radiography for the diagnosis of pneumothorax: review of the literature and meta-analysis. Crit Care 2013, 17: R208. 10.1186/cc13016
Leeflang MM, Deeks JJ, Gatsonis C, Bossuyt PM, Cochrane Diagnostic Test Accuracy Working Group: Systematic reviews of diagnostic test accuracy. Ann Intern Med 2008, 149: 889-897. 10.7326/0003-4819-149-12-200812160-00008
Reitsma JB, Glas AS, Rutjes AW, Scholten RJ, Bossuyt PM, Zwinderman AH: Bivariate analysis of sensitivity and specificity produces informative summary measures in diagnostic reviews. J Clin Epidemiol 2005, 58: 982-990. 10.1016/j.jclinepi.2005.02.022
Kirkpatrick AW, Rizoli S, Ouellet JF, Roberts DJ, Sirois M, Ball CG, Xiao ZJ, Tiruta C, Meade M, Trottier V, Zhu G, Chagnon F, Tien H, Canadian Trauma Trials Collaborative and the Research Committee of the Trauma Association of Canada: Occult pneumothoraces in critical care: a prospective multicenter randomized controlled trial of pleural drainage for mechanically ventilated trauma patients with occult pneumothoraces. J Trauma Acute Care Surg 2013, 74: 747-754. discussion 754–755 10.1097/TA.0b013e3182827158
Ball CG, Lord J, Laupland KB, Gmora S, Mulloy RH, Ng AK, Schieman C, Kirkpatrick AW: Chest tube complications: how well are we training our residents? Can J Surg 2007, 50: 450-458.
Borenstein M, Hedges LV, Higgins JPT, Rothstein HR: Subgroup analysis and notes on subgroup analysis and meta-regression. In Introduction to Meta-analysis. Chichester: John Wiley & Sons; 2009:150-186. 205–223
Soldati G, Testa A, Sher S, Pignataro G, La Sala M, Silveri NG: Occult traumatic pneumothorax: diagnostic accuracy of lung ultrasonography in the emergency department. Chest 2008, 133: 204-211. 10.1378/chest.07-1595
Lichtenstein D, Mezière G, Biderman P, Gepner A: The ‘lung point’: an ultrasound sign specific to pneumothorax. Intensive Care Med 2000, 26: 1434-1440. 10.1007/s001340000627
DJR is supported by an Alberta Innovates – Health Solutions Clinician Fellowship Award, a Knowledge Translation Canada Strategic Funding in Health Research Fellowship, and funding from the Canadian Institutes of Health Research and the Clinician Investigator Program at the University of Calgary. These funders had no role in the collection, analysis, or interpretation of the data; in writing of the manuscript; or in the decision to submit the manuscript for publication.
AWK received an unrestricted gift of a NanoMaxx™ Ultrasound Machine from SonoSite, Inc. (Markham, ON, Canada) for research purposes. The remaining authors declare that they have no competing interests.
DJR, DJN, and MTJ were involved with study conception and design. DJR extracted the data for bivariate random-effects meta-analysis while DJR and DJN computed summary diagnostic accuracy estimates and performed bivariate meta-regression. DJR, DJN, MTJ, CGB, and AWK interpreted the results of these analyses. DJR drafted the manuscript, which was critically revised for intellectual content by DJN, MTJ, CGB, and AWK through subsequent revisions. SA composed the manuscript. SA, GC and AMY reviewed the manuscript and data and made suggestions. All authors read the final manuscript and approved it to be submitted for publication.
About this article
Cite this article
Roberts, D.J., Niven, D.J., James, M.T. et al. Thoracic ultrasonography versus chest radiography for detection of pneumothoraces: challenges in deriving and interpreting summary diagnostic accuracy estimates. Crit Care 18, 416 (2014). https://doi.org/10.1186/cc13759
- Emergency Physician
- Linear Probe
- Damage Control Surgery
- Majority Trauma Patient