Pleural ultrasonography versus chest radiography for the diagnosis of pneumothorax: review of the literature and meta-analysis
© Alrajab et al.; licensee BioMed Central Ltd. 2013
Received: 23 June 2013
Accepted: 10 September 2013
Published: 23 September 2013
Ultrasonography is being increasingly utilized in acute care settings with expanding applications. Pneumothorax evaluation by ultrasonography is a fast, safe, easy and inexpensive alternative to chest radiographs. In this review, we provide a comprehensive analysis of the current literature comparing ultrasonography and chest radiography for the diagnosis of pneumothorax.
We searched English-language articles in MEDLINE, EMBASE and Cochrane Library dealing with both ultrasonography and chest radiography for diagnosis of pneumothorax. In eligible studies that met strict inclusion criteria, we conducted a meta-analysis to evaluate the diagnostic accuracy of pleural ultrasonography in comparison with chest radiography for the diagnosis of pneumothorax.
We reviewed 601 articles and selected 25 original research articles for detailed review. Only 13 articles met all of our inclusion criteria and were included in the final analysis. One study used lung sliding sign alone, 12 studies used lung sliding and comet tail signs, and 6 studies searched for lung point in addition to the other two signs. Ultrasonography had a pooled sensitivity of 78.6% (95% CI, 68.1 to 98.1) and a specificity of 98.4% (95% CI, 97.3 to 99.5). Chest radiography had a pooled sensitivity of 39.8% (95% CI, 29.4 to 50.3) and a specificity of 99.3% (95% CI, 98.4 to 100). Our meta-regression and subgroup analyses indicate that consecutive sampling of patients compared to convenience sampling provided higher sensitivity results for both ultrasonography and chest radiography. Consecutive versus nonconsecutive sampling and trauma versus nontrauma settings were significant sources of heterogeneity. In addition, subgroup analysis showed significant variations related to operator and type of probe used.
Our study indicates that ultrasonography is more accurate than chest radiography for detection of pneumothorax. The results support the previous investigations in this field, add new valuable information obtained from subgroup analysis, and provide accurate estimates for the performance parameters of both bedside ultrasonography and chest radiography for pneumothorax evaluation.
Chest ultrasonography (US) is gaining more attention in critical care and emergency medicine literature. US has been used recently for evaluation of pneumothorax and other lung pathologies. Several early trials [1–3] by Litchenstein et al. established the diagnostic signs of pneumothorax on US and showed a strong superiority in favor of US over chest radiography (CXR). Despite those and other cumulating original research evidence favoring ultrasonography, US remained underused. In fact, the most recent British thoracic society guidelines on pleural procedures and thoracic ultrasound stated that “The utility of thoracic ultrasound for diagnosing a pneumothorax is limited in hospital practice due to the ready availability of chest x-rays and conflicting data from published reports” . During the years 2011 and 2012, an increasing number of original research publications compared US with CXR for pneumothorax evaluation, reflecting the expanding rule of US in evaluation of pneumothorax and the growing interest in it to replace CXR. Two meta-analyses [5, 6] attempted for the first time to evaluate the diagnostic accuracy of US in comparison with CXR. In both studies, chest ultrasonography was a near-perfect test with very high sensitivity and specificity. Since the publication of those analyses, few other high-quality original research articles were published comparing the two tests for pneumothorax detection.
By using a regression-analysis model of the published literature, Lijmer et al.  showed that inclusion of a diseased population in meta-analyses of diagnostic tests overestimates the diagnostic odds ratio (DOR) by threefold and that using a different reference standard in those studies overestimates the DOR by at least twofold. DOR is defined as the odds for a positive test result in diseased persons relative to the odds of a positive result in nondiseased persons . It is an indicator of test performance that is independent of the prevalence of the disease . Studies with lower methodologic quality tend to include patients with known disease and apply the index test on them, which leads to overestimation of DOR by increasing the odds of having a positive test in diseased subjects. By using a different reference standard (in our analysis: obtaining CT scans preferentially on patients with pneumothorax compared with milder cases without pneumothorax) also overestimated the DOR by increasing the sensitivity and specificity of the index test and introduced possible selection biases to the study. Such studies were included in the previously published meta-analyses comparing the two tests.
We aimed to conduct an accurate meta-analysis of the available literature that included high-quality articles, and avoiding studies that evaluated populations with known pneumothorax and studies that used different verification methods. Additionally, we evaluated the studies for other possible sources of bias. We also intended to include the recent publications that were not included in previous analyses. Furthermore, we specifically planned to address the inherent heterogeneity found that could not be addressed in the previously published meta-analyses. We addressed issues related to operator, type of probe, and patient-population specifics. We believe that our study adds valuable information to the current literature in this field that could guide the application of pleural ultrasonography in the clinicians’ daily practices.
Materials and methods
Study design and data extraction
Studies inclusion criteria
The inclusion criteria we used to select articles are as follows: (a) Original prospective blinded studies comparing the performance of US and CXR for pneumothorax diagnosis; (b) compared the two tests with one gold standard, the computed tomography (CT) scan of the chest; (c) avoided studies that included diseased populations (populations with known pneumothorax); (d) Described the diagnostic criteria for pneumothorax on US in clear details; And (e) met quality standards, as assessed by the 14-item Quality Assessment of Diagnostic Accuracy Studies (QUADAS2)  tool.
All patients included in our analysis had CT scans in addition to CXR and US examinations. If a study included patients with differential verifications, only patients with CT scans were included. If a study included patients studied by US for other conditions in addition to pneumothorax, only patients evaluated for pneumothorax were included.
Characteristics of included studies
CT, LS, LP
LS, CT, LP
Convex and linear
LS, CT, LP
LS, CT, LP
LS, CT, LP
LS, CT, LP
Canada and United States
LS, CT, PDS
After extraction of data from the original studies, data were arranged in 2 × 2 tables expressing true positive (TP), false positive (FP), false negative (FN), and true negative (TN). In cases of uncertainty about data or the quality, the author was contacted (one case ). Five studies [11, 16–18, 22] reported their results considering hemithoraces as independent variables, whereas the others considered each patient as an independent variable. To overcome this challenge and maintain study weight estimates intact, we multiplied values in all cells of those studies by 2. In one study , four observations by independent operators were reported on each patient, considering the patient as a unit. In this case, we divided the results in all cells by 2. We evaluated all possible causes of heterogeneity and stratified studies according to the operator, ultrasound probe used, study subjects (trauma versus nontrauma), ultrasonographic signs assessed, as well as other possible sources of bias, including type of sampling (consecutive versus convenience sampling). We included these items as covariates in our data tables for meta-regression and subgroup analysis.
We assumed that US and CXR have different accuracy when applied to different patient populations by different operators. For this reason, we used a random-effect model in our meta-analysis to calculate pooled sensitivity and specificity with corresponding 95% confidence intervals (CIs). Other data such as diagnostic odds ratio (DOR) and receiver operative curves (ROCs) were also obtained. We used Meta-DiSc , version 1.4 software (Ramon y Cajal Hospital, Madrid, Spain). We also used Review Manager 5.2, mainly to assess quality and risk of bias. Results of analysis using both software programs were identical. However, for this report, all data and graphs were obtained from the results of Meta-DiSc analysis, as it provided more information for reporting.
To explain the observed heterogeneity, we performed meta-regression and subgroup analyses, as applicable, using all observed covariates. Meta-regression is a regression analysis of the effects of covariates in relation to each other at the level of studies. The effect sizes were explained as diagnostic odds ratio (DOR) and relative diagnostic odds ratio (RDOR) in relation to the dependent variable of interest. To compare performance-parameter estimates (sensitivity, specificity, or DOR) for different diagnostic tests at 5% level, we used the calculated 95% confidence intervals (CIs) for a parameter estimate for the diagnostic tests being compared. In comparison with previous studies, we observed a significant difference in the estimated parameter for two values being compared if the 95% CI for the parameter of interest in our estimate did not include the parameter estimate in the other studies’ estimates or vice versa.
For CXR, both consecutive sampling (RDOR = 6.77; 95% CI, 1.53 to 29.93; P = 0.017) and trauma settings (RDOR = 27.42; 95% CI, 5.36 to 140.31; P = 0.0013) were significantly associated with different results, with a higher DOR for consecutive sampling and trauma. Heterogeneity in CXR studies was fully explained by these factors with negligible residual T2 (Additional file 1: eTable S2). Subgroup analysis showed improvement in pooled sensitivity in consecutive-sampling studies to 49.7% (95% CI, 33.0 to 66.3). In contrast, in convenience sampling studies, the pooled sensitivity was significantly lower at 32.6% (95% CI, 20.7 to 44.5), whereas specificity remained comparable in all subgroups.
For US, both trauma settings (RDOR = 32.87; 95% CI, 2.42 to 447.03; P = 0.018) and consecutive sampling (RDOR = 21.99; 95% CI, 1.98 to 244.93; P = 0.021) were significant contributors to heterogeneity by using meta-regression analysis (Additional file 1: eTable S3). Subgroup analysis also showed that in consecutive sampling studies, the pooled sensitivity improved to 85.3% (95% CI, 68 to 100), whereas in nonconsecutive (convenience) sampling studies, the pooled sensitivity decreased to 73.6% (95% CI, 60.4 to 86.7). Studies that used the high-frequency linear array probe had a pooled sensitivity of 82.2% (95% CI, 68.8 to 95.5), whereas those using a convex array probe had a pooled sensitivity of 76% (95% CI, 59.8 to 92.3). Operator (radiologist versus others) was not a significant variable in our analysis. However, emergency physician-performed US had better sensitivity than nonemergency physicians-performed US (82.3% versus 72.8%). (Additional file 1contains statistical tables for both CXR and US subanalyses).
In the discussion sections of the reviewed articles [11–23], few conditions were reported to cause false-positive results on US, including pleural adhesions, bullous emphysema, and main-stem intubation on the contralateral side. Subcutaneous emphysema and pleural calcifications were also reported to impede the US waves.
Ultrasonography time, when assessed [12, 14, 18, 20, 21], ranged between <2 minutes and 15 minutes. In all studies that evaluated test-performance time, except one , US time was significantly shorter than CXR time (mean, <5 minutes versus 10 to 15 minutes).
In the past 3 years, at least nine published original prospective research articles addressed the diagnostic accuracy of pleural ultrasonography for the diagnosis of pneumothorax, reflecting the growing interest in this valuable test as an alternative to CXR. Six of those articles [11–16] met our inclusion and quality criteria and, for the first time, were included in a meta-analysis. The pooled sensitivity of US in our study is the lowest of the previous two analyses [5, 6] (78.6% versus 88%  and 90.9% ). The DOR reported by a previous meta-analysis  is 3.3 times higher than our result (993 with 95% CI, 333 to 2,957) indicating a threefold overestimation of the accuracy of the test and attesting to Lijmer’s previous estimates . Both reported sensitivity and DOR are significantly different from those obtained in previous analyses, as shown from the reported confidence intervals.
We believe that our study provides better estimates of the test parameters because of the inclusion of a large number of good-quality standardized studies and patients (total of 1,514 patients) in the analysis. Our meta-analysis allowed, for the first time, the identification of significant sources of variation in the effect size among the included studies. It is the first to compare CT scan, US, and CXR in the same population on this large scale. On all counts US remains superior to CXR for detection of pneumothorax, even after controlling for possible sources of heterogeneity (the lowest US subgroup sensitivity was 73.6%). With positive test results, patients tested with US have greater odds of having an accurate diagnosis of pneumothorax than do those tested with CXR (DOR, 279.31 versus 87.19). The majority of studies included in our analysis were in trauma settings; this was expected, as an indication for CT scan of the chest is readily available in this setting. Our results indicated that a linear probe provided better sensitivity (82% versus 76%); this is likely because of the better views of the lung sliding sign obtained with this high-resolution probe.
In our study, emergency physicians performed better US than did nonemergency physicians (sensitivity, 82.3% versus 72.8%). This could be related to their early experience in thoracic US use as part of the eFAST (Extended Focused Assessment with Sonography for Trauma) that emphasized the importance of training and experience in this operator-dependent test.
Our study is not without limitations. Despite meticulous efforts to explain possible causes of heterogeneity, we were unable to account for some minor sources, especially on the US analysis, which had some minimal residual heterogeneity after meta-regression (T2 = 0.2; Additional file 1: eTable S3). We did not evaluate our meta-analysis for publication bias. We kept our search very broad initially to overcome this issue but included all studies that performed US and CXR as well as CT scan as the gold standard to maintain accuracy and avoid overestimates of diagnostic accuracy.
Studies published in languages other than English, with the exception of one , were not identified in our search and were not included. This probably has a negligible effect. CXR was performed in supine position in the vast majority of our study patients, and this may have underestimated test performance. In nontrauma studies [16, 21], in which a large number of patients had semierect CXR, the sensitivity only increased to 42.3% (95% CI, 14.3 to 70.3). A previous meta-analysis  included studies of CXR alone to neutralize the effect of patient position, and their reported sensitivity was only 52%.
As stated earlier, most of our included studies were in trauma/emergency department settings. This was mainly the result of including studies that compared both tests with the gold standard (CT scan of the chest). It should be noted that the severity of trauma was not assessed in the majority of those studies. The consecutive-sampling studies (which showed higher sensitivity) may have allowed a wide spectrum of patients to be included in those studies. Furthermore, most pneumothoraces missed by CXR were occult and detected only by US and CT scans. In one study  that reported injury severity score (ISS), occult pneumothorax was 8 times more likely to be present in patients with ISS >16. Studies comparing US and CXR with CT scans in evaluation of postbronchoscopy pneumothorax, for example, would expose patients to unnecessary radiation from CT scan and would be unethical. A small pneumothorax might not require invasive treatment, but it is important to recognize, in certain clinical situations, such as positive-pressure ventilation and air transportation.
It is important to note that the test characteristics are only part of the assessment of a diagnostic test performance, and the value of any test ultimately lies in its effects on patient outcome. Other important factors such as potential of harm as a consequence of the test (in our case, possible exposure to unnecessary procedures to treat a small pneumothorax or exposure to ionizing radiation), physician’s perception and confidence in test results, as well as the ability to make treatment decisions based on test results were not addressed in our study . Future research can be designed to address the downstream effects of two separate testing strategies specifically for pneumothorax: one that uses CXR and another for US. Possible outcome measures are number of invasive procedures and subsequent tests resulting from the index test, and total condition-related cost of care. We expect US to be safer, more convenient, more cost effective, and to outperform CXR in most aspects.
Despite the lower sensitivity and lower DOR found in our analysis, US remains much more sensitive than CXR for identification of pneumothorax. Our analysis supports the available evidence in favor of ultrasonography over chest radiography and provides an objective assessment of the diagnostic performance of both tests in the well-designed published studies that we included in our meta-analysis. Our analysis identifies several important factors that increase the accuracy of US in detection of pneumothorax, including operator experience, patient population, and the type of probe used.
Pleural ultrasound is less sensitive than previously reported but remains superior to chest radiograph for detection of pneumothorax in the trauma and critical care populations.
Training and familiarity with bedside ultrasound techniques may provide better accuracy, as appeared with the emergency physician performance.
High-resolution linear probe gives higher accuracy for the sliding pleura sign.
Ultrasound is convenient, is a readily available bedside procedure, is easy to learn, is accurate for diagnosing pneumothorax, and avoids patient exposure to ionizing radiation.
Saadah Alrajab, MD, MPH; department of pulmonary, critical care and sleep medicine. Louisiana State University Health Sciences center and Cogent-The Intensivist Group, St.Bernardine Medical Center (California). Asser M Ypussef, MD; department of surgery and trauma. Louisiana State University Health Sciences center. Nuri I Akkus, MD; department of cardiology. Louisiana State University Health Sciences center. Gloria Caldito, PhD; department of biometry. Louisiana State University Health Sciences center.
Diagnostic odds ratio
Extended focused assessment with sonography for trauma
Relative diagnostic odds ratio
Summary receiver operating characteristic
The authors thank Barbara Reilly and the LSUHSC medical library staff for their support during the review process.
- Lichtenstein DA, Menu Y: A bedside ultrasound sign ruling out pneumothorax in the critically ill. Lung Sliding Chest 1995, 108: 1345-1348.View ArticlePubMedGoogle Scholar
- Lichtenstein D, Mezière G, Biderman P, Gepner A: The comet-tail artifact: an ultrasound sign ruling out pneumothorax. Intensive Care Med 1999, 25: 383-388. 10.1007/s001340050862View ArticlePubMedGoogle Scholar
- Lichtenstein D, Mezière G, Biderman P, Gepner A: The “lung point”: an ultrasound sign specific to pneumothorax. Intensive Care Med 2000, 26: 1434-1440. 10.1007/s001340000627View ArticlePubMedGoogle Scholar
- Havelock T, Teoh R, Laws D, Gleeson F: BTS Pleural Disease Guideline Group. Pleural procedures and thoracic ultrasound: British Thoracic Society Pleural Disease Guideline 2010. Thorax 2010, 65: ii61-76. doi:10.1136/thx.2010.137026View ArticlePubMedGoogle Scholar
- Ding W, Shen Y, Yang J, He X, Zhang M: Diagnosis of pneumothorax by radiography and ultrasonography: a meta-analysis. Chest 2011, 140: 859-866. doi:10.1378/chest.10-2946 10.1378/chest.10-2946View ArticlePubMedGoogle Scholar
- Alrajhi K, Woo MY, Vaillancourt C: Test characteristics of ultrasonography for the detection of pneumothorax: a systematic review and meta-analysis. Chest 2012, 141: 703-708. 10.1378/chest.11-0131View ArticlePubMedGoogle Scholar
- Lijmer JG, et al.: Empirical evidence of design-related bias in studies of diagnostic tests. JAMA 1999, 282: 1061-1066. 10.1001/jama.282.11.1061View ArticlePubMedGoogle Scholar
- Whiting PF, et al.: QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies. Ann Intern Med 2011, 155: 529-536. 10.7326/0003-4819-155-8-201110180-00009View ArticlePubMedGoogle Scholar
- Blaivas M, Lyon M, Duggal S: A prospective comparison of supine chest radiography and bedside ultrasound for the diagnosis of traumatic pneumothorax. Acad Emerg Med 2005, 12: 844-849. 10.1111/j.1553-2712.2005.tb00960.xView ArticlePubMedGoogle Scholar
- Garofalo G, Busso M, Perotto F, De Pascale A, Fava C: Ultrasound diagnosis of pneumothorax. Radiol Med 2006, 111: 516-525. Epub 2006 May 29 10.1007/s11547-006-0047-yView ArticlePubMedGoogle Scholar
- Donmez H, Tokmak TT, Yildirim A, Buyukoglan H, Ozturk M, Yaşar Ayaz U, Mavili E: Should bedside sonography be used first to diagnose pneumothorax secondary to blunt trauma? J Clin Ultrasound 2012, 40: 142-146. 10.1002/jcu.21884View ArticlePubMedGoogle Scholar
- Abbasi S, Farsi D, Hafezimoghadam P, Fathi M, Zare MA: Accuracy of emergency physician-performed ultrasound in detecting traumatic pneumothorax after a 2-h training course. Eur J Emerg Med 2012. Epub ahead of printGoogle Scholar
- Hyacinthe AC, Broux C, Francony G, Genty C, Bouzat P, Jacquot C, Albaladejo P, Ferretti GR, Bosson JL, Payen JF: Diagnostic accuracy of ultrasonography in the acute assessment of common thoracic lesions after trauma. Chest 2012, 141: 1177-1183. 10.1378/chest.11-0208View ArticlePubMedGoogle Scholar
- Nandipati KC, Allamaneni S, Kakarla R, Wong A, Richards N, Satterfield J, Turner JW, Sung KJ: Extended focused assessment with sonography for trauma (EFAST) in the diagnosis of pneumothorax: experience at a community based level I trauma center. Injury 2011, 42: 511-514. 10.1016/j.injury.2010.01.105View ArticlePubMedGoogle Scholar
- Nagarsheth K, Kurek S: Ultrasound detection of pneumothorax compared with chest x-ray and computed tomography scan. Am Surg 2011, 77: 480-484.PubMedGoogle Scholar
- Xirouchaki N, Magkanas E, Vaporidi K, Kondili E, Plataki M, Patrianakos A, Akoumianaki E, Georgopoulos D: Lung ultrasound in critically ill patients: comparison with bedside chest radiography. Intensive Care Med 2011, 37: 1488-1493. 10.1007/s00134-011-2317-yView ArticlePubMedGoogle Scholar
- Brook OR, Beck-Razi N, Abadi S, Filatov J, Ilivitzki A, Litmanovich D, Gaitini D: Sonographic detection of pneumothorax by radiology residents as part of extended focused assessment with sonography for trauma. J Ultrasound Med 2009, 28: 749-755.PubMedGoogle Scholar
- Soldati G, Testa A, Sher S, Pignataro G, La Sala M, Silveri NG: Occult traumatic pneumothorax: diagnostic accuracy of lung ultrasonography in the emergency department. Chest 2008, 133: 204-211. 10.1378/chest.07-1595View ArticlePubMedGoogle Scholar
- Soldati G, Testa A, Pignataro G, Portale G, Biasucci DG, Leone A, Silveri NG: The ultrasonographic deep sulcus sign in traumatic pneumothorax. Ultrasound Med Biol 2006, 32: 1157-1163. 10.1016/j.ultrasmedbio.2006.04.006View ArticlePubMedGoogle Scholar
- Zhang M, Liu ZH, Yang JX, Gan JX, Xu SW, You XD, Jiang GY: Rapid detection of pneumothorax by ultrasonography in patients with multiple trauma. Crit Care 2006, 10: 4.View ArticleGoogle Scholar
- Chung MJ, Goo JM, Im JG, Cho JM, Cho SB, Kim SJ: Value of high-resolution ultrasound in detecting a pneumothorax. Eur Radiol 2005, 15: 930-935. 10.1007/s00330-004-2518-7View ArticlePubMedGoogle Scholar
- Kirkpatrick AW, Sirois M, Laupland KB, Liu D, Rowan K, Ball CG, Hameed SM, Brown R, Simons R, Dulchavsky SA, Hamiilton DR, Nicolaou S: Hand-held thoracic sonography for detecting post-traumatic pneumothoraces: the Extended Focused Assessment with Sonography for Trauma (EFAST). J Trauma 2004, 57: 288-295. 10.1097/01.TA.0000133565.88871.E4View ArticlePubMedGoogle Scholar
- Rowan KR, Kirkpatrick AW, Liu D, Forkheim KE, Mayo JR, Nicolaou S: Traumatic pneumothorax detection with thoracic US: correlation with chest radiography and CT-initial experience. Radiology 2002, 225: 210-214. 10.1148/radiol.2251011102View ArticlePubMedGoogle Scholar
- Zamora J, Abraira V, Muriel A, Khan K, Coomarasamy A: Meta-DiSc: a software for meta-analysis of test accuracy data. BMC Med Res Methodol 2006, 6: 31. 10.1186/1471-2288-6-31PubMed CentralView ArticlePubMedGoogle Scholar
- Ferrante Di Ruffano L, Hyde CJ, McCaffery KJ, Bossuyt PM, Deeks JJ: Assessing the value of diagnostic tests: a framework for designing and evaluating trials. BMJ 2012, 344: e686. doi:10.1136/bmj.e686 10.1136/bmj.e686View ArticlePubMedGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.