A novel cardiovascular risk stratification model incorporating ECG and heart rate variability for patients presenting to the emergency department with chest pain
- Micah Liam Arthur Heldeweg†1,
- Nan Liu†2, 3Email author,
- Zhi Xiong Koh2,
- Stephanie Fook-Chong4,
- Weng Kit Lye3,
- Mark Harms5 and
- Marcus Eng Hock Ong2, 6
© The Author(s). 2016
Received: 11 January 2016
Accepted: 1 June 2016
Published: 11 June 2016
Risk stratification models can be employed at the emergency department (ED) to evaluate patient prognosis and guide choice of treatment. We derived and validated a new cardiovascular risk stratification model comprising vital signs, heart rate variability (HRV) parameters, and demographic and electrocardiogram (ECG) variables.
We conducted a single-center, observational cohort study of patients presenting to the ED with chest pain. All patients above 21 years of age and in sinus rhythm were eligible. ECGs were collected and evaluated for 12-lead ECG abnormalities. Routine monitoring ECG data were processed to obtain HRV parameters. Vital signs and demographic data were obtained from electronic medical records. Thirty-day major adverse cardiac events (MACE) were the primary endpoint, including death, acute myocardial infarction, and revascularization. Candidate variables were identified using univariate analysis; the model for the final risk score was derived by multivariable logistic regression. We compared the performance of the new model with that of the thrombolysis in myocardial infarct (TIMI) score using receiver operating characteristic (ROC) analysis.
In total, 763 patients were included in this study; 254 (33 %) met the primary endpoint, the mean age was 60 (σ = 13) years, and the majority was male (65 %). Nineteen candidate predictors were entered into the multivariable model for backward variable elimination. The final model contained 10 clinical variables, including age, gender, heart rate, three HRV parameters (average R-to-R interval (RR), triangular interpolation of normal-to-normal (NN) intervals, and high-frequency power), and four 12-lead ECG variables (ST elevation, ST depression, Q wave, and QT prolongation). Our proposed model outperformed the TIMI score for prediction of MACE (area under the ROC curve 0.780 versus 0.653). At the cutoff score of 9 (range 0–37), our model had sensitivity of 0.709 (95 % CI 0.653, 0.765), specificity of 0.674 (95 % CI 0.633, 0.715), positive predictive value of 0.520 (95 % CI 0.468, 0.573), and negative predictive value of 0.823 (95 % CI 0.786, 0.859).
A non-invasive and objective ECG- and HRV-based risk stratification tool performed well against the TIMI score, but future research warrants use of an external validation cohort.
Chest pain is the most frequent complaint in patients over 45 years of age presenting to the emergency department (ED) in the USA . The first priority in the evaluation of patients with chest pain is risk stratification to differentiate those who are in acute cardiovascular distress from those who are not. Risk stratification allows for an appropriate therapeutic strategy and an effective allocation of ED resources.
The American College of Cardiology/American Heart Association (ACC/AHA) practice guidelines recommend the use of validated risk scoring models such as the thrombolysis in myocardial infarction (TIMI), platelet glycoprotein IIb/IIIa in unstable angina: receptor suppression using integrilin (PURSUIT), and global registry of acute coronary events (GRACE) for cardiovascular risk stratification [2–6]. However, commonly employed cardiovascular risk models rely on traditional clinical indicators that are subjective, susceptible to risk factor modification (e.g., anticholesterol or antihypertensive therapy), may not be immediately available, and often do not correlate well with long-term or short-term outcomes [7–10]. Consequently, there is a need for a quantitative and rapid method to guide patient disposition in the ED.
Heart rate variability (HRV) parameters are quantitative measures of the interval between adjacent QRS complexes, mathematically derived from the electrocardiogram (ECG) [11–13]. Beat-to-beat interval fluctuations principally represent the short-term cardiovascular control exercised by the autonomic nervous system . There is an increasing recognition of HRV parameters as powerful independent predictors of many cardiovascular pathological conditions [15–24], and their potential role in early cardiovascular risk stratification [25, 26].
This study aims to develop a novel risk stratification model composed of HRV parameters, demographic data, traditional vital signs and 12-lead ECG variables for the prediction of major adverse cardiac events (MACE) in patients with chest pain (henceforth referred to as the Singapore General Hospital Emergency Department risk stratification model (SEDRSM)). This study hypothesizes that the SEDRSM will perform better than an established risk stratification tool (TIMI) at predicting MACE within 30 days of a patient presenting to the ED with chest pain.
Design and setting
We conducted a prospective, non-randomized, observational study of patients presenting to the ED with chest pain from March 2010 until August 2015. This study was performed at the ED of the Singapore General Hospital (SGH), a tertiary care hospital in Singapore. ED triage is performed by nurses using the national Singaporean patient acuity category scale (PACS), a symptom-based triage system without strict physiological criteria. ED patients are classified with a PACS score, which ranges from 1 to 4 and represents the degree of urgency in patient attendance. Patients with PACS 1 are the most critically ill, those with PACS 2 are non-ambulant, those with PACS 3 are ambulant, and those with PACS 4 are non-emergencies. Our study focuses on patients presenting with chest pain, who routinely receive a 12-lead ECG investigation (Philips PageWriter TC50 Cardiograph) during triage and are placed in PACS 1 or 2 units where they receive further ECG monitoring (ZOLL X Series Monitor defibrillator). The study was approved by the local ethics committee (SingHealth Centralised Institutional Review Board, Singapore) with a waiver of patient consent.
Patient recruitment and eligibility
All patients older than 21 years of age with a primary complaint of non-traumatic chest pain were eligible. Patients presenting in non-sinus rhythm (arrhythmias, asystole, complete heart blocks, or pacemaker rhythms) were excluded due to interference of these phenomena with the interpretation of QRS complexes. Similarly, patients with a high percentage of artifacts, ectopic beats, and non-sinus beats (>30 % of ECG recordings) were excluded due to their potential biasing effect on the HRV calculations . Finally, patients who were lost to follow up or transferred to other (private) hospitals within the 30-day time frame were excluded, on account of inability to ascertain whether these patients had reached our primary endpoint.
Data collection and processing
All data were collected on standardized forms in a Research Electronic Data Capture (REDCap) database. The electronic medical records (EMRs) were analyzed for demographic characteristics, medical history, presenting symptoms, clinical information, and laboratory results.
A trained research coordinator prospectively downloaded 12-lead ECG tracings from the ZOLL X Series monitor defibrillator on a daily basis. We use our in-house software package for ECG signal processing and parameter calculation . Noise was manually removed from the lead II ECG tracing and its sample of 6 minutes was stored in an Excel (Microsoft Office 2007; Microsoft, Redmond, WA, USA) file for further processing. A 5–28 Hz band-pass filter was applied to the lead II sample to facilitate peak detection . QRS complexes were detected using a threshold-plus-derivative method that has been previously validated . Time domain and frequency domain HRV parameters were calculated in accordance with the guidelines outlined by the Taskforce of the European Society of Cardiology .
Vital signs were recorded at initial ED patient presentation using the Propaq CS Vital Signs Monitor (Welch Allyn, Skaneateles, NY, USA). The first set of complete vital signs obtained at initial presentation was used for this study. The 12-lead ECG tracings recorded during triage were used for the evaluation of ECG variables. These tracings were recorded using a Philips PageWriter TC50 cardiograph and subsequently extracted for analysis and storage. A trained research associate, blinded to patient outcomes, ascertained whether the patient was in sinus rhythm, and evaluated the 12-lead ECG tracings for abnormalities. We followed the definitions of ECG variables as described in John Hampton’s book “The ECG Made Easy”.
We tested the SEDRSM against the TIMI score for unstable angina (UA)/non-ST elevation myocardial infarction (NSTEMI), a score that has been employed on the ED to predict MACE within 30 days of presentation to the ED with chest pain . Data pertaining to the TIMI score criteria were retrieved from the EMRs and used to construct the TIMI score.
The primary endpoint of this study, MACE, was a composite outcome of death, acute myocardial infarction, and revascularization, including coronary artery bypass graft (CABG) or percutaneous coronary intervention (PCI), within 30 days of presentation to the ED. Patients were followed up and EMRs were reviewed to ascertain whether the patient had experienced an endpoint criterion within 30 days after presentation.
SPSS (version 21.0; SPSS Inc, Chicago, IL, USA) software was used for statistical analysis. Derivation and validation of the SEDRSM was done in the same cohort. Univariate relationships between baseline characteristics and MACE were assessed using the appropriate statistical test, based on type and distribution of data. We tested normality of distribution by inspecting normality graphs and interpreting the Kolmogorov-Smirnov quantitative normality test.
A total of 16 HRV parameters, 13 ECG variables, 7 vital signs, and 3 demographic variables (age, gender, and race) were screened as candidate predictors of MACE using the same univariate analytical method described previously. Variables associated with a p value <0.05 were selected and categorized in order to facilitate scoring and increase applicability at the ED. HRV parameter category cutoffs were chosen based on the visual comparison between HRV parameter value and frequency of MACE occurrence. ECG variables were dichotomous. Vital signs and demographics were categorized based on recognized (physiological) cutoff values.
We introduced the categorized candidate variables into an automated likelihood ratio backward stepwise logistic regression model. The retained candidate variables were used to construct the SEDRSM. All unstandardized coefficients were normalized by dividing them by the smallest coefficient, and subsequently rounded off to the nearest integer. The SEDRSM score was then calculated by a simple arithmetic sum of the integers assigned to the criteria satisfied.
The overall goodness of fit of the model was assessed by the Hosmer-Lemeshow test. The predictive accuracy of the SEDRSM and TIMI score was assessed using the area under the receiver operating characteristic (AUROC) curve. Discriminatory values (i.e., sensitivity, specificity, positive predictive value, and negative predictive value) were also determined for both risk stratification models.
Baseline characteristics of patients in the study
(n = 763)
(n = 254)
(n = 509)
Age in years, μ (σ)
Disposition from ED
Admission to GW
Admission to ICW
Frequency of MACE types within 30 days
Number of patients (%)
Comparison of vital signs, ECG variables, and HRV parameters in patients with and without MACE within 30 days of arrival at the ED
(n = 509)
(n = 254)
Vital signs, μ (σ)
ECG variables, no. (%)
Left axis deviation
Right axis deviation
HRV parameters, μ (σ)
Predictors of 30-day MACE after backwards elimination in multivariable regression
Adjusted OR (95 % CI)
Gender (male vs female)
2.17 (1.45, 3.23)
Age, years (≥60 vs <60)
1.38 (0.95, 2.00)
Heart rate, beat/min
4.52 (1.08, 18.89)
2.05 (0.62, 6.80)
ST elevation (yes vs no)
8.48 (4.27, 16.85)
ST depression (yes vs no)
10.83 (5.49, 21.36)
Q wave (yes vs no)
2.93 (1.41, 6.11)
QT prolongation (yes vs no)
1.45 (0.99, 2.12)
AVRR (<0.77 vs ≥0.77)
1.52 (1.03, 2.22)
2.04 (1.30, 3.20)
1.32 (0.80, 2.18)
HF power (<0.07 vs ≥0.07)
1.70 (1.16, 2.50)
Normalization of unstandardized coefficients and final corresponding SEDRSM scores
Age in years, ≥60
Heart rate, beat/min
ST elevation, yes
ST depression, yes
Q wave, yes
QT prolongation, yes
HF power <0.07
Discriminatory values for the SEDRSM and TIMI scores
AUROC (95 % CI)
0.780 (0.743, 0.817)
0.653 (0.611, 0.696)
Sensitivity (95 % CI)
0.709 (0.653, 0.765)
0.618 (0.558, 0.678)
Specificity (95 % CI)
0.674 (0.633, 0.715)
0.572 (0.529, 0.615)
PPV (95 % CI)
0.520 (0.468, 0.573)
0.419 (0.369, 0.469)
NPV (95 % CI)
0.823 (0.786, 0.859)
0.750 (0.707, 0.793)
In this study we constructed a risk stratification model (the SEDRSM) incorporating vital signs, demographic data, ECG variables, and HRV parameters for the prediction of 30-day MACE in patients presenting to the ED with chest pain. In validation in the same cohort, the SEDRSM significantly outperformed the TIMI score in terms of AUROC (0.780 versus 0.653, p < 0.001). Additionally, the SEDRSM performs better than the TIMI score in terms of sensitivity, specificity, positive predictive value, and negative predictive value.
Vital signs and 12-lead ECG variables are well-established and frequently employed during clinical risk prediction on the ED [11, 32]. In contrast, many studies have reported the clinical and prognostic value of HRV parameters in the evaluation of patients with possible cardiovascular pathological conditions, but they have yet to be clinically applied . This study demonstrates that HRV parameters can be successfully implemented in cardiovascular risk stratification on the ED, even amidst other established prognosticators. The TIMI score has been used as a benchmark due to its popularity and accuracy in predicting 30-day MACE in patients presenting to the ED with chest pain . We used short-term (6-minute) recordings of 12-lead ECG as it has practical advantages in the time-scarce ED setting. Long-term (24-h) HRV analysis is prone to data analysis difficulties (e.g., failure to detect low-frequency oscillations and data-filtering difficulties). Recent evidence demonstrated a comparable predictive value for short-term vs long-term HRV analysis [34, 35]. The role of HRV in cardiovascular risk prediction has been examined previously but we cannot make direct comparisons with our study due to fundamental differences in methodology (i.e., no inclusion of 12-lead ECG variables) and a low yield of patients meeting the primary endpoints in previous reports .
Calculating HRV requires only ECG monitoring and standard analysis software [36, 37]. The SEDRSM had an AUROC of 0.780 versus an AUROC of 0.653 for the TIMI score. Risk stratification models are considered reasonable when the AUROC (or C statistic) is higher than 0.7 and strong when it exceeds 0.8 . Our findings reaffirm the potential role of HRV amidst clinical cardiovascular predictors such as 12-lead ECG variables, and demonstrate a good performance compared to a widely used cardiovascular ED risk prediction model; however, there are still many opportunities for enhancement.
Our results show that three HRV parameters are significant predictors in a multivariable prediction model. Additionally, four 12-lead ECG variables, and two demographic variables were strong significant predictors in the multivariable model. Only one vital sign, heart rate, was incorporated as a criterion into the model. The heart rate can also be obtained through processing of the 12-lead ECG. This tool would allow wider diffusion of HRV parameters into clinical use as it enables HRV parameter interpretation by the physician, which is nearly impossible by manual methods. The SEDRSM allows early clinical anticipation of MACE on the ED, and thus facilitates early intervention.
HRV is a highly complex nonlinear phenomenon; even though time-domain and frequency-domain HRV parameters are most frequently employed (designated as the “classical analysis”) they are not fully representative due to their linear and stationary nature. Evidence suggests that nonlinear HRV parameters are much more suitable for the assessment and prognosis of cardiovascular risk than the “classical analysis” . However, more high-quality longitudinal studies are required to establish the applicability of nonlinear HRV parameters .
Fragmented QRS complex is an easily obtainable ECG index that might further enhance cardiovascular risk prediction models . Signal averaged ECG analysis has been demonstrated to have a high negative predictive value , and could be employed simultaneously with HRV processing. Microvolt T-wave alternans, a measure of repolarization dispersion, has been employed in the prediction of cardiac death and may add value to HRV and signal averaged ECG (SAECG) analysis . Last, the occurrence of specific early repolarization morphological features that are frequently difficult to distinguish from true ST elevation, have recently been associated with increased risk of unexpected death. These patterns are considered particularly useful to refine risk stratification and identify a high-risk subset of patients; future research could explore the value of incorporating certain repolarization morphological features into risk prediction using the HRV and 12-lead ECG analysis [43, 44].
In our study we have compared the performance of the SEDRSM and the TIMI score for the prediction of 30-day MACE in patients presenting to the ED with chest pain. The SEDRSM score was only evaluated in our local population, whereas the TIMI score has been popular and widely validated, despite the fact that it was designed for a slightly different specification . Though there is now evidence of its usefulness in this setting , the usefulness of some of the criteria in the TIMI score is questionable in the ED. For example, the TIMI score requires knowledge of results of prior cardiac catheterization, which might not be available. Newer risk stratification scores have been developed that are specifically calibrated towards patients presenting to the ED with chest pain. For example, the history, ECG, age, risk factors (HEART) score  and the Emergency Department assessment of chest pain score (EDACS) score  could serve as better benchmarks due to their applicability to, and specific design for, an ED setting in which the risk of 30-day MACE needs to be assessed .
Our study evaluates HRV as a quantitative measure of a supposed quantitative primary endpoint, MACE. However, MACE includes revascularization (either through PCI or CABG) as a category, which is not necessarily a purely quantitative endpoint. Patient choice, i.e., the decision by patients to reject revascularization at their own risk, is a qualitative phenomenon. The revascularization endpoint therefore interferes with the computation of quantitative linear relationships between predictor and endpoint. In our study we have not corrected for, or quantified the number of patients rejecting medical diagnostics or therapy at any point after presentation to the ED. A modification of endpoint or exclusion of these patients would likely facilitate a more accurate linear relationship between predictor and endpoint.
In addition to the above limitations, we note that HRV parameters can not be manually calculated or interpreted. In this study, we used our in-house software to derive HRV measurements. We are currently developing a portable hardware device to integrate data acquisition and analysis. We believe that such a device will help clinicians quickly identify patients at high risk of developing MACE.
In our single-center, single-cohort study of patients presenting to the ED with chest pain, our risk stratification model (the SEDRSM) outperformed the TIMI score for the prediction of MACE, a composite endpoint of MI, revascularization, and death (AUROC of 0.780 versus 0.653 respectively). The SEDRSM incorporated the following criteria: age, gender, heart rate, three HRV parameters, and four 12-lead ECG variables. The SEDRSM provides useful information for making decisions about the placement of ED patients with chest pain under observation, and in determining the therapeutic strategy. The SEDRSM contains eight criteria that can be acquired by processing electrocardiographic data, allowing for a 12-lead ECG-based risk prediction device, setting aside only the manual input of demographic criteria. A risk stratification device could employ machine learning techniques that reduce information loss occurring during the construction of multivariable linear association models. There are several other ECG-based variables that can be valuable additions to our risk stratification score; these include nonlinear HRV parameters and novel depolarization or repolarization ECG variables. Our study demonstrates the potency and suitability of the SEDRSM for cardiovascular risk prediction in the ED, but also warrants evaluation and possibly resolution of existing limitations before it can be implemented in clinical practice.
The Singapore General Hospital (SGH) Emergency Department risk stratification model (SEDRSM) was proposed for patients with chest pain
The SEDRSM outperformed the TIMI score in predicting 30-day major adverse cardiac events
ACC/AHA, American College of Cardiology/American Heart Association; BP, blood pressure; CABG, coronary artery bypass graft; CHF, congestive heart failure; CI, confidence interval; DM, diabetes mellitus; ECG, electrocardiogram; ED, emergency department; EDACS, Emergency Department assessment of chest pain score; EMR, electronic medical records; GRACE, global registry of acute coronary events; GW, general ward; HEART, history, ECG, age, risk factors, Troponin; HF, high frequency; HR, heart rate; HRV, heart rate variability; ICW, intensive care ward; IHD, ischemic heart disease; IVCD, intraventricular conduction defect; LAA, left atrial abnormality; LBBB, left bundle branch block; LF, low frequency; LVH, left ventricular hypertrophy; MACE, major adverse cardiac event; MI, myocardial infarction; NHCS, National Heart Centre Singapore; NN, normal-to-normal intervals; NN50, number of interval differences of successive NN intervals greater than 50 ms; PACS, patient acuity category scale; PCI, percutaneous coronary intervention; pNN50, proportion derived by dividing NN50 by the total number of NN intervals; PURSUIT, Platelet glycoprotein IIb/IIIa in unstable angina: receptor suppression using integrilin therapy; RBBB, right bundle branch block; REDCap, research electronic data capture; RMSSD, root mean square of successive differences; ROC, receiver operator characteristic; RR, R-to-R interval; RVH, right ventricular hypertrophy; SAECG, signal averaged ECG; SDRR, standard deviation R-to-R interval; SEDRSM, Singapore Emergency Department risk stratification model; SGH, Singapore General Hospital; TIMI, thrombolysis in myocardial infarct; TINN, triangular interpolation of NN interval histogram; UA/NSTEMI, unstable angina/non-ST-elevation myocardial infarct; VLF, very low frequency
We would like to thank and acknowledge all contributions made from doctors, nurses, and research assistants from the Department of Emergency Medicine, Singapore General Hospital.
MLAH, NL, and MEHO planned and established the project, performed data collection and analysis, and drafted the manuscript. ZXK performed data collection and drafted the manuscript. SFC, WKL, and MH performed data analysis and reviewed critical revisions. All authors took part in manuscript writing and approved the final manuscript.
Marcus Eng Hock Ong and Nan Liu have a patent filing related to this study (System and method of determining a risk score for triage, Application Number: US 13/791,764). Marcus Eng Hock Ong has a patent filing related to this study (Method of predicting acute cardiopulmonary events and survivability of a patient, Application Number: US 13/047,348). Marcus Eng Hock Ong also has a licensing agreement with ZOLL Medical Corporation for the patented technology. There are no further patents, products in development or marketed products to declare. All the other authors do not have either commercial or personal associations or any sources of support that might pose a conflict of interest in the subject matter or materials discussed in this manuscript.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
- Weiss AJ, Wier LM, Stocks C, Blanchard J. Overview of Emergency Department Visits in the United States, 2011. In: Healthcare Cost and Utilization Project (HCUP) Statistical Briefs #174. Rockville, MD: Agency for Healthcare Research and Quality. 2014.Google Scholar
- Anderson JL, Adams CD, Antman EM, Bridges CR, Califf RM, Casey Jr DE, Chavey WE, 2nd, Fesmire FM, Hochman JS, Levin TN, et al. ACC/AHA 2007 guidelines for the management of patients with unstable angina/non-ST-elevation myocardial infarction: a report of the American College of Cardiology/American Heart Association Task Force on Practice Guidelines (Writing Committee to Revise the 2002 Guidelines for the Management of Patients With Unstable Angina/Non-ST-Elevation Myocardial Infarction) developed in collaboration with the American College of Emergency Physicians, the Society for Cardiovascular Angiography and Interventions, and the Society of Thoracic Surgeons endorsed by the American Association of Cardiovascular and Pulmonary Rehabilitation and the Society for Academic Emergency Medicine. J Am Coll Cardiol. 2007;50(7):e1–e157.Google Scholar
- Yan AT, Yan RT, Tan M, Casanova A, Labinaz M, Sridhar K, Fitchett DH, Langer A, Goodman SG. Risk scores for risk stratification in acute coronary syndromes: useful but simpler is not necessarily better. Eur Heart J. 2007;28(9):1072–8.Google Scholar
- Antman E, Cohen M, Bernink P, McCabe C, Horacek T, Papuchis G, Mautner B, Corbalan R, Radley D, Braunwald E. The TIMI risk score for unstable angina/non-ST elevation MI – a method for prognostication and therapeutic decision making. JAMA. 2000;284(7):835–42.Google Scholar
- Boersma E, Pieper KS, Steyerberg EW, Wilcox RG, Chang WC, Lee KL, Akkerhuis KM, Harrington RA, Deckers JW, Armstrong PW, et al. Predictors of outcome in patients with acute coronary syndromes without persistent ST-segment elevation. Results from an international trial of 9461 patients. The PURSUIT Investigators. Circulation. 2000;101(22):2557–67.Google Scholar
- Eagle KA, Lim MJ, Dabbous OH, Pieper KS, Goldberg RJ, Van de Werf F, Goodman SG, Granger CB, Steg PG, Gore JM, et al. A validated prediction model for all forms of acute coronary syndrome: estimating the risk of 6-month post discharge death in an international registry. JAMA. 2004;291(22):2727–33.Google Scholar
- Manini AF, Dannemann N, Brown DF, Butter J, Bamberg F, Nagurney JT, Nichols JH, Hoffmann U, Rule-Out Myocardial Infarction U. Limitations of risk score models in patients with acute chest pain. Am J Emerg Med. 2009;27(1):43–8.Google Scholar
- Sanchis J, Bodi V, Nunez J, Bosch X, Lorna-Sorio P, Mainar L, Santas E, Minana G, Robles R, Llacer A. Limitations of clinical history for evaluation of patients with acute chest pain, non-diagnostic electrocardiogram, and normal troponin. Am J Cardiol. 2008;101(5):613–7.Google Scholar
- Hargarten KM, Aprahamian C, Stueven H, Olson DW, Aufderheide TP, Mateer JR. Limitations of prehospital predictors of acute myocardial infarction and unstable angina. Ann Emerg Med. 1987;16(12):1325–9.View ArticlePubMedGoogle Scholar
- Bakker A, Koelemay M, Gorgels J, Vanvlies B, Smits R, Tijssen J, Haagen F. Failure of new biochemical markers to exclude acute myocardial-infarction at admission. Lancet. 1993;342(8881):1220–2.Google Scholar
- Scirica BM. Acute coronary syndrome: emerging tools for diagnosis and risk assessment. J Am Coll Cardiol. 2010;55(14):1403–15.View ArticlePubMedGoogle Scholar
- Liew R. Prediction of sudden arrhythmic death following acute myocardial infarction. Heart. 2010;96(14):1086–94.View ArticlePubMedGoogle Scholar
- Ernst G. Heart Rate Variability. London: Springer; 2014.View ArticleGoogle Scholar
- Akselrod S, Gordon D, Ubel FA, Shannon DC, Berger AC, Cohen RJ. Power spectrum analysis of heart rate fluctuation: a quantitative probe of beat-to-beat cardiovascular control. Science (New York, NY). 1981;213(4504):220–2.View ArticleGoogle Scholar
- Odemuyiwa O, Malik M, Farrell T, Bashir Y, Poloniecki J, Camm J. Comparison of the predictive characteristics of heart rate variability index and left ventricular ejection fraction for all-cause mortality, arrhythmic events and sudden death after acute myocardial infarction. Am J Cardiol. 1991;68(5):434–9.View ArticlePubMedGoogle Scholar
- Thayer JF, Yamamoto SS, Brosschot JF. The relationship of autonomic imbalance, heart rate variability and cardiovascular disease risk factors. Int J Cardiol. 2010;141(2):122–31.View ArticlePubMedGoogle Scholar
- Kotecha D, New G, Flather MD, Eccleston D, Pepper J, Krum H. Five-minute heart rate variability can predict obstructive angiographic coronary disease. Heart. 2012;98(5):395–401.View ArticlePubMedGoogle Scholar
- Kleiger RE, Miller JP, Bigger Jr JT, Moss AJ. Decreased heart rate variability and its association with increased mortality after acute myocardial infarction. Am J Cardiol. 1987;59(4):256–62.View ArticlePubMedGoogle Scholar
- Singh JP, Larson MG, Tsuji H, Evans JC, O'Donnell CJ, Levy D. Reduced heart rate variability and new-onset hypertension: insights into pathogenesis of hypertension: the Framingham Heart Study. Hypertension. 1998;32(2):293–7.View ArticlePubMedGoogle Scholar
- La Rovere MT, Pinna GD, Maestri R, Mortara A, Capomolla S, Febo O, Ferrari R, Franchini M, Gnemmi M, Opasich C, et al. Short-term heart rate variability strongly predicts sudden cardiac death in chronic heart failure patients. Circulation. 2003;107(4):565–70.Google Scholar
- Sands KE, Appel ML, Lilly LS, Schoen FJ, Mudge Jr GH, Cohen RJ. Power spectrum analysis of heart rate variability in human cardiac transplant recipients. Circulation. 1989;79(1):76–82.View ArticlePubMedGoogle Scholar
- Stein KM, Borer JS, Hochreiter C, Okin PM, Herrold EM, Devereux RB, Kligfield P. Prognostic value and physiological correlates of heart rate variability in chronic severe mitral regurgitation. Circulation. 1993;88(1):127–35.Google Scholar
- Lombardi F, Makikallio TH, Myerburg RJ, Huikuri HV. Sudden cardiac death: role of heart rate variability to identify patients at risk. Cardiovasc Res. 2001;50(2):210–7.View ArticlePubMedGoogle Scholar
- Mazzeo AT, La Monaca E, Di Leo R, Vita G, Santamaria LB. Heart rate variability: a diagnostic and prognostic tool in anesthesia and intensive care. Acta Anaesthesiol Scand. 2011;55(7):797–811.View ArticlePubMedGoogle Scholar
- Huikuri HV, Stein PK. Heart rate variability in risk stratification of cardiac patients. Prog Cardiovasc Dis. 2013;56(2):153–9.View ArticlePubMedGoogle Scholar
- Ong MEH, Goh K, Fook-Chong S, Haaland B, Wai KL, Koh ZX, et al. Heart rate variability risk score for prediction of acute cardiac complications in ED patients with chest pain. Am J Emerg Med. 2013;31(8):1201–7.View ArticlePubMedGoogle Scholar
- Ryan ML, Thorson CM, Otero CA, Vu T, Proctor KG. Clinical applications of heart rate variability in the triage and assessment of traumatically injured patients. Anesthesiol Res Pract. 2011;2011:416590.PubMedPubMed CentralGoogle Scholar
- Liu N, Lin Z, Koh ZX, Huang G-B, Ser W, Ong MEH. Patient outcome prediction with heart rate variability and vital signs. J Signal Process Sys. 2011;64:265–78.View ArticleGoogle Scholar
- Kohler BU, Hennig C, Orglmeister R. The principles of software QRS detection. IEEE Eng Med Biol Mag. 2002;21(1):42–57.View ArticlePubMedGoogle Scholar
- Task Force of the European Society of Cardiology and the North American Society of Pacing and Electrophysiology. Heart rate variability: standards of measurement, physiological interpretation and clinical use. Circulation. 1996;93(5):1043–65.View ArticleGoogle Scholar
- Hess EP, Agarwal D, Chandra S, Murad MH, Erwin PJ, Hollander JE, Montori VM, Stiell IG. Diagnostic accuracy of the TIMI risk score in patients with chest pain in the emergency department: a meta-analysis. CMAJ. 2010;182(10):1039–44.Google Scholar
- Subbe CP, Kruger M, Rutherford P, Gemmel L. Validation of a modified early warning score in medical admissions. QJM. 2001;94(10):521–6.View ArticlePubMedGoogle Scholar
- Xhyheri B, Manfrini O, Mazzolini M, Pizzi C, Bugiardini R. Heart rate variability today. Prog Cardiovasc Dis. 2012;55(3):321–31.View ArticlePubMedGoogle Scholar
- Voss A, Schroeder R, Vallverdu M, Schulz S, Cygankiewicz I, Vazquez R, Bayes de Luna A, Caminal P. Short-term vs. long-term heart rate variability in ischemic cardiomyopathy risk stratification. Front Physiol. 2013;4:364.Google Scholar
- Nussinovitch U, Cohen O, Kaminer K, Ilani J, Nussinovitch N. Evaluating reliability of ultra-short ECG indices of heart rate variability in diabetes mellitus patients. J Diabetes Complications. 2012;26(5):450–3.View ArticlePubMedGoogle Scholar
- van Ravenswaaij-Arts CM, Kollee LA, Hopman JC, Stoelinga GB, van Geijn HP. Heart rate variability. Ann Intern Med. 1993;118(6):436–47.View ArticlePubMedGoogle Scholar
- Tarvainen MP, Niskanen JP, Lipponen JA, Ranta-Aho PO, Karjalainen PA. Kubios HRV–heart rate variability analysis software. Comput Methods Programs Biomed. 2014;113(1):210–20.View ArticlePubMedGoogle Scholar
- Hosmer JDW, Lemeshow S, Sturdivant RX: Applied Logistic Regression: John Wiley & Sons, Inc.; 2013.Google Scholar
- Ramirez-Villegas JF, Lam-Espinosa E, Ramirez-Moreno DF, Calvo-Echeverry PC, Agredo-Rodriguez W. Heart rate variability dynamics for the prognosis of cardiovascular risk. PLoS One. 2011;6(2):e17060.View ArticlePubMedPubMed CentralGoogle Scholar
- Das MK, Saha C, El Masry H, Peng J, Dandamudi G, Mahenthiran J, McHenry P, Zipes DP. Fragmented QRS on a 12-lead ECG: a predictor of mortality and cardiac events in patients with coronary artery disease. Heart Rhythm. 2007;4(11):1385–92.Google Scholar
- Hartikainen JE, Malik M, Staunton A, Poloniecki J, Camm AJ. Distinction between arrhythmic and nonarrhythmic death after acute myocardial infarction based on heart rate variability, signal-averaged electrocardiogram, ventricular arrhythmias and left ventricular ejection fraction. J Am Coll Cardiol. 1996;28(2):296–304.View ArticlePubMedGoogle Scholar
- Bloomfield DM, Bigger JT, Steinman RC, Namerow PB, Parides MK, Curtis AB, Kaufman ES, Davidenko JM, Shinn TS, Fontaine JM. Microvolt T-wave alternans and the risk of death or sustained ventricular arrhythmias in patients with left ventricular dysfunction. J Am Coll Cardiol. 2006;47(2):456–63.Google Scholar
- Haruta D, Matsuo K, Tsuneto A, Ichimaru S, Hida A, Sera N, Imaizumi M, Nakashima E, Maemura K, Akahoshi M. Incidence and prognostic value of early repolarization pattern in the 12-lead electrocardiogram. Circulation. 2011;123(25):2931–7.Google Scholar
- Tikkanen JT, Anttonen O, Junttila MJ, Aro AL, Kerola T, Rissanen HA, Reunanen A, Huikuri HV. Long-term outcome associated with early repolarization on electrocardiography. N Engl J Med. 2009;361(26):2529–37.Google Scholar
- Six AJ, Cullen L, Backus BE, Greenslade J, Parsonage W, Aldous S, Doevendans PA, Than M. The HEART score for the assessment of patients with chest pain in the emergency department: a multinational validation study. Crit Pathw Cardiol. 2013;12(3):121–6.Google Scholar
- Than M, Flaws D, Sanders S, Doust J, Glasziou P, Kline J, Aldous S, Troughton R, Reid C, Parsonage WA, et al. Development and validation of the Emergency Department Assessment of Chest pain Score and 2 h accelerated diagnostic protocol. Emerg Med Australas. 2014;26(1):34–44.Google Scholar
- Backus BE, Six AJ, Kelder JH, Gibler WB, Moll FL, Doevendans PA. Risk scores for patients with chest pain: evaluation in the emergency department. Curr Cardiol Rev. 2011;7(1):2–8.View ArticlePubMedPubMed CentralGoogle Scholar