- Open Access
Development of a risk score to identify patients with type 2 diabetes mellitus and multivessel coronary artery disease who can defer bypass surgery
Diagnostic and Prognostic Research volume 3, Article number: 3 (2019)
Current American College of Cardiology/American Heart Association (ACC/AHA) guidelines provide a class I recommendation for patients with type 2 diabetes mellitus and multivessel coronary artery disease (CAD) to be treated with coronary artery bypass graft surgery (CABG). However, these patients are heterogeneous in terms of the risks and benefits associated with CABG. We sought to develop a risk score to identify low-risk patients with diabetes and multivessel CAD in whom CABG can be safely deferred.
Patients in the CABG strata randomized to intensive medical therapy (IMT) in the Bypass Angioplasty Revascularization Investigation 2 Diabetes (BARI 2D) trial who experienced death, myocardial infarction (MI), or stroke were compared with those who did not. We developed a risk score for death, MI, or stroke using a Cox proportional hazards model that included the following variables: age, history of heart failure, history of hypercholesterolemia, history of stroke, transient ischemic attack, serum creatinine, insulin use, myocardial jeopardy index, and HbA1c.
Among patients with a risk score less than the median, those randomized to IMT or prompt CABG experienced similar rates of event-free survival at 5 years (77.8% vs. 83.2%, logrank P = 0.24). Among patients with a risk score greater than the median, those randomized to IMT experienced worse rates of event-free survival at 5 years than those randomized to prompt CABG (60.3% vs 73.2%, logrank P = 0.01).
A novel risk score identifies low-risk patients with diabetes and stable, symptomatic multivessel CAD in whom CABG can be safely deferred.
The American College of Cardiology/American Heart Association (ACC/AHA) guidelines for the management of patients with type 2 diabetes mellitus (T2DM) and stable, symptomatic, multivessel coronary artery disease (CAD) recommend prompt coronary artery bypass graft surgery (CABG) . This recommendation is based on randomized controlled trials that demonstrated improved long-term outcomes when these patients are treated with prompt CABG as compared to intensive medical management (IMT) or percutaneous coronary intervention (PCI) [2, 3]. In low-risk patients with T2DM (e.g., single vessel or two-vessel disease), the European Society of Cardiology (ESC) recommends treatment with initial optimal medical therapy including an angiotensin-converting enzyme (ACE) inhibitor, beta-blocker, aspirin, and statin reserving CABG for refractory symptoms since revascularization has not been shown to have a mortality benefit in these patients [4, 5].
As the disparate guidelines suggest, there is an ongoing debate regarding the optimal management of patients with T2DM and multivessel CAD . This is a heterogeneous population with variable outcomes reported in observational studies, randomized controlled trials, and meta-analyses, supporting either early revascularization or a conservative approach with initial IMT [3, 5]. To our knowledge, there are no tools to risk-stratify patients with T2DM and multivessel CAD to guide shared decision-making discussions regarding revascularization.
The Bypass Angioplasty Revascularization Investigation 2 Diabetes (BARI 2D) trial compared the management of patients with T2DM and symptomatic CAD with prompt revascularization using PCI or CABG and IMT versus IMT alone with revascularization reserved for refractory symptoms . Overall, there was no difference in mortality between the revascularization and IMT groups. Within the CABG strata, however, a reduction in the composite outcome of death, myocardial infarction (MI), and stroke was observed in the patients who underwent prompt CABG compared with those managed with IMT alone. The improved outcomes with prompt CABG (in the CABG strata) appear to be influenced primarily by a reduction in non-fatal MI in the CABG group.
A prior analysis performed in the CABG arm of BARI 2D to identify a subgroup of patients within the IMT arm responsible for the inferior outcomes focused on the complexity of CAD and left ventricular ejection fraction (LVEF) . Another analysis of BARI 2D failed to identify factors at baseline that would predict the need for revascularization in the IMT arm . The aim of our analysis was to create a multivariable risk score to identify patients in the CABG strata at the time of randomization of BARI 2D for whom surgery may be safely deferred.
The design and outcomes of the BARI 2D study have been reported previously [5, 9]. Briefly, BARI 2D was a multicenter, international randomized control trial that investigated the management of stable CAD in patients with T2DM. CAD was defined as greater than or equal to 50% stenosis of a major epicardial artery with an associated positive stress test or greater than or equal to 70% stenosis of a major epicardial artery with classic angina. Patients were excluded if they required immediate revascularization or had significant left main disease.
Patients were randomized to two different strategies of revascularization management and diabetes management. Patients were assigned to the CABG or PCI strata a priori by the enrolling physician based on clinical judgment and then randomized to prompt revascularization with IMT or IMT alone. Angiographic factors that influenced selection of CABG over PCI included triple vessel disease, a diameter stenosis greater than or equal to 70% in the left anterior descending (LAD) coronary artery, a stenosis greater than or equal to 50% in the proximal LAD, and the presence of total occlusions and greater than two class C lesions. Non-angiographic factors included being enrolled outside of the USA, being randomized prior to the availability of drug eluting stents (25 April 2003), and age greater than 65 years .
Patients were also randomized to insulin-sensitizing therapy or insulin provision therapy, both targeting a hemoglobin A1c (HbA1c) < 7.0%. Patients were followed monthly for the first 6 months, and revascularization was permitted for refractory symptoms, worsening angina, or acute coronary syndromes. From 1 January 2001 to 31 March 2005, patients were enrolled at 49 different sites in North America, Central America, South America, and Europe. Overall, 2368 patients were enrolled, of whom 763 (32%) were in the CABG strata.
The BARI 2D dataset was obtained upon request from the Biologic Specimen and Data Repository Information Coordinating Center of the National Heart Lung and Blood Institute under a data use agreement. The Washington University Human Research Protection Office granted this study an exemption from Institutional Review Board oversight due to the de-identified nature of the dataset. One author (EN) had full access to the data and assumes responsibility for the integrity of the data and analyses performed.
Risk score development
A risk score to predict the likelihood of a composite outcome of death, MI, or stroke was developed from the IMT arm of the CABG strata. A univariate Cox proportional hazards model was built to evaluate all baseline characteristics contained in the dataset as predictors of the composite outcome. Date of randomization was the start date, and subjects were followed until first occurrence of death, MI, or stroke or until last available follow-up. The hazard ratio (HR) in predicting the composite outcome, 95% confidence interval (CI), and P value were obtained from model results. Prior to developing the risk score, missing data were imputed using a sequential imputation algorithm from the multiple imputations procedure available in SAS. The discriminant function method (SAS option DISCRIM) was used to impute categorical variables [11,12,13]. Continuous variables were imputed using a regression predictive mean matching algorithm. The predictive mean matching method is an imputation method available for continuous variables. It is similar to the regression method except that for each missing value, it imputes a value randomly from a set of observed values whose predicted values are closest to the predicted value for the missing value from the simulated regression model [14, 15]. The predictors included in the multivariable Cox proportional hazards model were identified based on clinical relevance and univariate model results (univariate P value < 0.10) and included age, history of congestive heart failure (CHF), history of hypercholesterolemia, history of stroke or transient ischemic attack (TIA), serum creatinine, insulin use, myocardial jeopardy index, and HbA1c. While a history of stroke or TIA and HbA1c did not meet criteria for inclusion based on univariate P value, these were included as they have particular relevance to patients with diabetes undergoing cardiac surgery. The myocardial jeopardy index is the ratio of myocardial territories supplied by major branch vessels with greater than or equal to 50% stenosis to the total number of myocardial territories. As a J-shaped association between HbA1c and outcome has previously been shown, both linear and quadratic terms for HbA1c were included . Some variables that were significant in the Cox proportional hazards model were not included in the risk score because they are not commonly obtained clinically and included urine albumin to creatinine ratio, ankle to brachial index, and insulin concentration.
The performance of the risk score in predicting the composite outcome of death, MI, or stroke was internally evaluated using a jack-knife cross-validation method. Under this method, a subject is removed from the sample and the model is developed on the remaining sample. The prediction of the model is then tested on the removed subject. This is repeated so that all subjects serve once to test model performance . A receiver operating characteristics (ROC) curve was created for the 5-year composite outcome of death, MI, or stroke, and the area under the curve was determined to summarize the ability of the predicted score to discriminate events and non-events. Kaplan-Meier curves were created by risk score tertile to examine relative score performance. The calibration slope was determined to assess agreement.
A point scoring system was developed from the model to help facilitate ease of use, based on the methods of Sullivan et al. . This method estimates the predicted risk from the Cox model by assigning integer points to each level of risk factor. Levels are designed to reflect clinically relevant states of the risk factor. For example, we chose three levels of risk for HbA1c: less than 7%, 7 to 9%, and greater than 9%. The risk estimate is then obtained by comparing the sum of points to a reference table generated by the Cox model. The possible point range in our score was 0–25. The estimated 1- and 5-year risks were determined for each point score. Patients randomized to prompt CABG were used as external validation of the point score. The ROC curve for 5-year composite outcome was created along with the corresponding area under the curve. Kaplan-Meier curves were created based on quartiles of risk score in the prompt CABG arm and were compared with the logrank test.
To compare the effects of IMT and CABG on survival, Kaplan-Meier curves were created for the IMT sample and prompt CABG sample within low-risk and, separately, within high-risk patients. The logrank test was used to compare curves within each group. Based on the survival curves among patients randomized to prompt CABG based on quartiles of risk score, the median score was chosen as the delineator between low- and high-risk score. All analyses were conducted in SAS v9.4 (SAS Institute Inc., Cary, NC, USA) and R packages SurvC1 and survivalROC.
Among the 763 patients in the CABG strata of BARI 2D, 385 were randomized to IMT and 378 to prompt CABG and IMT. Baseline characteristics are presented in Table 1, and the univariate Cox proportional hazards model results for predictors of death, MI, and stroke are displayed in Table 2. Patients who experienced the composite outcome tended to be older and have a higher serum creatinine, greater degrees of proteinuria, and higher myocardial jeopardy score. The following variables were selected based on the results of the Cox proportional hazards model and clinical relevance: age, history of CHF, history of hypercholesterolemia, history of stroke/TIA, serum creatinine, insulin use, myocardial jeopardy index, and HbA1c. The coefficients from the final model are presented in Table 3.
CHF, stroke, insulin use, and hypercholesterolemia were treated as binary variables with presence of the variable being coded as 1 and absence as 0.
Internal validation of the risk score using the data from patients randomized to the IMT arm based on risk score tertile demonstrated distinct survival curves (logrank P < 0.0001) (Fig. 1a). ROC analysis yielded an AUC of 0.62 (CI 0.57–0.67) (Fig. 1b). The calibration slope is 0.76.
The point score system based on the Cox regression model is presented in Table 4. The range of possible scores is from 0 to 25 with a median of 10. Estimated rates of the composite outcome at 1 and 5 years are reported for select values of the point score in Table 5. Subjects randomized to prompt CABG served as the external validation cohort for the point score; ROC analysis yielded an AUC of 0.62 (CI 0.54–0.69) (Fig. 2a). Kaplan-Meier curves based on quartiles of risk score in the prompt CABG group yielded distinct survival curves (logrank P = 0.0123) (Fig. 2b), consistent with results from the Cox regression model results. By examining the survival curves based on quartiles, the survival curves separate based on the median score. Therefore, we determined the median score, 10, should be the delineator between low and high scores.
Among all patients in the CABG strata, those with risk scores less than the median had similar event-free survival curves, regardless of revascularization strategy (Fig. 3a). Among those with risk scores higher than the median, patients in the IMT group had significantly reduced event-free survival (Fig. 3b). At 5 years, those with risk scores higher than the median randomized to IMT had a 65% survival rate, while those randomized to prompt CABG had a 73% survival rate. This results in an absolute risk reduction (ARR) of 8% and a number needed to treat (NNT) of 12.5 when comparing prompt CABG to IMT among high-risk patients.
In this post hoc analysis of the BARI 2D trial, we developed and internally validated a novel risk score that predicted the outcomes of death, MI, and stroke in patients with T2DM and multivessel CAD. We further created a simplified point score system for clinical ease of use that performs similarly to the Cox regression model in terms of predicting overall event-free survival. To our knowledge, this is the first such risk score created for use in shared decision-making regarding revascularization in patients with T2DM and multivessel CAD.
Our risk score incorporates multiple factors that are considered in clinical decision making and have been shown in prior studies to have a prognostic value. For example, in patients with a heart failure, studies have shown that CABG has a mortality benefit [19, 20]. Extent of atherosclerosis is also known to be a predictor of poor outcomes and is incorporated in the risk score as the myocardial jeopardy score . Additionally, the risk score incorporates HbA1c and use of insulin, which relate to the severity of an individual’s T2DM which is a known risk factor for perioperative and long-term mortality after CABG . In our multivariate analysis, a history of hypercholesterolemia was found to be a protective factor. While counterintuitive, this may reflect more aggressive cholesterol management and associated risk reduction in those patients.
There is conflicting evidence regarding the optimal management of patients with multivessel CAD. T2DM increases the risk for cardiovascular death but outcomes of patients with T2DM and CAD treated with revascularization are inconsistent concerning a mortality benefit from revascularization. Furthermore, T2DM is a known risk factor for poor outcomes after CABG . In the BARI 2D cohort, there was no mortality benefit from revascularization in the PCI or CABG arms when compared to IMT . In the Future REvascularization Evaluation in patients with Diabetes mellitus: Optimal management of Multivessel disease (FREEDOM) trial, CABG reduced all-cause mortality compared to PCI (10.9% vs 16.3% P = 0.049), but there was no IMT comparator arm . Recent observational data further supported results from FREEDOM by demonstrating a mortality benefit for CABG compared to PCI in patients with diabetes and stable CAD and acute coronary syndromes .
Subset analyses of the BARI 2D cohort have shown that the extent of atherosclerosis and reduced LVEF predict the reduction in mortality from prompt CABG . Our findings extend those findings by combining angiographic and clinical risk factors into one risk score. Our risk score includes additional variables particularly relevant to patients with T2DM: serum creatinine, use of insulin, and HbA1c. The ROC analyses further demonstrate the discriminatory ability of our risk score and the simplified point score. While the Synergy between Percutaneous Coronary Intervention with Taxus and Cardiac Surgery (SYNTAX) score is useful in assessing anatomic complexity of coronary disease, it does not incorporate clinical factors and its intended use is for shared decision-making in choosing between PCI and CABG, not between IMT and CABG as the current risk score is intended .
The clinical implication of these findings, if validated in other populations, is that patients with diabetes and symptomatic, multivessel CAD who currently would be recommended to undergo prompt CABG, may be safely treated with initial IMT alone if they have a low-risk score (less than the median), as these patients experienced similar rates of event-free survival whether they were treated with prompt CABG or IMT. These patients should be closely monitored for the development of refractory ischemic symptoms and, at that point, be referred for CABG. Among the patients with an elevated risk score, those treated with IMT had worse event-free survival and should, therefore, continue to be recommended prompt CABG. Thus, use of this risk score in clinical practice may be able to identify those who would benefit most from CABG without exposing all patients to the risks and costs of surgery.
Specifically, among high-risk patients, the ARR of CABG versus IMT at 5 years is 8% giving an NNT of 12.5 which is well within the range of other accepted treatments of cardiovascular disease. However, the NNT is based on the 5-year rate of freedom from death, MI, or stroke and is calculated for an “average” patient with a 0.35 risk for these outcomes. It would be the same value if the 5-year event-free survival rates were 2% and 10%, yet from the patient perspective, the difference in frame of reference may be very significant. Thus, while the NNT is reasonable, it is simply a point estimate, and the patient-specific benefit will have much greater variability depending on the baseline risk and frame of reference.
There are limitations to our study. The BARI 2D trial was a randomized controlled trial, and patients who participate in such studies may not be reflective of the overall population, thus limiting generalizability. In addition, the ongoing care, monitoring, and intensive lifestyle modification counseling that was provided in BARI 2D may not be easily achieved in other settings.
Patients with T2DM, multivessel CAD, and a low-risk score can be managed safely with IMT and close follow-up whereas those with an elevated risk score should continue to be offered prompt CABG.
Fihn SD, Blankenship JC, Alexander KP, et al. 2014 ACC/AHA/AATS/PCNA/SCAI/STS focused update of the guideline for the diagnosis and management of patients with stable ischemic heart disease: a report of the American College of Cardiology/American Heart Association Task Force on Practice Guidelines, and the American Association for Thoracic Surgery, Preventive Cardiovascular Nurses Association, Society for Cardiovascular Angiography and Interventions, and Society of Thoracic Surgeons. Circulation. 2014;130:1749–67.
Hueb W, Lopes N, Gersh BJ, et al. Ten-year follow-up survival of the Medicine, Angioplasty, or Surgery Study (MASS II): a randomized controlled clinical trial of 3 therapeutic strategies for multivessel coronary artery disease. Circulation. 2010;122:949–57.
Farkouh ME, Domanski M, Sleeper LA, et al. Strategies for multivessel revascularization in patients with diabetes. N Engl J Med. 2012;367:2375–84.
Task Force M, Montalescot G, Sechtem U, et al. 2013 ESC guidelines on the management of stable coronary artery disease: the task force on the management of stable coronary artery disease of the European Society of Cardiology. Eur Heart J. 2013;34:2949–3003.
Group BDS, Frye RL, August P, et al. A randomized trial of therapies for type 2 diabetes and coronary artery disease. N Engl J Med. 2009;360:2503–15.
Stone GW, Hochman JS, Williams DO, et al. Medical therapy with versus without revascularization in stable patients with moderate and severe ischemia: the case for community equipoise. J Am Coll Cardiol. 2016;67:81–99.
Brooks MM, Chaitman BR, Nesto RW, et al. Clinical and angiographic risk stratification and differential impact on treatment outcomes in the Bypass Angioplasty Revascularization Investigation 2 Diabetes (BARI 2D) trial. Circulation. 2012;126:2115–24.
Krone RJ, Althouse AD, Tamis-Holland J, et al. Appropriate revascularization in stable angina: lessons from the BARI 2D trial. Can J Cardiol. 2014;30:1595–601.
Brooks MM, Frye RL, Genuth S, et al. Hypotheses, design, and methods for the Bypass Angioplasty Revascularization Investigation 2 Diabetes (BARI 2D) trial. Am J Cardiol. 2006;97:9G–19G.
Kim LJ, King SB 3rd, Kent K, et al. Factors related to the selection of surgical versus percutaneous revascularization in diabetic patients with multivessel coronary artery disease in the BARI 2D (Bypass Angioplasty Revascularization Investigation in Type 2 Diabetes) trial. JACC Cardiovasc Interv. 2009;2:384–92.
Schafer JL. Multiple Imputation: A Primer. Stat Methods Med Res. 1999;8:3–15.
van Buuren S, Boshuizen HC, Knook DL. Multiple imputation of missing blood pressure covariates in survival analysis. Stat Med. 1999;18:681–94.
Rubin DB. Multiple imputation for nonresponse in surveys. New York: Wiley; 1987.
Heitjan F, Little RJA. Multiple imputation for the fatal accident reporting system. Appl Stat. 1991;40:13–29.
Schenker N, Taylor JMG. Partially parametric techniques for multiple imputation. Comput Stat Data Anal. 1996;22:425–46.
Arnold LW, Wang Z. The HbA1c and all-cause mortality relationship in patients with type 2 diabetes is J-shaped: a meta-analysis of observational studies. Rev Diabet Stud. 2014;11:138–52.
Efron B, Gong G. A leisurely look at the bootstrap, the jackknife, and cross-validation. Am Stat. 1983;37:36–48.
Sullivan LM, Massaro JM, D’Agostino RB Sr. Presentation of multivariate data for clinical use: the Framingham study risk score functions. Stat Med. 2004;23:1631–60.
Passamani E, Davis KB, Gillespie MJ, Killip T. A randomized trial of coronary artery bypass surgery. Survival of patients with a low ejection fraction. N Engl J Med. 1985;312:1665–71.
Velazquez EJ, Lee KL, Deja MA, et al. Coronary-artery bypass surgery in patients with left ventricular dysfunction. N Engl J Med. 2011;364:1607–16.
Halkos ME, Lattouf OM, Puskas JD, et al. Elevated preoperative hemoglobin A1c level is associated with reduced long-term survival after coronary artery bypass surgery. Ann Thorac Surg. 2008;86:1431–7.
Thourani VH, Weintraub WS, Stein B, et al. Influence of diabetes mellitus on early and late outcome after coronary artery bypass grafting. Ann Thorac Surg. 1999;67:1045–52.
Ramanathan K, Abel JG, Park JE, et al. Surgical versus percutaneous coronary revascularization in patients with diabetes and acute coronary syndromes. J Am Coll Cardiol. 2017;70:2995–3006.
Cavalcante R, Sotomi Y, Mancone M, et al. Impact of the SYNTAX scores I and II in patients with diabetes and multivessel coronary disease: a pooled analysis of patient level data from the SYNTAX, PRECOMBAT, and BEST trials. Eur Heart J. 2017;38(25):1969–77.
This research did not receive any specific grant from funding agencies in the public, commercial, or not-for-profit sectors.
Availability of data and materials
The data used for this analysis are available from the National Heart, Lung and Blood Institute Biologic Specimen and Data Repository Information Coordinating Center (https://biolincc.nhlbi.nih.gov/home/).
Ethics approval and consent to participate
The Human Research Protection Office at Washington University granted this study exemption from Institutional Review Board oversight. Patients enrolled in the original BARI 2D trial provided informed consent and the study received ethics approval at each of the enrolling sites.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Perry, A., Chung, M.J., Novak, E. et al. Development of a risk score to identify patients with type 2 diabetes mellitus and multivessel coronary artery disease who can defer bypass surgery. Diagn Progn Res 3, 3 (2019). https://doi.org/10.1186/s41512-019-0048-7
- Coronary artery disease
- Diabetes mellitus
- Coronary artery bypass graft surgery