|
|
||||||||||
|
J Am Coll Cardiol, 1998; 32:275-282 © 1998 by the American College of Cardiology Foundation |



a Heart Institute, Providence St. Vincent Medical Center, Portland, Oregon, USA
* Division of Cardiology, Department of Medicine and Division of Biometry, Department of Community and Family Medicine, Duke University Medical Center, Durham, North Carolina, USA
Department of Medicine, Washington University School of Medicine, Saint Louis, Missouri, USA
Department of Health Policy and Management, State University of New York, Albany, New York, USA
Department of Medicine, Center for the Evaluative Health Sciences, Dartmouth/Hitchcock Medical Center, Lebanon, New Hampshire, USA
|| Department of Epidemiology, University of Pittsburgh, Pittsburgh, Pennsylvania, USA
Manuscript received May 14, 1997; revised manuscript received March 11, 1998, accepted April 9, 1998.
Address for correspondence: Dr. Peter C. Block, Providence St. Vincent Medical Center, 9205 SW Barnes Rd., Portland, Oregon 97225
peter_block_md{at}phsor.org
| Abstract |
|---|
|
|
|---|
Background. Outcomes of percutaneous coronary interventions depend on patient risk characteristics and disease severity and acuity. Comparing results of interventions has been difficult because definitions of similar variables differ in databases, and variables are not uniformly tracked. Identifying the best predictor variables and standardizing their definitions are a first step in developing a universal stratification instrument.
Methods. A list of empirically derived variables was first tested in eight cardiac databases (158,273 cases). Three end points (in-hospital death, in-hospital coronary artery bypass graft surgery, Q wave myocardial infarction) were chosen for analysis. Univariate and multivariate regression models were used to quantify the predictive value of the variable in each database. The variables were then defined by consensus by a panel of experts.
Results. In all databases patient demographics were similar, but disease severity varied greatly. The most powerful predictors of adverse outcome were measures of hemodynamic instability, disease severity, demographics and comorbid conditions in both univariate and multivariate analyses.
Conclusions. Our analysis identified 29 variables that have the strongest statistical association with adverse outcomes after coronary interventions. These variables were also objectively defined. Incorporation of these variables into every cardiac dataset will provide uniform standards for data collected. Comparisons of outcomes among physicians, institutions and databases will therefore be more meaningful.
| ||||||||||
| Methods |
|---|
|
|
|---|
Databases used.
Eight databases ranging in size from 2,431 to 66,358 cases were used for this analysis (Table 1). Five of the eight databases were single- or multi-institutional clinical databases including all types of coronary interventional cases performed between 1990 and 1996. The National Heart, Lung, and Blood Institute (NHLBI) database was a multi-institution registry performed during 1985 to 1986. The New Approaches to Cardiac Intervention (NACI) Registry database was a multi-institutional clinical registry that included cases involving newer coronary interventional device technologies other than conventional balloon angioplasty only. The Cooperative Cardiac Project (CCP) database was a multi-institutional database limited to patients
65 years undergoing coronary interventional procedures. In total, our final analysis dataset included 158,273 cases.
|
Within each database attempts were made to match existing variable definitions to those set forth by the working group. If a database manager considered that a database variable definition differed significantly, it was not included in the analysis. The availability of predictor variables varied among databases. Missing data were handled by sites in one of two ways: If the variable was missing in >50% of cases within a database, it was deleted from analysis. If the variable was missing in a minority of cases, it was imputed to the median for continuous variables and the lowest risk category for categoric data (e.g., missing ejection fractions at Duke were replaced with a score of 56 [the median ejection fraction for the Duke data], whereas missing comorbid variables [e.g., renal insufficiency] were imputed to the "none" level). These imputation methods are conservative and tend to underestimate the predictive power of a variable. For outcomes, all databases had information on in-hospital death and CABG; only four had information on in-hospital Q wave MI. We also tested whether a variables effect on outcome varied among the eight data sources using a standard test for homogeneity (12).
Univariate analysis. The first step was to construct univariate logistic regression models predicting each of the three outcomes. Each database reported univariate coefficients and standard errors for each variable. To consolidate this large amount of information, these estimates were then combined using meta-analytic methods. The databases were independently analyzed, and then pooled odds ratios from these analyses were developed. Specifically, using a random-effects empirical Bayes methodology model, we calculated a "pooled estimate" for the univariate odds ratio and the confidence interval surrounding these point estimates. This random-effects model provides a more conservative estimate of a variables effect on outcome (13,14).
Multivariate analysis. Because many of the candidate variables describe similar aspects of the patients disease, multivariate logistic regression models were next used to distinguish between "competing" specifications of risk. Each database was asked to place all the variables it had collected into a "full" model and report the coefficients and standard errors for each variable. After fitting this model, each database used an automated stepwise selection algorithm to fit a smaller "stepwise" model that contained only variables significant at an alpha level of 0.05. Finally, to better assess the discrimination abilities of the variables in question, the C-index or area under the ROC curve was computed for each full and stepwise multivariate model (15).
As part of an international conference to further the development of data standards held in Bethesda, Maryland on June 27 to 28, 1996, the variables were reviewed to create explicit, objective definitions of each variable by consensus.
| Results |
|---|
|
|
|---|
|
|
|
|
|
Although many of these same baseline clinical features also predicted in-hospital CABG and Q-wave MI (Tables 5 and 6), these variables tended to be less powerful predictors of these other end points (i.e., lower odds ratios). In addition, certain variables that predicted a higher mortality risk (e.g., ejection fraction) predicted a lower risk for CABG or were not significant predictors of CABG (e.g., congestive heart failure).
Multivariate predictors of events. Tables 7, 8 and 9 display the variables chosen in stepwise multivariate analysis by each database for the three end points. The variables chosen by each database are organized in the tables into four subgroups for classification purposes: 1) demographics; 2) coronary disease severity; 3) comorbidity; 4) catheterization/intervention data. There was a high degree of consistency in the significant multivariate predictors of outcomes across the databases, as was noted in the univariate analysis.
|
|
|
Variable selection.
These data were then used to select the most important prognostic variables for coronary interventional outcomes. This comparison process provided a list of 29 variables that demonstrated an odds ratio >2.0 (or <0.5) in
50% of the databases in the univariate analysis or were a significant predictor identified in a majority of the multivariate analyses. The variables were divided into the categories of demographics, heart disease severity, acuity, comorbidity and procedure details. Consensus definitions for these variables are provided in Table 10.
|
| Discussion |
|---|
|
|
|---|
End points. Another problem is the choice of end points. Adverse outcomes are relatively few (3), so there is a desire to increase the end points, thus improving the robustness of any model by combining several outcomes. Usually, in-hospital mortality, emergency CABG and Q wave infarctions are combined. However, this study points out that individual variables may have interactions opposite in direction to the individual end points, so that their important role is not apparent. This is seen in the case of the variables "depressed ejection fraction" and "percutaneous transluminal coronary angioplasty (PTCA) of a graft," which were associated with increased in-hospital death but not associated with in-hospital CABG.
Definition of end points. The methods used to define the end points chosen for analysis deserve comment. Short-term mortality is defined as "in-hospital death." "Death within 30 days of an intervention" may be better but is at present impractical because of difficulty in obtaining outpatient follow-up information. "All-cause mortality" is not gameable and was therefore chosen. This minimum data set for coronary interventional procedures is not meant to be predictive for all patients undergoing all types of coronary interventional procedures. However, as much as possible we attempted to remain congruent with definitions chosen for CABG (10) so that if outcomes by patient characteristics were compared, data would be available.
Which variables best predict outcome?. It should be emphasized that we intended to identify a minimum dataset for catheter-based interventional cardiology outcomes. Data elements that reflect longer term effects on cardiac disease (e.g., hypertension, lipid profile, family history) are important in any database where the intent is to evaluate longer term outcomes. We realize that other variables that were not tested in this report may be equally predictive of short-term outcomes. The American College of Cardiology database includes our minimum data elements and is an example of a larger, more comprehensive database that might be used to evaluate both short-term and longer range outcomes (17).
Limitations of the study. By necessity, the data on the variables included in this report were retrospectively gathered. Existing variable definitions were matched as closely as possible to the consensus variable definitions. However, our pooled estimates of a specific variables effect size should be considered only as a relative approximation because this effect varied somewhat across individual sites for certain variables. In addition, some important variables, such as jeopardy score (18) or lesion characteristics defined by coronary ultrasound, were not included because they were not available in the databases surveyed. The data were also collected at various times, and most data were collected before the introduction of the new atherectomy devices, stents, and glycoprotein IIb/IIIA platelet receptor antagonists, which may have a significant impact on the importance of lesion specific variables (e.g., thrombus, eccentricity). We used data that predominantly referred to PTCA. As new devices are used, device-specific risk factors may be identified. Some variables amenable to gaming had to be included because of their predictive power (1). In some respects trying to control for gaming may seem "unfairly harsh" in some instances (e.g., in-hospital CABG includes all same-admission CABG, even elective), and even the broad definition of in-hospital death will obviously include some patients with a nonprocedure-related death. We only analyzed variables predicting adverse outcomes and do not imply that databases should be limited to that end point only.
Summary. By analyzing interventional outcomes across several large cardiac databases we were able to select 29 variables that had the strongest statistical association with outcomes. The variables selected are generally objective, easily obtainable and definable. Incorporation of these elements in every cardiac dataset will permit laboratories to be able to provide the information required in this era of managed care and preferred provider contracts as well as permit comparisons of the outcome of coronary interventions.
| References |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
P. Sousa, A. S. Uva, F. Pinto, and on behalf of the investigators of PCI registry of Risk-adjustment model in health outcomes evaluation: a contribution to strengthen assessment towards quality improvement in interventional cardiology Int. J. Qual. Health Care, July 11, 2008; (2008) mzn029v1. [Abstract] [Full Text] [PDF] |
||||
![]() |
B. Kunadian, J. Dunning, A. P Roberts, R. Morley, D. Twomey, J. A Hall, A. G C Sutton, R. A Wright, D. F Muir, and M. A d. Belder Cumulative funnel plots for the early detection of interoperator variation: retrospective database analysis of observed versus predicted results of percutaneous coronary intervention BMJ, April 26, 2008; 336(7650): 931 - 934. [Abstract] [Full Text] [PDF] |
||||
![]() |
C. K. Haan, S. O'Brien, F. H. Edwards, E. D. Peterson, and T. B. Ferguson Trends in emergency coronary artery bypass grafting after percutaneous coronary intervention, 1994-2003. Ann. Thorac. Surg., May 1, 2006; 81(5): 1658 - 1665. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. A. Brinker, C. J. Davidson, and W. Laskey Preventing in-hospital cardiac and renal complications in high-risk PCI patients Eur. Heart J. Suppl., August 1, 2005; 7(suppl_G): G13 - G24. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. R. Flynn, C. Barrett, F. G. Cosio, A. K. Gitt, L. Wallentin, P. Kearney, M. Lonergan, E. Shelley, and M. L. Simoons The Cardiology Audit and Registration Data Standards (CARDS), European data standards for clinical cardiology practice Eur. Heart J., February 1, 2005; 26(3): 308 - 313. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. P. Gold, K. E. Torres, W. Maldarelli, I. Zhuravlev, D. Condit, and J. Wasnick Improving Outcomes in Coronary Surgery: The Impact of Echo-Directed Aortic Cannulation and Perioperative Hemodynamic Management in 500 Patients Ann. Thorac. Surg., November 1, 2004; 78(5): 1579 - 1585. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. Singh, C. S. Rihal, R. J. Lennon, K. N. Garratt, and D. R. Holmes Jr Comparison of Mayo Clinic risk score and American College of Cardiology/American Heart Association lesion classification in the prediction of adverse cardiovascular outcome following percutaneous coronary interventions J. Am. Coll. Cardiol., July 21, 2004; 44(2): 357 - 361. [Abstract] [Full Text] [PDF] |
||||
![]() |
B. M. Rothenberg, T. Pearson, J. Zwanziger, and D. Mukamel Explaining disparities in access to high-quality cardiac surgeons Ann. Thorac. Surg., July 1, 2004; 78(1): 18 - 24. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. A. Hlatky Comorbidity andoutcome in patientswith coronary artery disease J. Am. Coll. Cardiol., February 18, 2004; 43(4): 583 - 584. [Full Text] [PDF] |
||||
![]() |
M. Lotfi, K. Mackie, V. Dzavik, and P. H. Seidelin Impact of delays to cardiac surgery after failed angioplasty and stenting J. Am. Coll. Cardiol., February 4, 2004; 43(3): 337 - 342. [Abstract] [Full Text] [PDF] |
||||
![]() |
D. G. Conaway, J. House, K. Bandt, L. Hayden, A. M. Borkon, and J. A. Spertus The elderly: health status benefits and recovery of function one year after coronary artery bypass surgery J. Am. Coll. Cardiol., October 15, 2003; 42(8): 1421 - 1426. [Abstract] [Full Text] [PDF] |
||||
![]() |
D. R. Holmes, F. Selzer, J. M. Johnston, S. F. Kelsey, R. Holubkov, H. A. Cohen, D. O. Williams, and K. M. Detre Modeling and Risk Prediction in the Current Era of Interventional Cardiology: A Report From the National Heart, Lung, and Blood Institute Dynamic Registry Circulation, April 15, 2003; 107(14): 1871 - 1876. [Abstract] [Full Text] [PDF] |
||||
![]() |
D. J. Malenka, D. E. Wennberg, H. A. Quinton, D. J. O'Rourke, P. D. McGrath, S. J. Shubrooks Jr, G. T. O'Connor, T. J. Ryan Jr, J. F. Robb, M. A. Kellett Jr, et al. Gender-related changes in the practice and outcomes of percutaneous coronary interventions in northern New England from 1994 to 1999 J. Am. Coll. Cardiol., December 18, 2002; 40(12): 2092 - 2101. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. A. Spertus, P. Jones, M. McDonell, V. Fan, and S. D. Fihn Health Status Predicts Long-Term Outcome in Outpatients With Coronary Disease Circulation, July 2, 2002; 106(1): 43 - 49. [Abstract] [Full Text] [PDF] |
||||
![]() |
R. E. Shaw, H. V. Anderson, R. G. Brindis, R. J. Krone, L. W. Klein, C. R. McKay, P. C. Block, L. J. Shaw, K. Hewitt, W. S. Weintraub, et al. Development of a risk adjustment mortality model using the American College of Cardiology-National Cardiovascular Data Registry (ACC-NCDR) experience: 1998-2000 J. Am. Coll. Cardiol., April 3, 2002; 39(7): 1104 - 1112. [Abstract] [Full Text] [PDF] |
||||
![]() |
P. A. Cowper, E. D. Peterson, E. R. DeLong, M. B. Wightman, R. P. Wawrzynski, L. H. Muhlbaier, and M. H. Sketch Jr The impact of statistical adjustment on economic profiles of interventional cardiologists J. Am. Coll. Cardiol., November 1, 2001; 38(5): 1416 - 1423. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. Moscucci, E. Kline-Rogers, D. Share, M. O'Donnell, A. Maxwell-Eward, W. L. Meengs, P. Kraft, A. C. DeFranco, J. L. Chambers, K. Patel, et al. Simple Bedside Additive Tool for Prediction of In-Hospital Mortality After Percutaneous Coronary Interventions Circulation, July 17, 2001; 104(3): 263 - 268. [Abstract] [Full Text] [PDF] |
||||
![]() |
T. M. Bashore, E. R. Bates, P. B. Berger, D. A. Clark, J. T. Cusma, G. J. Dehmer, M. J. Kern, W. K. Laskey, M. P. O'Laughlin, S. Oesterle, et al. American College of Cardiology/Society for Cardiac Angiography and Interventions Clinical Expert Consensus Document on Cardiac Catheterization Laboratory Standards: A report of the American College of Cardiology Task Force on Clinical Expert Consensus Documents endorsed by the American Heart Association and the Diagnostic and Interventional Catheterization Committee of the Council on Clinical Cardiology of the AHA J. Am. Coll. Cardiol., June 15, 2001; 37(8): 2170 - 2214. [Full Text] [PDF] |
||||
![]() |
S. C. Smith Jr, J. T. Dove, A. K. Jacobs, J. Ward Kennedy, D. Kereiakes, M. J. Kern, R. E. Kuntz, J. J. Popma, H. V. Schaff, D. O. Williams, et al. ACC/AHA guidelines for percutaneous coronary intervention (revision of the 1993 PTCA guidelines): A report of the American College of Cardiology/ American Heart Association Task Force on practice guidelines (Committee to revise the 1993 guidelines for percutaneous transluminal coronary angioplasty) endorsed by the Society for Cardiac Angiography and Interventions J. Am. Coll. Cardiol., June 15, 2001; 37(8): 2239 - 2239. [Full Text] [PDF] |
||||
![]() |
N. W. Niles, P. D. McGrath, D. Malenka, H. Quinton, D. Wennberg, S. J. Shubrooks, J. F. Tryzelaar, R. Clough, M. J. Hearne, F. Hernandez Jr, et al. Survival of patients with diabetes and multivessel coronary artery disease after surgical or percutaneous coronary revascularization: results of a large regional prospective study J. Am. Coll. Cardiol., March 15, 2001; 37(4): 1008 - 1015. [Abstract] [Full Text] [PDF] |
||||
![]() |
A. Rodriguez, V. Bernardi, J. Navia, J. Baldi, L. Grinfeld, J. Martinez, D. Vogel, R. Grinfeld, A. Delacasa, M. Garrido, et al. Argentine randomized study: coronary angioplasty with stenting versus coronary bypass surgery in patients with multiple-vessel disease (ERACI II): 30-day and one-year follow-up results J. Am. Coll. Cardiol., January 1, 2001; 37(1): 51 - 58. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. M. Brooks, R. H. Jones, R. G. Bach, B. R. Chaitman, M. J. Kern, T. A. Orszulak, D. Follmann, G. Sopko, E. H. Blackstone, and R. M. Califf Predictors of Mortality and Mortality From Cardiac Causes in the Bypass Angioplasty Revascularization Investigation (BARI) Randomized Trial and Registry Circulation, June 13, 2000; 101(23): 2682 - 2689. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. Lindsay Jr., E. E. Pinnow, and A. D. Pichard Frequency of major adverse cardiac events within one month of coronary angioplasty: a useful measure of operator performance J. Am. Coll. Cardiol., December 1, 1999; 34(7): 1916 - 1923. [Abstract] [Full Text] [PDF] |
||||
![]() |
G. T. O'Connor, D. J. Malenka, H. Quinton, J. F. Robb, M. A. Kellett Jr., S. Shubrooks, W. A. Bradley, M. J. Hearne, M. W. Watkins, D. E. Wennberg, et al. Multivariate prediction of in-hospital mortality after percutaneous coronary interventions in 1994-1996 J. Am. Coll. Cardiol., September 1, 1999; 34(3): 681 - 691. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. Moscucci, G. T. O'Connor, S. G. Ellis, D. J. Malenka, J. Sievers, E. R. Bates, D. W. M. Muller, S. W. Werns, E. K. Rogers, D. Karavite, et al. Validation of risk adjustment models for in-hospital percutaneous transluminal coronary angioplasty mortality on an independent data set J. Am. Coll. Cardiol., September 1, 1999; 34(3): 692 - 697. [Abstract] [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | SUBSCRIPTIONS | CURRENT ISSUE | PAST ISSUES | CARDIOSOURCE | SEARCH | HELP | FEEDBACK |