CLINICAL STUDIES
The effects of New Yorks bypass surgery provider profiling on access to care and patient outcomes in the elderly
Eric D. Peterson, MD, MPH* ,
Elizabeth R. DeLong, PhD* ,
James G. Jollis, MD, FACC* ,
Lawrence H. Muhlbaier, PhD* and
Daniel B. Mark, MD, MPH, FACC*
* Outcomes Research and Assessment Group, Duke Clinical Research Institute, Durham, North Carolina, USA
Division of Cardiology, Department of Medicine, Duke University Medical Center, Durham, North Carolina, USA
Division of Biometry, Department of Community and Family Medicine, Duke University Medical Center, Durham, North Carolina, USA
Manuscript received November 19, 1997;
revised manuscript received June 2, 1998,
accepted June 12, 1998.
Address for correspondence: Dr. Eric D. Peterson, Box 3236, Duke University Medical Center, Durham, North Carolina 27710 PETER016{at}MC.DUKE.EDU
 |
Abstract
|
|---|
Objective. The aim of this study was to examine the effects of provider profiling on bypass surgery access and outcomes in elderly patients in New York.
Background. Since 1989, New York (NY) has compiled provider-specific bypass surgery mortality reports. While some have proposed that "provider profiling" has led to lower surgical mortality rates, critics have suggested that such programs lower in-state procedural access (increasing out-of-state transfers) without improving patient outcomes.
Methods. Using national Medicare data, we examined trends in the percentages of NY residents aged 65 years or older receiving out-of-state bypass surgery between 1987 and 1992 (before and after program initiation). We also examined in-state procedure use among elderly myocardial infarction patients during this period. Finally, we compared trends in surgical outcomes in NY Medicare patients with those for the rest of the nation.
Results. Between 1987 and 1992, the percentage of NY residents receiving bypass out-of-state actually declined (from 12.5% to 11.3%, p < 0.01 for trend). An elderly patients likelihood for bypass following myocardial infarction in NY increased significantly since the programs initiation. Between 1987 and 1992, unadjusted 30-day mortality rates following bypass declined by 33% in NY Medicare patients compared with a 19% decline nationwide (p < 0.001). As a result of this improvement, NY had the lowest risk-adjusted bypass mortality rate of any state in 1992.
Conclusions. We found no evidence that NYs provider profiling limited procedure access in NYs elderly or increased out-of-state transfers. Despite an increasing preoperative risk profile, procedural outcomes in NY improved significantly faster than the national average.
In 1989, the New York (NY) State Department of Health began collecting detailed clinical data on all coronary artery bypass surgery cases performed in that state. These data were then used to develop hospital- and surgeon-specific risk-adjusted mortality reports (16). In 1990, a NY hospital was suspended from performing bypass surgery, in part because their observed mortality significantly exceeded the expected rate. In response to a 1991 lawsuit, NY officials were required to publicly release surgeon-specific outcomes data under the Freedom of Information Act (7). Since 1992, the NY State Department of Health has voluntarily released annual provider-specific procedure mortality profiles.
The impact of NYs provider-profiling effort has been controversial. Hannan et al. (1) have reported that overall unadjusted and risk-adjusted bypass surgery mortality rates declined by 21% and 41%, respectively, between 1989 and 1992. They concluded that much of this improvement in procedural outcomes might be due to NYs profiling efforts. In contrast, others suggested that the improved procedural outcomes in NY resulted from a change in patient selection rather than an actual improvement in quality of care (8). Surgeons may have deferred performing bypass on higher-risk patients either by transferring these patients to hospitals outside NY, or by directly refusing to offer the procedure in high-risk situations. Both of these behaviors have been anecdotally reported. Omoigui et al. (9) noted that patient transfers to the Cleveland Clinic from NY hospitals rose by 31% between 1989 and 1993. These NY transfers had generally higher risk profiles than patients transferred from Ohio or other states. Similarly, a New York Times reporter detailed how her father was refused open heart surgery in NY, presumably because of several surgeons concern for their own outcomes statistics (10). A third explanation for NYs declining mortality was that it merely reflected concurrent national improvements in surgical outcomes. For example, Ghali et al. (11) recently reported that Massachusetts experienced declines in bypass surgery mortality similar to those reported in NY despite not having a statewide profiling effort.
Our study objectives were to use the national Medicare database to assess the impact of NYs provider profiling program on procedure access and patient outcomes. First, we examined whether provider profiling had increased the percentage of NYs elderly residents going out-of-state for bypass surgery. Second, we investigated whether the use of bypass surgery following myocardial infarction (MI) had declined in NYs elderly since the initiation of provider profiling. Finally, we examined whether bypass surgery outcomes were improving more rapidly in NY than in the rest of the nation during this period.
 |
Methods
|
|---|
Data sources.
Our primary data source was the Medicare claims files provided by the Health Care Financing Administration (HCFA). These included the Medicare Provider Analysis and Review File (used by HCFA between 1987 and 1990) and the newer Medicare claims format, the National Claims History Files (used since 1991). Both files contain demographic and limited clinical and procedural information (ICD-9-CM codes) on all in-patient hospitalizations that are billed to Medicare. A patients residence was defined by his/her primary Medicare mail ing address. Medicare hospital identifier codes were also used to define the location of a specific hospital admission. Mortality data through the first quarter of 1993 came from Medicare records and date-of-death files.
Patient populations.
Our overall bypass surgery study population consisted of all Medicare patients age 65 years who underwent bypass surgery (ICD-9-CM codes 36.10 through 36.19) between 1987 to 1992 in a U.S. hospital. To avoid counting patients twice, patients undergoing multiple bypass procedures during the study period were included only once, defined by the initial procedure. We also excluded Medicare patients who were under age 65 years, those Medicare benefits as part of the Railroad Retirement Board or because of end-stage renal disease.
We also examined trends in the use of bypass surgery during the initial episode of care (index hospitalization linked with between-hospital transfers) in higher risk elderly patient subsets who were admitted to NY hospitals with an acute MI. Patients were considered to have been admitted for an acute MI if their principal diagnosis was ICD-9-CM code 410, or, if they had a secondary diagnosis of MI and a principal diagnosis of a complication of infarction (such as papillary muscle rupture). We also examined bypass surgery use in very high risk MI subgroups including those with advanced age (e.g., 75 to 80 years) and those with other preoperative risk factors such as congestive heart failure, diabetes mellitus and renal insufficiency (2,12,13).
Data analysis.
We compared demographic and clinical characteristics for patients undergoing bypass surgery in NY hospitals during the study period with those receiving procedures in the rest of the nation (U.S. non-NY). We also examined trends in the yearly number, rate and baseline characteristics for CABG procedures performed in NY hospitals. The yearly NY CABG rate was calculated by dividing the number of NY CABG procedures performed per year by the overall NY Medicare resident enrollee population (available from Medicares 100% Denominator File). Similar baseline comparisons were also made between NY residents receiving surgery in a NY hospital (in-state) and those receiving procedures in a hospital outside NY (out-of-state). The frequencies of coded comorbid diseases (for example, congestive heart failure or renal disease) were determined using ICD-9-CM applied to discharge abstract information (14). We also calculated a composite measure of comorbidity, the Charlson Index, applied to these ICD-9-CM diagnoses (1416).
We tested the significance of temporal trends in patient characteristics and out-of-state procedure rates using simple linear regression models (for continuous variables) and logistic regression models (for categorical variables) with year as the independent variable. Comparisons of trends in bypass surgery use in NY vs. U.S. non-NY hospital MI patients were made using regression models which included procedure year, hospital location (NY vs. non-NY) and an interaction term (hospital location by year) as independent predictors and tested the significance of the interaction term. Comparison of temporal trends in unadjusted 30-day mortality rates in NY vs. U.S. non-NY hospitals was made in a similar fashion.
We used a logistic regression model to calculate the risk-adjusted yearly decline in the likelihood for 30-day mortality following bypass surgery for individual states. This model included preoperative risk factors (patient age, race, gender, acute MI admission and Charlson comorbidity index), hospital location (each state), procedure year (continuous variable) and the interaction terms (state by procedure year). For each state, the coefficient of (state by year) interaction term, when added to the coefficient for procedure year and exponentiated, represents the yearly odds of mortality for the particular state. This odds ratio was converted to a yearly decline by comparison to 1.0 (e.g., an odds ratio of 0.93 implies a decline of 7%).
Finally, risk adjusted mortality rates by state in 1992 were calculated by using a similar regression model after limiting the dataset to include 1992 procedures only (and excluding temporal factors). State-specific coefficients from this model (relative to the comparison state, NY) were then converted to odds ratios. These odds ratios were then multiplied by the NY mortality rate for 1992 to get state-specific, risk adjusted 1992 mortality rates. This method uses the NY rate as a standard to which all other state rates are compared (17).
 |
Results
|
|---|
Baseline characteristics.
Baseline characteristics for NY and U.S. non-NY patients receiving bypass surgery between 1987 and 1992 are displayed in Table 1. While NY bypass patients were generally similar to those from the rest of the United States, NY patients were slightly older, more likely to have diabetes mellitus and congestive heart failure and less likely to have had an acute MI prior to bypass surgery. Table 2 displays temporal trends in bypass surgery use in NYs Medicare population between 1987 and 1992. The number of bypass procedures performed rose by 57% during this period, from 5,170 in 1987 to 8,120 in 1992. The yearly bypass rate among NY Medicare resident enrollees also rose by 50% between 1987 and 1992; from 2.4 to 3.6 bypass cases per 1,000 enrollees per year. The mean age of NYs bypass patients also rose slightly, including a significantly higher percentage of octogenarian patients (p < 0.001 for trend). There was also a rise in the percentage of bypass surgery cases that were performed following an acute MI, and in those with multiple comorbid illnesses (p < 0.001 for trend). In terms of changes in process measures, there was a significant increase in the use of internal mammary artery grafts during bypass in NY, from 30% in 1987 to 51% in 1992 (p < 0.001 for trend).
Out-of-state bypass use.
Figure 1 displays temporal trends in the percentage of NY residents receiving bypass surgery out-of-state. The out-of-state procedure rate prior to provider profiling (1987 to 1989) ranged between 12.5% and 14.3% per year. After the program was initiated, NYs out-of-state bypass surgery rate declined to its lowest rate (11.3%) in 1992. In fact, the overall trend for out-of-state bypass surgery use declined between 1987 and 1992 (p < 0.001 for trend).

View larger version (15K):
[in this window]
[in a new window]
|
Figure 1 Yearly trends in the percentage of NY residents receiving bypass surgery at hospitals outside NY state between 1987 and 1992.
|
|
Although the overall percentage of out-of-state bypass surgery referrals declined after provider profiling began, it remained possible that there was a bias towards referring higher risk patient out-of-state. Table 3 compares patient characteristics for NY residents receiving bypass surgery in-state vs. those referred out-of-state. In contrast with prior reports (9), NY residents receiving out-of-state surgery had demographics similar to those receiving in-state surgery.
In-state access to bypass surgery.
To address whether bypass surgery was less accessible to NYs higher risk elderly after provider profiling initiation, we examined trends in bypass surgery use among patients aged 65 to 70 years and 75 to 80 years who were admitted for acute MI (Fig. 2). While NY MI patients were generally less likely to receive bypass surgery than those admitted outside NY, the percentage of NY MI patients receiving surgery rose significantly from 1987 to 1992. For example, the rate of in-hospital bypass surgery among NY MI patients aged 65 to 70 rose from 3.4% in 1987 to 8.4% in 1992, paralleling national trends (Fig. 2). We subsequently repeated this analysis for even higher risk elderly subsets (i.e., those with concomitant MI and congestive heart failure, diabetes mellitus or renal insufficiency). The results in each case were the same as described for the overall MI group (demonstrating increased bypass use in NY in these high risk subgroups over time, paralleling national trends). Thus, we found no evidence that the initiation of NYs profiling program has resulted in a decline in procedural access for NYs elderly residents.

View larger version (18K):
[in this window]
[in a new window]
|
Figure 2 Rates of in-hospital bypass surgery following myocardial infarction among patients aged 65 to 70 years (boxes) and 75 to 80 years (triangles) in NY (solid lines) and U.S. non-NY hospitals (dotted lines).
|
|
Trends in bypass surgery mortality.
Figure 3 displays temporal trends in 30-day unadjusted mortality rates following bypass surgery for NY and U.S. non-NY Medicare patients. While unadjusted mortality rates fell significantly for both groups between 1987 and 1992, it fell significantly faster in NY than in the rest of the nation (p = 0.005 for interaction term, NY by year). For example, NYs 30-day mortality rate following bypass declined by 33% from 1987 to 1992 (from 6.0% to 4.0%). For U.S. non-NY patients, bypass surgery mortality declined by 19% (from 6.7% to 5.4%) during this period. Similarly, for the 4-year period from 1989 to 1992 (when NYs provider profiling existed), the corresponding decline in observed bypass mortality in NY vs. the rest of the nation was 22% vs. 9% (p < 0.001).

View larger version (18K):
[in this window]
[in a new window]
|
Figure 3 Yearly trends in 30-day mortality rates following bypass surgery in NY (squares) vs. U.S. non-NY hospitals (diamonds).
|
|
We also calculated the degree to which NY patients average yearly procedural mortality risk declined relative to the rest of the nation. After adjusting for age, race, gender, acute MI admission and comorbid illness, a NY patients likelihood for dying within 30 days of bypass surgery declined an average of 10.3% per year between 1987 and 1992 compared with 5.8% for patients in the rest of the nation.
As a final method of examining the relationship between provider profiling programs and surgical outcomes, we displayed each states yearly decline in bypass mortality (from 1987 to 1992) by their ending (1992) procedural mortality rate (Fig. 4). In Figure 4 the cross-bars represent the national averages for these two measures, thus creating quadrants. If NYs provider profiling program influenced surgical outcomes, NYs surgical mortality rate should have declined faster than the majority of states (right half of the graph) and they should have one of the lowest ending mortality rates (bottom half of the graph). As is evident, NY was one of the nations most improved bypass performers between 1987 and 1992 and had the nations lowest surgical mortality rate in 1992. Interestingly, surgical outcomes in northern New England (Maine, Vermont and New Hampshire), another area which has implemented bypass surgery provider profiling programs, also declined faster than the national average and had lower than average mortality rates in 1992.

View larger version (20K):
[in this window]
[in a new window]
|
Figure 4 Individual states 1992 adjusted bypass surgery 30-day mortality rate (controlling for age, gender, race, acute MI admission and comorbidity) vs. their adjusted average yearly decline in bypass surgery mortality risk between 1987 and 1992. The crosslines indicate national averages. Note: NNE refers to the northern New England region (Maine, New Hampshire and Vermont) which share a provider profiling program. LoVol refers to a composite of 10 states performing 500 or less bypass surgeries per year (including Alaska, Wyoming, Delaware, Idaho, New Mexico, Hawaii, Rhode Island, Montana and North and South Dakota).
|
|
 |
Discussion
|
|---|
Since 1989, the NY State Department of Health has collected detailed clinical and outcomes data on all patients undergoing bypass surgery in their state, and has used these data to report both unadjusted and risk-adjusted bypass surgery mortality rates (1). New York was the first state in the nation to publicly release these provider profiles as "cardiovascular scorecards," meant to increase consumer awareness (18). While many have suggested (on the basis of anecdotal reports) that provider profiling programs may adversely affect physician practice behaviors, empirical data supporting or refuting such claims were limited. Using a longitudinally linked national claims database, we found that since NY has enacted a profiling initiative, bypass surgery outcomes have improved markedly without any evidence that access to care has declined.
Effects on physician behavior.
Before public release, NYs provider-specific mortality data are risk-adjusted for potential differences in severity of illness using a validated risk-prediction model (5). State officials maintain that the model adequately compensates a surgeon for taking on higher-risk patients and, if anything, overcompensates for the highest-risk cases (6). Despite this contention, many critics of the program have asserted that surgeons natural reaction to having their outcomes monitored is to refer or refuse those patients with higher procedural risk (8,18).
Recently, Omoigui et al. (9) published a single-institution review supporting the contention that NY surgeons were transferring their highest risk patients out-of-state. The authors reported that there was an increase in both the number of patients and their disease severity transferred to the Cleveland Clinic from NY for bypass between 1989 and 1993 (n = 482). In contrast to these single-center results, when using a national database we found no evidence for a widespread increase in out-of-state transfers from NY for bypass surgery. In our study, out-of-state bypass procedures may have occurred in one of three general situations: patients living near NYs state boarder who cross-over to a neighboring state for a procedure; patients who are away from home when the need for bypass surgery occurs (e.g., vacation, dual homesite); and patients who are specifically transferred out-of-state for bypass surgery. While the "basal rates" for the two former situations should be relatively constant, if physicians were transferring a significant number of higher-risk elderly patients out-of-state for bypass, the overall rate should have increased over time. In fact, NY elderly residents were actually less likely to have their procedure performed outside NY after the profiling program was initiated. Additionally, while claims data provide only limited information on disease severity, we found no significant differences in age, gender, rates of acute MI or comorbid illness burden in NY residents receiving procedures out-of-state as compared with NY residents receiving in-state surgery. Given these national observations, it appears likely that the Cleveland Clinics experience was an exception resulting from particular local care patterns rather than the general rule.
New Yorks provider profiling program may also have affected surgeons willingness to operate on higher-risk patients. While it is difficult to monitor changes in procedure access, we examined temporal trends in bypass surgery use among all elderly Medicare enrollees (Table 2) and among higher-risk elderly MI patients in NY (Fig. 2). Had NY surgeons become more conservative in their care, we would have expected to see a decline in bypass surgery use, particularly among these high-risk patients, corresponding to the initiation of the profiling program. Care patterns in the rest of the nation during this period served as a control for nonspecific changes. Consistent with previous studies, we noted that NY physicians used revascularization procedures less frequently in post-MI patients than physicians in other regions of the country (19,20). However, we also found that NY elderly high-risk MI patients were actually more likely to receive bypass surgery since the programs initiation, mirroring national trends (Fig. 2). Thus, we were unable to detect systemic evidence for decreased access to bypass surgery in NYs elderly since provider profiling began.
Mortality outcomes.
The most important measure of any quality improvement effort is its effect on patient outcomes. Hannan et al. (1) previously reported that overall unadjusted and risk-adjusted in-hospital mortality rates in NY have declined significantly between 1989 and 1992. Our study confirmed that overall unadjusted bypass mortality rates in NY Medicare patients declined significantly faster than the rest of the nation from 1987 to 1992, 33% vs. 19% (p < 0.01 for trend comparisons). Furthermore, this decline in mortality was most profound in NY between 1989 to 1992, after the initiation of the profiling efforts and during a period when national mortality averages declined only slightly (Fig. 3).
We also found that risk-adjusted surgical mortality in NY improved faster than almost all individual states between 1987 to 1992 (Fig. 4). As a result, NY had the lowest risk-adjusted mortality rate in the country in 1992. It is also interesting to note that the other area of the country which initiated a provider profiling program during similar time periods, northern New England, experienced significantly larger improvements in their surgical outcomes than other areas of the country (Fig. 4) (21,22).
These results contrast with those recently reported by Ghali et al. (11). They found that Massachusetts (a state without provider profiling) experienced significant improvements in surgical outcomes from 1990 to 1994. While our study confirmed that bypass mortality improved in Massachusetts (a 25% decline in unadjusted Medicare procedural mortality between 1987 to 1992), this decline was significantly less than that experienced by either NY or northern New England. In part these differences in study results may be due to differences in the years of study and patient inclusion criteria (our study included all bypass surgery cases, but was limited to the elderly, while theirs included all age patients, but was limited to certain diagnosis-related groups). Finally, even if bypass outcomes in Massachusetts improved to a similar degree as in NY and northern New England, this may represent a "spill-over" of the effect of the quality improvement programs (from NY and northern New England to Massachusetts) resulting from its geographic location directly between two areas with statewide profiling programs.
If provider profiling has led to improved outcomes, the mechanism by which this program works remains unclear. While public disclosure of outcomes scorecards could have affected patients or physicians surgical referral decisions, NY State officials have not found evidence for mass patients migration from high- to low-mortality hospitals since the public release of provider profiles (5). Additionally, our study demonstrated that northern New England (which does not publicly disclose its providers outcome rating) achieved similar improvements in surgical outcomes to those in NY (21,22). Alternatively, provider profiling outcomes data may have been used internally by hospitals and physician to motivate internal, individualized, quality improvement initiatives. For example, Chassin et al. (5) have reported that certain NY hospitals restricted operating privileges for surgeons with poor outcomes while other institutions have improved their management of unstable patients. Malenka and OConnor (22) similarly reported that outcomes feedback has promoted provider-initiated quality improvement programs in northern New England.
Limitations.
While Medicare is currently the only data source available for examining national care trends, these data are limited in terms of the extent and accuracy of clinical information provided (23). This limitation prevented us from comparing fully risk-adjusted outcomes results. It is notable, however, that baseline characteristics for NY and U.S. non-NY bypass patients were strikingly similar, making significant differences in disease severity less likely. New York outcomes were also consistently better than nationwide outcomes after adjusting for available risk markers. Our results were limited to patients aged 65 years or older and may not reflect care patterns or outcomes in younger patients. However, we would have expected that if NYs profiling efforts had adversely affected access to care, the higher-risk elderly would have experienced the largest decline in in-state procedures. Our results only reflect care through the end of 1992 and NY surgeons may have altered their practice patterns since then. Finally, we examined general trends in care and outcomes over time and cannot rule out isolated incidences of altered clinical behavior resulting from the profiling effort.
Conclusions.
Since the enactment of NY States bypass surgery provider profiling, there has been an increase in the number and rate of bypass surgery procedures performed in NY (including a higher percentage of older patients, more acute MI patients and more comorbidity). We found no empirical evidence that NY residents were being forced to seek out-of-state bypass surgery, or that access to procedures had declined in high-risk elderly NY residents since the programs initiation. Furthermore, mortality following bypass surgery has declined significantly faster in NY as compared with the rest of the nation. These data support NYs provider profiling program as a potential means of improving patient outcomes while maintaining access to care.
 |
Footnotes
|
|---|
Supported by research grants HS-06503 and HS-05635 from the Agency for Health Care Policy and Research, Rockville, Maryland; and research grant HL-17670 from the National Heart, Lung and Blood Institute, Bethesda, Maryland.
 |
References
|
|---|
1. Hannan EL, Kilburn H, Racz M, Shields E, Chassin MR. Improving the outcomes of coronary artery bypass surgery in New York State. JAMA. 1994;271:761766[Abstract/Free Full Text]
2. Hannan EL, Kilburn H Jr, ODonnell JF. Adult open heart surgery in New York State: an analysis of risk factors and hospital mortality rates. JAMA. 1990;264:27682774[Abstract/Free Full Text]
3. Hannan EL, ODonnell JF, Kilburn H Jr. Investigation of the relationship between volume and mortality for surgical procedures performed in New York State hospitals. JAMA. 1991;29:10941107
4. Hannan EL, Kilburn H Jr, Lindsey ML, Lewis R. Clinical versus administrative data bases for CABG surgery: does it matter? Med Care. 1992;30:892907[Medline]
5. Chassin MR, Hannan EL, DeBuono BA. Benefits and hazards of reporting medical outcomes publicly. N Engl J Med. 1996;334:394398[Free Full Text]
6. Hannan EL, Kumar D, Racz M, Siu AL, Chassin MR. New York States cardiac surgery reporting system: four years later. Ann Thorac Surg. 1994;58:18521857[Abstract]
7. Zinman D. Heart surgeons rated: state reveals patient-morality records. Newsday December 18, 1991:3.
8. Green J, Wintfeld N. Report cards on cardiac surgeons. Assessing New York States approach. N Engl J Med. 1995;332:12291232[Free Full Text]
9. Omoigui NA, Miller DP, Brown KJ, et al. Outmigration for coronary bypass surgery in an era of public dissemination of clinical outcomes. Circulation. 1996;93:2733[Abstract/Free Full Text]
10. Byer MJ. Saint hearts. NY Times March 21, 1992:A23.
11. Ghali WA, Ash AS, Hall RE, Moskowitz MA. Statewide quality improvement initiatives and mortality after cardiac surgery. JAMA. 1997;277:379382[Abstract/Free Full Text]
12. Parsonnet V, Dean D, Bernstein AD. A method of uniform stratification of risk for evaluating the results of surgery in acquired adult heart disease. Circulation. 1989;79 Suppl I:I-3I-12
13. OConnor GT, Plume SK, Olmstead EM, et al. Multivariate prediction of in-hospital mortality associated with coronary artery bypass graft surgery. Circulation. 1992;85:21102118[Abstract/Free Full Text]
14. Romano PS, Roos LL, Jollis JG. Adapting a clinical comorbidity index for use with ICD-9-CM administrative data: differing perspectives. J Clin Epidemiol. 1993;46:10751079[CrossRef][Medline]
15. Charlson ME, Pompei P, Alex KL, MacKenzie CR. A new method of classifying prognostic comorbidity in longitudinal studies: development and validation. J Chronic Dis. 1987;40:373383[CrossRef][Medline]
16. Romano PS, Roos LL, Jollis JG. Further evidence concerning the use of a clinical comorbidity index with ICD-9-CM administrative data. J Clin Epidemiol. 1993;46:10851090[CrossRef]
17. DeLong ER, Peterson ED, DeLong EM, Muhlbaier LM, Hackett S, Mark DB. Comparing risk-adjustment methods for provider profiling. Stat Med. 1997;16:26452664[CrossRef][Medline]
18. Topol EJ, Califf RM. Scorecard cardiovascular medicine. Its impact and future directions. Ann Intern Med. 1994;120:6570[Abstract/Free Full Text]
19. Pilote L, Califf RM, Sapp S, et al. Regional variation across the United States in the management of acute myocardial infarction. GUSTO-1 Investigators. Global utilization of streptokinase and tissue plasminogen activator for occluded coronary arteries. N Engl J Med. 1995;333:565572[Abstract/Free Full Text]
20. Guadagnoli E, Haupman PJ, Ayznian JZ, Pashos CL, McNeil BJ, Cleary PD. Variation in the use of cardiac procedures after acute myocardial infarction. N Engl J Med. 1995;333:573578[Abstract/Free Full Text]
21. OConnor GT, Plume SK, Olmstead EM, et al. A regional intervention to improve the hospital mortality associated with coronary artery bypass graft surgery. JAMA. 1996;275:841846[Abstract/Free Full Text]
22. Malenka DJ, OConnor GT. A regional collaborative effort for CQI in cardiovascular disease. Northern New England Cardiovascular Study Group. Jt Comm J Qual Improv. 1995;21:627633[Medline]
23. Jollis JG, Ancukiewicz M, DeLong ER, Pryor DB, Muhlbaier LH, Mark DB. Discordance of databases designed for claims payment versus clinical information systems. Implications for outcomes research. Ann Intern Med. 1993;119:844850[Abstract/Free Full Text]
This article has been cited by other articles:

|
 |

|
 |
 
P. LINDENAUER
Public reporting and pay-for-performance programs in perioperative medicine: Are they meeting their goals?
Cleveland Clinic Journal of Medicine,
November 1, 2009;
76(Suppl_4):
S3 - S8.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
J. S. Ross and C. P. Gross
Policy Research: Using Evidence to Improve Healthcare Delivery Systems
Circulation,
February 17, 2009;
119(6):
891 - 898.
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
A. F. Hernandez and S. M. O'Brien
Sex Differences in Hospital Risk-Adjusted Mortality Rates for Medicare Beneficiaries Undergoing CABG Surgery--Invited Commentary
Arch Intern Med,
November 24, 2008;
168(21):
2323 - 2325.
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
C. S. Hollenbeak, C. P. Gorton, Y. P. Tabak, J. L. Jones, A. Milstein, and R. S. Johannes
Reductions in Mortality Associated With Intensive Public Reporting of Hospital Outcomes
American Journal of Medical Quality,
July 1, 2008;
23(4):
279 - 286.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
J. P. Drozda Jr, E. P. Hagan, M. J. Mirro, E. D. Peterson, and J. S. Wright
ACCF 2008 Health Policy Statement on Principles for Public Reporting of Physician Performance Data: A Report of the American College of Cardiology Foundation Writing Committee to Develop Principles for Public Reporting of Physician Performance Data
J. Am. Coll. Cardiol.,
May 20, 2008;
51(20):
1993 - 2001.
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
C. H. Fung, Y.-W. Lim, S. Mattke, C. Damberg, and P. G. Shekelle
Systematic Review: The Evidence That Publishing Patient Care Performance Data Improves Quality of Care
Ann Intern Med,
January 15, 2008;
148(2):
111 - 123.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
A. J. Epstein
Do Cardiac Surgery Report Cards Reduce Mortality? Assessing the Evidence
Med Care Res Rev,
August 1, 2006;
63(4):
403 - 426.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
Z. G. Turi
The Big Chill: The Deleterious Effects of Public Reporting on Access to Health Care for the Sickest Patients
J. Am. Coll. Cardiol.,
June 7, 2005;
45(11):
1766 - 1768.
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
M N Marshall and P S Romano
Impact of reporting hospital performance
Qual. Saf. Health Care,
April 1, 2005;
14(2):
77 - 78.
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
R. M. Werner and D. A. Asch
The Unintended Consequences of Publicly Reporting Quality Information
JAMA,
March 9, 2005;
293(10):
1239 - 1244.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
D. M. Shahian, E. H. Blackstone, F. H. Edwards, F. L. Grover, G. L. Grunkemeier, D. C. Naftel, S. A.M. Nashef, W. C. Nugent, and E. D. Peterson
Cardiac Surgery Risk Models: A Position Article
Ann. Thorac. Surg.,
November 1, 2004;
78(5):
1868 - 1877.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
R. E. Herzlinger and R. Parsa-Parsi
Consumer-Driven Health Care: Lessons From Switzerland
JAMA,
September 8, 2004;
292(10):
1213 - 1220.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
D. D. Wirtschafter and R. J. Powers
Organizing Regional Perinatal Quality Improvement: Global Considerations and Local Implementation
NeoReviews,
February 1, 2004;
5(2):
e50 - 59.
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
A. M. Epstein, T. H. Lee, and M. B. Hamel
Paying Physicians for High-Quality Care
N. Engl. J. Med.,
January 22, 2004;
350(4):
406 - 410.
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
E. L. Hannan, C. Wu, T. J. Ryan, E. Bennett, A. T. Culliford, J. P. Gold, A. Hartman, O. W. Isom, R. H. Jones, B. McNeil, et al.
Do Hospitals and Surgeons With Higher Coronary Artery Bypass Graft Surgery Volumes Still Have Lower Risk-Adjusted Mortality Rates?
Circulation,
August 19, 2003;
108(7):
795 - 801.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
M. N. Marshall, P. G. Shekelle, H. T.O. Davies, and P. C. Smith
Public Reporting On Quality In The United States And The United Kingdom
Health Aff.,
May 1, 2003;
22(3):
134 - 148.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
D. B. Mukamel and W. D. Spector
Quality Report Cards and Nursing Home Quality
Gerontologist,
April 1, 2003;
43(90002):
58 - 66.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
S. Schneeweiss, A. Manstetten, M. Wildner, O. Sangha, M. Liebetrau, and A. Paeger
Costs of Measuring Outcomes of Acute Hospital Care in a Longitudinal Outcomes Measurement System
American Journal of Medical Quality,
January 1, 2003;
18(1):
3 - 9.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
V. A. Ferraris and S. P. Ferraris
Risk Stratification and Comorbidity
Card. Surg. Adult,
January 1, 2003;
2(2003):
187 - 224.
[Full Text]
|
 |
|

|
 |

|
 |
 
K. E. Flynn, M. A. Smith, and M. K. Davis
From Physician to Consumer: The Effectiveness of Strategies to Manage Health Care Utilization
Med Care Res Rev,
December 1, 2002;
59(4):
455 - 481.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
R. Galvin and A. Milstein
Large Employers' New Strategies in Health Care
N. Engl. J. Med.,
September 19, 2002;
347(12):
939 - 942.
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
N. Gupta, P. L. Kotler, and R. A. Dudley
Analytic Reviews: Considerations in the Development of Intensive Care Unit Report Cards
J Intensive Care Med,
September 1, 2002;
17(5):
211 - 217.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
M. R. Chassin
Achieving And Sustaining Improved Quality: Lessons From New York State And Cardiac Surgery
Health Aff.,
July 1, 2002;
21(4):
40 - 51.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
J. D. Clough, D. Engler, R. Snow, and P. E. Canuto
Lack of Relationship Between the Cleveland Health Quality Choice Project and Decreased Inpatient Mortality in Cleveland
American Journal of Medical Quality,
March 1, 2002;
17(2):
47 - 55.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
D. M. Shahian, S.-L. Normand, D. F. Torchiana, S. M. Lewis, J. O. Pastore, R. E. Kuntz, and P. I. Dreyer
Cardiac surgery report cards: comprehensive review and statistical critique
Ann. Thorac. Surg.,
December 1, 2001;
72(6):
2155 - 2168.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
E. C. Becher and M. R. Chassin
Improving The Quality Of Health Care: Who Will Lead?
Health Aff.,
September 1, 2001;
20(5):
164 - 179.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
E C Schneider and T Lieberman
Publicly disclosed information about the quality of health care: response of the US public
Qual. Saf. Health Care,
June 1, 2001;
10(2):
96 - 103.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
B. R. Hemmelgarn, W. A. Ghali, and H. Quan
A case study of hospital closure and centralization of coronary revascularization procedures
Can. Med. Assoc. J.,
May 1, 2001;
164(10):
1431 - 1435.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
E. C. Becher and M. R. Chassin
Improving Quality, Minimizing Error: Making It Happen
Health Aff.,
May 1, 2001;
20(3):
68 - 81.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
B. J. Harlan
Statewide reporting of coronary artery surgery results: A view from California
J. Thorac. Cardiovasc. Surg.,
March 1, 2001;
121(3):
409 - 417.
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
D. J. O'Rourke, D. J. Malenka, E. M. Olmstead, H. B. Quinton, J. H. Sanders Jr, S. J. Lahey, M. Norotsky, R. D. Quinn, Y. R. Baribeau, F. Hernandez Jr, et al.
Improved in-hospital mortality in women undergoing coronary artery bypass grafting
Ann. Thorac. Surg.,
February 1, 2001;
71(2):
507 - 511.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
E. D. Peterson, E. R. DeLong, L. H. Muhlbaier, A. B. Rosen, H. E. Buell, C. I. Kiefe, and T. F. Kresowik
Challenges in comparing risk-adjusted bypass surgery mortality results: Results from the Cooperative Cardiovascular Project
J. Am. Coll. Cardiol.,
December 1, 2000;
36(7):
2174 - 2184.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
N. J.O. Birkmeyer, C. A.S. Marrin, J. R. Morton, B. J. Leavitt, S. J. Lahey, D. C. Charlesworth, F. Hernandez, E. M. Olmstead, and G. T. O'Connor
Decreasing mortality for aortic and mitral valve surgery in northern New England
Ann. Thorac. Surg.,
August 1, 2000;
70(2):
432 - 437.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
J. G. Canto, N. R. Every, D. J. Magid, W. J. Rogers, J. A. Malmgren, P. D. Frederick, W. J. French, A. J. Tiefenbrunn, V. K. Misra, C. I. Kiefe, et al.
The Volume of Primary Angioplasty Procedures and Survival after Acute Myocardial Infarction
N. Engl. J. Med.,
May 25, 2000;
342(21):
1573 - 1580.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
M. N. Marshall, P. G. Shekelle, S. Leatherman, and R. H. Brook
The Public Release of Performance Data: What Do We Expect to Gain? A Review of the Evidence
JAMA,
April 12, 2000;
283(14):
1866 - 1874.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
M. N Marshall, P. G Shekelle, S. Leatherman, and R. H Brook
Public disclosure of performance data: learning from the US experience
Qual. Saf. Health Care,
March 1, 2000;
9(1):
53 - 57.
[Full Text]
|
 |
|

|
 |

|
 |
 
K. A. Eagle, R. A. Guyton, R. Davidoff, G. A. Ewy, J. Fonger, T. J. Gardner, J. P. Gott, H. C. Herrmann, R. A. Marlow, W. C. Nugent, et al.
ACC/AHA guidelines for coronary artery bypass graft surgery: A report of the American College of Cardiology/ American Heart Association task force on Practice Guidelines (Committee to revise the 1991 Guidelines for Coronary Artery Bypass Graft Surgery)
J. Am. Coll. Cardiol.,
October 1, 1999;
34(4):
1262 - 1347.
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
J. H. Burack, P. Impellizzeri, P. Homel, and J. N. Cunningham Jr
Public reporting of surgical mortality: a survey of New York State cardiothoracic surgeons
Ann. Thorac. Surg.,
October 1, 1999;
68(4):
1195 - 1200.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
S. W. Dziuban Jr
Using database information in your clinical practice
Ann. Thorac. Surg.,
August 1, 1999;
68(2):
350 - 352.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
H. M. Krumholz
Mathematical Models and the Assessment of Performance in Cardiology
Circulation,
April 27, 1999;
99(16):
2067 - 2069.
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
R. E. Herzlinger
Finding "Truth" about Managed Care
Journal of Health Politics Policy and Law,
January 1, 1999;
24(5):
1077 - 1093.
[PDF]
|
 |
|

|
 |

|
 |
 
Does Provider Profiling Force High-Risk Patients to Seek Care Elsewhere?
Journal Watch (General),
October 20, 1998;
1998(1020):
4 - 4.
[Full Text]
|
 |
|
|