|
|
||||||||||
|
J Am Coll Cardiol, 1999; 33:1560-1566 © 1999 by the American College of Cardiology Foundation |

* Section of Heart Failure and Cardiac Transplantation, Division of Cardiovascular Medicine, Henry Ford Hospital, Detroit, Michigan, USA
Heart Failure and Transplantation Center, Cardiac Unit, Massachusetts General Hospital and Harvard Medical School, Boston, Massachusetts, USA
Manuscript received August 28, 1998; revised manuscript received January 5, 1999, accepted January 21, 1999.
Reprint requests and correspondence: Dr. Edward F. Philbin, Head, Section of Heart Failure and Cardiac Transplantation, Division of Cardiovascular Medicine, Henry Ford Hospital, 2799 West Grand Blvd, Detroit, Michigan 48202
ephilbi1{at}hfhs.org
| Abstract |
|---|
|
|
|---|
The purpose of this study was to develop a convenient and inexpensive method for identifying an individuals risk for hospital readmission for congestive heart failure (CHF) using information derived exclusively from administrative data sources and available at the time of an index hospital discharge.
BACKGROUND
Rates of readmission are high after hospitalization for CHF. The significant determinants of rehospitalization are debated.
METHODS
Administrative information on all 1995 hospital discharges in New York State which were assigned International Classification of Diseases9Clinical Modification codes indicative of CHF in the principal diagnosis position were obtained. The following were compared among hospital survivors who did and did not experience readmission: demographics, comorbid illness, hospital type and location, processes of care, length of stay and hospital charges.
RESULTS
A total of 42,731 black or white patients were identified. The subgroup of 9,112 patients (21.3%) who were readmitted were distinguished by a greater proportion of blacks, a higher prevalence of Medicare and Medicaid insurance, more comorbid illnesses and the use of telemetry monitoring during their index hospitalization. Patients treated at rural hospitals, those discharged to skilled nursing facilities and those having echocardiograms or cardiac catheterization were less likely to be readmitted. Using multiple regression methods, a simple methodology was devised that segregated patients into low, intermediate and high risk for readmission.
CONCLUSIONS
Patient characteristics, hospital features, processes of care and clinical outcomes may be used to estimate the risk of hospital readmission for CHF. However, some of the variation in rehospitalization risk remains unexplained and may be the result of discretionary behavior by physicians and patients.
| ||||||||
| Methods |
|---|
|
|
|---|
The codes used were 428.0, 402.91, 404.93, 428.1, 402.11, 398.91, 404.91, 404.13, 402.01, 404.03, 404.11, 404.01 and 428.9. This method of case selection defined a group of patients whose primary diagnosis was CHF, irrespective of procedures performed. The chronologically first hospital admission during 1995 for each patient was considered the index admission (or discharge). Patients who died during their index admission were excluded from this analysis. To simplify analyses of potentially complex relationships between ethnicity and other predictors of readmission (5,15), patients whose race was reported "unknown," "other" or any race other than black or white were also excluded.
Readmission for CHF was determined by searching the same data set for subsequent hospitalizations occurring before December 31, 1995 for each individual who qualified for inclusion in the study. Readmission was coded as present or absent for each patient. The records of 3% of the patients were manually reviewed by trained chart auditors to confirm the accuracy of the unique patient identifier used to identify hospital readmission, and to confirm the presence of CHF based on the documentation of typical symptoms, physical findings, diagnostic test results and clinical response to appropriate therapy.
Hospital length of stay was defined as the date of discharge or death minus the date of admission. Discharges were classified as "urban" if they occurred at a hospital located in a county which is part of a Federal Metropolitan Statistical Area. All other discharges were classified as "rural." Discharges were classified as "teaching" if they occurred at a hospital listed as a primary or affiliated institution of an accredited internal medicine or family practice residency program according to the American Medical Associations directory of postgraduate medical training programs (16). All other discharges were classified as "nonteaching."
Coexistent illnesses were determined by searching the principal ICD-9-CM diagnosis code and up to 14 secondary diagnosis codes for each patient. Total comorbid disease was quantified according to the method of Charlson. To achieve this, a Charlson Comorbidity Index (17), and its age-modified variant (18), were calculated for each patient. Process of care was determined by searching the principal procedure code and up to 14 secondary procedure codes for each patient. In some cases, similar procedures with closely related codes were combined to yield clinically relevant composite rates of technical services. Medical specialty codes for a maximum of three physicians caring for each patient were examined. A patient was classified as receiving care from a cardiologist if any of his or her providers was listed as a specialist in cardiovascular diseases.
Statistical analyses.
Differences between patients readmitted and those not readmitted were analyzed using chi-square tables (categorical data) and Student unpaired t test (interval data). To provide the opportunity to both develop risk scores and test their validity within a single data set, all patients were randomly assigned to either a derivation subset or a validation subset. Among patients in the derivation subset only, SASs PROC LOGISTIC (19) was used to determine which of the patient characteristics, hospital features, processes of care and clinical outcomes had independent predictive value for hospital readmission. All predictors with a significant or borderline statistical relationship with rehospitalization at the univariate level (p
0.10) were entered as independent variables in a logistic regression model for readmission. This technique yielded odds ratios and confidence intervals for readmission for every predictor variable tested in the model. After identifying those variables with significant independent predictive value (p
0.05 in the logistic regression model), two risk scoring systems based on these variables were derived. The simple risk score was computed by adding the number of positive predictors for readmission present for each patient, then subtracting the number of negative predictors present. The modified risk score assigned weights to each positive and negative predictor based on the odds ratio for that variable derived from the logistic regression model. The precision of the single best prediction method developed using data from the derivation subset only was then tested among patients in the validation subset only by entering each patients risk score as the independent variable in a logistic regression model for readmission. In interpreting results, a p value
0.05 was considered statistically significant. In this report, results are displayed as mean ± standard deviation.
| Results |
|---|
|
|
|---|
A total of 236 of New Yorks 243 acute care hospitals contributed at least one patient to the study sample of 42,731. Among these 236 institutions, the caseload per hospital ranged from 1 to 590 patients, with a median of 274. Of all discharges, 10.2% occurred at rural hospitals; 51.9% of them occurred at teaching institutions.
Among the 42,731 patients included in this study, mean age was 73.7 ± 13.2 years. Women comprised the majority of the cohort (56.4%). Blacks formed 18.2% of the group. The mean Charlson Comorbidity Index was 2.5 ± 1.6, and mean age-modified Charlson Comorbidity Index was 5.5 ± 2.0. Mean length of stay during the index admission was 9.2 ± 13.5 days, and mean hospital charges were $11,026 ± 14,748. The median postdischarge "follow-up" period for all patients was 6.9 months. Because patients in the rehospitalized group tended to experience their index discharge somewhat earlier during calendar year 1995, their median period of follow-up was 8.5 months. The same time period was 6.4 months for the nonrehospitalized group. Among patients who had one or more rehospitalizations, the median time from their index discharge to their first readmission was 91 days. Mortality rate during the index admission among black or white patients was 6.9%; the rate of death during subsequent hospitalizations was 7.9% (p < 0.0001).
Clinical characteristics. Table 1 displays the basic demographic characteristics, comorbid illnesses and comorbidity scores of the entire cohort, stratified by readmission status. Clinically relevant features distinguishing the rehospitalized group included a higher proportion of blacks, a higher prevalence of Medicare and Medicaid insurance, a lower prevalence of health maintenance organization and indemnity insurance and a higher prevalence of ischemic heart disease, idiopathic cardiomyopathy, prior cardiac surgery, peripheral vascular disease, renal disease, diabetes mellitus and anemia. The rehospitalized group also had higher mean comorbidity scores.
|
|
|
Composite risk scores.
In the simple scoring system (Table 4), one integer was added for each predictor of higher risk present, and one subtracted for each predictor of lower risk present. To avoid negative values, a correction factor of +4 was added to this sum. Thus, the range of potential values for the simple risk score was 0 to 15. (Because a patients primary insurance could not have been both Medicare and Medicaid, a maximum of 11 positive predictors could be present for any individual. A single variable "Medicare or Medicaid" was not created because of the different odds ratios associated with these two predictors.) Among patients in the derivation subset only, a logistic regression model for readmission with each patients simple risk score as the independent variable had a c statistic of 0.60, indicating that the risk score was moderately but significantly predictive of readmission (p < 0.001). The predictive value of this simple risk score was not reduced by grouping all patients with a score of 0 to 3 into a single unit and all patients with a score
11 into another single unit (c statistic of 0.60, p < 0.001). The modified scoring system based on weighting the 16 predictor variables proportional to their odds ratios performed no better than the simple system (c statistic of 0.61, p < 0.001).
|
11.
|
| Discussion |
|---|
|
|
|---|
Previous studies. In analyzing a large administrative data set, Krumholz et al. found male gender, prior hospitalization, higher comorbidity score, treatment in a tertiary care hospital and prolonged length of stay during the index hospitalization to be important predictors of all-cause readmission among Medicare patients hospitalized in Connecticut (3). These investigators could not study the effect of invasive cardiac procedures because of their choice of Diagnosis-Related Group inclusion criteria. In examining outcomes among a small number of patients treated at a single urban university teaching center, Vinson et al. found that past hospitalizations, prior CHF, acute myocardial ischemia and uncontrolled hypertension were significant predictors of all-cause readmission (4). In both studies (3,4), age was not an important predictor. In examining CHF admissions among a small number of black patients treated at a single urban university teaching hospital, Ghali et al. found that hospitalization for decompensated CHF could be explained in most cases by poor patient compliance, cardiac arrhythmias, emotional and environmental factors, poor medical care, pulmonary infection or thyrotoxicosis (5). Unfortunately, Ghali et al. did not include a comparison group of nonhospitalized patients to allow for determination of the significant predictors of admission or readmission. Chin and Goldman, examining a small number of patients treated at a single urban university teaching hospital, found that single marital status, hypotension, absent electrocardiographic repolarization abnormalities and higher Charlson Comorbidity Index were significant multivariable correlates of the combined end point of postdischarge death or hospital readmission (6). These authors did not report the determinants of readmission as an isolated end point.
From a methodologic viewpoint, our study differed from the others by including a much larger number of patients, perhaps with more diffuse demographic characteristics. Processes of care during the index hospitalization were examined as potential predictors based on their putative relationship with clinical events (20). Conversely, our data set lacked some of the richness of clinical information available to Vinson and colleagues (4), Ghali et al. (5) and Chin and Goldman (6). The results of our study were concordant with the prior investigations in describing comorbid illness as a major determinant of hospitalization risk. We, too, found that age was not a significant predictor of hospitalization after adjustment for other factors. Like Krumholz et al. (3), we found that patients treated at urban hospitals were more likely to be readmitted. In contrast, we found no relationship between readmission risk and gender or prior length of stay. The limitations of our data set precluded the opportunity to study prior hospitalization, social support and compliance as predictors of rehospitalization. Our study provided the additional insight that, after adjustment for other factors, race, medical insurance type and certain processes of care are significant positive or negative predictors of the risk for readmission for CHF. Moreover, our study yielded a framework for combining these multiple risk states to formulate a composite CHF readmission risk scorea utility not provided by previous authors.
Unexplained variation in readmission. Our results indicate that a prediction rule derived from administrative data collected during a patients index hospitalization only partially explains the risk for readmission. Our simple risk scoring system is convenient and inexpensive, as it is based on data that are readily available and not dependent upon case-by-case chart review (21). More precise mathematical prediction of readmission risk that reduces the unexplained residual variation in this end point would require additional data input from two broad domains: 1) patient- and disease-specific characteristics identifiable during the index hospitalization; and 2) factors related to the patients CHF and other medical conditions and their management assessed after discharge.
Regarding the first of these two domains, the limitations of administrative data are well known (2123). Illness severity is not fully captured in such sources of data, due to inadequate clinical information such as disease-specific functional status, physical examination findings, laboratory results, medication use, social support structure or valid global measures of risk. Thus, incorporation of more detailed measures of CHF severity and treatment, and global health status, might have improved the accuracy of predicting readmission. For example, information regarding prior hospitalizations (3,4), angiotensin-converting enzyme inhibitor use (24), digitalis use (25), emotional support (26) and quality of care (27) would likely be of value. Unfortunately, with the limitations of existing information systems, costly chart review would most often be required to collect and quantify these putative predictors. Such a process would not be feasible for studying large groups of patients or hospitals (3,21).
Regarding the postdischarge domain, many factors may impact on the risk for readmission. For example, the timing and frequency of medical follow-up (28), medication use (24,25), compliance with medical recommendations (5), participation in a care management program (913) and the specialty of the treating physician (29,30) affect the likelihood of hospitalization for CHF. Physician discretionary behavior also affects hospital stays for CHF (31). Other factors that are difficult to measure and quantify, such as a patients sense of security or well-being, likely contribute to the variation in rehospitalization. Thus, were it feasible and affordable to measure and quantify these factors, the mathematical prediction of readmission risk would probably become more precise. Of course, those measurements that could only be made after discharge would not be of utility in quantifying risk before a patient leaves the hospital.
Implications. The potential implications of our study deserve comment. From the clinical viewpoint, quantification of readmission risk at the time of hospital discharge is of value in that it provides the opportunity to enroll high risk patients into proactive care management programs. Programs of this type (913) have been demonstrated to be effective in reducing costs from hospitalization for CHF while improving quality of care and patient functional status. The use of the scoring system developed in the current study brings some refinement to the prediction of readmission risk, as it differentiates those with very low risk from those at intermediate and high riska much more precise process than assuming that all previously hospitalized patients have equally high risk (9). From the health services research viewpoint, our findings may be of use in comparing risk-stratified readmission rates among groups of patients, such as those treated within differing health care delivery systems (28,32).
Study limitations. As the present study was based on administrative discharge data, we cannot be sure how our patient groups truly related to one another upon entry into the hospital in terms of CHF severity or global health status. Furthermore, because the statistical methods employed in this study are designed only to examine associations between variables, we cannot draw conclusions about how or why predictor variables (such as hospital type or process of care) caused or prevented readmission. We cannot discount the possibility that biases in hospitals coding practices affected the results of this study. Patients living in areas near the geographic borders of New York, or moving from the state after their index discharge, may have been rehospitalized in hospitals outside of the state, thus rendering our study potentially vulnerable to slight underestimation of the rate of readmission, but not necessarily weakening the prediction of this event. As hospital readmissions for CHF were the only data available during the postdischarge period, cumulative mortality rates would by necessity be underestimates and are therefore not reported. As our study sample was limited to black or white patients treated in a single state during a single year, our results may not be generalizable to all patients hospitalized for CHF. Because our study, by design, derived prediction rules exclusively from administrative data, we were forced to exclude potentially important clinical predictors such as a history of prior hospitalizations (3) and psychosocial and behavioral factors (5,26). In point of fact, it is likely that the most powerful prediction methods are derived from a combination of administrative data and a few select clinical variables that are obtained by chart review (33).
| References |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
P. S. Keenan, S.-L. T. Normand, Z. Lin, E. E. Drye, K. R. Bhat, J. S. Ross, J. D. Schuur, B. D. Stauffer, S. M. Bernheim, A. J. Epstein, et al. An Administrative Claims Measure Suitable for Profiling Hospital Performance on the Basis of 30-Day All-Cause Readmission Rates Among Patients With Heart Failure Circ Cardiovasc Qual Outcomes, September 1, 2008; 1(1): 29 - 37. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. S. Ross, G. K. Mulvey, B. Stauffer, V. Patlolla, S. M. Bernheim, P. S. Keenan, and H. M. Krumholz Statistical Models and Patient Predictors of Readmission for Heart Failure: A Systematic Review Arch Intern Med, July 14, 2008; 168(13): 1371 - 1386. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. N. Lutfiyya, D. K. Bhat, S. R. Gandhi, C. Nguyen, V. L. Weidenbacher-Hoper, and M. S. Lipsky A comparison of quality of care indicators in urban acute care hospitals and rural critical access hospitals in the United States Int. J. Qual. Health Care, June 1, 2007; 19(3): 141 - 149. [Abstract] [Full Text] [PDF] |
||||
![]() |
C. G. Frazier, K. P. Alexander, L. K. Newby, S. Anderson, E. Iverson, M. Packer, J. Cohn, S. Goldstein, and P. S. Douglas Associations of Gender and Etiology With Outcomes in Heart Failure With Systolic Dysfunction: A Pooled Analysis of 5 Randomized Control Trials J. Am. Coll. Cardiol., April 3, 2007; 49(13): 1450 - 1458. [Abstract] [Full Text] [PDF] |
||||
![]() |
G. C. Fonarow, K. F. Adams Jr, W. T. Abraham, C. W. Yancy, W. J. Boscardin, and for the ADHERE Scientific Advisory Committee, Stud Risk Stratification for In-Hospital Mortality in Acutely Decompensated Heart Failure: Classification and Regression Tree Analysis JAMA, February 2, 2005; 293(5): 572 - 580. [Abstract] [Full Text] [PDF] |
||||
![]() |
P. Bettencourt, A. Azevedo, J. Pimenta, F. Frioes, S. Ferreira, and A. Ferreira N-Terminal-Pro-Brain Natriuretic Peptide Predicts Outcome After Hospital Discharge in Heart Failure Patients Circulation, October 12, 2004; 110(15): 2168 - 2174. [Abstract] [Full Text] [PDF] |
||||
![]() |
A. Gackowski, R. Isnard, J.-L. Golmard, F. Pousset, A. Carayon, G. Montalescot, J.-S. Hulot, D. Thomas, W. Piwowarska, and M. Komajda Comparison of echocardiography and plasma B-type natriuretic peptide for monitoring the response to treatment in acute heart failure Eur. Heart J., October 2, 2004; 25(20): 1788 - 1796. [Abstract] [Full Text] [PDF] |
||||
![]() |
A Cheng and K Ng Management programmes for heart failure Heart, September 1, 2004; 90(9): 972 - 974. [Full Text] [PDF] |
||||
![]() |
F. Gustafsson, C. Torp-Pedersen, H. Burchardt, P. Buch, M. Seibaek, E. Kjoller, I. Gustafsson, L. Kober, and for the DIAMOND Study group Female sex is associated with a better long-term survival in patients hospitalized with congestive heart failure Eur. Heart J., January 2, 2004; 25(2): 129 - 135. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. B. Braunstein, G. F. Anderson, G. Gerstenblith, W. Weller, M. Niefeld, R. Herbert, and A. W. Wu Noncardiac comorbidity increases preventable hospitalizations and mortality among medicare beneficiaries with chronic heart failure J. Am. Coll. Cardiol., October 1, 2003; 42(7): 1226 - 1233. [Abstract] [Full Text] [PDF] |
||||
![]() |
D. H. Kim and S. A. Hunt Heart Failure Management: Caregiver Versus Care Plan Circulation, July 15, 2003; 108(2): 129 - 131. [Full Text] [PDF] |
||||
![]() |
A. Mosterd and A.W. Hoes Reducing hospitalizations for heart failure Eur. Heart J., June 1, 2002; 23(11): 842 - 845. [Full Text] [PDF] |
||||
![]() |
M. R. Cowie, K. F. Fox, D. A. Wood, C. Metcalfe, S. G. Thompson, A. J. S. Coats, P. A. Poole-Wilson, and G. C. Sutton Hospitalization of patients with heart failure. A population-based study Eur. Heart J., June 1, 2002; 23(11): 877 - 885. [Abstract] [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | SUBSCRIPTIONS | CURRENT ISSUE | PAST ISSUES | CARDIOSOURCE | SEARCH | HELP | FEEDBACK |