Join the 200th Anniversary Celebration

Special Article

Variation among Hospitals in Coronary-Angiography Practices and Outcomes after Myocardial Infarction in a Large Health Maintenance Organization

Joe V. Selby, M.D., M.P.H., Bruce H. Fireman, M.A., Robert J. Lundstrom, M.D., Bix E. Swain, M.S., Alison F. Truman, M.S., Candice C. Wong, M.D., M.P.H., Erika S. Froelicher, R.N., Ph.D., Hal V. Barron, M.D., and Mark A. Hlatky, M.D.

N Engl J Med 1996; 335:1888-1896December 19, 1996

Abstract

Background

Wide geographic variation in the use of coronary angiography after myocardial infarction has been documented internationally and within the United States. An associated variation in clinical outcomes has not been consistently demonstrated.

Methods

We assessed the risk of death from heart disease and of any heart disease event (death, reinfarction, or rehospitalization) over a follow-up period of one to four years in 6851 patients hospitalized with acute myocardial infarction at 16 Kaiser Permanente hospitals from 1990 through 1992. The percentage of patients who underwent angiography within three months after infarction ranged from 30 to 77 percent. We selected a subcohort of 1109 patients from three hospitals with higher rates of angiography and four with lower rates for a record review to assess the severity of infarction, the number of coexisting conditions, treatments received, and the appropriateness and necessity of angiography, using established criteria.

Results

The rates of angiography were inversely related to the risk of death from heart disease (P = 0.03) and the risk of heart disease events (P<0.001) among the 16 hospitals after adjustment for age, sex, race, coexisting conditions, and the location of the infarction (subendocardial vs. transmural). In the subcohort, 440 patients met criteria indicating that angiography was necessary and 669 did not. Among the former, patients treated at hospitals with higher rates of angiography had a lower risk of death and of any heart disease event than those treated at hospitals with lower rates (hazard ratios, 0.67 and 0.72, respectively). Among the latter, the apparent benefits of being treated at hospitals with higher angiography rates were smaller (hazard ratios, 0.85 to 0.90 for death and any heart disease event, respectively).

Conclusions

During the one to four years after myocardial infarction, patients treated at hospitals with higher rates of angiography had more favorable outcomes than those treated at hospitals with lower rates. This association was stronger among patients for whom published criteria indicated that angiography was necessary.

Media in This Article

Figure 3Proportions of Patients Who Underwent Coronary Angiography within Three Months or More Than Three Months after the Index Myocardial Infarction, According to the RAND Scores for the Appropriateness and Necessity of Angiography.
Figure 1Unadjusted Proportions of Patients Who Underwent Coronary Angiography within Three Months or More Than Three Months after the Index Myocardial Infarction, in 16 Kaiser Permanente Hospitals, 1990–1992.
Article

There is considerable geographic variation in the use of coronary angiography and revascularization within the United States and internationally, both in general populations1-3 and among patients who have had myocardial infarctions.4-8 It is less clear whether this variation leads to differences in patient outcomes.4-7

Geographic variation may indicate overuse of a procedure (inappropriate use in persons not expected to benefit from the procedure) or underuse (failure to perform the procedure in persons who need it). Outcomes are more likely to differ when variation is due at least in part to the underuse of effective procedures.

Panels of experts have developed criteria for the appropriateness and necessity of coronary angiography and revascularization.9-13 To date, these criteria have been applied primarily to persons who undergo these procedures.14-20 The frequency of inappropriate use of procedures has been relatively low and is insufficient to explain geographic variation in procedure rates.14,20 These findings suggest that underuse may contribute to geographic variation, but this possibility has not been examined directly.

We studied whether variation in the rates of coronary angiography after myocardial infarction among 16 hospitals of a large health maintenance organization (HMO) was associated with differences in patient outcomes. We examined differences in the use of angiography rather than revascularization, because decisions regarding angiography involved more physicians and greater variation in practice patterns. Once referred for angiography, patients come under the care of a relatively small group of invasive cardiologists.

Methods

Study Setting and Patient Cohort

We conducted a retrospective, cohort study of 6851 patients 25 years of age or older who were discharged from hospitals of the Kaiser Permanente Medical Care Program, Northern California Region, with principal diagnoses of acute myocardial infarction (International Classification of Diseases, 9th Revision, Clinical Modification [ICD-9-CM] code 410) between January 1, 1990, and December 31, 1992. This group-model HMO served 2.4 million enrollees during this period through 15 program-owned hospitals and 1 contract community hospital. Three program-owned hospitals and the community hospital had coronary-angiography suites, but only one performed revascularization. Sixty-three percent of coronary angiographies and 15 percent of revascularizations were performed at these hospitals. The remainder were performed at seven community hospitals, often by Kaiser Permanente cardiologists.

Each patient's follow-up began with the first infarction during the study period. The first Kaiser hospital to which the patient was admitted was designated the index hospital for the attribution of outcomes. The index hospitalization also covered the time spent at another acute care hospital for angiography or revascularization for patients who were directly transferred. Not included were 611 patients admitted from home and discharged within less than five days afterward because their infarctions may have been subacute rather than acute.

Assessing Determinants of Angiography and Outcomes in the Full Cohort

Cardiac procedures (angiography, percutaneous transluminal coronary angioplasty, and coronary-artery bypass grafting) performed during follow-up were identified from hospital-discharge abstracts and from referrals and claims files from non-Kaiser hospitals. When procedures were performed more than once, the earliest postinfarction procedure was selected. Automated data sources were validated by comparison with a medical-record review in a subcohort of 1210 patients. For 1035 procedures, automated sources recorded 98.1 percent of angiographies, 91.5 percent of angioplasties, and 93.4 percent of bypass procedures.

Follow-up for outcomes extended from the date of the index admission to December 31, 1993, or to the date of death or disenrollment from Kaiser Permanente if it occurred earlier. Two outcomes were assessed: death from heart disease and any heart disease event (including death, reinfarction, and nonelective rehospitalization for other heart disease diagnoses). Deaths were identified from computerized death records of the State of California and classified as due to heart disease if the underlying cause of death was listed as an ICD-9-CM code of 410 to 429.

Reinfarctions were identified from subsequent hospitalizations with principal discharge diagnoses of myocardial infarction and from death certificates listing the principal cause of death as infarction or sudden cardiac death (ICD-9-CM code 798). Other heart disease events included hospitalizations with principal discharge diagnoses of ischemic heart disease (ICD-9-CM codes 411 to 414), arrhythmias (ICD-9-CM code 427), or congestive heart failure (ICD-9-CM code 428).

Coexisting conditions were identified on the basis of secondary discharge diagnoses during the index admission and all other hospitalizations in the previous five years. A Charlson comorbidity score,21 adapted for derivation from administrative data,22 was calculated for each patient given these diagnoses. The socioeconomic status of cohort members was estimated with proxy measures obtained by linking the patient's home address during the index hospitalization to 1990 U.S. Census block-group data for two measures: the percentage of block-group households below the poverty level and the percentage of adult residents with less than a high-school education. These measures are associated with health and the use of health services in our population.23-25

Measuring Appropriateness and Outcomes in a Subcohort

To measure the severity of the infarction, the degree of comorbidity, and the appropriateness of angiography in greater detail, a subcohort was randomly selected from among patients at three hospitals with the highest rates of angiography after myocardial infarction and four hospitals with the lowest rates from 1990 through 1991. This sampling approach was intended to maximize the power to detect any differences in outcomes with a relatively small sample. Hospitals were selected before the 1992 angiography rates were known. Therefore, the hospitals selected are not those with the three highest or four lowest rates for the entire study period (1990 through 1992). Of 1210 patients selected for the subcohort, 45 were excluded for the following reasons: a clinical diagnosis of infarction that was not confirmed by chart review (n = 25), cocaine-induced infarction (n = 5), or transferral from non-Kaiser hospitals with insufficient records available (n = 15). Subsequently, we excluded 51 additional patients who died within 48 hours after admission and 5 who died of noncardiac causes within three months after this admission, since many of these patients may not have been considered candidates for angiography. This left 1109 patients with confirmed acute infarction.

The severity of the infarction was assessed on the basis of the presence or absence of new Q waves, the location of the infarct (anterior vs. other), and the presence or severity of congestive heart failure (scored on a four-point scale in which a score of 0 indicated no mention of heart failure; a score of 1, mention of heart failure; a score of 2, mention of class IV or “intractable” failure; and a score of 3, mention of symptomatic hypotension or cardiogenic shock). Also abstracted was information on preexisting conditions needed to calculate the Charlson comorbidity index21 and on medical treatments (the administration and timing of thrombolytic agents, and in-hospital and post-discharge use of aspirin, beta-blockers, and angiotensin-converting–enzyme inhibitors).

RAND appropriateness scores for angiography9 were calculated for all subcohort members with RAND data-collection instruments. Scores were assigned for three intervals during hospitalization (the first 6 hours after the onset of chest pain, 6 to 12 hours after the onset, and from 12 hours after the onset to the time of discharge) and for the 12-week interval immediately after discharge. Patients who underwent angiography within three months after infarction were classified on the basis of the most recent appropriateness score before angiography. Patients who did not undergo angiography during this period were classified on the basis of their postdischarge score (if they survived after discharge) or their score for the last in-hospital interval if they died in the hospital. Analyses presented in this paper were repeated with the latter score for all subjects, with essentially identical results.

RAND appropriateness scores range from 1 to 9: angiography that is considered appropriate is given a score of 7 to 9, angiography whose appropriateness is uncertain is given a score of 4 to 6, and angiography that is considered inappropriate is given a score of 1 to 3. Patients who were judged to be appropriate candidates for angiography (n = 556) were further subdivided according to whether angiography was considered necessary or crucial (n = 440) or not necessary (n = 116).

Telephone interviews were conducted with 757 of 856 long-term survivors in the subcohort an average of 2.8 years (range, 1.3 to 4.8) after infarction. Forty-five patients (5.3 percent) declined to be interviewed, 45 could not be located, 7 were too sick to be interviewed, and 2 did not speak English. Current symptoms of chest pain and dyspnea were assessed on five-point scales ranging from no symptoms to symptoms at rest. Physical functioning was assessed with the Duke Activity Status Index.26

Statistical Analysis

Variables associated with the likelihood of angiography in the full cohort were studied with logistic regression. Cox proportional-hazards models were used to examine predictors of death from heart disease and of any heart disease event. The variables included age, sex, race, socioeconomic status, Charlson comorbidity score, location of the infarction (anterior or other), and type of infarction (subendocardial or transmural). To assess the effects of the hospital on patient outcomes, the patient's hospital was included in regression models first as a categorical variable (16 indicator variables were coded to compare each hospital to the regional mean27) and then as a continuous variable substituting each hospital's rate of angiography within three months after myocardial infarction.

Subcohort analyses compared outcomes in patients hospitalized at centers with higher rates of angiography and those hospitalized at centers with lower rates, after adjustment for demographic characteristics, the severity of infarction, and coexisting conditions. The type of hospital (higher vs. lower rate) was included in models as a dichotomous variable. Analyses were conducted in the entire subcohort and separately in the stratum in which angiography was deemed necessary (n = 440) and the stratum in which angiography was not deemed necessary (n = 669). A time-dependent indicator for the receipt of angiography was then added to determine whether angiography explained the apparent benefits of being hospitalized at a hospital with a higher rate of angiography.

Results

Determinants of Angiography and Outcomes in the Full Cohort

There was substantial variation among the 16 hospitals in the distributions of demographic and clinical variables (Table 1Table 1Distributions of Demographic and Clinical Variables among 16 Kaiser Permanente Hospitals for 6851 Patients Hospitalized with Acute Myocardial Infarction, 1990 –1992.). Forty-eight percent of the cohort underwent angiography within three months after myocardial infarction, but the rates ranged from 30 to 77 percent among the 16 hospitals (Figure 1Figure 1Unadjusted Proportions of Patients Who Underwent Coronary Angiography within Three Months or More Than Three Months after the Index Myocardial Infarction, in 16 Kaiser Permanente Hospitals, 1990–1992.). Three of the five hospitals with the highest rates of angiography, but none of the five hospitals with the lowest rates, had on-site angiography services. Hospital 5 was closely affiliated with a nearby community hospital that provided angiography services. The variation in the rates of angiography within three months after myocardial infarction changed very little after adjustment for age, sex, race, socioeconomic status, and the Charlson comorbidity score.

In proportional-hazards models, two hospitals with low three-month rates of angiography had adjusted risks of death from heart disease that were significantly above the regional average (Figure 2AFigure 2Hospital-Specific Hazard Ratios and 95 Percent Confidence Intervals for the Risk of Death from Ischemic Heart Disease (Panel A) and the Risk of Any Heart Disease Event (Panel B).) and one hospital with a high rate of angiography had a risk that was significantly below average. Overall, we found a weak inverse association between a hospital's three-month angiography rate and the risk of death from heart disease after adjustment for age, sex, race, the Charlson comorbidity score, and the type of infarction (subendocardial vs. transmural) (hazard ratio, 0.88 for a 20 percent increase in the angiography rate; P = 0.03).

There was a clearer trend toward fewer heart disease events at hospitals with higher rates of angiography (Figure 2B). The linear association between three-month angiography rates and this outcome was significant (hazard ratio, 0.82 for a 20 percent increase in the angiography rate; P<0.001). The patients' sex and race were unrelated to outcomes. The rates of revascularization within three months after infarction correlated very highly with the three-month rates of angiography (r = 0.93) and were more strongly associated with both mortality and any heart disease event (hazard ratios, 0.78 and 0.74, respectively; P<0.01 for each comparison).

Appropriateness of Angiography and Outcomes in the Subcohort

Among the 1109 eligible subcohort members, the rates of angiography within three months after infarction averaged 68 percent at three hospitals with higher rates of angiography and 38 percent at four hospitals with lower rates. Patients treated at hospitals with lower rates of angiography were slightly older and significantly more likely to be female and nonwhite (Table 2Table 2Distributions of the Clinical, Demographic, and Treatment Characteristics and Outcomes among the Seven Hospitals in the Subcohort Study, According to the Volume of Angiography.). Scores on the Charlson comorbidity index did not differ between patients treated at hospitals with higher rates of angiography and those treated at hospitals with lower rates. After adjustment for age, sex, and race, patients treated at hospitals with higher rates of angiography were substantially more likely to undergo revascularization, but the use of thrombolysis and recommended discharge medications did not differ significantly between the two groups. The rates of death from heart disease in the hospital and after discharge were lower at hospitals with higher rates of angiography.

Appropriateness of Angiography

Of 1109 subcohort patients, 440 (39.7 percent) met the RAND necessity criteria for angiography. The rates of angiography within three months after myocardial infarction were highest (77.5 percent) among these patients, intermediate (51.0 percent) among the 116 patients who met the criteria for appropriateness but not for necessity and the 227 patients for whom the appropriateness of angiography was uncertain, and lowest (14.4 percent) among the 326 patients for whom angiography was deemed inappropriate (Figure 3Figure 3Proportions of Patients Who Underwent Coronary Angiography within Three Months or More Than Three Months after the Index Myocardial Infarction, According to the RAND Scores for the Appropriateness and Necessity of Angiography.). However, there were wide variations in the patterns of practice for patients who met the necessity criteria, with 89.2 percent of these patients undergoing angiography at hospitals with higher rates and 66.4 percent undergoing the procedure at hospitals with lower rates (P<0.001). More angiographies were performed more than three months after myocardial infarction at hospitals with lower rates of angiography (Figure 3). Differences in the use of angiography between hospitals with higher rates of angiography and those with lower rates were even greater among patients for whom the appropriateness of angiography was deemed uncertain. Angiography rates were much lower among patients for whom angiography was judged inappropriate, although two hospitals with higher rates performed angiography in more than 20 percent of these patients.

Outcomes

For the entire subcohort, being hospitalized at a hospital with a higher rate of angiography was associated with a 25 percent lower risk of death from heart disease (P = 0.06) and a 15 percent lower risk of any heart disease event (P = 0.08) after adjustment for age, sex, race, Charlson comorbidity score, congestive-heart-failure score, and history of prior infarction (Table 3Table 3Risk of Death from Heart Disease in the Entire Subcohort and in the Subgroups in Which Angiography Was Deemed Necessary or Not Necessary. and Table 4Table 4Risk of Any Heart Disease Event in the Entire Subcohort and in the Subgroups in Which Angiography Was Deemed Necessary or Not Necessary.). Given that the rates of angiography differed by 30 percent between hospitals with higher rates of angiography and those with lower rates, these effect sizes are very similar to those observed for the full cohort. The location of infarction and the presence of new Q waves were not related to outcomes after adjustment for the congestive-heart-failure score.

The benefits of being hospitalized at a hospital with a higher rate of angiography appeared greater for both outcomes in patients who needed angiography. The adjusted hazard ratios for mortality (hospitals with higher rates vs. those with lower rates) were 0.67 for patients who met the criteria for the necessity of angiography and 0.85 for patients who did not (Table 3); for any heart disease event, the respective hazard ratios were 0.72 and 0.90 (Table 4). Tests for an interaction between necessity and the type of hospital (higher rates of angiography vs. lower rates) were not statistically significant (P = 0.30 for mortality and P = 0.32 for any heart disease event).

Inclusion of the variable for undergoing angiography markedly attenuated the apparent benefits of being hospitalized at a hospital with a higher rate of angiography for both outcomes among patients who met the necessity criteria, but not among the remaining patients (Table 5Table 5Risk of Death from Heart Disease and of Any Heart Disease Event in Relation to the Hospital Angiography Rate before (Model I) and after (Model II) Adjustment for Undergoing Angiography in the Subgroups in Which Angiography Was Deemed Necessary or Not Necessary.). Moreover, the hazard ratios for the angiography variable suggested greater efficacy in patients judged to need the procedure. The interaction between necessity and angiography was nearly significant for mortality (P = 0.09) and was significant for any heart disease event (P<0.001).

Measures of angina, shortness of breath, and physical functioning did not differ significantly between survivors treated at hospitals with higher rates of angiography and those treated at hospitals with lower rates in either subgroup before or after adjustment for covariates.

Discussion

This study examined whether outcomes after myocardial infarction differed between hospitals with higher rates of coronary angiography and those with lower rates. The use of coronary angiography after myocardial infarction in this HMO was similar to that of other community-hospital settings during the same period28,29 but varied widely among the hospitals that are part of the HMO. Variation was not explained by demographic or clinical differences between hospital populations, but it was related to the availability of on-site angiography services, as in other settings.29,30

Patients from hospitals with lower rates of angiography were not more likely to undergo revascularization after angiography. Thus, these hospitals were not successfully identifying a smaller group of patients with a greater need for revascularization. To determine whether these hospitals may have missed some patients who needed angiography, we applied the RAND criteria for the appropriateness and necessity of angiography9 in the subcohort, regardless of whether the patient underwent angiography. Kravitz et al.31 used a similar approach, applying appropriateness criteria for revascularization to a cohort of patients after angiography. Among patients in the subcohort who met the criteria for the necessity of angiography, we found sizable differences among hospitals in the proportion who received it.

The risks of death from heart disease and of heart disease events were both lower among patients in hospitals with higher rates of angiography. The subcohort study was not originally planned (nor did it have sufficient power) to test for differences in these associations between subgroups stratified according to the necessity of angiography. However, three aspects of the stratified analyses suggest that these overall associations were due to better outcomes in patients who underwent coronary angiography that was deemed necessary. The associations were consistently stronger for patients in whom angiography was deemed necessary; the variable for undergoing angiography almost entirely explained the benefits of facilities with higher rates of angiography in this stratum; and the estimated efficacy of angiography itself was substantially greater in patients who needed the procedure. These findings also support the validity of the RAND necessity criteria.

Although the use of other recommended therapies did not differ significantly between hospitals with higher rates of angiography and those with lower rates, the use of thrombolysis and treatment with aspirin and angiotensin-converting–enzyme inhibitors after discharge were somewhat more common at hospitals with higher rates. It is possible that their more favorable outcomes may be due in part to these therapies rather than to angiography. However, the specificity of the benefit of hospitals with higher rates of angiography (and of angiography itself) for patients who needed angiography and the observation that revascularization was even more closely related to outcomes than angiography suggest that angiography and the revascularization that followed it had the larger role in explaining benefits of hospitals with higher rates.

The apparent benefits could also be due in part to remaining case-mix differences between populations. We examined and adjusted for a number of demographic characteristics, the severity of disease, and the Charlson comorbidity score. The RAND appropriateness criteria incorporate additional indicators of disease severity, including the ejection fraction, results of noninvasive tests for ischemia, and the presence of persistent angina. Case-mix differences would be unlikely to explain the differential benefit of hospitals with higher rates of angiography for patients in whom angiography was deemed necessary.

Four previous geographic-variation studies have examined the association of angiography rates with mortality after infarction. In the Global Utilization of Streptokinase and Tissue Plasminogen Activator for Occluded Arteries trial,5,6 higher rates of angiography in the United States (72 percent) than in Canada (25 percent) were associated with higher survival rates at one year5; a smaller variation among various regions of the United States (52 to 81 percent) was unrelated to mortality.6 Postinfarction angiography rates in the Survival and Ventricular Enlargement trial4 were 78 percent and 48 percent in U.S. and Canadian hospitals, respectively, with no significant difference in one-year mortality. This trial excluded patients with congestive heart failure and required all patients with angina to undergo angiography. Guadagnoli et al.7 found no significant difference in the two-year mortality rate between Medicare patients from New York and those from Texas, despite moderate differences in the rates of angiography after infarction (30 percent and 45 percent, respectively). Angiography rates among patients at the highest risk of reinfarction were said to be similar among the states. Thus, the negative studies excluded patients who needed angiography, treated them similarly across comparison groups, or studied smaller rate differences than our study.

Previous studies4,5 have reported more symptoms and worse functional status due to chest pain and dyspnea in populations with lower rates of angiography. We found no such differences. However, we did not assess functional status until nearly three years after infarction, giving hospitals with lower rates of angiography time to perform angiography in symptomatic patients. The higher survival rate at hospitals with higher rates of angiography could also serve to obscure differences in these outcomes.

As pointed out by Mant and Hicks,32 the sensitivity of outcomes analyses to variations in the patterns of practice is diminished if only a portion of a population is eligible for a certain practice. In this study, necessity criteria were helpful in focusing an outcomes comparison on the appropriate patients. Our finding of better outcomes with higher procedure rates cannot be generalized to other settings in the absence of information on the need for the procedure. Indeed, we observed some evidence of overuse, which may explain most or all of the geographic variation in other settings. Within this HMO, our study findings have been shared with hospital chiefs of cardiology since 1994. The rates of angiography within three months after infarction increased from 48 percent to 58 percent regionwide from 1992 to 1995, with a reduction in the variation among facilities.

Supported in part by the Permanente Medical Group, by a grant (HL02942) from the National Heart, Lung, and Blood Institute, and by a grant (HS08362) from the Agency for Health Care Policy and Research, Rockville, Md.

We are indebted to Laura Ransom for coordinating the study and developing data-collection instruments; to Evelyn Chan, Lynn Ferrao, Kirsten Tretheway, and Beverly Whitmarsh for careful review of medical records; to Gina Smith, Lynda Tish, and Annette Wiggin for conducting the telephone interviews; to Lyn Wender for medical editing; and to Steven J. Bernstein, M.D., for reviewing and providing consultation on these analyses.

Source Information

From the Division of Research, Kaiser Permanente Medical Care Program (Northern California Region), Oakland (J.V.S., B.H.F., B.E.S., A.F.T.); the Division of Cardiology, Kaiser Permanente Medical Center, San Francisco (R.J.L.); the Department of Physiological Nursing (C.C.W., E.S.F.) and the Department of Medicine and Cardiovascular Research Institute (H.V.B.), University of California, San Francisco; and the Departments of Health Research and Policy and Medicine, Stanford University School of Medicine, Stanford, Calif. (M.A.H.).

Address reprint requests to Dr. Selby at the Division of Research, Kaiser Permanente Medical Care Program, 3505 Broadway, Oakland, CA 94611.

References

References

  1. 1

    Anderson GM, Grumbach K, Luft HS, Roos LL, Mustard C, Brook R. Use of coronary artery bypass surgery in the United States and Canada: influence of age and income. JAMA 1993;269:1661-1666
    CrossRef | Web of Science | Medline

  2. 2

    Whittle J, Conigliaro J, Good CB, Lofgren RP. Racial differences in the use of invasive cardiovascular procedures in the Department of Veterans Affairs medical system. N Engl J Med 1993;329:621-627
    Full Text | Web of Science | Medline

  3. 3

    Goldberg KC, Hartz AJ, Jacobsen SJ, Krakauer H, Rimm AA. Racial and community factors influencing coronary artery bypass graft surgery rates for all 1986 Medicare patients. JAMA 1992;267:1473-1477
    CrossRef | Web of Science | Medline

  4. 4

    Rouleau JL, Moye LA, Pfeffer MA, et al. A comparison of management patterns after acute myocardial infarction in Canada and the United States. N Engl J Med 1993;328:779-784
    Full Text | Web of Science | Medline

  5. 5

    Mark DB, Naylor CD, Hlatky MA, et al. Use of medical resources and quality of life after acute myocardial infarction in Canada and the United States. N Engl J Med 1994;331:1130-1135
    Full Text | Web of Science | Medline

  6. 6

    Pilote L, Califf RM, Sapp S, et al. Regional variation across the United States in the management of acute myocardial infarction. N Engl J Med 1995;333:565-572
    Full Text | Web of Science | Medline

  7. 7

    Guadagnoli E, Hauptman PJ, Ayanian JZ, Pashos CL, McNeil BJ, Cleary PD. Variation in the use of cardiac procedures after acute myocardial infarction. N Engl J Med 1995;333:573-578
    Full Text | Web of Science | Medline

  8. 8

    Kuhn EM, Hartz AJ, Baras M. Correlation of rates of coronary artery bypass surgery, angioplasty, and cardiac catheterization in 305 large communities for persons age 65 and older. Health Serv Res 1995;30:425-436
    Web of Science | Medline

  9. 9

    Bernstein SJ, Laouri M, Hilborne LH, et al. Coronary angiography: a literature review and ratings of appropriateness and necessity. Santa Monica, Calif.: RAND, 1992. (Publication no. JRA-03.)

  10. 10

    Guidelines for coronary angiography: a report of the American College of Cardiology/American Heart Association Task Force on Assessment of Diagnostic and Therapeutic Cardiovascular Procedures (Subcommittee on Coronary Angiography). Circulation 1987;76:963A-977A
    CrossRef | Web of Science | Medline

  11. 11

    Leape LL, Hilborne LH, Kahan JP, et al. Coronary artery bypass graft: a literature review and ratings of appropriateness and necessity. Santa Monica, Calif.: Rand, 1991. (Publication no. JRA-02.)

  12. 12

    Hilborne LH, Leape LL, Kahan JP, Park RE, Kamberg CJ, Brook RH. Percutaneous transluminal coronary angioplasty: a literature review and ratings of appropriateness and necessity. Santa Monica, Calif.: Rand, 1991. (Publication no. JRA-01.)

  13. 13

    Kahan JP, Bernstein SJ, Leape LL, et al. Measuring the necessity of medical procedures. Med Care 1994;32:357-365
    CrossRef | Web of Science | Medline

  14. 14

    Chassin MR, Kosecoff J, Park RE, et al. Does inappropriate use explain geographic variations in the use of health care services? A study of three procedures. JAMA 1987;258:2533-2537
    CrossRef | Web of Science | Medline

  15. 15

    Winslow CM, Kosecoff JB, Chassin M, Kanouse DE, Brook RH. The appropriateness of performing coronary artery bypass surgery. JAMA 1988;260:505-509
    CrossRef | Web of Science | Medline

  16. 16

    Leape LL, Hilborne LH, Park RE, et al. The appropriateness of use of coronary artery bypass graft surgery in New York State. JAMA 1993;269:753-760
    CrossRef | Web of Science | Medline

  17. 17

    Bernstein SJ, Hilborne LH, Leape LL, et al. The appropriateness of use of coronary angiography in New York State. JAMA 1993;269:766-769
    CrossRef | Web of Science | Medline

  18. 18

    Hilborne LH, Leape LL, Bernstein SJ, et al. The appropriateness of use of percutaneous transluminal coronary angioplasty in New York State. JAMA 1993;269:761-765
    CrossRef | Web of Science | Medline

  19. 19

    McGlynn EA, Naylor CD, Anderson GM, et al. Comparison of the appropriateness of coronary angiography and coronary artery bypass graft surgery between Canada and New York State. JAMA 1994;272:934-940
    CrossRef | Web of Science | Medline

  20. 20

    Bengtson A, Herlitz J, Karlsson T, Brandrup-Wognsen G, Hjalmarson A. The appropriateness of performing coronary angiography and coronary artery revascularization in a Swedish population. JAMA 1994;271:1260-1265
    CrossRef | Web of Science | Medline

  21. 21

    Charlson ME, Pompei P, Ales KL, MacKenzie CR. A new method of classifying prognostic comorbidity in longitudinal studies: development and validation. J Chronic Dis 1987;40:373-383
    CrossRef | Medline

  22. 22

    Deyo RA, Cherkin DC, Ciol MA. Adapting a clinical comorbidity index for use with ICD-9-CM administrative databases. J Clin Epidemiol 1992;45:613-619
    CrossRef | Web of Science | Medline

  23. 23

    Krieger N. Overcoming the absence of socioeconomic data in medical records: validation and application of a census-based methodology. Am J Public Health 1992;82:703-710
    CrossRef | Web of Science | Medline

  24. 24

    Krieger N. Women and social class: a methodological study comparing individual, household, and census measures as predictors of black/white differences in reproductive history. J Epidemiol Community Health 1991;45:35-42
    CrossRef | Web of Science | Medline

  25. 25

    Selby JV, Fireman BH, Swain BE. Effect of a copayment on use of the emergency department in a health maintenance organization. N Engl J Med 1996;334:635-641
    Full Text | Web of Science | Medline

  26. 26

    Hlatky MA, Boineau RE, Higginbotham MB, et al. A brief self-administered questionnaire to determine functional capacity (the Duke Activity Status Index). Am J Cardiol 1989;64:651-654
    CrossRef | Web of Science | Medline

  27. 27

    Hosmer DW Jr, Lemeshow S. Applied logistic regression. New York: John Wiley, 1989.

  28. 28

    Rogers WJ, Bowlby LJ, Chandra NC, et al. Treatment of myocardial infarction in the United States (1990 to 1993): observations from the National Registry of Myocardial Infarction. Circulation 1994;90:2103-2114
    Web of Science | Medline

  29. 29

    Every NR, Larson EB, Litwin PE, et al. The association between on-site cardiac catheterization facilities and the use of coronary angiography after acute myocardial infarction. N Engl J Med 1993;329:546-551
    Full Text | Web of Science | Medline

  30. 30

    Blustein J. High-technology cardiac procedures: the impact of service availability on service use in New York State. JAMA 1993;270:344-349
    CrossRef | Web of Science | Medline

  31. 31

    Kravitz RL, Laouri M, Kahan PJ, et al. Validity of criteria used for detecting underuse of coronary revascularization. JAMA 1995;274:632-638
    CrossRef | Web of Science | Medline

  32. 32

    Mant J, Hicks N. Detecting differences in quality of care: the sensitivity of measures of process and outcome in treating acute myocardial infarction. BMJ 1995;311:793-796
    CrossRef | Web of Science | Medline

Citing Articles (48)

Citing Articles

  1. 1

    Kristin M. Lefebvre, Lawrence A. Lavery. (2011) Disparities in Amputations in Minorities. Clinical Orthopaedics and Related Research® 469:7, 1941-1950
    CrossRef

  2. 2

    R.P. Gale, G. Barosi, T. Barbui, F. Cervantes, K. Dohner, B. Dupriez, V. Gupta, C. Harrison, R. Hoffman, J.-J. Kiladjian, R. Mesa, M.F. Mc Mullin, F. Passamonti, V. Ribrag, G. Roboz, G. Saglio, A. Vannucchi, S. Verstovsek. (2011) What are RBC-transfusion-dependence and -independence?. Leukemia Research 35:1, 8-11
    CrossRef

  3. 3

    Douglas G. Merrill. (2011) The Anesthesiologist as Administrator. ASA Refresher Courses in Anesthesiology 39:1, 106-114
    CrossRef

  4. 4

    Therese A. Stukel, David A. Alter, Michael J. Schull, Dennis T. Ko, Ping Li. (2010) Association Between Hospital Cardiac Management and Outcomes for Acute Myocardial Infarction Patients. Medical Care 48:2, 157-165
    CrossRef

  5. 5

    Dustin W. Ballard, Mary Price, Vicki Fung, Richard Brand, Mary E. Reed, Bruce Fireman, Joseph P. Newhouse, Joseph V. Selby, John Hsu. (2010) Validation of an Algorithm for Categorizing the Severity of Hospital Emergency Department Visits. Medical Care 48:1, 58-63
    CrossRef

  6. 6

    Camille A. Pearte, Merle Myerson, Joseph Coresh, Robert L. McNamara, Wayne Rosamond, Herman Taylor, Teri A. Manolio. (2008) Variation and Temporal Trends in the Use of Diagnostic Testing During Hospitalization for Acute Myocardial Infarction by Age, Gender, Race, and Geography (the Atherosclerosis Risk In Communities Study). The American Journal of Cardiology 101:9, 1219-1225
    CrossRef

  7. 7

    Neal T. Wallace, K. John McConnell, Charles A. Gallia, Jeanene A. Smith. (2008) How Effective Are Copayments in Reducing Expenditures for Low-Income Adult Medicaid Beneficiaries? Experience from the Oregon Health Plan. Health Services Research 43:2, 515-530
    CrossRef

  8. 8

    Vicki Fung, Jie Huang, Richard Brand, Joseph P. Newhouse, John Hsu. (2007) Hypertension treatment in a medicare population: Adherence and systolic blood pressure control. Clinical Therapeutics 29:5, 972-984
    CrossRef

  9. 9

    John Hsu, Mary Price, Richard Brand, G. Thomas Ray, Bruce Fireman, Joseph P. Newhouse, Joseph V. Selby. (2006) Cost-Sharing for Emergency Care and Unfavorable Clinical Events: Findings from the Safety and Financial Ramifications of ED Copayments Study. Health Services Research 41:5, 1801-1820
    CrossRef

  10. 10

    Debra Saliba, David Solomon, Laurence Rubenstein, Roy Young, John Schnelle, Carol Roth, Neil Wenger. (2005) Quality Indicators for the Management of Medical Conditions in Nursing Home Residents. Journal of the American Medical Directors Association 6:3, S36-S48
    CrossRef

  11. 11

    Peter W. Groeneveld, Sara B. Laufer, Alan M. Garber. (2005) Technology Diffusion, Hospital Variation, and Racial Disparities Among Elderly Medicare Beneficiaries. Medical Care 43:4, 320-329
    CrossRef

  12. 12

    Bonnie T. Zima, Michael S. Hurlburt, Penny Knapp, Heather Ladd, Lingqi Tang, Naihua Duan, Peggy Wallace, Abram Rosenblatt, John Landsverk, Kenneth B. Wells. (2005) Quality of Publicly-Funded Outpatient Specialty Mental Health Care for Common Childhood Psychiatric Disorders in California. Journal of the American Academy of Child & Adolescent Psychiatry 44:2, 130-144
    CrossRef

  13. 13

    Debra Saliba, David Solomon, Laurence Rubenstein, Roy Young, John Schnelle, Carol Roth, Neil Wenger. (2005) Quality Indicators for the Management of Medical Conditions in Nursing Home Residents. Journal of the American Medical Directors Association 6:SUPPLEMENT, S35???S48
    CrossRef

  14. 14

    Debra Saliba, David Solomon, Laurence Rubenstein, Roy Young, John Schnelle, Carol Roth, Neil Wenger. (2004) Quality Indicators for the Management of Medical Conditions in Nursing Home Residents. Journal of the American Medical Directors Association 5:5, 297-309
    CrossRef

  15. 15

    Carlos Iribarren, Alan S. Go, Irina Tolstykh, Stephen Sidney, S. Claiborne Johnston, David B. Spring. (2004) Breast Vascular Calcification and Risk of Coronary Heart Disease, Stroke, and Heart Failure. Journal of Women's Health 13:4, 381-389
    CrossRef

  16. 16

    Catherine H. MacLean, Kenneth G. Saag, Daniel H. Solomon, Sally C. Morton, Sarah Sampsel, John H. Klippel. (2004) Measuring quality in arthritis care: Methods for developing the Arthritis Foundation's quality indicator set. Arthritis & Rheumatism 51:2, 193-202
    CrossRef

  17. 17

    T. Niemann, R. Labouriau, H. Toft Sorensen, N. Thorsgaard, T. Toftegaard Nielsen. (2004) Prognostic impact of different regional referral practices for interventional investigation and coronary treatment after exercise testing: a population-based 5-year follow-up study. Journal of Internal Medicine 255:4, 478-485
    CrossRef

  18. 18

    Ted R. Mikuls, Catherine H. MacLean, Jason Olivieri, Fausto Patino, Jeroan J. Allison, John T. Farrar, Warren B. Bilker, Kenneth G. Saag. (2004) Quality of care indicators for gout management. Arthritis & Rheumatism 50:3, 937-943
    CrossRef

  19. 19

    McGlynn, Elizabeth A., Asch, Steven M., Adams, John, Keesey, Joan, Hicks, Jennifer, DeCristofaro, Alison, Kerr, Eve A., . (2003) The Quality of Health Care Delivered to Adults in the United States. New England Journal of Medicine 348:26, 2635-2645
    Full Text

  20. 20

    Angelo B. Biviano, Steven R. Bergmann, Joseph Tenenbaum, Jennifer Sullivan, Eileen Hurley, James Giglio, LeRoy E. Rabbani. (2003) Design of a Comprehensive Chest Pain Initiative in an Academic Urban Hospital. Critical Pathways in Cardiology: A Journal of Evidence-Based Medicine 2:2, 113-117
    CrossRef

  21. 21

    Petersen, Laura A., Normand, Sharon-Lise T., Leape, Lucian L., McNeil, Barbara J., . (2003) Regionalization and the Underuse of Angiography in the Veterans Affairs Health Care System as Compared with a Fee-for-Service System. New England Journal of Medicine 348:22, 2209-2217
    Full Text

  22. 22

    Elizabeth A. McGlynn, Eve A. Kerr, John Adams, Joan Keesey, Steven M. Asch. (2003) Quality of Health Care for Women. Medical Care 41:5, 616-625
    CrossRef

  23. 23

    Nandini Dendukuri, Sharon-Lise T. Normand, Barbara J. McNeil. (2003) Impact of Cardiac Service Availability on Case-Selection for Angiography and Survival Associated with Angiography. Health Services Research 38:1p1, 21-40
    CrossRef

  24. 24

    Debra Saliba, John F. Schnelle. (2002) Indicators of the Quality of Nursing Home Residential Care. Journal of the American Geriatrics Society 50:8, 1421-1430
    CrossRef

  25. 25

    McNeil, Barbara J., . (2001) Hidden Barriers to Improvement in the Quality of Care. New England Journal of Medicine 345:22, 1612-1620
    Full Text

  26. 26

    Paul G Shekelle, R.E Park, James P Kahan, Lucian L Leape, Caren J Kamberg, Steven J Bernstein. (2001) Sensitivity and specificity of the RAND/UCLA Appropriateness Method to identify the overuse and underuse of coronary revascularization and hysterectomy. Journal of Clinical Epidemiology 54:10, 1004-1010
    CrossRef

  27. 27

    A. Di Carlo, R. H. I. Andtbacka, I. Shrier, P. Belliveau, J. L. Trudel, B. L. Stein, P. H. Gordon, C. A. Vasilevsky. (2001) The value of specialization—is there an outcome difference in the management of fistulas complicating diverticulitis. Diseases of the Colon & Rectum 44:10, 1456-1463
    CrossRef

  28. 28

    Edward Guadagnoli, Mary Beth Landrum, Sharon-Lise T. Normand, John Z. Ayanian, Pushkal Garg, Paul J. Hauptman, Thomas J. Ryan, Barbara J. McNeil. (2001) Impact of Underuse, Overuse, and Discretionary Use on Geographic Variation in the Use of Coronary Angiography After Acute Myocardial Infarction. Medical Care 39:5, 446-458
    CrossRef

  29. 29

    Hemingway, Harry, Crook, Angela M., Feder, Gene, Banerjee, Shrilla, Dawson, J. Rex, Magee, Patrick, Philpott, Sue, Sanders, Julie, Wood, Alan, Timmis, Adam D., . (2001) Underuse of Coronary Revascularization Procedures in Patients Considered Appropriate Candidates for Revascularization. New England Journal of Medicine 344:9, 645-654
    Full Text

  30. 30

    Shekelle, Paul G., . (2001) Are Appropriateness Criteria Ready for Use in Clinical Practice?. New England Journal of Medicine 344:9, 677-678
    Full Text

  31. 31

    Bruno Detournay, Xavier Huet, Fran??ois Fagnani, Gilles Montalescot. (2000) Economic Evaluation of Enoxaparin Sodium versus Heparin in Unstable Angina. PharmacoEconomics 18:1, 83-89
    CrossRef

  32. 32

    Robert Peter Gale, Rolla Edward Park, Robert Dubois, Jacob D Bitran, Aman Buzdar, Gabriel Hortobagyi, Stephen E Jones, Gary S Lazar, Gary Spitzer, Sandra M Swain, Clarence B Vaughn, Charles E Vogel, Silvana Martino. (2000) Delphi-panel analysis of appropriateness of high-dose chemotherapy and blood cell or bone marrow autotransplants in women with breast cancer. Clinical Transplantation 14:1, 32-41
    CrossRef

  33. 33

    Robert Peter Gale, Rolla Edward Park, Robert W. Dubois, Geoffrey P. Herzig, William G. Hocking, Mary M. Horowitz, Armand Keating, Sanford Kempin, Charles A. Linker, Charles A. Schiffer, Peter H. Wiernik, Daniel J. Weisdorf, Kanti R. Rai. (1999) Delphi-panel analysis of appropriateness of high-dose therapy and bone marrow transplants in chronic myelogenous leukemia in chronic phase. Leukemia Research 23:9, 817-826
    CrossRef

  34. 34

    Robert Peter Gale, Rolla Edward Park, Robert W. Dubois, Geoffrey P. Herzig, William G. Hocking, Mary M. Horowitz, Armand Keating, Sanford Kempin, Charles A. Linker, Charles A. Schiffer, Peter H. Wiernik, Daniel J. Weisdorf, Kanti R. Rai. (1999) Delphi-panel analysis of appropriateness of high-dose therapy and bone marrow transplants in adults with acute myelogenous leukemia in 1st remission. Leukemia Research 23:8, 709-718
    CrossRef

  35. 35

    Shmuel Gottlieb, Valentina Boyko, David Harpaz, Hanoch Hod, Miriam Cohen, Lori Mandelzweig, Zahi Khoury, Shlomo Stern, Solomon Behar. (1999) Long-term (three-year) prognosis of patients treated with reperfusion or conservatively after acute myocardial infarction. Journal of the American College of Cardiology 34:1, 70-82
    CrossRef

  36. 36

    Iribarren, Carlos, Tekawa, Irene S., Sidney, Stephen, Friedman, Gary D., . (1999) Effect of Cigar Smoking on the Risk of Cardiovascular Disease, Chronic Obstructive Pulmonary Disease, and Cancer in Men. New England Journal of Medicine 340:23, 1773-1780
    Full Text

  37. 37

    Patrick J Scanlon, David P Faxon, Anne-Marie Audet, Blase Carabello, Gregory J Dehmer, Kim A Eagle, Ronald D Legako, Donald F Leon, John A Murray, Steven E Nissen, Carl J Pepine, Rita M Watson, James L Ritchie, Raymond J Gibbons, Melvin D Cheitlin, Kim A Eagle, Timothy J Gardner, Arthur Garson, Richard O Russell, Thomas J Ryan, Sidney C Smith. (1999) ACC/AHA guidelines for coronary angiography. Journal of the American College of Cardiology 33:6, 1756-1824
    CrossRef

  38. 38

    Lynette L. Y. Lim, Rachel L. O'Connell, Richard F. Heller. (1999) Differences in management of heart attack patients between metropolitan and regional hospitals in the Hunter Region of Australia. Australian and New Zealand Journal of Public Health 23:1, 61-66
    CrossRef

  39. 39

    (1998) The Hospitalist Movement and the Future of Academic General Internal Medicine. Journal of General Internal Medicine 13:11, 783-785
    CrossRef

  40. 40

    Robert Peter Gale, Rolla Edward Park, Robert W Dubois, Geoffrey P Herzig, William G Hocking, Mary M Horowitz, Armand Keating, Sanford Kempin, Charles A Linker, Charles A Schiffer, Peter H Wiernik, Daniel J Weisdorf, Kanti R Rai. (1998) Delphi-panel analysis of appropriateness of high-dose therapy and bone marrow transplants in adults with acute lymphoblastic leukemia in first remission. Leukemia Research 22:11, 973-981
    CrossRef

  41. 41

    Paul N Casale, Jayne L Jones, Flossie E Wolf, Yanfen Pei, L.Marlin Eby. (1998) Patients treated by cardiologists have a lower in-hospital mortality for acute myocardial infarction. Journal of the American College of Cardiology 32:4, 885-889
    CrossRef

  42. 42

    Ayanian, John Z., Landrum, Mary Beth, Normand, Sharon-Lise T., Guadagnoli, Edward, McNeil, Barbara J., . (1998) Rating the Appropriateness of Coronary Angiography — Do Practicing Physicians Agree with an Expert Panel and with Each Other?. New England Journal of Medicine 338:26, 1896-1904
    Full Text

  43. 43

    Shekelle, Paul G., Kahan, James P., Bernstein, Steven J., Leape, Lucian L., Kamberg, Caren J., Park, R.E., . (1998) The Reproducibility of a Method to Identify the Overuse and Underuse of Medical Procedures. New England Journal of Medicine 338:26, 1888-1895
    Full Text

  44. 44

    Lilian Murray, Iain B. Squire, John L. Reid, Kennedy R. Lees. (1998) Determinants of the blood pressure response to the first dose of ACE inhibitor in mild to moderate congestive heart failure. British Journal of Clinical Pharmacology 45:6, 559-566
    CrossRef

  45. 45

    Jaume Marrugat, Ginés Sanz, Rafel Masiá, Vicente Valle, Lluis Molina, Maria Cardona, Joan Sala, Lluis Serés, Lluis Szescielinski, Xavier Albert, Josep Lupón, Jordi Alonso. (1997) Six-Month Outcome in Patients With Myocardial Infarction Initially Admitted to Tertiary and Nontertiary Hospitals. Journal of the American College of Cardiology 30:5, 1187-1192
    CrossRef

  46. 46

    Allen J Taylor, Gregg S Meyer, Robert W Morse, Clarence E Pearson. (1997) Can Characteristics of a Health Care System Mitigate Ethnic Bias in Access to Cardiovascular Procedures? Experience From the Military Health Services System. Journal of the American College of Cardiology 30:4, 901-907
    CrossRef

  47. 47

    Alistair S Hall, Gordon D Murray, Stephen G Ball. (1997) Follow-up study of patients randomly allocated ramipril or placebo for heart failure after acute myocardial infarction: AIRE Extension (AIREX) Study. The Lancet 349:9064, 1493-1497
    CrossRef

  48. 48

    Goldman, Lee, . (1996) The Value of Cardiology. New England Journal of Medicine 335:25, 1918-1919
    Full Text