Join the 200th Anniversary Celebration

Special Article

Effect of a Copayment on Use of the Emergency Department in a Health Maintenance Organization

Joe V. Selby, M.D., M.P.H., Bruce H. Fireman, M.A., and Bix E. Swain, M.S.

N Engl J Med 1996; 334:635-642March 7, 1996

Abstract

Background

Use of the emergency department for nonemergency care is frequent and costly. We studied the effect of a copayment on emergency department use in a group-model health maintenance organization (HMO).

Methods

We examined the use of the emergency department in 1992 and 1993 by 30,276 subjects who ranged in age from 1 to 63 years at the start of the study and belonged to the Kaiser Permanente HMO in northern California. We assessed their use of various HMO services and their clinical outcomes before and after the introduction of a copayment of $25 to $35 for using the emergency department. This copayment group was compared with two randomly selected control groups not affected by the copayment. One control group, with 60,408 members, was matched for age, sex, and area of residence to the copayment group. The second, with 37,539 members, was matched for these factors and also for the type of employer.

Results

After adjustment for age, sex, socioeconomic status, and use of the emergency department in 1992, the decline in the number of visits in 1993 was 14.6 percentage points greater in the copayment group than in either control group (P<0.001 for each comparison). Visits for urgent care did not increase among subjects in any stratum defined by age and sex, and neither did the number of outpatient visits by adults and children. The decline in emergency visits for presenting conditions classified as “always an emergency” was small and not significant. For conditions classified as “often an emergency,” “sometimes not an emergency,” or “often not an emergency,” the declines in the use of the emergency department were larger and statistically significant, and they increased with decreasing severity of the presenting condition. Although our ability to detect any adverse effects of the copayment was limited, there was no suggestion of excess adverse events in the copayment group, such as increases in mortality or in the number of potentially avoidable hospitalizations.

Conclusions

Among members of an HMO, the introduction of a small copayment for the use of the emergency department was associated with a decline of about 15 percent in the use of that department, mostly among patients with conditions considered likely not to present an emergency.

Media in This Article

Table 1Base-Line Characteristics of the Copayment Group and the Control Groups.
Table 2Use of the Emergency Department and Other Services in 1992 and 1993.
Article

Using emergency departments for nonemergency care contributes to overcrowding1 and is costly.2 Such use is common in urban public hospitals,3,4 where a lack of accessible primary care often makes the emergency department a last resort. However, inappropriate use is also found in community hospitals,5,6 university teaching hospitals,7 and managed-care organizations.8,9 Guidelines are available for diverting patients with nonemergency conditions away from emergency departments,10 but such triage guidelines may lead to the misclassification of many patients.11,12

Sharing costs through the use of copayments is an alternative strategy that reduces the use of outpatient services,13-16 including emergency services,16 among people with health insurance. In the Health Insurance Experiment,17 however, cost sharing reduced appropriate office visits and preventive care as well as inappropriate visits, with adverse effects on visual acuity,18 blood-pressure control,19 and survival among high-risk patients.20 Reductions in the appropriate use of services are of particular concern in the emergency department, where even brief delays may be harmful. In the Health Insurance Experiment, cost sharing reduced the use of the emergency department more among patients with less severe diagnoses, suggesting a selectively greater effect on inappropriate visits.21 Possible adverse effects of copayment for emergency department use could not be studied in isolation, nor could the question of whether service use simply shifted to other departments be examined.

At the start of 1993, a copayment was introduced for using the emergency department that affected more than 30,000 members of the Kaiser Permanente health maintenance organization (HMO) in northern California. We studied changes in the use of the emergency department and other outpatient services and in clinical outcomes during 1993 for these members and for two comparison groups.

Methods

Setting

The Kaiser Permanente Medical Care Program, Northern California, is a group-model HMO serving about 2.4 million people, who are enrolled primarily through employer-sponsored plans. A total of 15 medical centers in the HMO provide 24-hour emergency care. Urgent (or same day) outpatient care, generally administered by the departments of adult medicine and pediatrics, is also available from 9 a.m. to 9 p.m. at each center. During these hours, registered nurses perform triage, sending patients whose conditions present less of an emergency to urgent care or to appointments for treatment at a later date. After 9 p.m., there is no such triage.

On January 1, 1993, at the request of 20 large employers, a copayment of $25 to $35 was instituted for use of the emergency department by employees of the firms and their dependents. Copayments are collected when a patient registers for treatment and are payable by cash, check, or credit card, with billing also an option. This study was not conducted as part of the copayment-implementation process but was undertaken by the Permanente Medical Group. No approval was sought from an institutional review committee, because the change would have occurred with or without the study. Affected enrollees were informed by their employers in advance of the change and had the opportunity to switch insurance plans.

Study Groups

The copayment group was selected from a group of 33,528 people who were either employees of the 20 companies or their covered family members and who were insured continuously throughout 1992. We excluded 2263 enrollees who became eligible for Medicare by December 1993; 596 people with double coverage in the HMO through a spouse whose insurance coverage did not require the copayment; and 393 children who were under one year of age on January 1, 1992 (because the first year of life is a period of high use of services that, by design, was not studied in 1993, the follow-up year). The copayment group included the remaining 30,276 members, who ranged in age from 1 to 63 years on January 1, 1992.

To control for secular changes in utilization, a control group (control group 1) containing 60,408 people was selected by 2:1 random sampling, and stratified according to age (in 10-year groups), sex, and area of residence. In preliminary analyses, base-line use of the emergency department was nearly 20 percent higher in control group 1 than in the copayment group. There were also more provision of urgent care and more visits to medical offices in this control group. Because the employers instituting the copayments were predominantly firms in the computer and electronics industries, we hypothesized that among the employees in the copayment group, relatively high socioeconomic status led to better health and less use of health services than among the membership of the HMO generally. Therefore, a second control group (control group 2) was selected from employees in other electronics and computer firms that did not institute copayments; this group contained 37,539 people matched to the members of the copayment group with respect to age, sex, and area of residence. There were not enough HMO members to permit 2:1 sampling in this group at older ages (Table 1Table 1Base-Line Characteristics of the Copayment Group and the Control Groups.).

Approximately 98 percent of the copayment group, but only 53 percent and 62 percent of control groups 1 and 2, respectively, were subject to copayments of $5 or $10 for other types of outpatient visits, including those for urgent care, during 1992 and 1993. These copayments did not change during this period for any group.

Measures of Socioeconomic Status

Proxy measures of a person's socioeconomic status were obtained by linking that person's current residential address to his or her census-block group (that is, to official subdivisions of the census tracts, each containing an average of 1000 inhabitants). The socioeconomic status of approximately 6 percent of the subjects in each group could not be determined in this way because their addresses were missing. We created three dichotomous indicators of poverty based on the 1990 data on census-block groups. A census-block group was considered to be poor if 10 percent or more of its residents had household incomes below the federal poverty level; if 25 percent or more of the residents at least 25 years old had less than a high-school education; and if 66 percent or more of employed residents more than 16 years old reported an occupation categorized as working class.21,22 Although the federal definition of an impoverished block group requires that at least 20 percent of residents have incomes below the poverty level, we chose a lower cutoff because the number of HMO members from such block groups was extremely low. Indicators of socioeconomic status derived from census-block–group data have been previously validated and used23 to study the interactions between poverty and copayments.

Emergency Department Use and Severity of Presenting Conditions

Numbers of visits were obtained from the registration data bases corresponding to four categories of care: visits to the emergency department; visits for urgent care, pediatric and adult; pediatric office visits made by appointment; and office visits for adult medicine made by appointment. We noted the time of registration in the emergency department in order to be able to tell whether triage was being performed (9 a.m. to 9 p.m.) or not being performed (9 p.m. to 9 a.m.) when the subject registered.

A diagnosis-based system for the classification of the severity of the presenting condition for emergency department visits was developed from the physicians' diagnoses at the subjects' discharge, as recorded in the registration data base. Diagnoses were available for approximately 90 percent of visits by members of the copayment group, 88 percent of visits by members of control group 1, and 86 percent of visits by members of control group 2. These proportions remained constant during the two years of the study. Samples of the diagnoses as recorded were reviewed by one of the authors before the study groups were selected. Key words were used to denote diagnostically similar entries. For example, “paroxysmal atrial tachycardia,” “PAT,” “PSVT,” “paroxysmal supraventricular tachycardia,” and variant spellings of these were grouped together. After we reviewed more than 25,000 entries, the classification system consistently assigned 85 to 87 percent of the entries in the records to 1 of 143 key words. The conditions indicated by the key words were ranked a priori in four levels of severity: those that were always an emergency, those often an emergency, those sometimes not an emergency, and those often not an emergency (see the Appendix). As the descriptions of these levels imply, this system was not intended to classify individual visits as emergency or nonemergency visits, but rather to create four categories in which there were increasingly large proportions of inappropriate visits to the emergency department. Admission to the hospital resulted from 33.4 percent of visits for conditions that were always an emergency, 4.2 percent of visits for conditions that were often an emergency, 3.4 percent of visits for conditions that were sometimes not an emergency, and 0.9 percent of visits for conditions that were often not an emergency.

Measures of Health Outcome

Hospitalizations for reasons other than childbirth were identified from the hospital discharge files and from claims submitted by non-Kaiser hospitals. From a longer list proposed by Weissman et al.24 of diagnoses associated with “avoidable hospitalization,” we selected six discharge diagnoses that are particularly likely to be prevented by timely emergency care. These were ruptured appendicitis (codes 540.0 and 540.1 of the International Classification of Diseases, 9th Revision, Clinical Modification), asthma (code 493), uncontrolled hyperglycemia in diabetes (codes 250.0 through 250.3), pneumonia (codes 480 through 487), pyelonephritis (code 590), and congestive heart failure (code 428).

Deaths occurring in the study groups during 1993 were ascertained by linking the data base to death certificates for the state of California. Because early emergency treatment may avert some deaths from myocardial infarction, we identified all infarctions listed as the underlying cause of death on the death certificates and all infarctions, fatal or nonfatal, that led to hospitalization, in order to calculate case fatality rates for 1993.

Statistical Analysis

Our initial analyses compared annual rates of emergency department use during 1992 and 1993 among the three groups in four age strata: subjects 1 to 5, 6 to 18, 19 to 44, and 45 to 63 years old. Although the data for 1992 were complete, the extent of follow-up in 1993 varied because of changes in copayment status, withdrawals from the health plan, and deaths. Rates were therefore calculated with person-years used as denominators.

Poisson regression was used to model the independent effects of study group, age, sex, and socioeconomic status (with poverty defined as present if at least 10 percent of block-group residents had household incomes below the federal poverty level) on use of the emergency department, with adjustment for the duration of follow-up. Emergency department use in each year studied decreased sharply from the age of 1 year to the age of 5 years and increased after the age of 50. Therefore, age was categorized and treated as nine indicator variables, corresponding to persons with base-line ages of 1, 2, 3, 4, 5 through 19, 20 through 29, 30 through 39, 40 through 49, and 50 through 59 years, with subjects 60 through 63 years old used as the reference group. A term was added to the model to include people for whom addresses were missing and for whom block-group data were therefore lacking.

The primary outcome — the effect of the copayment on use of the emergency department — was defined as the percent change in rates of visits in the copayment group as compared with the percent change in the two control groups, after adjustment for differences in use in 1992, age, and other covariates. Poisson regression was used to model the number of visits in 1993 as a function of study group, age, sex, socioeconomic status, the number of visits in 1992, and the ratio of the duration of follow-up in 1993 to that in 1992.25 The product of the last two of these variables may be considered to represent the number of visits that would have been expected in 1993 had there been no introduction of copayment or other changes. The log of this variable was included in the model as the offset — that is, the coefficient of the variable was constrained to be 1. Thus, the fitted models yielded estimates of the percent change in the visit rates in each control group relative to the change in the copayment group (the reference group). Ninety-five percent confidence intervals and results of significance tests (all of which were two-tailed) were adjusted for overdispersion by multiplying the standard errors of the regression coefficient by the square root of the ratio of the deviance to the degrees of freedom.26

To assess the robustness of these methods, we also used logistic regression. Conditioning the analysis on the total number of events in each subject in both years, we modeled the proportion of the total number of events that occurred in 1993 as a function of the study group, the covariates, and the proportion of the total follow-up that occurred in 1993. The results obtained in this manner were very close to those obtained with Poisson regression for the grouped data after adjustment for overdispersion.

Changes in use of the emergency department according to category of severity, in the use of other outpatient services, and in the total numbers of hospitalizations and potentially avoidable hospitalizations were examined in similar models. In an analysis restricted to the copayment group, the size of the effect of copayment was assessed according to age, sex, socioeconomic status, and copayment amount ($25 or $35).

Results

The base-line characteristics of the three study groups are shown in Table 1. Measures of socioeconomic status indicated that all three groups had relatively high status, but the copayment group scored significantly higher (P<0.001) than control group 1 (the group matched for age, sex, and area of residence but not for type of employer) on each measure. Control group 2 (the group matched for the type of employer in addition to age, sex, and area of residence) had socioeconomic-status indicators closer to those of the copayment group.

Use of the Emergency Department

At base line, the copayment group used the emergency department less than did control group 1 in every age group (Table 2Table 2Use of the Emergency Department and Other Services in 1992 and 1993.). The difference in such use between the copayment group and control group 2 was much smaller. After adjustment for age, sex, and socioeconomic status, emergency department use in 1992 was 27 percent greater in control group 1 than in the copayment group (P<0.001) and 7 percent higher in control group 2 (P = 0.04). When the three groups were considered together, residents of poor neighborhoods had 22 percent more visits to the emergency department than did residents of other neighborhoods (P<0.001). Male study subjects had 5 percent fewer visits than female study subjects (P = 0.04).

Members of the copayment group in each age group used the emergency department less in 1993 than in 1992. The reduction was greatest among children one through five years old; as expected, there were smaller but still significant decreases in use among children of these ages in both control groups. For the other three age strata, there was no appreciable change in emergency department use from 1992 to 1993 in either control group.

After adjustment for age, sex, socioeconomic status, and 1992 emergency department use, the decline in the number of visits in 1993 was 14.6 percentage points greater in the copayment group than in either control group (P<0.001 for each comparison). The number of claims received for emergency department treatment outside the HMO did not change from 1992 to 1993 in any study group.

Use of Other Outpatient Services

At base line, the use of urgent care and the number of office visits by adults were higher in control group 1 than in the copayment group in all age groups (Table 2). In control group 2, the use of urgent care was slightly less and the number of office visits somewhat more than in the copayment group. The copayment group had higher rates of pediatric office visits at base line than did either control group.

The use of these outpatient services by the copayment group was relatively unchanged in 1993 (Table 2). As expected, the rate of pediatric visits decreased markedly in all three groups, particularly among young children. Members of the copayment group continued to visit pediatricians at a slightly higher rate than did members of the control groups, but the decrease from 1992 to 1993 was greater in the copayment group. The rate of office visits by adults decreased by 4.4 percent in the copayment group, with almost no change in either control group.

We examined the effects of age, sex, socioeconomic status, and copayment amount on changes in emergency department use in the copayment group. The magnitude of the decrease in use did not differ according to sex and was not related to age, except for the steeper decline among children one through five years old. Residents of poor neighborhoods reduced their emergency department use by 22.5 percent (from 205 to 159 visits per 1000 person-years), as compared with a reduction of 14.7 percent (from 152 to 129 visits per 1000 person-years) among residents of other neighborhoods who also belonged to the copayment group (P = 0.13).

Diagnoses to which a key word could be assigned were available for 78 percent of visits in the copayment group, 75 percent of visits in control group 1, and 76 percent of visits in control group 2. These proportions remained constant between 1992 and 1993. For visits involving diagnoses categorized as “always an emergency,” the decline in emergency department use in the copayment group between 1992 and 1993 was small and did not differ significantly from the changes in the control groups (Table 3Table 3Changes in Use of the Emergency Department from 1992 to 1993, According to Severity of Diagnosis.). For visits involving diagnoses in the less severe categories, the declines were greater in the copayment group than in the control groups, and they became greater as the severity of the condition decreased. The amount of the copayment ($25 vs. $35) had no significant effect on changes in use (P = 0.75).

Approximately 57 percent of the emergency department visits in each group in 1992 occurred during the hours when triage was available (that is, they were “daytime” visits). Visits involving diagnoses categorized as “sometimes” or “often” not emergency conditions constituted a smaller proportion of daytime visits (49.0 percent) than of nighttime visits (54.5 percent), when there was no triage. The overall decrease in emergency department use in the copayment group was twice as great at night as during the day: the adjusted decreases associated with visits at night were 20.2 percent (95 percent confidence interval, 13.7 to 26.1 percent) relative to control group 1 and 19.7 percent (95 percent confidence interval, 12.4 to 26.2 percent) relative to control group 2. The relative decreases associated with daytime visits were 8.1 percent (95 percent confidence interval, 1.8 to 13.9 percent) and 10.2 percent (95 percent confidence interval, 3.3 to 16.7 percent), respectively. For visits involving conditions categorized as “often not an emergency,” the differences between day and night were greater. In the copayment group, the reductions were 36.2 percent (95 percent confidence interval, 23.5 to 46.7 percent) relative to control group 1 and 44.0 percent (95 percent confidence interval, 31.9 to 54.0 percent) relative to control group 2 at night, and 8.8 percent (95 percent confidence interval, -3.8 to 20.6 percent) and 15.6 percent (95 percent confidence interval, 1.3 to 27.8 percent), respectively, during the day.

Adverse Effects on Health

The adjusted rates of hospital admission for reasons other than childbirth increased slightly between 1992 and 1993 in each group (Table 4Table 4Rates of Hospital Admission for Reasons Other Than Childbirth, Potentially Avoidable Hospitalizations, and Overall Mortality.); the percentages of change were similar. Admissions for potentially avoidable hospitalizations decreased slightly in the copayment group and increased slightly in each control group, but these differences were not significant. The mean hospital stay after such admissions decreased slightly in the copayment group (from 5.7 to 5.2 days).

In the three study groups, a total of 272 people died in 1993. The adjusted mortality rate was lower in the copayment group than in either control group 1 (P = 0.001) or control group 2 (P = 0.06). Only 7 of the 272 deaths were attributable to conditions previously identified as associated with a potentially avoidable hospitalization. There was one death (from diabetes) in the copayment group, four deaths in control group 1, and two deaths in control group 2. The case fatality rates associated with myocardial infarction were similar: 17 percent (4 of 24) in the copayment group, 17 percent (11 of 65) in control group 1, and 12 percent (4 of 32) in control group 2.

Discussion

In this group of employees and their insured family members, the institution of a copayment of $25 to $35 for the use of the emergency department led to a 15 percent reduction in such use, with no offsetting increase in the use of other outpatient services. The fact that most members of the copayment group were already being required to pay small copayments ($5 or $10) for those services may help explain the absence of such increases.

Before the copayment for emergency department visits was introduced, approximately 25 percent of such visits involved diagnoses classified as “often not an emergency.” The copayment reduced emergency department use more for these visits than for those involving conditions of greater severity. Like another study,16 our study suggests that cost sharing selectively reduces inappropriate use of the emergency department.

Although there were more visits to the emergency department during daytime hours, a smaller proportion of these visits were classified in the two less severe categories, a fact that suggests that triage and the availability of alternative referral sites helped reduce inappropriate use. The reductions in use associated with copayments were twice as great at night, when triage was unavailable, as during the day. The day–night differential for the reduction in visits for conditions that were “often not an emergency” was even larger. These data suggest that triage and copayment may be alternative methods of controlling inappropriate use; they provide further evidence that copayments act selectively to decrease care for conditions that are not emergencies.

Our findings contrast with those of some studies of cost sharing for other outpatient services. Relatively large copayments (in the form of deductibles or coinsurance) have been shown to reduce the use of appropriate forms of care, such as preventive services,17 and to impede the use of screening mammography by Medicare recipients.27 However, small copayments ($5 per office visit) reduced the number of office visits but did not lower the use of preventive care among employed persons enrolled in an HMO.28 Patients may make better decisions about their medical care when emergencies arise than they do for chronic problems or the use of preventive services, but the amount of the copayment is also important.

Our ability to detect possible adverse effects of the copayment was limited. The number of adverse events in each group was relatively small. With regard to the outcomes examined, however, there was no suggestion of excess adverse events in the copayment group. The small increases in the overall number of hospitalizations between 1992 and 1993 in all three groups were primarily due to the exclusion of all deaths (and the related hospitalizations) that occurred in 1992, a reflection of the study design. We cannot tell whether the presence of the copayment increased suffering by causing delays in seeking care.

A greater impact of cost sharing on low-income patients has been demonstrated.17 Although poverty was rare in our study group, emergency department use was higher at base line, and the effect of the copayment was somewhat greater for persons from impoverished block groups. Overuse of emergency services in public or community hospitals by the poor is often related to a lack of alternative sources of care.3,4,29 The findings in our HMO, which has accessible urgent care and alternative forms of primary care, should not be generalized to apply to low-income groups or the elderly, particularly as regards the possibility that imposing a copayment could lead to adverse effects.

The members of the copayment group differed somewhat from those of the control groups in that they used the emergency department and other services less at base line, had slightly higher socioeconomic status, and more often had cost-sharing arrangements for other types of visits. Nevertheless, the sizable decrease in use of the emergency department in the copayment group persisted after we adjusted for base-line differences. The findings of this and previous studies support the view that the selective use of relatively small copayments can safely reduce inappropriate use of the emergency department among people who are employed and covered by health insurance.

Supported by the Permanente Medical Group.

We are indebted to Dr. Charles Quesenberry, Jr., of the Division of Research, Kaiser Permanente, for biostatistical consultation; to Rojean Madsen Willis of the Medical Economics Department, Kaiser Permanente, for consultation on policies regarding copayments in health plans; and to Dr. David Yoon of the Permanente Medical Group, for discussions of emergency department policies and practices.

Source Information

From the Division of Research, Permanente Medical Group, Kaiser Permanente Medical Care Program, 3505 Broadway, Oakland, CA 94611, where reprint requests should be addressed to Dr. Selby.

Appendix

The following 143 key words (or phrases) used to describe discharge diagnoses were ranked in four levels of severity, as described in the text. When multiple diagnoses were listed for a single visit, the key word representing the most severe condition was chosen.

Always an emergency (24 key words): cardiac arrest, ventricular tachycardia or fibrillation, respiratory failure, meningitis, coma, myocardial infarction, stroke or cerebral vascular accident, unstable angina, septicemia, appendicitis, ectopic pregnancy, admitted [to the hospital], bowel obstruction, rule out myocardial infarction, angina, congestive heart failure, poisoning or overdose, seizure, gastrointestinal bleeding, pneumonia, fracture, traumatic amputation, gunshot wound, and atrial fibrillation or flutter.

Often an emergency (39 key words): head trauma, sickle cell crisis, assault, motor vehicle accident, avulsion, hand injury, dislocation, burn, human bite, laceration or open wound, animal bite, puncture wound, nail avulsion, complications of pregnancy, abortion, threatened abortion, pelvic inflammatory disease, pancreatitis, hepatitis, cholelithiasis, urolithiasis, medical consultation, transfusion, triaged, phlebitis, croup, asthma, transient ischemic attack, peptic ulcer disease, hematuria, adverse reaction to medication, pyelonephritis, otitis media, chest pain, esophageal pain, abdominal pain, pelvic pain, urinary retention, and epididymitis.

Sometimes not an emergency (46 key words): dyspnea, other arrhythmia, chronic obstructive pulmonary disease, labyrinthitis, vertigo, abscess, diabetes, hypoglycemia, cancer, dental, Parkinson's, postoperative pain, gout, syncope, migraine, dehydration, anemia, dysfunctional uterine bleeding, gastroenteritis, vomiting, esophagitis, hernia, flu, sinusitis, bronchitis, viral syndrome, varicella, fever, urinary tract infection, insect or spider bite, allergic reaction, corneal abrasion or foreign body, skin infection, abrasion (excluding corneal abrasion), otitis externa, ingrown nail, foreign body, conjunctivitis, hemorrhoid, Bell's palsy, stress, depression, anxiety, psychosis, alcohol-related disease, and substance abuse.

Often not an emergency (34 key words): sprain of ankle, sprain of neck, musculoskeletal strain or pain, other sprain, low back pain, chest-wall pain, epistaxis, chest-wall contusion, soft-tissue injury, contusion, hypertension, arthritis, headache, nausea, dizziness, hyperventilation, vaginitis, rash, cyst, urticaria, edema, cast change, suture removal, dressing, wound check, wound infection, [visit for] injection only, subconjunctival hemorrhage, upper respiratory infection, nasopharyngitis, cough, constipation, [patient] left without being seen, [patient had] no injury.

References

References

  1. 1

    Andrulis DP, Kellermann AL, Hintz EA, Hackman BB, Weslowski VB. Emergency departments and crowding in United States teaching hospitals. Ann Emerg Med 1991;20:980-986
    CrossRef | Web of Science | Medline

  2. 2

    Baker LC, Baker LS. Excess cost of emergency department visits for nonurgent care. Health Aff (Millwood) 1994;13:162-171
    CrossRef | Web of Science | Medline

  3. 3

    Grumbach K, Keane D, Bindman A. Primary care and public emergency department overcrowding. Am J Public Health 1993;83:372-378
    CrossRef | Web of Science | Medline

  4. 4

    Baker DW, Stevens CD, Brook RH. Determinants of emergency department use by ambulatory patients at an urban public hospital. Ann Emerg Med 1995;25:311-316
    CrossRef | Web of Science | Medline

  5. 5

    Buesching DP, Jablonowski A, Vesta E, et al. Inappropriate emergency department visits. Ann Emerg Med 1985;14:672-676
    CrossRef | Web of Science | Medline

  6. 6

    Haddy RI, Schmaler ME, Epting RJ. Nonemergency emergency room use in patients with and without primary care physicians. J Fam Pract 1987;24:389-392
    Web of Science | Medline

  7. 7

    Afilalo M, Guttman A, Colacone A, et al. Emergency department use and misuse. J Emerg Med 1995;13:259-264
    CrossRef | Medline

  8. 8

    Daley WE, Leaning J, Braen GR. Prehospital emergency services and health maintenance organizations: an HMO perspective. J Emerg Med 1988;6:333-338
    CrossRef | Medline

  9. 9

    Rosen RA. The challenge of emergency, urgent and after-hours care. HMO Pract 1991;5:73-74

  10. 10

    Derlet RW, Kinser D, Ray L, Hamilton B, McKenzie J. Prospective identification and triage of nonemergency patients out of an emergency department: a 5-year study. Ann Emerg Med 1995;25:215-223
    CrossRef | Web of Science | Medline

  11. 11

    Lowe RA, Bindman AB, Ulrich SK, et al. Refusing care to emergency department of patients: evaluation of published triage guidelines. Ann Emerg Med 1994;23:286-293
    CrossRef | Web of Science | Medline

  12. 12

    Birnbaum A, Gallagher EJ, Utkewicz M, Gennis P, Carter W. Failure to validate a predictive model for refusal of care to emergency-department patients. Acad Emerg Med 1994;1:213-217
    CrossRef | Medline

  13. 13

    Newhouse JP, Manning WG, Morris CN, et al. Some interim results from a controlled trial of cost sharing in health insurance. N Engl J Med 1981;305:1501-1507
    Full Text | Web of Science | Medline

  14. 14

    Cherkin DC, Grothaus L, Wagner EH. The effect of office visit copayments on utilization in a health maintenance organization. Med Care 1989;27:1036-1045
    CrossRef | Web of Science | Medline

  15. 15

    Simon GE, VonKorff M, Durham ML. Predictors of outpatient mental health utilization by primary care patients in a health maintenance organization. Am J Psychiatry 1994;151:908-913
    Web of Science | Medline

  16. 16

    O'Grady KF, Manning WG, Newhouse JP, Brook RH. The impact of cost sharing on emergency department use. N Engl J Med 1985;313:484-490
    Full Text | Web of Science | Medline

  17. 17

    Lohr KN, Brook RH, Kamberg CJ, et al. Use of medical care in the Rand Health Insurance Experiment: diagnosis- and service-specific analyses in a randomized controlled trial. Med Care 1986;24:S1-S87
    CrossRef | Web of Science | Medline

  18. 18

    Lurie N, Kamberg CJ, Brook RH, Keeler EB, Newhouse JP. How free care improved vision in the health insurance experiment. Am J Public Health 1989;79:640-642[Erratum, J Public Health 1989;79:1677.]
    CrossRef | Web of Science | Medline

  19. 19

    Keeler EB, Brook RH, Goldberg GA, Kamberg CJ, Newhouse JP. How free care reduced hypertension in the health insurance experiment. JAMA 1985;254:1926-1931
    CrossRef | Web of Science | Medline

  20. 20

    Brook RH, Ware JE Jr, Rogers WH, et al. Does free care improve adults' health? Results from a randomized controlled trial. N Engl J Med 1983;309:1426-1434
    Full Text | Web of Science | Medline

  21. 21

    Krieger N. Overcoming the absence of socioeconomic data in medical records: validation and application of a census-based methodology. Am J Public Health 1992;82:703-710
    CrossRef | Web of Science | Medline

  22. 22

    Krieger N. Women and social class: a methodological study comparing individual, household, and census measures as predictors of black/white differences in reproductive history. J Epidemiol Community Health 1991;45:35-42
    CrossRef | Web of Science | Medline

  23. 23

    Cherkin DC, Grothaus L, Wagner EH. Is magnitude of co-payment effect related to income? Using census data for health services research. Soc Sci Med 1992;34:33-41
    CrossRef | Web of Science | Medline

  24. 24

    Weissman JS, Gatsonis C, Epstein AM. Rates of avoidable hospitalization by insurance status in Massachusetts and Maryland. JAMA 1992;268:2388-2394
    CrossRef | Web of Science | Medline

  25. 25

    Breslow NE, Day NE. Statistical methods in cancer research. Vol. 2. The design and analysis of cohort studies. Lyon, France: International Agency for Research on Cancer, 1987. (IARC scientific publications no. 82.)

  26. 26

    Nelder JA, Wedderburn RWM. Generalized linear models. J R Stat Soc [A] 1972;135:370-384
    CrossRef | Web of Science

  27. 27

    Blustein J. Medicare coverage, supplemental insurance, and the use of mammography by older women. N Engl J Med 1995;332:1138-1143
    Full Text | Web of Science | Medline

  28. 28

    Cherkin DC, Grothaus L, Wagner EH. The effect of office visit copayments on preventive care services in an HMO. Inquiry 1990;27:24-38
    Web of Science | Medline

  29. 29

    Kellermann AL. Nonurgent emergency department visits: meeting an unmet need. JAMA 1994;271:1953-1954
    CrossRef | Web of Science | Medline

Citing Articles (60)

Citing Articles

  1. 1

    Joan Benach, Gemma Tarafa, Carles Muntaner. (2012) El copago sanitario y la desigualdad: ciencia y política. Gaceta Sanitaria
    CrossRef

  2. 2

    Benjamin S. Heavrin, Rongwei Fu, Jin H. Han, Alan B. Storrow, Robert A. Lowe. (2011) An Evaluation of Statewide Emergency Department Utilization Following Tennessee Medicaid Disenrollment. Academic Emergency Medicineno-no
    CrossRef

  3. 3

    Anthony S. Kim, Stephen Sidney, Allan L. Bernstein, Vanja C. Douglas, S. Claiborne Johnston. (2011) Urgent neurology consultation from the ED for transient ischemic attack. The American Journal of Emergency Medicine 29:6, 601-608
    CrossRef

  4. 4

    Matthew L. Maciejewski, Chuan-Fen Liu, Andrew L. Kavee, Maren K. Olsen. (2011) HOW PRICE RESPONSIVE IS THE DEMAND FOR SPECIALTY CARE?. Health Economicsn/a-n/a
    CrossRef

  5. 5

    Anthony S. Kim, Stephen Sidney, Jeffrey G. Klingman, S. Claiborne Johnston. (2011) Practice variation in neuroimaging to evaluate dizziness in the ED. The American Journal of Emergency Medicine
    CrossRef

  6. 6

    Katherine Baicker, Dana Goldman. (2011) Patient Cost-Sharing and Healthcare Spending Growth. Journal of Economic Perspectives 25:2, 47-68
    CrossRef

  7. 7

    Thomas G. McGuire. 2011. Demand for Health Insurance. , 317-396.
    CrossRef

  8. 8

    Shang-Jyh Chiou, Claudia Campbell, Leann Myers, Richard Culbertson, Ronald Horswell. (2010) Factors influencing inappropriate use of ED visits among type 2 diabetics in an evidence-based management programme. Journal of Evaluation in Clinical Practice 16:6, 1048-1054
    CrossRef

  9. 9

    Robert A. Lowe, Rongwei Fu, Charles A. Gallia. (2010) Impact of Policy Changes on Emergency Department Use by Medicaid Enrollees in Oregon. Medical Care 48:7, 619-627
    CrossRef

  10. 10

    Amitabh Chandra, Jonathan Gruber, Robin McKnight. (2010) Patient Cost-Sharing and Hospitalization Offsets in the Elderly. American Economic Review 100:1, 193-213
    CrossRef

  11. 11

    Trivedi, Amal N., Moloo, Husein, Mor, Vincent, . (2010) Increased Ambulatory Care Copayments and Hospitalizations among the Elderly. New England Journal of Medicine 362:4, 320-328
    Full Text

  12. 12

    Dustin W. Ballard, Mary Price, Vicki Fung, Richard Brand, Mary E. Reed, Bruce Fireman, Joseph P. Newhouse, Joseph V. Selby, John Hsu. (2010) Validation of an Algorithm for Categorizing the Severity of Hospital Emergency Department Visits. Medical Care 48:1, 58-63
    CrossRef

  13. 13

    Kavita V. Nair, Jinhee Park, Pamela Wolfe, Joseph J. Saseen, Richard Read Allen, Rahul Ganguly. (2009) Consumer-Driven Health Plans: Impact on Utilization and Expenditures for Chronic Disease Sufferers. Journal of Occupational and Environmental Medicine 51:5, 594-603
    CrossRef

  14. 14

    Michael Chernew, Mark Fendrick. (2009) Clinically Sensitive Cost-Sharing for Prescription Drugs. Medical Care 47:5, 505-507
    CrossRef

  15. 15

    Dahlia K. Remler, Jessica Greene. (2009) Cost-Sharing: A Blunt Instrument. Annual Review of Public Health 30:1, 293-311
    CrossRef

  16. 16

    Daniel Simonet. (2009) Cost Reduction Strategies for Emergency Services: Insurance Role, Practice Changes and Patients Accountability. Health Care Analysis 17:1, 1-19
    CrossRef

  17. 17

    Robert A. Lowe, K. John McConnell, Molly E. Vogt, Jeanene A. Smith. (2008) Impact of Medicaid Cutbacks on Emergency Department Use: The Oregon Experience. Annals of Emergency Medicine 52:6, 626-634.e1
    CrossRef

  18. 18

    Dustin W. Ballard, Mary E. Reed, Huihui Wang, Laura Arroyo, Nancy Benedetti, John Hsu. (2008) Influence of Patient Costs and Requests on Emergency Physician Decisionmaking. Annals of Emergency Medicine 52:6, 643-650.e4
    CrossRef

  19. 19

    Daniel A. Handel, K. John McConnell, Neal Wallace, Charles Gallia. (2008) How Much Does Emergency Department Use Affect the Cost of Medicaid Programs?. Annals of Emergency Medicine 51:5, 614-621.e1
    CrossRef

  20. 20

    Daniel A. Vardy, Tami Freud, Michael Sherf, Ofer Spilberg, Dan Goldfarb, Arnon D. Cohen, Shlomo Mor-Yosef, Pesach Shvartzman. (2008) A Co-payment for Consultant Services: Primary Care Physicians’ Referral Actualization. Journal of Medical Systems 32:1, 37-41
    CrossRef

  21. 21

    Trivedi, Amal N., Rakowski, William, Ayanian, John Z., . (2008) Effect of Cost Sharing on Screening Mammography in Medicare Health Plans. New England Journal of Medicine 358:4, 375-383
    Full Text

  22. 22

    Akira Babazono, Kazuaki Kuwabara, Akito Hagihara, Eiji Yamamoto, Alan Hillman. (2008) Does income influence demand for medical services despite Japan's “Health Care for All” policy?. International Journal of Technology Assessment in Health Care 24:01,
    CrossRef

  23. 23

    Daniel Simonet. (2007) Managed Care in the USA: origins, HMO strategies and the marketing of health services. Journal of Public Affairs 7:4, 357-371
    CrossRef

  24. 24

    Lourdes Lostao, Enrique Regidor, Siegfried Geyer, Pierre Aïach. (2007) Patient cost sharing and social inequalities in access to health care in three western European countries. Social Science & Medicine 65:2, 367-376
    CrossRef

  25. 25

    John Hsu, Mary Price, Richard Brand, G. Thomas Ray, Bruce Fireman, Joseph P. Newhouse, Joseph V. Selby. (2006) Cost-Sharing for Emergency Care and Unfavorable Clinical Events: Findings from the Safety and Financial Ramifications of ED Copayments Study. Health Services Research 41:5, 1801-1820
    CrossRef

  26. 26

    Robert A. Lowe, A Russell Localio, Donald F. Schwarz, Sankey Williams, Lucy Wolf Tuton, Staci Maroney, David Nicklin, Neil Goldfarb, Deneen D. Vojta, Harold I. Feldman. (2005) Association Between Primary Care Practice Characteristics and Emergency Department Use in a Medicaid Managed Care Organization. Medical Care 43:8, 792-800
    CrossRef

  27. 27

    Mary Reed, Vicki Fung, Richard Brand, Bruce Fireman, Joseph P. Newhouse, Joseph V. Selby, John Hsu. (2005) Care-Seeking Behavior in Response to Emergency Department Copayments. Medical Care 43:8, 810-816
    CrossRef

  28. 28

    Sung-Hyun Cho. (2005) Older people's willingness to use home care nursing services. Journal of Advanced Nursing 51:2, 166-173
    CrossRef

  29. 29

    Daniel Simonet. (2005) Medical Practice under Managed Care: Cost-control Mechanisms and Impact on Quality of Service. Public Organization Review 5:2, 157-176
    CrossRef

  30. 30

    D. Simonet. (2005) Where does the US experience of managed care currently stand?. The International Journal of Health Planning and Management 20:2, 137-157
    CrossRef

  31. 31

    John Hsu, Mary Reed, Richard Brand, Bruce Fireman, Joseph P. Newhouse, Joseph V. Selby. (2004) Cost-Sharing. Medical Care 42:3, 290-296
    CrossRef

  32. 32

    David W. Baker, Julie A. Gazmararian, Mark V. Williams, Tracy Scott, Ruth M. Parker, Diane Green, Junling Ren, Jennifer Peel. (2004) Health Literacy and Use of Outpatient Physician Services by Medicare Managed Care Enrollees. Journal of General Internal Medicine 19:3, 215-220
    CrossRef

  33. 33

    I. Oakley-Girvan, L. N. Kolonel, R. P. Gallagher, A. H. Wu, A. Felberg, A. S. Whittemore. (2003) Stage at Diagnosis and Survival in a Multiethnic Cohort of Prostate Cancer Patients. American Journal of Public Health 93:10, 1753-1759
    CrossRef

  34. 34

    Judith M.E. Walsh, Samuel F. Posner, Eliseo J. Perez-Stable. (2002) Colon Cancer Screening in the Ambulatory Setting. Preventive Medicine 35:3, 209-218
    CrossRef

  35. 35

    Joshua H. Sarver, Rita K. Cydulka, David W. Baker. (2002) Usual Source of Care and Nonurgent Emergency Department Use. Academic Emergency Medicine 9:9, 916-923
    CrossRef

  36. 36

    Lisa S. Meredith, Nicole Humphrey, Maria Orlando, Patti Camp. (2002) Knowledge of Health Care Benefits Among Patients With Depression. Medical Care 40:4, 338-346
    CrossRef

  37. 37

    Lynne D. Richardson, Ula Hwang. (2001) Access to Care A Review of the Emergency Medicine Literature. Academic Emergency Medicine 8:11, 1030-1036
    CrossRef

  38. 38

    T Wagner. (2001) The demand for consumer health information. Journal of Health Economics 20:6, 1059-1075
    CrossRef

  39. 39

    Kevin Fiscella, Peter Franks. (2001) Impact of Patient Socioeconomic Status on Physician Profiles. Medical Care 39:1, 8-14
    CrossRef

  40. 40

    Albert Lee, Fei-Lung Lau, Clarke B Hazlett, Chak-Wah Kam, Patrick Wong, Tai-Wai Wong, Susan Chow. (2000) Factors associated with non-urgent utilization of Accident and Emergency services: a case-control study in Hong Kong. Social Science & Medicine 51:7, 1075-1085
    CrossRef

  41. 41

    R. A. Rosenblatt, G. E. Wright, L. M. Baldwin, L. Chan, P. Clitherow, F. M. Chen, L. G. Hart. (2000) The effect of the doctor-patient relationship on emergency department use among the elderly. American Journal of Public Health 90:1, 97-102
    CrossRef

  42. 42

    Craig J. Newschaffer, Daohzi Zhang, Walter W. Hauck, Thomas Fanning, Barbara J. Turner. (1999) Effect of Enhanced Prenatal and HIV-Focused Services for Pregnant Women Who Are Infected by Human Immunodeficiency Virus on Emergency Department Use. Medical Care 37:12, 1308-1319
    CrossRef

  43. 43

    Arleen F. Brown, Eliseo J. Perez-Stable, Eric E. Whitaker, Samuel F. Posner, Mark Alexander, Julia Gathe, A. Eugene Washington. (1999) Ethnic Differences in Hormone Replacement Prescribing Patterns. Journal of General Internal Medicine 14:11, 663-669
    CrossRef

  44. 44

    Tiepu Liu, Michael R. Sayre, Steven C. Carleton. (1999) Emergency Medical Care: Types, Trends, and Factors Related to Nonurgent Visits. Academic Emergency Medicine 6:11, 1147-1152
    CrossRef

  45. 45

    Harrison J. Alter, Russ Braun, James L. Zazzali. (1999) Health Status Disparities among Public and Private Emergency Department Patients. Academic Emergency Medicine 6:7, 736-743
    CrossRef

  46. 46

    K Sullivan. (1999) Managed care plan performance since 1980: another look at 2 literature reviews.. American Journal of Public Health 89:7, 1003-1008
    CrossRef

  47. 47

    Robert G. Buckley, Janet Distefan, K. Dean Gubler, Donald Slymen. (1999) The Risk of Appendiceal Rupture Based on Hospital Admission Source. Academic Emergency Medicine 6:6, 596-601
    CrossRef

  48. 48

    Edward T. Dickinson, Vincent P. Verdile, Timothy Duncan, Kerry A. Bryant. (1999) Managed care enrollee utilization of 911 medical services. Prehospital Emergency Care 3:4, 321-324
    CrossRef

  49. 49

    John R. Richards, Stephen J. Ferrall. (1999) Inappropriate Use of Emergency Medical Services Transport: Comparison of Provider and Patient Perspectives. Academic Emergency Medicine 6:1, 14-20
    CrossRef

  50. 50

    Kimberly J. Rask, Mark V. Williams, Sally E. McNagny, Ruth M. Parker, David W. Baker. (1998) Ambulatory Health Care Use by Patients in a Public Hospital Emergency Department. Journal of General Internal Medicine 13:9, 614-620
    CrossRef

  51. 51

    Laura A. Petersen, Helen R. Burstin, Anne C. O'Neil, E. John Orav, Troyen A. Brennan. (1998) Nonurgent Emergency Department Visits. Medical Care 36:8, 1249-1255
    CrossRef

  52. 52

    Leona E. Markson, Robert Houchens, Thomas R. Fanning, Barbara J. Turner. (1998) Repeated Emergency Department Use by HIV-Infected Persons: Effect of Clinic Accessibility and Expertise in HIV Care. Journal of Acquired Immune Deficiency Syndromes and Human Retrovirology 17:1, 35-41
    CrossRef

  53. 53

    (1997) Insurance Copayments and Delays in Seeking Emergency Care. New England Journal of Medicine 337:17, 1247-1248
    Full Text

  54. 54

    Gail M O'Brien, Michael D Stein, Sally Zierler, Marc Shapiro, Patricia O'Sullivan, Robert Woolard. (1997) Use of the ED as a Regular Source of Care: Associated Factors Beyond Lack of Health Insurance. Annals of Emergency Medicine 30:3, 286-291
    CrossRef

  55. 55

    Magid, David J., Koepsell, Thomas D., Every, Nathan R., Martin, Jenny S., Siscovick, David S., Wagner, Edward H., Weaver, W. Douglas, . (1997) Absence of Association between Insurance Copayments and Delays in Seeking Emergency Care among Patients with Myocardial Infarction. New England Journal of Medicine 336:24, 1722-1729
    Full Text

  56. 56

    Selby, Joe V., . (1997) Cost Sharing in the Emergency Department — Is It Safe? is It Needed?. New England Journal of Medicine 336:24, 1750-1751
    Full Text

  57. 57

    Rebecca Twersky, David Fishman, Peter Homel. (1997) What Happens After Discharge? Return Hospital Visits After Ambulatory Surgery. Anesthesia & Analgesia 84:2, 319-324
    CrossRef

  58. 58

    Selby, Joe V., Fireman, Bruce H., Lundstrom, Robert J., Swain, Bix E., Truman, Alison F., Wong, Candice C., Froelicher, Erika S., Barron, Hal V., Hlatky, Mark A., . (1996) Variation among Hospitals in Coronary-Angiography Practices and Outcomes after Myocardial Infarction in a Large Health Maintenance Organization. New England Journal of Medicine 335:25, 1888-1896
    Full Text

  59. 59

    (1996) Costs of Visits to Emergency Departments. New England Journal of Medicine 335:3, 209-211
    Full Text

  60. 60

    Steinbrook, Robert, . (1996) The Role of the Emergency Department. New England Journal of Medicine 334:10, 657-658
    Full Text

Letters