Join the 200th Anniversary Celebration

Perspective

Identifying and Eliminating the Roadblocks to Comparative-Effectiveness Research

Daniel F. Martin, M.D., Maureen G. Maguire, Ph.D., and Stuart L. Fine, M.D.

N Engl J Med 2010; 363:105-107July 8, 2010

Article

Patient-advocacy and health policy groups have hailed comparative-effectiveness research (CER) as a means of reducing health care costs without compromising the quality of care. The federal commitment of $1.1 billion under the American Recovery and Reinvestment Act (ARRA) ensures that the scientific community will undertake considerable amounts of such research. Yet major federal policy changes and innovative measures were required before one CER study, “Comparison of Age-Related Macular Degeneration [AMD] Treatments Trials (CATT),” could even be launched. Our experience with CATT highlights important roadblocks and dramatic changes needed in federal infrastructure for CER to be conducted efficiently.

In July 2005, clinical trial results established the efficacy of ranibizumab (Lucentis) for the treatment of neovascular (or “wet”) AMD, the leading cause of severe vision loss in the United States.1,2 While awaiting approval from the Food and Drug Administration (FDA), ophthalmologists began using intravitreal bevacizumab (Avastin), off label, to treat neovascular AMD because of its structural similarity to ranibizumab, its availability, and its low cost.3 Bevacizumab was rapidly adopted as first-line therapy because of its apparent effectiveness. The need for a head-to-head trial comparing ranibizumab and bevacizumab became obvious, and in June 2006, the National Eye Institute (NEI) approved funding for CATT. When ranibizumab was approved by the FDA on June 30, 2006, and its cost became known, the significance of the trial took on an added dimension. Some 95% of patients with neovascular AMD are Medicare beneficiaries, and at $2,000 for a monthly dose, ranibizumab would cost the Centers for Medicare and Medicaid Services (CMS) $1 billion to $3 billion per year, whereas bevacizumab, at $50 a dose, would cost the agency less than $100 million.

Who pays for drugs in a clinical trial in which there is no pharmaceutical company sponsor or partner will be a central question for most CER trials. In CATT, the NEI grant covered the $1 million cost for the purchase, repackaging, and distribution of bevacizumab. Because ranibizumab was FDA-approved and covered by Medicare, we assumed that its $25 million cost would be covered: an executive memorandum signed by President Bill Clinton in 2000 had established that Medicare must cover routine care for patients in clinical trials. Yet the CMS determined that the existing Medicare Clinical Trial Policy did not permit payment for drugs that were being compared in a clinical trial. Efforts to change this policy culminated in the Revised Medicare Clinical Trial Policy of July 2007, which explicitly extended coverage to drugs under investigation if they were normally covered outside of the trial.

But there were other roadblocks to be overcome. The estimated 15% of Medicare beneficiaries who do not have supplemental insurance are responsible for a 20% copayment for drugs. If drugs being compared in a trial cost different amounts, copayments will also differ. Such increased costs may lead patients who are assigned to receive the more expensive drug to refuse treatment as their bills accumulate or to switch to the less expensive drug, thereby eroding the integrity of the study design.

In CATT, the differential is large, with copayments as high as $5,000 per year for ranibizumab versus $100 per year for bevacizumab. With half the patients assigned to bevacizumab, charges to Medicare for CATT patients would be $25 million less than they would be if all patients were treated with ranibizumab. However, the CMS had no authority to waive the $1 million in copayments for participants who had no supplemental insurance, even though the agency stood to save $24 million. Ordinarily, National Institutes of Health (NIH) grant funds cannot be used to cover the costs of usual patient care or expenses that would be incurred outside of a study. Fortunately, the NIH Grants Policy Statement does outline exceptional circumstances and guiding principles for cases in which special reimbursement procedures can be adopted to meet a unique need. This flexibility allowed the NEI to allocate grant funds to cover the residual copayments for the study drug after the supplemental insurance companies had been billed.

Still, other roadblocks remained. In most trials, the identity of the study drugs is masked by having a centralized facility procure, package, and distribute the drugs to participating centers. When drugs are obtained commercially and billing is performed by the local centers, masking becomes more difficult. How do you bill for a drug when its identity is unknown? How do patients remain unaware of their treatment assignment when their insurance company's “explanation of benefits” identifies the drug being injected? How do you prevent supplemental insurers from identifying the drug on their statements? Who makes the initial investment to purchase the drugs? CMS staff members spent a year working with the study leaders to develop a Medicare Demonstration Project to address such billing and masking problems. In May 2007, this project was approved by the CMS, but 2 months later, with no explanation, the Office of the General Counsel of the Department of Health and Human Services refused to approve it, and it could not be executed.

The investigators elected to proceed with an alternative but cumbersome masking system that has proven robust. Ideally, CMS dollars would have been used to pay for the full cost of the drugs, thus averting all billing and copayment issues. The CMS indicated that, aside from demonstration projects, it had no authority to modify standard billing procedures and that only “an act of Congress” could authorize such flexibility. CATT leadership therefore proposed the initial language for an amendment to the Medicare Improvements for Patients and Providers Act of 2008, granting authority to the secretary of health and human services to develop alternative payment mechanisms for NIH-sponsored trials if they are needed to enhance the trials' scientific integrity. The bill was passed on July 15, 2008. Still, to our knowledge, there is no defined CMS process for initiating discussion of such alternative payment mechanisms.

The goal of providing study drugs to CATT patients at no out-of-pocket expense was achieved. The cost of ranibizumab is billed to Medicare, and 80% of it is covered under the Revised Medicare Clinical Trial Policy. The remaining cost is paid by insurance companies for patients with supplemental policies and by the NEI for those without such policies. Although the Medicare Act of 2008 came too late to benefit CATT directly, our goal was to prevent similar delays from occurring in future CER trials.

CATT enrollment began in February 2008, and our enrollment goal of 1200 patients was achieved in December 2009. The roadblocks delayed study initiation by more than a year, while another 200,000 patients and their doctors had to make decisions without important information about relative efficacy and safety. Once enrollment was initiated, it was undoubtedly slowed by a cobbled-together drug-payment system.

Despite our efforts, there is still insufficient infrastructure for the implementation of federally sponsored CER trials. Not only is there no established pathway for navigating issues of payment and masking for clinical trials involving Medicare beneficiaries, but trials focused on conditions that affect patients of all ages face the more daunting task of coordinating these logistics with hundreds of insurance plans. We believe that the Federal Coordinating Council for Comparative Effectiveness Research4 must address these issues, and the insurance industry should be called on to facilitate CER trials. A comprehensive federal policy that would cover all drug-related costs and avert the need to rely on current billing and payment mechanisms would greatly simplify the planning and execution of CER trials. Without such a policy, it is difficult to imagine that the $1.1 billion of ARRA funding for CER will be used effectively.

Disclosure forms provided by the authors are available with the full text of this article at NEJM.org.

This article (10.1056/NEJMp1001201) was published on June 2, 2010, at NEJM.org.

Source Information

From the Cole Eye Institute, Cleveland Clinic, Cleveland (D.F.M.); and the Department of Ophthalmology, University of Pennsylvania, Philadelphia (M.G.M., S.L.F.).

References

References

  1. 1

    Rosenfeld PJ, Brown DM, Heier JS, et al. Ranibizumab for neovascular age-related macular degeneration. N Engl J Med 2006;355:1419-1431
    Full Text | Web of Science | Medline

  2. 2

    Brown DM, Kaiser PK, Michels M, et al. Ranibizumab versus verteporfin for neovascular age-related macular degeneration. N Engl J Med 2006;355:1432-1444
    Full Text | Web of Science | Medline

  3. 3

    Avery RL, Pieramici DJ, Rabena MD, Castellarin AA, Nasir MA, Giust MJ. Intravitreal bevacizumab (Avastin) for neovascular age-related macular degeneration. Ophthalmology 2006;113:363-372
    CrossRef | Web of Science | Medline

  4. 4

    Federal Coordinating Council for Comparative Effectiveness Research. Report to the President and the Congress. June 30, 2009. Washington, DC: Department of Health and Human Services. (Accessed May 27, 2010, at http://www.hhs.gov/recovery/programs/cer/cerannualrpt.pdf.)

Citing Articles (11)

Citing Articles

  1. 1

    Tom Walley. (2012) Translating Comparative Effectiveness Research into Clinical Practice. Drugs 72:2, 163-170
    CrossRef

  2. 2

    2011. Can Research Guide Us to Improved Care at Lower Costs?. , 131-146.
    CrossRef

  3. 3

    Focke Ziemssen, Bianka Sobolewska. (2011) Therapeutic Efficacy of Bevacizumab for Age-Related Macular Degeneration. Drugs & Aging 28:11, 853-865
    CrossRef

  4. 4

    J. Demotes-Mainard, C. Kubiak. (2011) A European perspective - the European clinical research infrastructures network. Annals of Oncology 22:Suppl 7, vii44-vii49
    CrossRef

  5. 5

    William J. Dupps. (2011) Comparative-effectiveness research in cataract and refractive surgery: The CATT Call. Journal of Cataract & Refractive Surgery 37:9, 1569-1570
    CrossRef

  6. 6

    Rosenfeld, Philip J., . (2011) Bevacizumab versus Ranibizumab for AMD. New England Journal of Medicine 364:20, 1966-1967
    Full Text

  7. 7

    The CATT Research Group. (2011) Ranibizumab and Bevacizumab for Neovascular Age-Related Macular Degeneration. New England Journal of Medicine 364:20, 1897-1908
    Full Text

  8. 8

    John T Thompson. (2011) Increasing Costs of Imaging and Treatment of Subfoveal Choroidal Neovascularization in the Anti–Vascular Endothelial Growth Factor Era. Retina 31:5, 819-820
    CrossRef

  9. 9

    Amitabh Chandra, Anupam B Jena, Jonathan S Skinner. (2011) The Pragmatist's Guide to Comparative Effectiveness Research. Journal of Economic Perspectives 25:2, 27-46
    CrossRef

  10. 10

    Bradford W. Hesse, Robert T. Croyle, Kenneth H. Buetow. (2011) Cyberinfrastructure and the Biomedical Sciences. American Journal of Preventive Medicine 40:5, S97-S102
    CrossRef

  11. 11

    Folk, James C., Stone, Edwin M., . (2010) Ranibizumab Therapy for Neovascular Age-Related Macular Degeneration. New England Journal of Medicine 363:17, 1648-1655
    Full Text