Join the 200th Anniversary Celebration

Perspective

Saying No Isn't NICE — The Travails of Britain's National Institute for Health and Clinical Excellence

Robert Steinbrook, M.D.

N Engl J Med 2008; 359:1977-1981November 6, 2008

Article

Britain's National Institute for Health and Clinical Excellence, known as NICE, is an independent, government-funded organization that advises the British National Health Service (NHS).1 Established in 1999, the institute has recommended coverage for hundreds of medicines. Since 2002, NHS organizations in England and Wales have been required to pay for medicines and treatments recommended in NICE “technology appraisals.” The NHS usually does not provide medicines or treatments that are not recommended by NICE — although exceptions are possible.

NICE (www.nice.org.uk), however, has been criticized for the slow release of its appraisals, which has delayed the availability of some treatments that it eventually views favorably.2 Some of its decisions seem unfair, and the institute has been vilified for recommendations to limit or deny coverage for some high-profile medicines for cancer and other life-threatening diseases. Its decisions are often appealed (see tableAppeals of NICE Technology Appraisals, January 2000–September 2008.), usually by manufacturers, and one decision — that coverage of donepezil and other drugs for Alzheimer's disease should be restricted to patients with at least “moderate” (rather than “mild”) disease — has been challenged in court.

NICE is often challenged for its decisions on cancer drugs that are very costly but extend life, on average, by only several months. In August 2008, oncologists, patients, and drug manufacturers attacked NICE's preliminary recommendation against coverage of four expensive drugs for advanced renal-cell cancer — bevacizumab, sorafenib, sunitinib, and temsirolimus. Although the institute considered the drugs clinically beneficial in specific situations, it concluded that they “were not cost-effective within their licensed indications.” At a NICE board meeting in Plymouth, England, in September, a 57-year-old man with metastatic renal cancer described how sunitinib had stabilized his disease for more than 2 years, during which he had continued to work full-time. Although he had some pain and limited mobility, he said, “the quality of life this drug gives me is priceless.”

In another recent appraisal, NICE recommended restrictions on coverage of drugs other than generic alendronate for the primary and secondary prevention of osteoporotic fractures in postmenopausal women. After rejecting an appeal, NICE released the final guidance in late October. After NICE issued a preliminary recommendation against the use of lapatinib plus capecitabine for previously treated HER2-positive advanced breast cancer, the maker of lapatinib offered to pay the cost of this drug for up to 12 weeks of therapy. The NHS would pay after 12 weeks. This offer is still under consideration.

For coronary artery disease, NICE recommended the use of drug-eluting coronary stents only if the price difference between drug-eluting and bare-metal stents was no more than £300 ($516, at $1.72 per £1). For patients with neovascular age-related macular degeneration, NICE recommended covering ranibizumab but not pegaptanib; during the institute's review, ranibizumab's manufacturer agreed to cover the cost of the drug for people who need more than 14 injections per eye, starting with the 15th injection.

NICE can be viewed as either a heartless rationing agency or an intrepid and impartial messenger for the need to set priorities in health care. Insofar as it is the latter, its experiences may be instructive for many countries, including the United States, regardless of the differences in their health care systems. The U.S. Centers for Medicare and Medicaid Services may eventually gain the ability to negotiate drug prices, and Congress is considering the creation of a health care comparative effectiveness research institute, as proposed in a 2008 bill (S.3408). This institute would have a more limited scope than NICE has: it would develop evidence about what does and does not work in health care and would fund research but would not consider cost or factors of health plan design. Nonetheless, such an institute could help to improve quality and slow escalating costs only if it were able to make tough calls and remain independent of political and financial interests.

In the United Kingdom, the NHS funds and delivers about 95% of medical care. And although its budget has increased substantially in recent years, it is a tax-funded system with a finite amount to spend. During a recent visit to NICE, I was told by Michael Rawlins, the physician who has chaired the institute since its inception, that it has “to be fair to all the patients in the National Health Service, not just the patients with macular degeneration or breast cancer or renal cancer. If we spend a lot of money on a few patients, we have less money to spend on everyone else. We are not trying to be unkind or cruel. We are trying to look after everybody.”

NICE has about 270 full- and part-time staff members and an annual budget of about £32 million ($55 million). It calls on about 2000 outside experts to help develop guidance. There is a comprehensive practice code regarding conflicts of interest; the directors of NICE, the chairs of its advisory bodies, and employees of the institute and its collaborating centers can have essentially no financial relationships with industry. Members of advisory bodies must declare their interests, and when a conflict is identified, they cannot take part in decisions.

In addition to technology appraisals, NICE offers public health guidance, clinical guidelines, and guidance about diagnostic and therapeutic procedures. The institute recently began to open part of the meetings of its advisory committees to the public; the committees, however, consider confidential commercial, patient, and academic data in private and deliberate in closed sessions. NICE's technology appraisals are prepared by three committees that the institute appoints but are otherwise independent. Although the NICE board may reject a committee's recommendation, it has never done so.

NICE formally appraises about 40% of new drugs and new license indications for existing medications, as well as some medical devices, diagnostic techniques, and surgical procedures. It does not license drugs, nor does it appraise unlicensed products or off-label uses; the Medicines and Healthcare Products Regulatory Agency is responsible for licensing drugs and devices and ensuring their safety and effectiveness. NICE reaches conclusions about whether treatments are clinically effective, as compared with relevant alternatives, and determines whether they are cost-effective by using economic analysis to compare their value-for-money with that of other treatments.3

NICE does not set or negotiate drug prices. However, some of the institute's initial evaluations, such as those of ranibizumab for macular degeneration and bortezomib for multiple myeloma, have led manufacturers to offer the NHS better deals, resulting in favorable recommendations. For example, if patients with multiple myeloma have a full or partial response to bortezomib, the NHS pays and treatment continues; otherwise, treatment is discontinued, and the manufacturer refunds the drug's cost.

Assessing cost-effectiveness is the most controversial aspect of NICE's work. The institute estimates an incremental cost-effectiveness ratio, or the cost per quality-adjusted life-year (QALY), gained through a treatment's use, which, despite its imperfections, is widely considered the best available method for assessing value for money in health care. This ratio provides a means for considering costs in the context of both the quantity and quality of additional life by assigning a value ranging from 0 (death) to 1 (perfect health) to the quality of life for a given period. However, the method is complex; the cost-effectiveness ratio applies to groups of patients, not individuals, and is commonly confused with the cost of the medication, which is only one of many costs that are considered — others include, for example, the cost of medical care related to the treatment. Of course, if pharmaceutical manufacturers charged less for their products, NICE would find more medications cost-effective. The analyses are also susceptible to bias, and the cost-effectiveness ratio can vary widely depending on assumptions made about clinical benefit and harmful effects or other factors. Although resource use is most inefficient when an expensive intervention provides little or no benefit, resources can also be squandered through wide use of less expensive but relatively ineffective medicines.4

In the United States, a figure of $50,000 per QALY is often used as a threshold to assess the cost-effectiveness of an intervention. This threshold was recently criticized as “an arbitrary decision rule that lacks theoretical or empirical justification and is in any case outdated.”5 Scott Grosse of the Centers for Disease Control and Prevention noted that although treatments that cost up to $200,000 per QALY are often adopted, it would “be very expensive if all interventions with a [cost-effectiveness] ratio at this level were regarded as providing good value for money.”5

In general, NICE considers treatments cost-effective if their incremental cost-effectiveness ratio is £20,000 ($34,400) or less per QALY. This ratio, however, is not a rigid cutoff. On occasion, NICE accepts values between £20,000 and £30,000 ($51,600). On rare occasions, it accepts values beyond £30,000. This approach allows the appraisal committees to consider other evidence, to recognize that all cost-effectiveness ratios have uncertainty intervals, and to exercise their judgment in making decisions.

For example, in 2002 NICE was criticized for not recommending coverage of beta interferon and glatiramer acetate for treating multiple sclerosis. Subsequently, Britain's Department of Health decided to make the drugs available in the NHS as part of a 10-year trial. If the medications turned out to be less cost-effective than £36,000 ($66,600) per QALY, the manufacturers agreed to reimburse the NHS for their cost. However, an interim report has yet to be released; it is uncertain whether the study will yield reliable information or whether the NHS will ever receive any reimbursement.2

The highest incremental cost per QALY that NICE has accepted is about £49,000 ($84,000), for imatinib mesylate, when used in the blast-cell phase of chronic myeloid leukemia. By comparison, NICE calculated that the four treatments for advanced renal cancer that it evaluated had incremental costs per QALY of £71,462 ($122,915) for sunitinib, £94,385 ($162,342) for temsirolimus, £102,498 ($176,297) for sorafenib, and £171,301 ($294,638) for bevacizumab. A final recommendation on coverage is pending.

According to Rawlins, “The big problem is why we have chosen £20,000 to £30,000 per quality-adjusted life-year. I have always been very honest about this. There is really no empirical research that tells us where the boundaries ought to be. It is really a judgment of the economic community that has provided that sort of number.”

In the months ahead, NICE has a full agenda. The institute is continuing to study its threshold ranges for QALYs and other aspects of its assessment methods. It has committed to publishing its appraisals of new drugs and other treatments as quickly as possible — ideally, within 4 months of their becoming available for general use. Fully achieving this goal will take several years and require the institute to begin its evaluations about 15 months before new medicines are approved for marketing. And as part of broader changes in the system for pricing drugs that are purchased by the NHS, the Department of Health may give NICE a formal advisory role.

NICE is also seeking permission from the House of Lords to appeal the April 2008 decision of the Court of Appeal in the Alzheimer's disease case. If the current decision stands, NICE will have to make public “fully executable versions” of its economic models, which would make it easier for manufacturers to challenge the underlying assumptions. The appellate decision could also make it difficult, if not impossible, for NICE to protect confidential information, such as unpublished research reports or the likely price of drugs not yet on the market. NICE is also facing three additional judicial reviews, one about its appraisal of osteoporosis treatments, another about a clinical guideline on chronic fatigue syndrome, and a third about the use of abatacept, which it did not recommend covering for rheumatoid arthritis.

According to Andrew Dillon, NICE's chief executive, when it appears that the institute cannot support coverage of a treatment given its current price, “we encourage companies to think about what they might do [to make their product cost-effective]. . . . We push the envelope just as much as we possibly can.” Although the United Kingdom represents only a small percentage of the overall drug market, the institute's work has focused global attention on the importance of evaluating the comparative effectiveness and the cost-effectiveness of medical treatments. It remains to be seen, however, how many other countries will follow its lead. After all, saying no takes courage — and inevitably provokes outrage.

Source Information

Dr. Steinbrook () is a national correspondent for the Journal.

References

References

  1. 1

    Rawlins MD. NICE work -- providing guidance to the British National Health Service. N Engl J Med 2004;351:1383-1385
    Full Text | Web of Science | Medline

  2. 2

    House of Commons Health Committee. First report of session 2007-8. London: Stationery Office, January 10, 2008. (Accessed October 17, 2008, at http://www.publications.parliament.uk/pa/cm200708/cmselect/cmhealth/27/27.pdf.)

  3. 3

    National Institute for Health and Clinical Excellence. Guide to the methods of technology appraisal. June 2008. (Accessed October 17, 2008, at http://www.nice.org.uk/aboutnice/howwework/devnicetech/technologyappraisalprocessguides/guidetothemethodsoftechnologyappraisal.jsp.)

  4. 4

    American College of Physicians. Information on cost-effectiveness: an essential product of a national comparative effectiveness program. Ann Intern Med 2008;148:956-961
    Web of Science | Medline

  5. 5

    Grosse SD. Assessing cost-effectiveness in healthcare: the history of the $50,000 per QALY threshold. Expert Rev Pharmacoecon Outcomes Res 2008;8:165-178
    CrossRef

Citing Articles (20)

Citing Articles

  1. 1

    2011. Can We Lower Health Care Costs by Eliminating Waste?. , 41-56.
    CrossRef

  2. 2

    DANIEL M. FOX. (2011) Systematic Reviews and Health Policy: The Influence of a Project on Perinatal Care since 1988. Milbank Quarterly 89:3, 425-449
    CrossRef

  3. 3

    P. C. Taylor. (2011) Developing anti-TNF and biologic agents. Rheumatology 50:8, 1351-1353
    CrossRef

  4. 4

    Nancy A. Dreyer. (2011) Making Observational Studies Count. Epidemiology 22:3, 295-297
    CrossRef

  5. 5

    Christopher P. Filson, Bruce G. Redman, Rodney L. Dunn, David C. Miller. (2011) Initial Patterns of Care With Oral Targeted Therapies for Patients With Renal Cell Carcinoma. Urology 77:4, 825-830.e1
    CrossRef

  6. 6

    Vicki C Tse, Wai Ng, Victor Lee, Anne WM Lee, Daniel TT Chua, June Chau, Sarah M McGhee. (2011) Cost-analysis of XELOX and FOLFOX4 for treatment of colorectal cancer to assist decision-making on reimbursement. BMC Cancer 11:1, 288
    CrossRef

  7. 7

    Kevin Dew, Maria Stubbe, Lindsay Macdonald, Anthony Dowell, Elizabeth Plumridge. (2010) The (non) use of prioritisation protocols by surgeons. Sociology of Health & Illness 32:4, 545-562
    CrossRef

  8. 8

    Robert M. Wachter. (2010) Understanding the new vocabulary of healthcare reform. Journal of Hospital Medicine 5:4, 197-199
    CrossRef

  9. 9

    Alain Li-Wan-Po, Peter Farndon, Charles Craddock, Michael Griffiths. (2010) Integrating pharmacogenetics and therapeutic drug monitoring: optimal dosing of imatinib as a case-example. European Journal of Clinical Pharmacology 66:4, 369-374
    CrossRef

  10. 10

    Victor R. Grann, Priya Patel, Anubha Bharthuar, Judith S. Jacobson, Ellen Warner, Kristin Anderson, Eiran Warner, Wei-Yann Tsai, Kimberly A. Hill, Alfred I. Neugut, Dawn Hershman. (2010) Breast cancer-related preferences among women with and without BRCA mutations. Breast Cancer Research and Treatment 119:1, 177-184
    CrossRef

  11. 11

    A. MESSORI, S. TRIPPOLI, M. INNOCENTI, M. MORFINI. (2009) Risk-sharing approach for managing factor VIIa reimbursement in haemophilia patients with inhibitors. Haemophilia
    CrossRef

  12. 12

    G. Patrick Clagett. (2009) Does vascular surgery cost too much?. Journal of Vascular Surgery 50:5, 1211-1218
    CrossRef

  13. 13

    Göran Wennergren, Bernt Alm. (2009) Challenges to 21st century paediatrics. Acta Paediatrica
    CrossRef

  14. 14

    Hirotaka Komaba, Kensuke Moriwaki, Isao Kamae, Masafumi Fukagawa. (2009) Towards Cost-effective Strategies for Treatment of Chronic Kidney Disease-Mineral and Bone Disorder in Japan. Therapeutic Apheresis and Dialysis 13, S28-S35
    CrossRef

  15. 15

    Andrea Messori, Sabrina Trippoli, Massimo Bonacchi, Guido Sani. (2009) Left ventricular assist device as destination therapy: Application of the payment-by-results approach for the device reimbursement. The Journal of Thoracic and Cardiovascular Surgery 138:2, 480-485
    CrossRef

  16. 16

    Michael L. Steinberg, Andre Konski. (2009) Proton Beam Therapy and the Convoluted Pathway to Incorporating Emerging Technology into Routine Medical Care in the United States. The Cancer Journal 15:4, 333-338
    CrossRef

  17. 17

    Dan Greenberg, Miriam I. Siebzehner, Joseph S. Pliskin. (2009) The process of updating the National List of Health Services in Israel: Is it legitimate? Is it fair?. International Journal of Technology Assessment in Health Care 25:03, 255
    CrossRef

  18. 18

    John G.T. Augoustides, Harish Ramakrishna. (2009) Recent Advances in the Management of Coronary Artery Disease: Highlights From the Literature. Journal of Cardiothoracic and Vascular Anesthesia 23:2, 259-265
    CrossRef

  19. 19

    Peter C Taylor. (2009) How do the efficacy and safety of abatacept and infliximab compare in the treatment of active RA?. Nature Clinical Practice Rheumatology 5:3, 126-127
    CrossRef

  20. 20

    Bach, Peter B., . (2009) Limits on Medicare's Ability to Control Rising Spending on Cancer Drugs. New England Journal of Medicine 360:6, 626-633
    Full Text