Join the 200th Anniversary Celebration

Special Article

The Relation between Funding by the National Institutes of Health and the Burden of Disease

Cary P. Gross, M.D., Gerard F. Anderson, Ph.D., and Neil R. Powe, M.D., M.P.H., M.B.A.

N Engl J Med 1999; 340:1881-1887June 17, 1999

Abstract

Background

The Institute of Medicine has proposed that the amount of disease-specific research funding provided by the National Institutes of Health (NIH) be systematically and consistently compared with the burden of disease for society.

Methods

We performed a cross-sectional study comparing estimates of disease-specific funding in 1996 with data on six measures of the burden of disease. The measures were total mortality, years of life lost, and number of hospital days in 1994 and incidence, prevalence, and disability-adjusted life-years (one disability-adjusted life-year is defined as the loss of one year of healthy life to disease) in 1990. With the use of these measures as explanatory variables in a regression analysis, predicted funding was calculated and compared with actual funding.

Results

There was no relation between the amount of NIH funding and the incidence, prevalence, or number of hospital days attributed to each condition or disease (P=0.82, P=0.23, and P=0.21, respectively). The numbers of deaths (r=0.40, P=0.03) and years of life lost (r=0.42, P=0.02) were weakly associated with funding, whereas the number of disability-adjusted life-years was strongly predictive of funding (r=0.62, P<0.001). When the latter three measures were used to predict expected funding, the conclusions about the appropriateness of funding for some diseases varied according to the measure used. However, the acquired immunodeficiency syndrome, breast cancer, diabetes mellitus, and dementia all received relatively generous funding, regardless of which measure was used as the basis for calculating support. Research on chronic obstructive pulmonary disease, perinatal conditions, and peptic ulcer was relatively underfunded.

Conclusions

The amount of NIH funding for research on a disease is associated with the burden of the disease; however, different measures of the burden of disease may yield different conclusions about the appropriateness of disease-specific funding levels. .

Media in This Article

Figure 1Relation between NIH Disease-Specific Research Funding in 1996 and Disability-Adjusted Life-Years for 29 Conditions in 1990.
Table 1NIH Research Funds and Measures of Disease Burden for 29 Conditions.
Article

The research programs of the National Institutes of Health (NIH) have been remarkably successful over the past 50 years. NIH-funded scientists have made substantial progress in understanding the basic mechanisms of disease and have vastly improved the preventive, diagnostic, and therapeutic options available.1 However, the NIH is able to fund less than 30 percent of extramural grant applications; this fact has led scientists, patients, and other advocates of biomedical research to question how research funds are allocated to research on various diseases.2-6

The NIH working group on the setting of priorities has listed five major criteria for the allocation of research funds: public health needs, the scientific quality of research, the probability of success, the maintenance of a diverse portfolio, and the maintenance of an adequate scientific infrastructure.7 An Institute of Medicine panel recently embraced these criteria as an appropriate framework for funding.8 However, the panel also concluded that the NIH does not adequately describe how public health need is assessed, and it recommended that “in setting priorities, the NIH should strengthen its analysis and use of health data, such as burdens and costs of diseases.”8

We performed this study to determine whether the amount of funding the NIH allocates to research on particular diseases is associated with commonly available measures of the burden of disease.

Methods

Study Design

This was a cross-sectional study relating different measures of the burden of disease to the magnitude of NIH research funding. Diseases that were included in our study were those for which estimates of NIH funding, definitions from the International Classification of Diseases, 9th Revision, Clinical Modification (ICD-9-CM), and potential measures of the burden of disease were available.7,9,10

Measures of the Burden of Disease

Number of People Affected

Two of the more frequently cited measures of the burden of disease are the total number of people with a disease (prevalence) and the frequency of new cases (incidence).

Use of Resources and Cost

Several methods have been proposed for estimating the financial burden imposed by various diseases on the health care system.11-13 As a proxy for financial burden, we estimated the number of hospital days attributed to each disease as the principal diagnosis.

Mortality

The most readily available and frequently cited measure for assessing the burden of disease is total mortality.14 For each death, the underlying cause is determined on the basis of conditions reported in the death certificate with the use of an algorithm described in the ICD-9-CM.15 Because statistics on total mortality do not take age into account, another measure has been developed, called years of life lost, which is calculated by subtracting a person's age at death from his or her life expectancy in the absence of a given disease.16 We calculated years of life lost using the methods described in the Global Burden of Disease Study.17

The Global Burden of Disease Study was a five-year effort sponsored in part by the World Bank and the World Health Organization.18 The goal was to develop a comprehensive and objective set of estimates of current patterns of morbidity and mortality due to disease and injury for all regions of the world. The investigators used a systematic and exhaustive approach to estimate prevalence, incidence, and mortality and developed a new composite measure for assessing health status.9

Composite Measures

It is a widely held belief that increases in both the length and the quality of life are important.19 Therefore, measures were developed that took into account the notion that the value of a year of life spent in perfect health is greater than the value of a year spent in less than perfect health.20-22 The problem is how to ascertain the appropriate balance between the duration and the quality of life by converting time spent in various states of health to their “healthy-year equivalents.”23 Disability-adjusted life-years is the composite measure developed by the authors of the Global Burden of Disease Study; it incorporates the social values placed on various aspects of physical, mental, and social function.17,24 These social values were derived from a formal exercise involving health workers from throughout the world.25 The results of this analysis were subsequently validated by nine additional exercises with other participants that used the same protocol.25 One disability-adjusted life-year is defined as one year of healthy life that has been lost because of either disability or death.17

Sources of Data and Construction of Variables

Estimates of disease-specific research funding for all awards and contracts in fiscal year 1996 were obtained from an NIH report compiled in response to a request from the House Committee on Appropriations.26 Constructing annual budgets for the NIH is a complex process that begins approximately two years before each fiscal year.27 We wanted to examine the relation between NIH allocations and the burden of disease at the time funding decisions were made. Hence, we compared 1996 NIH funding with measures of the burden of disease in 1994, when possible.

The number of deaths attributed to each disease in 1994 was obtained from the National Center for Health Statistics.28 Data from the National Hospital Discharge Survey were used to estimate the number of hospital days attributed to each disease in 1994.29 For disability-adjusted life-years, incidence, and prevalence in 1990, we used the estimates from the Global Burden of Disease Study for what is referred to as “established market economies,” which includes western Europe, the United States, Canada, Japan, Australia, and New Zealand.25 Specific estimates of disability-adjusted life-years are not yet available for the United States.

Statistical Analysis

The dependent variable was NIH funding for research on specific medical conditions, and the independent variables were measures of the burden of disease. Correlations between funding and measures of the burden of disease were assessed with Spearman's rho test. Because the data were not normally distributed, we also performed logarithmic transformations and used the Shapiro–Wilk W statistic to confirm reasonable normality of the log-transformed data. We performed simple linear regression analyses with funding as the dependent variable and a measure of the burden of disease as the independent variable. For each measure that had a statistically significant association with funding, we used the regression-derived estimates to predict the expected NIH funding for each disease. We then compared the expected funding with the actual funding.

Results

Disease-Specific Funding

Estimates of NIH funding and measures of the burden of disease were available for 29 diseases. Funding for fiscal year 1996 and the various measures of the burden of these diseases are shown in Table 1Table 1NIH Research Funds and Measures of Disease Burden for 29 Conditions.. Total NIH research funding in 1996 was $11.9 billion, of which approximately $4.9 billion was for the diseases included in our analysis. Estimates of incidence and prevalence were not available for 4 of the 29 conditions (injuries, dental and oral disorders, sexually transmitted diseases, and perinatal conditions). Funding varied markedly, ranging from $6 million for peptic ulcer to $1.4 billion for the acquired immunodeficiency syndrome (AIDS).

Measures of the Burden of Disease

The relation between each of the measures of the burden of disease and the amount of NIH funding, as determined by simple linear regression of the log-transformed data, is shown in Table 2Table 2Association of Measures of the Burden of Disease with Amount of Research Funding by the NIH.. Neither the incidence nor the prevalence of disease was predictive of the amount of NIH funding (P=0.82 and P=0.23, respectively). The number of hospital days was also not predictive of NIH funding (P=0.21), suggesting that the consumption of resources for specific illnesses may not be a major factor in the allocation of NIH funds.

Mortality

Ischemic heart disease, stroke, and lung cancer were, respectively, the first, second, and third leading causes of death in the United States in 1994. There was a positive association between total mortality from disease and the amount of funding (r=0.40, P=0.03). Although the ranking of diseases according to mortality was somewhat different from that according to years of life lost (Table 1), the direction and magnitude of the association between each of these two variables and the amount of NIH funding were similar.

Disability-Adjusted Life-Years

The relation between NIH funding and disability-adjusted life-years was significant (r=0.62, P<0.001). The amount of predicted and actual NIH funding as a function of disability-adjusted life-years is shown in Figure 1Figure 1Relation between NIH Disease-Specific Research Funding in 1996 and Disability-Adjusted Life-Years for 29 Conditions in 1990.. The line represents the amount of funding that would be predicted if the number of disability-adjusted life-years were the sole criterion for funding.

Differences between Actual and Predicted Funding

The difference between actual and predicted funding for each disease, with mortality, disability-adjusted life-years, and years of life lost used as explanatory variables, is shown in Table 3Table 3Difference between Actual and Predicted Funding by the NIH, According to the Measure Used to Predict Funding. (negative values indicate that the disease received less funding than predicted). Research in the areas of chronic obstructive pulmonary disease, perinatal conditions, and peptic ulcer was underfunded according to all three measures. On the other hand, AIDS, breast cancer, dementia, and diabetes mellitus all received more than the predicted amount of research funding, regardless of which measure of the burden of disease was used. However, for some diseases, the conclusions about the appropriateness of funding differ depending on which measure is chosen. For example, if the number of disability-adjusted life-years is used as the sole funding criterion, then ischemic heart disease, schizophrenia, and depression received less funding than predicted. If mortality-based measures (total mortality or years of life lost) are used as funding criteria, these diseases received more funding than predicted.

Sensitivity Analysis

Because the discrepancy between actual and predicted funding was far higher for AIDS than for any other disease, we repeated the analyses after excluding AIDS. There was no significant change in the relation of actual to predicted funding with any of the measures of burden of disease (data not shown).

Discussion

Although it is arguable whether the burden of disease should assume priority in NIH funding decisions, the NIH's allocation process has been criticized as being arbitrary and insensitive to the burden of disease.2,3,8,30 However, only a few diseases have been analyzed, and often only one measure of the burden of disease has been assessed. Our analysis revealed a significant relation between NIH research funding and measures of the burden of disease. Disability-adjusted life-years, a measure that takes into account the age of those affected, the degree of disability, and the number of deaths, was most strongly associated with the amount of funding. The number of years of life lost was not substantially more predictive of funding than total mortality. This result suggests that all deaths are treated as having equal importance, regardless of the age at death.

However, the prevalence of a disease, its incidence, and the number of hospital days attributed to a disease were not associated with the amount of funding. The lack of association of prevalence and incidence with funding may be due to the fact that these measures do not take into account the severity of illness. These measures assign a higher burden to mild but widespread diseases such as otitis media than to severe but less common diseases, such as breast cancer.

Our data demonstrate how policy makers could be misled by using a single measure of the burden of disease, because the ranking of diseases according to their burden varies with the different measures used. Comparison of actual and predicted funding based on mortality, years of life lost, and disability-adjusted life-years led to similar conclusions (i.e., that actual funding was above or below predicted funding) for 21 of the 29 diseases. As a result, advocates interested in promoting research on particular diseases could select measures that best support their cause.

The burden of disease is only one of the five criteria used by the NIH to set priorities; all should be considered when research funds are allocated.7 Scientific opportunity is a particularly important factor to consider, because recent discoveries may make some areas of research more “ripe” for success. However, external pressure can also influence funding priorities. It was partially in response to such pressure that the Institute of Medicine panel recommended that the NIH explicitly compare the burden of disease and the amount of research funding.8

Policy makers are faced with two main problems when choosing among alternative measures of the burden of disease. The first is the availability and quality of the data. For many measures, there is no central repository of data, and advocacy groups can select or emphasize data derived by a variety of methods.31 The second, and far more important, problem is the social values incorporated into various measures. Some may argue that all lives are equal in importance and that total mortality should therefore be used to guide allocation decisions.16,32 Others may contend that the equitable distribution of resources requires attention to any incremental improvement in health status. For this purpose, disability-adjusted life-years may be a more appropriate measure.19,24 The relations among different measures should also be considered by policy makers, because some measures may be negatively correlated.33 For example, improved treatment of a disease could decrease mortality due to the disease but increase its prevalence by increasing the number of survivors.

Substitutes for NIH funding also need to be considered. For instance, private industry now funds nearly twice as much biomedical research as does the NIH.8,34 Research on pneumonia may receive relatively low funding from the NIH because the pharmaceutical industry is keenly interested in developing new antibiotics. Although research performed by industry may be distinct from NIH-funded research in a number of ways, it is important for policy makers to consider these substantial efforts when allocating funds. Trends in NIH-funded research should also be considered, since diseases that have been underfunded in earlier years may deserve additional funding.

Our study has several limitations. First, the serendipitous nature of science must be considered; investigations in one area frequently yield fruitful results in another. Research done by a virologist, for example, may produce information that is immediately and directly beneficial in cancer research. Hence, it may be overly simplistic to link funding to specific diseases. However, awareness of this factor does not preclude the need for rational methods to assign priorities and continue goal-directed initiatives.

Second, all measures of the burden of disease in our analysis are imperfect, since reporting errors, improper coding, and the use of proxy measures contribute to potential bias. For example, the death certificate is not always a reliable record of the cause of death. Improved diagnostic techniques may lead to increased recognition and diagnosis of some diseases. In addition, data may not accurately reflect the true burden of each disease, because many diseases contribute to the morbidity caused by other diseases.

Third, it was not possible to analyze all diseases, since we were constrained by the availability of data. However, the diseases in our study represented a substantial proportion of the total burden of disease. For instance, the sum of the mortality attributed to the 29 diseases and conditions we studied represents 63 percent of all deaths reported in 1994. Similarly, the sum of the disability-adjusted life-years for these 29 diseases represents 62 percent of the total estimate.

Fourth, our conclusions are based on estimates of disability-adjusted life-years for industrialized countries. The United States has a higher incidence of AIDS than most other countries in this group. However, even when we tripled the estimated number of disability-adjusted life-years attributed to AIDS, our results did not change substantially.

Finally, some funds may be assigned to more than one disease. For instance, a grant to investigate heart disease in patients with diabetes would be included in both categories.7 There may be disagreement about how some research expenditures are assigned to particular diseases.

Despite past criticisms, the allocation of research funds to specific diseases by the NIH is not arbitrary in relation to the burden of disease. The number of disability-adjusted life-years is strongly associated with funding levels. However, conclusions about the degree of matching between NIH funding and the burden of disease are extremely sensitive to the measure used, and assessments of the appropriateness of funding levels should be interpreted with great caution.

Supported by the Robert Wood Johnson Clinical Scholars Program.

We are indebted to Dr. Anna Reisman for her thoughtful comments.

Source Information

From the Robert Wood Johnson Clinical Scholars Program, Johns Hopkins University School of Medicine, Baltimore (C.P.G., G.F.A., N.R.P.); and the Department of Health Policy and Management (G.F.A., N.R.P.), the Welch Center for Prevention, Epidemiology, and Clinical Research (N.R.P.), and the Department of Epidemiology (N.R.P.), Johns Hopkins University School of Hygiene and Public Health, Baltimore.

Address reprint requests to Dr. Gross at the Primary Care Center, Yale University School of Medicine, 333 Cedar St., P.O. Box 208025, New Haven, CT 06520-8025, or at .

References

References

  1. 1

    Congressional justification. Bethesda, Md.: National Institutes of Health, 1996.

  2. 2

    Istook E. Research funding on major diseases is not proportionate to taxpayers' needs. J NIH Res 1997;9:26-28

  3. 3

    Anderson C. NIH budget: a new kind of earmarking. Science 1993;260:483-483
    CrossRef | Web of Science | Medline

  4. 4

    Marshall E. Lobbyists seek to reslice NIH's pie. Science 1997;276:344-346
    CrossRef | Web of Science | Medline

  5. 5

    NIH extramural data and trends facts and figures: NIH key facts and funding booklet. Bethesda, Md.: Office of Financial Management, 1996.

  6. 6

    NIH extramural trends: fiscal years 1985-1994. Bethesda, Md.: National Institutes of Health, 1995. (See http://www.nih.gov/grants/award/trends94/tintro94.htm.) (See NAPS document no. 05520 for 2 pages,c/o Microfiche Publications, 248 Hempstead Tpke., West Hempstead,NY 11552.)

  7. 7

    Working Group on Priority Setting. Setting research priorities at the National Institutes of Health. Bethesda, Md.: National Institutes of Health, 1997.

  8. 8

    Committee on NIH Research Priority-Setting Process. Scientific opportunities and public needs: improving priority setting and public input at the National Institutes of Health. Washington, D.C.: National Academy Press, 1998.

  9. 9

    Department of Health and Human Services. International classification of diseases. 3rd ed. 9th rev., clinical modification. Washington, D.C.: Government Printing Office, 1989. (DHHS publication no. (PHS) 89-1260.)

  10. 10

    Murray C, Lopez A. Global health statistics: a compendium of incidence, prevalence and mortality estimates for over 200 conditions. Vol. 2 of Global burden of disease and injury series. Cambridge, Mass.: Harvard University Press, 1996:20-2.

  11. 11

    Davidoff AJ, Powe NR. The role of perspective in defining economic measures for the evaluation of medical technology. Int J Technol Assess Health Care 1996;12:9-21
    CrossRef | Web of Science | Medline

  12. 12

    Koopmanschap MA, Rutten FF. The impact of indirect costs on outcomes of health care programs. Health Econ 1994;3:385-393
    CrossRef | Web of Science | Medline

  13. 13

    Glied S. Estimating the indirect cost of illness: an assessment of the forgone earnings approach. Am J Public Health 1996;86:1723-1728
    CrossRef | Web of Science | Medline

  14. 14

    Kindig DA. Purchasing population health: paying for results. Ann Arbor: University of Michigan Press, 1997:47-74.

  15. 15

    National Center for Health Statistics. Vital statistics of the United States, 1989. Vol. 2. Mortality. Part A. Section 7. Technical appendix. Washington, D.C.: Government Printing Office, 1993:1-24. (DHHS publication no. (PHS) 93-1101.)

  16. 16

    Haenszel W. Standardized rate for mortality defined in units of lost years of life. Am J Public Health 1950;40:17-26
    CrossRef | Web of Science

  17. 17

    Murray C. Quantifying the burden of disease: the technical basis for disability-adjusted life years. Bull World Health Organ 1994;72:429-445
    Web of Science | Medline

  18. 18

    Murray CJ, Lopez AD. Mortality by cause for eight regions of the world: Global Burden of Disease Study. Lancet 1997;349:1269-1276
    CrossRef | Web of Science | Medline

  19. 19

    Williams A. QALYs and ethics: a health economist's perspective. Soc Sci Med 1996;43:1795-1804
    CrossRef | Web of Science | Medline

  20. 20

    Weinstein MC, Stason WB. Foundations of cost-effectiveness analysis for health and medical practices. N Engl J Med 1977;296:716-721
    Full Text | Web of Science | Medline

  21. 21

    Loomes G, McKenzie L. The use of QALYs in health care decision making. Soc Sci Med 1989;28:299-308
    CrossRef | Web of Science | Medline

  22. 22

    Gold MR, Siegel J, Russell L, Weinstein M. Cost-effectiveness in health and medicine. New York: Oxford University Press, 1996:425.

  23. 23

    Rosser R, Kind P. A scale of valuations of states of illness: is there a social consensus? Int J Epidemiol 1978;7:347-358
    CrossRef | Web of Science | Medline

  24. 24

    Morrow RH, Bryant JH. Health policy approaches to measuring and valuing human life: conceptual and ethical issues. Am J Public Health 1995;85:1356-1360
    CrossRef | Web of Science | Medline

  25. 25

    Murray CJ, Lopez AD. Summary: the global burden of disease. Cambridge, Mass.: Harvard University Press, 1997:43.

  26. 26

    Office of the Director. Disease-specific estimates of direct and indirect cost of illness and NIH support: Bethesda, Md.: National Institutes of Health, 1997.

  27. 27

    Ahrens EH. The crisis in clinical research: overcoming institutional obstacles. New York: Oxford University Press, 1992:236.

  28. 28

    Work table 1: death from each cause by 5-year age groups, race and sex: United States, 1994. Hyattsville, Md.: National Center for Health Statistics, 1996. (See http://www.cdc.gov/nchswww/data/gmwk1_94.pdf.) (See NAPS document no. 05520 for 2 pages, c/o Microfiche Publications, 248 Hempstead Tpke., West Hempstead, NY 11552.)

  29. 29

    Graves EJ, Gillum BS. Detailed diagnoses and procedures, National Hospital Discharge Survey, 1994. Vital and health statistics. Series 13. No. 127. Washington, D.C.: Government Printing Office, 1997. (DHHS publication no. (PHS) 97-1788.)

  30. 30

    Hatziandreu E, Graham JD, Stoto MA. AIDS and biomedical research funding: comparative analysis. Rev Infect Dis 1988;10:159-167
    CrossRef | Medline

  31. 31

    Murray CJ, Lopez AD, Jamison DT. The global burden of disease in 1990: summary results, sensitivity analysis and future directions. Bull World Health Organ 1994;72:495-509
    Web of Science | Medline

  32. 32

    Romeder JM, McWhinnie JR. Potential years of life lost between ages 1 and 70: an indicator of premature mortality for health planning. Int J Epidemiol 1977;6:143-151
    CrossRef | Web of Science | Medline

  33. 33

    Extramural Committee to Assess Measures of Progress Against Cancer. Measurement of progress against cancer. J Natl Cancer Inst 1990;82:825-835
    CrossRef | Web of Science | Medline

  34. 34

    Office of Financial Management. NIH key facts and history of funding. Bethesda, Md.: National Institutes of Health, 1996.

Citing Articles (91)

Citing Articles

  1. 1

    Orsolina I. Martino, Derek J. Ward, Claire Packer, Sue Simpson, Andrew Stevens. (2012) Innovation and the Burden of Disease: Retrospective Observational Study of New and Emerging Health Technologies Reported by the EuroScan Network from 2000 to 2009. Value in Health
    CrossRef

  2. 2

    F. Pelone, M. L. Specchia, M. A. Veneziano, S. Capizzi, S. Bucci, A. Mancuso, W. Ricciardi, A. G. de Belvis. (2012) Economic impact of childhood obesity on health systems: a systematic review. Obesity Reviewsno-no
    CrossRef

  3. 3

    Michele Petrinco, Daniela Di Cuonzo, Paola Berchialla, Marco Gilardetti, Francesca Foltran, Cecilia Scarinzi, Giuseppe Costa, Dario Gregori. (2011) Economic burden of injuries in children: Cohort study based on administrative data in a northwestern Italian region. Pediatrics Internationalno-no
    CrossRef

  4. 4

    Ricard Gènova-Maleras, Elena Álvarez-Martín, Ferrán Catalá-López, Nerea Fernández de Larrea-Baz, Consuelo Morant-Ginestar. (2011) Aproximación a la carga de enfermedad de las personas mayores en España. Gaceta Sanitaria
    CrossRef

  5. 5

    H. Frohnhofen, B. Nickel, B. Talbi, H.C. Heuer, P. Wilschrei, C. Falkenhahn. (2011) Altersgebrechlichkeit und Schlafapnoe. Somnologie - Schlafforschung und Schlafmedizin 15:3, 141-147
    CrossRef

  6. 6

    James Nello Martin. (2011) Take the High Road and Choose to Dance. Obstetrics & Gynecology 117:6, 1268-1271
    CrossRef

  7. 7

    Djøra I. Soeteman, Jan J.V. Busschbach, Roel Verheul, Ties Hoomans, Jane J. Kim. (2011) Cost-Effective Psychotherapy for Personality Disorders in The Netherlands: The Value of Further Research and Active Implementation. Value in Health 14:2, 229-239
    CrossRef

  8. 8

    Ferrán Catalá-López, Anna García-Altés, Elena Álvarez-Martín, Ricard Gènova-Maleras, Consuelo Morant-Ginestar, Antoni Parada. (2011) Burden of disease and economic evaluation of healthcare interventions: are we investigating what really matters?. BMC Health Services Research 11:1, 75
    CrossRef

  9. 9

    Hebe N Gouda, John W Powles. (2011) Why my disease is important: metrics of disease occurrence used in the introductory sections of papers in three leading general medical journals in 1993 and 2003. Population Health Metrics 9:1, 14
    CrossRef

  10. 10

    Essam Abdel-Sattar, Louis Maes, Maha Mahmoud Salama. (2010) In Vitro activities of plant extracts from Saudi Arabia against malaria, leishmaniasis, sleeping sickness and Chagas disease. Phytotherapy Research 24:9, 1322-1328
    CrossRef

  11. 11

    Jessica B. Rubin, A. David Paltiel, W. Mark Saltzman. (2010) Are We Studying What Matters? Health Priorities and NIH-Funded Biomedical Engineering Research. Annals of Biomedical Engineering 38:7, 2237-2251
    CrossRef

  12. 12

    Ed Wilson, Keith Abrams. 2010. From Evidence-Based Economics to Economics-Based Evidence: Using Systematic Review to Inform the Design of Future Research. , 146-161.
    CrossRef

  13. 13

    Evelyn P. Whitlock, Sarah A. Lopez, Stephanie Chang, Mark Helfand, Michelle Eder, Nicole Floyd. (2010) AHRQ Series Paper 3: Identifying, selecting, and refining topics for comparative effectiveness systematic reviews: AHRQ and the Effective Health-Care program. Journal of Clinical Epidemiology 63:5, 491-501
    CrossRef

  14. 14

    Silvina Berra, Emília Sánchez, Joan M. V. Pons, Cristian Tebé, Jordi Alonso, Marta Aymerich. (2010) Setting priorities in clinical and health services research: Properties of an adapted and updated method. International Journal of Technology Assessment in Health Care 26:02, 217
    CrossRef

  15. 15

    Bruce H. Jones, Michelle Canham-Chervak, David A. Sleet. (2010) An Evidence-Based Public Health Approach to Injury Priorities and Prevention. American Journal of Preventive Medicine 38:1, S1-S10
    CrossRef

  16. 16

    Iain Chalmers, Paul Glasziou. (2009) Avoidable Waste in the Production and Reporting of Research Evidence. Obstetrics & Gynecology 114:6, 1341-1345
    CrossRef

  17. 17

    Iain Chalmers, Paul Glasziou. (2009) Avoidable waste in the production and reporting of research evidence. The Lancet 374:9683, 86-89
    CrossRef

  18. 18

    Essam Abdel-Sattar, Fathalla M. Harraz, Soliman M. A. Al-Ansari, Sahar El-Mekkawy, Chikara Ichino, Hiroaki Kiyohara, Kazuhiko Otoguro, Satoshi Omura, Haruki Yamada. (2009) Antiplasmodial and antitrypanosomal activity of plants from the Kingdom of Saudi Arabia. Journal of Natural Medicines 63:2, 232-239
    CrossRef

  19. 19

    Marshall D. Lindheimer, Sandra J. Taler, F. Gary Cunningham. (2009) ASH Position Paper: Hypertension in Pregnancy. The Journal of Clinical Hypertension 11:4, 214-225
    CrossRef

  20. 20

    Matthew T. Mckenna, Armineh Zohrabian. (2009) U.S. Burden of Disease–Past, Present and Future. Annals of Epidemiology 19:3, 212-219
    CrossRef

  21. 21

    Lars M. Ellison, Carl A. Olsson. (2009) The Sad and Bleak Future for Urology Funding at the National Institutes of Health. Urologic Clinics of North America 36:1, 85-93
    CrossRef

  22. 22

    Ad A. Kaptein, Margreet Scharloo, Maarten J. Fischer, Lucia Snoei, Brian M. Hughes, John Weinman, Robert M. Kaplan, Klaus F. Rabe. (2009) 50 Years of psychological research on patients with COPD – Road to ruin or highway to heaven?. Respiratory Medicine 103:1, 3-11
    CrossRef

  23. 23

    Marshall D. Lindheimer, Sandra J. Taler, F. Gary Cunningham. (2008) Hypertension in pregnancy. Journal of the American Society of Hypertension 2:6, 484-494
    CrossRef

  24. 24

    DANIEL P. GITTERMAN, WILLIAM W. HAY. (2008) That Sinking Feeling, Again? The State of National Institutes of Health Pediatric Research Funding, Fiscal Year 1992–2010. Pediatric Research 64:5, 462-469
    CrossRef

  25. 25

    Essam Abdel-Sattar, Fathalla M. Harraz, Soliman Mohammed Abdullah Al-ansari, Sahar El-Mekkawy, Chikara Ichino, Hiroaki Kiyohara, Aki Ishiyama, Kazuhiko Otoguro, Satoshi Omura, Haruki Yamada. (2008) Acylated pregnane glycosides from Caralluma tuberculata and their antiparasitic activity. Phytochemistry 69:11, 2180-2186
    CrossRef

  26. 26

    S.-G. KIM, M.-I. HAHM, K.-S. CHOI, N.-Y. SEUNG, H.-R. SHIN, E.-C. PARK. (2008) The economic burden of cancer in Korea in 2002. European Journal of Cancer Care 17:2, 136-144
    CrossRef

  27. 27

    Ad A. Kaptein, Rik C.J. van Klink, Frédérique de Kok, Margreet Scharloo, Lucia Snoei, Elizabeth Broadbent, Elisabeth H.D. Bel, Klaus F. Rabe. (2008) Sexuality in patients with asthma and COPD. Respiratory Medicine 102:2, 198-204
    CrossRef

  28. 28

    Andrew J. Baker, Eugene Park, Greg M. T. Hare, Elaine Liu, Nancy Sikich, David C. Mazer. (2008) Effects of Resuscitation Fluid on Neurologic Physiology After Cerebral Trauma and Hemorrhage. The Journal of Trauma: Injury, Infection, and Critical Care 64:2, 348-357
    CrossRef

  29. 29

    P.S. Tawadros, K.A. Powers, I. Yang, D.A. Becker, M.D. Ginsberg, K. Szaszi, A. Kapus, O.D. Rotstein. (2007) Stilbazulenyl Nitrone Decreases Oxidative Stress and Reduces Lung Injury After Hemorrhagic Shock/Resuscitation and LPS. Antioxidants & Redox Signaling 9:11, 1971-1978
    CrossRef

  30. 30

    R. Lohmann, U. Frerichmann, U. Stöckle, T. Riegel, M.J. Raschke. (2007) Proximale Femurfrakturen im Alter. Der Unfallchirurg 110:7, 603-609
    CrossRef

  31. 31

    U. Frerichmann, M.J. Raschke, U. Stöckle, S. Wöhrmann, R. Lohmann. (2007) Proximale Femurfrakturen im Alter. Der Unfallchirurg 110:7, 610-616
    CrossRef

  32. 32

    R. Lohmann, K. Haid, U. Stöckle, M. Raschke. (2007) Epidemiologie und Perspektiven der Alterstraumatologie. Der Unfallchirurg 110:6, 553-562
    CrossRef

  33. 33

    Sarah T. Pendlebury. (2007) Worldwide under-funding of stroke research. International Journal of Stroke 2:2, 80-84
    CrossRef

  34. 34

    Don D. Sin, S.F. Paul Man. (2007) Systemic inflammation and mortality in chronic obstructive pulmonary diseaseThis paper is one of a selection of papers published in this Special Issue, entitled Young Investigators' Forum.. Canadian Journal of Physiology and Pharmacology 85:1, 141-147
    CrossRef

  35. 35

    Thomas D Brown, Richard C Johnston, Charles L Saltzman, J Lawrence Marsh, Joseph A Buckwalter. (2006) Posttraumatic Osteoarthritis: A First Estimate of Incidence, Prevalence, and Burden of Disease. Journal of Orthopaedic Trauma 20:10, 739-744
    CrossRef

  36. 36

    William H. Theodore, Susan S. Spencer, Samuel Wiebe, John T. Langfitt, Amza Ali, Patricia O. Shafer, Anne T. Berg, Barbara G. Vickrey. (2006) Epilepsy in North America: A Report Prepared under the Auspices of the Global Campaign against Epilepsy, the International Bureau for Epilepsy, the International League Against Epilepsy, and the World Health Organization. Epilepsia 47:10, 1700-1722
    CrossRef

  37. 37

    Zachary B. Mackey, Arthur M. Baca, Jeremy P. Mallari, Beth Apsel, Anang Shelat, Elizabeth J. Hansell, Peter K. Chiang, Brian Wolff, Kiplin R. Guy, Janice Williams, James H. McKerrow. (2006) Discovery of Trypanocidal Compounds by Whole Cell HTS of Trypanosoma brucei. Chemical Biology <html_ent glyph="@amp;" ascii="&"/> Drug Design 67:5, 355-363
    CrossRef

  38. 38

    Brian Celso, Joseph Tepas, Barbara Langland-Orban, Etienne Pracht, Linda Papa, Lawrence Lottenberg, Lewis Flint. (2006) A Systematic Review and Meta-Analysis Comparing Outcome of Severely Injured Patients Treated in Trauma Centers Following the Establishment of Trauma Systems. The Journal of Trauma: Injury, Infection, and Critical Care 60:2, 371-378
    CrossRef

  39. 39

    Shalini Thuppal, Jennifer M. Propp, Bridget J. McCarthy. (2006) Average Years of Potential Life Lost in Those Who Have Died from Brain and CNS Tumors in the USA. Neuroepidemiology 27:1, 22-27
    CrossRef

  40. 40

    Karl P Claxton, Mark J Sculpher. (2006) Using Value of Information Analysis to Prioritise Health Research. PharmacoEconomics 24:11, 1055-1068
    CrossRef

  41. 41

    Uriel Heresco-Levy. (2005) Glutamatergic neurotransmission modulators as emerging new drugs for schizophrenia. Expert Opinion on Emerging Drugs 10:4, 827-844
    CrossRef

  42. 42

    I. G. Levy. (2005) Neuroblastoma, Well-Designed Evaluations, and the Optimality of Research Funding: Ask Not What Your Country Can Do for You .... JNCI Journal of the National Cancer Institute 97:15, 1105-1106
    CrossRef

  43. 43

    Joanna E. Siegel, Sepheen C. Byron, William F. Lawrence. (2005) Federal Sponsorship of Cost-Effectiveness and Related Research in Health Care: 1997–2001. Value in Health 8:3, 223-236
    CrossRef

  44. 44

    Laura Ginnelly, Karl Claxton, Mark J Sculpher, Sue Golder. (2005) Using Value of Information Analysis to Inform Publicly Funded Research Priorities. Applied Health Economics and Health Policy 4:1, 37-46
    CrossRef

  45. 45

    Ralph P Insinga, Erik J Dasbach, Elamin H Elbasha. (2005) Assessing the Annual Economic Burden of Preventing and Treating Anogenital Human Papillomavirus-Related Disease in the US. PharmacoEconomics 23:11, 1107-1122
    CrossRef

  46. 46

    Dwijen Rangnekar. (2005) Acknowledged: analysing the bibliometric presence of the Multiple Sclerosis Society. Aslib Proceedings 57:3, 247-260
    CrossRef

  47. 47

    Sanjay Sethi, Thomas M. File. (2004) Managing patients with recurrent acute exacerbations of chronic bronchitis: a common clinical problem. Current Medical Research and Opinion 20:10, 1511-1521
    CrossRef

  48. 48

    Ralph P Insinga, Andrew G Glass, Brenda B Rush. (2004) The health care costs of cervical human papillomavirus–related disease. American Journal of Obstetrics and Gynecology 191:1, 114-120
    CrossRef

  49. 49

    Ruth Bonita, Shanthi Mendis, Thomas Truelsen, Julien Bogousslavsky, James Toole, Frank Yatsu. (2004) The Global Stroke Initiative. The Lancet Neurology 3:7, 391-393
    CrossRef

  50. 50

    Ralph P Insinga, Andrew G Glass, Brenda B Rush. (2004) Diagnoses and outcomes in cervical cancer screening: A population-based study. American Journal of Obstetrics and Gynecology 191:1, 105-113
    CrossRef

  51. 51

    J. Alonso, M.C. Angermeyer, J.P. Lepine. (2004) The European Study of the Epidemiology of Mental Disorders (ESEMeD) project: an epidemiological basis for informing mental health policies in Europe. Acta Psychiatrica Scandinavica 109:s420, 5-7
    CrossRef

  52. 52

    Mary-Margaret Chren, Martin A. Weinstock. (2004) In That Issue: The Burden of Skin Disease. Journal of Investigative Dermatology 122:3, viii-viii
    CrossRef

  53. 53

    Mary-Margaret Chren, Martin A. Weinstock. (2004) Conceptual Issues in Measuring the Burden of Skin Diseases. Journal of Investigative Dermatology Symposium Proceedings 9:2, 97-100
    CrossRef

  54. 54

    David H. Howard, Noelle-Angelique Molinari, Kenneth E. Thorpe. (2004) National estimates of medical costs incurred by nonelderly cancer patients. Cancer 100:5, 883-891
    CrossRef

  55. 55

    S. Aoun, D. Pennebaker, R. Pascal. (2004) To what extent is health and medical research funding associated with the burden of disease in Australia?. Australian and New Zealand Journal of Public Health 28:1, 80-86
    CrossRef

  56. 56

    Jodi B. Segal, Neil R. Powe. (2004) Accuracy of identification of patients with immune thrombocytopenic purpura through administrative records: A data validation study. American Journal of Hematology 75:1, 12-17
    CrossRef

  57. 57

    JONATHAN LOMAS, NAOMI FULOP, DIANE GAGNON, PAULINE ALLEN. (2003) On Being a Good Listener: Setting Priorities for Applied Health Services Research. Milbank Quarterly 81:3, 363-388
    CrossRef

  58. 58

    Kinga A. Powers, Andras Kapus, Rachel G. Khadaroo, Ruijuan He, John C. Marshall, Thomas F. Lindsay, Ori D. Rotstein. (2003) Twenty-five percent albumin prevents lung injury following shock/resuscitation. Critical Care Medicine 31:9, 2355-2363
    CrossRef

  59. 59

    Kathleen M. Boozang. (2003) National Policy on CAM: The White House Commission Report. The Journal of Law, Medicine & Ethics 31:2, 251-261
    CrossRef

  60. 60

    Edward C. Mansley, Elamin H. Elbasha. (2003) Preferences and person trade-offs: forcing consistency or inconsistency in health-related quality of life measures?. Health Economics 12:3, 187-198
    CrossRef

  61. 61

    M.T. Halpern, A. Musin, S. Sondhi. (2003) Economic analysis of the confronting COPD survey: methodology. Respiratory Medicine 97, S15-S22
    CrossRef

  62. 62

    Timothy H Rainer, Pieter de Villiers Smit. (2003) Trauma systems and emergency medicine. Emergency Medicine Australasia 15:1, 11-17
    CrossRef

  63. 63

    Abebaw M. Yohannes, Christopher C. Hardy. (2003) Treatment of Chronic Obstructive Pulmonary Disease in Older Patients. Drugs & Aging 20:3, 209-228
    CrossRef

  64. 64

    Majid Ezzati, Alan D Lopez, Anthony Rodgers, Stephen Vander Hoorn, Christopher JL Murray. (2002) Selected major risk factors and global and regional burden of disease. The Lancet 360:9343, 1347-1360
    CrossRef

  65. 65

    Jan H.F. Remme, Erik Blas, Lester Chitsulo, Philippe M.P. Desjeux, Howard D. Engers, Thomas P. Kanyok, Jane F.Kengeya Kayondo, Deborah W. Kioy, Vasanthapuram Kumaraswami, Janis K. Lazdins, Paul P. Nunn, Ayoade Oduola, Robert G. Ridley, Yeya T. Toure, Fabio Zicker, Carlos M. Morel. (2002) Strategic emphases for tropical diseases research: a TDR perspective. Trends in Microbiology 10:10, 435-440
    CrossRef

  66. 66

    Richard D. Blondell, Stephen W. Looney, Lance M. Hottman, Phillip W. Boaz. (2002) Characteristics of Intoxicated Trauma Patients. Journal of Addictive Diseases 21:4, 1-12
    CrossRef

  67. 67

    Shawn J. Rangel, Bradley Efron, R. Lawrence Moss. (2002) Recent Trends in National Institutes of Health Funding of Surgical Research. Annals of Surgery 236:3, 277-287
    CrossRef

  68. 68

    Alicia L. Wolfert, Steven Kolpak. (2002) Hyperlipidemia. Primary Care Case Reviews 5:3, 115-124
    CrossRef

  69. 69

    P. Vermeire. (2002) The burden of chronic obstructive pulmonary disease. Respiratory Medicine 96, S3-S10
    CrossRef

  70. 70

    Kinga A Powers, Andras Kapus, Rachel G Khadaroo, Giuseppe Papia, Ori D Rotstein. (2002) 25% albumin modulates adhesive interactions between neutrophils and the endothelium following shock/resuscitation. Surgery 132:2, 391-398
    CrossRef

  71. 71

    Hirsch S. Ruchlin, James M. Pellissier. (2001) An economic overview of prostate carcinoma. Cancer 92:11, 2796-2810
    CrossRef

  72. 72

    Kristy Sanderson, Gavin Andrews. (2001) Mental disorders and burden of disease: how was disability estimated and is it valid?. Australian and New Zealand Journal of Psychiatry 35:5, 668-676
    CrossRef

  73. 73

    PM Rothwell. (2001) The high cost of not funding stroke research: a comparison with heart disease and cancer. The Lancet 357:9268, 1612-1616
    CrossRef

  74. 74

    Martin L Brown, Joseph Lipscomb, Claire Snyder. (2001) T HE B URDEN OF I LLNESS OF C ANCER : Economic Cost and Quality of Life 1. Annual Review of Public Health 22:1, 91-113
    CrossRef

  75. 75

    Hirsch S. Ruchlin, Erik J. Dasbach. (2001) An Economic Overview of Chronic Obstructive Pulmonary Disease. PharmacoEconomics 19:6, 623-642
    CrossRef

  76. 76

    Bernard S. Bloom, Douglas J. Bruno, Daniel Y. Maman, Ravi Jayadevappa. (2001) Usefulness of US Cost-of-Illness Studies in Healthcare Decision Making. PharmacoEconomics 19:2, 207-213
    CrossRef

  77. 77

    A.A. Kaptein. 2001. Respiratory Disorders: Psychosocial Aspects. , 13275-13279.
    CrossRef

  78. 78

    Edward J. Campbell. (2000) Animal models of emphysema: the next generations. Journal of Clinical Investigation 106:12, 1445-1446
    CrossRef

  79. 79

    Z. Wang, T. Zheng, Z. Zhu, R. J. Homer, R. J. Riese, H. A. Chapman, S. D. Shapiro, J. A. Elias. (2000) Interferon   Induction of Pulmonary Emphysema in the Adult Murine Lung. Journal of Experimental Medicine 192:11, 1587-1600
    CrossRef

  80. 80

    Louis F. Martin, Alex Robinson, Barbara J. Moore. (2000) Socioeconomic Issues Affecting the Treatment of Obesity in the New Millennium. PharmacoEconomics 18:4, 335-353
    CrossRef

  81. 81

    Basil A. Pruitt. (2000) Centennial Changes in Surgical Care and Research. Annals of Surgery 232:3, 287-301
    CrossRef

  82. 82

    Louis W Niessen, Els W.M Grijseels, Frans F.H Rutten. (2000) The evidence-based approach in health policy and health care delivery. Social Science & Medicine 51:6, 859-869
    CrossRef

  83. 83

    Deborah Tallon, Jiri Chard, Paul Dieppe. (2000) Relation between agendas of the research community and the research consumer. The Lancet 355:9220, 2037-2040
    CrossRef

  84. 84

    Roberta J. Elman, Jennifer Ogar, Sidney H. Elman. (2000) Aphasia: Awareness, advocacy, and activism. Aphasiology 14:5-6, 455-459
    CrossRef

  85. 85

    Quentin R Regestein. (2000) Psychiatrists’ views of managed care and the future of psychiatry. General Hospital Psychiatry 22:2, 97-106
    CrossRef

  86. 86

    Abhijit V. Kshirsagar, Melanie S. Joy, Susan L. Hogan, Ronald J. Falk, Romulo E. Colindres. (2000) Effect of ACE inhibitors in diabetic and nondiabetic chronic renal disease: A systematic overview of randomized placebo-controlled trials. American Journal of Kidney Diseases 35:4, 695-707
    CrossRef

  87. 87

    Lars Werkö. (2000) Who Determines the Research Agenda?. Scandinavian Cardiovascular Journal 34:2, 99-102
    CrossRef

  88. 88

    Helios Pardell, Ricard Tresserras, Pedro Armario, Raquel Hern??ndez del Rey. (2000) Pharmacoeconomic Considerations in the Management of Hypertension. Drugs 59:Supplement 2, 13-20
    CrossRef

  89. 89

    Arthur M. Feldman. (1999) Heart failure awareness. Journal of Cardiac Failure 5:4, 287-289
    CrossRef

  90. 90

    Ann Scheck McAlearney, Sharon B. Schweikhart, Dev S. Pathak. (1999) Quality-adjusted life-years and other health indices: A comparative analysis. Clinical Therapeutics 21:9, 1605-1629
    CrossRef

  91. 91

    Varmus, Harold, . (1999) Evaluating the Burden of Disease and Spending the Research Dollars of the National Institutes of Health. New England Journal of Medicine 340:24, 1914-1915
    Full Text