Learn how NEJM.org uses cookies at the Cookie Information page.

Special Article

Compliance with Results Reporting at ClinicalTrials.gov

Monique L. Anderson, M.D., Karen Chiswell, Ph.D., Eric D. Peterson, M.D., M.P.H., Asba Tasneem, Ph.D., James Topping, M.S., and Robert M. Califf, M.D.

N Engl J Med 2015; 372:1031-1039March 12, 2015DOI: 10.1056/NEJMsa1409364

Abstract

Background

The Food and Drug Administration Amendments Act (FDAAA) mandates timely reporting of results of applicable clinical trials to ClinicalTrials.gov. We characterized the proportion of applicable clinical trials with publicly available results and determined independent factors associated with the reporting of results.

Methods

Using an algorithm based on input from the National Library of Medicine, we identified trials that were likely to be subject to FDAAA provisions (highly likely applicable clinical trials, or HLACTs) from 2008 through 2013. We determined the proportion of HLACTs that reported results within the 12-month interval mandated by the FDAAA or at any time during the 5-year study period. We used regression models to examine characteristics associated with reporting at 12 months and throughout the 5-year study period.

Results

From all the trials at ClinicalTrials.gov, we identified 13,327 HLACTs that were terminated or completed from January 1, 2008, through August 31, 2012. Of these trials, 77.4% were classified as drug trials. A total of 36.9% of the trials were phase 2 studies, and 23.4% were phase 3 studies; 65.6% were funded by industry. Only 13.4% of trials reported summary results within 12 months after trial completion, whereas 38.3% reported results at any time up to September 27, 2013. Timely reporting was independently associated with factors such as FDA oversight, a later trial phase, and industry funding. A sample review suggested that 45% of industry-funded trials were not required to report results, as compared with 6% of trials funded by the National Institutes of Health (NIH) and 9% of trials that were funded by other government or academic institutions.

Conclusions

Despite ethical and legal obligations to disclose findings promptly, most HLACTs did not report results to ClinicalTrials.gov in a timely fashion during the study period. Industry-funded trials adhered to legal obligations more often than did trials funded by the NIH or other government or academic institutions. (Funded by the Clinical Trials Transformation Initiative and the NIH.)

Media in This Article

Figure 1Clinical Trials Included in the Study.
Figure 2Cumulative Percentage of Clinical Trials That Reported Results to ClinicalTrials.gov, According to the Time after the Primary Completion Date.
Article

The human experimentation that is conducted in clinical trials creates ethical obligations to make research findings publicly available. However, there are numerous historical examples of potentially harmful data being withheld from public scrutiny and selective publication of trial results.1-3 In 2000, Congress authorized the creation of the ClinicalTrials.gov registry to provide information about and access to clinical trials for persons with serious medical conditions. In 2007, Section 801 of the Food and Drug Administration Amendments Act (FDAAA) expanded this mandate by requiring sponsors of applicable clinical trials to register and report basic summary results at ClinicalTrials.gov.4 Such trials generally include all non–phase 1 interventional trials of drugs, medical devices, or biologics that were initiated after September 27, 2007, or before that date but that were still ongoing as of December 26, 2007, have at least one U.S. research site, or are conducted under an investigational-new-drug application or an investigational-device exemption.5 The FDAAA also mandates that trial results be reported by the sponsor within 1 year after the completion of data collection for the prespecified primary outcome (primary completion date) or within 1 year after the date of early termination, unless legally acceptable reasons for the delay are evident.5

Studies have shown that compliance with the FDAAA provisions is generally poor,6-12 despite a growing consensus favoring transparent, public reporting of human trials — an enterprise whose ethical justification rests on the creation of generalizable scientific knowledge.13,14 More than 5 years after the FDAAA was enacted, we sought to determine which trial characteristics have been associated with reporting, as well as the timing of that reporting.

Methods

Data Sources

Because we could not precisely identify which applicable clinical trials are subject to FDAAA provisions using publicly available data, we used an algorithm that is based on input from the National Library of Medicine (Zarin D: personal communication) to identify 32,656 highly likely applicable clinical trials (HLACTs) from among all registered trials (Table S1 in the Supplementary Appendix, available with the full text of this article at NEJM.org). We further restricted our study to HLACTs with a recruitment status of “completed” or “terminated” before August 31, 2012, to allow at least 1 year of reporting for trials with a primary completion date of September 2012. We excluded 1131 trials for which dates of trial completion could not be determined and for which the date of the last data verification was either before 2008 (1078 trials) or after September 2012 (53 trials). Our final study population included 13,327 HLACTs that had been either completed or terminated between January 1, 2008, and August 31, 2012 (Figure 1Figure 1Clinical Trials Included in the Study.). To estimate rates of false positive and false negative findings, we also conducted a manual review of random samples of HLACTs and non-HLACTs (see Tables S15A and S15B in the Supplementary Appendix for details).

To determine whether a product or indication was approved by the FDA (and if approved, the approval date), we searched Drugs@FDA, the National Drug Code Directory (for generics and supplements), the 510(k) Premarket Notification database (for devices), the Premarket Approval database (for devices), and Biologic Approvals by Year database and also conducted Web searches when necessary. Two of the authors manually reviewed uncertain cases to provide high and low estimates for false positives and false negatives.

Definitions

We specified that clinical trials had reported results if at least one primary outcome was provided. We calculated the time to reporting as the number of months from the primary completion date of the trial until the date that results were first reported to ClinicalTrials.gov. The primary completion date was defined as the date that the final trial participant was examined or received an intervention for the purpose of final data collection for the primary outcome. If the primary completion date was missing, the study completion year was used. If the study completion year was missing, the study verification date was used. We categorized a trial as having a legally acceptable period of delay to the reporting of results if a certification or extension request (as described below) was received by September 27, 2013.

A responsible party could delay the 12-month deadline for submitting results through several mechanisms, including submission of a “certification of initial use” to ClinicalTrials.gov if the medical product being studied had not been approved for market at the time of trial completion. In this case, results must be submitted 30 days after the product is approved. A “certification of new use” may be submitted if a sponsor intends to seek FDA approval, clearance, or licensure of a new use of an approved medical product. In this case, reporting may be delayed for up to 2 years or for 30 days after the FDA determines approval status or issues a complete response letter or the application is withdrawn.6 Extensions can be requested to delay the reporting of results for good cause. Data on trials that submit certification or extension requests to ClinicalTrials.gov were provided by the National Library of Medicine (Tse T: personal communication).

Trial characteristics included the type of intervention, study phase, funding source, oversight authorities, enrollment characteristics, site locations, purpose, and study-design descriptors.15-17 (Details are provided in the Supplementary Appendix.)

Statistical Analysis

We summarized trial characteristics overall and by the presence or absence of basic reporting of results. We also summarized the existence of a certification or extension request for a delay in results reporting. Categorical variables are reported as frequencies and percentages, and continuous variables as medians and interquartile ranges. Unless otherwise noted, missing values were excluded from the analyses.

We used the Kaplan–Meier method to estimate the cumulative percentage of trials that reported results at monthly intervals from the primary completion date, with data censored on September 27, 2013. Estimates were stratified according to funding source, trial phase, intervention, and trial status (terminated vs. completed).

We used multivariable regression modeling to examine factors associated with the time to reporting. Models included 12 prespecified trial characteristics: primary purpose, intervention group, phase, FDA oversight, funding source, total enrollment, completion status (terminated vs. completed), primary completion year, study duration, number of study groups, randomized treatment assignment, and study masking technique. Two time points were specified: reporting within 12 months after study completion and reporting within 5 years. We used logistic regression to determine factors that were associated with reporting within 12 months and Cox regression to determine factors that were associated with reporting within 5 years. Adjusted odds ratios with Wald 95% confidence intervals were reported for the logistic regression; adjusted hazard ratios with 95% confidence intervals were reported for the Cox model. In the regression analyses, we calculated P values using Wald chi-square statistics to identify unexpectedly large differences and associations. However, because of the large sample size and the number of effects tested, only differences with both large practical importance and statistical significance at the 0.001 level are highlighted in the text.

To evaluate the effect of accounting for trials with known exceptions to reporting requirements, we conducted alternative logistic-regression and Cox regression analyses (see the Supplementary Appendix for details). Statistical analyses were performed at the Duke Clinical Research Institute with the use of SAS software, version 9.2 (SAS Institute).

Results

Trial Population

Of the 13,327 HLACTs that we reviewed during the study period, 1790 (13.4%) reported results within 12 months after trial completion, and 5110 (38.3%) reported results at any time during the 5-year study period (Table 1Table 1Characteristics of Clinical Trials That Were Completed or Terminated before September 2012., and Table S2 in the Supplementary Appendix). In contrast, among the 25,646 non-HLACTs, only 1287 (5.0%) reported results within 12 months, and 2473 (9.6%) reported results at any time during the 5-year study period (Table S3 in the Supplementary Appendix).

In our study cohort, the primary purpose was identified as treatment by 84.8% of the trials, prevention by 7.7%, and “other” (which included diagnostic, screening, supportive care, health services research, and basic science) by 7.5%. Trials were categorized according to their interventions, with drugs studied in 77.4% of the trials, devices in 11.9%, biologics in 8.9%, and “other” (including radiation and genetics) in 1.9%. The largest funding source was industry (65.6%); the National Institutes of Health (NIH) funded 14.2% of trials, and other government or academic institutions funded the remaining 20.2% (Table 1). Components of basic summary results are listed in Table S4 in the Supplementary Appendix.

Rates of Reporting

At 12 months, results had been reported for 17.0% of trials that were funded by industry, 8.1% of trials funded by the NIH, and 5.7% of trials funded by other government or academic institutions. At 5 years, results had been reported by 41.5% of trials funded by industry, 38.9% of those funded by the NIH, and 27.7% of those funded by other government or academic institutions. Additional details of summary results reporting are provided in Tables S3 through S6 in the Supplementary Appendix.

By September 27, 2013, a total of 2100 of 13,327 HLACTs (15.8%) had submitted a certification or extension request to delay reporting to ClinicalTrials.gov. Of these HLACTs, 482 (23.0%) had reported results throughout the 5-year study period. At 12 months, 1790 of 13,314 trials (13.4%) that were evaluated had reported results and 818 (6.1%) had not reported results but had a legally acceptable delay because of a certification or an exemption request (Table 2Table 2Reporting of Results to ClinicalTrials.gov.). Phase 2 and phase 3 trials were more likely to have certification or exemption requests than were trials in other phases.

Time to Results Reporting

For trials with results, the median time to reporting for HLACTs was 17 months (interquartile range, 13 to 29) (Table 2). For the primary analysis, the median time to reporting was 16 months (interquartile range, 13 to 26) for industry-funded trials, 23 months (interquartile range, 14 to 36) for NIH-funded trials, and 21 months (interquartile range, 14 to 30) for other government or academic institutions (Table 2). After the exclusion of trials with certification or extension requests at any time in the secondary analysis, the median time to reporting decreased from 16 to 14 months for industry-funded trials but remained the same for NIH-funded trials and those funded by other government or academic institutions (Table 2).

Reporting over Time

Kaplan–Meier curves showing reporting of trial results during the 5-year study period according to funding source are provided in Figure 2Figure 2Cumulative Percentage of Clinical Trials That Reported Results to ClinicalTrials.gov, According to the Time after the Primary Completion Date.. Industry-funded trials significantly led reporting for several years, but by 5 years, reporting rates of NIH-funded trials equaled those of industry-funded trials. Trials that were funded by other government or academic institutions had consistently lower rates of reporting over 5 years than did those funded by other sources (Fig. S1, S2, and S3 in the Supplementary Appendix).

Multivariable Factors Associated with Results Reporting

Reporting within 12 Months

The factors that were most strongly associated with reporting by 12 months were funding source, trial phase, and FDA oversight (P<0.001 for all comparisons) (Table 3Table 3Likelihood That Results of Clinical Trials Were Reported by 12 Months or 5 Years after the Primary Completion Date, According to Trial Characteristics., and Table S7 in the Supplementary Appendix). As compared with NIH-funded trials, industry-funded trials were more likely to report results in a timely fashion (adjusted odds ratio, 1.62; 95% confidence interval [CI], 1.34 to 1.97), whereas trials that were funded primarily by other government or academic institutions were less likely to report on time (adjusted odds ratio, 0.58; 95% CI, 0.45 to 0.75). As compared with phase 4 trials, earlier-phase trials were significantly less likely to report on time, with an adjusted odds ratio of 0.28 (95% CI, 0.21 to 0.38) for phase 1–2 combination trials, 0.33 (95% CI, 0.27 to 0.39) for phase 2 trials, 0.22 (95% CI, 0.14 to 0.36) for phase 2–3 combination trials, 0.60 (95% CI, 0.50 to 0.71) for phase 3 trials, and 0.56 (95% CI, 0.45 to 0.70) for trials in which the phase was not applicable (e.g., trials of devices). Trials without FDA oversight were less likely to report on time than those with FDA oversight (adjusted odds ratio, 0.61; 95% CI, 0.52 to 0.71). Sensitivity analyses revealed similar associations (Tables S8 and S9 in the Supplementary Appendix).

Reporting within 5 Years

Multivariable factors that were most strongly associated with results reporting during the 5-year study period included trial phase and funding source (P<0.001 for both comparisons) (Table 3, and Table S7 in the Supplementary Appendix). As compared with phase 4 trials, a stepwise decrease in reporting for phases was observed, with an adjusted hazard ratio of 0.46 (95% CI, 0.40 to 0.54) for phase 1–2 combination trials, 0.54 (95% CI, 0.49 to 0.59) for phase 2 trials, 0.54 (95% CI, 0.44 to 0.66) for phase 2–3 combination trials, and 0.80 (95% CI, 0.72 to 0.88) for phase 3 trials.

Industry-funded and NIH-funded trials were nearly equally likely to report results (adjusted hazard ratio, 0.97; 95% CI, 0.89 to 1.07) within 5 years, whereas trials that were funded by other government or academic institutions were less likely to report results than were NIH-funded trials (adjusted hazard ratio, 0.62; 95% CI, 0.56 to 0.70) (Table 3). After the exclusion of trials with certification or extension requests, a sensitivity analysis showed that industry-funded trials were more likely to report results within 5 years than were NIH-funded trials (Table S10 in the Supplementary Appendix). However, other sensitivity analyses that used a time-dependent covariate to account for whether reporting requirements were in effect did not change the primary finding that reporting rates over 5 years were similar for industry-funded and NIH-funded studies and were substantially lower for those funded by other government or academic institutions (Tables S11 through S14 in the Supplementary Appendix).

Findings from Sample Review

We manually reviewed a sample of 205 HLACTs to determine requirements for reporting (Tables S15A and S15B in the Supplementary Appendix). By reviewing approval dates and labeling information, we determined that 44 to 45% of industry-funded HLACTs in this sample were not required to report results, as compared with 6% of NIH-funded studies and 9% of those funded by other government or academic institutions. On the basis of this review, we estimated that during the 5-year period, approximately 79 to 80% of industry-funded trials reported summary results or had a legally acceptable reason for delay. In contrast, only 49 to 50% of NIH-funded trials and 42 to 45% of those funded by other government or academic institutions reported results or had legally acceptable reasons for delay.

Discussion

The reporting requirements of the FDAAA reflect the ethical obligation of researchers and sponsors to respect human trial participants through fidelity to commitments made explicit in informed consent: namely, to make results of trials available to contribute to generalizable knowledge.1,13,14,18 The FDAAA was designed to ensure timely disclosure of trial results3 and was enacted amid public concern that sponsors and investigators were selectively publishing trials that favored the interests of the sponsors and that journals were selectively reporting positive findings.1-3 However, we found that summary data are not publicly available at ClinicalTrials.gov for a majority of trials that are subject to FDAAA provisions.

Before the passage of the FDAAA, industry sponsors received particular scrutiny for selective reporting.2,3 Since the enactment of the law, many companies have developed disclosure policies and have actively pursued expanded public disclosure of data.19-22 Curiously, reporting continues to lag for trials funded by the NIH and by other government or academic institutions. Pfizer has reported that the preparation of results summaries requires 4 to 60 hours,19 and it is possible that the NIH and other funders have been unable or unwilling to allocate adequate resources to ensure timely reporting.

As expected, earlier-phase trials were consistently the least likely to report results in a timely fashion or over the 5-year study interval. Concern has been raised that earlier-phase trials are primarily focused on proof-of-concept demonstrations and as such represent valuable, closely guarded intellectual property.2 Counterarguments include the ethical obligation to volunteers who participate in early-phase experiments, which often carry unknown risks without the prospect of benefit, and concern that nondisclosure could harm participants in similar trials, because researchers and funders would remain unaware of possible risks.

Penalties that have been established by the FDAAA include publication at ClinicalTrials.gov of “failure to submit” notifications and lists of sanctions that have been imposed, including civil penalties of up to $10,000 per day and loss of funding to the NIH.4 No enforcement has yet occurred, partly because the Notice of Proposed Rulemaking for the FDAAA was released in November 2014 and the period for public comment has recently been extended to March 23, 2015.23,24 In addition, the FDA and National Library of Medicine could work together to inform sponsors of all trials that are required to report to ClinicalTrials.gov on approval of the product or new indication. Finally, the International Committee of Medical Journal Editors (ICMJE) could create policies that mandate the reporting of results, perhaps concurrent with peer-reviewed publication or FDA approval, since earlier ICMJE policies have notably improved rates of trial registration before publication.25 Other factors that could prompt increased reporting to CinicalTrials.gov include notification by the National Library of Medicine to sponsors regarding the status of all applicable clinical trials and reporting deadlines, development of internal reporting policies by sponsors, endorsement of requirements for the reporting of results by federal and nonfederal funding agencies, and enforcement of legal penalties.

We note a number of limitations to our study. Our analysis includes only registered HLACTs, and therefore some HLACTs may have been missed as a result of not being registered. The algorithm that we used to identify HLACTs cannot perfectly ascertain which trials were subject to FDAAA regulation and does not identify trials of interventions that have not been approved for marketing and therefore were not required to report results (Fig. S4 in the Supplementary Appendix). Although we examined data on certification and extension requests, not all sponsors of applicable clinical trials of unapproved or unlabeled products submitted such requests. Many of these trials may have been in the premarketing phase or may have been early negative trials for which plans for marketing were withdrawn. Finally, since trial characteristics are submitted by sponsors, we cannot independently verify their accuracy.

In conclusion, despite ethical mandates, statutory obligations, and considerable societal pressure, most trials that were funded by the NIH or other government or academic institutions and were subject to FDAAA provisions have yet to report results at ClinicalTrials.gov, whereas the medical-products industry has been more responsive to the legal mandate of the FDAAA. However, industry, the NIH, and other government and academic institutions all performed poorly with respect to ethical obligations for transparency.

The views presented here are solely those of the authors and do not necessarily represent the official views of the Clinical Trials Transformation Initiative or the NIH.

Supported by the Clinical Trials Transformation Initiative and the NIH Common Fund through cooperative agreements (1U54AT007748-01 and 3U54AT007748-02S1) with the Office of Strategic Coordination in the Office of the NIH Director.

Disclosure forms provided by the authors are available with the full text of this article at NEJM.org.

We thank Deborah Zarin, M.D., and Tony Tse, M.S., of the National Library of Medicine, NIH, for their technical assistance in using data from ClinicalTrials.gov; and Jonathan McCall, M.S., and Liz Wing, M.A., of the Duke Clinical Research Institute for assistance in the preparation of the manuscript.

Source Information

From the Department of Medicine, Division of Cardiology (M.L.A., E.D.P., R.M.C.), the Duke Clinical Research Institute, Duke University Medical Center (M.L.A., K.C., E.D.P., A.T., J.T.), and the Duke Translational Medicine Institute (R.M.C.), Duke University School of Medicine, Durham, NC.

Address reprint requests to Dr. Anderson at the Duke Clinical Research Institute, 7022 North Pavilion, Duke University Medical Center 17969, 2400 Pratt St., Durham, NC 27715, or at .

References

References

  1. 1

    Kesselheim AS, Mello MM. Confidentiality laws and secrecy in medical research: improving public access to data on drug safety. Health Aff (Millwood) 2007;26:483-491
    CrossRef | Web of Science | Medline

  2. 2

    Turner EH, Matthews AM, Linardatos E, Tell RA, Rosenthal R. Selective publication of antidepressant trials and its influence on apparent efficacy. N Engl J Med 2008;358:252-260
    Free Full Text | Web of Science | Medline

  3. 3

    Nissen SE, Wolski K. Effect of rosiglitazone on the risk of myocardial infarction and death from cardiovascular causes. N Engl J Med 2007;356:2457-2471
    Free Full Text | Web of Science | Medline

  4. 4

    Food and Drug Administration Amendments Act of 2007. (Public Law No. 110-85 § 801;2007.)

  5. 5

    ClinicalTrials.gov. FDAAA 801 requirements (http://clinicaltrials.gov/ct2/manage-recs/fdaaa).

  6. 6

    Zarin DA, Tse T, Williams RJ, Califf RM, Ide NC. The ClinicalTrials.gov results database -- update and key issues. N Engl J Med 2011;364:852-860
    Free Full Text | Web of Science | Medline

  7. 7

    Gill CJ. How often do US-based human subjects research studies register on time, and how often do they post their results? A statistical analysis of the Clinicaltrials.gov database. BMJ Open 2012;2:e001186-e001186
    CrossRef

  8. 8

    Law MR, Kawasumi Y, Morgan SG. Despite law, fewer than one in eight completed studies of drugs and biologics are reported on time on ClinicalTrials.gov. Health Aff (Millwood) 2011;30:2338-2345
    CrossRef | Medline

  9. 9

    Nguyen TA, Dechartres A, Belgherbi S, Ravaud P. Public availability of results of trials assessing cancer drugs in the United States. J Clin Oncol 2013;31:2998-3003
    CrossRef | Medline

  10. 10

    Prayle AP, Hurley MN, Smyth AR. Compliance with mandatory reporting of clinical trial results on ClinicalTrials.gov: cross sectional study. BMJ 2012;344:d7373-d7373
    CrossRef | Medline

  11. 11

    Saito H, Gill CJ. How frequently do the results from completed US clinical trials enter the public domain? A statistical analysis of the ClinicalTrials.gov database. PLoS One 2014;9:e101826-e101826
    CrossRef | Medline

  12. 12

    Kuehn BM. Few studies reporting results at US government clinical trials site. JAMA 2012;307:651-653
    CrossRef | Medline

  13. 13

    Emanuel EJ, Wendler D, Grady C. What makes clinical research ethical? JAMA 2000;283:2701-2711
    CrossRef | Web of Science | Medline

  14. 14

    Drazen JM, Morrissey S, Curfman GD. Open clinical trials. N Engl J Med 2007;357:1756-1757
    Free Full Text | Web of Science | Medline

  15. 15

    Clinical Trials Transformation Initiative. AACT database (http://ctti-clinicaltrials.org/what-we-do/analysis-dissemination/state-clinical-trials/aact-database).

  16. 16

    Tasneem A, Aberle L, Ananth H, et al. The database for aggregate analysis of ClinicalTrials.gov (AACT) and subsequent regrouping by clinical specialty. PLoS One 2012;7:e33677-e33677
    CrossRef | Medline

  17. 17

    Califf RM, Zarin DA, Kramer JM, Sherman RE, Aberle LH, Tasneem A. Characteristics of clinical trials registered in ClinicalTrials.gov, 2007-2010. JAMA 2012;307:1838-1847
    CrossRef | Web of Science | Medline

  18. 18

    Shalowitz DI, Miller FG. Disclosing individual results of clinical research: implications of respect for participants. JAMA 2005;294:737-740
    CrossRef | Medline

  19. 19

    Pfizer.com. Clinical case study series: disclosure of clinical trials information, 2009 (https://www.pfizer.com/files/research/research_clinical_trials/Disclosure_ClinicalTrialsInformation_030209.pdf).

  20. 20

    GSK.com. Global public policy issues: public disclosure of clinical research, April 2014 (http://www.gsk.com/media/280827/disclosure-of-clinical-trial-information-policy.pdf).

  21. 21

    Merck.com. Public policy statement: clinical trials data disclosure, July 2014 (http://www.merck.com/about/views-and-positions/Clinical%20Trials%20Data%20Disclosure%20–%20July%202014.pdf).

  22. 22

    Feczko J. Clinical trials report card. N Engl J Med 2006;354:1426-1429
    Free Full Text | Medline

  23. 23

    Department of Health and Human Services. U.S. Food and Drug Administration response letter to the Honorable Leonard Lance, July 10, 2014 (http://nebula.wsimg.com/402766aac55d29eb46728087828d33de?AccessKeyId=B353B9F4C0E2B832754F&disposition=0&alloworigin=1).

  24. 24

    Federal Register. Clinical trials registration and results submission: a proposed rule by the National Institutes of Health on 02/13/2015 (https://www.federalregister.gov/articles/2015/02/13/2015-02990/clinical-trials-registration-and-results-submission).

  25. 25

    Laine C, Horton R, DeAngelis CD, et al. Clinical trial registration -- looking back and moving ahead. N Engl J Med 2007;356:2734-2736
    Free Full Text | Web of Science | Medline

Citing Articles (44)

Citing Articles

  1. 1

    Kerina H. Jones, Graeme Laurie, Leslie Stevens, Christine Dobbs, David V. Ford, Nathan Lea. (2017) The other side of the coin: Harm due to the non-use of health-related data. International Journal of Medical Informatics 97, 43-51
    CrossRef

  2. 2

    Agnès Dechartres, Philippe Ravaud, Ignacio Atal, Carolina Riveros, Isabelle Boutron. (2016) Association between trial registration and treatment effect estimates: a meta-epidemiological study. BMC Medicine 14:1
    CrossRef

  3. 3

    Mattias Neyt, Thierry Christiaens, Jacques Demotes, Tom Walley, Frank Hulstaert. (2016) Publicly funded practice-oriented clinical trials: of importance for healthcare payers. Journal of Comparative Effectiveness Research 5:6, 551-560
    CrossRef

  4. 4

    Yu-Pei Chen, Xu Liu, Jia-Wei Lv, Wen-Fei Li, Yuan Zhang, Ying Guo, Ai-Hua Lin, Ying Sun, Yan-Ping Mao, Jun Ma. (2016) Publication status of contemporary oncology randomised controlled trials worldwide. European Journal of Cancer 66, 17-25
    CrossRef

  5. 5

    Amy C. Killeen, Jennifer A. Harn, Leah M. Erickson, Fang Yu, Richard A. Reinhardt. (2016) Local Minocycline Effect on Inflammation and Clinical Attachment During Periodontal Maintenance: Randomized Clinical Trial. Journal of Periodontology 87:10, 1149-1157
    CrossRef

  6. 6

    Zarin, Deborah A., Tse, Tony, Williams, Rebecca J., Carr, Sarah, . Trial Reporting in ClinicalTrials.gov — The Final Rule. New England Journal of Medicine 0:0
    Free Full Text

  7. 7

    A. Boswood, J. Häggström, S.G. Gordon, G. Wess, R.L. Stepien, M.A. Oyama, B.W. Keene, J. Bonagura, K.A. MacDonald, M. Patteson, S. Smith, P.R. Fox, K. Sanderson, R. Woolley, V. Szatmári, P. Menaut, W.M. Church, M. L. O'Sullivan, J.-P. Jaudon, J.-G. Kresken, J. Rush, K.A. Barrett, S.L. Rosenthal, A.B. Saunders, I. Ljungvall, M. Deinert, E. Bomassi, A.H. Estrada, M.J. Fernandez Del Palacio, N.S. Moise, J.A. Abbott, Y. Fujii, A. Spier, M.W. Luethy, R.A. Santilli, M. Uechi, A. Tidholm, P. Watson. (2016) Effect of Pimobendan in Dogs with Preclinical Myxomatous Mitral Valve Disease and Cardiomegaly: The EPIC Study-A Randomized Clinical Trial. Journal of Veterinary Internal Medicine
    CrossRef

  8. 8

    H. A. Bradley, J. J. Rucklidge, R. T. Mulder. (2016) A systematic review of trial registration and selective outcome reporting in psychotherapy randomized controlled trials. Acta Psychiatrica Scandinavica
    CrossRef

  9. 9

    Aleta Quinn. (2016) Run the Experiment, Publish the Study, Close the Sale: Business, Values, Science and Biomedical Research - A Thematic Introduction. De Ethica. A Journal of Philosophical, Theological and Applied Ethics 3:2, 5-21
    CrossRef

  10. 10

    Changyu Shen, Ziyue Liu, Huiping Xu, Hai Liu, Cynthia Yue. (2016) Control of false positives in randomized phase III clinical trials. Journal of Biopharmaceutical Statistics, 1-13
    CrossRef

  11. 11

    Warren, Elizabeth, . (2016) Strengthening Research through Data Sharing. New England Journal of Medicine 375:5, 401-403
    Free Full Text

  12. 12

    (2016) How to encourage trial reporting. Nature Medicine 22:8, 823-823
    CrossRef

  13. 13

    Maria Elena Flacco, Lamberto Manzoli, Stefania Boccia, Anna Puggina, Annalisa Rosso, Carolina Marzuillo, Giacomo Scaioli, Maria Rosaria Gualano, Walter Ricciardi, Paolo Villari, John P.A. Ioannidis. (2016) Registered Randomized Trials Comparing Generic and Brand-Name Drugs: A Survey. Mayo Clinic Proceedings 91:8, 1021-1034
    CrossRef

  14. 14

    Rebecca Sudlow, Janice Branson, Tim Friede, David Morgan, Caroline Whately-Smith. (2016) EFSPI/PSI working group on data sharing: accessing and working with pharmaceutical clinical trial patient level datasets – a primer for academic researchers. BMC Medical Research Methodology 16:S1
    CrossRef

  15. 15

    Paul Beninger, Marcia Boumil, Deeb Salem, Kenneth Getz, Henry Klapholz, Gregory D. Curfman, Rohan Jotwani, Harris Berman. (2016) Bridging the Academia/Industry Chasm: Proposed Solutions. The Journal of Clinical Pharmacology
    CrossRef

  16. 16

    Su Golder, Yoon K. Loke, Kath Wright, Carmelo Sterrantino. (2016) Most systematic reviews of adverse effects did not include unpublished data. Journal of Clinical Epidemiology
    CrossRef

  17. 17

    M. Campa, C. Ryan, A. Menter. (2016) Developing more open and equitable relationships with industry to improve advancements in clinical research in dermatology. British Journal of Dermatology 174:6, 1365-1369
    CrossRef

  18. 18

    John P.A. Ioannidis. (2016) Evidence-based medicine has been hijacked: a report to David Sackett. Journal of Clinical Epidemiology 73, 82-86
    CrossRef

  19. 19

    Bethany Withycombe, Mac Ovenell, Amanda Meeker, Sharia M. Ahmed, Daniel M. Hartung. (2016) Timing of pivotal clinical trial results reporting for newly approved medications varied by reporting source. Journal of Clinical Epidemiology
    CrossRef

  20. 20

    Anja Maria Brænd, Jørund Straand, Rune Bruhn Jakobsen, Atle Klovning. (2016) Publication and non-publication of drug trial results: a 10-year cohort of trials in Norwegian general practice. BMJ Open 6:4, e010535
    CrossRef

  21. 21

    R Griebenow. (2016) Competing interests in continuing medical education - what should accreditors do?. Continuing Cardiology Education 2:1, 4-5
    CrossRef

  22. 22

    Meiping Chang, Man Chang, Jane Z. Reed, David Milward, Jinghai James Xu, Wendy D. Cornell. (2016) Developing timely insights into comparative effectiveness research with a text-mining pipeline. Drug Discovery Today 21:3, 473-480
    CrossRef

  23. 23

    A C Tompson, S Petit-Zeman, B Goldacre, C J Heneghan. (2016) Getting our house in order: an audit of the registration and publication of clinical trials supported by the National Institute for Health Research Oxford Biomedical Research Centre and the Musculoskeletal Biomedical Research Unit. BMJ Open 6:3, e009285
    CrossRef

  24. 24

    William T Gattrell, Sally Hopewell, Kate Young, Paul Farrow, Richard White, Elizabeth Wager, Christopher C Winchester. (2016) Professional medical writing support and the quality of randomised controlled trial reporting: a cross-sectional study. BMJ Open 6:2, e010329
    CrossRef

  25. 25

    Barbara J. Bain, Tim J. Littlewood, Richard M. Szydlo. (2016) The finer points of writing and refereeing scientific articles. British Journal of Haematology 172:3, 350-359
    CrossRef

  26. 26

    Jason Roberts. (2016) Trial Registration, Transparency, and Selective Reporting: Let's Get Clear About What Is Needed in Headache Medicine. Headache: The Journal of Head and Face Pain 56:1, 3-7
    CrossRef

  27. 27

    C. M. Stein. (2015) Academic clinical research: Death by a thousand clicks. Science Translational Medicine 7:318, 318fs49-318fs49
    CrossRef

  28. 28

    Marcus Ruopp, Karen Chiswell, Joshua T. Thaden, Kunal Merchant, Ephraim L. Tsalik. (2015) Respiratory Tract Infection Clinical Trials from 2007 to 2012. A Systematic Review of ClinicalTrials.gov. Annals of the American Thoracic Society 12:12, 1852-1863
    CrossRef

  29. 29

    Eve Tang, Philippe Ravaud, Carolina Riveros, Elodie Perrodeau, Agnes Dechartres. (2015) Comparison of serious adverse events posted at ClinicalTrials.gov and published in corresponding journal articles. BMC Medicine 13:1
    CrossRef

  30. 30

    M. L. Rayhill, R. Sharon, R. Burch, E. Loder. (2015) Registration status and outcome reporting of trials published in core headache medicine journals. Neurology 85:20, 1789-1794
    CrossRef

  31. 31

    Huseyin Naci, Jacob Cooper, Elias Mossialos. (2015) Timely publication and sharing of trial data: opportunities and challenges for comparative effectiveness research in cardiovascular disease. European Heart Journal - Quality of Care and Clinical Outcomes 1:2, 58-65
    CrossRef

  32. 32

    Jennifer E Miller, David Korn, Joseph S Ross. (2015) Clinical trial registration, reporting, publication and FDAAA compliance: a cross-sectional analysis and ranking of new drugs approved by the FDA in 2012. BMJ Open 5:11, e009758
    CrossRef

  33. 33

    Barbara Mintzes, Joel Lexchin, Ancel·la Santos Quintano. (2015) Clinical trial transparency: many gains but access to evidence for new medicines remains imperfect. British Medical Bulletin, ldv042
    CrossRef

  34. 34

    Claudia Pansieri, Chiara Pandolfini, Maurizio Bonati. (2015) The evolution in registration of clinical trials: a chronicle of the historical calls and current initiatives promoting transparency. European Journal of Clinical Pharmacology 71:10, 1159-1164
    CrossRef

  35. 35

    Charity G. Moore, Susan Spillane, Gertrude Simon, Barbara Maxwell, Frederic F. Rahbari-Oskoui, William E. Braun, Arlene B. Chapman, Robert W. Schrier, Vicente E. Torres, Ronald D. Perrone, Theodore I. Steinman, Godela Brosnahan, Peter G. Czarnecki, Peter C. Harris, Dana C. Miskulin, Michael F. Flessner, K. Ty Bae, Kaleab Z. Abebe, Marie C. Hogan. (2015) Closeout of the HALT-PKD trials. Contemporary Clinical Trials 44, 48-55
    CrossRef

  36. 36

    Gregory Morley. (2015) Regulatory Writing. Medical Writing 24:3, 153-154
    CrossRef

  37. 37

    Daniel B. Kramer, Donald E. Cutlip. (2015) Regulatory science: Trust and transparency in clinical trials of medical devices. Nature Reviews Cardiology 12:9, 503-504
    CrossRef

  38. 38

    Bina Rawal, Bryan R. Deane. (2015) Clinical trial transparency update: an assessment of the disclosure of results of company-sponsored trials associated with new medicines approved in Europe in 2012. Current Medical Research and Opinion 31:7, 1431-1435
    CrossRef

  39. 39

    Zarin, Deborah A., Tse, Tony, , Ross, Joseph S., . (2015) Trial-Results Reporting and Academic Medical Centers. New England Journal of Medicine 372:24, 2371-2372
    Free Full Text

  40. 40

    (2015) Compliance with Results Reporting at ClinicalTrials.gov. New England Journal of Medicine 372:24, 2370-2371
    Free Full Text

  41. 41

    Françoise Baylis, Matthew Herder. (2015) Who will implement WHO's statement on public disclosure of trial results?. The Lancet 385:9985, 2353-2354
    CrossRef

  42. 42

    Sandra Morris, Karla G Childers, Jesse A Berlin, Joanne Waldstreicher. (2015) The need for even further progress with clinical trial data sharing efforts: patients are waiting. Clinical Investigation 5:6, 531-533
    CrossRef

  43. 43

    Fotini B. Karassa, John P. A. Ioannidis. (2015) Clinical trials: A transparent future for clinical trial reporting. Nature Reviews Rheumatology 11:6, 324-326
    CrossRef

  44. 44

    Drummond Rennie, Constance Murphy. . Wiley StatsRef: Statistics Reference Online. 2015:, 1.
    CrossRef

Letters
Metrics

Page Views

Page view data are collected daily and posted on the second day after collection. Page views include both html and pdf views of an article.
Geographical Distribution of Page Views

Media Coverage

A media monitoring service searches for every mention of NEJM or New England Journal of Medicine in news stories from around the world. Radio and television mentions are predominantly from the United States, but print and web media are tracked worldwide in multiple languages. Coverage may take up to a week to appear.

Source Information

    Source Information

      Social Media — Altmetric.com Data

      Comparisons to NEJM and other journal articles are to Altmetric.com data on all types of articles in all types of medical journals around the world.

      Comparisons

      Compared to Other
      NEJM Articles
      In the
      N/A
      Ranks
      N/A
      Compared to Articles in
      Other Medical Journals
      In the
      N/A
      Ranks
      N/A

      Recent Twitter Activity

      Tweets

      TWEETS

      Other Article Activity

      Emailed
      31

      Trends

      Most Viewed (Last Week)