Join the 200th Anniversary Celebration

Special Article

Readability Standards for Informed-Consent Forms as Compared with Actual Readability

Michael K. Paasche-Orlow, M.D., M.P.H., Holly A. Taylor, Ph.D., M.P.H., and Frederick L. Brancati, M.D., M.H.S.

N Engl J Med 2003; 348:721-726February 20, 2003

Abstract

Background

Institutional review boards (IRBs) are charged with safeguarding potential research subjects with limited literacy but may have an inadvertent role in promulgating unreadable consent forms. We hypothesized that text provided by IRBs in informed-consent forms falls short of the IRBs' own readability standards and that readability is influenced by the level of research activity, local literacy rates, and federal oversight.

Methods

To test these hypotheses, we conducted a cross-sectional study linking data from several public-use sources. A total of 114 Web sites of U.S. medical schools were surveyed for IRB readability standards and informed-consent-form templates. Actual readability was measured with the Flesch–Kincaid scale, which assigns a score on the basis of the minimal grade level required to read and understand English text (range, 0 to 12). Data on the level of research activity, local literacy rates, and federal oversight were obtained from organizational Web sites.

Results

The average readability score for text provided by IRBs was 10.6 (95 percent confidence interval, 10.3 to 10.8) on the Flesch–Kincaid scale. Specific readability standards, found on 61 Web sites (54 percent), ranged from a 5th-grade reading level to a 10th-grade reading level. The mean Flesch–Kincaid scores for the readability of sample text provided by IRBs exceeded the stated standard by 2.8 grade levels (95 percent confidence interval, 2.4 to 3.2; P<0.001). Readability was not associated with either the level of research funding (P=0.89) or local rates of literacy (P=0.92). However, the 52 schools that had been made subject to oversight by the Office for Human Research Protections (46 percent) had lower Flesch–Kincaid scores than the other schools (10.2 vs. 10.9, P=0.005).

Conclusions

IRBs commonly provide text for informed-consent forms that falls short of their own readability standards. Federal oversight is associated with better readability.

Media in This Article

Figure 1Difference between Actual Readability and Target Readability.
Table 1Examples of Informed-Consent Text Provided by Institutional Review Boards at U.S. Medical Schools.
Article

Educational materials for patients and informed-consent documents present highly complex information that must be understood by patients.1-3 This complexity is a major barrier to comprehension for the approximately one quarter of American adults with low literacy skills.4 A low level of literacy is independently associated with poor health outcomes and billions of dollars of additional annual health care expenditures.5-9 When documents are incomprehensible, health care providers may risk liability.10-12

Obtaining informed consent for participation in medical research is particularly challenging because it requires a level of comprehension beyond that required for consent to usual care.13 A large literature already supports the notion that the language used in informed-consent forms is not comprehensible to most Americans.14 However, the origin of this problem is unclear.

Institutional review boards (IRBs) are charged with safeguarding potential subjects with limited literacy,15,16 but they may have an inadvertent role in promulgating unreadable informed-consent forms. IRBs commonly present investigators with readability standards and informed-consent text, in the form of templates and sample forms. We surveyed U.S. medical schools to test the hypothesis that IRBs fail to meet their own standards for readability in the informed-consent text offered to investigators.

Methods

Data Sources

We obtained all data from publicly available Web sites, which were accessed between December 2001 and February 2002. A total of 123 U.S. medical-school Web sites were surveyed for specified readability standards and suggested text for informed-consent documents. Data were obtained from 114 of the Web sites (93 percent). We were unable to collect data from the other nine Web sites because information about the IRB was restricted to intranet access (six sites) or because the Web site contained no information about an IRB (three).

Data on the rank order of medical schools that received funding in 2001, obtained from the Web site of the National Institutes of Health,17 were used as an indicator of research activity. Local literacy rates were obtained from the Web site of the National Institute for Literacy, which provides literacy rates by congressional district.18 Data on federal oversight were obtained from the Web site of the Office for Human Research Protections, which lists medical schools that were made subject to oversight between July 2000 and February 2002.19 Federal oversight is initiated to evaluate indications of noncompliance with federal policy.20

Readability Standards

Each medical-school Web site was examined for information about readability standards. Descriptive standards (e.g., “in lay language”) and specific grade-level standards (e.g., “at or below an 8th-grade reading level”) were recorded.

Sample Text

Web sites were examined for sample informed-consent text to be used for adults who have full decision-making capacity. Text intended for special populations (e.g., children) or special circumstances (e.g., genetic testing) was excluded from the analysis. Applicable templates and sample language were downloaded into Microsoft Word 2000 (Microsoft).

Readability Score

The readability of sample text was measured with the use of the Flesch–Kincaid readability scale (grade-level range, 0 to 12), which is automated in Microsoft Word and has been demonstrated to be reliable and valid.21 The Flesch–Kincaid scale assesses readability on the basis of the average number of syllables per word and the average number of words per sentence.22 The Flesch–Kincaid grade level that we assigned to a document was the average of three separate measurements conducted on the three largest uninterrupted blocks of text (Table 1Table 1Examples of Informed-Consent Text Provided by Institutional Review Boards at U.S. Medical Schools.).

An additional measure of readability was applied to a randomly selected 20 percent subsample of materials according to the method developed by Fry.22 The Fry score, expressed as the number of years of education required for comprehension (range, 1 to 17 or more), is based on the average number of syllables per three 100-word blocks and the average number of sentences per three 100-word blocks.

Statistical Analysis

We used the Wilcoxon signed-rank test to compare readability scores with grade-level standards for readability. Analysis of variance was used to test the association of readability with quartile means for the level of research funding and local literacy rates. Readability scores for schools that had been subjected to federal oversight and those that had not were compared with use of the Wilcoxon rank-sum test. All significance tests were two-tailed. Analyses were conducted with Stata software, version 8 (Stata).

Results

Readability Standards

Grade-level readability standards were specified at 61 of the 114 Web sites (54 percent). The standards ranged from a 5th-grade reading level to a 10th-grade level (mode, 8th grade). Forty-seven other Web sites (41 percent) contained descriptive guidelines such as “simple lay language,” and six (5 percent) contained no guidelines for readability.

Readability of Sample Text

The mean Flesch–Kincaid grade level for sample text supplied by IRBs was 10.6 (95 percent confidence interval, 10.3 to 10.8). Among the 61 schools with specific grade-level standards, only 8 percent (95 percent confidence interval, 3 to 18 percent) met their own standards; the mean score for readability exceeded the stated standard by 2.8 grade levels (95 percent confidence interval, 2.4 to 3.2; P<0.001) (Figure 1Figure 1Difference between Actual Readability and Target Readability.).

The magnitude of this disparity was amplified by application of the Fry formula. In a representative subsample of materials from 24 medical schools, the modal score for readability was 13 (range, 6 to 16), and the mean score was 13.0 (95 percent confidence interval, 12.2 to 13.9). The modal Flesch–Kincaid score for these materials was 10.9 (range, 5.8 to 12.0), and the mean score was 10.7 (95 percent confidence interval, 10.1 to 11.3).

Several schools presented sample text for informed-consent forms that did meet their own standards. For example, the text supplied by the State University of New York Downstate Medical School, which specifies a 6th-grade reading level as the standard for readability, had a Flesch–Kincaid score of 5.8 and a Fry score of 6. The University of Washington and the schools of the University of Minnesota met their goal of an 8th-grade reading level.

Factors Thought to Influence Readability

Neither the level of research funding received from the National Institutes of Health nor the local rate of literacy was associated with the readability of informed-consent text (P=0.89 and P=0.92, respectively). However, there was a small but significant association between federal oversight and readability. The grade-level score was lower for text provided by the 52 medical schools that had been subjected to federal oversight than for text presented by the other schools (10.2 vs. 10.9, P=0.005). This association was even stronger when the oversight predated the posting of the informed-consent text (readability score, 9.8 vs. 10.9; P<0.001).

Discussion

Our findings suggest that the sample texts provided to investigators by IRBs of U.S. medical schools generally fail to meet the IRBs' own standards for readability. The readability of sample text does not appear to be influenced by the level of research activity or the local rate of literacy but does appear to be influenced by prior oversight by the Office for Human Research Protections. Previous reports have demonstrated the complexity of informed-consent forms23-32 but have not examined the language promulgated by IRBs.

The strengths of this study that lend weight to our conclusions are its nearly complete coverage of IRBs at U.S. medical schools and the use of standardized instruments for data abstraction. Nonetheless, several limitations should be kept in mind. First, data were obtained exclusively from Web sites. Although it is likely that the materials presented on IRB Web sites accurately reflect local practices, additional materials were not examined. Second, our analysis was limited to templates and samples rather than actual consent forms. Investigators sometimes modify the language in templates to make the forms more readable. Third, we did not attempt to evaluate content. It is possible that variations in conceptual complexity influence readability as well. Fourth, the grade level of text is only one aspect of the suitability of informed-consent forms. Additional factors, such as the type font, layout, and length, also affect readability.27,33-37

We chose the Flesch–Kincaid scale for our main analysis primarily because of its convenience: of the dozens of readability scales, the Flesch–Kincaid system is the most widely available for computerized use, since it is embedded in Microsoft Word. Other advantages include its wide use in studies of readability, excellent repeatability, and high correlation with other established readability scales (r=0.87 to 0.90).21 However, since the Flesch–Kincaid scoring method in Microsoft Word artificially truncates readability at the 12th-grade level, it underestimates the actual reading level required for complex text. Had we applied the more laborious Fry method in our main analyses, the disparities between readability standards and sample forms would have been even more striking. Furthermore, neither method accounts for the complexity introduced by short but unfamiliar medical terms. Both these limitations tend to result in underestimation of the actual reading level required for medical documents.

Almost half of American adults read at or below the 8th-grade level.3 Illiteracy in the United States is mainly the result of insufficient education. The text of informed-consent documents can be written at a 4th-grade level, as Table 1 shows. Even though consent forms are never used in isolation, text written at a 4th-grade level would promote the autonomy of most candidates for participation in medical research. People who have poor literacy skills should not be excluded from such participation. Alternative methods for obtaining informed consent, such as multimedia systems, are also likely to be of substantial benefit.38

To achieve systemic change, IRBs need to improve the templates and sample text they offer to investigators. Although federal review appears to improve the readability of these materials, models are already available for interested medical schools. Institutions as diverse as the National Cancer Institute and the State University of New York Downstate Medical School have presented informed-consent templates and sample forms that are below an 8th-grade reading level.39 Our study suggests that a 4th-grade to 6th-grade reading level may be a suitable target, since text at this level appears to convey key concepts simply and directly.

Important documents for patients must be written in clear, direct language. Plain language requires honesty and a good understanding of what to convey.40 We believe that IRBs should lead by example.

Dr. Paasche-Orlow is the recipient of a grant (T32HL007180) from the National Heart, Lung, and Blood Institute. Dr. Brancati is the recipient of a Mid-Career Investigator Award in Patient-Oriented Research (K24DK62222) from the National Institute of Diabetes and Digestive and Kidney Diseases.

Source Information

From the Departments of Medicine (M.K.P.-O., F.L.B.), Health Policy and Management (H.A.T.), and Epidemiology (F.L.B.) and the Phoebe R. Berman Bioethics Institute (M.K.P.-O., H.A.T.), Johns Hopkins University, Baltimore.

Address reprint requests to Dr. Paasche-Orlow at the Welch Center for Prevention, Epidemiology, and Clinical Research, Johns Hopkins Medical Institutions, 2024 E. Monument St., Suite 2-600, Baltimore, MD 21205, or at .

References

References

  1. 1

    Fitzmaurice DA, Adams JL. A systematic review of patient information leaflets for hypertension. J Hum Hypertens 2000;14:259-262
    CrossRef | Web of Science | Medline

  2. 2

    Andrus MR, Roth MT. Health literacy: a review. Pharmacotherapy 2002;22:282-302
    CrossRef | Web of Science | Medline

  3. 3

    Communicating with patients who have limited literacy skills: report of the National Work Group on Literacy and Health. J Fam Pract 1998;46:168-176
    Web of Science | Medline

  4. 4

    Kirsch IS, Jungeblut A, Jenkins L, Kolstad A. Adult literacy in America: a first look at the results of the National Adult Literacy Survey. Washington, D.C.: Office of Education Research and Improvement, Department of Education, 1993.

  5. 5

    Ad Hoc Committee on Health Literacy for the Council on Scientific Affairs. Health literacy: report of the Council on Scientific Affairs. JAMA 1999;281:552-557
    CrossRef | Web of Science

  6. 6

    Baker DW. Access to health care and preventable hospitalizations. JAMA 1995;274:1759-1759
    CrossRef | Web of Science | Medline

  7. 7

    Kickbusch I, Ratzan SC. Health literacy: making a difference in the USA. J Health Commun 2001;6:87-88
    CrossRef | Web of Science | Medline

  8. 8

    Rudd RE, Moeykens BA, Colton TC. Health and literacy: a review of medical and public health literature. In: Comings J, Garners B, Smith C, eds. Health and literacy. New York: Jossey-Bass, 1999.

  9. 9

    Williams MV, Baker DW, Honig EG, Lee TM, Nowlan A. Inadequate literacy is a barrier to asthma knowledge and self-care. Chest 1998;114:1008-1015
    CrossRef | Web of Science | Medline

  10. 10

    Health Literacy Project. Literacy, health, and the law. Philadelphia: Health Promotion Council of Southeastern Pennsylvania, 1996.

  11. 11

    Pape T. Legal and ethical considerations of informed consent. AORN J 1997;65:1122-1127
    CrossRef | Medline

  12. 12

    Faden RR, Beauchamp TL. A history and theory of informed consent. New York: Oxford University Press, 1986.

  13. 13

    The Belmont report: ethical principles and guidelines for the protection of human subjects of research. Bethesda, Md.: National Commission for the Protection of Human Subjects of Biomedical and Behavioral Research, 1978.

  14. 14

    Sugarman J, McCrory DC, Powell D, et al. Empirical research on informed consent: an annotated bibliography. Hastings Cent Rep 1999;29:S1-S42
    Medline

  15. 15

    Protection of Human Subjects. C.F.R. title 45, §§ 46.109 and 50.20 (1993).

  16. 16

    Department of Health and Human Services Office for Human Research Protections. Institutional review board guidebook. Washington, D.C.: Government Printing Office, 1993.

  17. 17

    NIH awards to medical schools by rank. Bethesda, Md.: National Institutes of Health, 2002. (Accessed January 28, 2003, at http://grants2.nih.gov/grants/award/rank/medttlnod.htm.)

  18. 18

    The state of literacy in America. Washington, D.C.: National Institute for Literacy, 2003. (Accessed January 28, 2003, at http://www.nifl.gov/reders/reder.htm.)

  19. 19

    OHRP compliance activities: determination letters. Washington, D.C.: Office for Human Research Protections, 2002. (Accessed January 28, 2003, at http://ohrp.osophs.dhhs.gov/detrm_letrs/lindex.htm.)

  20. 20

    Protection of Human Subjects. C.F.R. title 45, §46 (1993).

  21. 21

    Kincaid JP, Fishburne RP, Rogers RL, Chissom BS. Derivation of new readability formulas (Automated Readability Index, Fog Count, and Flesch Reading Ease Formula) for Navy enlisted personnel. Research Branch report 8-75. Memphis: Naval Air Station, 1975.

  22. 22

    Doak CC, Doak LG, Root JH. Teaching patients with low literacy skills. 2nd ed. Philadelphia: J.B. Lippincott, 1996.

  23. 23

    Hammerschmidt DE, Keane MA. Institutional Review Board (IRB) review lacks impact on the readability of consent forms for research. Am J Med Sci 1992;304:348-351
    CrossRef | Web of Science | Medline

  24. 24

    Young DR, Hooker DT, Freeberg FE. Informed consent documents: increasing comprehension by reducing reading level. IRB 1990;12:1-5
    CrossRef | Medline

  25. 25

    Grossman SA, Piantadosi S, Covahey C. Are informed consent forms that describe clinical oncology research protocols readable by most patients and their families? J Clin Oncol 1994;12:2211-2215
    Web of Science | Medline

  26. 26

    White LJ, Jones JS, Felton CW, Pool LC. Informed consent for medical research: common discrepancies and readability. Acad Emerg Med 1996;3:745-750
    CrossRef | Web of Science | Medline

  27. 27

    Bjorn E, Rossel P, Holm S. Can the written information to research subjects be improved? An empirical study. J Med Ethics 1999;25:263-267
    CrossRef | Web of Science | Medline

  28. 28

    Philipson SJ, Doyle MA, Gabram SG, Nightingale C, Philipson EH. Informed consent for research: a study to evaluate readability and processability to effect change. J Investig Med 1995;43:459-467
    Web of Science | Medline

  29. 29

    Taylor KM, Bezjak A, Hunter R, Fraser S. Informed consent for clinical trials: is simpler better? J Natl Cancer Inst 1998;90:644-645
    CrossRef | Web of Science | Medline

  30. 30

    Taylor HA. Barriers to informed consent. Semin Oncol Nurs 1999;15:89-95
    CrossRef | Medline

  31. 31

    Davis TC, Holcombe RF, Berkel HJ, Pramanik S, Divers SG. Informed consent for clinical trials: a comparative study of standard versus simplified forms. J Natl Cancer Inst 1998;90:668-674
    CrossRef | Web of Science | Medline

  32. 32

    Raich PC, Plomer KD, Coyne CA. Literacy, comprehension, and informed consent in clinical research. Cancer Invest 2001;19:437-445
    CrossRef | Web of Science | Medline

  33. 33

    Jimison HB, Sher PP, Appleyard R, LeVernois Y. The use of multimedia in the informed consent process. J Am Med Inform Assoc 1998;5:245-256
    CrossRef | Web of Science | Medline

  34. 34

    Doak CC, Doak LG, Friedell GH, Meade CD. Improving comprehension for cancer patients with low literacy skills: strategies for clinicians. CA Cancer J Clin 1998;48:151-162
    CrossRef | Web of Science | Medline

  35. 35

    Heinze-Lacey B, Saunders C, Sugar A. Improving the readability of informed consent documents. IRB 1993;15:10-11
    CrossRef | Medline

  36. 36

    Meade CD, Howser DM. Consent forms: how to determine and improve their readability. Oncol Nurs Forum 1992;19:1523-1528
    Medline

  37. 37

    Peterson BT, Clancy SJ, Champion K, McLarty JW. Improving readability of consent forms: what the computers may not tell you. IRB 1992;14:6-8
    CrossRef | Medline

  38. 38

    Barbour GL, Blumenkrantz MJ. Videotape aids informed consent decision. JAMA 1978;240:2741-2742
    CrossRef | Web of Science | Medline

  39. 39

    Padberg RM, Flach J. National efforts to improve the informed consent process. Semin Oncol Nurs 1999;15:138-144
    CrossRef | Medline

  40. 40

    Lehmann LS, Brancati FL, Chen M-C, Roter D, Dobs AS. The effect of bedside case presentations on patients' perceptions of their medical care. N Engl J Med 1997;336:1150-1155
    Full Text | Web of Science | Medline

Citing Articles (99)

Citing Articles

  1. 1

    David Wright. (2012) Redesigning Informed Consent Tools for Specific Research. Technical Communication Quarterly 21:2, 145-167
    CrossRef

  2. 2

    N. J. Reavley, A. J. Mackinnon, A. J. Morgan, M. Alvarez-Jimenez, S. E. Hetrick, E. Killackey, B. Nelson, R. Purcell, M. B. H. Yap, A. F. Jorm. (2011) Quality of information sources about mental disorders: a comparison of Wikipedia with centrally controlled web and printed sources. Psychological Medicine1-10
    CrossRef

  3. 3

    GEORGE SILBERMAN, KATHERINE L. KAHN. (2011) Burdens on Research Imposed by Institutional Review Boards: The State of the Evidence and Its Implications for Regulatory Reform. Milbank Quarterly 89:4, 599-627
    CrossRef

  4. 4

    Nancy E. Kass, Lelia Chaisson, Holly A. Taylor, Jennifer Lohse. (2011) Length and Complexity of US and International HIV Consent Forms from Federal HIV Network Trials. Journal of General Internal Medicine 26:11, 1324-1328
    CrossRef

  5. 5

    A. Arora, S. Rajagopalan, N. Shafiq, P. Pandhi, A. Bhalla, D.P. Dhibar, S. Malhotra. (2011) Development of tool for the assessment of comprehension of informed consent form in healthy volunteers participating in first-in-human studies. Contemporary Clinical Trials 32:6, 814-817
    CrossRef

  6. 6

    (2011) Department of Health and Human Services. Biotechnology Law Report111101130709004
    CrossRef

  7. 7

    Nikolaos Korfiatis, Elena García-Bariocanal, Salvador Sánchez–Alonso. (2011) Evaluating content quality and helpfulnessof online product reviews: The interplay of review helpfulness vs.review content. Electronic Commerce Research and Applications
    CrossRef

  8. 8

    Nan Hu, Indranil Bose, Noi Sian Koh, Ling Liu. (2011) Manipulation of online reviews: An analysis of ratings, readability, and sentiments. Decision Support Systems
    CrossRef

  9. 9

    Enrique M. San Norberto, James Taylor, Roberto Salvador, Álvaro Revilla, Borja Merino, Carlos Vaquero. (2011) The Quality of Information Available on the Internet About Aortic Aneurysm and Its Endovascular Treatment. Revista Española de Cardiología (English Edition) 64:10, 869-875
    CrossRef

  10. 10

    David-Jan Jansen. (2011) Mumbling with great incoherence: Was it really so difficult to understand Alan Greenspan?. Economics Letters 113:1, 70-72
    CrossRef

  11. 11

    Krista Davis, C. Lindsay Fitzsimmons, Timothy E. Moore. (2011) Improving the Comprehensibility of a Canadian Police Caution on the Right to Silence. Journal of Police and Criminal Psychology 26:2, 87-99
    CrossRef

  12. 12

    DAVID-JAN JANSEN. (2011) DOES THE CLARITY OF CENTRAL BANK COMMUNICATION AFFECT VOLATILITY IN FINANCIAL MARKETS? EVIDENCE FROM HUMPHREY-HAWKINS TESTIMONIES. Contemporary Economic Policy 29:4, 494-509
    CrossRef

  13. 13

    Enrique M. San Norberto, James Taylor, Roberto Salvador, Álvaro Revilla, Borja Merino, Carlos Vaquero. (2011) Calidad de la información disponible en internet sobre el aneurisma de aorta y su tratamiento endovascular. Revista Española de Cardiología 64:10, 869-875
    CrossRef

  14. 14

    Cynthia J. Vaughn, Sandy Oelschlegel, Eric Heidel, C. Brooke Caldwell, Lorraine S. Wallace. (2011) Reading Demands of Commercial Patient Educational Materials. Journal of Consumer Health On the Internet 15:4, 305-312
    CrossRef

  15. 15

    Emanuel, Ezekiel J., Menikoff, Jerry, . (2011) Reforming the Regulations Governing Research with Human Subjects. New England Journal of Medicine 365:12, 1145-1150
    Full Text

  16. 16

    Lianna R. Lipton, Nanette Santoro, Hugh Taylor, Neiha Kidwai, Barbara Isaac, Maureen Magnani, Lubna Pal. (2011) Assessing comprehension of clinical research. Contemporary Clinical Trials 32:5, 608-613
    CrossRef

  17. 17

    , Amy L. Corneli, James R. Sorenson, Margaret E. Bentley, Gail E. Henderson, J. Michael Bowling, Jacqueline Nkhoma, Agnes Moses, Cynthia Zulu, James Chilima, Yusuf Ahmed, Charles M. Heilig, Denise J. Jamieson, Charles Horst. (2011) Improving Participant Understanding of Informed Consent in an HIV-Prevention Clinical Trial: A Comparison of Methods. AIDS and Behavior
    CrossRef

  18. 18

    M. H. Ditmore, D. Allman. (2011) 'Who is Helsinki?' Sex workers advise improving communication for good participatory practice in clinical trials. Health Education Research 26:3, 466-475
    CrossRef

  19. 19

    R. I. Lindley. (2011) Drug Trials for Older People. The Journals of Gerontology Series A: Biological Sciences and Medical Sciences
    CrossRef

  20. 20

    Elisa J. Gordon, Ashley Bergeron, Gwen McNatt, John Friedewald, Michael M. Abecassis, Michael S. Wolf. (2011) Are informed consent forms for organ transplantation and donation too difficult to read?. Clinical Transplantationno-no
    CrossRef

  21. 21

    Julie S. Hansen, Lorraine S. Wallace, Jennifer E. DeVoe. (2011) How Readable are Spanish-Language Medicaid Applications?. Journal of Immigrant and Minority Health 13:2, 293-298
    CrossRef

  22. 22

    Erin N. Marcus, Lee M. Sanders, Margaret Pereyra, Yanisa Del Toro, Ada Pat Romilly, Monica Yepes, Monica Webb Hooper, Beth A. Jones. (2011) Mammography Result Notification Letters: Are They Easy to Read and Understand?. Journal of Women's Health 20:4, 545-551
    CrossRef

  23. 23

    Henry Silverman. (2011) Protecting Vulnerable Research Subjects in Critical Care Trials: Enhancing the Informed Consent Process and Recommendations for Safeguards. Annals of Intensive Care 1:1, 8
    CrossRef

  24. 24

    Peter Knapp, David K Raynor, Jonathan Silcock, Brian Parkinson. (2011) Can user testing of a clinical trial patient information sheet make it fit-for-purpose? - a randomized controlled trial. BMC Medicine 9:1, 89
    CrossRef

  25. 25

    Brianna Hoffner, Susan Bauer-Wu, Suzanne Hitchcock-Bryan, Mark Powell, Andrew Wolanski, Steven Joffe. (2011) “Entering a clinical trial: Is it right for you?”. Cancern/a-n/a
    CrossRef

  26. 26

    Martine C de Vries, Mirjam Houtlosser, Jan M Wit, Dirk P Engberts, Dorine Bresters, Gertjan L Kaspers, Evert van Leeuwen. (2011) Ethical issues at the interface of clinical care and research practice in pediatric oncology: a narrative review of parents' and physicians' experiences. BMC Medical Ethics 12:1, 18
    CrossRef

  27. 27

    V Jenkins, D Farewell, L Batt, T Maughan, L Branston, C Langridge, L Parlour, V Farewell, L Fallowfield. (2010) The attitudes of 1066 patients with cancer towards participation in randomised clinical trials. British Journal of Cancer 103:12, 1801-1807
    CrossRef

  28. 28

    Carol A. Heimer, JuLeigh Petty. (2010) Bureaucratic Ethics: IRBs and the Legal Regulation of Human Subjects Research. Annual Review of Law and Social Science 6:1, 601-626
    CrossRef

  29. 29

    J. M. L. Williamson, A. G. Martin. (2010) Analysis of patient information leaflets provided by a district general hospital by the Flesch and Flesch-Kincaid method. International Journal of Clinical Practice 64:13, 1824-1831
    CrossRef

  30. 30

    Abass Sheikhtaheri, Mehrdad Farzandipour. (2010) Factors Associated with Quality of Informed Consent in Patients Admitted for Surgery: An Iranian Study. AJOB Primary Research 1:4, 9-16
    CrossRef

  31. 31

    R. Dal-Ré, I. Luque-Montoro, E. Morejón-Bosch. (2010) Legibilidad de la hoja de información para el paciente tras su revisión por los comités éticos de investigación clínica. Revista Clínica Española 210:10, 529-530
    CrossRef

  32. 32

    Christopher Thomas Scott, Mindy C. DeRouen, LaVera M. Crawley. (2010) The Language of Hope: Therapeutic Intent in Stem-Cell Clinical Trials. AJOB Primary Research 1:3, 4-11
    CrossRef

  33. 33

    Savyasachi C. Thakkar, Frank J. Frassica, Simon C. Mears. (2010) Accuracy, Legibility, and Content of Consent Forms for Hip Fracture Repair in a Teaching Hospital. Journal of Patient Safety 6:3, 153-157
    CrossRef

  34. 34

    Laura D. Buccini, Donald Iverson, Peter Caputi, Caroline Jones. (2010) An Australian Based Study on the Readability of HIV/AIDS and Type 2 Diabetes Clinical Trial Informed Consent Documents. Journal of Bioethical Inquiry 7:3, 313-319
    CrossRef

  35. 35

    Laura M. Beskow, Joëlle Y. Friedman, N. Chantelle Hardy, Li Lin, Kevin P. Weinfurt. (2010) Simplifying informed consent for biorepositories: Stakeholder perspectives. Genetics in Medicine 12:9, 567-572
    CrossRef

  36. 36

    Dharma E. Cortés, Mari-Lynn Drainoni, Lori E. Henault, Michael K. Paasche-Orlow. (2010) How to Achieve Informed Consent for Research from Spanish-Speaking Individuals with Low Literacy: A Qualitative Report. Journal of Health Communication 15:sup2, 172-182
    CrossRef

  37. 37

    Winson Y. Cheung, Gregory R. Pond, Ronald J. Heslegrave, Katherine Enright, Larissa Potanina, Lillian L. Siu. (2010) The Contents and Readability of Informed Consent Forms for Oncology Clinical Trials. American Journal of Clinical Oncology 33:4, 387-392
    CrossRef

  38. 38

    Wouter K. G. Leclercq, Bram J. Keulers, Marc R. M. Scheltinga, Paul H. M. Spauwen, Gert-Jan Wilt. (2010) A Review of Surgical Informed Consent: Past, Present, and Future. A Quest to Help Patients Make Better Decisions. World Journal of Surgery 34:7, 1406-1415
    CrossRef

  39. 39

    Paul S. Appelbaum. (2010) Understanding “Understanding”: An Important Step Toward Improving Informed Consent to Research. AJOB Primary Research 1:2, 1-3
    CrossRef

  40. 40

    Joaquín Borrás-Blasco, Andrés Navarro-Ruiz, Consuelo Borrás. 2010. Emergency Clinical Trials. .
    CrossRef

  41. 41

    Helena Länsimies-Antikainen, Tomi Laitinen, Rainer Rauramaa, Anna-Maija Pietilä. (2010) Evaluation of informed consent in health research: a questionnaire survey. Scandinavian Journal of Caring Sciences 24:1, 56-64
    CrossRef

  42. 42

    S L Todhunter, P J Clamp, S Gillett, D D Pothier. (2010) Readability of out-patient letters copied to patients: can patients understand what is written about them?. The Journal of Laryngology & Otology 124:03, 324
    CrossRef

  43. 43

    Bernard Ravina, Lisa Deuel, Andrew Siderowf, E. Ray Dorsey. (2010) Local institutional review board (IRB) review of a multicenter trial: Local costs without local context. Annals of Neurology 67:2, 258-260
    CrossRef

  44. 44

    J. M. L. Williamson, A. G. Martin. (2010) Assessing the readability statistics of national consent forms in the UK. International Journal of Clinical Practice 64:3, 322-329
    CrossRef

  45. 45

    Charles Philip Gabel, Lori A. Michener, Markus Melloh, Brendan Burkett. (2010) Modification of the Upper Limb Functional Index to a Three-point Response Improves Clinimetric Properties. Journal of Hand Therapy 23:1, 41-52
    CrossRef

  46. 46

    Scott A. Hrnack, Shelbi P. Elmore, George W. Brindley. (2009) Literacy and Patient Information in the Amputee Population. JPO Journal of Prosthetics and Orthotics 21:4, 223-226
    CrossRef

  47. 47

    Marilyn J. Goske, Dorothy Bulas. (2009) Improving health literacy: informed decision-making rather than informed consent for CT scans in children. Pediatric Radiology 39:9, 901-903
    CrossRef

  48. 48

    Jessica R. Ridpath, Cheryl J. Wiese, Sarah M. Greene. (2009) Looking at Research Consent Forms Through a Participant-Centered Lens: The PRISM Readability Toolkit. American Journal of Health Promotion 23:6, 371-375
    CrossRef

  49. 49

    Timothy W. Bickmore, Laura M. Pfeifer, Michael K. Paasche-Orlow. (2009) Using computer agents to explain medical documents to patients with low health literacy. Patient Education and Counseling 75:3, 315-320
    CrossRef

  50. 50

    James M. Wilson. (2009) Lessons learned from the gene therapy trial for ornithine transcarbamylase deficiency. Molecular Genetics and Metabolism 96:4, 151-157
    CrossRef

  51. 51

    Michael K. Paasche-Orlow, Dan M. Jacob, Mark Hochhauser, Ruth M. Parker. (2009) National Survey of Patients’ Bill of Rights Statutes. Journal of General Internal Medicine 24:4, 489-494
    CrossRef

  52. 52

    David B. Resnik. (2009) Do informed consent documents matter?. Contemporary Clinical Trials 30:2, 114-115
    CrossRef

  53. 53

    Randi Shedlosky-Shoemaker, Amy Curry Sturm, Muniba Saleem, Kimberly M. Kelly. (2009) Tools for Assessing Readability and Quality of Health-Related Web Sites. Journal of Genetic Counseling 18:1, 49-59
    CrossRef

  54. 54

    Markus Weih, Angelika Reinhold, Tanja Richter-Schmidinger, Anne-Kathrin Sulimma, Harald Klein, Johannes Kornhuber. (2008) Unsuitable readability levels of patient information pertaining to dementia and related diseases: a comparative analysis. International Psychogeriatrics 20:06, 1116
    CrossRef

  55. 55

    Richard D. Jackson, George J. Eckert. (2008) Health Literacy in an Adult Dental Research Population: A Pilot Study. Journal of Public Health Dentistry 68:4, 196-200
    CrossRef

  56. 56

    Steven Walfish, Katherine Pinholster. (2008) Reading Level of Overeaters Anonymous Primary Educational Material. Eating Disorders 16:3, 212-216
    CrossRef

  57. 57

    Michael Jefford, Rosemary Moore. (2008) Improvement of informed consent and the quality of consent documents. The Lancet Oncology 9:5, 485-493
    CrossRef

  58. 58

    Catherine A. Marco. (2008) Impact of Detailed Informed Consent on Research Subjects’ Participation: A Prospective, Randomized Trial. The Journal of Emergency Medicine 34:3, 269-275
    CrossRef

  59. 59

    Bryn Williams-Jones, Chris MacDonald. (2008) Conflict of Interest Policies at Canadian Universities: Clarity and Content. Journal of Academic Ethics 6:1, 79-90
    CrossRef

  60. 60

    Lorah D. Dorn. 2008. Adolescent Participation in Research. , 48-55.
    CrossRef

  61. 61

    Benjamin Wilfond. (2007) Ethical Considerations About Observational Research in Children. The Journal of Trauma: Injury, Infection, and Critical Care 63:Supplement, S146-S151
    CrossRef

  62. 62

    Angelo E. Volandes, Michael K. Paasche-Orlow. (2007) Health Literacy, Health Inequality and a Just Healthcare System. The American Journal of Bioethics 7:11, 5-10
    CrossRef

  63. 63

    Yael Schenker, Frances Wang, Sarah Jane Selig, Rita Ng, Alicia Fernandez. (2007) The Impact of Language Barriers on Documentation of Informed Consent at a Hospital with On-Site Interpreter Services. Journal of General Internal Medicine 22:S2, 294-299
    CrossRef

  64. 64

    Ana M. Bertoli, Ingrid Strusberg, Gonzalo A. Fierro, Mariela Ramos, Alberto M. Strusberg. (2007) Lack of correlation between satisfaction and knowledge in clinical trials participants: A pilot study. Contemporary Clinical Trials 28:6, 730-736
    CrossRef

  65. 65

    Kellie E Carlyle, Kenneth J. Steinman. (2007) Demographic Differences in the Prevalence, Co-Occurrence, and Correlates of Adolescent Bullying at School. Journal of School Health 77:9, 623-629
    CrossRef

  66. 66

    Steven E. Roskos, Amy J. Keenum, Lindsay M. Newman, Lorraine S. Wallace. (2007) Literacy Demands and Formatting Characteristics of Opioid Contracts in Chronic Nonmalignant Pain Management. The Journal of Pain 8:10, 753-758
    CrossRef

  67. 67

    Lorraine S. Wallace, Amy J. Keenum, Steven E. Roskos, Kelly S. McDaniel. (2007) Development and Validation of a Low-Literacy Opioid Contract. The Journal of Pain 8:10, 759-766
    CrossRef

  68. 68

    C. M. Obermeyer, M. Osborn. (2007) The Utilization of Testing and Counseling for HIV: A Review of the Social and Behavioral Evidence. American Journal of Public Health 97:10, 1762-1774
    CrossRef

  69. 69

    Adeline Paris, Daniel Nogueira da Gama Chaves, Catherine Cornu, Patrick Maison, Muriel Salvat-Mélis, Christophe Ribuot, Christian Brandt, Jean-Luc Bosson, Marc Hommel, Jean-Luc Cracowski. (2007) Improvement of the comprehension of written information given to healthy volunteers in biomedical research: a single-blind randomized controlled study. Fundamental & Clinical Pharmacology 21:2, 207-214
    CrossRef

  70. 70

    Nikki B. Zite, Sandra J. Philipson, Lorraine S. Wallace. (2007) Consent to Sterilization section of the Medicaid-Title XIX form: is it understandable?. Contraception 75:4, 256-260
    CrossRef

  71. 71

    Richard Rogers, Kimberly S. Harrison, Daniel W. Shuman, Kenneth W. Sewell, Lisa L. Hazelwood. (2007) An Analysis of Miranda Warnings and Waivers: Comprehension and Coverage. Law and Human Behavior 31:2, 177-192
    CrossRef

  72. 72

    Jonathan Bergman, Ramdev Konijeti, Steven E. Lerman. (2007) Myelomeningocele Information on the Internet is Accessible and of Variable Quality, and Requires a High Reading Level. The Journal of Urology 177:3, 1138-1142
    CrossRef

  73. 73

    Peter Breese, Cornelis Rietmeijer, William Burman. (2007) Content Among Locally Approved HIPAA Authorization forms for Research. Journal of Empirical Research on Human Research Ethics 2:1, 43-46
    CrossRef

  74. 74

    D.L. MANNING, C. DICKENS. (2006) Health literacy: more choice, but do cancer patients have the skills to decide?. European Journal of Cancer Care 15:5, 448-452
    CrossRef

  75. 75

    Rebecca L. Sudore, C. Seth Landefeld, Brie A. Williams, Deborah E. Barnes, Karla Lindquist, Dean Schillinger. (2006) Use of a Modified Informed Consent Process among Vulnerable Patients: A Descriptive Study. Journal of General Internal Medicine 21:8, 867-873
    CrossRef

  76. 76

    Lisa T. Eyler, Dilip V. Jeste. (2006) Enhancing the informed consent process: a conceptual overview. Behavioral Sciences & the Law 24:4, 553-568
    CrossRef

  77. 77

    Nicasio Marín-Gámez, María de los Ángeles López-Salido, Antonia Belén Márquez-Garcí, José Antonio Trujillo-Pérez, Francisco Jódar-Morente, Mónica Rodríguez-Galdeano. (2006) El efecto Fausto: sobre la legibilidad y comprensión de los informes clínicos de alta hospitalaria. Revista Española de Geriatría y Gerontología 41:4, 245-248
    CrossRef

  78. 78

    Barbara Curbow, Linda A. Fogarty, Karen A. McDonnell, Julia Chill, Lisa Benz Scott. (2006) The Role of Physician Characteristics in Clinical Trial Acceptance: Testing Pathways of Influence. Journal of Health Communication 11:2, 199-218
    CrossRef

  79. 79

    Paula C. Barata, Enza Gucciardi, Farah Ahmad, Donna E. Stewart. (2006) Cross-cultural perspectives on research participation and informed consent. Social Science & Medicine 62:2, 479-490
    CrossRef

  80. 80

    &NA;. (2006) 10. INFORMED CONSENT. Journal of Infusion Nursing 29:Supplement, S18-S19
    CrossRef

  81. 81

    Nedal H. Arar, Helen Hazuda, Rebecca Steinbach, Mazen Y. Arar, Hanna E. Abboud. (2005) Ethical Issues Associated with Conducting Genetic Family Studies of Complex Disease. Annals of Epidemiology 15:9, 712-719
    CrossRef

  82. 82

    Alla Keselman, Laura Slaughter, Vimla L. Patel. (2005) Toward a framework for understanding lay public’s comprehension of disaster and bioterrorism information. Journal of Biomedical Informatics 38:4, 331-344
    CrossRef

  83. 83

    Michael J. Rossi, Dan Guttmann, Megan J. MacLennan, James H. Lubowitz. (2005) Video Informed Consent Improves Knee Arthroscopy Patient Comprehension. Arthroscopy: The Journal of Arthroscopic & Related Surgery 21:6, 739-743
    CrossRef

  84. 84

    Adeline Paris, Jean-Luc Cracowski, Patrick Maison, Anca Radauceanu, Catherine Cornu, Marc Hommel. (2005) Impact of French 'Comites de Protection des Personnes' on the readability of informed consent documents (ICD) in biomedical research: more information, but not better information. Fundamental and Clinical Pharmacology 19:3, 395-399
    CrossRef

  85. 85

    Nancy Cotugna, Connie E. Vickery, Kara M. Carpenter-Haefele. (2005) EVALUATION OF LITERACY LEVEL OF PATIENT EDUCATION PAGES IN HEALTH-RELATED JOURNALS. Journal of Community Health 30:3, 213-219
    CrossRef

  86. 86

    Henry J. Silverman, John M. Luce, Paul N. Lanken, Alan H. Morris, Andrea L. Harabin, Cathryn F. Oldmixon, B Taylor Thompson, Gordon R. Bernard. (2005) Recommendations for informed consent forms for critical care clinical trials*. Critical Care Medicine 33:4, 867-882
    CrossRef

  87. 87

    Didier Dreyfuss. (2005) Is it better to consent to an RCT or to care?. Intensive Care Medicine 31:3, 345-355
    CrossRef

  88. 88

    Michael K. Paasche-Orlow, Frederick L. Brancati. (2005) Assessment of medical school institutional review board policies regarding compensation of subjects for research-related injury. The American Journal of Medicine 118:2, 175-180
    CrossRef

  89. 89

    N. Marín-Gámez, B. Cervantes-Bonet, J.A. Montes-Romero, M. Rodríguez-Galdeano, J. Gámir-Ruiz, H. Kessel-Sardiñas. (2005) El pronóstico: la «caja negra» de la medicina clínica. Revista Española de Geriatría y Gerontología 40:1, 44-46
    CrossRef

  90. 90

    Maurie Markman. (2005) Reflections on Ethical Concerns Arising from the Incorporation of Results of Randomized Trials of Antineoplastic Therapy into Routine Clinical Practice. Cancer Investigation 23:8, 735-740
    CrossRef

  91. 91

    S Michael Sharp. (2004) Consent Documents for Oncology Trials: Does Anybody Read These Things?. American Journal of Clinical Oncology 27:6, 570-575
    CrossRef

  92. 92

    Andrea Akkad, Clare Jackson, Sara Kenyon, Mary Dixon-Woods, Nick Taub, Marwan Habiba. (2004) Informed consent for elective and emergency surgery: questionnaire study. BJOG: An International Journal of Obstetrics and Gynaecology 111:10, 1133-1138
    CrossRef

  93. 93

    , Terri A. Schmidt, David Salo, Jason A. Hughes, Jean T. Abbott, Joel M. Geiderman, Catherine X. Johnson, Katie B. McClure, Mary Pat McKay, Junaid A. Razzak, Raquel M. Schears, Robert C. Solomon. (2004) Confronting the Ethical Challenges to Informed Consent in Emergency Medicine Research. Academic Emergency Medicine 11:10, 1082-1089
    CrossRef

  94. 94

    Christine L. Roberts, Carolyn A. Cameron, Natasha Nassar, Camille H. Raynes-Greenow. (2004) A simple patient-initiated intervention to increase antenatal detection of breech presentation at term. Paediatric and Perinatal Epidemiology 18:5, 371-376
    CrossRef

  95. 95

    Frances A Campbell, Barbara D Goldman, Maria L Boccia, Martie Skinner. (2004) The effect of format modifications and reading comprehension on recall of informed consent information by low-income parents: a comparison of print, video, and computer-based presentations. Patient Education and Counseling 53:2, 205-216
    CrossRef

  96. 96

    Mehret S Birru, Richard A Steinman. (2004) Online Health Information and Low-Literacy African Americans. Journal of Medical Internet Research 6:3, e26
    CrossRef

  97. 97

    Mehret S Birru, Valerie M Monaco, Lonelyss Charles, Hadiya Drew, Valerie Njie, Timothy Bierria, Ellen Detlefsen, Richard A Steinman. (2004) Internet Usage by Low-Literacy Adults Seeking Health Information: An Observational Analysis. Journal of Medical Internet Research 6:3, e25
    CrossRef

  98. 98

    Lynne Roberts, David Indermaur. (2003) Signed Consent Forms in Criminological Research: Protection for Researchers and Ethics Committees but a Threat to Research Participants?. Psychiatry, Psychology and Law 10:2, 289-299
    CrossRef

  99. 99

    (2003) Readability of Informed-Consent Forms. New England Journal of Medicine 348:22, 2262-2263
    Full Text

Letters