Join the 200th Anniversary Celebration

Special Article

Effects of Pay for Performance on the Quality of Primary Care in England

Stephen M. Campbell, Ph.D., David Reeves, Ph.D., Evangelos Kontopantelis, Ph.D., Bonnie Sibbald, Ph.D., and Martin Roland, D.M.

N Engl J Med 2009; 361:368-378July 23, 2009

Abstract

Background

A pay-for-performance scheme based on meeting targets for the quality of clinical care was introduced to family practice in England in 2004.

Methods

We conducted an interrupted time-series analysis of the quality of care in 42 representative family practices, with data collected at two time points before implementation of the scheme (1998 and 2003) and at two time points after implementation (2005 and 2007). At each time point, data on the care of patients with asthma, diabetes, or coronary heart disease were extracted from medical records; data on patients' perceptions of access to care, continuity of care, and interpersonal aspects of care were collected from questionnaires. The analysis included aspects of care that were and those that were not associated with incentives.

Results

Between 2003 and 2005, the rate of improvement in the quality of care increased for asthma and diabetes (P<0.001) but not for heart disease. By 2007, the rate of improvement had slowed for all three conditions (P<0.001), and the quality of those aspects of care that were not associated with an incentive had declined for patients with asthma or heart disease. As compared with the period before the pay-for-performance scheme was introduced, the improvement rate after 2005 was unchanged for asthma or diabetes and was reduced for heart disease (P=0.02). No significant changes were seen in patients' reports on access to care or on interpersonal aspects of care. The level of the continuity of care, which had been constant, showed a reduction immediately after the introduction of the pay-for-performance scheme (P<0.001) and then continued at that reduced level.

Conclusions

Against a background of increases in the quality of care before the pay-for-performance scheme was introduced, the scheme accelerated improvements in quality for two of three chronic conditions in the short term. However, once targets were reached, the improvement in the quality of care for patients with these conditions slowed, and the quality of care declined for two conditions that had not been linked to incentives. Continuity of care was reduced after the introduction of the scheme.

Media in This Article

Figure 1Mean Scores for the Quality of Care at the Practice Level, 1998–2007.
Figure 2Mean Scores for Clinical Quality at the Practice Level for Aspects of Care for Coronary Heart Disease, Asthma, and Type 2 Diabetes That Were Linked with Incentives and Aspects of Care That Were Not Linked with Incentives, 1998–2007.
Article

In 2004, the U.K. government introduced a pay-for-performance scheme with 136 indicators for family practices. The indicators covered the management of chronic disease, practice organization, and patients' experiences with respect to care.1 In 2006, revisions to the scheme added seven new clinical areas, including dementia and chronic kidney disease, and two new indicators of patient access to care (see the Supplementary Appendix, available with the full text of this article at NEJM.org).2 Payments make up approximately 25% of family practitioners' income, and 99.6% of family practitioners participated in the pay-for-performance scheme, which is voluntary.

We have previously reported on the quality of clinical care in 2005, the year after the pay-for-performance scheme was introduced.3 We found a modest acceleration in the rate of improvement in the quality of care for asthma and diabetes but not for heart disease. There had been rapid improvement in the quality of care for all three conditions before the introduction of pay for performance. This article extends these analyses to include performance data in 2007. We used an interrupted time-series analysis to examine trends in the quality of clinical care from 1998 through 2007, a period spanning the introduction of pay for performance. We also report on trends in patient reports on communication with their physician, on access to care, and on continuity of care across the same period.

Methods

Data Collection

Trained research staff abstracted clinical data from the medical records kept by 42 nationally representative family practices. In each practice, data were collected for nonoverlapping random samples of patients (20 in 1998 and 12 each in 2003, 2005, and 2007) who had heart disease, asthma, or diabetes; the data were collected with the use of quality indicators.4,5 The methods used to collect data in 2007 were consistent with the methods used in 1998, 2003, and 2005.3

For patient evaluation, a version of the General Practice Assessment Questionnaire (www.gpaq.info) was mailed, with one follow-up reminder, to a random sample of 200 registered adult patients (age, ≥18 years) in each practice.6,7 Rapid access to any doctor within 48 hours was associated with an incentive under the pay-for-performance scheme, and our questionnaire included two items addressing the patient's ability to get an appointment within 48 hours with “any doctor” and with “a particular doctor.” Because of concern that the scheme's focus on clinical indicators might lead practitioners to neglect other aspects of care,8 we also analyzed communication with physicians and continuity of care. Communication was assessed by asking seven questions, with the answers scored on a six-point scale ranging from “very poor” to “excellent”; continuity of care was assessed with the use of the same six-point scale and a single question: “How often do you see your usual doctor?” All scores were rescaled to range from 0 to 100. The rate of response to the survey was 38% in 1998, 47% in 2003, 45% in 2005, and 38% in 2007. In all cases, higher scores indicate higher quality of care. The research protocol was approved by the North West Research Ethics Committee.

Statistical Analysis

As we had done previously,3,9,10 we computed an overall clinical quality score for each patient in 1998, 2003, 2005, and 2007, which was based on the number of indicators for which appropriate care was provided, divided by the number of indicators relevant to that patient. This score represents the percentage, from 0 to 100%, of “necessary” or “indicated” care provided to the patient. Practice-level quality scores were computed as the mean of individual patient scores in each practice. We computed separate quality scores for the subgroups of indicators that were assigned incentives under the pay-for-performance scheme and for the subgroups that were not assigned incentives.

Data on quality of care had been collected in the same practices in 1998.9 When a pay-for-performance scheme was announced for commencement in 2004, we designed an interrupted time-series study whereby data on quality of care would be collected at two points before the scheme was introduced (1998 and 2003) and at two points after its introduction (2005 and 2007). We use the term “pre-introduction period” to refer to the period from 1998 through 2003, “introduction period” for 2003 through 2005 (from the year before to the year after the implementation of pay for performance), and “post-introduction period” for 2005 through 2007.

We analyzed the data as an interrupted, or segmented, time series. In this model, the within-practice variation was partitioned into three main components to provide independent tests of the slope in scores for the pre-introduction period (test 1); the change in level during the introduction period, allowing for the trend before pay for performance (test 2); and the change in slope from before to after pay for performance (test 3).11 Practice was treated as a random effect, and robust standard-error estimates were used (see the Supplementary Appendix).

The analysis for each outcome measure was conducted in two steps. In step 1, we used the interrupted time-series analysis to look for evidence that pay for performance was having an effect on the trend in scores over time, as indicated by a statistically significant result with respect to either the change in level or the change in slope (tests 2 and 3). The results of these tests determined step 2: if the results of neither test were significant, there was no evidence that pay for performance had affected the preexisting trend and we conducted no further analyses; if the results of either test were significant, there was evidence of an effect and we investigated this further by using the coefficients from the time-series analysis to compare the immediate- and long-term effects of the scheme (i.e., compare the slope during the introduction period with the slope during the post-introduction period) and to estimate the size of the effect on mean quality scores in 2005 and 2007.

We compared the trends in quality scores for the subgroups of indicators associated with incentives and indicators not associated with incentives by means of interactions between indicator set and the changes in level and slope (as defined above) within a regression analysis. If either interaction was significant, we took this as evidence that the trends varied by indicator set and next tested the interaction between indicator set and the change in slope from the introduction period to the post-introduction period.

The quality scores based on medical records and those based on patient evaluation are subject to ceilings of 100%, and many practices achieved this level on at least one indicator. The ceiling necessarily limits any linear trend in improvement, since a score on quality cannot exceed 100%. Analyses were therefore conducted on scores transformed to a logit scale, which has no ceiling, as described previously.3 The transformation increases the weight given to score changes near the ceiling or floor — for example, score changes from 97 to 98% and from 55 to 65% are numerically equivalent (0.41) after transformation. However, where possible, results are re-expressed in original units to facilitate interpretation.

To assess the sensitivity of the findings to our statistical assumptions, we varied the method of statistical inference with the use of a bootstrap method, using 1000 bootstrap samples, and we assumed a linear model for the trend by repeating the analysis on untransformed scores (for details see the Supplementary Appendix). We report any results that differ from those of the primary analysis.

Results

Coronary Heart Disease

The quality of care for coronary heart disease had been improving before the pay-for-performance incentives were introduced (Table 1Table 1Mean Clinical-Quality Scores for 42 Family Practices in 1998, 2003, 2005, and 2007. and Table 2Table 2Summary of Interrupted Time-Series Analysis. and Figure 1Figure 1Mean Scores for the Quality of Care at the Practice Level, 1998–2007.). The rate of increase was equivalent to an average of 3.5% per annum from 1998 through 2003 (95% confidence interval [CI], 2.8 to 4.2; P<0.001). In 2005, after the introduction of pay for performance, scores on quality rose slightly, but not significantly, higher than expected, as compared with the trend before the introduction of pay for performance (P=0.06). Subsequently, the rate of improvement dropped below the improvement rates for both the pre-introduction period (P=0.02) and the introduction period (P=0.001), and the overall quality score in 2007 (84.8; 95% CI, 82.2 to 87.4) was similar to that in 2005 (85.0; 95% CI, 83.0 to 87.1) (Table 2 and Table 3Table 3Mean Clinical-Quality Scores in 1998, 2003, 2005, and 2007, According to Individual Clinical Indicators. and Figure 1).

Asthma

The quality of care for asthma was improving during the pre-introduction period, at an average rate of 2.0% per annum (95% CI, 0.9 to 3.1; P<0.001), and there was a significant change in the level of quality over and above this trend in 2005 (P<0.001) (Table 1 and Table 2 and Figure 1). However, this accelerated rate of increase was not maintained after 2005 (P=0.001). The trend after 2005 did not differ significantly from the trend before the introduction of pay for performance (P=0.16), although in absolute terms, overall quality hardly changed between 2005 (84.3; 95% CI, 80.6 to 88.1) and 2007 (85.0; 95% CI, 82.2 to 87.8) (Table 2 and Table 3 and Figure 1).

Diabetes

The quality of care for patients with diabetes was improving in the pre-introduction period, at an average rate of 1.8% per annum (95% CI, 1.1 to 2.4; P<0.001) (Table 2 and Table 3 and Figure 1). Diabetes care, like asthma care, showed a significant change in the level of improvement after the introduction of pay for performance that was well above the preexisting trend (P<0.001). As with asthma care, this accelerated rate of improvement was not maintained after 2005 (P<0.001); instead, the rate fell back to the pre-introduction level (P=0.91) (Table 2 and Table 3 and Figure 1).

Effect of Incentives on Quality Scores

Mean quality scores for aspects of care that were linked to incentives were higher than those for care that was not linked to incentives, and this pattern applied to all conditions at all four time points (Figure 2Figure 2Mean Scores for Clinical Quality at the Practice Level for Aspects of Care for Coronary Heart Disease, Asthma, and Type 2 Diabetes That Were Linked with Incentives and Aspects of Care That Were Not Linked with Incentives, 1998–2007.). Allowing for these overall differences, there were further differences over time in the scores for aspects of care that were linked to incentives as compared with those that were not. For heart disease, the scores for aspects of care that were linked to incentives showed a bigger immediate increase when the pay-for-performance system was introduced (P=0.05), although this trend was not significant as calculated in the linear model (P=0.46). The long-term trends (scores in the post-introduction period vs. scores in the pre-introduction period) did not differ significantly (P=0.06). However, the difference was significant when calculated with the use of the bootstrapping method (P=0.05) or the linear model (P=0.03), and in absolute terms, the mean quality score for aspects of care for heart disease that were not linked to incentives declined after 2005, whereas the quality score for care that was linked to incentives increased. For asthma, the immediate effect of pay for performance did not differ between care that was and care that was not linked with incentives (P=1.00), but the trends subsequently diverged (post-introduction period vs. pre-introduction period, P=0.006; post-introduction period vs. introduction period, P=0.05), with the mean score for care that was not linked to incentives declining after 2005, and the mean score for care that was linked to incentives increasing. Trends in diabetes care did not differ at any time according to whether the care was linked to incentives.

Communication, Waiting Times, and Continuity of Care

The percentages of patients able to see a physician within 48 hours, as well as the mean scores on the physician-communication scale, showed no significant changes in trend. Continuity of care declined significantly after the introduction of pay for performance (P<0.001) and remained at this lower level (Table 1 and Table 2 and Figure 2).

Estimated Overall Effect of Pay for Performance

For outcomes in which there was evidence that pay for performance altered the trend in quality improvement, we used coefficients from the interrupted time-series analysis to compute estimates of the increase in scores beyond that expected from the trend in the pre-introduction period (back-transforming the results from the logit analysis, with estimated 95% confidence limits). As compared with the expected level of improvement based on the pre-introduction trend, the pay-for-performance scheme was associated with an improvement in the quality of care for diabetes of 7.5 percentage points in 2005 (95% CI, 4.7 to 10.4) and 6.9 percentage points in 2007 (95% CI, 3.8 to 10.0). For asthma, the increase in quality potentially attributable to pay for performance was 9.4 percentage points in 2005 (95% CI, 3.9 to 15.0) and 5.5 percentage points in 2007 (95% CI, −1.0 to 12.1). For heart disease, pay for performance in 2005 was associated with a nonsignificant improvement in quality above the levels expected (2.8 percentage points; 95% CI, −0.1 to 5.8), and in 2007, it was associated with a nonsignificant reduction in quality from that expected (0.8 percentage points; 95% CI, −4.7 to 3.1). The results of patient evaluations of continuity of care were 4.1 percentage points lower than expected in 2005 (95% CI, −6.1 to −2.0) and 4.3 percentage points lower in 2007 (95% CI, −6.9 to −1.6).

Discussion

We previously found that there were improvements in some aspects of clinical care over and above the underlying trend after the introduction of a pay-for-performance scheme.3 Our current findings suggest that although these initial improvements were maintained, for two of the three conditions studied (heart disease and asthma), improvements in the quality of care reached a plateau a year after the scheme's introduction. Allowing for ceiling effects, care for diabetes continued to improve, but it did so at a rate equivalent to that of the rate in the pre-introduction period.

Within these overall trends for care, we found significant differences between aspects of care that were linked to incentives and aspects of care that were not linked to incentives. For asthma and heart disease, we found a significant difference in the effect of pay for performance on these two groups of quality indicators; for both conditions, mean quality scores for aspects of care that were not linked to incentives dropped between 2005 and 2007, whereas mean scores for aspects of care that were linked to incentives continued to increase. This widening gap in quality came on top of already lower levels of care for indicators not linked to incentives.

For all aspects of care — whether associated with incentives or not — and for all three conditions, rates of quality improvement slowed considerably after 2005. There are several possible explanations. The first is that near-maximal scores had been achieved. However, whereas achievement was high for some indicators (e.g., smoking status recorded for more than 98% of patients for all conditions), the logit transformation theoretically eliminates ceiling effects, and we observed the same plateau effect for indicators reflecting lower levels of achievement. A second explanation is that once initial gains had been made, subsequent gains were more difficult to achieve. A third explanation is that the structure of the pay-for-performance scheme did not reward further improvement once targets had been attained. This explanation is supported by the fact that family practices in our study gained, on average, 96.9% of available clinical-quality payment points in 2005 and 97.8% in 2007 (which were similar to the average gains of 97.1% and 97.5%, respectively, for all family practices in England12,13) — that is, there was little financial incentive for further improvement. A fourth explanation is that family practitioners had sufficient income and had little personal motivation to improve performance and income further (the target-income hypothesis); this explanation would be consistent with the 30 to 40% gains in family practitioners' net income from the 2002–2003 period to the 2005–2006 period.14

Our data cannot be used to ascertain the relative merit of these explanations. However, government negotiators in England appear to endorse the third explanation (too many physicians achieving maximal or near-maximal payments for quality of care). Alterations of the pay-for-performance scheme in 2006 introduced higher thresholds for maximal clinical-quality payments and a wider range of indicators (see the Supplementary Appendix).

This study suggests that continuity of care declined after pay for performance was introduced. One possible explanation is that practices focused on meeting rapid-access targets in which access to any doctor in the practice within 48 hours was linked to incentives but access to a particular physician was not,15 making it more difficult for patients to see their own doctor. This could be an unintended and perverse effect of the scheme and is a concern, since continuity is an aspect of family practice that patients value.16 Another explanation is that there were increases in the size of practices, and many practices introduced nurse-led clinics for management of individual chronic diseases. Although this may have been an important part of improving the quality of care, it may have made continuity of care harder to achieve.

Other studies suggest that financial incentives result in small improvements in quality.17,18 Our data suggest that the pay-for-performance scheme in England attained its quality-improvement goals but that the pace of improvement was not sustained once these goals had been reached. There may be unintended consequences for aspects of care other than those studied, which may be influenced by differences in the operational details of apparently similar incentive schemes.19 An unanticipated benefit of the scheme in England has been a reduction in sociodemographic inequalities in the delivery of health care.20

Our study has several limitations. First, the pay-for-performance scheme was introduced throughout the United Kingdom, thereby precluding a controlled trial and making the use of an interrupted time series the best evaluation method available. The only other time-series analysis of the quality of primary care in England suggests that pay for performance has had a more modest effect than that suggested by our results.21 Second, because practices were observed at only two time points before the introduction of pay for performance, we cannot say whether the rate of improvement was already accelerating as a result of earlier but still ongoing initiatives. Third, the statistical power of our study was such that only moderate-to-large differences in trend were detectable between indicators that were and those that were not associated with incentives. Fourth, response rates for the patient questionnaire were poor (38 to 47%), although there is no reason to suspect any differences in bias at the four study time points. Finally, we focused on three diseases for which substantial efforts had been made to improve the quality of care before the introduction of the pay-for-performance scheme. Pay for performance might have a greater effect on conditions with lower profiles, including some introduced as the scheme developed (e.g., learning disabilities).

In conclusion, between 1998 and 2007, there were significant improvements in measurable aspects of clinical performance with respect to the care provided for three major chronic diseases. The initial acceleration in the underlying rate of quality improvement after the introduction of pay for performance was not sustained. If the aim of pay for performance is to give providers incentives to attain targets, the scheme achieved that aim. There may have been unintended consequences, including reductions in the quality of some aspects of care not linked to incentives and in the continuity of care.

Supported by the Department of Health for England.

The views presented here are those of the authors and not those of the Department of Health.

Dr. Roland reports serving as an academic adviser to the government and British Medical Association negotiating teams during the development of the U.K. pay-for-performance scheme in 2001 and 2002. No other potential conflict of interest relevant to this article was reported.

We thank the staff of all the practices that participated in the study and also Nan Bailey, Michele Bohan, Nicholas Burr, Ella Gaehl, Nicola Small, and Angela Swallow, who contributed to data collection.

Source Information

From the National Primary Care Research and Development Centre, University of Manchester, Manchester (S.M.C., D.R., E.K., B.S., M.R.); and the University of Cambridge General Practice and Primary Care Research Unit, Institute of Public Health, Cambridge (M.R.) — both in the United Kingdom.

Address reprint requests to Dr. Campbell at the National Primary Care Research and Development Centre, University of Manchester, Oxford Rd., Manchester M13 9PL, United Kingdom, or at .

References

References

  1. 1

    Roland M. Linking physicians' pay to quality of care -- a major experiment in the United Kingdom. N Engl J Med 2004;351:1448-1454
    Full Text | Web of Science | Medline

  2. 2

    Quality and Outcomes Framework: guidance for GMS contract, 2009/10. London: NHS Employers, March 2009. (Accessed June 29, 2009, at http://www.nhsemployers.org/Aboutus/Publications/Documents/QOF_Guidance_2009_final.pdf.)

  3. 3

    Campbell S, Reeves D, Kontopantelis E, Middleton E, Sibbald B, Roland M. Quality of primary care in England with the introduction of pay for performance. N Engl J Med 2007;357:181-190
    Full Text | Web of Science | Medline

  4. 4

    Campbell SM, Roland MO, Shekelle PG, Cantrill JA, Buetow SA, Cragg DK. The development of review criteria for assessing the quality of management of stable angina, adult asthma and non-insulin dependent diabetes mellitus in general practice. Qual Health Care 1999;8:6-15
    CrossRef | Medline

  5. 5

    Campbell SM, Hann M, Hacker J, Durie A, Thapar A, Roland MO. Quality assessment for three common conditions in primary care: validity and reliability of review criteria developed by expert panels for angina, asthma and type 2 diabetes. Qual Saf Health Care 2002;11:125-130
    CrossRef | Web of Science | Medline

  6. 6

    Ramsay J, Campbell JL, Schroter S, Green J, Roland M. The General Practice Assessment Survey (GPAS): tests of data quality and measurement properties. Fam Pract 2000;17:372-379
    CrossRef | Web of Science | Medline

  7. 7

    Mead N, Bower P, Roland M. The General Practice Assessment Questionnaire (GPAQ) -- development and psychometric characteristics. BMC Fam Pract 2008;9:13-13http://www.biomedcentral.com/1471-2296/9/13
    CrossRef | Web of Science | Medline

  8. 8

    Mangin D, Toop L. The Quality and Outcomes Framework: what have you done to yourselves? Br J Gen Pract 2007;57:435-437
    Web of Science | Medline

  9. 9

    Campbell SM, Hann M, Hacker J, et al. Identifying predictors of high quality care in English general practice: observational study. BMJ 2001;323:784-787
    CrossRef | Web of Science | Medline

  10. 10

    Campbell SM, Roland MO, Middleton E, Reeves D. Improvements in the quality of clinical care in English general practice 1998-2003: longitudinal observational study. BMJ 2005;331:1121-1125
    CrossRef | Web of Science | Medline

  11. 11

    Wagner AK, Soumerai SB, Zhang F, Ross-Degnan D. Segmented regression analysis of interrupted time series studies in medication use research. J Clin Pharm Ther 2002;27:299-309
    CrossRef | Web of Science | Medline

  12. 12

    National Quality and Outcomes Framework statistics for England 2005/06. London: National Health Service Information Centre, 2006. (Accessed June 29, 2009, at http://www.ic.nhs.uk/webfiles/publications/qof/NationalQualityOutcomesFramework280906_WORD.doc.)

  13. 13

    National Quality and Outcomes Framework statistics for England 2007/08. London: National Health Service Information Centre, 2008. (Accessed June 29, 2009, at http://www.ic.nhs.uk/statistics-and-data-collections/supporting-information/audits-and-performance/the-quality-and-outcomes-framework/qof-2007/08/bulletin.)

  14. 14

    GP Earnings and Expenses Enquiry 2005/06: final report. London: National Health Service Information Centre, 2008. (Accessed June 29, 2009, at http://www.ic.nhs.uk/statistics-and-data-collections/primary-care/general-practice/gp-earnings-and-expenses-enquiry-2005-2006:-final-report.)

  15. 15

    Goodall S, Montgomery A, Banks J, Salisbury C, Sampson F, Pickin M. Implementation of Advanced Access in general practice: postal survey of practices. Br J Gen Pract 2006;56:918-923
    Web of Science | Medline

  16. 16

    Cheraghi-Sohi S, Hole AR, Mead N, et al. What patients want from primary care consultations: a discrete choice experiment to identify patients' priorities. Ann Fam Med 2008;6:107-115
    CrossRef | Web of Science | Medline

  17. 17

    Rosenthal MB, Frank RG, Li Z, Epstein AM. Early experience with pay-for-performance: from concept to practice. JAMA 2005;294:1788-1793
    CrossRef | Web of Science | Medline

  18. 18

    Lindenauer PK, Remus D, Roman S, et al. Public reporting and pay for performance in hospital quality improvement. N Engl J Med 2007;356:486-496
    Full Text | Web of Science | Medline

  19. 19

    McDonald R, Roland M. Pay for performance in primary care in England and California: comparison of unintended consequences. Ann Fam Med 2009;7:121-127
    CrossRef | Web of Science | Medline

  20. 20

    Doran T, Fullwood C, Kontopantelis E, Reeves D. Effect of financial incentives on inequalities in the delivery of primary clinical care in England: analysis of clinical activity indicators for the quality and outcomes framework. Lancet 2008;372:728-736
    CrossRef | Web of Science | Medline

  21. 21

    QRESEARCH and The Information Centre. Time series analysis for selected clinical indicators from the Quality and Outcomes Framework 2001-2006. Nottingham, United Kingdom: QRESEARCH, 2007. (Accessed June 29, 2009, at http://www.qresearch.org/Public_Documents/Time%20Series%20Analysis%20for%20selected%20clinical.pdf.)

Citing Articles (62)

Citing Articles

  1. 1

    Rachelle E. Bernacki, Danielle N. Ko, Philip Higgins, Sandra N. Whitlock, Amelia Cullinan, Robin Wilson, Vicki Jackson, Constance Dahlin, Janet Abrahm, Elizabeth Mort, Kenneth N. Scheer, Susan Block, J. Andrew Billings. (2012) Improving Access to Palliative Care through an Innovative Quality Improvement Initiative: An Opportunity for Pay-for-Performance. Journal of Palliative Medicine120203065428002
    CrossRef

  2. 2

    Jeffrey K. Aronson. (2012) What do clinical pharmacologists do? A questionnaire survey of senior UK clinical pharmacologists. British Journal of Clinical Pharmacology 73:2, 161-169
    CrossRef

  3. 3

    Carlos Eirea Eiras, Vicente Ortún Rubio. (2012) Incentivos financieros en la mejora de la calidad asistencial. Informe SESPAS 2012. Gaceta Sanitaria
    CrossRef

  4. 4

    Nathaniel M. Hawkins, David J. Wright, Simon Capewell. (2011) Heart failure services in the United Kingdom: Rethinking the machine bureaucracy. International Journal of Cardiology
    CrossRef

  5. 5

    Evangelos Kontopantelis, Tim Doran, Hugh Gravelle, Rosalind Goudie, Luigi Siciliani, Matt Sutton. (2011) Family Doctor Responses to Changes in Incentives for Influenza Immunization under the U.K. Quality and Outcomes Framework Pay-for-Performance Scheme. Health Services Researchn/a-n/a
    CrossRef

  6. 6

    S. M. Campbell, T. Eriksson. (2011) Multiple strategies for quality improvement and patient safety—money alone is not the answer, nor is trust. Conclusions of the 6th EQuiP Invitational conference April 2011. European Journal of General Practice 17:4, 238-240
    CrossRef

  7. 7

    Joan Gené Badia. (2011) Las mejoras en las actividades incentivadas se consiguen a expensas de pequeños detrimentos de las no sujetas a incentivos. FMC - Formación Médica Continuada en Atención Primaria 18:9, 602
    CrossRef

  8. 8

    Adam A. Powell, Katie M. White, Melissa R. Partin, Krysten Halek, Jon B. Christianson, Brian Neil, Sylvia J. Hysong, Edwin J. Zarling, Hanna E. Bloomfield. (2011) Unintended Consequences of Implementing a National Performance Measurement System into Local Practice. Journal of General Internal Medicine
    CrossRef

  9. 9

    Paul E. Stevens, Christopher K.T. Farmer, Simon de Lusignan. (2011) Effect of Pay for Performance on Hypertension in the United Kingdom. American Journal of Kidney Diseases 58:4, 508-511
    CrossRef

  10. 10

    Douglas P. Olsen. (2011) When Being Good Means Looking Bad. AJN, American Journal of Nursing 111:10, 63-65
    CrossRef

  11. 11

    Luis Palomo, Joan Gené-Badia, Juan José Rodríguez-Sendín. (2011) La reforma de la atención primaria, entre el refugio del pasado y la aventura de la innovación. Informe SESPAS 2012. Gaceta Sanitaria
    CrossRef

  12. 12

    Jeannette P. P. So, James G. Wright. (2011) The Use of Three Strategies to Improve Quality of Care at a National Level. Clinical Orthopaedics and Related Research®
    CrossRef

  13. 13

    Anthony Scott, Peter Sivey, Driss Ait Ouakrim, Lisa Willenberg, Lucio Naccarella, John Furler, Doris Young, Anthony Scott. 2011. The effect of financial incentives on the quality of health care provided by primary care physicians. .
    CrossRef

  14. 14

    Christian Blickem, Peter Bower, Joanne Protheroe, Anne Kennedy, Ivaylo Vassilev, Caroline Sanders, Sue Kirk, Carolyn Chew-Graham, Anne Rogers. (2011) The role of information in supporting self-care in vascular conditions: a conceptual and empirical review. Health & Social Care in the Community 19:5, 449-459
    CrossRef

  15. 15

    Frank Eijkenaar. (2011) Key issues in the design of pay for performance programs. The European Journal of Health Economics
    CrossRef

  16. 16

    D. Gorman, M. Thompson. (2011) Encouraging and rewarding the good behaviour of healthcare providers. Internal Medicine Journal 41:8, 585-587
    CrossRef

  17. 17

    I. Mills, P. Batchelor. (2011) Quality indicators: the rationale behind their use in NHS dentistry. BDJ 211:1, 11-15
    CrossRef

  18. 18

    Tinh-Hai Collet, Sophie Salamin, Lukas Zimmerli, Eve A. Kerr, Carole Clair, Michel Picard-Kossovsky, Eric Vittinghoff, Edouard Battegay, Jean-Michel Gaspoz, Jacques Cornuz, Nicolas Rodondi. (2011) The Quality of Primary Care in a Country with Universal Health Care Coverage. Journal of General Internal Medicine 26:7, 724-730
    CrossRef

  19. 19

    David P.J. Osborn, Gianluca Baio, Kate Walters, Irene Petersen, Heather Limburg, Rosalind Raine, Irwin Nazareth. (2011) Inequalities in the provision of cardiovascular screening to people with severe mental illnesses in primary care. Schizophrenia Research 129:2-3, 104-110
    CrossRef

  20. 20

    Martin Emmert, Frank Eijkenaar, Heike Kemter, Adelheid Susanne Esslinger, Oliver Schöffski. (2011) Economic evaluation of pay-for-performance in health care: a systematic review. The European Journal of Health Economics
    CrossRef

  21. 21

    Joachim P. Sturmberg. (2011) Primary health care organizations - through a conceptual and a political lens. Journal of Evaluation in Clinical Practice 17:3, 525-529
    CrossRef

  22. 22

    D. Heresbach. (2011) Résultats des programmes de récompenses ou d’incitation à la performance (P4P). Acta Endoscopica 41:3, 115-122
    CrossRef

  23. 23

    Carlos Brotons. (2011) ¿Cuáles son los determinantes que explican mejor la variabilidad en la reducción de la mortalidad por enfermedad coronaria?. FMC - Formación Médica Continuada en Atención Primaria 18:5, 313
    CrossRef

  24. 24

    Joan Gené Badia. (2011) El pago por desempeño no mejora el control de la tensión arterial. FMC - Formación Médica Continuada en Atención Primaria 18:5, 315
    CrossRef

  25. 25

    Lara E. Szent-Gyorgyi, Jonathan Coblyn, Alexander Turchin, Joseph Loscalzo, Allen Kachalia. (2011) Building a Departmental Quality Program: A Patient-Based and Provider-Led Approach. Academic Medicine 86:3, 314-320
    CrossRef

  26. 26

    M. Schrappe, N. Gültekin. (2011) Pay for Performance (P4P). Bundesgesundheitsblatt - Gesundheitsforschung - Gesundheitsschutz 54:2, 166-170
    CrossRef

  27. 27

    Paul BS Lai. (2011) Quality of surgery. Surgical Practice 15:1, 1-1
    CrossRef

  28. 28

    David Dranove. 2011. Health Care Markets, Regulators, and Certifiers. , 639-690.
    CrossRef

  29. 29

    Michael Soljak, Edgar Samarasundera, Tejal Indulkar, Hannah Walford, Azeem Majeed. (2011) Variations in cardiovascular disease under-diagnosis in England: national cross-sectional spatial analysis. BMC Cardiovascular Disorders 11:1, 12
    CrossRef

  30. 30

    Sabine Ludt, Stephen M Campbell, Jan van Lieshout, Richard Grol, Joachim Szecsenyi, Michel Wensing. (2011) Development and pilot of an internationally standardized measure of cardiovascular risk management in European primary care. BMC Health Services Research 11:1, 70
    CrossRef

  31. 31

    Sally Hull, Gavin Dreyer, Ellena Badrick, Alistair Chesser, Muhammad Yaqoob. (2011) The relationship of ethnicity to the prevalence and management of hypertension and associated chronic kidney disease. BMC Nephrology 12:1, 41
    CrossRef

  32. 32

    Martin P Eccles, Susan Hrisos, Jill J Francis, Elaine Stamp, Marie Johnston, Gillian Hawthorne, Nick Steen, Jeremy M Grimshaw, Marko Elovainio, Justin Presseau, Margaret Hunter. (2011) Instrument development, data collection, and characteristics of practices, staff, and measures in the Improving Quality of Care in Diabetes (iQuaD) Study. Implementation Science 6:1, 61
    CrossRef

  33. 33

    Antje Erler, Thomas Bodenheimer, Richard Baker, Nick Goodwin, Cor Spreeuwenberg, Hubertus J.M. Vrijhoef, Ellen Nolte, Ferdinand M. Gerlach. (2011) Preparing primary care for the future – perspectives from the Netherlands, England, and USA. Zeitschrift für Evidenz, Fortbildung und Qualität im Gesundheitswesen 105:8, 571-580
    CrossRef

  34. 34

    Mohammad A Tahir, Olga Dmitrieva, Simon de Lusignan, Jeremy van Vlymen, Tom Chan, Ramez Golmohamad, Kevin Harris, Charles Tomson, Nicola Thomas, Hugh Gallagher. (2011) Confidence and quality in managing CKD compared with other cardiovascular diseases and diabetes mellitus: a linked study of questionnaire and routine primary care data. BMC Family Practice 12:1, 83
    CrossRef

  35. 35

    Martin Beyer, Regine Chenot, Antje Erler, Ferdinand M. Gerlach. (2011) Die Darstellung der hausärztlichen Versorgungsqualität durch Qualitätsindikatoren. Zeitschrift für Evidenz, Fortbildung und Qualität im Gesundheitswesen 105:1, 13-20
    CrossRef

  36. 36

    Thomas Kötter, Friederike Schaefer, Eva Blozik, Martin Scherer. (2011) Die Entwicklung von Qualitätsindikatoren – Hintergrund, Methoden und Probleme. Zeitschrift für Evidenz, Fortbildung und Qualität im Gesundheitswesen 105:1, 7-12
    CrossRef

  37. 37

    Dominick L. Frosch, Glyn Elwyn. (2011) I Believe, Therefore I Do. Journal of General Internal Medicine 26:1, 2-4
    CrossRef

  38. 38

    G. M. Magee, S. J. Hunter, C. R. Cardwell, G. Savage, F. Kee, M. C. Murphy, D. G. Fogarty. (2010) Identifying additional patients with diabetic nephropathy using the UK primary care initiative. Diabetic Medicine 27:12, 1372-1378
    CrossRef

  39. 39

    Fran Tanner, Robbie Foy, Wendy Harrison. (2010) ‘Wads up, doc’ – trends in British newspapers’ reporting of general practitioners’ pay. Primary Health Care Research & Development 11:04, 405-409
    CrossRef

  40. 40

    R. K. Simmons, J. B. Echouffo-Tcheugui, S. J. Griffin. (2010) Screening for type 2 diabetes: an update of the evidence. Diabetes, Obesity and Metabolism 12:10, 838-844
    CrossRef

  41. 41

    E. A. M. Gale. (2010) Diabetes in the UK: time for a reality check?. Diabetic Medicine 27:9, 973-976
    CrossRef

  42. 42

    J. Murray, S. Saxena, C. Millett, V. Curcin, S. de Lusignan, A. Majeed. (2010) Reductions in risk factors for secondary prevention of coronary heart disease by ethnic group in south-west London: 10-year longitudinal study (1998-2007). Family Practice 27:4, 430-438
    CrossRef

  43. 43

    P. Hutt. (2010) Health inequalities. InnovAiT 3:6, 316-321
    CrossRef

  44. 44

    M. Laura Johnson, Hector P. Rodriguez, M. Rosa Solorio. (2010) Case-Mix Adjustment and the Comparison of Community Health Center Performance on Patient Experience Measures. Health Services Research 45:3, 670-690
    CrossRef

  45. 45

    Patricia W. Stone, Sherry A. Glied, Peter D. McNair, Nikolas Matthes, Bevin Cohen, Timothy F. Landers, Elaine L. Larson. (2010) CMS Changes in Reimbursement for HAIs. Medical Care 48:5, 433-439
    CrossRef

  46. 46

    L. Nekhlyudov, S. Latosinsky. (2010) The Interface of Primary and Oncology Specialty Care: From Symptoms to Diagnosis. JNCI Monographs 2010:40, 11-17
    CrossRef

  47. 47

    Jozé Braspenning, Richard Grol, Rob Dijkstra, Marlies Hulscher, Michel Wensing. (2010) Implementatie van NHG-Standaarden: succes of probleem?. Huisarts en wetenschap 2010:1, 42-46
    CrossRef

  48. 48

    Winnie Chi-Man Yip, William Hsiao, Qingyue Meng, Wen Chen, Xiaoming Sun. (2010) Realignment of incentives for health-care providers in China. The Lancet 375:9720, 1120-1130
    CrossRef

  49. 49

    Ibrahim Alabbadi, Grainne Crealey, Kathryn Turner, Therese Rafferty, Lynn Keenan, Penny Murray, James C. McElnay. (2010) Statin prescribing in Northern Ireland and England pre and post introduction of the quality and outcomes framework. Pharmacy World & Science 32:1, 43-51
    CrossRef

  50. 50

    Hugh Gravelle, Matt Sutton, Ada Ma. (2010) Doctor Behaviour under a Pay for Performance Contract: Treating, Cheating and Case Finding?. The Economic Journal 120:542, F129-F156
    CrossRef

  51. 51

    , T. Koch, S. Iliffe. (2010) The role of primary care in the recognition of and response to dementia. The journal of nutrition, health & aging 14:2, 107-109
    CrossRef

  52. 52

    Israel Rabinowitz, Ohad Hochman, Rachel Luzzati, Yelena Haifitz, Yuri Shclar, Natalia Kaykov, Alexander Khemlin, Michael Kaffman, Ada Tamir. (2010) Monitoring and treatment for cardiovascular risk. Primary Health Care Research & Development 11:01, 29
    CrossRef

  53. 53

    Andreea Voinea-Griffin, D. Brad Rindal, Jeffrey L. Fellows, Andrei Barasch, Gregg H. Gilbert, Monika M. Safford, . (2010) Pay-for-Performance in Dentistry: What We Know. Journal for Healthcare Quality 32:1, 51-58
    CrossRef

  54. 54

    Ian A. Scott. (2010) Public hospital bed crisis: too few or too misused?. Australian Health Review 34:3, 317
    CrossRef

  55. 55

    Alberto Cordero, Lorenzo Fácila, Enrique Galve, Pilar Mazón. (2010) Novedades en hipertensión arterial y diabetes mellitus. Revista Española de Cardiología 63, 101-115
    CrossRef

  56. 56

    Hector P. Rodriguez, Ted Glahn, Marc N. Elliott, William H. Rogers, Dana Gelb Safran. (2009) The Effect of Performance-Based Financial Incentives on Improving Patient Care Experiences: A Statewide Evaluation. Journal of General Internal Medicine 24:12, 1281-1288
    CrossRef

  57. 57

    Colin R. Cooke. (2009) Translating evidence into practice: how good is good enough?. Journal of Evaluation in Clinical Practice 15:6, 1187-1189
    CrossRef

  58. 58

    Sheena Mc Hugh, Jo O’Keeffe, Anne Fitzpatrick, Anna de Siún, Monica O’Mullane, Ivan Perry, Colin Bradley. (2009) Diabetes care in Ireland: A survey of general practitioners. Primary Care Diabetes 3:4, 225-231
    CrossRef

  59. 59

    Mark Hauswald, Lowell W. Gerson, Nancy L. Kerr. (2009) Public Health and Emergency Medicine. Academic Emergency Medicine 16:11, 1040-1043
    CrossRef

  60. 60

    Kearney, Linda, O'Neill, Desmond, . (2009) Pay for Performance and Quality of Care in England. New England Journal of Medicine 361:17, 1709-1709
    Full Text

  61. 61

    DS Evans, E O'Connell, M O'Donnell, L Hurley, M Glacken, AW Murphy, SF Dinneen. (2009) The current state of general practicediabetes care in the West of Ireland. Practical Diabetes International 26:8, 322-325
    CrossRef

  62. 62

    Patricia W Stone. (2009) Economic burden of healthcare-associated infections: an American perspective. Expert Review of Pharmacoeconomics & Outcomes Research 9:5, 417-422
    CrossRef

Letters