BMJ  2006;333:1-2 (1 July), doi:10.1136/bmj.333.7557.1

Editorial

Can patients assess the quality of health care?

Patients' surveys should ask about real experiences of medical care

Patient feedback surveys are increasingly seen as a key component of monitoring and improving the quality of health care.¹ Since 2002, all NHS trusts in England have been required to survey a sample of their patients on an annual basis and report the results to their regulator, the Healthcare Commission. General practitioners throughout the United Kingdom can earn extra contractual points and more money if they implement patient surveys. Patients' feedback on individual doctors has been advocated for practice accreditation, clinical governance, assessment of trainees, appraisal, and revalidation. But can patients' really make reliable judgments on the quality of health care?

In this week's BMJ Rao and colleagues point to some potential problems, particularly with regard to patients' assessment of the technical quality of care.² Using a British adaptation of a US patient questionnaire (the general practice assessment survey (GPAS)³), they found no correlation between patients' evaluations of the quality of technical care and evidence based indicators drawn from a separate review of case records. They conclude that patients' assessments are not a reliable basis for assessing the technical quality of care. Are they right?

Well, yes and no. They are right to dismiss the notion that patients' questionnaires could be used as the sole measure of quality of clinical practice, but has anyone seriously suggested this? They are probably also correct to point to the limitations of the technical quality domain of the GPAS questionnaire, which uses a rating scale to assess patients' perceptions of doctors' medical knowledge, thoroughness of physical examination, and diagnostic and prescribing skills. The GPAS questionnaire has now been withdrawn from the website of the National Primary Care Research and Development Centre (www.npcrdc.ac.uk), and its replacement, the general practice assessment questionnaire (GPAQ), does not attempt to assess technical quality. However, it is a generalisation too far to suggest that patients are unable to assess the quality of care they receive, even technical quality.

Most patients prefer doctors who have excellent communication skills, but they also want to be assured that their doctor has sound, up to date, technical skills.⁴ Occasionally patients conflate the two, which possibly explains why some patients of Dr Harold Shipman, the UK general practitioner who murdered more than 200 of his patients, remained loyal to him. But both attributes are viewed by patients and the public as equally important.

A recent public survey carried out for the General Medical Council found that giving good advice and treatment was the factor that most influenced people's confidence in doctors (rated as very important by nine out of 10 respondents), followed closely by good communication skills.⁵ Other factors that were highly rated included maintaining confidentiality, respecting patients' dignity, and involving them in treatment decisions.

Well designed questionnaires for patients could contribute usefully to an assessment of both the technical competence and interpersonal skills of doctors. If these surveys are to play a role in quality improvement, they should provide clear factual results that prompt follow-up actions. Knowing that, say, 20% of your patients gave you a low rating for technical skills doesn't give you a clear view of what you need to do to improve things, but receiving feedback on the proportion of your elderly patients who, for example, would have liked a flu vaccination but were not offered one gives a much more useful guide to deficiencies in performance. Rao and colleagues had to search clinical records manually for this information where patient records were not computerised, but could just as easily have used a patient survey.

The type of evaluative or rating-style question that was used to assess technical skills in the GPAS questionnaire is not useful for this purpose. It is difficult enough for a doctor's peers to give them a reliable rating, but well nigh impossible for a patient with no clinical training. Instead of asking patients to rate their care using general evaluation categories (such as excellent, very good, good, fair, poor), it is better to ask them to report in detail on their experiences of clinical care during a particular consultation (for instance, "Were you given information about any side effects of your medicine?"), a specific episode of care ("Were you given a plan to help you manage your diabetes at home?"), or over a specified period ("Have you had your blood pressure checked in the past 12 months?"). These types of questions are designed to elicit reports on what actually occurred, rather than the patient's evaluation of what occurred, and they produce more reliable results.

Simply giving doctors the results of patients' feedback does not seem to be effective for instigating change.^{6 7} However, in some parts of the US integrating patients' feedback into educational programmes with the results made available to the public has yielded improvements in doctors' performance.^8-12 But will doctors elsewhere have the courage to publish their patient survey results?

Picker Institute Europe, King's Mead House, Oxford OX1 1RX
(angela.coulter{at}pickereurope.ac.uk)

---

Competing interests: Picker Institute Europe gains part of its income from designing and implementing patient surveys. AC is a member of the BMJ's editorial advisory board.

See Papers p 19

References

1. Cleary PD. The increasing importance of patient surveys. BMJ 1999; 319: 720-1.[Free Full Text]
2. Rao M, Clarke A, Sanderson C, Hammersley R. Patients' own assessments of quality of primary care compared with objective records based measures of technical quality of care: cross sectional study. BMJ 2006;333: 19-22.[Abstract/Free Full Text]
3. Ramsay J, Campbell JL, Schroter S, Green J, Roland M. The general practice assessment survey (GPAS): tests of data quality and measurement properties. Fam Pract 2000;17: 372-9.[Abstract/Free Full Text]
4. Coulter A. What do patients and the public want from primary care? BMJ 2005;331: 1199-201.[Free Full Text]
5. GfK NOP Social Research. Annual tracking survey. London: General Medical Council, 2006.
6. Vingerhoets E, Wensing M, Grol R. Feedback of patients' evaluations of general practice care: a randomised trial. Qual Health Care 2001;10: 224-8.[Abstract/Free Full Text]
7. Wensing M, Vingerhoets E, Grol R. Feedback based on patient evaluations: a tool for quality improvement? Patient Educ Couns 2003;51: 149-53.[CrossRef][ISI][Medline]
8. Greco M, Sweeney K, Broomhall J, Beasley P. Patient assessment of interpersonal skills: a clinical governance activity for hospital doctors and nurses. Journal of Clinical Excellence 2001;3: 117-24.
9. Greco M, Brownlea A, McGovern J. Impact of patient feedback on the interpersonal skills of general practice registrars: results of a longitudinal study. Med Educ 2001;35: 748-56.[CrossRef][ISI][Medline]
10. Leeper MK, Veale JR, Westbrook TS, Reed K. The effect of standardized patient feedback in teaching surgical residents informed consent: results of a pilot study. Curr Surg 2003;60: 615-22.[Medline]
11. Leddy KM, Wolosin RJ. Patient satisfaction with pain control during hospitalization. Improving health care quality and safety. Oak Brook, IL: Joint Commission Resources, 2005.
12. Gillies RR, Shortell SM, Casalino L, Robinson JC, Rundall TG. How different is California? A comparison of US physician organisations. Health Aff 2003; Suppl Web Exclusives:W3-492-502. (doi 10.1377/hlthaff.W3.492.)

CiteULike    Complore    Connotea    Del.icio.us    Digg    Reddit    Technorati    What's this?

Related Articles

Patient involvement in health care will improve quality

Robert Hunter and Rosie Cameron
BMJ 2006 333: 147-148. [Extract] [Full Text]

Patients' own assessments of quality of primary care compared with objective records based measures of technical quality of care: cross sectional study

Mala Rao, Aileen Clarke, Colin Sanderson, and Richard Hammersley
BMJ 2006 333: 19. [Abstract] [Full Text] [PDF]

What do patients and the public want from primary care?

Angela Coulter
BMJ 2005 331: 1199-1201. [Extract] [Full Text] [PDF]

The increasing importance of patient surveys

Paul D Cleary
BMJ 1999 319: 720-721. [Extract] [Full Text] [PDF]

This article has been cited by other articles:

• Campbell, J L, Dickens, A, Richards, S H, Pound, P, Greco, M, Bower, P (2007). Capturing users' experience of UK out-of-hours primary medical care: piloting and psychometric properties of the Out-of-hours Patient Questionnaire. Qual Saf Health Care 16: 462-468 [Abstract] [Full text]  
• Baron, J. A. (2007). Can Aspirin Keep Mortality at Bay?. Arch Intern Med 167: 535-536 [Full text]  
• Hunter, R., Cameron, R. (2006). Patient involvement in health care will improve quality.. BMJ 333: 147-148 [Full text]  

Rapid Responses:

Read all Rapid Responses

Yes They Can And They Should

Dr. Herbert H. Nehrlich
bmj.com, 3 Jul 2006 [Full text]

Patient assessment of quality of care

George E. Pickett, et al.
bmj.com, 4 Jul 2006 [Full text]

Assessors for quality of healthcare

MK V Sathyamoorthy
bmj.com, 4 Jul 2006 [Full text]

Patients' role in workplace-based assessment of healthcare

Douglas J Murphy, et al.
bmj.com, 5 Jul 2006 [Full text]

Patient involvement in health care will improve quality.

Robert Hunter, et al.
bmj.com, 7 Jul 2006 [Full text]

Letter to the Editor

Rebecca C. Jonnerhag
bmj.com, 2 Sep 2006 [Full text]