Patient Reports and Ratings of Individual Physicians: An Evaluation of the DoctorGuide and Consumer Assessment of Health Plans Study Provider-Level Surveys
Restricted accessResearch articleFirst published online September, 2003
Patient Reports and Ratings of Individual Physicians: An Evaluation of the DoctorGuide and Consumer Assessment of Health Plans Study Provider-Level Surveys
The objective of this study was to compare physician-level survey instruments and estimate the number of patients needed per physician to provide reliable estimates of health care. The setting consisted of 3 health plans and 1 large physician group in the greater Cincinnati metro area. Surveys were mailed to patients of 100 primary care physicians. Patients were mailed either the Consumer Assessment of Health Plans Study(r) (CAHPS) or DoctorGuide survey instrument. A total of 4245 CAHPS surveys and 5519 DoctorGuide surveys were returned. Internal consistency reliability estimates for the multi-item scales (access to care, communication, and preventive care) for both surveys were adequate. The number of patient responses needed to obtain a reliability of 0.70 at the physician level for the access to care, communication, and preventive care scales were 32, 43, and 38, respectively, for the CAHPS survey and 26, 25, and 47, respectively, for the DoctorGuide survey. These results indicate similar and parallel psychometric performance for the DoctorGuide and CAHPS survey instruments.
Cleary PD. The increasing importance of patient surveys. Br Med J1999;319:720-772.
2.
Schnaier JA, Sweeny SF, Williams VSL, et al.Special issues addressed in the CAHPSTM survey of Medicare managed care beneficiaries. Med Care. 1999;37:MS69-MS78.
3.
Zaslavsky AM, Beaulieu ND, Landon, BE, et al.Dimensions of consumer-assessed quality of Medicare managed-care health plans. Med Care. 2000;38:162-174.
4.
Brown JA, Nederend SE, Hays RD, et al.Special issues in assessing care of Medicaid recipients. Med Care. 1999;37:MS79-MS88.
5.
Millar JS, McCauley D, Hays C, et al.Consumer assessment of health plans survey (CAHPS(r)): results for Oklahoma managed care Medicaid, 1997, 1998, and 1999. J Okla State Med Assoc. 2000;93:109-117.
6.
Weisman CS, Henderson JT, Schifrin E, et al.Gender and patient satisfaction in managed care plans: analysis of the 1999 HEDIS/CAHPS 2.0H adult survey. Womens Health Issues. 2000; 11:401-415.
7.
Haviland MG, Morales LS, Reise SP, et al.Do health care ratings differ by race/ethnicity?Jt Comm J Qual Improv. 29:134-145, 2003.
8.
National Research Corporation, 1998. NRC Healthcare Market Guide Survey. Lincoln, Neb: National Research Corporation; 1998.
9.
Sainfort F, Booske BC. Role of information in consumer selection of health plans. Health Care Financing Rev. 1996;18:31-54.
10.
Swanson DB, Webster GD, Norcini JJ. Precision of patient ratings of residents' humanistic qualities: How many items and patients are enough? In: Bender W, Hiemstra R, Scherpbler A, Zweistra R, eds. Teaching and Assessing Clinical Competence. Groningen, The Netherlands: BoekWerk Publications; 1990.
11.
Cronbach LJ. Coefficient alpha and the internal structure of tests. Psychometrika. 1951;16:297-334.
12.
Meterko M, Kosinski M, Davies AR, et al.Physician-specific patient satisfaction profiles: Report of a pilot study at Tufts Associated Health Plans. New England Medical Center; 1994.
13.
Nelson EC, Gentry MA, Mook KH, et al.How many patients are needed to provide reliable evaluations of individual clinicians?Med Care. In press.
