The literature of continuing medical education (CME) program evaluation was reviewed and analyzed. The “State-of-the-art” of CME evaluation is depicted in a series of tables which indicate evaluation methods and results. Evaluation designs providing strong assurances of valid results were not often found. The weakness of most published evaluations limit possible conclusions about the effectiveness of CME.
Get full access to this article
View all access options for this article.
References
1.
FahsIJMillerWR: Continuing medical education and educational television: An evaluation of a series for physicians in Minnesota. J Med Educ45:578–587, 1970.
2.
McGuinnessAC: Continuation medical education by open-circuit television: A preliminary report. J Med Educ39:735–745, 1964.
3.
McGuinnessAC: The New york Academy of Medicine TV-PG efforts in a metropolis. J Med Educ40:878–881, 1965.
4.
MenzelH: The effectiveness of the televised clinical science seminars of the New York Academy of Medicine. Bull NY Acad Med42:679–714, 1966.
5.
MenzelH; Evaluation of the New York Academy of Medicine's television programs. J Med Educ41:826–843, 1966.
6.
McGuinnessAC: The medical television audience of the New York Academy of Medicine after four years. Bull NY Acad Med44:332–345, 1968.
7.
McGuinnessAC: Physician interest in the New York Academy of Medicine television program after four years. J Med Educ43:852–855, 1968.
8.
MosesCWolfeR: Grand Rounds via television: An experiment in continuing education. Pa Med J67:23–28, 1964.
9.
GroomD: The South Carolina experiment in medical television. J Med Educ38:202–206, 1963.
10.
DenneKTUlicnyS: Open-circuit television: A dying medium for continuing medical education. Proceedings, Tenth Annual Conference on Research in Medical Education, Association of American Medical Colleges, 1971, pp 88–91.
11.
DenneKT: Two-way radio: An evaluation of its effectiveness in continuing medical education. Proceedings, Tenth Annual Conference on Research in Medical Education, Association of American Medical Colleges, 1971, pp 92–95.
12.
BergenSS: Use of two-way radio by a voluntary health organization for continuing medical education. NY State J Med66:2694–2697, 1966.
13.
MeyerTC: Report of an experiment in the use of telelectures for the continuing education of physicians and allied health personnel. J Med Educ43:73–77, 1968.
14.
ConklinJL: Slide-tape programs in independent study in continuing medical education. Proceedings, Tenth Annual Conference on Research in Medical Education, Association of American Medical Colleges, 1971, pp 100–103.
15.
KotreJN: The Michigan physician: His use and evaluation of the professional meeting and postgraduate course. Mich Med70:111–117, 1971.
16.
California Medical Association: A survey of continuing medical education for physicians. Calif Med109:245–251, 1968.
17.
NewbleDI: An experiment in continuing education for physicians. Aust NZ J Med3:512–515, 1973.
18.
BellAEShawG: Scottish television medical programmes: A preliminary assessment. Scot Med J11:250–257, 1966.
19.
LewisCEHassaneinRS: Continuing medical education: An epidemiologic evaluation. N Engl J Med282:254–259, 1970.
20.
PetersonOL: An analytical study of North Carolina general practice. J Med Educ31 (pt II):1–165, 1956.
21.
CluteKF: The General Practitioner. Toronto, University of Toronto Press, 1963, pp 451–465.
22.
RoneyJGRoarkGM: Continuing Education of Physicians in Kansas: An Exploratory End-Result Study. Menlo Park, California, Stanford Research Institute, 1967.
23.
ByrnePS: Evaluation of courses for general practitioners. J R Coll Gen Pract21:719–725, 1971.
24.
NaftulinDH: Psychiatry education programs for nonpsychiatrist physicians: A 10-year perspective. Compr Psychiatry15:133–139, 1974.
25.
WilliamsonJW: Continuing education and patient care research. JAMA201:118–122, 1967.
26.
InuiTS: Effects of Postgraduate Physician Education on the Management and Outcomes of Patients with Hypertension. Master of Science thesis, The Johns Hopkins University, School of Hygiene and Public Health, June 1973.
27.
GauvainSBowieDC: Continuing medical education: Assessment of coursesJ R Coll Gen Pract19:223–227, 1970.
28.
SchlesingerLE: Evaluation of a symposium on epilepsy as a method of training. Public Health Rep81:929–937, 1966.
29.
GauvainS: An experiment in postgraduate education to evaluate teaching and examination techniques. J Med Educ40:516–523, 1965.
30.
McGuireC: Auscultatory skill: Gain and retention after intensive instruction. J Med Educ39:120–131, 1964.
31.
DonnelyFA: Evaluation of weekend seminars for physicians. J Med Educ47:184–187, 1972.
32.
EdsonJN: An evaluation of a clerkship in cardiology for general practitioners. J Med Educ45:1150–1155, 1969.
33.
MockRH: Northern California postgraduate medical television: An evaluation. J Med Educ45:40–46, 1970.
34.
GravensteinJSRhotonMF: A brief note on a technique for postgraduate education: An educational experiment involving 465 physicians. Anaesthesist22:249–250, 1973.
35.
MannFC: The Michigan physician and his continuing education: MARMP study purpose, design, and first findings. Mich Med69:981–990, 1970.
36.
RittelmeyerLFJr.: Continuing education in psychiatry for physicians. JAMA220:710–713, 1972.
37.
KernH MJr.: Continuing education in psychiatry: A report of a program based upon the inductive method. Johns Hopkins Med J123:78–84, 1968.
38.
BrennanJG: Continuing education in alcoholism: Attitude change as a measure of seminar effectiveness. Md State Med J23:63–67, 1974.
39.
BrandtENJr.: An experiment in continuing education developed for the annual meeting of a professional society. J Med Educ49:1189–1191, 1974.
40.
WilliamsonJWMcGuireC: Consecutive Case Conference: An educational evaluation. J Med Educ43:1068–1074, 1968.
41.
GillilandICGibbonsJL: The assessment of advanced courses of medical education. Br J Med Educ5:305–306, 1971.
42.
LyltonB: Results of objective evaluation of postgraduate urologic seminar. J Urol110:582–584, 1973.
43.
AdlerLMEnelowAJ: Attempts to evaluate postgraduate teaching of psychiatry to non-psychiatrist physicians. Proceedings, Second Colloquium for Postgraduate Teaching of Psychiatry, American Psychiatric Association, 1963, pp 62–78.
44.
JonesRTaxayEP: Methodology and effectiveness of a program of postgraduate education for Cuban physicians. J Med Educ38:949–960, 1963.
45.
DriverSC: A comparison of three methods of using television for the continuing medical education of general practitioners. Br J Med Educ6:246–252, 1972.
46.
YoumansJB: Experience with a postgraduate course for practitioners: Evaluation of results. J Assoc Am Med Coll10:154–172, 1935.
47.
DollingerMR: A novel program of continuing medical education. JAMA220:714–716, 1972.
48.
RichardsonFM: Examinations as devices for evaluation. J Med Educ40:972–977, 1965.
49.
NeuHCHowreySP: Testing the physician's knowledge of antibiotic use. N Engl J Med293:1291–1295, 1975.
50.
MargolisCZ: Using a workshop to determine the effectiveness of a text on the problem-oriented medical record. J Med Educ51:767–768, 1976.
51.
WareJEJr.NaftulinDH: Continuing education and clinical skills: A second look. Proceedings, Tenth Annual Conference on Research in Medical Education, Association of American Medical Colleges, 1971, pp 96–99.
52.
ManningPR: Comparison of four teaching techniques: Programmed text, textbook, lecture-demonstration, and lecture-workshop. J Med Educ43:356–359, 1968.
53.
AbrahamsonS: The use of self-instructional material in continuing education. Complete Papers, Ninth Annual Conference on Research in Medical Education, Association of American Medical Colleges, 1970, pp 143–148.
54.
DoneganJH: The use of test results from ASA workshops to evaluate workshop effectiveness. J Med Educ51:500–505, 1976.
55.
NaftulinDHWareJEJr.: Continuing education, clinical competence, and specialty certification. J Med Educ46:901–903, 1971.
56.
HazlettCB: Evaluation of on-campus continuing medical education programs in Alberta. Can Med Assoc J108:1282–1287, 1973.
57.
KaneRBaileyRQ: Evaluation of a postgraduate educational programme in early cancer detection. Br J Med Educ5:134–137, 1971.
58.
HirschEO: Utilization review as a means of continuing education. Med Care12:358–362, 1974.
59.
ReedDE: Continuing education based on record audit in a community hospital. J Med Educ48:1152–1155, 1973.
60.
CaplanRM: Measuring the effectiveness of continuing medical education. J Med Educ48:1150–1152, 1973.
61.
TrincaJCRoweIL: Evaluation of a medical education programme: Diabetes Mellitus Telecast, 1968. Med J Aust2:140–145, 1970.
62.
ShepherdRM: Evaluation of continuing education. Proc R Soc Med64:149–150, 1971.
63.
RubensteinE: Continuing medical education at Stanford: The back-to-medical school program. J Med Educ48:911–918, 1973.
64.
WilliamsonJW: Health accounting: An outcome-based system of quality assurance—illustrative application to hypertension. Bull NY Acad Med51:727–738, 1975.
65.
FoxHM: Psychiatric consultation in general medical clinics: An experiment in postgraduate education. JAMA185:999–1003, 1963.
66.
AbrahamsonS: Evaluation in continuing medical education. JAMA206:625–628, 1968.
67.
BarroAR: Survey and evaluation approaches to physician performance measurement. J Med Educ48:1051–1093, 1973.
68.
BrownCRUhlSM: Mandatory continuing education: Sense or nonsense. JAMA213:1660–1668, 1970.
69.
CampbellDTStanleyJC: Experimental and Quasi-Experimental Designs for Research. Chicago, Rand McNally, 1963.
70.
CrowleyAE: Continuing medical education. JAMA231(suppl):63–69, 1975.
71.
GoranMJ: The PSRO hospital review system. Med Care13(4, suppl):1–33, 1975.
72.
GreenLWLevineDMDeedsSG: Clinical trials of health education for hypertensive outpatients: Design and baseline data. Prev Med4:417–425, 1975.
73.
KelmanHC: Attitudes are alive and well and gainfully employed in the sphere of action. Am Psychol29:310–324, 1974.
74.
LibbyGN: Help stamp out mandatory continuing education!JAMA233:797–799, 1975.
75.
LongLD: The evaluation of continuing education efforts. Am J Public Health59:967–973, 1969.
76.
McGuireWT: The nature of attitudes and attitude change. In LindzeyGAronsonE (eds): The Handbook of Social Psychology. Reading, Addison-Wesley Publishing Co, 1969.
77.
MillerGE: Continuing education for what?J Med Educ42:320–326, 1967.
78.
MillerLA: The current investment in continuing medical education. In EgdahlRGertmanP (eds): Quality Health Care: The Role of Continuing Medical Education. Germantown, Maryland, Aspen Systems Corp, 1977.
79.
RokeachM: Beliefs, Attitudes and Values. San Francisco, Jossey-Bass Inc, 1972, p 112.
80.
RuheChw: Recent events of special interest to medical education. JAMA231(suppl):3–5, 1975.
81.
SanazaroPJ: Medical audit, continuing medical education and quality assurance. West J Med125:241–252, 1976.
82.
SivertsonSE: Individual physician profile: Continuing education related to medical practice. J Med Educ48:1006–1012, 1973.
83.
StearnsNS: Continuing Medical Education in Community Hospitals. Boston, Massachusetts Medical Society, 1971.
84.
WilliamsonJW: Evaluating quality of patient care. JAMA218:564–569, 1971.
85.
WilliamsonJW: Improving Medical Practice and Health Care. Cambridge, Massachusetts, Ballinger Publishing Co, 1977.
86.
WilliamsonJW: Priorities in patient-care research and continuing medical education. JAMA204:303–308, 1968.
