Evaluation from Start to Finish: Incorporating Comprehensive Assessment into a Training Program for Public Health Professionals

Abstract

This article examines the role of a comprehensive evaluation process in the context of a program to enhance use of the Internet by public health professionals. The Public Health Information Link for Nevada incorporated training and Web site development into a program to raise levels of awareness and competence of the public health professional. Evaluation played a key and ongoing role in the planning and implementation phases and made a marked contribution to the overall effectiveness of the project. Evaluation contributed to the ability to make midprogram adjustments, thereby enhancing user satisfaction and confidence. Participant evaluations indicated significant improvement in self-perceived competence in utilizing the Internet for job-related activities. The authors conclude that the effort to integrate evaluation in an ongoing manner is balanced by the value of continuous feedback. A Web site review checklist, which will be useful to public health professionals who are developing new Web sites, is appended.

Keywords

comprehensive evaluation Web site evaluation Internet utilization

Get full access to this article

View all access options for this article.

References

Alfers, D. , & Butterfoss, F. D. (2000). Evaluation on a shoestring: Key to success for Virginia prenatal incentive program. Health Promotion Practice, 1(3), 259-267.

Allen, M. J. , Kaufman, D. M. , Barrett, A. , Paterson, G. , Sargeant J. , & McLeod, R. (2000). Self-reported effects of computer workshops on physicians’ computer use. The Journal of Continuing Education in the Health Professions, 20(1), 20-26.

Baranowski, T. , & Stables, G. (2000). Process evaluations of the 5-a-day projects. Health Education and Behavior, 27(2), 157-166.

Capwell, E. M. , Butterfoss, F. , & Francisco, V. T. (2000). Why evaluate? Health Promotion Practice, 1(1), 15-20.

Centers for Disease Control and Prevention (CDC) . (1999). CDC taskforce on public health workforce development: Draft report. Atlanta, GA: Author.

Gilliam, A. , Davis, D. , Barrington, T. , Lacson, R. , Uhl, G. , & Phoenix, U. (2002). The value of engaging stakeholders in planning and implementing evaluations. AIDS Education and Prevention, 14(Suppl. A), 5-17.

Goldstein, I. , & Gilliam, P. , (1990). Training system issues in the year 2000. American Psychologist, 45, 134-143.

Head, A. J. (1999). Web redemption and the promise of usability. Online, 23(6), 20-23.

Helitzer, D. B. , Davis, S. M. , Gittelsohn, J. , Going, S. B. , Murray, D. M. , Snyder, P. , et al. (1999). Process evaluation in a multisite, primary obesity-prevention trial in American Indian schoolchildren. American Journal of Clinical Nutrition, 69(4 Suppl.), 816S-824S.

10.

Henner, T. , & Charles, P. (2002). Using focus groups to guide development of a public health Web site. Medical Reference Services Quarterly, 21(4), 15-22.

11.

Hollis, V. , Openshaw, S. , & Goble, R. (2002). Conducting focus groups: Purpose and practicalities. The British Journal of Occupational Therapy, 65(1), 2-8.

12.

Hughes, R. (2001). A process evaluation of a Web site for family life education. Family Relations, 50(2), 164-170.

13.

Israel, B. A. , Cummings, K. M. , Dingnan, M. B. , Heaney, C. A. , Perales, D. P. , Simons-Morton, B. G. , et al. (1995). Evaluation of health education programs: Current assessment and future directions. Health Education Quarterly, 22(3), 364-389.

14.

Krueger, R. (1988). Focus groups: A practical guide for applied research. Newbury Park, CA: Sage.

15.

Lasker, R. D. , Humphreys, B. L. , and Braithwaite, W. R. (1995). Making a powerful connection: The health of the public and the national information infrastructure (Report of the U.S. Public Health Service Public Health Data Policy Coordinating Committee). Retrieved August 2, 2002, from the U.S. Department of Health and Human Services Web site: http://aspe.hhs.gov/datacncl/phniiwp.htm

16.

Muraskin, L. (1993). Understanding evaluation: The way to better prevention programs. Washington, DC: U.S. Department of Education.

17.

Office of Management and Budget . (1993). Government Performance Results Act of 1993. Retrieved from www.whitehouse.gov/omb/mgmt-gpra/gplaw2m.html

18.

Patton, M. Q. (1997). Utilization focused evaluation (3rd ed.). Thousand Oaks, CA: Sage.

19.

Patton, M. Q. (2001). The CEFP as a model for integrating evaluation within organizations. Cancer Practice, 9(Suppl.1), S11-S16.

20.

Pealer, L. N. , & Dorman, S. M. (1997). Evaluating health-related Web sites. Journal of School Health 1997, 67(6), 232-235.

21.

Rogers, E. M. (1995). Diffusion of innovations (4th ed.). New York: Free Press.

22.

Rogers, E. M. , & Scott, K. L. (1997). The diffusion of innovations model and outreach from the national network of libraries of medicine to Native American communities. Retrieved from http://nnlm.gov/pnr/eval/rogers.html

23.

Roper, W. L. , Baker, E. L. , Dyal, W. M. , & Nicola, R. M. (1992). Strengthening the public health system. Public Health Reports, 107(6), 609-615.

24.

Stout, R. (1997). Web site traffic reports: A simple analysis. NetGuide, 4(3), 147-149.