Evaluation of community-based, teen pregnancy prevention initiatives is complex. This article describes the challenges encountered and solutions derived while creating a comprehensive evaluation of teen pregnancy prevention initiatives across 46 counties in a southeastern state. Background information on the evaluation and highlights of the data collection constructs, methods, and tools are provided. In particular, the efforts to appropriately scope the evaluation activities and the use of qualitative and quantitative methods are discussed. In addition, the key lessons learned from the evaluation are presented. This article's discussion of contextual influences and evaluation planning and implementation efforts may benefit program practitioners and evaluators in their future evaluation activities.
Get full access to this article
View all access options for this article.
References
1.
Benson, P. L. (1997). All kids are our kids: What communities must do to raise caring and responsible children and adolescents. San Francisco: Jossey-Bass.
2.
Brandt, P. A. (1999). A case for abstinence education: Friends of the family, citizenlink research papers. Retrieved November 30, 2000, from http://www.family.org
3.
Brener, N. D., Collins, J. L., Warren, C. W., & Williams, B. I. (1995). Reliability of the youth risk behavior survey questionnaire. American Journal of Epidemiology, 141, 575-580.
4.
Brindis, C. D., Irwin, C. E., Jr., Ozer, E. M., Handley, M., Knopt, D. C., & Millstein, S. G. (1997). Improving adolescent health: An analysis and synthesis of health policy recommendations. San Francisco: University of California, San Francisco, National Adolescent Health Information Center.
5.
Butterfoss, F., Goodman, R. M., Wandersman, A., Valois, R. F., & Chinman, M. (1996). The plan quality index: An empowerment evaluation tool for measuring and improving the quality of plans. In D. Fetterman, S. Kaftarian, & A. Wandersman (Eds.), Empowerment evaluation knowledge and tools for self-assessment and accountability (2nd ed., pp. 304-331). Thousand Oaks, CA: Sage.
6.
Campbell, D. T. (1955). The informant in quantitative research. The American Journal of Sociology, 60, 339-342.
7.
De la Cruz, D. S. (1997). A quantitative evaluation to determine the effect of a community-based program on community key leaders' levels of awareness, concern, and action toward the reduction and prevention of the abuse of alcohol, tobacco, and other drugs. Unpublished doctoral dissertation, University of South Carolina, School of Public Health.
8.
Denham, A., Quinn, S. C., & Gamble, D. (1998). Community organizing for health promotion in the rural south: An exploration of community competence. Family and Community Health, 21, 1-21.
9.
Denzin, N. K. (1978). The research act: A theoretical introduction to sociological methods. New York: McGraw-Hill.
10.
Devillis, R. F. (1991). Scale development: Theory and application (Vol. 26). Newbury Park, CA: Sage.
11.
Dignan, M. B., & Carr, P. A. (1992). Program planning for health education and promotion (2nd ed., Vol. 1). Philadelphia: Lee & Febiger.
12.
Dryfoos, J. G. (1990). Adolescents at risk: Prevalence and prevention. New York: Oxford University Press.
13.
Edgar, W. (1998). South Carolina: A history (1st ed.). Columbia: University of South Carolina Press.
14.
Eng, E., & Parker, E. (1994). Measuring community competence in the Mississippi delta: The interface between program evaluation and empowerment. Health Education Quarterly, 21, 199-220.
15.
Eyler, A. A., Mayer, J., Rafii, R., Housemann, R., Brownson, R. C., & King, A. C. (1999). Key informant surveys as a tool to implement and evaluate physical activity interventions in the community. Health Education Research, 14, 289-298.
16.
Family and Youth Service Bureau. (1998). Preventing adolescent pregnancy: A youth development approach. Washington, DC: U.S. Department of Health and Human Services.
17.
Fawcett, S. B., Francisco, V. T., Paine-Andrews, A., Lewis, R. K., Richter, K. P., & Harris, K. J., et al. (1995). Work group evaluation handbook: Evaluating and supporting community initiatives for health development. Lawrence, KS: Work Group on Health Promotion and Community Development, the Schiefelbush Institute for Life Span Studies.
18.
Fawcett, S. B., Paine-Andrews, A., Francisco, V. T., Richter, K. P., Lewis, R. K., & Harris, K. J., et al. (1994). Preventing adolescent pregnancy: An action planning guide for community-based initiatives. Lawrence, KS: Work Group on Health Promotion and Community Development, the Schiefelbusch Institute for Life Span Studies.
19.
Fishman, E. L., Betzner, A., Luxenberg, M., Schmidt, C., & Rainey, J. (1999, November 10). State-wide Evaluation of Two Community-Based Teen Pregnancy Prevention Programs: MNENABL and the Minnesota Abstinence Education Community Grants Program. Paper presented at the American Public Health Association annual meeting, Chicago.
20.
Glaser, M. A., Denhardt, K. G., & Grubbs, J. W. (1997). Local government-sponsored community development: Exploring relationship between perceptions of empowerment and community impact. American Review of Public Administration, 27, 76-94.
21.
Goodman, R. M., Speers, M. A., McLeroy, K., Fawcett, S., Kegler, M., & Parker, E., et al. (1998). Identifying and defining the dimensions of community capacity to provide a basis for measurement. Health Education Quarterly, 25, 258-278.
22.
Goodman, R. M., Wandersman, A., Chinman, M., Imm, P., & Morrissey, E. (1996). An ecological assessment of community-based interventions for prevention and health promotion: Approaches to measuring community coalitions. Amercian Journal of Community Psychology, 24, 33-62.
23.
Green, L. W., & Kreuter, M. W. (1999). Health promotion planning: An educational and ecological approach (3rd ed.). Mountain View, CA: Mayfield.
24.
Hayes, C. D. (1987). Risking the future: Adolescent sexuality, pregnancy, and childbearing. Washington, DC: National Academy Press.
25.
House, E. R. (1993). Professional evaluation: Social impact and political consequences (1st ed.). Newbury Park, CA: Sage.
26.
Huebner, E. S., Laughlin, L., Ash, C., & Gilman, R. (1998). Further validation of the multidimensional student's life satisfaction scale. Journal of Psychoeducational Assessment, 16, 118-134.
27.
Israel, B. A., Checkoway, B., Schulz, A., & Zimmerman, M. (1994). Health education and community empowerment: Conceptualizing and measuring perceptions of individual, organizational, and community control. Health Education Quarterly, 21, 149-170.
28.
Jemmott, J. B. (1998). Abstinence and safer sex: A randomized trial of HIV sexual risk-reduction interventions for young African-American adolescents. Journal of the American Medical Association, 279, 1529-1536.
29.
Kirby, D. (1997). No easy answers: Research findings on programs to reduce teen pregnancy. Washington, DC: The National Campaign to Prevent Teen Pregnancy.
30.
Kolbe, L. J. (1990). An epidemiological surveillance system to monitor the prevalence of youth behaviors that affect health. Journal of Health Education, 21(6), 44-48.
31.
Kolbe, L. J., Kann, L., & Collins, J. L. (1993). Overview of the youth risk surveillance system. Public Health Reports, 108(Suppl. 1), 2-10.
32.
Leffert, N., Benson, P. L., Scales, P. C., Sharma, A. R., Drake, D. R., & Blyth, D. A. (1998). Developmental assets: measurement and prediction of risk behaviors among adolescents. Applied Developmental Science, 2(4), 209-230.
33.
Lickona, T. (1999). The neglected heart: The emotional dangers of premature sexual involvement. National Abstinence Clearinghouse. Retrieved November 30, 2000, from http://www.abstinence.net
34.
McKenzie, J. F., & Smeltzer, J. L. (1997). Planning, implementing, and evaluating health promotion programs. Boston: Allyn & Bacon.
35.
Medical Institute for Sexual Health. (1998). Eye-opening information on the “success” of “safe sex” programs and exciting news about abstinence education programs. Austin, TX: Author.
36.
National Campaign to Prevent Teen Pregnancy. (2000). Fact sheet: Teen pregnancy and childbearing in South Carolina. Retrieved December 2000 from http://www.teenpregnancy.org
37.
Paine-Andrews, A., Fisher, J. L., Harris, K. J., Lewis, R. K., Williams, E. L., & Vincent, M. L., et al. (2000). Some experiential lessons in supporting and evaluating community-based initiatives for preventing adolescent pregnancy. Health Promotion Practice, 1, 66-76.
38.
Paine-Andrews, A., Fisher, J. L., Lewis, R. K., Fawcett, S. B., & Vincent, M. L. (1999). Effects of a replication of a school/community model for preventing adolescent pregnancy in three Kansas communities. Family Planning Perspectives, 31(64), 182-189.
39.
Paine-Andrews, A., Vincent, M. L., Fawcett, S. B., Campuzano, M. K., Harris, K. J., & Lewis, R. K., et al. (1996). Replicating a community-based initiative for the prevention of adolescent pregnancy: from South Carolina to Kansas. Family and Community Health, 19, 14-30.
40.
Parker, E. A., Eng, E., Schulz, A. J., & Israel, B. A. (1999). Evaluating community-based health programs that seek to increase community capacity. New Directions in Evaluation, 83, 37-54.
41.
Roth, J., Brooks-Gunn, J., Murray, L., & Foster, W. (1998). Promoting healthy adolescents: Synthesis of youth development program evaluation. Journal of Adolescent Research, 8, 423-459.
42.
Scriven, M. (1994). The final synthesis. Evaluation Practice, 15, 367-382.
43.
Seidler, J. (1974). On using informants: A technique for collecting quantitative data and controlling measurement error in organizational analysis. American Journal of Sociology, 39, 816-831.
44.
Smith, E. A., & Potter, S. (1999, November 10). Overview of strategies for evaluating Pennsylvania's abstinence education and related services initiatives. Paper presented at the American Public Health Association annual meeting, Chicago.
45.
South Carolina Department of Health and Environmental Control. (1999). The health of South Carolinians (No. 006048). Columbia, SC: Author.
46.
South Carolina Department of Health and Environmental Control. (2000). South Carolina teen pregnancy data book 1989-1999 (Data Report No. SRS-0001-1000). Columbia, SC: Author.
47.
South Carolina Legislature. (1998). Chapter 122: County grant funds for adolescent pregnancy prevention initiatives. Retrieved January 18, 1999, from http://www.lpitr.state.sc.us/appro/1998/tap2.htm
48.
Steckler, A., McLeroy, K. R., Goodman, R. M., McCormick, L., & Bird, S. T. (1992). Toward integrating qualitative and quantitative methods: An introduction. Health Education Quarterly, 19, 1-8.
49.
Thompson, B., Lichtenstein, E., Corbett, K., Nettekove, L., & Feng, Z. (2000). Durability of tobacco control efforts in the 22 Community Intervention Trial for Smoking Cessation (COMMITT) communities 2 years after the end of intervention. Health Education Research, 15, 353-366.
50.
U.S. Congress. (1996). Personal Responsibility and Work Opportunity Reconciliation Act of 1996, Public Law 104-193, Section 912, Abstinence Education. Retrieved November 30, 1999, from http://www.frwebgate.access.gpo
51.
U.S. Department of Health and Human Services: Public Health Services. (1999). Healthy People 2000 progress review: Family planning. Available from http://odphp.osophs.dhhs.gov/pubs/hp2000/
52.
Valois, R. F., & Fraser, J. G. (1998). The 1997 Carolina youth risk behavior survey and summary report. Columbia: South Carolina Department of Education and the University of South Carolina School of Public Health.
53.
Ventura, S. J., Curtin, S. C., & Mathews, T. J. (2000). Variation in teenage birth rates, 1991-1998: National and state trends. National Statistics Report, 58(6), 1-16.
54.
Vincent, M. L., Clearie, A., & Schluchter, M. (1987). Reducing adolescent pregnancy through school and community-based education. Journal of American Medical Association, 257, 3382-3386.
55.
Von Korff, M., Wickizer, T., Maeser, J., O'Leary, P., Pearson, D., & Beery, W. (1992). Community activation and health promotion: Identification of key organizations. American Journal of Health Promotion, 7, 110-117.
56.
Warheit, G. J., Bulh, J. M., & Bell, R. A. (1978). A critique of social indicators, analysis of key informants surveys as needs assessment methods. Education and Program Planning, 1, 239-247.
57.
Windsor, R., Baranowski, T., Clark, N., & Cutter, G. (1994). Evaluation of health promotion, health education, and disease prevention programs (2nd ed., Vol. 1). Mountain View, CA: Mayfield.
58.
Worthen, B. R., Sanders, J. R., & Fitzpatrick, J. L. (1997). Program evaluation: Alternative approaches and practical guidelines (2nd ed.). Reading, MA: Addison Wesley.
