The current emphasis on best practices for school-based health and mental health programs brings with it the demand for evaluation efforts in schools. This article describes the challenges of launching a successful school program and evaluation, with lessons learned from three projects that focus on intimate partner violence. The authors discuss issues related to constraints on the research design in schools, the recruitment of schools and participants within schools, program and evaluation implementation issues, the iterative implementation-evaluation cycle, and the dissemination of programs and study findings. The authors emphasize the need for flexibility and cultural awareness during all stages of the process.
Adcock, A. G., Nagy, S., & Simpson, J. A. (1991). Selected risk factors in adolescent suicide attempts. Adolescence, 26(104), 817-828.
2.
Barrios, L. C., Davis, M. K., Kann, L., Desai, S., Mercy, J. A., Reese, L. E., et al. (2001). School health guidelines to prevent unintentional injuries and violence [Electronic version]. Morbidity and Mortality Weekly Reports, 50(RR22), 1-46.
3.
Children’s Hospital of Los Angeles. (2000). Teen relationship abuse: A summary of a needs assessment from Los Angeles, Ventura, San Luis Obispo & Kern Counties. Los Angeles: Children’s Hospital of Los Angeles, Division of Adolescent Medicine.
4.
Cline, A., Schafer-Kalkhoff, T., Strickland, E., & Hamann, T. (2005). Recruitment strategies for the Princeton (Ohio) City School District epidemiological study. Journal of School Health, 75(5), 189-191.
5.
Community Health Scholars Program. (n.d.). Program goals and competencies. Retrieved June 9, 2005, from http://www.sph.umich.edu/chsp/program/index.shtml
6.
Donabedian, A. (1988). The quality of care: How can it be assessed?Journal of the American Medical Association, 260, 1743-1748.
7.
Ellickson, P. L. (1994). Getting and keeping schools and kids for evaluation studies. Journal of Community Psychology [CSAP Special Issue], pp. 102-116.
8.
Ennett, S. T., Tobler, N. S., Ringwalt, C. L., & Flewelling, R. L. (1994). How effective is drug abuse education? A meta-analysis of Project DARE outcome evaluations. American Journal of Public Health, 84(9), 1394-1401.
9.
Evans, S. W., Axelrod, J. L., & Sapia, J. K. (2000). Effective school-based mental health interventions: Advancing the social skills training paradigm. Journal of School Health, 70(5), 191-194.
10.
Fisher, P. A., & Ball, T. J. (2002). The Indian Family Wellness Project: An application of the tribal participatory research model. Prevention Science, 3, 235-240.
11.
Flay, B. R. (1986). Efficacy and effectiveness trials in the development of health promotion programs. Preventive Medicine, 15, 451-474.
12.
Flay, B. R., Biglan, A., Boruch, R. F., Castro, F. G., Gottfredson, D., Kellam, S., et al. (2005). Standards of evidence: Criteria for efficacy, effectiveness, and dissemination. Prevention Science, 6(3), 151-175.
13.
Flay, B. R., & Collins, L. M. (2005). Historical review of school-based randomized trials for evaluating problem behavior prevention programs. Annals of the American Academy of Political and Social Science, 599(1), 115-146.
14.
Foshee, V. A., Linder, G. F., Bauman, K. E., Langwick, S. A., Arriaga, X. B., Heath, J. L., et al. (1996). The Safe Dates Project: Theoretical basis, evaluation design, and selected baseline findings. American Journal of Preventive Medicine, 12(Suppl. 5), 39-47.
15.
Gittelsohn, J., Davis, S. M., Steckler, A., Ethelbah, B., Clay, T., Metcalfe, L., et al. (2003). Pathways: Lessons learned and future directions for school-based interventions among American Indians. Preventive Medicine, 37(6), S107-S112.
16.
Glasgow, R. E., Lichtenstein, E., & Marcus, A. C. (2003). Why don’t we see more translation of health promotion research to practice? Rethinking the efficacy-to-effectiveness transition. American Journal of Public Health, 93(8), 1261-1267.
17.
Grunbaum, J. A., Labarthe, D. R., Ayars, C., Harrist, R., & Nichaman, M. Z. (1996). Recruitment and enrollment for Project HeartBeat! Achieving the goals of minority inclusion. Ethnicity & Disease, 6(3-4), 203-212.
18.
Horowitz, J. A., Vessey, J. A., Carlson, K. L., Bradley, J. F., Montoya, C., & McCullough, B. (2003). Conducting school-based focus groups: Lessons learned from the CATS project. Journal of Pediatric Nursing, 18(5), 321-331.
19.
Institute of Medicine. (1997). Challenges in school health research and evaluation. In D. Allensworth, E. Lawson, L. Nicholson, & J. Wyche (Eds.), Schools and health: Our nation’s investment (pp. 271-295). Washington, DC: National Academies Press.
20.
Kirby, D. (2001). Emerging answers: Research findings on programs to reduce teen pregnancy. Washington, DC: National Campaign to Prevent Teen Pregnancy.
21.
Kirby, D. (2002). Do abstinence-only programs delay the initiation of sex among young people and reduce teen pregnancy?Washington, DC: National Campaign to Prevent Teen Pregnancy.
22.
Klindera, K., & Pagliaro, S. (1999). Youth development can strengthen prevention programs. Transitions, 10(4), 1-1, 5-6, 13-13.
23.
Komro, K. A., Perry, C. L., Williams, C. L., Stigler, M. H., Farbakhsh, K., Veblen-Mortenson, S. (2001). How did Project Northland reduce alcohol use among young adolescents? Analysis of mediating variables. Health Education Research, 16(1), 59-70.
24.
Lytle, L. A., Davidann, B. Z., Bachman, K., Edmundson, E. W., Johnson, C. C., Reeds, J. N., et al. (1994). CATCH: Challenges of conducting process evaluation in a multicenter trial. Health Education Quarterly, Suppl. 2, S129-S142.
25.
MacKinnon, D. P., Johnson, C. A., Pentz, M. A., Dwyer, J. H., Hansen, W. B., Flay, B. R., et al. (1991). Mediating mechanisms in a school-based drug prevention program: First-year effects of the Midwestern Prevention Project. Health Psychology, 10(3), 164-172.
26.
McGlynn, E. A., Norquist, G. S., Wells, K. B., Sullivan, G., & Liberman, R. P. (1988). Quality-of-care research in mental health: Responding to the challenge. Inquiry, 25, 157-170.
27.
McMorris, B. J., Clements, J., Evans-Whipp, T., Gangnes, D., Bond, L., Tumbourou, J. W., et al. (2004). A comparison of methods to obtain active parental consent for an international student survey. Evaluation Review, 28(1), 64-83.
28.
Murray, D. M. (1998). Design and analysis of group randomize trials. New York: Oxford University Press.
29.
Nabors, L. A., Weist, M. D., & Reynolds, M. W. (2000). Overcoming challenges in outcome evaluations of school mental health programs. Journal of School Health, 70(5), 206-209.
30.
Nagy, S., Adcock, A. G., & Nagy, M. C. (1994). A comparison of risky health behaviors of sexually active, sexually abused, and abstaining adolescents. Pediatrics, 93(4), 570-575.
31.
Nagy, S., DiClemente, R., & Adcock, A. G. (1995). Adverse factors associated with forced sex among southern adolescent girls. Pediatrics, 96(5), 944-946.
32.
Nichols, C. (2004). Supporting violence prevention at the school site issues and lessons in state administration. American Journal of Preventive Medicine, 26, 74-77.
33.
Ocampo, B. W., Shelley, G., & Jaycox, L. H. (in press). Latino teens talk about help-seeking and help-giving in relation to dating violence. Violence Against Women.
34.
Orlando, M., Jaycox, L. H., McCaffrey, D. F. & Marshall, G. N. (2006). Improving the measurement of socially unacceptable attitudes and behaviors with item response theory (Working Paper WR-383). Santa Monica, CA: RAND.
35.
Peterson, A. V., Jr., Kealey, K. A., Mann, S. L., Marek, P. M., & Sarason, I. G. (2000). Hutchinson Smoking Prevention Project: Long-term randomized trial in school-based tobacco use prevention—Results on smoking. Journal of the National Cancer Institute, 92(24), 1979-1991.
36.
Pokorny, S. B., Jason, L. A., Schoeny, M. E., Townsend, S. M., & Curie, C. J. (2001). Do participation rates change when active consent procedures replace passive consent?Evaluation Review, 25(5), 567-580.
37.
President’s New Freedom Commission on Mental Health. (2003). Achieving the promise: Transforming mental health care in America (Final report, DHHS Pub. No. SMA-03-3832. Rockville, MD: U.S. Department of Health and Human Services.
38.
Raab, G. M., & Butcher, I. (2001). Balance in cluster randomized trials. Statistics in Medicine, 20, 351-365.
39.
Schuster, M. A., Bell, R. M., Berry, S. H., & Kanouse, D. E. (1998). Impact of a high school condom availability program on sexual attitudes and behaviors. Family Planning Perspectives, 30, 67-72.
40.
Shadish, W. R., Cook, T. D., & Campbell, D. T. (2002). Experimental and quasi-experimental designs for generalized causal inference. Boston: Houghton Mifflin.
41.
Tingle, L. R., DeSimone, M., & Covington, B. (2003). A meta-evaluation of 11 school-based smoking prevention programs. Journal of School Health, 73(2), 64-68.
42.
Unger, J. B., Gallaher, P., Palmer, P. H., Baezconde-Garbanati, L., Trinidad, D. R., Cen, S., et al. (2004). No news is bad news: Characteristics of adolescents who provide neither parental consent nor refusal for participation in school-based survey research. Evaluation Review, 28(1), 52-63.
43.
U.S. Department of Health and Human Services. (1999). Understanding substance abuse prevention: Toward the 21st century: A primer on effective programs (DHHS Pub. No. SMA99-3301). Rockville, MD: Author.
44.
U.S. Department of Health and Human Services. (2001). Youth violence: A report of the surgeon general. Rockville, MD: U.S. Department of Health and Human Services, Substance Abuse and Mental Health Services Administration, Center for Mental Health Services, National Institutes of Health, National Institute of Mental Health.
45.
Wandersman, A., & Florin, P. (2003). Community interventions and effective prevention. American Psychologist, 58(6-7), 441-448.
46.
Weisz, J. R., Donenberg, G. R., Han, S. S., & Weiss, B. (1995). Bridging the gap between laboratory and clinic in child and adolescent psychotherapy. Journal of Consulting & Clinical Psychology, 63(5), 688-701.
