This article summarizes critical evaluation needs, challenges, and lessons learned in translational research. Evaluation can play a key role in enhancing successful application of research-based programs and tools as well as informing program refinement and future research. Discussion centers on what is unique about evaluating programs and policies for implementation impact (or potential for dissemination). Central issues reviewed include the importance of context and local issues, robustness and external validity issues, multiple levels of evaluation, implementation fidelity versus customization, choosing evaluation designs to fit questions, and who participates and characteristics of success at each stage of program recruitment, delivery, and outcome. The use of mixed quantitative and qualitative methods is especially important, and the primary redirection that is needed is to focus on questions of decision makers and potential adoptees rather than the research colleagues.
Baranowski, T., Lin, L.S., Wetter, D.W., Resnicow, K., & Davis, H.M. ( 1997). Theory as mediating variables: Why aren’t community interventions working as desired? Annals of Epidemiology, 7, S89-S95.
2.
Basch, C.E., Sliepcevich, E.M., & Gold, R.S. ( 1985). Avoiding type III errors in health education program evaluations. Health Education Quarterly, 12, 315-331.
3.
Bellg, A.J., Borrelli, B., Resnick, B., Ogedegbe, G., Hecht, J., Ernst, D., et al. (2004). Enhancing treatment fidelity in health behavior change studies: Best practices and recommendations from the Behavior Change Consortium. Health Psychology, 23, 443-451.
4.
Berwick, D.M. ( 1996). A primer on leading the improvement of systems. British Medical Journal, 312, 619-622.
5.
Besculides, M., Zaveri, H., Farris, R., & Will, J. ( 2006). Identifying best practices for WISEWOMAN programs using a mixed-methods evaluation. Preventing Chronic Disease, 3, 1-9.
Castro, F.G., Barrera, M., Jr., & Martinez, C.R. , Jr. (2004). The cultural adaptation of prevention interventions: Resolving tensions between fidelity and fit. Prevention Science, 5, 41-45.
8.
Crabtree, B.F., & Miller, W.L. ( 1999). Depth interviewing. In B. F. Crabtree & W. L. Miller (Eds.), Doing qualitative research (pp. 89-107). Thousand Oaks, CA: Sage.
9.
Glasgow, R.E. ( 2008). What types of evidence are most needed to advance behavioral medicine? Annals of Behavioral Medicine, 35, 19-25.
10.
Glasgow, R.E., Davidson, K.W., Dobkin, P.L., Ockene, J., & Spring, B. ( 2006a). Practical behavioral trials to advance evidence-based behavioral medicine. Annals of Behavioral Medicine, 31, 5-13.
11.
Glasgow, R.E., & Emmons, K.M. ( 2007a). How can we increase translation of research into practice ? Annual Review of Public Health, 28, 413-433.
12.
Glasgow, R.E., Klesges, L.M., Dzewaltowski, D.A., Bull, S.S., & Estabrooks, P. (2004). The future of health behavior change research: What is needed to improve translation of research into health promotion practice? Annals of Behavioral Medicine, 27, 3-12.
13.
Glasgow, R.E., Lichtenstein, E., & Marcus, A.C. ( 2003). Why don’t we see more translation of health promotion research to practice? Rethinking the efficacy to effectiveness transition . American Journal of Public Health, 93, 1261-1267.
14.
Glasgow, R.E., & Linnan, L. ( 2007b). Evaluation of theory-based interventions. In K. Glanz (Ed.), Health education: Theory, research and practice (4th ed. pp. 487-506). Hoboken, NJ: Jossey-Bass.
15.
Glasgow, R.E., Magid, D.J., Beck, A., Ritzwoller, D., & Estabrooks, P.A. (2005). Practical clinical trials for translating research to practice: Design and measurement recommendations . Medical Care, 43, 551-557.
16.
Glasgow, R.E., McKay, H.G., Piette, J.D., & Reynolds, K.D. (2001). The RE-AIM framework for evaluating interventions: What can it tell us about approaches to chronic illness management? Patient Education and Counseling, 44, 119-127.
17.
Glasgow, R.E., Strycker, L.A., King, D., Toobert, D., Kulchak Rahm, A., Jex, M., et al. (2006b). Robustness of a computer-assisted diabetes self-management intervention across patient characteristics, healthcare settings, and intervention staff. American Journal of Managed Care, 12, 137-145.
18.
Goodman, R.M., McLeroy, K.R., Steckler, A., & Hoyle, R. ( 1993). Development of level of institutionalization scales for health promotion programs. Health Education Quarterly, 20, 161-178.
19.
Green, L.W., & Kreuter, M.W. ( 2005). Health promotion planning: An educational and ecological approach (4th ed.). Mountain View, CA: Mayfield.
20.
Green, L.W., & Ottosen, J.M. ( 2004, January 12-13). From efficacy to effectiveness to community and back: Evidence-based practice vs. practice-based evidence. Proceedings from conference From Clinical Trials to Community: The Science of Translating Diabetes and Obesity Research, National Institutes of Diabetes, Digestive and Kidney Diseases, Bethesda, MD.
21.
Institute of Medicine & Committee on Quality Health Care in America. (2003). Crossing the quality chasm: A new health system for the 21st century. Washington, DC : National Academies Press.
22.
Kaplan, R.M. ( 2003). The significance of quality of life in health care. Quality of Life Research, 12, 3-16.
23.
Kingdon, J. ( 1995). Agendas, alternatives, and public policy (2nd ed.). New York: Harper Collins.
24.
Klesges, L.M., Estabrooks, P.A., Glasgow, R.E., & Dzewaltowski, D. (2005). Beginning with the application in mind: Designing and planning health behavior change interventions to enhance dissemination. Annals of Behavioral Medicine, 29, 66S-75S.
25.
Linnan, L., & Steckler, A. ( 2002). Process evaluation and public health interventions: An overview. In A. Steckler & L. Linnan (Eds.), Process evaluation in public health interventions and research (pp. 1-23). San Francisco : Jossey-Bass.
26.
McGlynn, E.A., Asch, S.M., Adams, J., Keesey, J., Hicks, J., DeCristofaro, A., et al. (2003). The quality of health care delivered to adults in the United States. New England Journal of Medicine , 348, 2635-2645.
27.
Orleans, C.T. ( 2000). Promoting the maintenance of health behavior change: Recommendations for the next generation of research and practice. Health Psychology, 19, 76-83.
28.
Ory, M.G., Mier, N., Sharkey, J.R., & Anderson, L.A. (2007). Translating science into public health practice: Lessons from physical activity interventions. Alzheimer’s and Dementia, 3, S57.
29.
Pawson, R., Greenhalgh, T., Harvey, G., & Walshe, K. ( 2005). Realist review: A new method of systematic review designed for complex policy interventions. Journal of Health Services Research & Policy, 10, S21-S39.
30.
Reynolds, K.D., Buller, D.B., Yaroch, A.L., Maloy, J.A., & Cutter, G.R. ( 2006). Mediation of a middle school skin cancer prevention program . Health Psychology, 25, 616-625.
31.
Ritzwoller, D.P., Toobert, D., Sukhanova, A., & Glasgow, R.E. ( 2006). Economic analysis of the Mediterranean Lifestyle Program for postmenopausal women with diabetes. Diabetes Educator , 32, 761-769.
32.
Rotheram-Borus, M.J., Flannery, D., & Duan, N. ( 2004). Interventions that are CURRES: Cost-effective, useful, realistic, robust, evolving, and sustainable. In H. Rehmschmidt, M. L. Belfer & I. Goodyer (Eds.), Facilitating pathways: Care, treatment, and prevention in child and adolescent health (pp. 235-244). New York: Springer.
33.
Rovniak, L.S., Hovell, M.F., Wojcik, J.R., Winett, R.A., & Martinez-Donate, A.P. (2005). Enhancing theoretical fidelity: An e-mail-based walking program demonstration. American Journal of Health Promotion, 20, 85-95.
34.
Shadish, W.R., Cook, T.D., & Campbell, D.T. (2002). Experimental and quasi-experimental design for generalized causal inference. Boston: Houghton Mifflin.
35.
Tunis, S.R., Stryer, D.B., & Clancey, C.M. ( 2003). Practical clinical trials. Increasing the value of clinical research for decision making in clinical and health policy. Journal of the American Medical Association, 290, 1624-1632.
36.
Viswanathan, M., Ammerman, A., Eng, E., Gartlehner, G., Lohr, K.N., Griffith, D., et al. (2004). Community-based participatory research: Assessing the evidence (Evidence Report/Technology Assessment No. 99; Rep. No. AHRQ Pub No. 04-E022-2). Rockville, MD: Agency for Healthcare Research and Quality.
