To determine the relationship between return on investment (ROI) and quality of study methodology in workplace health promotion programs.
Data Source.
Data were obtained through a systematic literature search of National Health Service Economic Evaluation Database (NHS EED), Database of Abstracts of Reviews of Effects (DARE), Health Technology Database (HTA), Cost Effectiveness Analysis (CEA) Registry, EconLit, PubMed, Embase, Wiley, and Scopus.
Study Inclusion and Exclusion Criteria.
Included were articles written in English or German reporting cost(s) and benefit(s) and single or multicomponent health promotion programs on working adults. Return-to-work and workplace injury prevention studies were excluded.
Data Extraction.
Methodological quality was graded using British Medical Journal Economic Evaluation Working Party checklist. Economic outcomes were presented as ROI.
Data Synthesis.
ROI was calculated as ROI = (benefits − costs of program)/costs of program. Results were weighted by study size and combined using meta-analysis techniques. Sensitivity analysis was performed using two additional methodological quality checklists. The influences of quality score and important study characteristics on ROI were explored.
Results.
Fifty-one studies (61 intervention arms) published between 1984 and 2012 included 261,901 participants and 122,242 controls from nine industry types across 12 countries. Methodological quality scores were highly correlated between checklists (r = .84–.93). Methodological quality improved over time. Overall weighted ROI [mean ± standard deviation (confidence interval)] was 1.38 ± 1.97 (1.38–1.39), which indicated a 138% return on investment. When accounting for methodological quality, an inverse relationship to ROI was found. High-quality studies (n= 18) had a smaller mean ROI, 0.26 ± 1.74 (.23–.30), compared to moderate (n= 16) 0.90 ± 1.25 (.90–.91) and low-quality (n= 27) 2.32 ± 2.14 (2.30–2.33) studies. Randomized control trials (RCTs) (n= 12) exhibited negative ROI, −0.22 ± 2.41(–.27 to –.16). Financial returns become increasingly positive across quasi-experimental nonexperimental, and modeled studies: 1.12 ± 2.16 (1.11–1.14), 1.61 ± 0.91 (1.56–1.65), and 2.05 ± 0.88 (2.04–2.06), respectively.
Conclusion.
Overall, mean weighted ROI in workplace health promotion demonstrated a positive ROI. Higher methodological quality studies provided evidence of smaller financial returns. Methodological quality and study design are important determinants.
LernerDRoddayAMCohenJTRogersWH. A systematic review of the evidence concerning the economic impact of employee-focused health promotion and wellness programs. J Occup Environ Med. 2013;55:209–222.
2.
WarnerKEWickizerTMWolfeRA. Economic implications of workplace health promotion programs: review of the literature. J Occup Med. 1988;30:106–112.
3.
van DongenJMProperKIvan WierMF. Systematic review on the financial return of worksite health promotion programmes aimed at improving nutrition and/or increasing physical activity. Obes Rev. 2011;12:1031–1049.
4.
BaickerKCutlerDSongZ. Workplace wellness programs can generate savings. Health Aff (Millwood). 2010;29:304–311.
5.
ChapmanLS. Meta-evaluation of worksite health promotion economic return studies: 2012 update. Am J Health Promot. 2012;26:TAHP1–TAHP12.
6.
GoetzelRZJudayTROzminkowskiRJ. What's the ROI. A systematic review of return on investment (ROI) studies of corporate health and productivity management initiatives. AWHP's Worksite Health. 1999:12–21.
7.
AldanaSG. Financial impact of health promotion programs: a comprehensive review of the literature. Am J Health Promot. 2001;15:296–320.
8.
ChapmanLS. Meta-evaluation of worksite health promotion economic return studies: 2005 update. Am J Health Promot. 2005;19:1–11.
9.
PelletierKR. A review and analysis of the clinical and cost-effectiveness studies of comprehensive health promotion and disease management programs at the worksite: update VIII 2008 to 2010. J Occup Environ Med. 2011;53:1310–1331.
10.
ChiouCFHayJWWallaceJF. Development and validation of a grading system for the quality of cost-effectiveness studies. Med Care. 2003;41:32–44.
11.
OxmanAGroupGW. Grading quality of evidence and strength of recommendations. BMJ. 2004;328:1490–1494.
12.
EversSGoossensMde VetH. Criteria list for assessment of methodological quality of economic evaluations: consensus on health economic criteria. Int J Technol Assess Health Care. 2005;21:240–245.
13.
Centre for Reviews and Dissemination. Systematic Reviews: CRD's Guidance for Undertaking Reviews in Health Care. 3rd ed.York, UK: Centre for Reviews and Dissemination; 2009. Available at: http://www.york.ac.uk/inst/crd/index_guidance.htm. Accessed August 4, 2011.
14.
University of York. Database of abstracts of reviews of effects. Available at: http://www.crd.york.ac.uk/crdweb/. Accessed October 2011.
15.
ShemiltIMugfordMValeLMarshKDonaldsonC, eds. Evidence-Based Decisions and Economics: Health Care, Social Welfare, Education and Criminal Justice. 2nd ed.Hoboken, NJ: Wiley-Blackwell/BMJ Books; 2010.
16.
Campbell and Cochrane Economnics Methods Group. How to add health economics to Cochrane protocols. Available at: http://www.c-cemg.org/. Accessed October 10, 2011.
17.
National Institute for Health and Clinical Excellence. Incorporating health economics in guidelines and assessing resource impact. Chapter 8. In: The Guidelines Manual. London, UK: NICE; 2007. Available at: http://www.nice.org.uk/niceMedia/pdf/GuidelinesManualChapter8.pdf.
PhilipsZBojkeLSculpherM. Good practice guidelines for decision-analytic modelling in health technology assessment: a review and consolidation of quality assessment. Pharmacoeconomics. 2006;24:355–371.
DrummondMFSculpherMJTorranceGW. Methods for the Economic Evaluation of Health Care Programmes. 3rd ed.New York, NY: Oxford University Press; 2005.
22.
DrummondMFJeffersonTO. Guidelines for authors and peer reviewers of economic submissions to the BMJ. The BMJ Economic Evaluation Working Party. BMJ. 1996;313:275–283.
FinkelsteinEALinnanLATateDFLeesePJ. A longitudinal study on the relationship between weight loss, medical expenditures, and absenteeism among overweight employees in the WAY to Health study. J Occup Environ Med. 2009; 51:1367–1373.
25.
DeitzDCookRHerschR. Workplace health promotion and utilization of health services: follow-up data findings. J Behav Health Serv Res. 2005;32:306–319.
26.
MillotJLAymardMBardolA. Reduced efficiency of influenza vaccine in prevention of influenza-like illness in working adults: a 7 month prospective survey in EDF Gaz de France employees, in Rhône-Alpes, 1996–1997. Occup Medi. 2002;52:281–292.
27.
SerxnerSGoldDAndersonDWilliamsD. The impact of a worksite health promotion program on short-term disability usage. J Occup Environ Med. 2001;43:25–29.
28.
ChungMMelnykPBlueD. Worksite health promotion: the value of the Tune Up Your Heart Program. Popul Health Manag. 2009;12:297–304.
29.
ChenowethDHGarrettJ. Cost-effectiveness analysis of a worksite clinic: is it worth the cost?AAOHN J. 2006;54: 84–89; quiz 90–91.
30.
IdeRMizoueTTsukiyamaY. Evaluation of oral health promotion in the workplace: the effects on dental care costs and frequency of dental visits. Community Dent Oral Epidemiol. 2001;29: 213–219.
31.
NelsonDJSennettLLefebvreRC. A campaign strategy for weight loss at worksites. Health Educ Res. 1987;2:27–31.
32.
RenaudLKishchukNJuneauM. Implementation and outcomes of a comprehensive worksite health promotion program. Can J Pub Health. 2008;99:73–77.
33.
SchwartzSMDayBWildenhausK. The impact of an online disease management program on medical costs among health plan members. Am J Health Promot. 2010;25:126–133.
34.
NymanJAAbrahamJMJefferyMMBarleenNA. The effectiveness of a health promotion program after 3 years: evidence from the University of Minnesota. Med Care. 2012;50:772–778.
35.
ShiL. Health promotion, medical care use, and costs in a sample of worksite employees. Eval Rev. 1993;17:475–487.
36.
OzminkowskiRJDunnRLGoetzelRZ. A return on investment evaluation of the Citibank, N.A., health management program. Am J Health Promot. 1999;14:31–43.
37.
HenkeRMGoetzelRZMcHughJIsaacF. Recent experience in health promotion at Johnson & Johnson: lower health spending, strong return on investment. Health Aff. 2011;30:490–499.
38.
BakerKMGoetzelRZPeiX. Using a return-on-investment estimation model to evaluate outcomes from an obesity management worksite health promotion program. J Occup Environ Med. 2008;50: 981–990.
39.
McEachanRRLawtonRJJacksonC. Testing a workplace physical activity intervention: a cluster randomized controlled trial. Int J Behav Nutr Phys Act. 2011;8:29.
40.
Australian Government, Dept of Innovation Industry Science and Research. Key Statistics: Australian Small Businesses. Canberra ACT, Australia: Australian Government; 2011.
At'kovOAzarovAZhukovD. Influenza vaccination in healthy working adults in Russia: observational study of effectiveness and return on investment for the employer. Appl Health Econ Health Policy. 2011;9:89–99.
43.
GibbsJOMulvaneyDHenesCReedRW. Work-site health promotion. Five-year trend in employee health care costs. J Occup Med. 1985;27:826–830.
44.
WoodEAOlmsteadGWCraigJL. An evaluation of lifestyle risk factors and absenteeism after two years in a worksite health promotion program. Am J Health Promot. 1989;4:128–133.
45.
MilaniRVLavieCJ. Impact of worksite wellness intervention on cardiac risk factors and one-year health care costs. Am J Cardiol. 2009;104:1389–1392.
46.
TaoXChenowethDAlfriendAS. Monitoring worksite clinic performance using a cost-benefit tool. J Occup Environ Med. 2009;51:1151–1157.
47.
AldanaSGMerrillRMPriceK. Financial impact of a comprehensive multisite workplace health promotion program. Prev Med. 2005;40:131–137.
48.
IchihashiTMutoTShibuyaK. Cost-benefit analysis of a worksite oral-health promotion program. Ind Health. 2007;45: 32–36.
49.
BerteraRL. The effects of workplace health promotion on absenteeism and employment costs in a large industrial population. Am J Public Health. 1990;80: 1101–1105.
50.
CampbellDSRumleyMH. Cost-effectiveness of the influenza vaccine in a healthy, working-age population. J Occup Environ Med. 1997;39:408–414.
51.
BridgesCBThompsonWWMeltzerMI. Effectiveness and cost-benefit of influenza vaccination of healthy working adults. JAMA. 2000;284:1655–1663.
52.
ColomboGLFerroAVinciMZordanMSerraG. Cost-benefit analysis of influenza vaccination in a public healthcare unit. Ther Clin Risk Manag. 2006;2:219–226.
53.
DilleJH. A worksite influenza immunization program: impact on lost work days, health care utilization, and health care spending. AAOHN J. 1999;47: 301–309.
54.
SamadAHUsulMHZakariaD. Workplace vaccination against influenza in Malaysia: does the employer benefit?J Occup Health. 2006;48:1–10.
55.
MoralesAMartinezMMTasset-TisseauA. Costs and benefits of influenza vaccination and work productivity in a Colombian company from the employer's perspective. Value in Health. 2004;7:433–441.
SchneiderMHäckHJ. Screening for colorectal cancer: a cost benefit analysis on a health prevention programme at the Boehringer Ingelheim Company [in German]. Dtsch Med Wochenschr. 2011;136: 1047–1052.
58.
SchrammelPGriffithsRIGriffithsCB. A workplace breast cancer screening program: costs and components. AAOHN J. 1998;46:523–529.
59.
ShoreGPrasadPZrobakM. Metrofit: a cost-effective fitness program. Fitness in Business. 1989;4:147–153.
60.
ShephardRJ. Twelve years experience of a fitness program for the salaried employees of a Toronto life assurance company. Am J Health Promot. 1992;6:292–301.
61.
MillsPRKesslerRCCooperJSullivanS. Impact of a health promotion program on employee health risks and work productivity. Am J Health Promot. 2007;22: 45–53.
62.
American Heart Association Division of Planning. Heart at Work: Technical Report, Extended Field Studies. Dallas, Tex: American Heart Association; 1987.
63.
GoetzelRZOzminkowskiRJBaaseCMBillottiGM. Estimating the return-on-investment from changes in employee health risks on the Dow Chemical Company's health care costs. J Occup Environ Med. 2005;47:759–768.
64.
GolaszewskiTSnowDLynchW. A benefit-to-cost analysis of a work-site health promotion program. J Occup Med. 1992;34:1164–1172.
65.
GreeneBLMillerJDBrownTM. Economic impact of the BP DownShift Program on blood pressure control among commercial driver license employees. J Occup Environ Med. 2009;51: 542–553.
66.
GroeneveldIFvan WierMFProperKI. Cost-effectiveness and cost-benefit of a lifestyle intervention for workers in the construction industry at risk for cardiovascular disease. J Occup Environ Med. 2011;53:610–617.
67.
MeenanRTVogtTMWilliamsAE. Economic evaluation of a worksite obesity prevention and intervention trial among hotel workers in Hawaii. J Occup Environ Med. 2010;52(suppl 1):S8–S13.
68.
ProperKIde BruyneMCHildebrandtVH. Costs, benefits and effectiveness of worksite physical activity counseling from the employer's perspective. Scand J Work Environ Health. 2004;30:36–46.
69.
TaimelaSJusténSAronenP. An occupational health intervention programme for workers at high risk for sickness absence. Cost effectiveness analysis based on a randomised controlled trial. J Occup Environ Med. 2008;65:242–248.
70.
BowneDWRussellMLMorganJL. Reduced disability and health care costs in an industrial fitness program. J Occup Med. 1984;26:809–816.
71.
DavisLLoyoKGlowkaA. A comprehensive worksite wellness program in Austin, Texas: partnership between Steps to a Healthier Austin and Capital Metropolitan Transportation Authority. Prev Chronic Dis. 2009;6:A60.
72.
LeutzingerJHawesCHunnicuttDRichlingD. Predicting the ratio of benefit to cost in a cardiovascular disease-prevention program. Managing Employee Health Benefits. 1995;3:1–10.
73.
SchultzABLuCBarnettTE. Influence of participation in a worksite health-promotion program on disability days. J Occup Environ Med. 2002;44:776–780.
74.
WindsorRALoweJB. Behavioral impact and cost analysis of a worksite self-help smoking cessation program. Prog Clin Biol Res. 1989;293:231–242.
75.
YenLSchultzABSchaeferC. Long-term return on investment of an employee health enhancement program at a Midwest utility company from 1999 to 2007. Int J Workplace Health Manag. 2010;3:79–96.
76.
AldanaSGJacobsonBHHarrisCJ. Influence of a mobile worksite health promotion program on health care costs. Am J Prev Med. 1993;9:378–383.
77.
GettmanL. Cost/benefit analysis of a corporate fitness program. Fitness in Business. 1986;1:11–17.
78.
NaydeckBLPearsonJAOzminkowskiRJ. The impact of the highmark employee wellness programs on 4-year healthcare costs. J Occup Environ Med. 2008;50:146–156.
79.
HarrisJS. Northern Telecom: a million dollar medically based program in a rapidly changing high tech environment. Am J Health Promot. 1986;1:50–84.
80.
MerrillRMHyattBAldanaSGKinnersleyD. Lowering employee health care costs through the Healthy Lifestyle incentive program. J Public Health Manag Pract. 2011;17:225–232.
81.
BerteraRLOehlLKTelepchakJM. Self-help versus group approaches to smoking cessation in the workplace: eighteen-month follow-up and cost analysis. Am J Health Promot. 1990;4:187–192.
82.
SerxnerSAdamsVGHundahlLS. A smoking cessation pilot program. Hawaii Med J. 1993;52:266–272.
83.
HarveyMRWhitmerRWHilyerJCBrownKC. The impact of a comprehensive medical benefit cost management program for the city of Birmingham: results at five years. Am J Health Promot. 1993;7:296–303.
84.
FooteAErfurtJC. The benefit to cost ratio of work-site blood pressure control programs. JAMA. 1991;265:1283–1286.
85.
AltmanDGBlandJM. Measurement in medicine: the analysis of method comparison studies. The Statistician. 1983; 32:307–317.
86.
PelletierKR. A review and analysis of the clinical and cost-effectiveness studies of comprehensive health promotion and disease management programs at the worksite: update VI 2000–2004. J Occup Environ Med. 2005;47:1051–1058.
87.
PelletierKR. A review and analysis of the clinical and cost-effectiveness studies of comprehensive health promotion and disease management programs at the worksite: 1995–1998 update (IV). Am J Health Promot. 1999;13:333–345, iii.
88.
Hamberg-van ReenenHHProperKIvan den BergM. Worksite mental health interventions: a systematic review of economic evaluations. J Occup Environ Med. 2012;69:837–845.
89.
TsaiSPBernackiEJBaunWB. Injury prevalence and associated costs among participants of an employee fitness program. Prev Med. 1988;17:475–482.
90.
SteinADKarelTZuidemaR. Carrots and sticks: impact of an incentive/disincentive employee flexible credit benefit plan on health status and medical costs. Am J Health Promot. 1999;13:260–267.
91.
ShimizuTNagashimaSMizoueT. A psychosocial-approached health promotion program at a Japanese worksite. J UOEH. 2003;25:23–34.
92.
ShiL. Worksite health promotion and changes in medical care use and sick days. J Health Behav Ed Promot. 1993;17:9–17.
93.
MaesSVerhoevenCKittelFScholtenH. Effects of a Dutch work-site wellness-health program: the Brabantia Project. Am J Public Health. 1998;88:1037–1041.
94.
LynchWDGolaszewskiTJClearieAF. Impact of a facility-based corporate fitness program on the number of absences from work due to illness. J Occup Med. 1990;32:9–12.
95.
KnightKKGoetzelRZFieldingJE. An evaluation of Duke University's LIVE FOR LIFE health promotion program on changes in worker absenteeism. J Occup Med. 1994;36:533–536.
96.
JefferyRWForsterJLDunnBV. Effects of work-site health promotion on illness-related absenteeism. J Occup Med. 1993;35:1142–1146.
97.
HodgesLCHarperTSHall-BarrowJTatomID. Reducing overall health care costs for a city municipality: a real life community based learning model. AAOHN J. 2004;52:247–253.
98.
Hall-BarrowJHodgesLBrownP. A collaborative model for employee health and nursing education. Successful program. AAOHN J. 2001;49:429–436.
99.
GoetzelRZDunnRLOzminkowskiRJ. Differences between descriptive and multivariate estimates of the impact of Chevron Corporation's Health Quest Program on medical expenditures. J Occup Environ Med. 1998;40:538–545.
100.
DaltonBAHarrisJS. A comprehensive approach to corporate health management. J Occup Med. 1991;33:338–347.
101.
EdingtonDWYenLTWittingP. The financial impact of changes in personal health practices. J Occup Environ Med. 1997;39:1037–1046.
102.
ConradKMRiedelJEGibbsJO. Effect of worksite health promotion programs on employee absenteeism. A comparative analysis. AAOHN J. 1990;38:573–580.
103.
CadyLDJr.ThomasPCKarwaskyRJ. Program for increasing health and physical fitness of fire fighters. J Occup Med. 1985;27:110–114.
104.
BerteraRL. Behavioral risk factor and illness day changes with workplace health promotion: two-year results. Am J Health Promot. 1993;7:365–373.
105.
BaunWBBernackiETsaiSP. A preliminary investigation: effect of a corporate fitness program on absenteeism and health care cost. J Occup Med. 1986;28:18–22.
106.
AnderzénIArnetzBB. The impact of a prospective survey-based workplace intervention program on employee health, biologic stress markers, and organizational productivity. J Occup Environ Med. 2005;47:671–682.
107.
TrudeauJVDeitzDKCookRF. Utilization and cost of behavioral health services: employee characteristics and workplace health promotion. J Behav Health Serv Res. 2002;29:61–74.
108.
BlyJLJonesRCRichardsonJE. Impact of worksite health promotion on health care costs and utilization. Evaluation of Johnson & Johnson Live for Life program. JAMA. 1986;256:3235–3240.
109.
BlairSNSmithMCollingwoodTR. Health promotion for educators: impact on absenteeism. Prev Med. 1986;15:166–175.
110.
GoetzelRZJacobsonBHAldanaSG. Health care costs of worksite health promotion participants and non-participants. J Occup Environ Med. 1998; 40:341–346.
111.
HenritzeJBrammellHLMcGloinJ. LIFECHECK: a successful, low touch, low tech, in-plant, cardiovascular disease risk identification and modification program. Am J Health Promot. 1992;7:129–136.
112.
JonesRCBlyJLRichardsonJE. A study of a work site health promotion program and absenteeism. J Occup Med. 1990;32: 95–99.
113.
SciaccaJSeehaferRReedRMulvancyD. The impact of participation in health promotion on medical costs: a reconsideration of the Blue Cross and Blue Shield of Indiana study. Am J Health Promot. 1993;7:374–383, 395.
114.
SerxnerSAGoldDBGrossmeierJJAndersonDR. The relationship between health promotion program participation and medical costs: a dose response. J Occup Environ Med. 2003;45:1196–1200.
PageMJParamoreLCDoshiDRupnowMFT. Evaluation of resource utilization and cost burden before and after an employer-based migraine education program. J Occup Environ Med. 2009;51: 213–220.
Bureau of Labor Statistics. Employer Costs for Employee Compensation Summary. Washington, DC: Bureau of Labor Statistics; 2009.
120.
NixonJStoykovaBGlanvilleJ. The U.K. NHS economic evaluation database. Economic issues in evaluations of health technology. Int J Technol Assess Health Care. 2000;16:731–742.
121.
ZarnkeKBLevineMAO'BrienBJ. Cost-benefit analyses in the health-care literature: don't judge a study by its label. J Clin Epidemiol. 1997;50:813–822.
122.
Dept of Business Innovation and Skills. Small and Medium-sized Enterprise (SME) Statistics for the UK and Regions 2009. London, UK: Government of the United Kingdom; 2010.
123.
Australian Bureau of Statistics. Counts of Australian Businesses, Including Entries and Exits, June 2007 Until June 2011. (Cat. No. 8165.0). Canberra ACT, Australia: Australian Bureau of Statistics; 2012.
124.
DivineR. Determinants of small business interest in offering a wellness program to their employees. Health Mark Q. 2005;22: 43–58.
