Restricted accessResearch articleFirst published online 2020-06
The Trials and Tribulations of Selecting Comparison Groups in Randomized Trials of Nonpharmacological Complementary and Integrative Health Interventions
For over two decades, JACM Editorial Board member Karen Sherman, PhD has been among the most respected clinical trialists in complementary and integrative health research. The epidemiologist and Senior Researcher at Kaiser Permanente Washington Health Research Institute has focused on pain conditions and has led or been part of teams exploring the roles of such therapies as yoga, acupuncture, mind-body and manual therapies. In this Invited Commentary, Sherman shares wisdom gleaned from the process: trial designs, principles for selecting controls, benefits and liabilities of placebo and sham controls, attention controls, usual care controls, and more. She also discusses the effects of comparison groups on sample sizes, comparison groups for mechanistic studies, and other comparison groups' considerations. This commentary should prove a useful primer wherever research methods in complementary and integrative health are taught. We are pleased to offer it here through JACM.
PockockS. Clinical Trials. New York: John Wiley & Sons, 1983.
2.
LindquistR, WymanJF, TalleyKM, et al.Design of control-group conditions in clinical trials of behavioral interventions. J Nurs Scholarsh, 2007; 39:214–221.
3.
DusekJA, HibberdPL, BuczynskiB, et al.Stress management versus lifestyle modification on systolic hypertension and medication elimination: A randomized trial. J Altern Complement Med, 2008; 14:129–138.
4.
GuidiJ, BrakemeierEL, BocktingCLH, et al.Methodological recommendations for trials of psychological interventions. Psychother Psychosom, 2018; 87:276–284.
5.
HeckstedenA, FaudeO, MeyerT, DonathL. How to construct, conduct and analyze an exercise training study?. Front Physiol, 2018; 9:1007.
6.
Byrd-BredbennerC, WuF, SpaccarotellaK, et al.Systematic review of control groups in nutrition education intervention research. Int J Behav Nutr Phys Act, 2017; 14:91.
7.
KaptchukT, ed. The Web That Has No Weaver, 2nd ed. New York, NY: McGraw-Hill/Contemporary Books, 2000.
8.
KraftsowG. Yoga for Wellness. New York: Arkana, 1999.
9.
WaynePM, KaptchukTJ. Challenges inherent to t'ai chi research: Part I—t'ai chi as a complex multicomponent intervention. J Altern Complement Med, 2008; 14:95–102.
10.
ShermanKJ. Guidelines for developing yoga interventions for randomized trials. Evid Based Complement Alternat Med, 2012; 2012:143271.
11.
PatersonC, DieppeP. Characteristic and incidental (placebo) effects in complex interventions such as acupuncture. BMJ, 2005; 330:1202–1205.
12.
BarnesPM, Powell-GrinerE, McFannK, NahinRL. Complementary and alternative medicine use among adults: United States, 2002. Adv Data, 2004:1–19.
13.
ShermanKJ, CherkinDC, EisenbergDM, et al.The practice of acupuncture: Who are the providers and what do they do?. Ann Fam Med, 2005; 3:151–158.
14.
ShermanKJ, CherkinDC, KahnJ, et al.A survey of training and practice patterns of massage therapists in two US states. BMC Complement Altern Med, 2005; 5:13.
15.
FouladbakhshJM, StommelM. Gender, symptom experience, and use of complementary and alternative medicine practices among cancer survivors in the U.S. cancer population. Oncol Nurs Forum, 2010; 37:E7–E15.
16.
FriedmanLM, FurbergCD, DemetsDL. Fundamentals of Clinical Trials, 3rd ed. New York: Springer, 1998.
17.
TunisSR, StryerDB, ClancyCM. Practical clinical trials: Increasing the value of clinical research for decision making in clinical and health policy. JAMA, 2003; 290:1624–1632.
18.
ConcatoJ, PeduzziP, HuangGD, et al.Comparative effectiveness research: What kind of studies do we need?. J Investig Med, 2010; 58:764–769.
19.
PeduzziP, KyriakidesT, O'ConnorTZ, et al.Methodological issues in comparative effectiveness research: Clinical trials. Am J Med, 2010; 123(12Suppl. 1):e8–e15.
20.
LuceBR, SimeoneJC. How different is research done by the Patient-centered Outcomes Research Institute, and what difference does it make?. J Comp Eff Res, 2019; 8:1239–1251.
21.
BauerMS, DamschroderL, HagedornH, et al.An introduction to implementation science for the non-specialist. BMC Psychol, 2015; 3:32.
22.
BodisonSC, SankareI, AnayaH, et al.Engaging the community in the dissemination, implementation, and improvement of health-related research. Clin Transl Sci, 2015; 8:814–819.
23.
PatsopoulosNA. A pragmatic view on pragmatic trials. Dialogues Clin Neurosci, 2011; 13:217–224.
24.
HermanPM, CraigBM, CaspiO. Is complementary and alternative medicine (CAM) cost-effective? A systematic review. BMC Complement Altern Med, 2005; 5:11.
25.
RevickiDA, FrankL. Pharmacoeconomic evaluation in the real world. Effectiveness versus efficacy studies. Pharmacoeconomics, 1999; 15:423–434.
26.
MarchJS, SilvaSG, ComptonS, et al.The case for practical clinical trials in psychiatry. Am J Psychiatry, 2005; 162:836–846.
27.
LoudonK, TreweekS, SullivanF, et al.The PRECIS-2 tool: Designing trials that are fit for purpose. BMJ, 2015; 350:h2147.
28.
RounsavilleBJ, OnkenLS. A stage model of behavioral therapies research: Getting started and moving on from stage I. Clin Psychol Sci Pract, 2001; 8:133–142.
29.
GlasgowRE, DavidsonKW, DobkinPL, et al.Practical behavioral trials to advance evidence-based behavioral medicine. Ann Behav Med, 2006; 31:5–13.
30.
GoldSM, EnckP, HasselmannH, et al.Control conditions for randomised trials of behavioural interventions in psychiatry: A decision framework. Lancet Psychiatry, 2017; 4:725–732.
31.
KienleGS, KieneH. The powerful placebo effect: Fact or fiction?. J Clin Epidemiol, 1997; 50:1311–1318.
32.
BensingJM, VerheulW. The silent healer: The role of communication in placebo effects. Patient Educ Couns, 2010; 80:293–299.
33.
LeibowitzKA, HardebeckEJ, GoyerJP, CrumAJ. Physician assurance reduces patient symptoms in US adults: An experimental study. J Gen Intern Med, 2018; 33:2051–2052.
34.
LindeK, WittCM, StrengA, et al.The impact of patient expectations on outcomes in four randomized controlled trials of acupuncture in patients with chronic pain. Pain, 2007; 128:264–271.
35.
ShermanKJ, CherkinDC, IchikawaL, et al.Treatment expectations and preferences as predictors of outcome of acupuncture for chronic back pain. Spine (Phila Pa 1976), 2010; 35:1471–1477.
36.
FinnissDG, KaptchukTJ, MillerF, BenedettiF. Biological, clinical, and ethical advances of placebo effects. Lancet, 2010; 375:686–695.
37.
MoustgaardH, ClaytonGL, JonesHE, et al.Impact of blinding on estimated treatment effects in randomised clinical trials: Meta-epidemiological study. BMJ, 2020; 368:l6802.
38.
AnandR, NorrieJ, BradleyJM, et al.Fool's gold? Why blinded trials are not always best. BMJ, 2020; 368:l6228.
39.
KibarS, KonakHE, EvcikD, AyS. Laser acupuncture treatment improves pain and functional status in patients with subacromial impingement syndrome: A randomized, double-blind, sham-controlled study. Pain Med, 2017; 18:980–987.
40.
HershmanDL, UngerJM, GreenleeH, et al.Effect of acupuncture vs sham acupuncture or waitlist control on joint pain related to aromatase inhibitors among women with early-stage breast cancer: A randomized clinical trial. JAMA, 2018; 320:167–176.
41.
HaakeM, MullerHH, Schade-BrittingerC, et al.German Acupuncture Trials (GERAC) for chronic low back pain: Randomized, multicenter, blinded, parallel-group trial with 3 groups. Arch Intern Med, 2007; 167:1892–1898.
42.
StreitbergerK, KleinhenzJ. Introducing a placebo needle into acupuncture research. Lancet, 1998; 352:364–365.
43.
VickersAJ. Placebo controls in randomized trials of acupuncture. Eval Health Prof, 2002; 25:421–435.
44.
IrnichD, BehrensN, MolzenH, et al.Randomised trial of acupuncture compared with conventional massage and “sham” laser acupuncture for treatment of chronic neck pain. BMJ, 2001; 322):1574–1578.
45.
Scholten-PeetersGG, ThoomesE, KoningsS, et al.Is manipulative therapy more effective than sham manipulation in adults: A systematic review and meta-analysis. Chiropr Man Ther, 2013; 21):34.
46.
MeekerWC, HaldemanS. Chiropractic: A profession at the crossroads of mainstream and alternative medicine. Ann Intern Med, 2002; 136:216–227.
47.
PattersonM, MaurerS, AdlerSR, AvinsAL. A novel clinical-trial design for the study of massage therapy. Complement Ther Med, 2008; 16:169–176.
48.
MacCoomDG, ImelZE, RosenkrantzME, et al.The validation of an active control intervention for Mindfulness Based Stress Reduction (MBSR). Behav Res Ther, 2012; 50:3–12.
49.
GrossD. On the merits of attention-control groups. Res Nurs Health, 2005; 28:93–94.
50.
MohrDC, SpringB, FreedlandKE, et al.The selection and design of control conditions for randomized controlled trials of psychological interventions. Psychother Psychosom, 2009; 78:275–284.
51.
KelleyJM, Kraft-ToddG, SchapiraL, et al.The influence of the patient-clinician relationship on healthcare outcomes: A systematic review and meta-analysis of randomized controlled trials. PLoS One, 2014; 9:e94207.
52.
ShermanKJ, LudmanEJ, CookAJ, et al.Effectiveness of therapeutic massage for generalized anxiety disorder: A randomized controlled trial. Depress Anxiety, 2010; 27:441–450.
53.
KanayaAM, AranetaMR, PawlowskySB, et al.Restorative yoga and metabolic risk factors: The Practicing Restorative Yoga vs. Stretching for the Metabolic Syndrome (PRYSMS) randomized trial. J Diabetes Complicat, 2014; 28:406–412.
54.
ShermanKJ, InnesKE. Yoga for metabolic risk factors: Much ado about nothing or new form of adjunctive care?. J Diabetes Complicat, 2014; 28:253–254.
55.
ShermanKJ, Wellman RD HawkesRJ, et al.Tai Chi for chronic low back pain in older adults: A feasibility trial. J Altern Complement Med, 2020 [Epub ahead of print]; DOI: 10.1089/acm.2019.0438.
56.
ShermanKJ, ThakralM, BandyE, et al.Development of an attention control group for tai chi in older adults with chronic low back pain. In: International Congress on Integrative Medicine & Health; Baltimore, MD, 2018.
57.
Von KorffM, MooreJE, LorigK, et al.A randomized trial of a lay person-led self-management group intervention for back pain patients in primary care. Spine, 1998; 23:2608–2615.
58.
LorigKR, LaurentDD, DeyoRA, et al.Can a Back Pain E-mail Discussion Group improve health status and lower health care costs?: A randomized study. Arch Intern Med, 2002; 162:792–796.
59.
VickersAJ, de CraenAJ. Why use placebos in clinical trials? A narrative review of the methodological literature. J Clin Epidemiol, 2000; 53:157–161.
60.
VickersAJ, VertosickEA, LewithG, et al.Acupuncture for chronic pain: Update of an individual patient data meta-analysis. J Pain, 2018; 19:455–474.
61.
FonneboV, GrimsgaardS, WalachH, et al.Researching complementary and alternative treatments—The gatekeepers are not at home. BMC Med Res Methodol, 2007; 7:7.
62.
LiA, KaptchukTJ. The case of acupuncture for chronic low back pain: When efficacy and comparative effectiveness conflict. Spine (Phila Pa 1976), 2011; 36:181–182.
63.
CherkinDC, ShermanKJ, AvinsAL, et al.A randomized controlled trial comparing acupuncture, simulated acupuncture, and usual care for chronic low back pain. Arch Intern Med, 2009; 169:858–866.
64.
ShermanKJ, CherkinDC, ErroJ, et al.Comparing yoga, exercise, and a self-care book for chronic low back pain: A randomized, controlled trial. Ann Intern Med, 2005; 143:849–856.
65.
ShermanKJ, CherkinDC, WellmanRD, et al.A randomized trial comparing yoga, stretching, and a self-care book for chronic low back pain. Arch Intern Med, 2011; 171:2019–2026.
66.
MeissnerK, FasslerM, RuckerG, et al.Differential effectiveness of placebo treatments: A systematic review of migraine prophylaxis. JAMA Intern Med, 2013; 173:1941–1951.
67.
KaptchukTJ, StasonWB, DavisRB, et al.Sham device v inert pill: Randomised controlled trial of two placebo treatments. BMJ, 2006; 332:391–397.
68.
WechslerME, KelleyJM, BoydIO, et al.Active albuterol or placebo, sham acupuncture, or no intervention in asthma. N Engl J Med, 2011; 365:119–126.
69.
CollinsLM, MurphySA, StrecherV. The multiphase optimization strategy (MOST) and the sequential multiple assignment randomized trial (SMART): New methods for more potent eHealth interventions. Am J Prev Med, 2007; 32(5Suppl.):S112–S118.
70.
FritzJM, SharpeJA, LaneE, et al.Optimizing treatment protocols for spinal manipulative therapy: Study protocol for a randomized trial. Trials, 2018; 19:306.
71.
WampoldBE. How important are the common factors in psychotherapy? An update. World Psychiatry, 2015; 14:270–277.
72.
MillerFG, KaptchukTJ. Sham procedures and the ethics of clinical trials. J R Soc Med, 2004; 97:576–578.
73.
BermanBM, LaoL, LangenbergP, et al.Effectiveness of acupuncture as adjunctive therapy in osteoarthritis of the knew: A randomized controlled trial. Ann Inter Med, 2004; 141:901–910.
74.
ThomasKJ, MacPhersonH, ThorpeL, et al.Randomised controlled trial of a short course of traditional acupuncture compared with usual care for persistent non-specific low back pain. BMJ, 2006; 333:623.
75.
McKeeMD, NielsenA, AndersonB, et al.Individual vs. group delivery of acupuncture therapy for chronic musculoskeletal pain in urban primary care—A randomized trial. J Gen Intern Med, 2020. [Epub ahead of print]; DOI: 10.1007/s11606-019-05583-6.
76.
SaperRB, LemasterC, DelittoA, et al.Yoga, physical therapy, or education for chronic low back pain: A randomized noninferiority trial. Ann Intern Med, 2017; 167:85–94.
77.
CherkinDC, EisenbergD, ShermanKJ, et al.Randomized trial comparing traditional Chinese medical acupuncture, therapeutic massage, and self-care education for chronic low back pain. Arch Intern Med, 2001; 161:1081–1088.
