Linear-rank testing of a non-binary,responder-analysis,efficacy score to evaluate pharmacotherapies for substance use disorders

Abstract

The design of pharmacological trials for management of substance use disorders is shifting toward outcomes of successful individual-level behavior (abstinence or no heavy use). While binary success/failure analyses are common, McCann and Li (CNS Neurosci Ther 2012; 18: 414–418) introduced “number of beyond-threshold weeks of success” (NOBWOS) scores to avoid dichotomized outcomes. NOBWOS scoring employs an efficacy “hurdle” with values reflecting duration of success. Here, we evaluate NOBWOS scores rigorously. Formal analysis of mathematical structure of NOBWOS scores is followed by simulation studies spanning diverse conditions to assess operating characteristics of five linear-rank tests on NOBWOS scores. Simulations include assessment of Fisher’s exact test applied to hurdle component. On average, statistical power was approximately equal for five linear-rank tests. Under none of conditions examined did Fisher’s exact test exhibit greater statistical power than any of the linear-rank tests. These linear-rank tests provide good Type I and Type II error control for comparing distributions of NOBWOS scores between groups (e.g. active vs. placebo). All methods were applied to re-analyses of data from four clinical trials of differing lengths and substances of abuse. These linear-rank tests agreed across all trials in rejecting (or not) their null (equality of distributions) at ≤ 0.05.

Keywords

Linear-rank tests pharmacotherapy development randomized clinical trial statistical power substance use disorders Type I error

Get full access to this article

View all access options for this article.

References

Winchell

Rappaport

Roca

et al.

Reanalysis of methamphetamine dependence treatment trial. CNS Neurosci Ther 2012; 18: 367–368.

U. S. Food and Drug Administration, Center for Drug Evaluation and Research. Medical Review of Vivitrol NDA 21-897, http://www.accessdata.fda.gov/drugsatfda_docs/nda/2006/021897_toc_Vivitrol.cfm (2006, accessed 27 November 2012).

U. S. Food and Drug Administration, Center for Drug Evaluation and Research. Medical Review of Varenicline NDA 21-928, http://www.accessdata.fda.gov/drugsatfda_docs/nda/2006/021928_s000_ChantixTOC.cfm (2006, accessed 27 November 2012).

Falk

Wang

Liu

et al.

Percentage of individuals with no heavy drinking days: evaluation as an efficacy endpoint for alcohol clinical trials. Alcohol Clin Exp Res 2010; 34: 2022–2034.

Deyi

Kosinski

Snapinn

. Power considerations when a continuous outcome variable is dichotomized. J Biopharm Stat 1998; 8: 337–352.

Altman

Royston

. The cost of dichotomising continuous variables. Br Med J 2006; 332: 1080–1080.

Snapinn

Jiang

. Responder analyses and the assessment of a clinically relevant treatment effect. Trials 2007; 8: 31–31.

Senn

Julious

. Measurement in clinical trials: a neglected issue for statisticians? Stat Med 2009; 28: 3189–3209.

McCann

. A novel, nonbinary evaluation of success and failure reveals bupropion efficacy versus methamphetamine dependence: reanalysis of a multisite trial. CNS Neurosci Ther 2012; 18: 414–418.

10.

Lawless

. Statistical models and methods for lifetime data, 2nd ed. Hoboken: John Wiley & Sons, Inc., 2003, pp. 63–66.

11.

Dalrymple

Hudson

Ford

RPK

. Finite mixture, zero-inflated Poisson and hurdle models with application to SIDS. Comput Stat Data Anal 2003; 41: 491–504.

12.

Hajek

. Asymptotic normality of simple linear rank statistics under alternatives. Ann Math Stat 1968; 39: 325–346.

13.

Conover

. Rank tests for one sample, two samples, and k samples without the assumption of a continuous distribution function. Ann Stat 1973; 1: 1105–1125.

14.

Daniel

. Applied nonparametric statistics, 2nd ed. Boston: PWS-KENT Publishing Company, 1990, pp. 90–90.

15.

Pratt

. Robustness of some procedures for the two-sample location problem. J Am Stat Assoc 1964; 59: 665–680.

16.

Mann

Whitney

. On a test of whether one of two random variables is stochastically larger than the other. Ann Math Stat 1947; 18: 50–60.

17.

Marshall

Olkin

Distributions with bounded support. In: Bickel

Diggle

Feinberg

et al. (eds). Life distributions, New York: Springer, 2007, pp. 473–495.

18.

Kim

Cohen

. On the Behrens-Fisher problem: a review. J Educ Behav Stat 1998; 23: 356–377.

19.

Dodge

. The Oxford dictionary of statistical terms, Oxford: Oxford Press, 2003, pp. 266–266.

20.

Randles

Wolfe

. Introduction to the theory of nonparametric statistics, New York: John Wiley & Sons, 1979.

21.

Manly

BFJ

. Randomization, bootstrap and Monte Carlo methods in biology, 2nd ed. London: Chapman & Hall, 1997.

22.

Ratcliffe

. The effect on the t distribution of non-normality in the sampled population. Appl Stat 1968; 17: 42–48.

23.

Welch

. The significance of the difference between two means when the population variances are unequal. Biometrika 1938; 29: 350–362.

24.

Permutt

Berger

. A new look at rank tests in ordered-

2 \times k

contingency tables. Commun Stat Theory Meth 2000; 29: 989–1003.

25.

Edgington ES. Randomization tests, 3rd ed. New York: Marcel Dekker, Inc., 1995, p. 88.

26.

Kahn

Biswas

Childress

et al.

Multi-center trial of baclofen for abstinence initiation in severe cocaine-dependent individuals. Drug Alcohol Depend 2009; 103: 59–64.

27.

Anderson

Reid

et al.

Modafinil for the treatment of cocaine dependence. Drug Alcohol Depend 2009; 104: 133–139.

28.

Johnson

Roache

Ait-Daoud

et al.

A preliminary randomized, double-blind, placebo-controlled study of the safety and efficacy of ondansetron in the treatment of cocaine dependence. Drug Alcohol Depend 2006; 84: 256–263.

29.

Winhusen

Somoza

Sarid-Segal

et al.

A double-blind, placebo-controlled trial of reserpine for the treatment of cocaine dependence. Drug Alcohol Depend 2007; 91: 205–212.

30.

Elkashef

Fudala

Gorgon

et al.

Double-blind, placebo-controlled trial of selegiline transdermal system (STS) for the treatment of cocaine dependence. Drug Alcohol Depend 2006; 85: 191–197.

31.

Winhusen

Somoza

Ciraulo

et al.

A double-blind, placebo-controlled trial of tiagabine for the treatment of cocaine dependence. Drug Alcohol Depend 2007; 91: 141–148.

32.

Elkashef

Rawson

Anderson

et al.

Bupropion for the treatment of methamphetamine dependence. Neuropsychopharmacol 2008; 33: 1162–1170.

33.

Anton

O’Malley

Ciraulo

et al.

Combined pharmacotherapies and behavioral interventions for alcohol dependence: the COMBINE study: a randomized controlled trial. J Am Med Assoc 2006; 295: 2003–2017.

34.

Gonzales

Rennard

Nides

et al.

Varenicline, an α4β2 nicotinic acetylcholine receptor partial agonist, vs sustained-release bupropion and placebo for smoking cessation: a randomized controlled trial. J Am Med Assoc 2006; 296: 47–55.

35.

Jorenby

Hays

Rigotti

et al.

Efficacy of varenicline, an α4β2 nicotinic acetylcholine receptor partial agonist, vs placebo or sustained-release bupropion for smoking cessation: a randomized controlled trial. J Am Med Assoc 2006; 296: 56–63.

36.

Mehrotra

Chan

ISF

Berger

. A cautionary note on exact unconditional inference for a difference between two independent binomial proportions. Biometrics 2003; 59: 441–450.

37.

Yuan

Yue

et al.

Detecting case–control expression quantitative trait loci using locally most powerful or maximin robust rank tests. Stat Med 2012; 31: 887–900.