Multicategory matched learning for estimating optimal individualized treatment rules in observational studies with application to a hepatocellular carcinoma study

Abstract

One primary goal of precision medicine is to estimate the individualized treatment rules that optimize patients’ health outcomes based on individual characteristics. Health studies with multiple treatments are commonly seen in practice. However, most existing individualized treatment rule estimation methods were developed for the studies with binary treatments. Many require that the outcomes are fully observed. In this article, we propose a matching-based machine learning method to estimate the optimal individualized treatment rules in observational studies with multiple treatments when the outcomes are fully observed or right-censored. We establish theoretical property for the proposed method. It is compared with the existing competitive methods in simulation studies and a hepatocellular carcinoma study.

Keywords

Imputation matching multicategory support vector machine random survival forest right-censored survival data

Get full access to this article

View all access options for this article.

References

Collins

Varmus

. A new initiative on precision medicine. N Engl J Med 2015; 372: 793–795.

Schork

. Personalized medicine: time for one-person trials. Nature 2015; 520: 609–611.

Kosorok

Laber

. Precision medicine. Annu Rev Stat Appl 2019; 6: 263–286.

Blatt

Murphy

Zhu

. A-learning for approximate planning. Ann Arbor 2004; 1001: 48109–42122.

Qian

Murphy

. Performance guarantees for individualized treatment rules. Ann Stat 2011; 39: 1180–1210.

Zhao

Zeng

Rush

, et al. Estimating individualized treatment rules using outcome weighted learning. J Am Stat Assoc 2012; 107: 1106–1118.

Liu

Wang

Kosorok

, et al. Augmented outcome-weighted learning for estimating optimal dynamic treatment regimens. Stat Med 2018; 37: 3776–3788.

Zhao

Laber

Ning

, et al. Efficient augmentation and relaxation learning for individualized treatment rules using observational data. J Mach Learn Res 2019; 20: 1821–1843.

Zeng

Wang

. Matched learning for optimizing individualized treatment strategies using electronic health records. J Am Stat Assoc 2020; 115: 380–392.

10.

Watkins

Dayan

. Q-learning. Mach Learn 1992; 8: 279–292.

11.

Murphy

. Optimal dynamic treatment regimes. J R Stat Soc: Ser B (Statistical Methodological) 2003; 65: 331–355.

12.

Robins

. Optimal structural nested models for optimal sequential decisions. In: Proceedings of the Second Seattle Symposium in Biostatistics: analysis of correlated data. Springer, pp.189–326.

13.

Zhang

Zeng

. Variable selection for optimal treatment decision. Stat Methods Med Res 2013; 22: 493–504.

14.

Laber

Linn

Stefanski

. Interactive model building for q-learning. Biometrika 2014; 101: 831–847.

15.

Song

Wang

Zeng

, et al. Penalized q-learning for dynamic treatment regimens. Stat Sin 2015; 25: 901.

16.

Shi

Fan

Song

, et al. High-dimensional a-learning for optimal dynamic treatment regimes. Ann Stat 2018; 46: 925.

17.

Chen

, et al. Estimating individualized treatment rules for ordinal treatments. Biometrics 2018; 74: 924–933.

18.

Zhang

Tsiatis

Laber

, et al. A robust method for estimating optimal treatment regimes. Biometrics 2012; 68: 1010–1018.

19.

Zhang

Tsiatis

Laber

, et al. Robust estimation of optimal dynamic treatment regimes for sequential treatment decisions. Biometrika 2013; 100: 681–694.

20.

Zhao

Zeng

Laber

, et al. Doubly robust learning for estimating individualized treatment with censored data. Biometrika 2015; 102: 151–168.

21.

Cui

Zhu

Kosorok

. Tree based weighted learning for estimating individualized treatment rules with censored data. Electron J Stat 2017; 11: 3927–3953.

22.

Leete

Kallus

Hudgens

, et al. Balanced Policy Evaluation and Learning for Right Censored Data. arXiv preprint 2019; arXiv:1911.05728.

23.

Xue

Zhang

Zhou

, et al. Multicategory angle-based learning for estimating optimal dynamic treatment regimes with censored data. J Am Stat Assoc 2022; 117: 1438–1451.

24.

Wood

Sweeting

, et al. Optimal individualized decision rules from a multi-arm trial: a comparison of methods and an application to tailoring inter-donation intervals among blood donors in the UK. Stat Methods Med Res 2020; 29: 3113–3134.

25.

Lou

Shao

. Optimal treatment assignment to maximize expected outcome with multiple treatments. Biometrics 2018; 74: 506–516.

26.

Huang

Goldberg

. Multicategory individualized treatment regime using outcome weighted learning. Biometrics 2019; 75: 1216–1227.

27.

Liu

, et al. Multi-armed angle-based direct learning for estimating optimal individualized treatment rules with various outcomes. J Am Stat Assoc 2020; 115: 678–691.

28.

Zhang

Chen

, et al. Multicategory outcome weighted margin-based learning for estimating individualized treatment rules. Stat Sin 2020; 30: 1857–1879.

29.

Lee

Lessler

Stuart

. Improving propensity score weighting using machine learning. Stat Med 2010; 29: 337–346.

30.

Frölich

. Programme evaluation with multiple treatments. J Econ Surv 2004; 18: 181–224.

31.

Yang

Imbens

Cui

, et al. Propensity score matching and subclassification in observational studies with multi-level treatments. Biometrics 2016; 72: 1055–1065.

32.

Lee

Lin

Wahba

. Multicategory support vector machines: theory and application to the classification of microarray data and satellite radiance data. J Am Stat Assoc 2004; 99: 67–81.

33.

Liu

Yuan

. Reinforced multicategory support vector machines. J Comput Graph Stat 2011; 20: 901–919.

34.

Zhang

Liu

. Multicategory angle-based large-margin classification. Biometrika 2014; 101: 625–640.

35.

Zhang

Liu

Wang

, et al. Reinforced angle-based multicategory support vector machines. J Comput Graph Stat 2016; 25: 806–825.

36.

Ishwaran

Kogalur

Blackstone

, et al. Random survival forests. Ann Appl Stat 2008; 2: 841–860.

37.

Zhang

Jiang

Zhang

, et al. A novel tailored prognosis calculator for the individualized curative treatments allocation of HCC patients within the Milan criteria. J Hepatol 2020; 73: S100–S101.

38.

Zhang

Jiang

Zhang

, et al. Individualised tailored assessment of therapeutic alternatives for HCC patients within the Milan criteria. Gut 2020; 69: 1893–1895.

39.

Stuart

. Matching methods for causal inference: A review and a look forward. Stat Sci 2010; 25: 1–21.

40.

Crammer

Singer

. On the algorithmic implementation of multiclass kernel-based vector machines. J Mach Learn Res 2001; 2: 265–292.

41.

Lopez

Gutman

. Estimation of causal effects with multiple treatments: a review and new ideas. Stat Sci 2017; 32: 432–454.

42.

Scotina

Gutman

. Matching algorithms for causal inference with multiple treatments. Stat Med 2019; 38: 3139–3167.

43.

Scotina

Beaudoin

Gutman

. Matching estimators for causal effects of multiple treatments. Stat Methods Med Res 2020; 29: 1051–1066.

44.

Therneau

Grambsch

. Modeling Survival Data: Extending the Cox Model. New York: Springer, 2000.

45.

Athey

Wager

. Policy learning with observational data. Econometrica 2021; 89: 133–161.

46.

Antonelli

Cefalu

Palmer

, et al. Doubly robust matching estimators for high dimensional confounding adjustment. Biometrics 2018; 74: 1171–1179.

47.

Zeng

, et al. On using electronic health records to improve optimal treatment rules in randomized trials. Biometrics 2020; 76: 1075–1086.

48.

Zhang

Pham

, et al. Robust multicategory support vector machines using difference convex algorithm. Math Program 2018; 169: 277–305.

49.

Bai

Tsiatis

, et al. Optimal treatment regimes for survival endpoints using a locally-efficient doubly-robust estimator from a classification perspective. Lifetime Data Anal 2017; 23: 585–604.

50.

Jiang

Song

, et al. On estimation of optimal treatment regimes for maximizing t-year survival probability. J R Stat Soc: Ser B (Statistical Methodological) 2017; 79: 1165–1185.

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.55 MB