Sage Journals: Discover world-class research

Abstract

Variable selection in semiparametric mixed models for longitudinal data remains a challenge, especially in the presence of multiple correlated outcomes. In this paper, we propose a model selection procedure that simultaneously selects fixed and random effects using a maximum penalized likelihood method with the adaptive least absolute shrinkage and selection operator penalty. Through random effects selection, we determine the correlation structure among multiple outcomes and therefore address whether a joint model is necessary. Additionally, we include a bivariate nonparametric component, as approximated by tensor product splines, to accommodate the joint nonlinear effects of two independent variables. We use an adaptive group least absolute shrinkage and selection operator to determine whether the bivariate nonparametric component can be reduced to additive components. To implement the selection and estimation method, we develop a two-stage expectation-maximization procedure. The operating characteristics of the proposed method are assessed through simulation studies. Finally, the method is illustrated in a clinical study of blood pressure development in children.

Keywords

Adaptive least absolute shrinkage and selection operator adaptive group least absolute shrinkage and selection operator expectation-maximization algorithm mixed effects multivariate data

Get full access to this article

View all access options for this article.

References

Liu

. A Sexually transmitted infection screening algorithm based on semiparametric regression models. Stat Med 2015; 34: 2844–2857.

Laird

Ware

. Random-effects Melection for longitudinal data. Biometrics 1982; 38: 963–974.

Reinsel

. Multivariate repeated-measurement or growth curve models with multivariate random-effects covariance structure. J Am Stat Assoc 1982; 77: 190–195.

Shah

Laird

Schoenfeld

. A random-effects model for multiple characteristics with possibly missing data. J Am Stat Assoc 1997; 92: 775–779.

Papageorgiou

Hinde

. Multivariate generalized linear mixed models with semi-nonparametric and smooth nonparametric random effects densities. Stat Comput 2012; 22: 79–92.

Lindstrom

Bates

. Nonlinear mixed effects models for repeated measures data. Biometrics 1990; 46: 673–687.

Wang

. Semiparametric nonlinear mixed-effects models and their applications. J Am Stat Assoc 2001; 96: 1272–1281.

Coull

Staudenmayer

. Self-modeling regression for multivariate curve data. Stat Sin 2004; 14: 695–711.

Liu

. A semiparametric regression model for paired longitudinal outcomes with application in childhood blood pressure development. Ann Appl Stat 2012; 6: 1861–1882.

10.

Eckert

Pratt

et al.

Plasma levels of prorenin and renin in blacks and whites: their relative abundance and associations with plasma aldosterone concentration. Am J Hypertens 2012; 25: 1030–1034.

11.

Eckert

Liu

et al.

Adiposity has unique influence on the renin-aldosterone axis and blood pressure in black children. J Pediatr 2013; 163: 1317–1322.

12.

Eckert

Hannon

et al.

Racial differences in sensitivity of blood pressure to aldosterone. Hypertension 2014; 63: 1212–1218.

13.

Greene

. Econometric analysis, 7th ed. Upper Saddle River, NJ: Prentice Hall, 2000.

14.

Liang

Zeger

. Longitudinal data analysis using generalized linear models. Biometrika 1986; 73: 13–22.

15.

Lange

Laird

. The effect of covariance structures on variance estimation in balance growth-curve models with random parameters. J Am Stat Assoc 1989; 84: 241–247.

16.

Heagerty

Kurland

. Misspecified maximum likelihood estimates and generalised linear mixed models. Biometrika 2011; 88: 973–985.

17.

Tibshirani

. Regression shrinkage and selection via the lasso. J R Stat Soc B 1996; 58: 267–288.

18.

Fan

. Variable selection via nonconcave penalized likelihood and its oracle properties. J Am Stat Assoc 2001; 96: 1348–1360.

19.

Efron

Hastie

Johnstone

et al.

Least angle regression. Ann Stat 2004; 32: 407–499.

20.

Zou

Hastie

. Regularization and variable selection via the elastic net. J R Stat Soc B 2005; 67: 301–320.

21.

Zou

. The adaptive lasso and its oracle properties. J Am Stat Assoc 2006; 101: 1418–1429.

22.

Yuan

Lin

. Model selection and estimation in regression with grouped variables. J R Stat Soc B 2006; 68: 49–67.

23.

Wang

Leng

. A note on adaptive group lasso. Comput Stat Data Anal 2008; 52: 5277–5286.

24.

Wei

Huang

. Consistent group selection in high-dimensional linear regression. Bernoulli 2010; 16: 1369–1384.

25.

Huang

Xie

et al.

A group bridge approach for variable selection. Biometrika 2009; 96: 339–355.

26.

Bondell

Krishna

Ghosh

. Joint variable selection for fixed and random effects in linear mixed-effects models. Biometrics 2010; 66: 1069–1077.

27.

Fan

. Variable selection in linear mixed effects models. Ann Stat 2012; 40: 2043–2068.

28.

Ibrahim

Zhu

Garcia

et al.

Fixed and random effects selection in mixed effects models. Biometrics 2011; 67: 495–503.

29.

Lin

Zhang

. Component selection and smoothing in multivariate nonparametric regression. Ann Stat 2006; 34: 2272–2297.

30.

Huang

Horowitz

Wei

. Variable selection in nonparametric additive models. Ann Stat 2010; 38: 2282–2313.

31.

Zhang

Cheng

Liu

. Linear or nonlinear? Automatic structure discovery for partially linear models. J Am Stat Assoc 2011; 106: 1099–1112.

32.

Cheng

Liang

. Semiparametric regression models with additive nonparametric components and high dimensional parametric components. Comput Stat Data Anal 2012; 56: 2006–2017.

33.

Fan

. New Estimation and model selection procedures for semiparametric modeling in longitudinal data analysis. J Am Stat Assoc 2004; 99: 710–723.

34.

Zhang

. Variable selection in semiparametric mixed models in longitudinal studies. Biometrics 2010; 66: 79–88.

35.

Zhao

Xue

. Variable selection in semiparametric regression analysis for longitudinal data. Ann Inst Stat Math 2012; 64: 213–231.

36.

Wang

. Simultaneous structure estimation and variable selection in partial linear varying coefficient models for longitudinal data. J Stat Comput Sim 2015; 85: 1459–1473.

37.

Song

Wang

. Simultaneous variable selection and estimation in semiparametric modeling of longitudinal/clustered data. Bernoulli 2013; 19: 252–274.

38.

Zeng

Qin

et al.

Variable selection in strong hierarchical semiparametric models for longitudinal data. Stat Interface 2015; 8: 355–365.

39.

Ruppert

Wand

Carroll

. Semiparametric regression, New York, NY: Cambridge University Press, 2003.

40.

Pinhero

Bates

. Approximations to the log-likelihood function in the nonlinear mixed-effects model. J Comput Graph Stat 1995; 4: 12–35.

41.

Meng

Rubin

. Maximum likelihood estimation via the ECM algorithm: a general framework. Biometrika 1993; 80: 267–278.

42.

Akaike

Information theory and an extension of the maximum likelihood principle. In: Petrov

Csaki

(eds). Int symp inform theory, Budapest: Akademiai Kiado, 1973, pp. 267–281.

43.

Schwarz

. Estimating the dimension of a model. Ann Stat 1978; 6: 461–464.

44.

R Core Team. R: A Language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing, 2016. Version: 3.3.1, http://www.R-project.org/ (2014, accessed 1 March 2016).

45.

Wood SN and Scheipl F. gamm4: generalized additive mixed models using mgcv and lme4; 2016. Version: 0.2-4. R package version 0.2-3, http://CRAN.R-project.org/package=gamm4 (accessed 1 March 2016).

46.

Pratt

Jones

Miller

et al.

Racial differences in aldosterone excretion and plasma aldosterone concentrations in children. N Engl J Med 1989; 321: 1152–1157.

47.

Eckert

Saha

et al.

Synchronization of adolescent blood pressure and pubertal somatic growth. J Clin Endocr Metab 2009; 94: 5019–5022.

48.

Eckert

DiMeglio

et al.

Intensified effect of adiposity on blood pressure in overweight and obese children. Hypertension 2011; 58: 818–824.

49.

Tibshirani

. The Lasso method for variable selection in the Cox model. Stat Med 1997; 16: 385–395.

50.

Berk

Brown

Buja

et al.

Valid post-selection inference. Ann Stat 2013; 41: 802–837.

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.06 MB

Model selection in multivariate semiparametric regression

Abstract

Keywords

Get full access to this article

References

Supplementary Material