Sage Journals: Discover world-class research

Abstract

We consider an ordinal regression model with latent variables to investigate the effects of observable and latent explanatory variables on the ordinal responses of interest. Each latent variable is characterized by correlated observed variables through a confirmatory factor analysis model. We develop a Bayesian adaptive lasso procedure to conduct simultaneous estimation and variable selection. Nice features including empirical performance of the proposed methodology are demonstrated by simulation studies. The model is applied to a study on happiness and its potential determinants from the Inter-university Consortium for Political and Social Research.

Keywords

Bayesian adaptive lasso latent variable MCMC methods ordinal response

Get full access to this article

View all access options for this article.

References

Alhamzawi

Benoit

D. F.

. 2012. “Bayesian Adaptive Lasso Quantile Regression.” Statistical Modelling 12:279–97.

Andrews

D. F.

Mallows

C. L.

. 1974. “Scale Mixtures of Normal Distributions.” Journal of the Royal Statistical Society: Series B (Statistical Methodology) 36:99–102.

Bennink

Croon

M. A.

Vermunt

J. K.

. 2013. “Micro–macro Multilevel Analysis for Discrete Data a Latent Variable Approach and an Application on Personal Network Data.” Sociological Methods & Research 42:431–57.

Bollen

K. A.

1989. Structural Equations with Latent Variables. New York: Wiley.

Fan

. 2001. “Variable Selection Via Nonconcave Penalized Likelihood and Its Oracle Properties.” Journal of the American Statistical Association 96:1348–60.

Gelman

Hwang

Vehtari

. 2014. “Understanding Predictive Information Criteria for Bayesian Models.” Statistics and Computing 24:997–1016.

Geman

. 1984. “Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images.” IEEE Transactions on Pattern Analysis and Machine Intelligence 6:721–41.

Gilks

W. R.

Richardson

Spiegelhalter

D. J.

. 1996. Markov Chain Monte Carlo in Practice. London, UK: Chapman&Hall.

Greenhaus

J. H.

Beutell

N. J.

. 1985. “Sources of Conflict Between Work and Family Roles.” Academy of Management Review 10:76–88.

10.

Guo

Zhu

Chow

S. M.

Ibrahim

J. G.

. 2012. “Bayesian Lasso for Semiparametric Structural Equation Models.” Biometrics 68:567–77.

11.

Harman

H. H.

1976. Modern Factor Analysis. Chicago: University of Chicago Press.

12.

Hastings

W. K.

1970. “Monte Carlo Sampling Methods Using Markov Chains and Their Application.” Biometrika 57:97–100.

13.

Hoti

Sillanpää

M. J.

. 2006. “Bayesian Mapping of Genotype × Expression Interactions in Quantitative and Qualitative Traits.” Heredity 97:4–18.

14.

Johnson

V. E.

1996. “On Bayesian Analysis of Multirater Ordinal Data: An Application to Automated Essay Grading.” Journal of the American Statistical Association 91:42–51.

15.

Johnson

V. E.

2008. “Statistical Analysis of the National Institutes of Health Peer Review System.” Proceedings of the National Academy of Sciences 105:11076–80.

16.

Kass

R. E.

Raftery

A. E.

. 1995. “Bayes Factors.” Journal of the American Statistical Association 90:773–95.

17.

Kenny

D. A.

Judd

C. M.

. 1984. “Estimating the Nonlinear and Interactive Effects of Latent Variables.” Psychological Bulletin 96:201–10.

18.

Kyung

Gill

Ghosh

Casella

. 2010. “Penalized Regression, Standard Errors, and Bayesian Lassos.” Bayesian Analysis 5:369–412.

19.

Lang

Brezger

. 2004. “Bayesian P-splines.” Journal Computational and Graphical Statistics 13:183–212.

20.

Lee

K. S.

Ono

. 2008. “Specialization and Happiness in Marriage: A US-Japan Comparison.” Social Science Research 37:1216–34.

21.

Lee

S. Y.

2007. Structural Equation Modeling: A Bayesian Approach. Chichester, UK: Wiley.

22.

Lee

S. Y.

Song

X. Y.

. 2007. “A Unified Maximum Likelihood Approach for Analyzing Structural Equation Models with Missing Nonstandard Data.” Sociological Methods & Research 35:352–81.

23.

Leng

C. L.

Tran

M. N.

Nott

. 2014. “Bayesian Adaptive Lasso.” Annals of the Institute of Statistical Mathematics 66:221–44.

24.

Magis

Tuerlinckx

De Boeck

. 2015. “Detection of Differential Item Functioning Using the Lasso Approach.” Journal of Educational and Behavioral Statistics 40:111–35.

25.

McCullagh

1980. “Regression Models for Ordinal Data.” Journal of the Royal Statistical Society: Series B (Statistical Methodology) 42:109–42.

26.

Metropolis

Rosenbluth

A. W.

Rosenbluth

M. N.

Teller

A. H.

Teller

. 1953. “Equations of State Calculations by Fast Computing Machine.” Journal of Chemical Physics 21:1087–91.

27.

Mohanty

M. S.

2009. “Effects of Positive Attitude on Happiness and Wage: Evidence from the US Data.” Journal of Economic Psychology 30:884–97.

28.

Moustaki

2003. “A General Class of Latent Variable Models for Ordinal Manifest Variables with Covariate Effects on the Manifest and Latent Variables.” British Journal of Mathematical and Statistical Psychology 56:337–57.

29.

Muthén

1984. “A General Structural Equation Model with Dichotomous, Ordered Categorical, and Continuous Latent Variable Indicators.” Psychometrika 49:115–32.

30.

Oshio

Kobayashi

. 2010. “Income Inequality, Perceived Happiness, and Self-rated Health: Evidence from Nationwide Surveys in Japan.” Social Science & Medicine 70:1358–66.

31.

Oshio

Kobayashi

. 2011. “Area-level Income Inequality and Individual Happiness: Evidence from Japan.” Journal of Happiness Studies 12:633–49.

32.

Park

Casella

. 2008. “The Bayesian Lasso.” Journal of the American Statistical Association 103:681–86.

33.

Poon

W. Y.

Wang

H. B.

. 2012. “Latent Variable Models with Ordinal Categorical Covariates.” Statistics and Computing 22:1135–54.

34.

Rasmussen

C. E.

Williams

C. K. I.

. 2006. Gaussian Processes for Machine Learning. Cambridge, MA: The MIT Press.

35.

Shi

J. Q.

Lee

S. Y.

. 2000. “Latent Variable Models with Mixed Continuous and Polytomous Data.” Journal of the Royal Statistical Society: Series B (Statistical Methodology) 62:77–87.

36.

Shimazu

Demerouti

Bakker

A. B.

Shimada

Kawakami

. 2011. “Workaholism and Well-being among Japanese Dual-earner Couples: A Spillover-crossover Perspective.” Social Science & Medicine 73:399–409.

37.

Skrondal

Rabe-Hesketh

. 2004. Generalized Latent Variable Modeling: Multilevel, Longitudinal, and Structural Equation Models. Boca Raton, FL: Chapman & Hall.

38.

Song

X. Y.

Lee

S. Y.

. 2001. “Bayesian Estimation and Test for Factor Analysis Model with Continuous and Polytomous Data in Several Populations.” British Journal of Mathematical and Statistical Psychology 54:237–63.

39.

Song

X. Y.

Lee

S. Y.

. 2012. Basic and Advanced Bayesian Structural Equation Modeling: With Applications in the Medical and Behavioral Sciences. London, UK: Wiley.

40.

Song

X. Y.

Z. H.

Cai

J. H.

H. S.

. 2013. “A Bayesian Modeling Approach for Generalized Semiparametric Structural Equation Models.” Psychometrika 78:624–47.

41.

Song

X. Y.

Z. H.

Feng

X. N.

. 2014. “Latent Variable Models with Nonparametric Interaction Effects of Latent Variables.” Statistics in Medicine 33:1723–37.

42.

Spiegelhalter

D. J.

Best

N. G.

Carlin

B. P.

van der Linde

. 2002. “Bayesian Measures of Model Complexity and Fit (with Discussion).” Journal of the Royal Statistical Society: Series B (Statistical Methodology) 64:583–639.

43.

Stack

Eshleman

J. R.

. 1998. “Marital Status and Happiness: A 17-nation Study.” Journal of Marriage and the Family 60:527–36.

44.

Tibshirani

1996. “Regression Shrinkage and Selection Via a Lasso.” Journal of the Royal Statistical Society: Series B (Statistical Methodology) 58:267–88.

45.

Vehtari

Gelman

Gabry

. 2015. “Efficient Implementation of Leave-one-out Cross-validation and WAIC for Evaluating Fitted Bayesian Models.” ArXiv E-prints. (http://arxiv.org/abs/1507.04544).

46.

Wang

H. S.

G. D.

Tsai

C. L.

. 2007. “Regression Coefficient and Autoregressive Order Shrinkage and Selection Via the Lasso.” Journal of the Royal Statistical Society: Series B (Statistical Methodology) 69:63–78.

47.

Wang

Y. F.

Feng

X. N.

Song

X. Y.

. 2015. “Bayesian Quantile Structural Equation Models.” Structural Equation Modeling: A Multidisciplinary Journal. (http://www.tandfonline.com/doi/full/10.1080/10705511.2015.1033057).

48.

Watanabe

2010. “Asymptotic Equivalence of Bayes Cross Validation and Widely Applicable Information Criterion in Singular Learning Theory.” The Journal of Machine Learning Research 11:3571–94.

49.

World Values Study Group. 1994. World Values Survey, 1981-1984 and 1990-1993. ICPSR version. Ann Arbor : Institute of Social Research [producer]. Ann Arbor: Inter-university Consortium for Political and Social Research [distributor].

50.

Yuan

K. H.

Bentler

P. M.

. 2011. “Ridge Structural Equation Modelling with Correlation Matrices for Ordinal and Continuous Data.” British Journal of Mathematical and Statistical Psychology 64:107–33.

51.

Zou

2006. “The Adaptive Lasso and Its Oracle Properties.” Journal of the American Statistical Association 101:1418–29.

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.37 MB

Bayesian Adaptive Lasso for Ordinal Regression With Latent Variables

Abstract

Keywords

Get full access to this article

References

Supplementary Material