Bayesian methods for latent trait modelling of longitudinal data

Abstract

Latent trait models have long been used in the social science literature for studying variables that can only be measured indirectly through multiple items. However, such models are also very useful in accounting for correlation in multivariate and longitudinal data, particularly when outcomes have mixed measurement scales. Bayesian methods implemented with Markov chain Monte Carlo provide a flexible framework for routine fitting of a broad class of latent variable (LV) models, including very general structural equation models. However, in considering LV models, a number of challenging issues arise, including identifiability, confounding between the mean and variance, uncertainty in different aspects of the model, and difficulty in computation. Motivated by the problem of modelling multidimensional longitudinal data, this article reviews the recent literature, provides some recommendations and highlights areas in need of additional research, focusing on methods for model uncertainty.

Get full access to this article

View all access options for this article.

References

Diggle, PJ , Heagerty P. , Liang KY , Zeger SL The analysis of longitudinal data. second edition. Oxford University Press, 2002.

Laird NM , Ware JH Random-effects models for longitudinal data. Biometrics 1982; 38: 963—74.

Gray SM , Brookmeyer R. Estimating a treatment effect from multidimensional longitudinal data. Biometrics 1998; 54: 976—88.

Gray SM , Brookmeyer R. Multidimensional longitudinal data: estimating a treatment effect from continuous, discrete or time-to-event response variables. Journal of the American Statistical Association 2000; 95: 396—406.

Dunson DB Dynamic latent trait models for multidimensional longitudinal data. Journal of the American Statistical Association 2003; 98: 555—63.

Byrne BM Structural equation modeling with LISREL, PRELIS and SIMPLIS: basic concepts, applications and programming. Lawrence Erlbaum Associates , 1998.

Bollen KA Structural equations with latent variables. Wiley, 1989.

Sanchez BN , Budtz-Jorgensen E. , Ryan LM , Hu H. Structural equation models: a review with applications to environmental epidemiology . Journal of the American Statistical Association 2005; 100: 1443—55.

Palomo J. , Dunson DB , Bollen KA Bayesian structural equation modeling. Handbook on Structural Equation Models 2006. In press.

10.

Carvalho C. , Lucas J. , Wang Q. , Nevins J. , West M. High-dimensional sparse factor models and latent factor regression. ISDS Discussion Paper 2005—15, Duke University.

11.

Lopes HF , West M. Bayesian model assessment in factor analysis. Statistica Sinica 2004; 14: 41—67.

12.

Lin X. , Ryan L. , Sammel M. , Zhang D. , Padungtod C. , Xu X. A scaled linear mixed model for multiple outcomes. Biometrics 2000; 56: 593—601.

13.

Roy J. , Lin XH , Ryan LM Scaled marginal models for multiple continuous outcomes. Biostatistics 2003; 4: 371—83.

14.

Muthén B. A general structural equation model with dichotomous, ordered categorical, and continuous latent variable indicators. Psychometrika 1984; 49: 115—32.

15.

Catalano PJ , Ryan LM Bivariate latent variable models for clustered discrete and continuous outcomes . Journal of the American Statistical Association 1992; 87: 651—8.

16.

Gueorguieva RV , Agresti A. A correlated probit model for joint modeling of clustered binary and continuous responses. Journal of the American Statistical Association 2001; 96: 1102—12.

17.

Dunson DB , Chen Z. , Harry J.A. Bayesian approach for joint modeling of cluster size and subunit-specific outcomes. Biometrics 2003; 59: 521—30.

18.

Rasmussen CE , Williams Cki. Gaussian processes for machine learning. The MIT Press , 2006.

19.

Daniels MJ , Normand S. - LT. Longitudinal profiling of health care units based on continuous and discrete patient outcomes. Biostatistics 2006; 7: 1—15.

20.

Roy J. , Lin XH Latent variable models for longitudinal data with multiple continuous outcomes . Biometrics 2000; 56: 1047—54.

21.

Muthén B. , Brown CH , Masyn K. , Jo B. , Khoo ST , Yang CC , Wang CP , Kellam SG , Carlin JB , Liao J. General growth mixture modeling for randomized preventive interventions. Biostatistics 2002; 3: 459—75.

22.

Dunson DB , Perrealt SD Factor analytic models of clustered multivariate data with informative censoring . Biometrics 2001; 57: 302—8.

23.

Follmann D. , Wu M. An approximate generalized linear-model with random effects for informatively missing data. Biometrics 1995; 51: 151—68.

24.

Fieuws S. , Verbeke G. Joint modelling of multivariate longitudinal profiles: pitfalls of the random-effects approach. Statistics in Medicine 2004; 23: 3093—104.

25.

Roy J. , Lin XH Analysis of multivariate longitudinal outcomes with nonignorable dropout and missing covariates: changes in methadone treatment practices. Journal of the American Statistical Association 2002; 97: 40—52.

26.

Lin HQ , McCulloch CE , Rosenheck RA Latent pattern mixture models for informative intermittent missing data in longitudinal studies. Biometrics 2004; 60: 295—305.

27.

Dunson DB , Baird DD Bayesian modeling of incidence and progression of disease from cross-sectional data. Biometrics 2002; 58: 813—22.

28.

Kelloway EK Using LISREL for structural equation modeling: a researcher's guide, Sage, 1998.

29.

Byrne BM Structural equation modeling with EQS: basic concepts, applications and programming : second Edition. Sage Publications , 2006.

30.

Muthén LK , Muthén BO Mplus user's guide, fourth edition. Muthén & Muthén, 2006.

31.

Arbuckle JL Amos 6.0 User's Guide. Amos Development Corporation, 2006.

32.

Fox J. Structural equation modeling with the SEM package in R. Structural Equation Modeling 2006; 13: 465—86.

33.

Shi JQ , Lee SY Latent variable models with mixed continuous and polytomous data. Journal of the Royal Statistical Society B 2000; 62: 77—87.

34.

Lee SY , Song XY Maximum likelihood analysis of a two-level nonlinear structural equation model with fixed covariates. Journal of Educational and Behavioral Statistics 2005; 30: 1—26.

35.

Spiegelhalter DJ , Thomas A. , Best NG WinBUGS Version 1.2 User Manual. MRC Biostatistics Unit, 1999 from www.mrc-bsu.cam.ac.uk/bugs.

36.

Lee SY , Song XY Evaluation of the Bayesian and maximum likelihood approaches in analyzing structural equation models with small sample sizes. Multivariate Behavioral Research 2004; 39: 653—86.

37.

Albert J. , Chib S. Bayesian residual analysis for binary response regression models. Biometrika 1995; 82: 747—59.

38.

Gelman A. , Van Mechelen I. , Verbeke, G. , Heitjan DF , Meulders M. Multiple imputation for model checking: completed-data plots with missing and latent data. Biometrics 2005; 61: 74 —85.

39.

Albert JH , Chib S. Bayesian-analysis of binary and polychotomous response data. Journal of the American Statistical Association 1993; 88: 669—79.

40.

Arminger G.A. Bayesian approach to nonlinear latent variable models using the Gibbs sampler and the Metropolis—Hastings algorithm . Psychometrika 1998; 63: 271—300.

41.

Scheines R. , Hoijtink H. , Boomsma A. Bayesian estimation and testing of structural equation models. Psychometrika 1999; 64: 37—52.

42.

Gelman A. Prior distributions for variance parameters in hierarchical models. Bayesian Analysis, 2006; 515—534.

43.

Lee SE , Press SJ Robustness of Bayesian factor analysis estimates. Communications in Statistics — Theory and Methods 1998; 27: 1871—93.

44.

Lee SY , Zhu HT Statistical analysis of nonlinear structural equation models with continuous and polytomous data. British Journal of Mathematical & Statistical Psychology 2000; 53: 209—32.

45.

Lee SY , Zhu HT Maximum likelihood estimation of nonlinear structural equation models. Psychometrika 2002; 67: 189—210.

46.

Sammel MD , Ryan LM , Legler JM Latent variable models for mixed discrete and continuous outcomes. Journal of the Royal Statistical Society B 1997; 59: 667—78.

47.

Moustaki I. , Knott M. Generalized latent trait models. Psychometrika 2000; 65: 391—411.

48.

Dunson DB Bayesian latent variable models for clustered mixed outcomes. Journal of the Royal Statistical Society B 2000; 62: 355—66.

49.

Wang FJ , Wall MM Generalized common spatial factor model. Biostatistics 2003; 4: 569—82.

50.

Zhu J. , Eickhoff JC , Yan P. Generalized linear latent variable models for repeated measures of spatially correlated multivariate data. Biometrics 2005 ; 61: 674 —83.

51.

Liu X. , Wall MM , Hodges JS Generalized spatial structural equation models. Biostatistics 2005; 6: 539—57.

52.

Hogan JW , Tchernis, R. Bayesian factor analysis for spatially correlated data, with application to summarizing area-level material deprivation from census data. Journal of the American Statistical Association 2004; 99: 314 —24.

53.

Dunson DB , Herring AH Bayesian latent variable models for mixed discrete outcomes. Biostatistics 2005; 6: 11—25.

54.

Utsugi A. , Kumagai T. , Bayesian analysis of mixtures of factor analyzers. Neural Computation 2001; 13: 993—1002.

55.

Fokoue E. , Titterington, DM

Mixtures of factor analysers: Bayesian estimation and inference by stochastic simulation. Machine

Learning 2003; 50: 73—94.

56.

McLachlan GJ , Peel D. , Bean RW

Modelling high-dimensional data by mixtures of factor analyzers. Computational Statistics & Data

Analysis 2003; 41: 379—88.

57.

Zhu HT , Lee SY A Bayesian analysis of finite mixtures in the LISREL model. Psychometrika 2001; 66: 133—52.

58.

Richardson S. , Green PJ On Bayesian analysis of mixtures with an unknown number of components. Journal of the Royal Statistical Society B 1997; 59: 731—58.

59.

Ferguson TS A Bayesian analysis of some nonparametric problems . Annals of Statistics 1973; 1: 209—30.

60.

Ferguson TS Prior distributions on spaces of probability measures. Annals of Statistics 1974; 2: 615—29.

61.

Bush CA MacEachern SN. A semiparametric Bayesian model for randomised block designs . Biometrika 1996; 83: 275—85.

62.

Kleinman KP , Ibrahim JG A semiparametric Bayesian approach to the random effects model. Biometrics 1998; 54: 921—38.

63.

Ishwaran H. , Takahara G. Independent and identically distributed Monte Carlo algorithms for semiparametric linear mixed models. Journal of the American Statistical Association 2002; 97: 1154 —66.

64.

Dunson DB Bayesian dynamic modeling of latent trait distributions. Biostatistics 2006; 7: 551—568.

65.

Pennell ML , Dunson DB Bayesian semiparametric dynamic frailty models for multiple event time data . Biometrics 2006. In press.

66.

Dunson DB , Watson M. , Taylor JA Bayesian latent variable models for median regression on multiple outcomes . Biometrics 2003; 59: 296—304.

67.

Reboussin BA , Liang KY An estimating equations approach for the LISCOMP model. Psychometrika 1998; 63: 165—82.

68.

Sammel MD , Ryan LM Effects of covariance misspecification in a latent variable model for multiple outcomes. Statistica Sinica 2002; 12: 1207—22.

69.

Yuan KH , Bentler PM , Chan W. Structural equation modeling with heavy tailed distributions. Psychometrika 2004; 69: 421—36.

70.

Press SJ , Shigemasu K. A note on choosing the number of factors. Communications in Statistics — Theory and Methods 1999; 28: 1653—70.

71.

Green, PJ Reversible jump Markov chain Monte Carlo computation and Bayesian model determination . Biometrika 1995; 82: 711—32.

72.

Cai B. , Dunson DB Bayesian covariance selection in generalized linear mixed models. Biometrics 2006; 62: 446—457.

73.

Lee SY , Song XY Model comparison of nonlinear structural equation models with fixed covariates . Psychometrika 2003; 68: 27—47.

74.

Gelman, A. , Meng XL Simulating normalizing constants: from importance sampling to bridge sampling to path sampling. Statistical Science 1998 ; 13: 163—85.