We discuss a flexible regression model for multivariate mixed responses. Dependence between outcomes is introduced via the joint distribution of discrete outcome- and individual-specific random effects that represent potential unobserved heterogeneity in each outcome profile. A different number of locations can be used for each margin, and the association structure is described by a tensor that can be further simplified by using the Parafac model. A case study illustrates the proposal.
AkaikeH (1974) A new look at the statistical model identication. IEEE Transactions on Automatic Control, 19, 716–23.
2.
AitkinM (1996) A general maximum likelihood analysis of overdispersion in generalized linear models. Statistics and Computing, 6, 127–30.
3.
AitkinM (1999) A general maximum likelihood analysis of variance components in generalized linear models. Biometrics, 55, 117–28.
4.
AlfoM and RocchettiI (2013) A flexible approach to finite mixture regression models for multivariate mixed responses. Statistics and Probability Letters, 83, 1754–58.
5.
AlfoM and TrovatoG (2004) Semiparametric mixture models for multivariate count data, with application. Econometrics Journal, 7, 1–29.
6.
BatesMD, CastellanoKE, Rabe-HeskethS and SkrondalA (2014) Handling correlations between covariates and random slopes in multilevel models. Journal of Educational and Behavioral Statistics, 39, 524–49.
7.
BiernackiC, CeleuxG and GovaertG (2000) Assessing a mixture model for clustering with the integrated completed likelihood. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22, 719–25.
8.
BöhningD. (1982) Convergence of Simar's algorithm for finding the maximum likelihood estimate of a compound Poisson process. Annals of Statistics, 10, 1006–8.
9.
BöhningD (2000) Computer-assisted Analysis of Mixtures and Applications. Boca Raton, FL: Chapman & Hall/CRC.
10.
BozdoganH (1987) Model selection and Akaike's information criterion (AIC): The general theory and its analytical extensions. Psychometrika, 52, 345–70.
11.
CarrollJD and ChangJJ (1970) Analysis of individual differences in multidimensional scaling via an n-way generalization of ‘Eckart-Young’ decomposition. Psychometrika, 35, 283–319.
12.
ChibS and WinkelmannR (2001) Markov chain Monte Carlo analysis of correlated count data. Journal of Business and Economic Statistics, 19, 428–35.
13.
ChippereldJO and SteelDG (2012) Multivariate random effect models with complete and incomplete data. Journal of Multivariate Analysis, 109, 146–55
14.
DebP, MunkinM and TrivediP (2006). Private insurance, selection, and health care use: A Bayesian analysis of a Roytype model. Journal of Business and Economic Statistics, 24, 403–15.
15.
DebP and TrivediPK (1997) Demand for medical care by the elderly: A finite mixture approach. Journal of Applied Econometrics, 12, 313–36.
16.
DietzE (1992) Estimation of heterogeneity. A GLM-approach. In Advances in GLIM and Statistical Modelling, edited by FahrmeirL, FrancisB, GilchristR and TutzG.New York, NY: Springer-Verlag.
17.
DunsonDB and XingC (2009) Nonparametric Bayes modeling of multivariate categorical data. Journal of the American Statistical Association, 104, 1042–51.
18.
EinbeckJ, DarnellR and HindeJ (2018). npmlreg: Nonparametric maximum likelihood estimation for random effect models. R package version 0.46-5. URL https://CRAN.R-project.org/package=npmlreg(last accessed 21 July 2021).
19.
GrünB, KosmidisI and ZeileisA (2012). Extended beta regression in R: Shaken, stirred, mixed, and partitioned. Journal of Statistical Software, 48, 1–25.
20.
HabermanSJ (1979) Analysis of Qualitative Data. New York, NY: Academic Press.
21.
HarshmanRA (1970) Foundations of the PARAFAC procedure: Models and conditions for an ‘exploratory’ multimodal factor analysis. UCLA Working Papers in Phonetics, 16, 1–84.
22.
HindeJP and WoodATA (1987). Binomial variance component models with a nonparametric assumption concerning random effects.In Longitudinal Data Analysis, edited by R Crouchley. Aldershot: Avebury.
23.
HussonF, JosseJ, NarasimhanB and RobinG (2019) Imputation of mixed data with multilevel singular value decomposition. Journal of Computational and Graphical Statistics, 28, 552–66.
24.
JaffaMA, GebregziabherM, LuttrellDK, LuttrellLM and JaffaAA (2016) Multivariate generalized linear mixed models with random intercepts to analyze cardiovascular risk markers in type-1 diabetic patients. Journal of Applied Statistics, 43, 1447–64.
25.
KarlisD and MeligkotsidouL (2007) Finite mixtures of multivariate Poisson distributions with application. Journal of Statistical Planning and Inference, 137, 1942–60.
26.
KivietJF (2020) Testing the impossible: Identifying exclusion restrictions. Journal of Econometrics, 218, 294–316.
27.
KroonenbergPM (2008) Applied Multiway Data Analysis. Hoboken, NJ: Wiley.
28.
KruskalJB (1977) Three-way arrays: rank and uniqueness of trilinear decompositions, with applications to arithmetic complexity and statistics. Linear Algebra and Its Applications, 18, 95–138.
29.
LairdNM (1978) Nonparametric maximum likelihood estimation of a mixing distribution. Journal of the American Statistical Association, 73, 805–11.
30.
LindsayBG (1983a) The geometry of mixture likelihoods: A general theory. Annals of Statistics, 11, 86–94.
31.
LindsayBG (1983b) The geometry of mixture likelihoods, part II: The exponential family. Annals of Statistics, 11, 783–92.
32.
McCullochCE, SearleSR and NeuhausJM (2008) Generalized, Linear, and Mixed Models. New York, NY: John Wiley & Sons.
33.
McLachlanG and KrishnamT (1997) The EM Algorithm and Extensions. New York, NY: John Wiley & Sons.
34.
MunkinM and TrivediP (1999) Simulated maximum likelihood estimation of multivariate mixed-Poisson regression models, with application. Econometrics Journal, 2, 29–48.
35.
OskrochiG, LesaffreE, OskrochiY and ShamleyD (2016) An application of the multivariate linear mixed model to the analysis of shoulder complexity in breast cancer patients. International Journal of Environmental Research and Public Health, 13, 274.
36.
QuandtRE (1972) A new approach to estimating switching regressions. Journal of the American Statistical Association, 67, 306–10.
37.
QuandtRE and RamseyJB (1978) Estimating mixtures of normal distributions and switching regressions (with discussion). Journal of the American Statistical Association, 73, 730–52.
38.
Rabe-HeskethS, SkrondalA and PicklesA (2005) Maximum likelihood estimation of limited and discrete dependent variable models with nested random effects. Journal of Econometrics, 128, 301–23.
39.
SchwarzGE (1978) Estimating the dimension of a model. Annals of Statistics, 6, 461–64.
40.
SimarL (1976) Maximum likelihood estimation of a compound Poisson process. Annals of Statistics, 4, 1200–9.
41.
VermuntJ (2010) Latent class modeling with covariates: Two improved three-step approaches. Political Analysis, 18, 450–469.
42.
WedelM and DeSarboWS (1995) A mixture likelihood approach for generalized linear models. Journal of Classification, 12, 21–55.
