We derive a multivariate latent Markov model with number of latent states that can possibly change at each time point. We model both the manifest and latent distributions conditionally on explanatory variables. Bayesian inference is based on a transdimensional Markov Chain Monte Carlo approach, where Reversible Jump is separately performed for each time occasion. In a simulation study, we show how our approach can recover the true underlying sequence of latent states with high probability, and that it has lower bias than competitors. We conclude with an analysis of the well-being of 100 nations, as expressed by the dimensions of the Human Development Index, for six-time points spanning a period of 22 years. R code with an implementation is available as supplementary material, together with files for reproducing the data analysis.
AcemogluD and RobinsonJ (2010) The role of institutions in growth and development. Review of Economic Institutions, 1, 1–33.
2.
AcemogluD and RobinsonJ (2012) Why nations fail: The origins of power, prosperity, and poverty. New York: Crown.
3.
AltmanRM (2007) Mixed hidden Markov models: an extension of the hidden Markov model to the longitudinal data setting. Journal of the American Statistical Association, 102, 201–210.
4.
AndersonG, FarcomeniA, PittauMG and ZelliR (2016) A new approach to measuring and studying the characteristics of class membership: Examining poverty, inequality and polarization in urban China. Journal of Econometrics, 191, 348–359.
5.
AndersonG, FarcomeniA, PittauMG and ZelliR (2019a) Rectangular latent Markov models for time-specific clustering, with an analysis of the well being of nations. Journal of the Royal Statistical Society (Series C), 68, 603–621.
6.
AndersonG, FarcomeniA, PittauMG and ZelliR (2019b). Multidimensional nation wellbeing, more equal yet more polarized: an analysis of the progress of human development since 1990. Journal of Economic Development, 44.
7.
BarbieriMM and BergerJ (2004) Optimal predictive model selection. Annals of Statistics, 32, 870–897.
8.
BartolucciF and FarcomeniA (2009) A multivariate extension of the dynamic logit model for longitudinal data based on a latent Markov heterogeneity structure. Journal of the American Statistical Association, 104, 816–831.
9.
BartolucciF and FarcomeniA (2015) A discrete time event-history approach to informative drop-out in mixed latent Markov models with covariates. Biometrics, 71, 80–89.
10.
BartolucciF and FarcomeniA (2019) A sharedparameter continuous-time hidden Markov and survival model for longitudinal data with informative drop-out. Statistics in Medicine, 38, 1056–1073.
11.
BartolucciF and FarcomeniA (2022a) A spatiotemporal model based on discrete latent variables for the analysis of COVID-19 incidence. Spatial Statistics, 49, 100504.
12.
BartolucciF and FarcomeniA (2022b) A hidden Markov space-time model for mapping of the dynamics of global access to food. Journal of the Royal Statistical Society (Series A), 185, 246–266.
13.
BartolucciF and PandolfiS (2018) Bayesian inference for a class of latent Markov models for categorical longitudinal data. arXiv:1101.0391v2.
14.
BartolucciF, FarcomeniA and PennoniF (2013) Latent Markov Models for Longitudinal Data. Boca Raton, FL: Chapman & Hall/CRC Press.
15.
BartolucciF, FarcomeniA and PennoniF (2014) Latent Markov models: a review of a general framework for the analysis of longitudinal data with covariates (with discussion). TEST, 23, 433–486.
16.
BartolucciF, LupparelliM and MontanariGE (2009) Latent Markov models for longitudinal binary data: An application to the performance evaluation of nursing homes. Annals of Applied Statistics, 3, 611–636.
17.
BartolucciF, PennoniF and FrancisB (2007) A latent Markov model for detecting patterns of criminal activity. Journal of the Royal Statistical Society (Series A), 170, 115–132.
18.
BaumL, PetrieT, SoulesG and WeissN (1970) A maximization technique occurring in the statistical analysis of probabilistic functions of Markov chains. Annals of Mathematical Statistics, 41, 164–171.
19.
Bo¨ ckenholtU (1997) Concomitant variables in latent change models. In Applications of latent trait and latent class models in the social sciences, pages 361–369. Kornwestheim: Waxmann Publishing Co.
20.
BockenholtU (2005) A latent Markov model for the analysis of longitudinal data collected in continuous time: States, durations, and transitions. Psychological Methods, 10, 65–83.
21.
BrunelN and PieczynskiW (2005) Unsupervised signal restoration using hidden Markov chains with copulas. Signal Processing, 85, 2304–2315.
22.
Cappe´O, RobertCP and RydenT (2003) Reversible jump, birth-and-death and more general continuous time Markov Chain Monte Carlo samplers. Journal of the Royal Statistical Society (Series B), 65, 679–700.
23.
Cappe´O, MoulinesE and RydenT (2005) Inference in Hidden Markov Models. Berlin: SpringerVerlag.
24.
Di MariR, DottoF, FarcomeniA and PunzoA (2022) Assessing measurement invariance for longitudinal data through latent Markov models. Structural Equation Modeling, 29, 381–393.
FarcomeniA (2015) Generalized linear mixed models based on latent Markov heterogeneity structures. Scandinavian Journal of Statistics, 42, 1127–1135.
27.
FarcomeniA (2017) Penalized estimation in latent Markov models, with application to monitoring serum Calcium levels in end-stage kidney insufficiency. Biometrical Journal, 59, 1035–1046.
28.
GelmanA and RubinDB (1992) Inference from iterative simulation using multiple sequences. Statistical Science, 7, 457–472.
29.
GelmanA, CarlinJB, SternHS, DunsonDB, VehtariA and RubinDB (2014) Bayesian data analysis. London: Chapman and Hall/CRC.
30.
GreenPJ (1995) Reversible jump Markov Chain Monte Carlo computation and Bayesian model determination. Biometrika, 82, 711–732.
31.
GrossmanG and HelpmannE (1991) Trade, knowledge spillovers, and growth. European Economic Review, 35, 517–26.
32.
HardleWK, OkhrinO and WangW (2015) Hidden Markov structures for dynamic copulae. Econometric Theory, 31, 981–1015.
33.
JacksonCH, SharpleLD, ThompsonSG, DuffySW and CoutoE (2003) Multistate markov models for disease progression with classification error. Journal of the Royal Statistical Society (Series D), 52, 193–209.
34.
JohnsonP and PapageorgiouC (2020) What remains of cross-country convergence? Journal of Economic Literature, 58, 129–75.
35.
KassRE and WassermanL (1995) A reference Bayesian test for nested hypotheses and its relationship to the Schwarz criterion. Journal of the American Statistical Association, 90, 928–934.
36.
LucasR (1988) On the mechanics of economic development. Journal of Monetary Economics, 22, 4–42.
37.
MarinJ-M, MengersenK and RobertCP (2005) Bayesian modelling and inference on mixtures of distributions. In Bayesian Thinking: Handbook of Statisics, edited by DeyD. and RaoC., volume 25, pages 459–507. Amsterdam: Elsevier.
38.
MaruottiA (2011) Mixed hidden Markov models for longitudinal data: An overview. International Statistical Review, 79, 427–454.
39.
NaranjoL, LesaffreE and PerezCJ (2020) A mixed hidden Markov model for multivariate monotone disease processes in the presence of measurement errors. Statistical Modelling, 22(5), 1471082X2097347.
40.
OttingM and AndreasG (2021) A regularized hidden Markov model for analyzing the hot shoe in football. Statistical Modelling. https://doi.org/10.1177/1471082X211008014
41.
OttingM, LangrockR and MaruottiA (2021) A copula-based multivariate hidden Markov model for modelling momentum in football. AStA Advances in Statistical Analysis, 1–19.
42.
ParoliR and SpeziaL (2010) Reversible jump Markov Chain Monte Carlo methods and segmentation algorithms in hidden Markov models. Australian and New Zealand Journal of Statistics, 52, 151–166.
43.
PhillipsP and SulD (2009) Economic transition and growth. Journal of Applied Econometrics, 24, 1153–1185.
44.
PhillipsPCB and SulD (2007) Some empirics on economic growth under heterogeneous technology. Journal of Macroeconomics, 29, 455–469.
45.
PittauMG, ZelliR and JohnsonP (2010) Mixture models, convergence clubs, and polarization. Review of Income and Wealth, 56, 102–122.
46.
RobertCP, Ryde´nT and TitteringtonDM (2000) Bayesian inference in hidden Markov models through the reversible jump Markov Chain Monte Carlo method. Journal of the Royal Statistical Society (Series B), 62, 57–75.
47.
SpeziaL (2010) Bayesian analysis of multivariate Gaussian hidden Markov models with an unknown number of regimes. Journal of Time Series Analysis, 31, 1–11.
48.
United Nations Development Programme (1990) Human Development Report 1990. Oxford University Press.
49.
WelchLR (2003) Hidden Markov models and the Baum-Welch algorithm. IEEE Information Theory Society Newsletter, 53, 1–13.
50.
ZucchiniW, MacDonaldIL and LangrockR (2016) Hidden Markov Models for time series: an introduction using R. New York: SpringerVerlag.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
