Constrained parameter problems arise in a wide variety of applications. This article
deals with estimation and model selection in linear mixed models with inequality
constraints on the parameters. It is shown that different theories can be translated
into statistical models by putting constraints on the model parameters yielding a
set of competing models. A new approach based on the principle of encompassing
priors is proposed and used to compute Bayes factors and subsequently posterior
model probabilities. Model selection is based on posterior model probabilities. The
approach is illustrated using a longitudinal data set.
Box GEP
and
Tiao GC
(1965)
Multiparameter problems from a Bayesian point of view
. The Annals of Mathematical Statistics36,
1468-1482
.
2.
Browne WJ (1998) Applying MCMC methods to multi-level models. PhD
dissertation, Department of Mathematical Sciences, University of Bath, UK.
3.
Browne WJ
and
Draper D
(2000)
Implementation and performance issues in the Bayesian and likelihood
fitting of multilevel models
. Computational Statistics15,
391-420
.
4.
Berger JO
and
Delempady M
(1987)
Testing precise hypotheses
. Statistical Science2,
317-335
.
5.
Carlin BP
and
Chib S
(1995)
Bayesian model choice via Markov chain Monte Carlo methods
. Journal of the Royal Statistical Society B57,
473-484
.
6.
Chen MH
and
Shao QM
(1998)
Monte Carlo methods for Bayesian analysis of constrained parameter problems
. Biometrika85,
73-87
.
7.
Chib S
(1995)
Marginal likelihood from the Gibbs output
. Journal of the American Statistical Association90,
1313-1321
.
8.
Dalla Valle A
(2004) The skew-normal distribution. In
Genton MG
, editors, Skew-elliptical distributions and their applications.
Chapman & Hall/CRC
, 3-24.
9.
Diggle PJ
(1990) Time series: a biostatistical introduction.
Oxford University Press
.
10.
Diggle PJ
and
Kenward MG
(1994)
Informative drop-out in longitudinal data analysis
. Applied Statistics43,
49-93
.
11.
Diggle PJ
,
Liang KY
and
Zeger SL
(1994) Analysis of longitudinal data.
Clarendon Press
.
12.
Gelfand AE
and
Smith AFM
(1990)
Sampling based approaches to calculating marginal densities
. Journal of the American Statistical Association85,
398-409
.
13.
Gelfand AE
,
Smith AFM
and
Lee TM
(1992)
Bayesian analysis of constrained parameter and truncated data problems
using Gibbs sampling
. Journal of the American Statistical Association87,
523-532
.
14.
Gelman A
,
Carlin JB
,
Stern HS
and
Rubin DB
(2000) Bayesian data analysis.
Chapman & Hall
, 474-475.
15.
Geman D
and
Geman S
(1984)
Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images
. IEEE Transactions on Pattern Analysis and Machine Intelligence6,
721-741
.
16.
Hoijtink H
(2000)
Posterior inference in the random intercept model based on samples obtained
with Markov chain Monte Carlo methods
. Computational Statistics15,
315-336
.
17.
Kass RE
and
Raftery AE
(1995)
Bayes factors
. Journal of the American Statistical Association90,
773-795
.
18.
Klugkist I
,
Laudy O
and
Hoijtink H
(2005a)
Inequality constrained analysis of variance: a Bayesian approach
. Psychological Methods10,
477-493
.
19.
Klugkist I
,
Laudy O
and
Hoijtink H
(2005b)
Bayesian eggs and Bayesian omelettes: reply to Stern (2005)
. Psychological Methods10,
500-503
.
20.
Lee PM
(1997) Bayesian statistics: an introduction.
Arnold
.
21.
Liseo B
and
Loperfido N
(2003)
A Bayesian interpretation of the multivariate skew-normal distribution
. Statistics and Probability Letters61,
395-401
.
22.
Lindley DV
(1964)
The Bayesian analysis of contingency tables
. The Annals of Mathematical Statistics35,
1622-1643
.
23.
Mukerjee H
and
Tu R
(1995)
Order-restricted inferences in linear regression
. Journal of the American Statistical Association90,
717-728
.
24.
Newton MA
and
Raftery AE
(1994)
Approximate Bayesian inference with the weighted likelihood bootstrap
. Journal of the Royal Statistical Society B56,
3-48
.
25.
Robertson T
,
Wright FT
and
Dykstra RL
(1988) Order restricted statistical inference.
John Wiley & Sons
.
26.
Spiegelhalter DJ, Thomas A, Best NG and Lunn D (2003) WinBUGS Version 1.4
Users Manual. MRC Biostatistics Unit, Cambridge. Retrieved 26 July 2006 from http://www.mrc-bsu.cam.ac.uk/bugs/.
27.
Stern HS
(2005)
Model inference or model selection: discussion of Klugkist, Laudy and
Hoijtink (2005)
. Psychological Methods10,
494-499
.
28.
Verblya AP
and
Cullis BR
(1990)
Modelling in repeated measures experiments
. Applied Statistics39,
341-356
.
29.
Verbeke G
and
Molenberghs G
(2000) Linear mixed models for longitudinal data.
Springer-Verlag
.
30.
Zeger SL
and
Karim MR
(1991)
Generalised linear models with random effect: a Gibbs sampling
. Journal of the American Statistical Association86,
79-86
.
