Analysts fitting a hierarchical Bayesian model must specify the distribution of heterogeneity. There are several distributions to choose from, including the multivariate normal, mixture of normals, Dirichlet processes priors, and so forth. Although significant progress has been made, estimating the models and obtaining measures for model selection remain ongoing areas of research for more flexible distributions of heterogeneity. As a result, the multivariate normal remains the default choice for many researchers and software packages. This article proposes model-checking statistics that signal the adequacy of the multivariate normal assumption for the distribution of heterogeneity; these methods do not require the analyst to fit alternative models. The authors use posterior predictive model checking to determine whether a discrepancy exists between the individual-level parameters and those implied by the assumed distribution of heterogeneity. In simulated and real data sets, the results show that these statistics are useful for identifying when the multivariate normal distribution is adequate, when there is a departure in the tails of the distribution, and when a multimodal distribution of heterogeneity may be more appropriate.
AllenbyGreg M., and RossiPeter E. (1999), “Marketing Models of Consumer Heterogeneity,”Journal of Econometrics, 89(1-2), 57–78.
2.
AndrewsRick L., AinslieAndrew, and CurrimImran S. (2002a), “An Empirical Comparison of Logit Choice Models with Discrete Versus Continuous Representations of Heterogeneity,”Journal of Marketing Research, 39(November), 479–87.
3.
AndrewsRick L., AinslieAndrew, and CurrimImran S. (2002b), “Hierarchical Bayes Versus Finite Mixture Conjoint Analysis Models: A Comparison of Fit, Prediction, and Partworth Recovery,”Journal of Marketing Research, 39(February), 87–98.
4.
AnsariAsim, and MelaCarl F. (2003), “E-Customization,”Journal of Marketing Research, 40(May), 131–45.
5.
BasuSanjib, and ChibSiddhartha (2003), “Marginal Likelihood and Bayes Factors for Dirichlet Process Mixture Models,”Journal of the American Statistical Association, 98(461), 224–35.
6.
BayarriM.J., and BergerJamew O. (2000), “P Values for Composite Null Models,”Journal of the American Statistical Association, 95(452), 1127–42.
7.
BayarriM.J., and CastellanosM.E. (2007), “Bayesian Checking of the Second Levels of Hierarchical Models,”Statistical Science, 22(3), 322–43.
8.
CarlinB.P., and ChibS. (1995), “Bayesian Model Choice via Markov Chain Monte Carlo Methods,”Journal of the Royal Statistical Society: Series B, 57(3), 473–84.
9.
CeleuxGilles, HurnMerrilee, and RobertChristian P. (2000), “Computational and Inferential Difficulties with Mixture Posterior Distributions,”Journal of the American Statistical Association, 95(451), 957–70.
10.
ChibSiddhartha (1995), “Marginal Likelihood from the Gibbs Output,”Journal of the American Statistical Association, 90(432), 1312–21.
11.
ChibSiddhartha, and JeliascovIvan (2001), “Marginal Likelihood from the Metropolis-Hasting Output,”Journal of the American Statistical Association, 96(453), 270–81.
12.
DeyDipak K., GelfandAlan E., SwartzTim B., and VlachosPantelis K. (1998), “A Simulation-Intensive Approach for Checking Hierarchical Models,”Test, 7(2), 325–46.
13.
EscobarMichael D., and WestMike (1995), “Bayesian Density Estimation and Inferences Using Mixtures,”Journal of the American Statistical Association, 90(430), 577–88.
14.
Frühwirth-SchnatterSylvia (2004), “Estimating Marginal Likelihoods for Mixture and Markov Switching Models Using Bridge Sampling Techniques,”Econometrics Journal, 7(1), 143–67.
15.
GelfandAlan E., and DeyDipak K. (1994), “Bayesian Model Choice: Asymptotics and Exact Calculations,”Journal of the Royal Statistical Society: Series B, 56(3), 501–514.
16.
GelmanAndrew (2003), “A Bayesian Formulation of Exploratory Data Analysis and Goodness-of-Fit Testing,”International Statistical Review, 71(2), 369–82.
17.
GelmanAndrew (2004), “Exploratory Data Analysis for Complex Models,”Journal of Computational and Graphical Statistics, 13(4), 755–79.
18.
GelmanAndrew (2007), “Comment: Bayesian Checking of the Second Levels of Hierarchical Models,”Statistical Science, 22(3), 349–52.
19.
GelmanAndrew, CarlinJohn B., SternHal S., and RubinDonald B. (2004), Bayesian Data Analysis, 2d ed. New York: Champan & Hall/CRC.
20.
GelmanAndrew, MengXiao-Li, and SternHal (1996), “Posterior Predictive Assessment of Model Fitness via Realized Discrepancies,”Statistica Sinica, 6(4), 733–807.
21.
GilbrideTimothy J., and AllenbyGreg M. (2004), “A Choice Model with Conjunctive, Disjunctive, and Compensatory Screening Rules,”Marketing Science, 23(3), 391–406.
22.
GilbrideTimothy J., and AllenbyGreg M. (2006), “Estimating Heterogeneous EBA and Economic Screening Rule Choice Models,”Marketing Science, 25(5), 494–509.
23.
GreenPeter J. (1995), “Reversible Jump Markov Chain Monte Carlo Computation and Bayesian Model Determination,”Biometrika, 82(4), 711–32.
24.
JedidiKamel, JagpalSharan, and ManchandaPuneet (2003), “Measuring Heterogeneous Reservation Prices for Product Bundles,”Marketing Science, 22(1), 107–130.
25.
JeffreysHarold (1935), “Some Tests of Significance, Treated by the Theory of Probability,”Mathematical Proceedings of the Cambridge Philosophy Society, 31(2), 203–222.
26.
JeffreysHarold (1961), Theory of Probability, 3d ed. Oxford: Oxford University Press.
27.
JohnsonRichard A., and WichernDean W. (2007), Applied Multivariate Statistical Analysis, 6th ed. Upper Saddle River, NJ: Pearson/Prentice Hall.
28.
KassRobert E., and RafteryAdrian E. (1995), “Bayes Factors,”Journal of the American Statistical Association, 90(430), 773–95.
29.
KimJin Gyo, MenzefrickeUlrich, and FeinbergFred M. (2004), “Assessing Heterogeneity in Discrete Choice Models Using a Dirichlet Process Prior,”Review of Marketing Science, 2(1), 1–39.
30.
LenkPeter J. (2009), “Simulation Pseudo-Bias Correction to the Harmonic Mean Estimator of Integrated Likelihoods,”Journal of Computational and Graphical Statistics, 18(4), 941–60.
31.
LenkPeter J., and DeSarboWayne S. (2000), “Bayesian Inference for Finite Mixtures of Generalized Linear Models with Random Effects,”Psychometrika, 65(1), 93–119.
32.
MengXiao-Li (1994), “Posterior Predictive p-Values,”The Annals of Statistics, 22(3), 1142–60.
33.
MengXiao-Li, and WongWing Hung (1996), “Simulating Ratios of Normalizing Constants via a Simple Identity: A Theoretical Exploration,”Statistica Sinica, 6(4), 831–60.
34.
MoodAlexander M., GraybillFranklin A., and BoesDuane C. (1974), Introduction to the Theory of Statistics, 3d ed. New York: McGraw-Hill.
35.
NewtonMichael A., and RafteryAdrian E. (1994), “Approximating Bayesian Inference with the Weighted Likelihood Bootstrap,”Journal of the Royal Statistical Society Series B, 56(March), 3–48.
36.
NobileAgostino (2004), “On the Posterior Distribution of the Number of Components in a Finite Mixture,”Annals of Statistics, 32(5), 2044–2073.
37.
NobileAgostino, and FearnsideAlastair T. (2007), “Bayesian Finite Mixtures with an Unknown Number of Components: The Allocation Sampler,”Statistical Computing, 17(2), 147–62.
38.
RobinsJames M., van der VaartAad, and VenturaValerie (2000), “Asymptotic Distributions of P Values in Composite Null Models,”Journal of the American Statistical Association, 95(452), 1143–56.
39.
RossiPeter E., AllenbyGreg M., and McCullochRobert (2005), Bayesian Statistics and Marketing.West Sussex, UK: John Wiley & Sons.
40.
SinharaySandip, and SternHal S. (2003), “Posterior Predictive Model Checking in Hierarchical Models,”Journal of Statistical Planning and Inference, 111(1-2), 209–221.
41.
SteinleyDoug, and HensonRobert (2005), “OCLUS: An Analytic Method for Generating Clusters with Known Overlap,”Journal of Classification, 22(1), 221–50.
42.
StephensMathew (2000), “Dealing with Label Switching in Mixture Models,”Journal of the Royal Statistical Society, Series B, 62(4), 795–809.
43.
TitteringtonD.M., SmithA.F.M., and MakovU.E. (1985), Statistical Analysis of Finite Mixture Distributions.New York: John Wiley & Sons.
44.
TrainKenneth E. (2003), Discrete Choice Methods with Simulation.Cambridge, UK: Cambridge University Press.
45.
WedelMichel, and PietersRik (2000), “Eye Fixations on Advertisements and Memory for Brands: A Model and Findings,”Marketing Science, 19(4), 297–312.
46.
WedelMichel, and ZhangJie (2004), “Analyzing Brand Competition Across Subcategories,”Journal of Marketing Research, 41(November), 448–56.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
