An index for characterizing the separation of two distributions is introduced. It is applied to assessing whether mixture components are clusters. A related property of being a satellite and a partial ordering of the components are defined. A sequence of clustering structures is defined for a finite mixture with a continuum of thresholds that qualify a cluster. The approach is suitable for outcomes with arbitrary univariate or multivariate distributions and their mixtures. The properties of the index are explored by simulations and on examples.
AndrewsJLMcNicholasPDSubediS (2011) Model-based classification via mixtures of multivariate image-distributions. Computational Statistics and Data Analysis, 55, 520–29.
2.
BasfordKMcLachlanGJ (1985) Estimation of allocation rates in a cluster analysis context. Journal of the American Statistical Association, 80, 286–93.
3.
BaudryJRafteryAECeleuxGLoKGottardoR (2010) Combining mixture components for clustering. Journal of Computational and Graphical Statistics, 19, 332–53.
4.
BhattacharyyaA (1943) On a measure of divergence between two statistical populations defined by their probability distributions. Bulletin of the Calcutta Mathematical Society, 35, 99–109.
5.
BiernackiCGovaertG (2000) Assessing a mixture model for clustering with the integrated completed likelihood. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22, 719–25.
6.
BouveyronC and Brunet-Saumard C (2013) Model-based clustering of high-dimensional data. A review. Computational Statistics and Data Analysis, 57; to appear.
7.
CerdeiraJOMartinsMJSilvaPC (2012) A combinatorial approach to assess the separability of clusters. Journal of Classification, 29, 7–22.
8.
CoxDRHinkleyDV (1974) Theoretical statistics.London: Chapman and Hall.
9.
DempsterAPLairdNMRubinDB (1977) Maximum likelihood for incomplete data via the EM algorithm. Journal of the Royal Statistical Society, Series B, 39, 1–38.
10.
FraleyCRafteryA (1998) How many clusters? Which clustering method? Answers via model-based cluster analysis. Technical Report No. 329, Department of Statistics, University of Washington.
11.
FukunagaK (1990) Introduction to statistical pattern recognition,, 2nd ed. New York: Academic Press.
12.
HennigC (2010) Methods for merging Gaussian mixture components. Advances in Data Analysis and Classification, 4, 3–34.
13.
HoltD and Smith, TMF (1979) Post stratification. Journal of the Royal Statistical Society, Series A, 142, 33–46.
14.
KassGV (1980) An exploratory technique for investigating large quantities of categorical data. Applied Statistics, 29, 119–27.
15.
KullbackSLeiblerRA (1951) On information and sufficiency. Annals of Mathematical Statistics, 22, 79–86.
16.
LiJ (2004) Clustering based on a multilayer mixture model. Journal of Computational and Graphical Statistics, 14, 547–68.
17.
LongfordNT (2007) Discussion of ‘Model-based clustering for social networks’, by HandcockMSRafteryAETantrumJM, Journal of the Royal Statistical Society, Series A, 170, 329.
18.
LongfordNTNicodemoC (2009) A sensitivity analysis of poverty definitions. IRISS Working Paper Series 2009–15. CEPS/ INSTEAD, Esch-sur-Alzette, Luxembourg.
19.
LongfordNTPittauMG (2006) Stability of household income in European countries in the 1990’s. Computational Statistics and Data Analysis, 51, 1364–83.
20.
McLachlanGJBasfordK (1988) Mixture models: Inference and applications to clustering.New York: Marcel Dekker.
MaitraRMelnykovV (2010) Simulating data to study performance of finite mixture modeling and clustering algorithms. Journal of Computational and Graphical Statistics, 19, 354–76.
MinotteMCScottDW (1993) The mode tree: A tool for visualisation of nonparametric density features. Journal of Computational and Graphical Statistics, 2, 51–68.
25.
PittauMGJohnsonP (2010) Mixture models, convergence clubs and polarization. Review of Income and Wealth, 56, 102–22.
26.
RaySLindsayBG (2005) The topography of multivariate normal mixtures. The Annals of Statistics, 33, 2042–65.
27.
RichardsonSGreenPJ (1997) On Bayesian analysis of mixtures with an unknown number of components. Journal of the Royal Statistical Society, Series B, 59, 731–92.
28.
StephensM (2000) Dealing with label switching in mixture models. Journal of the Royal Statistical Society, Series B, 62, 795–809.
29.
SugarCAJamesGM (2003) Finding the number of clusters in a dataset: An information-theoretic approach. Journal of the American Statistical Association, 98, 750–63.
30.
TibshiraniRHastieT (2001) Estimating the number of clusters in a data set via the gap statistic. Journal of the Royal Statistical Society, Series B, 63, 411–23.
31.
WangYCheeCS (2012) Density estimation using non-parametric and semi-parametric mixtures. Statistical Modelling, 12, 67–92.
