Clustering is the primary technique used to divide data into groups based on unknown models inherent to the data. Regulation of the entire clustering method is complicated and submitted to several uncertainties. Similarity measures one of the first decisions to be made to establish how the similarity between two objects must be measured. This research focuses on the influence of similarity measures in the hierarchical clustering to uncover patterns in heavy-tailed data. Stable distributions are the most important subclass of heavy-tailed distributions. A well-known measure of similarity is defined based on correlation of two objects. However, this measure cannot be used for heavy-tailed data. We will illustrate how to perform a hierarchical cluster analysis in heavy-tailed data by extending the similarity measure based on the correlation. We introduce a new similarity measure based on covariation coefficient. We evaluate the performance of covariation similarity and compare it to others using external and internal criteria.
AggarwalC.C.HinneburgA. and KeimD.A., On the surprising behavior of distance metrics in high dimensional spaces, 8th International Conference Lecture Notes in Computer Science1973 (2001), 420–434.
2.
AmorimR.C. and MirkinB., Minkowski metric, feature weighting and anomalous cluster initializing in K-Means clustering, Pattern Recognition45(3) (2012), 1061–1075.
3.
AssentI., Clustering high dimensional data, WIREs Data Mining and Knowledge Discovery2(4) (2012), 340–350.
4.
EmbrechtsP.KlppelbergC. and MikoschT., Modelling extremal Events: for insurance and finance, Springer, Berlin Heidelberg, 2013.
FennD.J.PorterM.A.MuchaP.J.McDonaldM.WilliamsS.JohnsonN.F. and JonesN.S., Dynamical clustering of exchange rates, Quantitative Finance12(10) (2012), 1493–1520.
7.
FilipponeM.CamastraF.MasulliF. and RovettaS., A survey of kernel and spectral methods for clustering, Pattern Recognition41(1) (2008), 176–190.
8.
FrancoisD.WertzV. and VerleysenM., The concentration of fractional distances, IEEE Transactions on Knowledge and Data Engineering19(7) (2007), 873–886.
9.
GanG.MaCh. and WuJ., Data clustering: Theory, algorithms, and applications, ASA-SIAM, Philadelphia, 2007.
10.
GargA.EnrightC.G. and MaddenM.G., On asymmetric similarity search, 2015 IEEE 14th International Conference on Machine Learning and Applications (2015), 649–654.
11.
GevaA.B.SteinbergY.BruckmairSh.NahumG., A comparison of cluster validity criteria for a mixture of normal distributed data, Pattern Recognition Letters21(6–7) (2000), 511–529.
12.
Gil-GarciaR. and Pons-PorrataA., Dynamic hierarchical algorithms for document clustering, Pattern Recognition Letters31(6) (2010), 469–477.
13.
GuerraL.RoblesV.BielzaC. and LarraagaP., A comparison of clustering quality indices using outliers and noise, Intelligent Data Analysis16(4) (2012), 703–715.
14.
HeyerL.KruglyakS. and YoosephS., Exploring expression data: Identification and analysis of coexpressed genes, Genome Research9 (1999), 1106–1115.
15.
JiaY. and DarrellT., Heavy-tailed Distances for Gradient Based Image Descriptors, Advances in Neural Information Processing Systems24, (2011), 379–405.
16.
JiangD.TangC. and ZhangA., Cluster analysis for gene expression data: A survey, IEEE Transactions on Knowledge and Data Engineering16(11) (2004) 1370–1386.
17.
KwapieńJ.GworekS.DrożdżS. and GórskiA., Analysis of a network structure of the foreign currency exchange market, Journal of Economic Interaction and Coordination4(1) (2009), 1860–7128.
18.
MartosG.MunozA. and GonzalezJ., Generalizing the Mahalanobis distance via density kernels, Intelligent Data Analysis18(6) (2014), 19–31.
19.
McDonaldM.SulemanO.WilliamsS.HowisonS. and JohnsonS.N.F., Detecting a currency’s dominance or dependence using foreign exchange network trees, Physical Review E72(4) (2005), 046106.
20.
ModarresR. and NolanJ.P., A Method for simulating stable random vectors, Computational Statistics9 (1994), 11–19.
21.
NielsenF. and NockR., Clustering multivariate normal distributions, Lecture Notes in Computer Science5416 (2009), 164–174.
22.
NikiasC.L. and ShaoM., Signal processing with alpha-stable distributions and applications, Wiley, New York, 1995.
23.
NolanJ.P., Stable: Functions for working with stable distributions, R package version 5.1, 2009.
24.
NolanJ.P.PanorskaA.K. and McCullochJ.H., Estimation of stable spectral measures, Mathematical and Computer Modelling, 34 (2001), 1113–1122.
25.
OmranM.G.EngelbrechtA.P. and SalmanA., An overview of clustering methods, Intelligent Data Analysis11(6) (2007), 583–605.
26.
R Core Team, R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria, 2013. ISBN 3-900051-07-0, URL http://www.R-project.org/.
27.
ReissR.D. and ThomasM., Statistical Analysis of Extreme Values: with applications to insurance, finance, hydrology and other fields, Springer, 2007.
28.
RencherA.C., Methods of multivariate analysis, Wiley, New York, 2003.
29.
ResnickS.I., Heavy-tail phenomena: Probabilistic and statistical modeling, Springer, New York, 2007.
30.
Salas-GonzalezD.KuruogluE.E.RuizD.P., Modelling with mixture of symmetric stable distributions using Gibbs sampling, Signal Processing, 90(3) (2010), 774–783.
31.
SamorodnitskyG. and TaqquM.S., Stable non-Gaussian random processes: Stochastic models with infinite variance, Chapman & Hall, New York, 1994.
32.
SzekelyG.J. and RizzoM.L., Hierarchical clustering via joint between-within distances: Extending Ward’s minimum variance method, Journal of Classification22(2) (2005), 151–183.
33.
TeimouriM. and RezakhahS.MohammdpourA., EM algorithm for symmetric stable mixture model, Communications in Statistics-Simulation and Computation (2017), 1532–4141.
34.
WangJ.LiM.ChenJ. and PanY., A fast hierarchical clustering algorithm for functional modules discovery in protein interaction networks, IEEE Transactions on Computational Biology and Bioinformatics8(3) (2011), 607–620.
35.
WangG. and XieC., Tail dependence structure of the foreign exchange market: A network view, Expert Systems with Applications46 (2016), 164–179.
