A new clustering algorithm, based on Adaptive Local Density (ALD) and Evidential -Nearest Neighbors (EKNN), is proposed here. In density peaks clustering, many other density metrics fail to detect cluster centers on multi-density datasets, however the ALD deals with the tasks very well since it can better utilize the local information. To assign the remaining points after detecting the cluster centers, an assigning strategy in the framework of evidential theory, named EKNN, is created. The advantage of EKNN is twofold. Firstly, by fusing the information of -Nearest Neighbors, it can reduce the risk of a phenomenon named domino effect: the drawback of one classical clustering, i.e., clustering by fast search and find of density peaks (always named as DPC). Secondly, it can detect border and noise points simultaneously since a credal partition is derived which can mine ambiguity and uncertainty of data structure. Simulations on both synthetic and real-world datasets demonstrate the outstanding performance of ALD-EKNN compared with DPC and some of its successors.
Yibang RuanA.Yanshan XiaoA.Zhifeng HaoA.C. and Bo LiuB., A nearest-neighbor search model for distance metric learning, Information Sciences552 (2021), 261–277.
2.
ArthurD. and VassilvitskiiS., k-means++: The advantages of careful seeding, in: Proceedings of the Eighteenth Annual ACM-SIAM Symposium on Discrete Algorithms, pages 1027–1035, Society for Industrial and Applied Mathematics, 2007.
3.
ChenJ. and SchizasI.D., Distributed information-based clustering of heterogeneous sensor data, Signal Processing126 (2016), 35–51.
4.
DavisJ.V.KulisB.JainP.SraS. and DhillonI.S., Information-theoretic metric learning, in: Machine Learning, Proceedings of the Twenty-Fourth International Conference (ICML 2007), Corvallis, Oregon, USA, June 20–24, 2007, 2007.
5.
DemišarJ. and SchuurmansD., Statistical comparisons of classifiers over multiple data sets, Journal of Machine Learning Research7(1) (2006), 1–30.
6.
DenœuxT. and MassonM.-H., Evclus: Evidential clustering of proximity data, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics)34(1) (2004), 95–109.
7.
DuM.DingS. and JiaH., Study on density peaks clustering based on k-nearest neighbors and principal component analysis, Knowledge-Based Systems99 (2016), 135–145.
8.
DuM.DingS. and XueY., A novel density peaks clustering algorithm for mixed data, Pattern Recognition Letters97 (2017), 46–53.
9.
EsterM.KriegelH.-P.SanderJ.XuX. et al., A density-based algorithm for discovering clusters in large spatial databases with noise, in: Kdd, Vol. 96, pages 226–231, 1996.
10.
FräntiP. and VirmajokiO., Iterative shrinking method for clustering problems, Pattern Recognition39(5) (2006), 761–775.
11.
FrantiP.VirmajokiO. and HautamakiV., Fast agglomerative clustering using a k-nearest neighbor graph, IEEE Transactions on Pattern Analysis and Machine Intelligence28(11) (2006), 1875–1881.
12.
GengY.-a.LiQ.ZhengR.ZhuangF.HeR. and XiongN., Recome: A new density-based clustering algorithm using relative knn kernel density, Information Sciences436 (2016), 13–30.
13.
GongC.SuZ.G.WangP.H. and WangQ., Cumulative belief peaks evidential k-nearest neighbor clustering, Knowledge-Based Systems200 (2020), 105982.
14.
GrecheL.JazouliM.Es-SbaiN.MajdaA. and ZarghiliA., Comparison between euclidean and manhattan distance measure for facial expressions classification, in: International Conference on Wireless Technologies, 2017.
15.
JainA.K., Data clustering: 50 years beyond k-means, Pattern Recognition Letters31(8) (2010), 651–666.
16.
JajooG.KumarY.YadavS.K.AdhikariB. and KumarA., Blind signal modulation recognition through clustering analysis of constellation signature, Expert Systems with Applications90 (2017), 13–22.
17.
JiangX.Zhong-YangX.Yu-FangZ.YongF. and JieM., Density core-based clustering algorithm with dynamic scanning radius, Knowledge Based Systems142 (2018), 58–70.
18.
KamimuraR. and UchidaO., Greedy network-growing by minkowski distance functions, in: IEEE International Joint Conference on Neural Networks, 2004.
19.
KanungoT.MountD.M.NetanyahuN.S.PiatkoC.D.SilvermanR. and WuA.Y., An efficient k-means clustering algorithm: Analysis and implementation, IEEE Transactions on Pattern Analysis & Machine Intelligence (7) (2002), 881–892.
20.
KarkkainenI. and FrantiP., Dynamic local search for clustering with unknown number of clusters, in: Object Recognition Supported by User Interaction for Service Robots, Vol. 2, pages 240–243, IEEE, 2002.
21.
LichmanM. et al., Uci machine learning repository, 2013.
22.
LikasA.VlassisN. and VerbeekJ.J., The global k-means clustering algorithm, Pattern Recognition36(2) (2003), 451–461.
23.
LiuJ.PhamT.D.YanH. and LiangZ., Fuzzy mixed-prototype clustering algorithm for microarray data analysis, Neurocomputing276 (2018), 42–54.
24.
LiuR.WangH. and YuX., Shared-nearest-neighbor-based clustering by fast search and find of density peaks, Information Sciences450 (2018), 200–226.
25.
LiuZ.-G.DezertJ.MercierG. and PanQ., Belief c-means: An extension of fuzzy c-means algorithm in belief functions framework, Pattern Recognition Letters33(3) (2012), 291–300.
26.
LiuZ.-G.PanQ. and DezertJ., Evidential classifier for imprecise data based on belief functions, Knowledge-Based Systems52 (2013), 246–257.
27.
LiweiW.YanZ. and JufuF., On the euclidean distance of images, IEEE Transactions on Pattern Analysis and Machine Intelligence27(8) (2005), 1334–1339.
28.
MassonM.-H. and DenoeuxT., Ecm: An evidential version of the fuzzy c-means algorithm, Pattern Recognition41(4) (2008), 1384–1397.
29.
ObermayerK.BlasdelG.G. and SchultenK., Statistical-mechanical analysis of self-organization and pattern formation during the development of visual maps, Physical Review A45(10) (1992), 7568–7589.
30.
PagnucoI.A.PastoreJ.I.AbrasG.BrunM. and BallarinV.L., Analysis of genetic association using hierarchical clustering and cluster validation indices, Genomics109(5–6) (2017), 438–445.
31.
ParmarM.WangD.ZhangX.TanA.-H.MiaoC.JiangJ. and ZhouY., Redpc: A residual error-based density peak clustering algorithm, Neurocomputing348 (2018), 82–96.
RezaeiM. and FrantiP., Set matching measures for external cluster validity, IEEE Transactions on Knowledge and Data Engineering28(8) (2016), 2173–2186.
34.
RodriguesE.O., Combining minkowski and cheyshev: New distance proposal and survey of distance metrics using k-nearest neighbours classifier, Pattern Recognition Letters110(jul.15) (2018), 66–71.
35.
RodriguezA. and LaioA., Clustering by fast search and find of density peaks, Science344(6191) (2014), 1492–1496.
36.
ShaferG., A mathematical theory of evidence, Vol. 42, Princeton university press, 1976.
37.
SmetsP., Decision making in the tbm: The necessity of the pignistic transformation, International Journal of Approximate Reasoning38(2) (2005), 133–147.
38.
SuZ. and DenoeuxT., Bpec: Belief-peaks evidential clustering, IEEE Transactions on Fuzzy Systems27(1) (2019), 111–123.
39.
Van PhamN.PhamL.T.NguyenT.D. and NgoL.T., A new cluster tendency assessment method for fuzzy co-clustering in hyperspectral image analysis, Neurocomputing307 (2018), 213–226.
40.
VeenmanC.J.ReindersM.J.T. and BackerE., A maximum variance cluster algorithm, IEEE Transactions on Pattern Analysis and Machine Intelligence24(9) (2002), 1273–1280.
41.
VinhN.X.EppsJ. and BaileyJ., Information Theoretic Measures for Clusterings Comparison: Variants, Properties, Normalization and Correction for Chance, JMLR.org, 2010.
42.
XianF.TieZ.GuanY. and RaoS., Quasi-cluster centers clustering algorithm based on potential entropy and t-distributed stochastic neighbor embedding, Soft Computing (44) (2018), 1–13.
43.
XieJ.GaoH.XieW.LiuX. and GrantP.W., Robust clustering by detecting density peaks and assigning points based on fuzzy weighted k-nearest neighbors, Information Sciences354 (2016), 19–40.
44.
XuJ.WangG. and DengW., Denpehc: Density peak based efficient hierarchical clustering, Information Sciences373 (2016), 200–218.
45.
YaohuiL.ZhengmingM. and FangY., Adaptive density peak clustering based on k-nearest neighbors with aggregating strategy, Knowledge-Based Systems133 (2017), 208–220.
46.
ZhongG.ZhengY.LiS. and FuY., Slmoml: Online metric learning with global convergence, IEEE Transactions on Circuits and Systems for Video Technology28(10) (2017), 2460–2472.
