Sage Journals: Discover world-class research

Abstract

Fuzzy C-Means (FCM) is the most commonly used and discussed fuzzy clustering algorithm in the literature. Nevertheless, it is well known that the performance of FCM is strongly affected by the selection of the initial cluster centers. In other words, the selection of a good set of initial cluster centers plays an important role in the performance of this algorithm. The most common selection method is the trial-and-test random method, in which each execution is performed with different initial centers, randomly generated, resulting in different dataset partitions. This paper proposes two methods to obtain the initial cluster centers which are applied in FCM and its variants. The proposed methods are deterministic, since, for each data set and number of clusters, they will always provide the same cluster centers set. The main advantage of these methods is to provide high quality partitions faster than the original methods as well as other FCM and ckMeans-based algorithms with deterministic selection of cluster centers.

Keywords

Data clustering fuzzy c-means initial centers cluster validation indexes

Get full access to this article

View all access options for this article.

References

Abu-Zeid

Kashif

and Badawy

O.M.

, Immune based clustering for medical diagnostic systems, in: IEEE 2012 International Conference on Advanced Computer Science Applications and Technologies (ACSAT), [S.l.], 2012, pp. 372–375.

Arnaldo

H.A.

and Bedregal

, A new way to obtain the initial centroid clusters in fuzzy c-means algorithm, in: 2nd Workshop-School on Theoretical Computer Science, Rio Grande, Brazil, 2013, pp. 139–144. doi: 10.1109/WEIT.2013.30.

Chiu

S.L.

, Fuzzy model identification based on cluster estimation, Journal of Intelligent and Fuzzy Systems 2(3) (1994), 267–278.

Bai

Liang

and Dang

, An initialization method to simultaneously find initial cluster centers and the number of clusters for clustering categorical data, Knowledge-Based Systems 24(6) (2011), 785–795.

Bezdek

J.C.

, Pattern recognition with fuzzy objective function algorithms, [S.l.], Kluwer Academic Publishers, 1981.

Campello

R.J.

and Hruschka

E.R.

, A fuzzy extension of the Silhouette width criterion for cluster analysis, Fuzzy Sets and Systems 157(21) (2006), 2858–2875.

Cheng

T.W.

Goldgof

D.B.

and Hall

L.O.

, Fast fuzzy clustering, Fuzzy Sets and Systems 93 (1998), 49–56.

Davies

D.L.

and Bouldin

D.W.

, A cluster separation measure, IEEE Transactions on Pattern Analysis and Machine Intelligence 1(2) (1979), 224–227.

Devijver

P.A.

and Kittler

, Pattern recognition: A statistical approach, [S.l.], Prentice/Hall International Englewood Cliffs, NJ, 1982.

10.

Dong

Y.Y.

Zhang

Y.J.

and Chang

C.L.

, Multistage random sampling genetic-algorithm-based fuzzy c-means clustering algorithm, in: Proceedings of 2004 International Conference on Machine Learning and Cybernetics (IEEE Cat. No.04EX826), Shanghai, China, Vol. 4, 2004, pp. 2069–2073. doi: 10.1109/ICMLC.2004.1382136.

11.

Duda

R.O.

and Hart

P.E.

, Pattern classification and scene analysis, [S.l.: s.n.], Wiley, 1973.

12.

Dunn

J.C.

, A fuzzy relative of the ISODATA process and its use in detecting compact well-separated clusters, Journal of Cybernetics 3(3) (1973), 32–57.

13.

Fisher

R.A.

, The use of multiple measurements in taxonomic problems, Annals of Eugenics 7(2) (1936), 179–188.

14.

Gregory

Scata

and Brown

, Web document classification using machine learning clustering algorithms, Journal of Computing Sciences in Colleges 21(6) (2006), 276–277.

15.

Halkidi

Batistakis

and Vazirgiannis

, On clustering validation techniques, Journal of Intelligent Information Systems 17(2–3) (2001), 107–145.

16.

Hammer

Hasenfuss

Schleif

F.M.

Villmann

Strickert

and Seiffert

, Intuitive clustering of biological data, in: IEEE Neural Networks, 2007. IJCNN 2007. International Joint Conference on, [S.l.], 2007, pp. 1877–1882.

17.

Hayet

Hamza

Mostefa

and Nadjette

D.H.

, Initialization Methods for K-means and Fuzzy C-means Clustering Algorithm, in: International Conference on Automatic, Telecommunication, and Signals (ICATS’15), Annaba, Algeria, November 16–18, 2015. doi: 10.13140/RG.2.1.3971.4968.

18.

Hubert

and Araibe

, Comparing partitions, Journal of Classification 2(1) (1985), 193–218.

19.

Hung

M-C.

and Yang

D.-L.

, An efficient fuzzy c-means clustering algorithm, Data Mining, 2001, in: ICDM 2001, Proceedings IEEE International Conference on, San José, CA, 2001, pp. 225–232. doi: 10.1109/ICDM.2001.989523.

20.

Jain

A.K.

and Dubes

R.C.

, Algorithms for clustering data, [S.l.], Prentice-Hall, Inc., 1988.

21.

Jain

A.K.

Murty

M.N.

and Flynn

P.J.

, Data clustering: a review, ACM Computing Surveys (CSUR) 31(3) (1999), 264–323.

22.

Kalaiselvi

and Somasundaram

, Knowledge based self initializing FCM algorithms for fast segmentation of brain tissues in magnetic resonance images, International Journal of Computer Applications 90(14) (2014), 19–26.

23.

Kumar

K.M.

and Reddy

R.M.

, An efficient k-means clustering filtering algorithm using density based initial cluster centers, Information Sciences 418–419 (2017), 286–301.

24.

Nadella

and Sekar

M.R.

, Analysis of Variant Approaches for Initial Centroid Selection in K-Means Clustering Algorithm, in: Satapathy

Bhateja

and Das

, eds, Smart Computing and Informatics, Smart Innovation, Systems and Technologies, Springer, Singapore, Vol. 78, 2018, pp. 109–121.

25.

Paul

and Hoque

A.S.M.L.

, Clustering medical data to predict the likelihood of diseases, in: IEEE Digital Information Management (ICDIM), 2010 Fifth International Conference on, [S.l.], 2010, pp. 44–49.

26.

Salicrú

Vives

and Zheng

, Inferential clustering approach for microarray experiments with replicated measurements, IEEE/ACM Transactions on Computational Biology and Bioinformatics (TCBB) 6(4) (2009), 594–604.

27.

Silva

Moura

Canuto

Santiago

and Bedregal

, New ways to calculate centers for interval data in fuzzy clustering algorithms, in: IEEE Conference on Norbert Wiener in the 21st Century (21CW), Boston, MA, 2014, pp. 1–6. doi: 10.1109/NORBERT.2014.6893865.

28.

Silva

Moura

Canuto

Santiago

and Bedregal

, Fuzzy clustering algorithm with H-operator applied to problems with interval-based data, in: IEEE International Conference on Fuzzy Systems (FUZZ-IEEE), Beijing, 2014, pp. 237–244. doi: 10.1109/FUZZ-IEEE.2014.6891846.

29.

Silva

Moura

Canuto

A.M.

Santiago

R.H.

and Bedregal

, An interval-based framework for fuzzy clustering applications, IEEE Transactions on Fuzzy Systems 23(6) (2015), 2174–2187.

30.

Stetko

Zeng

X.J.

and Keane

, Fuzzy C-means+⁣+: Fuzzy C-means with effective seeding initialization, Expert Systems with Applications 42(21) (2015), 7541–7548.

31.

de Vargas

R.R.

and Bedregal

, A comparative study between fuzzy c-means and ckMeans algorithms, In: IEEE Conference Publications. 2010 Annual Meeting of the North American Fuzzy Information Processing Society (NAFIPS), [S.l.], 2010, pp. 1–6. doi: 10.1109/NAFIPS.2010.5548194.

32.

de Vargas

R.R.

and Bedregal

, Interval ckmeans: An algorithm for clustering symbolic data, in: IEEE Conference Publications. 2011 Annual Meeting of the North American Fuzzy Information Processing Society (NAFIPS), [S.l.], 2011, pp. 1–6. doi: 10.1109/NAFIPS.2011.5752042.

33.

de Vargas

R.R.

Freddo

Galafassi

Gass

S.L.B.

Russini

and Bedregal

, Identifying Pixels Classified Uncertainties ckMeansImage Algorithm, Information Processing and Management of Uncertainty in Knowledge-Based Systems, Applications – 17th International Conference, IPMU 2018, Cádiz, Spain, June 11–15, 2018, Proceedings, Part III, pp. 429–440. doi: 10.1007/978-3-319-91479-4_36.

34.

Verma

N.K.

Gupta

Agrawal

Hanmandlu

Vasikarla

and Cui

, Medical image segmentation using improved mountain clustering approach, Information Technology: New Generations, 2009, ITNG ’09, Sixth International Conference on, Las Vegas, NV, 2009, pp. 1307–1312. doi: 10.1109/ITNG.2009.238.

35.

Wang

Yang

and Muntz

, STING: A statistical information grid approach to spatial data mining, in: Proceedings of the 23rd International Conference on Very Large Data Bases, August 25–29, 1997, [S.l.], 1991, pp. 186–195.

36.

Yager

R.R.

and Filev

D.P.

, Approximate clustering via the mountain method, IEEE Transactions on Systems, Man, and Cybernetics 24(8) (1994), 1279–1284.

37.

Yang

Zhang

and Tian

, An initialization method for fuzzy C-means algorithm using subtractive clustering, in: Third International Conference on Intelligent Networks and Intelligent Systems, Shenyang, 2010, pp. 393–396. doi: 10.1109/ICINIS.2010.171.

38.

Zadeh

L.A.

, Fuzzy sets, Information and Control 8(3) (1965), 338–353.

39.

Dua

and Graff

, UCI Machine Learning Repository, 2017. http://archive.ics.uci.edu/ml, University of California, Irvine, School of Information and Computer Sciences.

40.

Pedregosa

Varoquaux

Gramfortn

Michel

Thirion

Grisel

Blondel

Prettenhofer

Weiss

Dubourg

Vanderplas

Passos

Cournapeau

Brucher

Perrot

and Duchesnay

É.

, Scikit-learn: machine learning in python, Journal of Machine Learning Research 12 (2011), 2825–2830.

41.

Fränti

and Virmajoki

, Iterative shrinking method for clustering problems, Pattern Recognition 39(5) (2006), 761–775.

Two deterministic selection methods for the initial centers in fuzzy c-means based algorithms

Abstract

Keywords

Get full access to this article

References