Sage Journals: Discover world-class research

Abstract

Cluster analysis or clustering is one of the most important and widely used techniques for data exploration and knowledge discovery that concerned with partitioning a set of objects in such a way that objects in the same groups, called clusters, are more similar to each other than to those in other clusters. However, obtaining the clusters that exhibit high within-cluster similarity or homogeneity and high between-cluster dissimilarity or heterogeneity is critically depended on the similarity notion, which has not been yet clearly defined for clustering purposes. Distance and correlation are the most important and commonly used mathematics and statistics-based similarity measurements in the literature of the clustering, respectively. In this paper, the learning speed of the supervised neural networks is proposed as novel intelligent similarity measurement for unsupervised clustering problems. On the other hand, the main aim of this paper is to answer this question that can convergence speed of the different objects to the given target be used for measuring the similarity. Empirical results of the simulated data sets indicate that the proposed measurement not only can be used as similarity measurement in clustering tasks, but also can produce accurate results. In this way, for first time and in contrast of the literature, it is demonstrated that a supervised model can be used for handling the unsupervised tasks.

Keywords

Classification & clustering similarity measurement Artificial Neural Networks (ANNs)supervised and unsupervised processes pattern recognition data mining

Get full access to this article

View all access options for this article.

References

Tan

Steinbach

and Kumar

, Introduction to Data Mining, Addison-Wesley, 2005.

Estivill-Castro

, Why so many clustering algorithms, ACM SIGKDD Explorations Newsletter 4(1), 65–75.

Halkidi

Batistakis

and Vazirgiannis

, On Clustering Validation Techniques, Journal of Intelligent Information Systems 17 (2001), 107–145.

Jain

A.K.

and Dubes

R.C.

, Algorithms for Clustering Data, Prentice Hall, 1988.

Kaufman

and Rousseeuw

P.J.

, Finding Groups in Data: An Introduction to Cluster Analysis, John Wiley and Sons, 1990.

Kent

R.A.

, Analysing Quantitative Data: Variable-based and Case-based Approaches to Non-experimental Datasets, SAGE Publications, 2015.

Jain

A.K.

Murty

M.N.

and Flyn

P.J.

, Data Clustering: A Review, ACM Computing Surveys 31 (1999), 264–323.

Guha

Rastogi

and Shim

, CURE: An Efficient Clustering Algorithm for Large Databases, In Proceedings of the ACM SIGMOD Conference, 1998.

MacQueen

J.B.

, Some Methods for Classification and Analysis of Multivariate Observations, In Proceedings of 5th Berkley Symposium on Mathematical Statistics and Probability, 1967, pp. 281–297.

10.

Kaufman

and Rousseeuw

P.J.

, Clustering by means of medoids, Statistical Data Analysis based on the L1-Norm and Related Methods, North-Holland 1987, pp. 405–416.

11.

Ester

Kriegel

Sander

and Xu

, A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise, Proceedings of 2nd International Conference on Knowledge Discovery and Data Mining, Portland, OR, 1996, 226–231.

12.

Hinneburg

and Keim

, An Efficient Approach to Clustering in Large Multimedia Databases with Noise, Proceedings of the 4th International Conference on Knowledge Discovery and Data Mining, AAAI Press.

13.

Ankerst

Breunig

M.M.

Kriegel

H.P.

and Sander

, OPTICS: Ordering Points to Identify the Clustering Structure, ACM SIGMOD international conference on Management of data, ACM Press, 1999, 49–60.

14.

Mechelen

Bock

H.H.

and De Boeck

, Two-mode clustering methods: a structured overview, Statistical Methods in Medical Research 13 (2004), 363–94.

15.

Khashei

Hejazi

S.R.

and Bijari

, A new hybrid artificial neural networks and fuzzy regression model for time series forecasting, Fuzzy Sets and Systems 159 (2008), 769–786.

16.

Khashei

Zeinal Hamadani

and Bijari

, A fuzzy intelligent approach to the classification problem in gene expression data analysis, Knowledge-Based Systems 27 (2012), 465–474.

17.

Cybenko

, Continuous Valued Neural Networks with Two Hidden Layers are Sufficient, Technical Report, Tuft University, 1988.

18.

Hornik

Stinchcombe

and White

, Multilayer feed-forward networks are universal approximators, Neural Networks 2 (1989), 359–366.

19.

Hornik

, Approximation capabilities of multilayer feed forward networks, Neural Networks 4 (1991), 251–257.

20.

Khashei

and Bijari

, An artificial neural network (p, d, q) model for time series forecasting, Expert Systems with Applications 37 (2010), 479–489.

21.

Rumelhart

and McClelland

, Parallel distributed processing, Cambridge, MA: MIT Press, 1986.

22.

Khashei

, Soft Intelligent Decision Making, Ph.D. Thesis, Industrial and Systems Engineering Department, Isfahan University of Technology, 2012.

23.

Zhang

Patuwo

B.E.

and Hu

M.Y.

, Forecasting with artificial neural networks: the state of the art, International Journal of Forecasting 14 (1998), 35–62.

24.

Khashei

Bijari

and Ardali

G.A.R.

, Improvement of Auto-Regressive Integrated Moving Average Models Using Fuzzy Logic and Artificial Neural Networks (ANNs), Neurocomputing 72 (2009), 956–967.

25.

Khashei

Zeinal Hamadani

and Bijari

, A novel hybrid classification model of artificial neural networks and multiple linear regression models, Expert Systems with Applications 39 (2012), 2606–2620.

26.

Manning

C.D.

Raghavan

and Schutze

, Introduction to Information Retrieval, Cambridge University Press, 2008.

27.

Rand

W.M.

, Objective criteria for the evaluation of clustering methods, Journal of the American Statistical Association 66 (1971), 846–850.

28.

Chen

M.S.

Han

and Yu

P.S.

, Data Mining: An Overview from Database Perspective, IEEE Transactions on Knowledge and Data Engineering 8 (1996), 866–883.

29.

Beyer

Goldstein

Ramakrishnan

and Shaft

, When is Nearest Neighbor Meaningful? International Conference on Database Theory (1999), 217–235.

30.

Khashei

and Bijari

, A novel hybridization of artificial neural networks and ARIMA models for time series forecasting, Applied Soft Computing 11 (2011), 2664–2675.

31.

Khashei

, Forecasting the Isfahan Steel Company production price in Tehran Metals Exchange using artificial neural networks (ANNs), Master of Science Thesis, Isfahan University of Technology, 2005.

Learning speed of supervised neural networks as similarity measurement in unsupervised cluster analysis

Abstract

Keywords

Get full access to this article

References