Sage Journals: Discover world-class research

Abstract

Data collection plays an important role in business agility; data can prove valuable and provide insights for important features. However, conventional data collection methods can be costly and time-consuming. This paper proposes a hybrid system R-EDML that combines a sequential feature selection performed by Reinforcement Learning (RL) with the evolutionary feature prioritization of Evolutionary Distance Metric Learning (EDML) in a clustering process. The goal is to reduce the features while maintaining or increasing the accuracy leading to less time complexity and future data collection time and cost reduction. In this method, features represented by the diagonal elements of EDML matrices are prioritized using a differential evolution algorithm. Further, a selection control strategy using RL is learned by sequentially inserting and evaluating the prioritized elements. The outcome offers the best accuracy R-EDML matrix with the least number of elements. Diagonal R-EDML focusing on the diagonal elements is compared with EDML and conventional feature selection. Full Matrix R-EDML focusing on the diagonal and non-diagonal elements is tested and compared with Information-Theoretic Metric Learning. Moreover, R-EDML policy is tested for each EDML generation and across all generations. Results show a significant decrease in the number of features while maintaining or increasing accuracy.

Keywords

Clustering distance metric learning feature selection reinforcement learning

Get full access to this article

View all access options for this article.

References

A.Y.

, Feature selection, L1 vs. L2 regularization, and rotational invariance, in: Proc. The Twenty-first International Conference on Machine Learning (ICML), 2004.

Karegowda

A.G.

Manjunath

and Jayaram

, Comparative study of attribute selection using gain ratio and correlation based feature selection, International Journal of Information Technology and Knowledge Management 2(2) (2010), 271–277.

Ali

Fukui

Kalintha

Moriyama

and Numao

, Reinforcement learning based distance metric filtering approach in clustering, in: Proc. IEEE Symposium Series on Computational Intelligence (SSCI), 2017, pp. 1–8.

Ali

Kalintha

Moriyama

Numao

and Fukui

, Reinforcement learning for evolutionary distance metric learning systems improvement, in: Proc. the Genetic and Evolutionary Computation Conference Companion, 2018, pp. 155–156.

Blake

C.L.

and Merz

C.J.

, UCI Repository of machine learning databases, in: Department of Information and Computer Science, Vol. 55, 1998. http://www.ics.uci.edu/∼mlearn/MLRepository.html.

and Tian

, A comprehensive survey of clustering algorithms, in: Annals of Data Science, 2015, pp. 165–193.

Norouzi

Ahmadabadi

M.N.

and Araabi

B.N.

, Attention control with reinforcement learning for face recognition under partial occlusion, Machine Vision and Applications 22(2) (2011), 337–348.

Xing

E.P.

Jordan

M.I.

Russell

S.J.

and Ng

A.Y.

, Distance metric learning with application to clustering with side-information, in: Advances in Neural Information Processing Systems, 2003, pp. 521–528.

Rendon

Abundez

Arizmendi

and Quiroz

E.M.

, Internal versus external cluster validation indexes, in: International Journal of Computers and Communications, 2011, pp. 27–34.

10.

Wang

and Sun

, Survey on distance metric learning and dimensionality reduction in data mining, Data Mining and Knowledge Discovery 29(2) (2015), 534–564.

11.

Arnold

G.D.

Denoyer

Preux

and Gallinari

, Datum-wise classification: a sequential approach to sparsity, in: Proc. Joint European Conference on Machine Learning and Knowledge Discovery in Databases (EDML-PKDD), 2011, pp. 375–390.

12.

Chandrashekar

and Sahin

, A survey on feature selection methods, Computers & Electrical Engineering 40(1) (2014), 16–28.

13.

Hachiya

and Sugiyama

, Feature selection for reinforcement learning: Evaluating implicit state-reward dependency via conditional mutual information, in: Joint European Conference on Machine Learning and Knowledge Discovery in Databases, 2010, pp. 474–489.

14.

Brest

Greiner

Boskovic

Mernik

and Zumer

, Self-adapting control parameters in differential evolution: A comparative study on numerical benchmark problems, IEEE Transactions on Evolutionary Computation 10(6) (2006), 646–657.

15.

Davis

J.V.

Kulis

Jain

Sra

and Dhillon

I.S.

, Information-theoretic metric learning, in: Proceedings of the 24th International Conference on Machine Learning, ICML ’07, ACM, 2007, pp. 209–216.

16.

Janisch

Pevný

and Lisý

, Classification with costly features using deep reinforcement learning, in: Proc. the AAAI Conference on Artificial Intelligence, Vol. 33, 2019, pp. 3959–3966.

17.

Fukui

Ono

Megano

and Numao

, Evolutionary distance metric learning approach to semi-supervised clustering with neighbor relations, in: Proc. IEEE 25th International Conference on Tools with Artificial Intelligence (ICTAI), 2013, pp. 398–403.

18.

Fukui

and Numao

, Neighborhood-based smoothing of external cluster validity measures, in: Proc. Pacific-Asia Conference on Knowledge Discovery and Data Mining (PAKDD), 2012, pp. 354–365.

19.

Weinberger

K.Q.

and Saul

L.K.

, Distance metric learning for large margin nearest neighbor classification, Journal of Machine Learning Research 10(2) (2009), 207–244.

20.

Dash

and Liu

, Feature selection for classification, Intelligent Data Analysis 1(1–4) (1997), 131–156.

21.

Nezhad

M.Z.

Zhu

Yang

and Levy

, Safs: A deep feature selection approach for precision medicine, in: IEEE International Conference on Bioinformatics and Biomedicine (BIBM), 2016, pp. 501–506.

22.

Sutton

R.S.

and Barto

A.G.

, Reinforcement Learning: An introduction, in: MIT Press Cambridge, Vol. 1, 1998.

23.

Hertz

Bar-Hillel

and Weinshall

, Boosting margin based distance functions for clustering, in: Proc. The twenty-first International Conference on Machine Learning (ICML), 2004, p. 50.

24.

Nguyen

Silander

and Leong

T.Y.

, Online feature selection for model-based reinforcement learning, in: International Conference on Machine Learning, 2013, pp. 498–506.

25.

Rückstieß

, Reinforcement Learning in Supervised Problem Domains, PhD thesis, Universität München, 2016.

26.

Kalintha

Fukui

Ono

Megano

Moriyama

and Numao

, Semi-supervised Evolutionary Distance Metric Learning for Clustering, in: Proc. the 29th Annual Conference of The Japanese Society for Artificial Intelligence, 2015.

27.

Kalintha

Ono

Numao

and Fukui

, Kernelized evolutionary distance metric learning for semi-supervised clustering, in: Intelligent Data Analysis, Vol. 23, 2019, pp. 1271–1297.

Reinforcement learning based metric filtering for evolutionary distance metric learning

Abstract

Keywords

Get full access to this article

References