Feature Selection is one of the preprocessing steps in machine learning tasks. Feature Selection is effective in reducing the dimensionality, removing irrelevant and redundant feature. In this paper, we propose a new feature selection algorithm (Sigmis) based on Correlation method for handling the continuous features and the missing data. Empirical comparison with three existing feature selection algorithms using UCI data sets shows that the proposed system is very effective and efficient in selecting the feature set.
HaindlM.SomolP.VerveridisD. and KotropoulosC., Feature Selection Based on Mutual Correlation, Progress in Pattern Recognition, Image Analysis and Applications, Springer Heidelberg, 2006, 4225, 569–577.
2.
HallM.A. and SmithL.A., Feature Selection for Machine Learning: Comparing a Correlation-Based Filter Approach to the Wrapper, American Association of Artificial Intelligence, 1998.
3.
SebbanM., On Feature Selection: A New Filter Model, Proceedings of the twelfth International FLAIRS Conference, 1999, 230–234.
4.
ChuangLi-YehKeChao-Hsuan, and YangCheng-Hong, A Hybrid Both Filter and Wrapper Feature Selection Method for Microarray Classification, Proceedings of the International MultiConference of Engineers and Computer Scientists, IMECS, Hong Kong, 2008, I, 19–21.
5.
YuL. and LiuH., Feature selection for high-dimensional data: A fast correlation-based filter solution, ICML-03 Proceedings of the twelfth International Conference on Machine Learning, Morgan Kaufmann, Washington, D.C., San Francisco, CA, USA, 2003, 856–863.
6.
HallM.A., Correlation-based Feature Selection for Discrete and Numeric Class Machine Learning, Proceedings of the Seventeenth International Conference on Machine Learning, Morgan Kaufmann, San Francisco, CA, USA, 2000, pages 359–366.
7.
BiesiadaJacek and DuchWłodzisław, A Kolmogorov-Smirnov Correlation-Based Filter for Microarray Data, Neural Information Processing, SpringerHeidelberg, 2008, 4985, 285–294.
8.
BiesiadaJacek and DuchWłodzisław, Feature Selection for High-Dimensional Data: A Pearson Redundancy Based Filter, Advances in Soft Computing, SpringerHeidelberg, 2007, 45, 242–249.
9.
FayyadU. and IraniK.B., Multi-interval discretization of continuous-valued attributes for classification learning. Proceedings of the thirteenth International Joint Conference on Artificial Intelligence, Morgan Kaufmann, Washington, D.C., San Francisco, CA, USA, 1993, 1022–1027.
10.
YuLei and LiuHuan, Efficient Feature Selection via Analysis of Relevance and Redundancy, Journal of Machine Learning Research, 2004, 5, 1205–1224.
11.
ZhaoZheng and LiuHuan, Searching for Interacting Features, Proceedings of the twentyth International Joint Conference on Artificial Intelligence, Morgan Kaufmann, Washington, D.C., San Francisco, CA, USA, 2007, 1156–1161.
12.
KannanSenthamarai S. and RamarajN., An Improved Correlation-based Algorithm with Discretization for Attribute Reduction in Data Clustering, Data Science Journal, 2009, 8(2), 125–138.
13.
ReddyBabu M. and ReddyL.S.S., Dimensionality Reduction: An Empirical Study on the Usability of IFE-CF (Independent Feature Elimination- by C-Correlation and F-Correlation) Measures, IJCSI International Journal of Computer Science, 2010, 7(1).
14.
GuyonI. and ElisseeffA., An introduction to variable and feature selection, Journal of Machine Learning Research, 2003, (3), 1157–1182.
15.
HallM. A., Correlation-based feature selection for machine learning, PhD thesis, Department of Computer Science, University of Waikato, Hamilton, New Zealand, 1999.
16.
LiuH. and MotodaH., Feature Selection for Knowledge Discovery and Data Mining, Kluwer Academic Publishers, Norwell, MA, USA, 1998.
17.
KohaviR. and JohnG.H., Wrappers for feature subset selection, Artificial Intelligence, 1997, (1–2), 273–324.
18.
XingE.JordanM. and KarpR., Feature selection for high-dimensional genomic microarray data. Proceedings of the Eighteenth International Conference on Machine Learning, Morgan Kaufmann, Washington, D.C., San Francisco, CA, USA, 2001, 601–608.
19.
PatriciaLutuE.N., and EngelbrechtA.P., A decision rule-based method for feature selection in predictive data mining, Expert Systems with Applications, 2010, 37, 602–609.
20.
MolinaL.C.BelancheL. and NebotA., Feature Selection algorithms: A survey and experimental evaluation, ICDM- Proceedings of IEEE International Conference on Data Mining, IEEE Xplore, 2002, 306–313.
21.
DashM.LiuH. and MotodaH., Consistency based feature selection. Proceedings of the fourth Pacific Asia Conference on Knowledge Discovery and Data Mining, Current Issues and New Applications, Springer-Verlag, London, UK, 2000, 98–109.
