This paper investigates feature selection methods based on hybrid architecture using feature selection algorithm called Adapted Fast Correlation Based Feature selection and Support Vector Machine Recursive Feature Elimination (AFCBF-SVMRFE). The AFCBF-SVMRFE has three stages and composed of SVMRFE embedded method with Correlation based Features Selection. The first stage is the relevance analysis, the second one is a redundancy analysis, and the third stage is a performance evaluation and features restoration stage. Experiments show that the proposed method tested on different classifiers: Support Vector Machine SVM and K nearest neighbors KNN provide a best accuracy on various dataset. The SVM classifier outperforms KNN classifier on these data. The AFCBF-SVMRFE outperforms FCBF multivariate filter, SVMRFE, Particle swarm optimization PSO and Artificial bees colony ABC.
Bolon-CanedoVSanchez-MaronoNAlonso-BetanzosABenitezJMHerreraF. A review of microarray datasets and applied feature selection methods. Information Sciences. 2014; 282: 111-135.
2.
GuyonJWestonSBarnhillV. Gene selection for cancer classification using support vector machines. Machine Learning. 2002. 46(1-3), 389-422.
3.
YanKZhangD. Feature selection and analysis on correlated gas sensor data with recursive feature elimination. Journal Sensors and Actuators B Chemical. 2015; 212: 353-363.
4.
FakhraeiSZadehHSFotouhiF. Bias and stability of single variable classifiers for feature ranking and selection. Expert Systems with Applications. 2014; 41: 6945-6958.
5.
KononenkoI. Estimating attributes: Analysis and extensions of relief.In machine learning1994; ECML 94, Springer. 171-182.
6.
BarettaLSantanielloA. Implementing reliefF filters to extract meaningful features from genetic life time datasets. Journal Biomedical Informatics. 2011; 44: 361-369.
7.
HallM. Correlation based feature selection for machine learning. Phd Thesis, The University of Waikato. 1999.
8.
DingCPengHLongF. Feature selection based on mutual information: Criteria of max-dependency, max relevance, and min-redundancy. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2005; 27(8).
9.
YuLLiuH. Feature selection for high-dimensional data: A fast correlation based filter solution. in: Proceedings of International Conference on Machine Learning. ICML. 2003; 856-863.
10.
BolonCVSanchezMNBetanzosA. A review of feature selection methods on synthetic data. Journal of Knowledge Information System. 2013; 34: 483-519.
11.
YoonSKimS. Mutual information-based SVM-RFE for diagnostic classification of digitized mammograms. Journal of Pattern Recognition Letters. 2009; 30: 1489-1495.
12.
DiazRUriarteS. Gene selection and classification of microarray data using random forest. BMC Bioinformatics. 2006; 7.
13.
HollandJH. Adaptation in natural and artificial systems. University of Michigan Press, Ann Arbor. 1975.
14.
ShreemSAbdullahSNazriMAlzaqebahM. Hybridizing reliefF MRMR filters and GA wrapper approaches for gene selection. J Theor Appl Inf Technol. 2012; 46(2): 1034-1039.
YeomanTBXueBZhangM. Particle swarm optimisation for feature selection: A size-controlled approach. Proceedings of the 13-th Australasian Data Mining Conference. Sydney, Australia. 2015.
17.
DorigoMManiezzoVColorniA. Ant system: Optimization by a colony of cooperating agents. IEEE Trans on Systems, Man and Cybernetics. 1996; 26(1): 29-41.
18.
KarabogaD. An idea based on honey bee swarm for numerical optimization. Technical Report TR06, Erciyes University, Engineering Faculty. 2005.
19.
PriceKVStornRLampinenJ. Differential evolution: A practical approach to global optimization. Springer, London2005.
20.
Kai-BoDRajapakseHWangHAzuajeF. Multiple SVM-RFE for gene selection in cancer classification with expression data. IEEE Trans Nanobioscience. 2005; 4(3): 228-234.
21.
ZorarpacESelmaAYÖzelSE. A hybrid approach of differential evolution and artificial bee colony for feature selection. Journal Expert Systems with Applications. 2016; 62: 91-103.
22.
El AkadiAAmineAEl OuardighiAAboutajdineD. A two-stage gene selection scheme utilizing MRMR filter and GA wrapper. Knowl Inf Syst. 2011; 26: 487-500.
23.
EsseghirMAGoncalvesGSlimaniY. Adaptive particle swarm optimizer for feature selection. in: International Conference on Intelligent Data Engineering and Automated Learning. Springer Verlag, Berlin, Heidelberg. 2010; 226-233.
24.
JiangSYWangLX. Efficient feature selection based on correlation measure between continuous and discrete features. Journal of Information Processing Letters. 2016; 116: 203-215.
25.
ZhangJHuXLiPHeWZhangHY. A hybrid feature selection approach by correlation based filters and SVM-RFE. International Conference on Pattern Recognition. 2014; 3684-3689.
26.
DjellaliHZineNGAziziN. Two stages feature selection based on filter ranking methods and SVMRFE on medical applications. in: Modelling and Implementation of Complex Systems. Lecture Notes in Networks and Systems, Vol 1. Springer, Cham. 2016; doi: 10.1007/978-3-319-33410-3_20.
27.
XueFTFuZZhangYQBourgeoisAG. A genetic algorithm-based method for feature subset selection. Soft Comput. 2008; 12: 111-120. doi: 10.1007/s00500-007-01938.
FreemanCDanaKOtmanB. An evaluation of classifier-specific filter measure performance. Feature Selection Pattern Recognition. 2015; 48: 1812-1826.
30.
TapiaEBulacioPAngeloneL. Sparse and stable gene selection with consensus SVM-RFE. Pattern Recognition Letters. 2012; 33: 164-172.
31.
PiyushkumarAJagathMRajapakseC. Gene and sample selection using t-score with sample selection. Journal Bimedical Informatics. 2016; 59: 31-41.
32.
MaldonadoSWeberR. A wrapper method for feature selection using support vector machines. Journal Information Sciences. 2009; 179: 2208-2217.
33.
ApolloniJLeguizamonGAlbaE. Two hybrid wrapper-filter feature selection algorithms applied to high dimensional microarray experiments. Journal Soft Computing. 2016; 38: 922-932.
34.
CadenasJMGarridoMKMartinezR. Feature subset selection filter – wrapper based on low quality data. Journal Expert Systems with Applications. 2013; 40: 6241-6252.
35.
MakaMWKungSY. Fusion of feature selection methods for pairwise scoring SVM. Neurocomputing. 2008; 71: 3104-3113.
36.
VapnickV. Statistical learning theory. John Wiley & Sons. 1998.
37.
RifkinRKlautauA. In defense of one vs all classification. Journal of Machine Learning Research. 2004; 5: 101-141.
38.
DudaROHartPE. Pattern classification and scene analysis. Wiley. 1973.
39.
AlaydinE. Introduction to machine learning. The MIT Press, 2004.
