As the huge dimensionality of textual data restrains the classification accuracy, it is essential to apply feature selection (FS) methods as dimension reduction step in text classification (TC) domain. Most of the FS methods for TC contain several number of probabilities. In this study, we proposed a new FS method named as Extensive Feature Selector (EFS), which benefits from corpus-based and class-based probabilities in its calculations. The performance of EFS is compared with nine well-known FS methods, namely, Chi-Squared (CHI2), Class Discriminating Measure (CDM), Discriminative Power Measure (DPM), Odds Ratio (OR), Distinguishing Feature Selector (DFS), Comprehensively Measure Feature Selection (CMFS), Discriminative Feature Selection (DFSS), Normalised Difference Measure (NDM) and Max–Min Ratio (MMR) using Multinomial Naive Bayes (MNB), Support-Vector Machines (SVMs) and k-Nearest Neighbour (KNN) classifiers on four benchmark data sets. These data sets are Reuters-21578, 20-Newsgroup, Mini 20-Newsgroup and Polarity. The experiments were carried out for six different feature sizes which are 10, 30, 50, 100, 300 and 500. Experimental results show that the performance of EFS method is more successful than the other nine methods in most cases according to micro-F1 and macro-F1 scores.
UysalAK. An improved global feature selection scheme for text classification. Expert Syst Appl2016; 43: 82–92.
2.
AgnihotriDVermaKTripathiP, Variable global feature selection scheme for automatic classification of text documents. Expert Syst Appl2017; 81: 268–281.
3.
OnanA. An ensemble scheme based on language function analysis and feature engineering for text genre classification. J Inform Sci2018; 44: 28–47.
4.
BhowmickAHazarikaSM. E-Mail spam filtering: a review of techniques and trends. In: KalamADasSSharmaK (eds) Advances in electronics, communication and computing. New York: Springer, 2018, pp. 583–590.
5.
SjarifNNAAzmiNFMChupratSet al. SMS spam message detection using term frequency–inverse document frequency and random forest algorithm. Proced Comput Sci2019; 161: 509–515.
6.
GuptaSTSahooJKRoulRK. Authorship identification using recurrent neural networks. In: Proceedings of the 2019 3rd international conference on information system and data mining, Houston, TX, 6–8 April 2019, pp. 133–137. New York: ACM.
7.
ChangYCHsiehYLChenCCet al. A semantic frame-based intelligent agent for topic detection. Soft Comput2017; 21: 391–401.
8.
ParlakBUysalAK. On classification of abstracts obtained from medical journals. J Inform Sci2019; 46: 648–663.
9.
ParlakBUysalAK. Classification of medical documents according to diseases. In: 23rd signal processing and communications applications conference (SIU), Malatya, Turkey, 16–19 May 2015, pp. 1635–1638. New York: IEEE.
10.
ParlakBUysalAK. The impact of feature selection on medical document classification. In: 11th Iberian conference on information systems and technologies (CISTI), Las Palmas, 15–18 June 2016, pp. 1–5. New York: IEEE.
11.
ParlakBUysalAK. On feature weighting and selection for medical document classification. In: RochaAReisLP (eds) Developments and advances in intelligent systems and applications. New York: Springer, 2018, pp. 269–282.
12.
OnanA. Classifier and feature set ensembles for web page classification. J Inform Sci2016; 42: 150–165.
13.
UysalAKGunalS. The impact of preprocessing on text classification. Inform Proces Manag2014; 50: 104–112.
14.
FormanG. An extensive empirical study of feature selection metrics for text classification. J Mach Learn Res2003; 3: 1289–1305.
15.
SebastianiF. Machine learning in automated text categorization. ACM Comput Surv2002; 34: 1–47.
16.
GuyonIElisseeffA. An introduction to variable and feature selection. J Mach Learn Res2003; 3: 1157–1182.
17.
YangYPedersenJO. A comparative study on feature selection in text categorization. In: ICML ’97: proceedings of the fourteenth international conference on machine learning, Nashville, TN, 8–12 July 1997, pp. 412–420. New York: ACM.
18.
LeeCLeeGG. Information gain and divergence-based feature selection for machine learning-based text categorization. Inform Proces Manag2006; 42: 155–165.
ShangWHuangHZhuHet al. A novel feature selection algorithm for text categorization. Expert Syst Appl2007; 33: 1–5.
21.
OguraHAmanoHKondoM, Feature selection with a measure of deviations from Poisson in text categorization. Expert Syst Appl2009; 36: 6826–6832.
22.
UysalAKGunalS. A novel probabilistic feature selection method for text classification. Knowl Based Syst2012; 36: 226–235.
23.
YangJLiuYZhuXet al. A new feature selection based on comprehensive measurement both in inter-category and intra-category for text categorization. Inform Proces Manag2012; 48: 741–754.
24.
ZongWWuFChuL-Ket al. A discriminative and semantic feature selection method for text categorization. Int J Product Econ2015; 165: 215–222.
25.
RehmanAJavedKBabriHA. Feature selection based on a normalized difference measure for text classification. Inform Proces Manag2017; 53: 473–489.
26.
RehmanAJavedKBabriHAet al. Selection of the most relevant terms based on a max-min ratio metric for text classification. Expert Syst Appl2018; 114: 78–96.
27.
RehmanAJavedKBabriHAet al. Relative discrimination criterion – A novel feature ranking method for text data. Expert Syst Appl2015; 42: 3670–3681.
28.
KimKZzangSY. Trigonometric comparison measure: a feature selection method for text categorization. Data Knowl Eng2019; 119: 1–21.
29.
PinheiroRHCavalcantiGDCorreaRFet al. A global-ranking local feature selection method for text categorization. Expert Syst Appl2012; 39: 12851–12857.
30.
PinheiroRHCavalcantiGDRenTI. Data-driven global-ranking local feature selection methods for text categorization. Expert Syst Appl2015; 42: 1941–1949.
31.
AgnihotriDVermaKTripathiPet al. Soft voting technique to improve the performance of global filter based feature selection in text corpus. Appl Intel2019; 49: 1597–1619.
32.
UysalAKGunalS. Text classification using genetic algorithm oriented latent semantic features. Expert Syst Appl2014; 41: 5938–5947.
33.
GharebASBakarAAHamdanAR. Hybrid feature selection based on enhanced genetic algorithm for text categorization. Expert Syst Appl2016; 49: 31–47.
34.
UysalAK. On two-stage feature selection methods for text classification. IEEE Access2018; 6: 43233–43251.
35.
ChenJHuangHTianSet al. Feature selection for text classification with Naïve Bayes. Expert Syst Appl2009; 36: 5432–5435.
36.
ChenC-MLeeH-MChangY-J. Two novel feature selection approaches for web page classification. Expert Syst Appl2009; 36: 260–272.
37.
PorterMF. An algorithm for suffix stripping. Program1980; 14: 130–137.
ParlakBUysalAK. The effects of globalisation techniques on feature selection for text classification. J Inform Sci. Epub ahead of print 18June2020. DOI: 10.1177/0165551520930897.
40.
TanS. An effective refinement strategy for KNN text classifier. Expert Syst Appl2006; 30: 290–298.
