This paper proposes a particle swarm K-means optimization (PSKO)-based granular computing (GrC) model to preprocess skewed class distribution in order to enhance the classification accuracy for the class imbalance problem. The GrC model obtains knowledge from information granules rather than from numerical data. It also processes multi-dimensional and sparse data by using singular value decomposition and latent semantic indexing (LSI). The data possessing features of multiple dimensions and scarcity can be preprocessed using LSI in order to reduce the number of data dimensions as well as records. Ten benchmark data sets are employed to demonstrate the effectiveness of the proposed model. Experiment results indicate that the proposed model has better classification performance with both imbalanced and balanced data. In addition, the computational result for prostate cancer prognosis reveals that the proposed model really can support physicians in judging the condition of prostate cancer patients with a more accurate survival rate estimation.
BatistaG.E., PratiR.C. and MonardM.C., A study of the behavior of several methods for balancing machine learning training data, ACM Sigkdd Explorations Newsletter6 (2004), 20–29.
2.
ChawlaN.V., BowyerK.W., HallL.O. and KegelmeyerW.P., SMOTE: Synthetic minority over-sampling technique, Journal of Artificial Intelligence Research (2002), 321–357.
3.
KelesA., HasilogluA.S., KelesA. and AksoyY., Neuro-fuzzy classification of prostate cancer using NEFCLASS-J, Computers in Biology and Medicine37 (2007), 1617–1628.
4.
SakrW., GrignonD.J., CrissmanJ., HeilbrunL., CassinB., PontesJ. and HaasG., High grade prostatic intraepithelial neoplasia (HGPIN) and prostatic adenocarcinoma between the ages of 20-69: An autopsy study of 249 cases, In Vivo8 (1993), 439–443.
5.
FuW., MadanE., YeeM. and ZhangH., Progress of molecular targeted therapies for prostate cancers, Biochimica et Biophysica Acta (BBA) - Reviews on Cancer1825 (2012), 140–152.
6.
MillerD.C., GruberS.B., HollenbeckB.K., MontieJ.E. and WeiJ.T., Incidence of initial local therapy among men with lower-risk prostate cancer in the united states, Journal of the National Cancer Institute98 (2006), 1134–1141.
7.
ÇinarM.,
EnginM.,
EnginE.Z. and AteşçiY.Z., Early prostate cancer diagnosis by using artificial neural networks and support vector machines, Expert Systems with Applications36 (2009), 6357–6361.
8.
ChenA.H. and LinC.-H., A novel support vector sampling technique to improve classification accuracy and to identify key genes of leukaemia and prostate cancers, Expert Systems with Applications38 (2011), 3209–3219.
9.
SaritasI., OzkanI.A. and SertI.U., Prognosis of prostate cancer by artificial neural networks, Expert Systems with Applications37 (2010), 6646–6650.
10.
TanM.S.P.N. and KumarV., Introduction to data mining, Boston, Pearson Education, Inc, 2006.
11.
ZopounidisC. and DoumposM., Multicriteria classification and sorting methods: A literature review, European Journal of Operational Research138 (2002), 229–246.
12.
StefanowskiJ., On rough set based approaches to induction of decision rules, Rough Sets in Knowledge Discovery1 (1998), 500–529.
13.
TsumotoS., Automated extraction of medical expert system rules from clinical databases based on rough set theory, Information Sciences112 (1998), 67–84.
14.
BelacelN., Multicriteria assignment method PROAFTN: Methodology and medical application, European Journal of Operational Research125 (2000), 175–183.
15.
MichalowskiW., RubinS., SlowinskiR. and WilkS., Triage of the child with abdominal pain: A clinical algorithm for emergencyatient management, Paediatrics & Child Health6 (2001), 23.
16.
RipleyB.D., Pattern recognition and neural networks, Cambridge University Press, 2007.
17.
NiedduL. and PatriziG., Formal methods in pattern recognition: A review, European Journal of Operational Research120 (2000), 459–495.
18.
RulonP.J., TiedemanD.V., TatsuokaM.M., LangmuirC.R., Multivariate statistics for personnel classification, 1967.
19.
ShenL., TayF.E., QuL. and ShenY., Fault diagnosis using rough sets theory, Computers in Industry43 (2000), 61–72.
20.
SiskosY., GrigoroudisE., ZopounidisC. and SauraisO., Measuring customer satisfaction using a collective preference disaggregation model, Journal of Global Optimization12 (1998), 175–195.
21.
FlinkmanM., MichalowskiW., NilssonS., SlowinskiR., SusmagaR. and WilkS., Use Of rough sets analysis to classify siberian forest ecosystems according to net primary production of phytomass, INFOR, Information Systems and Operational Research38 (2000), 145–160.
22.
SáezJ.A., LuengoJ., StefanowskiJ. and HerreraF., SMOTE–IPF: Addressing the noisy and borderline examples problem in imbalanced classification by a re-sampling method with filtering, Information Sciences291 (2015), 184–203.
23.
KrawczykB., GalarM.,
JeleńŁ. and HerreraF., Evolutionary undersampling boosting for imbalanced classification of breast cancer malignancy, Applied Soft Computing38 (2016), 714–726.
24.
CharteF., RiveraA.J., del JesusM.J. and
HerreraF., Addressing imbalance in multilabel classification: Measures and random resampling algorithms, Neurocomputing163 (2015), 3–16.
25.
RamentolE., VluymansS., VerbiestN., CaballeroY., BelloR., CornelisC. and HerreraF., IFROWANN: Imbalanced fuzzy-rough ordered weighted average nearest neighbor classification, IEEE Transactions on Fuzzy Systems23 (2015), 1622–1637.
26.
SanzJ.A., BernardoD., HerreraF., BustinceH. and HagrasH., A compact evolutionary interval-valued fuzzy rule-based classification system for the modeling and prediction of real-world financial applications with imbalanced data, IEEE Transactions on Fuzzy Systems23 (2015), 973–990.
27.
ZhaoW., XuM., JiaX. and ShangL., A Classification Method for Imbalanced Data Based on SMOTE and Fuzzy Rough Nearest Neighbor Algorithm, in:
YaoY.,
HuQ.,
YuH. and Grzymala-BusseW.J. (Eds.) Rough Sets, Fuzzy Sets, Data Mining, and Granular Computing: 15th International Conference, RSFDGrC 2015, Tianjin, China, 2015, pp. 340–351.
28.
CastellanoG. and FanelliA.M., Information granulation via neural network-based learning, IFSA World Congress and 20th NAFIPS International Conference, vol. 3055, 2001, pp. 3059–3064.
29.
YaoY., Information granulation and rough set approximation, International Journal of Intelligent Systems16 (2001), 87–104.
30.
ZadehL.A., Fuzzy sets and information granularity, Advances in Fuzzy Set Theory and Applications11 (1979), 3–18.
31.
ZadehL.A., Fuzzy Sets: Where Do We Stand? Where Do We Go? Toward a theory of fuzzy information granulation and its centrality in human reasoning and fuzzy logic, Fuzzy Sets and Systems90 (1997), 111–127.
32.
BargielaA. and PedryczW., Recursive information granulation: Aggregation and interpretation issues, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics)33 (2003), 96–112.
33.
ZadroznyB. and ElkanC., Learning and making decisions when costs and probabilities are both unknown, Proceedings of the Seventh ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, (ACM2001), pp. 204–213.
34.
SuC.-T., ChenL.-S. and YihY., Knowledge acquisition through information granulation for imbalanced data, Expert Systems with Applications31 (2006), 531–541.
35.
EberhartR. and KennedyJ., A new optimizer using particle swarm theory, Proceedings of the Sixth International Symposium on Micro Machine and Human Science, Nagoya, 1995, pp. 39–43.
36.
YusupN., ZainA.M. and HashimS.Z.M., Overview of PSO for optimizing process parameters of machining, Procedia Engineering29 (2012), 914–923.
37.
NiknamT. and AmiriB., An efficient hybrid approach based on PSO, ACO and k-means for cluster analysis, Applied Soft Computing10 (2010), 183–197.
38.
NiknamT., AmiriB., OlamaeiJ. and ArefiA., An efficient hybrid evolutionary optimization algorithm based on PSO and SA for clustering, Journal of Zhejiang University SCIENCE A10 (2009), 512–519.
39.
ChenM.-C., ChenL.-S., HsuC.-C. and ZengW.-R., An information granulation based data mining approach for classifying imbalanced data, Information Sciences178 (2008), 3214–3227.
40.
KuoR.J., WangM.J. and HuangT.W., An application of particle swarm optimization algorithm to clustering analysis, Soft Computing15 (2009), 533–542.
