Data gathered from real world often contains label noise, which is harmful to the quality of data. Moreover, any data mining process suffers a deterioration when it is applied on noisy data. In this paper, a new approach is proposed to improve data quality by correcting mislabeled data. The proposed method employs a procedure to estimate the level of the noise in the data and combines this noise estimation with a correction process. A clustering method and k nearest neighbors approach are applied in the correction process. Extensive experimental results using real-world data sets from UCI machine learning repository are provided. The empirical study shows that our approach successfully improves data quality in many cases and outperforms several correction methods.
AbellánJ.MantasC.J. and CastellanoJ.G., Adaptative CC4.5: Credal C4.5 with a rough class noise estimator, Expert Systems with Applications92 (2017).
2.
AhaD.W.KiblerD. and AlbertM.K., Instance-based learning algorithms, Machine Learning6(1) (1991), 37–66.
3.
BouveyronC. and GirardS., Robust supervised classification with mixture models: Learning from data with uncertain labels, Pattern Recognition42(11) (2009), 2649–2658.
4.
DelanyS.J.SegataN. and NameeB.M., Profiling instances in noise reduction, Knowledge-Based Systems31(31) (2012), 28–40.
5.
DevijverP.A. and KittlerJ., On the edited nearest neighbor rule, in: Proceedings of the Fifth International Conference on Pattern Recognition, 1980, pp. 72–80.
6.
EverittB.S.LandauS.LeeseM. and StahlD., Miscellaneous Clustering Methods, John Wiley and Sons, Ltd, 2011, pp. 215–255.
7.
FefilatyevS.ShreveM.KramerK. and HallL., Label-noise reduction with support vector machines, in: International Conference on Pattern Recognition, 2012, pp. 3504–3508.
8.
FixE. and HodgesJ.L., Discriminatory analysis. Nonparametric discrimination: Consistency properties, International Statistical Review57(3) (1989), 238–247.
9.
FrénayB. and VerleysenM., Classification in the presence of label noise: A survey, IEEE Transactions on Neural Networks and Learning Systems25(5) (2014), 845–869.
10.
GambergerD.LavracN. and GroseljC., Experiments With Noise Filtering in a Medical Domain, in: Proceedings of the Sixteenth International Conference on Machine Learning, 1999, pp. 143–151.
11.
GarcíaS.LuengoJ. and HerreraF., Dealing with noisy data, Intelligent Systems Reference Library72 (2015), 107–145.
12.
GuanD.YuanW.LeeY.K. and LeeS., Identifying mislabeled training data with the aid of unlabeled data, Applied Intelligence35(3) (2011), 345–358.
13.
HartiganJ.A. and WongM.A., Algorithm as 136: A K-means clustering algorithm, Journal of the Royal Statistical Society28(1) (1979), 100–108.
14.
KononenkoI. and KukarM., Machine Learning and Data Mining: Introduction to Principles and Algorithms, Horwood Publishing Limited, 2007.
15.
LiC.ShengV.S.JiangL. and LiH., Noise filtering to improve data and model quality for crowdsourcing, Knowledge-Based Systems107(C) (2016), 96–103.
16.
LiuT. and TaoD., Classification with noisy labels by importance reweighting, IEEE Transactions on Pattern Analysis & Machine Intelligence38(3) (2016), 447–461.
17.
NatarajanN.DhillonI.S.RavikumarP. and TewariA., Learning with noisy labels, Advances in Neural Information Processing Systems26 (2013), 1196–1204.
18.
NicholsonB.ShengV.S. and ZhangJ., Label noise correction and application in crowdsourcing, Expert Systems with Applications66 (2016), 149–162.
19.
NorthcuttC.G.WuT. and ChuangI.L., Learning with Confident Examples: Rank Pruning for Robust Classification with Noisy Labels, arXiv preprint arXiv:1705.01936, 2017.
20.
Olvera-LópezJ.A.Carrasco-OchoaJ.A.Martínez-TrinidadJ.F. and KittlerJ., A review of instance selection methods, Artificial Intelligence Review34(2) (2010), 133–143.
21.
QuinlanJ.R., C4.5: programs for machine learning, San Francisco, CA, USA: Morgan Kaufmann Publishers Inc, 1993.
22.
SongY.WangC.ZhangM.SunH. and YangQ., Spectral label refinement for noisy and missing text labels, in: Twenty-Ninth AAAI Conference on Artificial Intelligence, 2015, pp. 2972–2978.
23.
TengC.M., Correcting Noisy Data, in: Sixteenth International Conference on Machine Learning, 1999, pp. 239–248.
24.
VerbaetenS. and AsscheA.V., Ensemble Methods for Noise Elimination in Classification Problems, in: Multiple Classifier Systems, International Workshop, Mcs 2003, Guilford, Uk, June 11–13, 2003, Proceedings, 2003, pp. 317–325.
25.
WuY.IanakievK.G. and GovindarajuV., Improvements in K-Nearest Neighbor Classification, in: Advances in Pattern Recognition – ICAPR 2001, Second International Conference Rio de Janeiro, Brazil, March 11–14, 2001, Proceedings, 2001, pp. 222–229.
26.
YuanW.GuanD.MaT. and KhattakA.M., Classification with class noises through probabilistic sampling, Information Fusion41 (2018), 57–67.
27.
ZhangY. and WuX., Integrating induction and deduction for noisy data mining, Information Sciences180(14) (2010), 2663–2673.
28.
ZhangJ.ShengV.S.LiT. and WuX., Improving crowdsourced label quality using noise correction, IEEE Transactions on Neural Networks and Learning SystemsPP(99) (2017), 1–14.
