Outlier detection is an important task in data mining. In this paper, a novel outlier detection algorithm is proposed, which integrates the local density with the global distance seamlessly. In the proposed method, an integrated outlier factor is used to measure the detecting accuracy. A comprehensive experimental study on both synthetic and real-life datasets shows that the proposed method is more effective than some typical outlier detection methods, including Relative Density-based Outlier Score (RDOS), INFLuenced Outlierness (INFLO), Local Outlier Factor (LOF) and Local Distance-based Outlier detection Factor (LDOF).
HanJ.KamberM. and PeiJ., Data mining concepts and techniques third edition, Morgan Kaufmann (2011), 9–22, 251–374.
2.
LaurikkalaJ.JuholaM. and KentalaE., Informal identification of outliers in medical data, in: Intelligent Data Analysis in Medicine and Pharmacology, 2000, pp. 20–24.
3.
BreunigM.M.KriegelH.-P.NgR.T. and SanderJ.,LOF: identifying density-based local outliers, 29(2) (2000), 93–104.
TangB. and HeH., A local density-based approach for outlier detection, Neurocomputing241 (2017), 171–180.
6.
TangJ.ChenZ.FuA.W. and CheungD., in: A Robust Outlier Detection Scheme for Large Data Sets Pacific-Asia Conf on Knowledge Discovery & Data Mining, 2002, pp. 6–8.
7.
KnoxE.M. and NgR.T., Algorithms for Mining Distance-Based Outliers in Large Datasets, in: International Conference on Very Large Data Bases, Morgan Kaufmann Publishers Inc, 1998, pp. 392–403.
8.
KnorrE.M.NgR.T. and TucakovV., Distance-based outliers: Algorithms and applications, Vldb Journal8(3-4) (2000), 237–253.
9.
ZhangK.HutterM. and JinH., A New Local Distance-Based Outlier Detection Approach for Scattered Real-World Data, in: Pacific-Asia Conference on Knowledge Discovery and Data Mining, Springer Berlin Heidelberg, 2009, pp. 813–822.
10.
WittenI.H.FrankE.HallM.A. and PalC.J., Data Mining: Practical Machine Learning Tools and Techniques, third edition, Morgan Kaufmann Publishers Inc, 2011, 134–210.
11.
ZhaoW. and WuL., Integration of ANN and Statistical Method for Outlier Detection in Complex System, in: 8th International Conference on Neural Information Processing, 2001.
12.
GoelA. and MontgomeryM., Statistics and Machine Learning based Outlier Detection Techniques for Exoplanets, IAU General Assembly, 2015, 22.
13.
ZhouH.F.LiJ.LiJ.H.ZhangF.C. and CuiY.A., A graph clustering method for community detection in complex networks, Physica A: Statistical Mechanics & Its Applications469 (2017), 551–562.
14.
ZhouH.GuoJ.WangY. and ZhaoM., A feature selection approach based on interclass and intraclass relative contributions of terms, Computational Intelligence and Neuroscience (17) (2016), 1–8.
15.
KontakiM.GounarisA.PapadopoulosA.N.TsichlasK. and ManolopoulosY., Efficient and flexible algorithms for monitoring distance-based outliers over data streams, Information Systems55(C) (2016), 37–53.
16.
RoK.ZouC.WangZ. and YinG., Outlier detection for high dimensional data, ACM SIGMOD International Conference on Management of Data30(2) (2015), 37–46.
17.
HuangT.QinX.ChenC. and WangQ., Density-Based Spatial Outliers Detecting, in: Computational Science-Iccs 2005, International Conference, Atlanta, Ga, Usa, Proceedings, DBLP, Vol. 3514, May 22–25, 2005, pp. 979–986.
18.
JinW.TungA.K.H.HanJ. and WangW., Ranking outliers using symmetric neighborhood relationship, Lecture Notes in Computer Science3918 (2006), 577–593.
19.
TangB. and HeH., KernelADASYN: Kernel based adaptive synthetic data generation for imbalanced learning, in: Evolutionary Computation, IEEE, 2015, pp. 664–671.
20.
SchubertE.ZimekA. and KriegelH.-P., Generalized Outlier Detection with Flexible Kernel Density Estimates, in: Siam International Conference on Data Mining, 2014, pp. 542–550.
21.
CamposG.O.ZimekA.SanderJ.CampelloR.J.G.B.MicenkovaB.SchubertE.AssentI. and HouleM.E., On the evaluation of unsupervised outlier detection: measures, datasets, and an empirical study, Data Mining & Knowledge Discovery30(4) (2016), 891–927.
22.
HuangJ.ZhuQ.YangL.ChengD.D. and WuQ., A novel outlier cluster detection algorithm without top-n parameter, Knowledge-Based Systems121 (2017), 32–40.
23.
FukunagaK. and FlickT.E., A test of the gaussian-ness of a data set using clustering, IEEE Transactions on Pattern Analysis & Machine Intelligence8(2) (1986), 240–247.
24.
LichmanM., UCI Machine Learning Repository, School of Information and Computer Science, University of California, Irvine, CA, 2013. http://archive.ics.uci.edu/ml/.
25.
HeH. and GarciaE.A., Learning from imbalanced data, IEEE Transactions on Knowledge & Data Engineering21(9) (2008), 1263–1284.
26.
PalS. and VepakommaP., Optimal bandwidth estimation for a fast manifold learning algorithm to detect circular structure in high-dimensional data, 2016.
27.
ZhouH.GuoJ. and WangY., A feature selection approach based on term distributions, Springer Plus5(1) (2016), 249.
28.
SheatherS.J. and JonesM.C., A reliable data-based bandwidth selection method for kernel density estimation, Journal of the Royal Statistical Society53(3) (1991), 683–690.
29.
ZhouH.ZhangY. and LiuY., A Global-Relationship Dissimilarity Measure for the k-Modes Clustering Algorithm, Computational Intelligence and Neuroscience, 2017, 1–7.
30.
ZhangK.HutterM. and JinH., A New Local Distance-Based Outlier Detection Approach for Scattered Real-World Data, 5476 (2009), 813–822.
31.
ZhuC.KitagawaH.PapadimitriouS. and FaloutsosC., Outlier detection by example, Journal of Intelligent Information Systems36(2) (2011), 217–247.
32.
ElgammalA.DuraiswamiR.HarwoodD. and DavisL.S., Background and foreground modeling using nonparametric kernel density estimation for visual surveillance, Proc IEEE90(7) (2002), 1151–1163.
33.
ZhouH.F.LiuJ.LiJ.H. and DuanW.C., A density-based approach for detecting complexes in weighted PPI networks by semantic similarity, Plus One12(7) (2017).
34.
ZhouH.ZhaoX. and WangX., An effective ensemble pruning algorithm based on frequent patterns, Elsevier Science Publishers B. V.56(3) (2014), 79–85.
