The intelligent system for detection and counteraction of malicious and inappropriate information on the Internet

Abstract

The Internet is becoming one of the most significant threats to personal and state information security. Therefore, the identification and counteraction of inappropriate information in global network content become the problem of national importance. The paper presents a new approach to building an intelligent system for identification and counteraction of malicious and inappropriate information on the Internet using artificial intelligence methods, in particular, machine learning and big data processing. The system architecture includes a set of intelligent components for data collection, information objects classification, ensuring the timeliness of analysis, eliminating incompleteness and inconsistency of analysis results, selecting the countermeasures for counteraction, and visualization. The paper presents an experimental evaluation of methods implemented for information object classification in single-threaded and multithreaded modes using various classifiers included in the Scikit-learn and Spark MLlib libraries.

Keywords

Inappropriate information Internet machine learning big data classifier

Get full access to this article

View all access options for this article.

References

C.C.

Aggarwal, Data Classification: Algorithms and Applications, CRC Press, 2014.

C.C.

Aggarwal, Machine Learning for Text, Springer, 2018.

Al-Khateeb,

M.N.

Hussain and

Agarwal, Leveraging social network analysis and cyber forensics approaches to study cyber propaganda campaigns, in: Social Networks and Surveillance for Society,

Özyer,

Bakshi and

Alhajj, eds, Springer, Cham, 2019, pp. 19–42. doi:10.1007/978-3-319-78256-0_2.

C.-S.

Atodiresei,

Tănăselea and

Iftene, Identifying fake news and fake users on Twitter, Procedia Computer Science 126 (2018), 451–461. doi:10.1016/j.procs.2018.07.279.

P.R.

Badri Satya,

Lee,

Tran and

J.J.

Zhang, Uncovering fake likers in online social networks, in: Proceedings of the 25th ACM International on Conference on Information and Knowledge Management, ACM, 2016, pp. 2365–2370. doi:10.1145/2983323.2983695.

Benkler,

Faris and

Roberts, Network Propaganda: Manipulation, Disinformation, and Radicalization in American Politics, Oxford University Press, 2018.

Bojanowski,

Grave,

Joulin and

Mikolov, Enriching word vectors with subword information, Transactions of the Association for Computational Linguistics 5 (2017), 135–146. doi:10.1162/tacl_a_00051.

Branitskiy,

Fedorchenko,

Kotenko and

Saenko, An approach to intelligent distributed scanning and analytical processing of the Internet inappropriate information, in: 10th IEEE International Conference on Intelligent Data Acquisition and Advanced Computing Systems: Technology and Applications (IDAACS), 2019, pp. 146–151. doi:10.1109/IDAACS.2019.8924380.

N.J.

Conroy,

V.L.

Rubin and

Chen, Automatic deception detection: Methods for finding fake news, Proceedings of the Association for Information Science and Technology 52(1) (2015), 1–4. doi:10.1002/pra2.2015.145052010082.

10.

Declaration of principles [electronic resource]: Building the information society: A global challenge in the new millennium, 2001, https://digitallibrary.un.org/record/533621?ln=en.

11.

Durumeric,

Adrian,

Mirian,

Bailey and

J.A.

Halderman, A search engine backed by Internet-wide scanning, in: Proceedings of the 22nd ACM SIGSAC Conference on Computer and Communications Security, ACM, 2015, pp. 542–553.

12.

Feldman and

Sanger, The Text Mining Handbook: Advanced Approaches in Analyzing Unstructured Data, Cambridge University Press, 2007.

13.

Joulin,

Grave,

Bojanowski,

Douze,

Jégou and

Mikolov, FastTest.zip: Compressing text classification models, 2016, arXiv:1612.03651.

14.

Joulin,

Grave,

Bojanowski and

Mikolov, Bag of tricks for efficient text classification, 2016, arXiv:1607.01759.

15.

Khonji,

Iraqi and

Jones, Enhancing phishing e-mail classifiers: A lexical url analysis approach, International Journal for Information Security Research 3(1) (2013), 236–245. doi:10.20533/ijisr.2042.4639.2013.0029.

16.

Kotenko,

Chechulin and

Komashinsky, Evaluation of text classification techniques for inappropriate web content blocking, in: IEEE 8th International Conference on “Intelligent Data Acquisition and Advanced Computing Systems: Technology and Applications” (IDAACS’2015). Proceedings, IEEE, 2015, pp. 412–417. doi:10.1109/IDAACS.2015.7340769.

17.

Kotenko,

Chechulin and

Komashinsky, Categorisation of web pages for protection against inappropriate content in the Internet, International Journal of Internet Protocol Technology 10(1) (2017), 61–71. doi:10.1504/IJIPT.2017.083038.

18.

Kotenko,

Saenko and

Kushnerevich, Parallel big data processing system for security monitoring in Internet of things networks, Journal of Wireless Mobile Networks, Ubiquitous Computing, and Dependable Applications 8(4) (2017), 60–74. doi:10.22667/JOWUA.2017.12.31.060.

19.

Lai,

Xu,

Liu and

Zhao, Recurrent convolutional neural networks for text classification, in: Twenty-Ninth AAAI Conference on Artificial Intelligence, 2015, pp. 2267–2273.

20.

Li,

Wang,

Gao and

Zhang, A survey on information diffusion in online social networks: Models and methods, Information 8(4) (2017), 118. doi:10.3390/info8040118.

21.

Liu,

Zhang and

Ma, Pay me and I’ll follow you: Detection of crowdturfing following activities in microblog environment, in: IJCAI’16: Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence, AAAI Press, 2016, pp. 3789–3796.

22.

Lodhi,

Saunders,

Shawe-Taylor,

Cristianini and

Watkins, Text classification using string kernels, Journal of Machine Learning Research 2 (2002), 419–444. doi:10.1162/153244302760200687.

23.

Ma,

L.K.

Saul,

Savage and

G.M.

Voelker, Beyond blacklists: Learning to detect malicious web sites from suspicious urls, in: Proceedings of the 15th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, ACM, 2009, pp. 1245–1254. doi:10.1145/1557019.1557153.

24.

Method for parsing, indexing and searching world-wide-web pages, https://patents.google.com/patent/US5864863A/en.

25.

Mikolov,

Chen,

Corrado and

Dean, Efficient estimation of word representations in vector space, 2013, arXiv:1301.3781.

26.

Mustafaraj and

P.T.

Metaxas, The fake news spreading plague: Was it preventable?, in: Proceedings of the 2017 ACM on Web Science Conference, ACM, 2017, pp. 235–239. doi:10.1145/3091478.3091523.

27.

Nigam,

A.K.

McCallum,

Thrun and

Mitchell, Text classification from labeled and unlabeled documents using EM, Machine Learning 39 (2000), 103–134. doi:10.1023/A:1007692713085.

28.

Novozhilov,

Kotenko and

Chechulin, Improving the categorization of web sites by analysis of html-tags statistics to block inappropriate content, in: Intelligent Distributed Computing IX, Springer, 2016, pp. 257–263. doi:10.1007/978-3-319-25017-5_24.

29.

Qi and

B.D.

Davison, Web page classification: Features and algorithms, ACM Computing Surveys (CSUR) 41(2) (2009), 12. doi:10.1145/1459352.1459357.

30.

K.A.

Raniere, Data stream division to increase data transmission rates, Dec.5 2017, US Patent 9,838,166.

31.

Shu,

Sliva,

Wang,

Tang and

Liu, Fake news detection on social media: A data mining perspective, ACM SIGKDD Explorations Newsletter 19(1) (2017), 22–36, arXiv:1708.01967. doi:10.1145/3137597.3137600.

32.

Tschiatschek,

Singla,

Gomez Rodriguez,

Merchant and

Krause, Fake news detection in social networks via crowd signals, in: WWW’18: Companion Proceedings of the Web Conference 2018, 2018, pp. 517–524. doi:10.1145/3184558.3188722.

33.

Tushkanova, Comparative analysis of the numerical measures for mining associative and causal relationships in big data, in: Creativity in Intelligent Technologies and Data Science, First Conference Proceedings, CIT &DS, Springer, 2015, pp. 571–582. doi:10.1007/978-3-319-23766-4_45.

34.

UN resolution on countering the use of information and communication technologies for criminals for criminal purposes, https://undocs.org/en/A/C.3/73/L.9/Rev.1.

35.

Vitkova,

Saenko and

Tushkanova, An approach to creating an intelligent system for detecting and countering inappropriate information on the Internet, in: Intelligent Distributed Computing XIII, Studies in Computational Intelligence, Vol. 868, Springer-Verlag, 2019, pp. 244–254. doi:10.1007/978-3-030-32258-8_29.

36.

L.R.

Waugh, The poetic function in the theory of Roman Jakobson, in: Poetics Today, Vol. 2, Duke University Press, 1980, pp. 57–82.

37.

Yao,

Chelmis and

D.S.

Zois, Cyberbullying ends here: Towards robust detection of cyberbullying in social media, in: WWW’19: The World Wide Web Conference, 2019, pp. 3427–3433. doi:10.1145/3308558.3313462.

38.

Zhang,

Zhao and

LeCun, Character-level convolutional networks for text classification, in: NIPS’15: Proceedings of the 28th International Conference on Neural Information Processing Systems, Vol. 1, 2015, pp. 649–657.