ICRM: An intelligent citation recommendation mechanism based on BERT and weighted BoW models

Abstract

With the field of technology has witnessed rapid advancements, attracting an ever-growing community of researchers dedicated to developing theories and techniques. This paper proposes an innovative ICRM (Intelligent Citation Recommendation Mechanism), designed to automate the process of suggesting the appropriate number of citations for individual brackets within a document. The proposed ICRM comprises three phases: Coarse-grained Weighted Bag of Word (WCBW), Fine-grained SciBERT (FSB) and Citation Adjustment phases. Firstly, the WCBW phase employs TF-IDF to extract keywords from both target and candidate documents, forming vectors that capture word significance along with metadata like authorship, keywords, and titles. It aims to identify relevant papers from a database, serving as initial candidates for each bracket. Secondly, the FSB phase employs the SciBERT model to assess the similarity between candidate documents and the local context around brackets, enhancing the precision of recommendations. It refines this selection by analyzing candidate-document relationships within the proximity of the brackets. Lastly, the Citation Adjustment phase tackles overlapping citations and ensures that recommended citation numbers align with user-defined criteria, resolving issues of imbalance. The simulation results demonstrate that the proposed ICRM outperforms existing models significantly in terms of precision, recall and F1-score.

Keywords

Citation recommendation TF-IDF weighted bag of word BERT

Get full access to this article

View all access options for this article.

References

Iqbal

, et al. A decade of in-text citation analysis based on natural language processing and machine learning techniques: An overview of empirical studies, Scientometrics 126(8) (2021), 6551–6599.

Yue

, et al. Natural language processing (NLP) in management research: A literature review,, Journal of Management Analytics 7(2) (2020), 139–172.

Qin

, et al. Natural language processing was effective in assisting rapid title and abstract screening when updating systematic reviews,, Journal of Clinical Epidemiology 133 (2021), 121–129.

Enríquez

, José

A.T.

and Tomás

L.S.

, An approach to the use of word embeddings in an opinion classification task, Expert Systems with Applications 66 (2016), 1–6.

Costa

and Riccardo

, Jointly modeling and simultaneously discovering topics and clusters in text corpora using word vectors,, Information Sciences 563 (2021), 226–240.

Kim

, et al. Multi-co-training for document classification using various document representations: TF–IDF, LDA, and Doc2Vec,, Information Sciences 477 (2019), 15–29.

Lan

, Research on text similarity measurement hybrid algorithm with term semantic information and TF-IDF method,, Advances in Multimedia 2022 (2022), 1–11.

Lee

, et al. Personalized academic research paper recommendation system, arXiv preprint arXiv (2013), 1–8.

Nogueira

, et al. Navigation-based candidate expansion and pretrained language models for citation recommendation, Scientometrics 125 (2020), 3001–3016.

10.

Dai

, et al. Attentive stacked denoising autoencoder with bi-lstm for personalized context-aware citation recommendation,, IEEE/ACM Transactions on Audio, Speech, and Language Processing 28 (2019), 553–568.

11.

Yang

, et al. A LSTM based model for personalized context-aware citation recommendation,, IEEE Access 6 (2018), 59618–59627.

12.

Wang

, et al. Deep memory network with bi-lstm for personalized context-aware citation recommendation,, Neurocomputing 410 (2020), 103–113.

13.

Gökce

, et al. Embedding-based scientific literature discovery in a text editor application, The 58th Annual Meeting of the Association for Computational Linguistics, Online (2020), 320–326.

14.

Jeong

, et al. A context-aware citation recommendation model with BERT and graph convolutional networks,, Scientometrics 124 (2020), 1907–1922.

15.

, et al. Local Citation Recommendation with Hierarchical-Attention Text Encoder and SciBERT-Based Reranking, 44th European Conference on IR Research (ECIR), Stavanger, Norway (2022), 274–288.

16.

Yang

, Zhiqiang

and Huang

, A study of BERT-based methods for formal citation identification of scientific data,, Scientometrics 128 (2023), 1–17.

17.

, et al. Research on semantic representation and citation recommendation of scientific papers with multiple semantics fusion,, Scientometrics 128(2) (2023), 1367–1393.

18.

Hao

, et al. A node localization algorithm based on Voronoi diagram and support vector machine for wireless sensor networks,, International Journal of Distributed Sensor Networks 17(2) (2021), 1550147721993410.

19.

Zarei

and Mozafar

B.M.

, Coverage improvement using Voronoi diagrams in directional sensor networks, IET Wireless Sensor Systems 11(3) (2021), 111–119.