AIRank: An algorithm on evaluating the academic influence of papers based on heterogeneous academic network

Abstract

Evaluation of papers’ academic influence is a hot issue in the field of scientific research management. Academic big data provides a data treasure with the coexistence of different types of academic entities, which can be used to evaluate academic influence from a more macro and comprehensive perspective. Based on academic big data, a heterogeneous academic network composed of links within and between three types of academic entities (authors, papers and venues) is constructed. In addition, a new academic influence ranking algorithm, AIRank, is proposed to evaluate papers’ academic influence. Different from the existing academic influence ranking algorithms, AIRank has made innovations in the following two aspects. (1) AIRank distinguishes the influence transmission intensity between different node pairs. Different from the strategy of evenly distributing influence among different node pairs, AIRank quantifies the intensity of influence transmission between node pairs based on investigating the citation emotional attribute, semantic similarity and academic quality differences between node pairs. Based on the intensity characteristics, AIRank realises the distribution and transmission of influence among different node pairs. (2) AIRank incorporates the influence transmission from heterogeneous neighbours in evaluating papers’ influence. According to the academic influence of author nodes and venue nodes, AIRank fine-tunes the iteration formula of paper influence to obtain the ranking of papers under the joint influence of homogeneous and heterogeneous neighbours. Experimental results show that, compared with the ranking results based on citation frequency and PageRank algorithm, AIRank algorithm can produce more differentiated and reasonable academic influence ranking results.

Keywords

Academic influence AIRank algorithm heterogeneous academic network influence transmission intensity

Get full access to this article

View all access options for this article.

References

Chen

Ren

Yang

GL.

A novel approach for assessing academic journals: application of integer DEA model for management science and operations research field. J Informetr 2021; 15. DOI: 10.1016/j.joi.2021.101176.

Xie

Zhang

Song

A network embedding-based scholar assessment indicator considering four facets: research topic, author credit allocation, field-normalized journal impact, and published time. J Informetr 2021; 15. DOI: 10.1016/j.joi.2021.101201.

Lehmann

Jackson

Lautrup

BE.

Measures for measures. Nature 2006; 444: 1003–1004.

Sheng

Influence difference main path analysis: evidence from DNA and blockchain domain citation networks. J Informetr 2021; 15. DOI: 10.1016/j.joi.2021.101186.

Wang

Mariani

et al. The local structure of citation networks uncovers expert-selected milestone papers. J Informetr 2021; 15: 101220.

Zhang

Predicting future influence of papers, researchers, and venues in a dynamic academic network. J Informetr 2020; 14. DOI: 10.1016/j.joi.2020.101035.

Bai

Zhang

et al. Measure the impact of institution and paper via institution-citation network. IEEE Access 2020; 8: 17548–17555.

Liu

Dong

A survey on network node ranking algorithms: representative methods, extensions, and applications. Sci China Technol Sci 2020; 64: 451–461.

Yan

Ding

Applying centrality measures to impact analysis: a coauthorship network analysis. J Am Soc Inf Sci Technol 2009; 60: 2107–2118.

10.

Fiala

Tutoky

PageRank-based prediction of award-winning researchers and the impact of citations. J Informetr 2017; 11: 1044–1068.

11.

Massucci

Docampo

Measuring the academic reputation through citation networks via PageRank. J Informetr 2019; 13: 185–201.

12.

Liu

et al. Weighted citation based on ranking-related contribution: a new index for evaluating article impact. Scientometrics 2021; 126: 8653–8672.

13.

Zhou

Zeng

Fan

et al. Ranking scientific publications with similarity-preferential mechanism. Scientometrics 2015; 106: 805–816.

14.

Glanzel

Bai

Zhang

et al. Quantifying the impact of scholarly papers based on higher-order weighted citations. PLoS ONE 2018; 13. DOI: 10.1371/journal.pone.0193192.

15.

Wang

Zeng

Fan

et al. Ranking scientific publications considering the aging characteristics of citations. Scientometrics 2019; 120: 155–166.

16.

Wang

Xie

Zhang

et al. Coranking the future influence of multiobjects in bibliographic network through mutual reinforcement. ACM Trans Intell Syst Technol 2016; 7: 1–28.

17.

Mariani

Lü

et al. Unbiased evaluation of ranking metrics reveals consistent performance in science and technology citation data. J Informetr 2020; 14. DOI: 10.1016/j.joi.2019.101005.

18.

Amodio

Brugnano

Scarselli

Implementation of the PaperRank and AuthorRank indices in the Scopus database. J Informetr 2021; 15. DOI: 10.1016/j.joi.2021.101206.

19.

Shi

et al. Constrained-meta-path-based ranking in heterogeneous information network. Knowl Inf Syst 2016; 49: 719–747.

20.

Jiang

Sun

Yang

et al. Exploiting heterogeneous scientific literature networks to combat ranking bias: evidence from the computational linguistics area. J Assoc Inf Sci Technol 2016; 67: 1679–1702.

21.

Wang

Zhang

et al. A multiple-link, mutually reinforced journal-ranking model to measure the prestige of journals. Scientometrics 2017; 111: 521–542.

22.

Wang

Zhang

Jiao

et al. Evaluating the impact of citations of articles based on knowledge flow patterns hidden in the citations. PLoS ONE 2019; 14. DOI: 10.1371/journal.pone.0225276.

23.

Zhao

Zhang

et al. Measuring academic influence using heterogeneous author-citation networks. Scientometrics 2019; 118: 1119–1140.

24.

Zhang

Measuring academic entities’ impact by content-based citation analysis in a heterogeneous academic network. Scientometrics 2021; 126: 7197–7222.

25.

Xiao

Sun

Han

et al. Heterogeneous academic network embedding based multivariate random-walk model for predicting scientific impact. Appl Intell 2022; 52: 2171–2188.

26.

Wang

Zhang

Jiao

et al. Important citation identification by exploiting the syntactic and contextual information of citations. Scientometrics 2020; 125: 2109–2129.

27.

Wang

Shi

et al. Heterogeneous graph attention network. In: The world wide web conference, San Francisco, CA, 13 May 2019, pp. 2022–2032.

28.

Beltagy

Cohan

SciBERT: a pretrained language model for scientific text, https://arxiv.org/abs/1903.10676 (2019).

29.

Cho

Van Merriënboer

Gulcehre

et al. Learning phrase representations using RNN encoder-decoder for statistical machine translation, https://arxiv.org/abs/1406.1078 (2014).

30.

Wang

Kuen

et al. Recent advances in convolutional neural networks. Pattern Recognit 2018; 77: 354–377.

31.

Arora

Liang

. A simple but tough-to-beat baseline for sentence embeddings. In: International conference on learning representations, Toulon, 2017, pp. 1–16.