The journal ranking problem has drawn a great deal of attention from researchers in various fields due to its importance in the evaluation of academic performance. Most previous studies solved the problem with either a subjective approach, based on expert survey metrics, or an objective approach, based on citation-based metrics. Since both have their own advantages and disadvantages, and since they are usually complementary, this work proposes a brand new approach that integrates the two. In this work, we propose the Evolutionary PageRank algorithm, which first uses the PageRank algorithm to evaluate journal prestige and then uses the Multi-Objective Particle Swarm Optimization to balance citation analysis and expert opinion. Experiments evaluating ranking quality were carried out with citation records and experts’ surveys to show the effectiveness of the proposed method. The results indicate that the proposed method can improve PageRank journal ranking results.
Katerattanakul P., Han B. and Hong S.Objective quality ranking of computing journals . Commun ACM2003; 46: 111-114.
2.
Via BJ and Schmidle DJInvesting wisely: citation rankings as a measure of quality in library and information science journals. Portal Libr Acad2007; 7: 333-374.
3.
Svensson G.Scholarly journal ranking (s) in marketing: single- or multi-item measures?Market Intell Plann2008; 26: 340-352.
4.
Serenko A. and Bontis N.Global ranking of knowledge management and intellectual capital academic journals . JKM2009; 13: 4-15.
5.
Olson JETop-25-business-school professors rate journals in operations management and related fields. Interfaces2005; 35: 323-338.
6.
Hofacker CF , Gleim MR and Lawson SJRevealed reader preference for marketing journals. JAMS2009; 37: 238-247.
7.
Harris C.Ranking the management journals. J Scholarly Publ2008; 39: 373-409.
8.
Coleman A.Assessing the value of a journal beyond the impact factor. JASIST2007; 58: 1148-1161.
9.
Beattie V. and Goodacre A.A new method for ranking academic journals in accounting and finance . Account Bus Res2006; 36: 65-91.
10.
Barnes SJTechnical opinion: assessing the value of IS journals. Commun ACM2005; 48: 110-112.
11.
Nord JH and Nord GDMIS research: journal status assessment and analysis. Inform Manage1995; 29: 29-42.
12.
Peffers K. and Ya T.Identifying and evaluating the universe of outlets for information systems research: ranking the journals. J Inform Tech Theory Appn2003; 5: 63-84.
13.
Mylonopoulos NA and Theoharakis V.On site: global perceptions of IS journals: where is the best IS research published?Commun ACM2001; 44: 29-33.
14.
Marsh SJ and Hunt CSNot quite as simple as ABC: reflections on one department’s experiences with publication ranking. J Manage Inquiry2006; 15: 301.
15.
Garfield E.Citation analysis as a tool in journal evaluation . Science1972; 178: 471-479.
16.
Garfield E.The history and meaning of the journal impact factor. JAMA2006; 295: 90-93.
17.
Maslov S. and Redner S.Promise and pitfalls of extending Google’s PageRank algorithm to citation networks. J Neurosci2008; 28: 11103-11105.
18.
Bollen J. , Rodriquez M. and Van de Sompel H.Journal status. Scientometrics2006; 69: 669-687.
19.
Bergstrom C. and West J.Assessing citations with the EigenfactorTM metrics. Neurology2008; 71: 1850-1851.
20.
Habibzadeh F. and Yadollahie M.Journal weighted impact factor: a proposal . J Infometr2008; 2: 164-172.
21.
Ma N. , Guan J. and Zhao Y.Bringing PageRank to the citation analysis . Inform Process Manag2008; 44: 800-810.
22.
Pinski G. and Narin F.Citation influence for journal aggregates of scientific publications: theory, with application to the literature of physics. Inform Process Manag1976; 12: 297-312.
23.
Brin S. and Page L.The anatomy of a large-scale hypertextual Web search engine. Comput Networks ISDN1998; 30: 107-117.
24.
Pillai S. , Suel T. and Cha S.The Perron-Frobenius theorem: some of its applications. IEEE Signal Proc Mag2005; 22: 62-75.
25.
Ding Y., Yan E., Frazho A. and Caverle J.PageRank for ranking authors in co-citation networks. JASIST2009; 60: 2229-2243.
26.
Dellavalle R., Schilling L., Rodriguez M., Van de Sompel H. and Bollen J.Refining dermatology journal impact factors using PageRank. J Am Acad Derm2007; 57: 116-119.
27.
Chen P., Xie H., Maslov S. and Redner S.Finding scientific gems with google’s pagerank algorithm. J Infometr2007; 1: 8-15.
28.
Lim A. , Ma H., Wen Q., Xu Z. and Cheang B.Distinguishing citation quality for journal impact assessment. Commun ACM2009; 52: 111-116.
29.
Lim A., Xu Z. and Wen VQJournal-Ranking.com, www.journal-ranking.com/ranking/web/index.html (2007, accessed 23 April 2010).
30.
West J., Althouse B., Bergstrom C., Rosvall M. and Bergstrom T.Eigenfactor.org: ranking and mapping scientific knowledge, www.eigenfactor.org/ (2007, accessed 23 April 2010 ).
31.
Page L., Brin S., Motwani R. and Winograd T.The pagerank citation ranking: bringing order to the web. Stanford Digital Libraries Working Paper1998.
32.
Kennedy J. and Eberhart R.Particle swarm optimization. Proceedings of IEEE International Conference on Neural Networks1995: 1942-1948.
33.
Ratnaweera A., Halgamuge S. and Watson H.Self-organizing hierarchical particle swarm optimizer with time-varying acceleration coefficients . IEEE T Eνolut Comput2004; 8: 240-255.
34.
Krink T., Vesterstrøm JS and Riget J.Particle swarm optimization with spatial particle extension. Proceedings of the IEEE Congress on Eνolutionary Computation (CEC 2002), Honolulu, Hawaii, 2002.
35.
Clerc M.Discrete particle swarm optimization, illustrated by the traveling salesman problem. New Optimization Techniques in Engineering , 2004: 219-239.
36.
Tasgetiren MF, Liang Y.-C, Sevkli M. and Gencyilmaz G.A particle swarm optimization algorithm for makespan and total flowtime minimization in the permutation flowshop sequencing problem. Eur J Oper Res2007; 177: 1930-1947.
37.
Zhao L. and Yang Y.PSO-based single multiplicative neuron model for time series prediction . Expert Syst Appl2009; 36: 2805-2812.
38.
Rasmussen TK and Krink T.Improved Hidden Markov Model training for multiple sequence alignment by a particle swarm optimization -evolutionary algorithm hybrid. Biosystems2003; 72: 5-17.
39.
Cagnina L. , Esquivel S. and Coello CAC.A Particle Swarm Optimizer for multi-objective optimization. J Comput Sci Technol2005; 5: 204-210.
40.
Tripathi PK, Bandyopadhyay S. and Pal SKMulti-Objective Particle Swarm Optimization with time variant inertia and acceleration coefficients . Inform Sciences2007; 177: 5033-5049.
41.
Haveliwala THTopic-sensitive PageRank. Proceedings of the 11th International Conference on World Wide Web. Honolulu, Hawaii, USA, 2002: 517-526.
42.
Jing Y. and Baluja S.VisualRank: applying PageRank to large-scale image search. IEEE T Pattern Anal2008; 30: 1877-1890.
43.
Bar-Ilan J.Rankings of information and library science journals by JIF and by h-type indices. J Informetr2010; 4: 141-147.
44.
Bar-Ilan J. , Mat-Hassan M. and Levene M.Methods for comparing rankings of search engine results. Comput Netw2006; 50: 1448-1463.
45.
Davis PMEigenfactor: does the principle of repeated improvement result in better estimates than raw citation counts?JASIST2008; 59: 2186-2188
46.
Agarwal A., Chakrabarti S. and Aggarwal S.Learning to rank networked entities. Proceedings of the 12th ACM SIGKDD international conference on Knowledge discoνery and data mining. Philadelphia, PA, USA, 2006: 14-23
47.
Coello CAC, Pulido GT and Lechuga MSHandling multiple objectives with particle swarm optimization. IEEE T Eνolut Comput2004; 8: 256-279.
48.
Rainer RK and Miller MDExamining differences across journal rankings. Commun ACM2005; 48: 91-94.
49.
Gillenson M. and Stutz J.Academic issues in MIS: journals and books . MIS Quart1991; 15: 447-452.
50.
Walstrom K. , Hardgrave B. and Wilson R.Forums for management information systems scholars. Commun ACM1995; 38: 93-107.
51.
Doke E., Rebstock S. and Luke R.Journal Publishing Preferences of CIS/MIS Scholars: an empirical investigation . J Comp Inform Syst1995; 36: 49.
52.
Hardgrave B. and Walstrom K.Forums for MIS scholars. Commun ACM1997; 40: 119-124.
53.
Lowry P., Romans D. and Curtis A.Global journal prestige and supporting disciplines: a scientometric study of information systems journals. J Assoc Inf Syst2004; 5: 29-80.
54.
Herbrich R. , Graepel T. and Obermayer K.Large Margin Rank Boundaries for Ordinal Regression. Adνances in Large Margin Classifiers. Cambridge: MIT Press, 2000: 115-132.
55.
Zhang H. and Su J.Naive Bayesian classifiers for ranking. Lect Notes Comput Sci2004; 3201: 501-512.
