This study examines the use of formal rankings of journals by management departments for personnel decision purposes. We posit that the probability of adopting a list of formal rankings is related to a set of characteristics of the department. Few schools have formal lists of journals. Our empirical findings imply that the probability of adopting a list is positively correlated with department size and is inversely correlated with the perceived quality of the department. Considerable variation exists across such lists and across different institutions in the perceptions of the quality of journals. This suggests that, although lists may reduce the level of uncertainty regarding the assessment of research quality by providing explicit targets, lists may also induce faculty members to develop institution-specific human capital. This could reduce faculty mobility and impede career development.
Get full access to this article
View all access options for this article.
References
1.
Barringer, M. W., & Milkovich, G. T.1998. A theoretical exploration of the adoption and design of flexible benefit plans: A case of human resource innovation. Academy of Management Review, 23(2): 305–324.
2.
Bedeian, A. G., & Feild, H. S.1980. Academic stratification in graduate management programs: Departmental prestige and faculty hiring patterns. Journal of Management, 6(2): 99–115.
3.
Beyer, J.1978. Editorial policies and practices among leading journals in four scientific fields. The Sociological Quarterly, 19: 68–88.
4.
Blackburn, R. S., & Mitchell, M.1981. Citation analysis in the organizational sciences. Journal of Applied Psychology, 66: 337–342.
5.
Cabell, D. W. E., & English, D. L. (eds.) (1994). Cabell’s Directory of Publishing Opportunities in Management and Marketing, Sixth Edition 1994–1995. Beaumont, Texas: Cabell Publishing Company.
6.
Campbell, D. J., Campbell, K. M., & Chia, H.1998. Merit pay, performance appraisal, and individual motivation: An analysis and alternative. Human Resource Management, 37 (2): 131–146.
7.
Cattell, R. B.1966. The scree test for the number of factors. Multivariate Behavioral Research, 1 (2): 245–276.
8.
Coe, R., & Weinstock, I.1984. Evaluating the management journals: A second look. Academy of Management Journal, 27 (3): 660–666.
9.
Cortina, J. M., & Folger, R. G.1998. When is it acceptable to accept a null hypothesis: No way Jose?Organizational Research Methods, 1 (3): 334–350.
10.
Daley, D. M.1993. Productivity tools and employee incentives: Availability and associations among North Carolina municipalities. Public Productivity & Management Review, 17: 2, 161–171.
11.
De Corte, W.1995. Cutoff that optimize the utility of a fixed quota of successful employees selection decision. International Journal of Selection and Assessment, 3 (1): 1–10.
12.
DeNisi, A.1997. Message from Angelo DeNisi. Academy of Management Journal, 40 (2): 259-259.
13.
Durden, G. C., & Ellis, L. V.1994. A method for identifying the most influential articles in an academic discipline. Atlantic Economic Journal, 21 (4): 1–10.
14.
Dwyer, C. A.1966. Cut scores and testing: Statistics, judgment, truth, and error. Psychological Assessment, 8 (4): 360–368.
15.
Enomoto, C. E., & Ghosh, S. N.1993. A stratified approach to the ranking of economics journals. Studies in Economic Analysis, 14 (2): 74–92.
16.
Everett, J. E., & Pecotich, A.1993. Citation analysis mapping of journals in applied and clinical psychology. Journal of Applied Social Psychology, 23 (9): 750–766.
17.
Extejt, M. M., & Smith, J. E.1990. The behavioral sciences and management: An evaluation of relevant journals. Journal of Management, 16 (3): 539–551.
18.
Ferris, G. R., Judge, T. A., Rowland, K. M., & Fitzgibbons, D. E.1994. Subordinate influence and the performance evaluation process: Test of a model. Organizational Behavior and Human Decision Processes, 58: 101–135.
19.
Ferris, G. R., & King, T. R.1991. Politics in human resources decisions: A walk on the dark side. Organizational Dynamics, 20: 59–71.
20.
Garfield, E.1972. Citation analysis as a tool in journal evaluation. Science, 178: 471–479.
21.
Garfield, E.1996. How can impact factors be improved?British Medical Journal, 313: 411–413.
22.
Garfield, E.1998. Long-term vs. short-term journal impact: Does it matter?The Physiologist, 41: 113–115.
23.
Garfield, E., & Welljams–Dorof, A.1992. Citation data: Their use as quantitative indicators for science and technology evaluation and policy making. Science and Public Policy, 19: 321–327.
24.
Goodson, J. R., & McGee, G. W.1991. Enhancing individual perceptions of objectivity in performance appraisal. Journal of Business Research, 22: 293–303.
25.
Gomez–Mejia, L. R., & Balkin, D. B.1992. Determinants of faculty pay: An agency theory perspective. Academy of Management Journal, 35 (5): 921–955.
26.
Gordon, M. E., & Purvis, J. E.1991. Journal publication records as a measure of research performance in industrial relations. Industrial and Labor Relations Review, 45: 194–201.
27.
Gregory, P.1994. Advanced materials — A tale of two journals. Advanced Materials, 6 (1): 7–8.
28.
Hasselback, J. R. (Ed.). 1996. The McGraw-Hill Directory of Management Faculty 1995–1996. NY: McGraw-Hill.
29.
Hotard, D., Tanner, J., & Manakyan, H.1996. Management faculty ratings of journal quality: The factors and the journals. Southern Business Review, 22 (1): 8–20.
30.
Huettner, D. A., & Clark, W.1997. Comparative research productivity measures for economics departments. Journal of Economic Education, 28 (3): 272–278.
31.
Jackson, S. E., Schuler, R. S., & Rivero, J. C.1989. Organizational characteristics as predictors of personnel practices. Personnel Psychology, 42: 727–786.
32.
Johnson, J. L., & Podsakoff, P. M.1994. Journal influence in the field of management: An analysis using Salancik’s Index in a dependency network. Academy of Management Journal, 37: 1392–1407.
33.
King, D. W., & Roderer, N. K.1982. Communication in physics —The use of journals. Physics Today, 35: 43–47.
34.
Kirkpatrick, S. A., & Locke, E. A.1992. The development of measures of faculty scholarship. Group & Organization Management, 17: 5–23.
35.
Latham, G. P., & Wexley, K. N.1981. Increasing productivity through performance appraisal. Reading, MA: Addison–Wesley Publishing Company.
36.
Lausen, B., & Schumacher, M.1996. Evaluating the effect of optimized cutoff values in the assessment of prognostic factors. Computational Statistics & Data Analysis, 21 (3): 307–326.
37.
Liu, M.1993. Progress in documentation of the complexities of citation practices: A review of citation studies. Journal of Documentation, 49: 370–408.
38.
London, M., & Smither, J. W.1999. Empowered self-development and continuous learning. Human Resource Management, 38: 3–15.
39.
Long, W. S., Long, E. J., & Dobbins, G. H.1998. Correlates of satisfaction with a peer evaluation system: Investigation of performance levels and individual differences. Journal of Business and Psychology, 12 (3): 299–312.
40.
Longenecker, C. O., & Nykodym, N.1996. Public sector performance appraisal effectiveness: A case study. Public Personnel Management, 25: 151–164.
41.
MacRoberts, M. H., & MacRoberts, B. R.1996. Problems of citation analysis. Scientometrics, 36: 435–444.
42.
Mahoney, T. A.1985. Journal publishing and the organization sciences: An analysis of exchanges. In L. L. Cummings & P. J. Frost (Eds.), Publishing in the Organizational Sciences. Homewood, IL: Irwin, 14–34.
43.
Maurer, T. J., Alexander, R. A., Callahan, C. M., Bailey, J. J., & Dambrot, F. H.1991. Methodological and psychometric issues in setting cutoff scores using the Angoff method. Personnel Psychology, 44 (2): 235–262.
44.
Maurer, T. J., & Tarulli, B. A.1996. Acceptance of peer/upward performance appraisal systems: Role of work context factors and beliefs about managers’ development capability. Human Resource Management, 35 (2): 217–241.
45.
Race, K. E. H., & Planek, T. W.1992. Modified scree test: Further considerations on its application to Delphi study data. Evaluation Review, 16 (2): 171–183.
46.
Saladin, B.1985. Operations management research: Where should we publish?Operations Management Review, 3 (4): 3–9.
47.
Sharplin, A. D., & Mabry, R. H.1985. The relative importance of journals used in management research: An alternative ranking. Human Relations, 38: 139–149.
48.
Stahl, M. J., Leap, T. L., & Wei, Z. Z.1988. Publication in leading management journals as a measure of institutional research productivity. Academy of Management Journal, 31: 707–720.
49.
Starbuck, W. H.1995. 1995. Estimated citations allowing for area norms [citation counts adjusted for differences across subject areas]. Provided by William H. Starbuck, December, 7.
50.
Tahai, A., & Meyer, M. J.1999. A revealed preference study of management journals’ direct influences. Strategic Management Journal, 20: 279–296.
51.
Todorov, R., & Glanzel, W.1988. Journal citation measures: A concise review. Journal of Information Science, 14: 47–56.
52.
Trenchard, P. M.1992. Hierarchical bibliometry: A new objective measure of individual scientific performance to replace publication counts and to complement citation measures. Journal of Information Science, 18: 69–75.
53.
Weinstock, I., & Coe, R. K.1969. The perceived image and policies of the business journals. Southern Journal of Business, 4: 91–98.
54.
Williams, W. W.1987. Institutional propensities to publish in academic journals of business administration: 1979–1984. Quarterly Review of Economics and Business, 27: 77–94.
55.
Young, S. T., Blumenfeld, W. S., St. John, C. H., & Angelidis, J. P. 1986. A ranking of management departments based on publications in prestigious management journals: A comparison of two approaches, Southern Management Association Proceedings, 112–114.
56.
Zoski, K., & Jurs, S.1990. Priority determination in surveys: An application of the scree test. Evaluation Review, 14 (2): 214–219.
57.
Zoski, K., & Jurs, S.1996. An objective counterpart to the visual scree test for factor analysis: The standard error Scree. Educational and Psychological Measurement, 56 (3): 443–451.
