In this paper, the development of knowledge management (KM) was surveyed, using a literature review and classification of articles from 1995 to 2004. With a keyword index and article abstract, we explored how KM performance evaluation has developed during this period. Based on a scope of 108 articles from 80 academic KM journals (retrieved from six online databases), we surveyed and classified methods of KM measurement, using the following eight categories: qualitative analysis, quantitative analysis, financial indicator analysis, non-financial indicator analysis, internal performance analysis, external performance analysis, project-orientated analysis and organizationorientated analysis, together with their measurement matrices for different research and problem domains. Future development directions for KM performance evaluation are presented in our discussion. They include: (1) KM performance measurements have tended towards expertise orientation, while evaluation development is a problemorientated domain; (2) different information technology methodologies, such as expert systems, knowledge-based systems and case-based reasoning may be able to evaluate KM as simply another methodology; (3) the ability to continually change and obtain new understanding is the driving power behind KM methodologies, and should be the basis of KM performance evaluations in the future.
J.H. Ahn and S.G. Chang , Assessing the contribution of knowledge to business performance: the KP3 methodology , Decision Support Systems36 (2004) 403–416 .
2.
U. Schultze and D.E. Leidner , Studying knowledge management in information systems research: discourses and theoretical assumptions , MIS Quarterly26(3) (2002) 213–242 .
3.
M. Shin , T. Holden and R.A. Schmidt , From knowledge theory to management practice: towards an integrated approach , Information Processing and Management37 (2001) 335–355 .
4.
E. Brynjolfsson , A.A. Renshaw and M.V. Alstyne , The matrix of change , Sloan Management Review38(2) (1997) 37–54 .
5.
M. Alavi , KPMG Peat Marwick U.S.: one giant brain, Case 9–397–108( Harvard Business School, Boston, MA , 1997).
6.
T. Beckman , A methodology for knowledge management. In: M.H. Hamza (ed.), Proceedings of the IASTED International Conference on AI and Soft Computing, Banff, Canada, 1997( ACTA Press, Calgary , 1997) 29–32.
7.
A.P. Chen and M.Y. Chen , Integrating option model and knowledge management performance measures: an empirical study , Journal of Information Science31(5) (2005) 381–393 .
8.
M.Y. Chen , M.J. Tsai and H.R. Wu , The research of KM operation module in science and technology industry – case study of TSMC. In: S-C.T. Chou (ed.), Proceedings of the 12th International Information Management Conference( CSIM Press, Taipei , 2001) A-75.
9.
T.H. Davenport , D.W. Long and M.C. Beers , Successful knowledge management projects , Sloan Management Review39(2) (1998) 43–57 .
10.
J. Liebowitz , Key ingredients to the success of an organization's knowledge management strategy , Knowledge and Process Management6(1) (1999) 37–40 .
11.
I. Nonaka and H. Takeuchi , The Knowledge Creating Company( Oxford University Press, New York , 1995).
12.
K. Wiig , Knowledge management: where did it come from and where will it go?Expert Systems with Applications13(1) (1997) 1–14 .
13.
M. Alavi and D.E. Leidner , Review: knowledge management and knowledge management systems: conceptual foundations and research issues , MIS Quarterly25(1) (2001) 107–136 .
14.
R.M. Grant , Prospering in dynamically-competitive environments: organizational capability as knowledge integration , Organization Science7(4) (1996) 375–387 .
15.
M. Polanyi , The Tacit Dimension, Knowledge in Organizations( Butterworth-Heinemann, Newton, MA , 1996).
16.
T.S. Kuhn , The Structure of Scientific Revolutions ( University of Chicago Press, Chicago , 1962).
17.
I. Nonaka , A dynamic theory of organizational knowledge creation , Organization Science5(1) (1994) 14–37 .
18.
S.D.N. Cook and J.S. Brown , Bridging epistemologies: the generative dance between organizational knowledge and organizational knowing , Organization Science10(4) (1999) 381–400 .
19.
H. Tsoukas , The firm as a distributed knowledge system: a constructionist approach , Strategic Management Journal17 (1996) 11–25 .
20.
R.J. Calantone , S.T. Cavusgil and Y. Zhao , Learning orientation, firm innovation capability, and firm performance , Industrial Marketing Management31 (2002) 515–524 .
21.
M. Hertzum , The importance of trust in software engineers assessment and choice of information sources , Information and Organization12 (2002) 1–18 .
22.
G. Walsham , Knowledge management: the benefits and limitations of computer systems , European Management Journal19(6) (2002) 599–608 .
23.
C. Changchit , C.W. Holsapple and R.E. Viator , Transferring auditors’ internal control evaluation knowledge to management , Expert Systems with Applications20 (2001) 275–291 .
24.
D. Longbottom and P. Chourides , Knowledge management: a survey of leading UK companies. In: P. Hermel (ed.), Proceedings of the 2nd MAAOE International Conference, Versailles, France, 2001( UVSQ Press, Versailles , 2001) 113–126.
25.
D. Longbottom and P. Chourides , Climbing new heights: conquering K2 , Knowledge Management Magazine17June (2002).
26.
P. Chourides , D. Longbottom and W. Murphy , Excellence in Knowledge Management: an empirical study to identify critical factors and performance measures , Measuring Business Excellence7(2) (2003) 29–45 .
27.
M. Mitri , Applying tacit knowledge management techniques for performance assessment , Computers & Education41 (2003) 173–189 .
28.
C.W. Choo , The Knowing Organization( Oxford University Press, New York , 1998).
29.
J. Laitamaki and R. Kordupleski , Building and deploying profitable growth strategies based on the waterfall of customer value added , European Management Journal15(2) (1997) 158–166 .
30.
E.W. Stein , M.P. Manco , S.A. Manco , A knowledgebased system to assist university administrators in meeting disability act requirements , Expert Systems with Applications21(2) (2001) 65–74 .
31.
B. Lev , Intangibles: Management, Measurement, and Reporting( Brookings Institution Press, Washington, DC , 2001).
32.
B.H. Hall , A. Jaffè and M. Trajtenberg , Market Value and Patent Citations: A First Look. Working Paper No. 7741 ( National Bureau of Economic Research, Cambridge, MA , 2000).
33.
C.D. Ittner and D.F. Larcker , Are non-financial measures leading indicators of financial performance? An analysis of customer satisfaction , Journal of Accounting Research36 (1998) 1–35 .
34.
B. Villalonga , Intangible resources, Tobin's q, and sustainability of performance differences , Journal of Economic Behavior and Organization54(2) (2004) 205–230 .
35.
E.W. Stein , M.C. Pauster and D. May , A knowledgebased system to improve the quality and efficiency of titanium melting , Expert Systems with Applications24(2) (2003) 239–246 .
36.
W.L. Tung , C. Quek and P. Cheng , GenSo-EWS: a novel neural-fuzzy based early warning system for predicting bank failures , Neural Networks17(4) (2004) 567–587 .
37.
M. Benaroch and R.J. Kauffman , A case for using real options pricing analysis to evaluate information technology project investments , Information Systems Research10(1) (1999) 70–86 .
38.
A. Taudes , M. Feurstein and A. Mild , Options analysis of software platform decisions: a case study , MIS Quarterly24(2) (2000) 227–243 .
39.
B.L. Dos Santos , Justifying investments in new information technologies , Journal of Management Information Systems7(4) (1991) 71–90 .
40.
W. Margrabe , The value of an option to exchange one asset for another , Journal of Finance33(1) (1978) 177–186 .
41.
A. Kambil , J. Henderson and H. Mohsenzaden , Strategic management of information technology investments: an option perspective. In: R.D. Banker et al. (eds), Strategic Information Technology Management: Perspectives on Organization Growth and Competitive Advantage( Idea Publishing Group, Hershey , 1993) 161–178.
42.
J. Cox , S. Ross and M. Rubinstein , Option pricing: a simplified approach , Journal of Financial Economics6 (1979) 229–263 .
43.
W.C. Kester , Today's options for tomorrow's growth , Harvard Business Review62 (1984) 153–161 .
44.
A. Taudes , Software growth options , Journal of Management Information Systems15(1) (1998) 165–185 .
45.
M. Benaroch and R.J. Kauffman , Justifying electronic banking network expansion using real options analysis , MIS Quarterly24(2) (2000) 197–225 .
46.
S. Yahya and W.K. Goh , Managing human resources toward achieving knowledge management , Journal of Knowledge Management6(5) (2002) 457–468 .
47.
M. Smits and A.D. Moor , Measuring knowledge management effectiveness in communities of practice. In: R. Sprague (ed.), Proceedings of the 37th Hawaii International Conference on System Sciences, 2004( IEEE Press, Big Island , 2004) 80236b [Abstract only].
48.
D.T. Holt , S.E. Bartczak , S.W. Clark and M.R. Trent , The development of an instrument to measure readiness for knowledge management. In: R. Sprague (ed.), Proceedings of the 37th Hawaii International Conference on System Sciences( IEEE Press, Big Island , 2004) 80238b [Abstract only].
49.
R. Kaplan and D. Norton , The balanced scorecard: measures that drive performance , Harvard Business Review70(1) (1992) 71–79 .
50.
R. Kaplan and D. Norton , Putting the balanced scorecard to work , Harvard Business Review71(5) (1993) 134–142 .
51.
R. Kaplan and D. Norton , Using the balanced scorecard as a strategic management system , Harvard Business Review74(1) (1996) 75–85 .
52.
A.M. Fairchild , Knowledge management metrics via a balanced scorecard methodology. In: R. Sprague (ed.), Proceedings of the 35th Hawaii International Conference on System Sciences 2002( IEEE Press, Big Island , 2002) 243-243 [Abstract only].
53.
M. Martinsons , R. Davison and D. Tse , The balanced scorecard: a foundation for the strategic management of information systems , Decision Support Systems25 (1999) 71–88 .
54.
W. Van Grembergen and D. Vander Borght , Audit guidelines for IT outsourcing, EDP Auditing(1997) 1–8.
55.
S.T. Cavusgil , R.J. Calantone and Y. Zhao , Tacit knowledge transfer and firm innovation capability , The Journal of Business & Industrial Marketing18(1) (2003) 6–21 .
56.
H. Hasan and E.Gould , Support for the sense-making activity of managers , Decision Support Systems31(1) (2001) 71–86 .
57.
K. Kuutti , Activity theory as a potential framework for human-computer interaction research. In: B. Nardi (ed.), Context and Consciousness: Activity Theory and Human-Computer Interaction( MIT Press, Cambridge, MA , 1996) 9–22.
58.
Y.J. Kim , A. Chaudhury and H.R. Rao , A knowledge management perspective to evaluation of enterprise information portals , Knowledge and Process Management9(2) (2002) 57–71 .
59.
K.A. Pervaiz , K.L. Kwang and Z. Mohamed , Measurement practice for knowledge management , Journal of Workplace Learning11(8) (1999) 304–311 .
60.
K.H. Chai , M. Gregory and Y. Shi , Bridging islands of knowledge: a framework of knowledge sharing mechanisms , International Journal of Technology Management25(8) (2003) 703–727 .
61.
H.N. Leung , W.K. Chan and W.B. Lee , Benchmarking the role-modification process for successful knowledge transfer , Benchmarking11(6) (2004) 601–609 .
62.
S. Massa and S. Testa , Innovation or imitation? Benchmarking: a knowledge-management process to innovate services , Benchmarking11(6) (2004) 610–620 .
63.
F.J. Carrillo , Capital cities: a taxonomy of capital accounts for knowledge cities , Journal of Knowledge Management8(5) (2004) 28–46 .
64.
B. Marr , Measuring and benchmarking intellectual capital , Benchmarking11(6) (2004) 559–570 .
65.
J.D. Pemberton , G.H. Stonehouse and D.J. Yarrow , Benchmarking and the role of organizational learning in developing competitive advantage , Knowledge and Process Management8(2) (2001) 123–135 .
66.
M.Q. Patton , Evaluation, knowledge management, best practices, and high quality lessons learned , American Journal of Evaluation22(3) (2001) 329–336 .
67.
D. Asoh , S. Belardo and R. Neilson , Knowledge management: issues, challenges and opportunities for governments in the new economy. In: R. Sprague (ed.), Proceedings of the 35th Hawaii International Conference on System Sciences 2002( IEEE Press, Big Island , 2002) 129-129 [Abstract only].
M. Bresnen , L. Edelman , S. Newell , H. Scarbrough and J. Swan , Social practices and the management of knowledge in project environments , International Journal of Project Management21 (2003) 157–166 .
70.
L. Edelman , M. Bresnen , S. Newell , H. Scarbrough and J. Swan , The paradox of social capital: structural, cognitive and relational dimensions. In: R.A. Bettis (ed.), Reinventing strategic management: old truths and new insights: Strategic Management Society, 21st Annual International Conference, San Francisco, 2001( Blackwell, San Francisco , 2001) 153–174.
71.
B. Rubenstein-Montano , J. Liebowitz , J. Buchwalter , D. McCaw , B. Newman and K. Rebeck , A systems thinking framework for knowledge management , Decision Support Systems31(1) (2001) 5–16 .
72.
J. Liebowitz , I. Megbolugbe , A set of frameworks to aid the project manager in conceptualizing and implementing knowledge management initiatives , International Journal of Project Management21 (2003) 189–198 .
73.
J.M. Kamara , C.J. Anumba and P.M. Carrillo , A CLEVER approach to selecting a knowledge management strategy , International Journal of Project Management20 (2002) 205–211 .
74.
M. Vartiainen , M. Hakonen , A. Simola , A. Kokko and T. Rantamaki , Learning project model and transfer of experiences. In: P. Chung (ed.), Proceedings of the 6th International Product Development Conference 1999 ( Cambridge U.P., Cambridge , 1999) 774–786.
75.
J.J. Kasvi , M. Vartiainen and M. Hailikari , Managing knowledge and knowledge competences in projects and project organizations , International Journal of Project Management21 (2003) 571–582 .
76.
L. Edvinsson , Developing intellectual capital at Skandia , Long Range Planning30(3) (1997) 366–373 .
M.E. Van Buren , A yardstick for knowledge management , Training & Development53(5) (1999) 71–78 .
79.
K.H. Leitner and C. Warden , Managing and reporting knowledge-based resources and processes in research organizations: specifics, lessons learned and perspectives , Management Accounting Research15 (2004) 33–51 .
80.
P.N. Bukh , M.E. Johansen and J. Mouritsen , Multiple integrated performance management systems: IC and BSC in a software company , Singapore Management Review24(3) (2002) 21–33 .
81.
J. De Gooijer , Designing a knowledge management performance framework , Journal of Knowledge Management4(4) (2000) 303–310 .
82.
U. Johanson , M. Martensson and M. Skoog , Measuring to understand intangible performance drivers , European Accounting Review10(3) (2001) 407–437 .
83.
R. Ruggles , Knowledge Management Tools( Butterworth-Heinemann, Oxford , 1997).
84.
C. Jackson , Process to product – creating tools for knowledge management. In: Y. Malhotra (ed.), Knowledge Management for Business Model Innovation( Idea Group Publishing, Hershey , 1999) 402–413.
85.
A. Wensley , Tools for knowledge management. In: D. Chauvel and C. Despres (eds), Proceedings of the BPRC 2000 Conference on Knowledge Management: Concepts and Controversies( Butterworth-Heinemann, Warwick , 2000) 21-21.
86.
P. Tyndale , A taxonomy of knowledge management software tools: origins and applications , Evaluation and Program Planning25 (2002) 183–190 .
87.
B. Van Den Hooff , J. Vijvers and J. De Ridder , Foundations and applications of a knowledge management scan , European Management Journal21(2) (2003) 237–246 .
88.
KPMG , Knowledge Management Research Report(1998).
89.
S.H. Liao , Knowledge management technologies and applications-literature review from 1995 to 2002 , Expert Systems with Applications25 (2003) 155–164 .
90.
J.S. Brown and P. Duguid , The Social Life of Information ( Harvard Business School, Boston, MA , 2000).
91.
B.A. Nardi and V.L. O'Day , Information Ecologies: Using Technology with Heart( MIT Press, Cambridge, MA , 1999).
