Achieving cognitive coordination in cross-functional teams is a perennial challenge in organizations. It is especially challenging in the context of information systems, where strategic alignment remains a top concern of leaders despite decades of research on the topic. In this study, we develop and empirically validate a theoretical model that explores the role of communicating about performance metrics in fostering cognitive coordination between the Chief Information Officer (CIO) and top management team (TMT). Building on a theoretical lens of transactive memory systems, we hypothesize how the use of unit-specific metrics of information technology (IT) performance and collective metrics of organizational performance can differentially influence mutual trust and shared understanding in the CIO–TMT relationship. Through a survey of 268 CIOs, an experiment with 106 participants using a novel IT leadership game, and an algorithmic analysis of 3200+ articles in a trade publication, we find that communications using narrowly focused IT unit metrics improve mutual trust between the CIO and the TMT, while communications using broader organizational metrics (along with mutual trust) increase shared understanding of IT's role in improving organizational performance. Our multimethod study adds an important new facet to the rich literature on IT strategic alignment as well as the use of performance metrics in operations management. We discuss its implications for both theory and practice in improving cognitive coordination among the CIOs and TMT. Our model and findings are also relevant to other cross-functional teams where specialized individuals must collaborate to achieve collective goals.
AlanYLapréMA (2018) Investigating operational predictors of future financial distress in the US airline industry. Production and Operations Management27(4): 734–755.
2.
AmiriAKCavusogluHBenbasatI (2015) Enhancing strategic IT alignment through common language: Using the terminology of the resource-based view or the capability-based view? International Conference on Information Systems, Fort Worth, TX.
3.
ArgoteLHoraM (2017) Organizational learning and management of technology. Production and Operations Management26(4): 579–590.
4.
ArmstrongCPSambamurthyV (1999) Information technology assimilation in firms: The influence of senior leadership and IT infrastructures. Information Systems Research10(4): 304–327.
5.
AryaAMittendorfB (2010) The effect of earnings-based metrics on vertical efficiency. Production and Operations Management19(4): 406–417.
6.
BachuraEValechaRChenR, et al. (2022) The OPM data breach: An investigation of shared emotional reactions on Twitter. MIS Quarterly46(2): 881–910.
7.
BankerRDHuNPavlouPA, et al. (2011) CIO reporting structure, strategic positioning, and firm performance. MIS Quarterly35(2): 487–504.
BarnesSJVidgenRT (2006) Data triangulation and web quality metrics: A case study in e-government. Information & Management43(6): 767–777.
10.
BaruaAKriebelCHMukhopadhyayT (1995) Information technologies and business value: An analytic and empirical investigation. Information Systems Research6(1): 3–23.
11.
BattRJTongJD (2020) Mean service metrics: Biased quality judgment and the customer–server quality gap. Manufacturing & Service Operations Management22(5): 975–995.
12.
BendolyE (2014) System dynamics understanding in projects: Information sharing, psychological safety, and performance effects. Production and Operations Management23(8): 1352–1369.
13.
BendolyERosenzweigEDStratmanJK (2007) Performance metric portfolios: A framework and empirical analysis. Production and Operations Management16(2): 257–276.
14.
BharadwajAEl SawyOAPavlouPA, et al. (2013) Digital business strategy: Toward a next generation of insights. MIS Quarterly37(2): 471–482.
15.
BollenKADiamantopoulosA (2017) In defense of causal-formative indicators: A minority report. Psychological Methods22(3): 581.
16.
BrynjolfssonEHittL (1996) Paradox lost? Firm-level evidence on the returns to information systems spending. Management Science42(4): 541–558.
17.
ButlerBSGrayPH (2006) Reliability, mindfulness, and information systems. MIS Quarterly30(2): 211–224.
18.
CarlilePR (2002) A pragmatic view of knowledge and boundaries: Boundary objects in new product development. Organization Science13(4): 442–455.
19.
CenfetelliRTBassellierG (2009) Interpretation of formative measurement in information systems research. MIS Quarterly33(4): 689–707.
20.
ChaeH-CKohCEPrybutokVR (2014) Information technology capability and firm performance: Contradictory findings and their possible causes. MIS Quarterly38(1): 305–326.
21.
ChanYEReichBH (2007) IT alignment: What have we learned?Journal of Information Technology22(4): 297–315.
22.
ChenCMDelmasM (2011) Measuring corporate social performance: An efficiency perspective. Production and Operations Management20(6): 789–804.
23.
ChenXLiXClarkJG, et al. (2013) Knowledge sharing in open source software project teams: A transactive memory system perspective. International Journal of Information Management33(3): 553–563.
24.
ChinWW (1998) The partial least squares approach to structural equation modeling. Modern Methods for Business Research295(2): 295–336.
25.
ClarkHH (1992) Arenas of Language Use. Chicago: University of Chicago Press.
26.
CohenMAEliashbergJHoTH (2000) An analysis of several new product performance metrics. Manufacturing & Service Operations Management2(4): 337–349.
27.
ColtmanTTallonPSharmaR, et al. (2015) Strategic IT alignment: Twenty-five years on. Journal of Information Technology30: 91–100.
28.
CorbinJMStraussA (1990) Grounded theory research: Procedures, canons, and evaluative criteria. Qualitative Sociology13(1): 3–21.
29.
De HaesSVan GrembergenW (2004) IT governance and its mechanisms. Information Systems Control Journal1: 27–33.
30.
De HaesSVan GrembergenW (2009) An exploratory study into IT governance implementations and its impact on business/IT alignment. Information Systems Management26(2): 123–137.
31.
DennisARFullerRMValacichJS (2008) Media, tasks, and communication processes: A theory of media synchronicity. MIS Quarterly32(3): 575–600.
32.
DevarajSFanMKohliR (2002) Antecedents of B2C channel satisfaction and preference: Validating e-commerce metrics. Information Systems Research13(3): 316–333.
33.
DiamantopoulosASiguawJA (2006) Formative versus reflective indicators in organizational measure development: A comparison and empirical illustration. British Journal of Management17(4): 263–282.
34.
DoerrKHGueKR (2013) A performance metric and goal-setting procedure for deadline-oriented processes. Production and Operations Management22(3): 726–738.
35.
DouglasBDEwellPJBrauerM (2023) Data quality in online human-subjects research: Comparisons between MTurk, prolific, CloudResearch, Qualtrics, and SONA. Plos One18(3): e0279720.
36.
EnnsHGHuffSLHigginsCA (2003) CIO lateral influence behaviors: Gaining peers’ commitment to strategic information systems. MIS Quarterly27(1): 155–176.
37.
EvansJR (2004) An exploratory study of performance measurement systems and relationships with performance results. Journal of Operations Management22(3): 219–232.
38.
FornellCLarckerDF (1981) Evaluating structural equation models with unobservable variables and measurement error. Journal of Marketing Research18(1): 39–50.
GattikerTFGoodhueDL (2005) What happens after ERP implementation: Understanding the impact of inter-dependence and differentiation on plant-level outcomes. MIS Quarterly29(3): 559–585.
41.
GefenDRigdonEEStraubD (2011) Editor's comments: An update and extension to SEM guidelines for administrative and social science research. MIS Quarterly35(2): iii–xiv.
42.
GinoFArgoteLMiron-SpektorE, et al. (2010) First, get your feet wet: The effects of learning from direct and indirect experience on team creativity. Organizational Behavior and Human Decision Processes111(2): 102–115.
43.
GuerreroHHBradleyJR (2013) Failure modes and effects analysis: An evaluation of group versus individual performance. Production and Operations Management22(6): 1524–1539.
44.
GunasekaranAPatelCTirtirogluE (2001) Performance measures and metrics in a supply chain environment. International Journal of Operations & Production Management21(1/2): 71–87.
45.
GuoWStraubDZhangP, et al. (2021) How trust leads to commitment on microsourcing platforms: Unraveling the effects of governance and third-party mechanisms on triadic microsourcing relationships. MIS Quarterly45(3): 1309–1348.
46.
HairJFHultGTMRingleCM, et al. (2021) Partial Least Squares Structural Equation Modeling (PLS-SEM) Using R: A Workbook. Springer Nature.
47.
HairJFRisherJJSarstedtM, et al. (2019) When to use and how to report the results of PLS-SEM. European Business Review31(1): 2–24.
48.
HausmanWHLeeHLSubramanianU (2013) The impact of logistics performance on trade. Production and Operations Management22(2): 236–252.
49.
HeikkiläJ (2002) From supply to demand chain management: Efficiency and customer satisfaction. Journal of Operations Management20(6): 747–767.
50.
HoeglMGemuendenHG (2001) Teamwork quality and the success of innovative projects: A theoretical concept and empirical evidence. Organization Science12(4): 435–449.
51.
HuangRZmudRWPriceRL (2010) Influencing the effectiveness of IT governance practices through steering committees and communication policies. European Journal of Information Systems19(3): 288–302.
52.
HunterRWestermanG (2009) Real Business of IT: How CIOs Create and Communicate Value. Boston, MA: Harvard Business Review Press.
53.
JarvenpaaSLMajchrzakA (2008) Knowledge collaboration among professionals protecting national security: Role of transactive memories in ego-centered knowledge networks. Organization Science19(2): 260–276.
54.
JiangJJKleinGCarrCL (2002) Measuring information system service quality: SERVQUAL from the other side. MIS Quarterly26(2): 145–166.
55.
JohnsonAMLedererAL (2005) The effect of communication frequency and channel richness on the convergence between chief executive and chief information officers. Journal of Management Information Systems22(2): 227–252.
56.
JohnsonVTorresRMaurerC, et al. (2023) The 2022 SIM IT issues and trends study. MIS Quarterly Executive22(1): 55–98.
57.
KanawattanachaiPYooY (2007) The impact of knowledge coordination on virtual team performance over time. MIS Quarterly31(4): 783–808.
58.
KaplanRSNortonDP (1996) Linking the balanced scorecard to strategy. California Management Review39(1): 53–79.
59.
KarahannaEPrestonDS (2013) The effect of social capital of the relationship between the CIO and top management team on firm performance. Journal of Management Information Systems30(1): 15–56.
60.
KobakDLindermanGC (2021) Initialization is critical for preserving global data structure in both t-SNE and UMAP. Nature Biotechnology39(2): 156–157.
61.
KockN (2020) Harman’s single factor test in PLS-SEM: Checking for common method bias. Data Analysis Perspectives Journal2(2): 1–6.
62.
KohliRTanSS-L (2016) Electronic health records: How can IS researchers contribute to transforming healthcare?MIS Quarterly40(3): 553–573.
63.
KotlarskyJvan den HooffBHoutmanL (2015) Are we on the same page? Knowledge boundaries and transactive memory system development in cross-functional teams. Communication Research42(3): 319–344.
64.
KoufterosXAVonderembseMADollWJ (2002) Examining the competitive capabilities of manufacturing firms. Structural Equation Modeling9(2): 256–282.
65.
LewisKHerndonB (2011) Transactive memory systems: Current issues and future research directions. Organization Science22(5): 1254–1265.
66.
MachucaJAD (1998) Improving POM learning: Systems thinking and transparent-box business simulators. Production and Operations Management7(2): 210–227.
67.
MallickDNSchroederRG (2005) An integrated framework for measuring product development performance in high technology industries. Production and Operations Management14(2): 142–158.
68.
MarquesLManzanaresMD (2023) Towards social network metrics for supply network circularity. International Journal of Operations & Production Management43(4): 595–618.
69.
MayerRCDavisJHSchoormanFD (1995) An integrative model of organizational trust. Academy of Management Review20(3): 709–734.
70.
McKnightDHChoudhuryVKacmarC (2002) Developing and validating trust measures for e-commerce: An integrative typology. Information Systems Research13(3): 334–359.
71.
McKnightDHPhillipsBHardgraveBC (2009) Which reduces IT turnover intention the most: Workplace characteristics or job characteristics?Information & Management46(3): 167–174.
72.
MelvilleNKraemerKGurbaxaniV (2004) Information technology and organizational performance: An integrative model of IT business value. MIS Quarterly28(2): 283–322.
73.
MitchellVL (2006) Knowledge integration and information technology project performance. MIS Quarterly30(4): 919–939.
74.
MitraSSambamurthyVWestermanG (2011) Measuring IT performance and communicating value. MIS Quarterly Executive10(1): 47–59.
75.
NahapietJGhoshalS (1998) Social capital, intellectual capital, and the organizational advantage. Academy of Management Review23(2): 242–266.
76.
NunnallyJ (1978) Psychometric Methods. New York: McGraw-Hill.
77.
PetterSStraubDRaiA (2007) Specifying formative constructs in information systems research. MIS Quarterly31(4): 623–656.
78.
PittLFWatsonRTKavanCB (1995) Service quality: A measure of information systems effectiveness. MIS Quarterly19(2): 173–187.
79.
PodsakoffPMLeeJYMacKenzieSB, et al. (2003) Common method biases in behavioral research: A critical review of the literature and recommended remedies. Journal of Applied Psychology88(5): 879–903.
80.
PrestonDSKarahannaE (2009) Antecedents of IS strategic alignment: A nomological network. Information Systems Research20(2): 159–179.
81.
PrestonDSKarahannaERoweF (2006) Development of shared understanding between the chief information officer and top management team in US and French organizations: A cross-cultural comparison. IEEE Transactions on Engineering Management53(2): 191–206.
82.
ŘehůřekR (2010) Software framework for topic modelling with large corpora. Proceedings of the LREC 2010 Workshop on New Challenges for NLP Frameworks, Valletta, Malta.
83.
ReichBHBenbasatI (2000) Factors that influence the social dimension of alignment between business and information technology objectives. MIS Quarterly24(1): 81–113.
84.
RenYArgoteL (2011) Transactive memory systems 1985–2010: An integrative framework of key dimensions, antecedents, and consequences. Academy of Management Annals5(1): 189–229.
85.
SabherwalRJeyarajA (2015) Information technology impacts on firm performance: An extension of Kohli and Devaraj (2003). MIS Quarterly39(4): 809–836.
86.
SenonerJKratzwaldBKuzmanovicM, et al. (2023) Addressing distributional shifts in operations management: The case of order fulfillment in customized production. Production and Operations Management32(10): 3022–3042.
87.
SmaltzDHSambamurthyVAgarwalR (2006) The antecedents of CIO role effectiveness in organizations: An empirical study in the healthcare sector. IEEE Transactions on Engineering Management53(2): 207–222.
88.
SonghoriMJNasiryJ (2020) Organizational structure, subsystem interaction pattern, and misalignments in complex NPD projects. Production and Operations Management29(1): 214–231.
89.
SunS (2004) Assessing joint maintenance shops in the Taiwanese army using data envelopment analysis. Journal of Operations Management22(3): 233–245.
90.
TallonPPRamirezRVShortJE (2013) The information artifact in IT governance: Toward a theory of information governance. Journal of Management Information Systems30(3): 141–178.
91.
Van der MaatenLHintonG (2008) Visualizing data using t-SNE. Journal of Machine Learning Research9(11): 2579–2605.
92.
WeillPRossJ (2005) A matrixed approach to designing IT governance. MIT Sloan Management Review46(2): 26–34.
93.
WestermanGBonnetDMcAfeeA (2014) Leading digital: Turning technology into business transformation. Harvard Business Press.
94.
WestermanGSouleDLEswaranA (2019) Building digital-ready culture in traditional organizations. MIT Sloan Management Review60(4): 59–68.
95.
WestermanGWeillP (2006) Getting higher business value from IT: The non-IT executive view. MIT CISR Research BriefingsVI(3A): 1–4.
96.
WilliamsLJHartmanNCavazotteF (2010) Method variance and marker variables: A review and comprehensive CFA marker technique. Organizational Research Methods13(3): 477–514.
97.
WuSPJStraubDWLiangT-P (2015) How information technology governance mechanisms and strategic alignment influence organizational performance: Insights from a matched survey of business and IT managers. MIS Quarterly39(2): 497–518.
98.
YooYBolandRJLyytinenK, et al. (2012) Organizing for innovation in the digitized world. Organization Science23(5): 1398–1408.
99.
ZhuKKraemerKL (2002) E-commerce metrics for net-enhanced organizations: Assessing the value of e-commerce to firm performance in the manufacturing sector. Information Systems Research13(3): 275–295.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
