This is an invited commentary on a paper by Sen et al. (forthcoming). I explain how their paper provides a useful reminder of the need to communicate the practical importance of statistical findings more effectively and more often. I also explain how their recommendations address just a small piece of the issue of practical importance. I describe how we must keep the whole issue in mind and I provide examples from my editorial role at MIS Quarterly.
ApplegateLM (1999) Rigor and relevance in MIS research: introduction. MIS Quarterly23(1): 1–2.
2.
BreuKPeppardJ (2003) Useful knowledge for information systems practice: the contribution of the participatory paradigm. Journal of Information Technology18(3): 177–193.
3.
Burton-JonesA (2021) Editor’s comments: continuing and extending the MIS Quarterly trifecta vision. MIS Quarterly45(1). iii–viii.
4.
Burton-JonesALeeAS (2017) Thinking about measures and measurement in positivist research: a proposal for refocusing on fundamentals. Information Systems Research28(3): 451–467.
5.
DavisonRMMartinsonsMG (2011) Methodological practice and policy for organisationally and socially relevant is research: an inclusive–exclusive perspective. Journal of Information Technology26(4): 288–293.
6.
DulJvan der LaanEKuikR (2020) A statistical significance test for necessary condition analysis. Organizational Research Methods23(2): 385–395.
7.
GreenJPTonidandelSCortinaJM (2016) Getting through the gate: statistical and methodological issues raised in the reviewing process. Organizational Research Methods19(3): 402–432.
8.
HoSYLimKH (2018) Nudging moods to induce unplanned purchases in imperfect mobile personalization contexts. MIS Quarterly42(3): 757–778.
9.
HoffmanAJ (2021) The Engaged Scholar: Expanding the Impact of Academic Research in Today’s World. Redwood City, CA: Stanford University Press.
10.
KitchensBJohnsonSLGrayP (2020) Understanding echo chambers and filter bubbles: the impact of social media on diversification and partisan shifts in news consumption. MIS Quarterly44(4): 1619–1649.
11.
LinMLucasHCShmueliG (2013) Too big to fail: large samples and the p-value problem. Information Systems Research24(4): 906–917.
12.
LukyanenkoRParsonsJWiersmaYFMaddahM (2019) Expecting the unexpected: effects of data collection design choices on the quality of crowdsourced user-generated content. MIS Quarterly43(2): 623–647.
13.
MertensWReckerJ (2020) New guidelines for null hypothesis significance testing in hypothetico-deductive IS research. Journal of the Association for Information Systems21(4): 1072–2201.
14.
MirandaSMWangDTianC (forthcoming) Discursive fields and the diversity-coherence paradox: an ecological perspective on the blockchain community discourse. MIS Quarterly. DOI:10.25300/MISQ/2022/15736.
15.
MohajeriKMesgariMLeeAS (2020) When statistical significance is not enough: investigating relevance, practical significance, and statistical significance. MIS Quarterly44(2): 525–559.
16.
RaiA (2019) Editor’s comments: engaged scholarship: research with practice for impact. MIS Quarterly43(2). iii–viii.
17.
RosemannMVesseyI (2008) Toward improving the relevance of information systems research to practice: the role of applicability checks. MIS Quarterly32(1): 1–22.
18.
SchoenJLDeSimoneJAJamesLR (2011) Exploring joint variance between independent variables and a criterion: meaning, effect, and size. Organizational Research Methods14(4): 674–695.
19.
SenASmithGVan NoteC (Forthcoming). Statistical significance versus practical importance in information systems research. Journal of Information Technology. https://doi.org/10.1177/02683962211062236.
20.
SmithHJDinevTXuH (2011) Information Privacy Research: an Interdisciplinary Review. MIS Quarterly35(4): 989–1015.
21.
SorellT (1991) Scientism: Philosophy and the Infatuation with Science. London, UK: International Library of PhilosophyRoutledge.
22.
SpiegelM (2012) Reviewing less—progressing more. The Review of Financial Studies25(5): 1331–1338.
23.
StraubDAngS (2011) Rigor and relevance in IS research: redefining the debate and a call for future research. MIS Quarterly35(1): iii–xi.
24.
WalshamG (2012) Are we making a better world with ICTs? Reflections on a future agenda for the IS field. Journal of Information Technology27(2): 87–93.
25.
WunderlichPVeitDJSarkerS (2019) Adoption of sustainable technologies: a mixed-methods study of German households. MIS Quarterly43(2): 673–691.
