Mine the Gap: Augmenting Foresight Methodologies with Data Analytics

Abstract

The explosion of Big Data and analytic tools in recent years has brought new opportunities to the field of foresight. Big Data and improved analytics capabilities can expand the knowledge base and act as a corrective to our cognitive biases. Moreover, several data mining and machine learning techniques that increase performance for businesses can be applied in foresight to help researchers discover patterns that may be early signals of change and correct our misperception of patterns where they don’t exist. This article discusses the opportunities and limitations of various data mining and machine learning techniques in foresight.

Keywords

foresight future studies data analytics machine learning artificial intelligence methodology

Get full access to this article

View all access options for this article.

References

Ahmad

2018. “How Much Data Is Generated Every Minute? [Infographic].” Social Media Today, June 15. https://www.socialmediatoday.com/news/how-much-data-is-generated-every-minute-infographic-1/525692/

Attewell

P. A.

Monaghan

2015. Data Mining for the Social Sciences: An Introduction. Oakland: University of California Press.

Auerback. 2018. Bitwise: A Life in Code. New York: Pantheon Book.

Bishop

2009. “Horizon Scanning Why Is It So Hard?” http://law.uh.edu/faculty/thester/courses/Emerging%20Tech%202011/Horizon%20Scanning.pdf.

Bishop

Hines

2012. Teaching about the Future. New York: Palgrave Macmillan.

Bolukbasi

Chang

Zou

Saligrama

Kalai

2016. “Man Is to Computer Programmer as Woman Is to Homemaker? Debiasing Word Embeddings.” Neural Information Processing Systems Foundation. https://papers.nips.cc/paper/6228-man-is-to-computer-programmer-as-woman-is-to-homemaker-debiasing-word-embeddings.pdf.

Boysen

2019. “How Data Science Enhances Foresight.” Futurist.com by Glen Hiemstra, February 26. https://www.futurist.com////how-data-science-enhances-foresight-by-anne-boysen/20190226.

“Confirmation Bias and the Power of Disconfirming Evidence.” 2017. Farnam Street. https://fs.blog/2017/05/confirmation-bias/.

Conway

2006. “An Overview of Foresight Methodologies.” http://www.forschungsnetzwerk.at/downloadpub/An-Overview-of-Foresight-Methodologies1.pdf.

10.

Das

T. K.

Kumar

P. Mohan

. 2013. “Big Data Analytics: A Framework for Unstructured Data Analysis.” International Journal of Engineering and Technology 5 (1): 153–56.

11.

Dator

2009. “Alternative futures at the Manoa School.” Journal of Futures Studies 14 (2): 1–18.

12.

Dator

2018. “Emerging Issues Analysis: Because of Graham Molitor.” World Futures Review 10 (1): 5–10.

13.

Dea

2015. “Do You Know the 4 V’s of Big Data?” INTELEX Blog, July 16. https://blog.intelex.com/2015/07/16/do-you-know-the-4-vs-of-big-data/.

14.

Gunluk

Kalagnanam

Menickelly

Scheinberg

2019. “Optimal Decision Trees for Categorical Data via Integer Programming.” http://www.optimization-online.org/DB_FILE/2018/01/6404.pdf.

15.

Harryson

Métayer

Sarrazin

2014. “The strength of ‘weak signals.’” Mckinsey Quarterly, February . https://www.mckinsey.com/industries/technology-media-and-telecommunications/our-insights/the-strength-of-weak-signals.

16.

Hiltunen

2008. “Good Sources for Weak Signals: A Global Study of Where Futurists Look For Weak Signals.” Journal of Future Studies 12 (4): 21–44.

17.

Hiltunen

2010. Weak Signals in Organizational Futures Learning. Aalto University School of Economics: Aalto Print. http://epub.lib.aalto.fi/pdf/diss/a365.pdf.

18.

Inayatullah

2009. “Causal Layered Analysis: An Integrative and Transformative Theory and Method.” In Futures Research Methodology, Version 3.0, edited by Glenn

Gordon

Washington, DC: The Millennium Project.

19.

Inayatullah

2014. “Causal Layered Analysis (CLA) Defined (2014).” Metafuture. https://www.metafuture.org/causal-layered-analysis-cla-defined-2014/.

20.

Kayser

Blind

2017. “Extending the knowledge base of foresight: The contribution of text mining.” Technological Forecasting & Social Change 116:208–15.

21.

Koehrsen

2018. “Beyond Accuracy: Precision and Recall,” towards Data Science.” https://towardsdatascience.com/beyond-accuracy-precision-and-recall-3da06bea9f6c.

22.

Kuntz

2012. “The Postmodern Assault on Science: If All Truths are Equal, who Cares What Science Has to Say?” EMBO Reports 13:885–89. doi:10.1038/embor.2012.130.

23.

Lavanchy

2018. “Amazon’s Sexist Hiring Algorithm Could Still Be Better than a Human.” Phys.org, November 1. https://phys.org/news/2018-11-amazon-sexist-hiring-algorithm-human.html.

24.

LeCunn

Cortes

Burgess

(n.d.). “The MNIST Database of Handwritten Digits.” http://yann.lecun.com/exdb/mnist/.

25.

Linoff

Berry

M. J. A.

2011. Data Mining Techniques: For Marketing, Sales, and Customer Relationship Management. Indianapolis: John Wiley.

26.

Logg

J. M.

2019. “Using Algorithms to Understand the Biases in Your Organization.” Harvard Business Review, August 9. https://hbr.org/2019/08/using-algorithms-to-understand-the-biases-in-your-organization.

27.

London School of Economics and Political Science. 2017. “Is Post-Modernism to Blame for our Post-Truth World?” [Audio Podcast], Public Lectures and Events, October 2. http://www.lse.ac.uk/lse-player?id=3892.

28.

Lum

2016. “Trends vs. Emerging Issues: What Is the Difference?” Visionforesightstrategy.wordpress.com, April 3. https://visionforesightstrategy.wordpress.com////trends-vs-emerging-issues-what-is-the-difference/20160403.

29.

Molitor

G. T. T.

2017. “The Molitor Model of Change.” World Futures Review 10 (1): 13–21. doi:10.1177/1946756717747636.

30.

Mounk

2018. “What an Audacious Hoax Reveals about Academia.” The Atlantic, October 5. https://www.theatlantic.com/ideas/archive/2018/10/new-sokal-hoax/572212/.

31.

Mühlroth

Grottke

2018. “A Systematic Literature Review of Mining Weak Signals and Trends for Corporate Foresight.” Journal of Business Economics 88 (5): 643–87.

32.

O’Neil

2016. Weapons of Math Destruction: How Big Data Increases Inequality and Threatens Democracy. New York: Crown.

33.

Pearl

Mackenzie

2018. The Book of Why: The New Science of Cause and Effect. New York: Basic Books.

34.

Popper

K. R.

2002. The Logic of Scientific Discovery. New York: Routledge.

35.

Sarniak

2015. “9 Types of Research Bias and How to Avoid Them.” https://www.quirks.com/articles/9-types-of-research-bias-and-how-to-avoid-them

36.

Stephens-Davidowitz

2017. Everybody Lies: What the Internet Can Tell Us about Who We Really Are. New York: HarperCollins Publishers.

37.

Taleb

N. N.

2007. The Black Swan: The Impact of the Highly Improbable. New York: Random House.

38.

“The World’s Most Valuable Resource Is No Longer Oil, But Data.” (2017). The Economist, May 6. https://www.economist.com/leaders/2017/05/06/the-worlds-most-valuable-resource-is-no-longer-oil-but-data.

39.

Voros

2003. “A Generic Foresight Process Framework.” Foresight 5 (3): 10–21.

40.

Webster

Axelrod

Baldridge

Recasens

2018. “Mind the GAP: A Balanced Corpus of Gendered Ambiguous Pronouns.” Transactions of the Association for Computational Linguistics 6, 605–17. https://arxiv.org/pdf/1810.05201.pdf.

41.

Wiggers

2018. “Google’s What-If Tool for TensorBoard Helps Users Visualize AI Bias.” https://venturebeat.com/2018/09/11/googles-what-if-tool-for-tensorboard-lets-users-visualize-ai-bias/.

42.

Wiggers

2019. “MIT CSAIL Researchers Propose Automated Method for Debiasing AI Algorithms.” https://venturebeat.com/2019/01/26/mit-csail-researchers-propose-automated-method-for-debiasing-ai-algorithms/.

43.

“Word of the Year.” 2016. Oxford Languages. https://languages.oup.com/word-of-the-year/word-of-the-year-2016.

44.

Yao

2017. “Chihuahua or Muffin? Searching for the Best Computer Vision API.” TOPBOTS, September 22. https://www.topbots.com/chihuahua-muffin-searching-best-computer-vision-api/.