Big data in evaluation: Experiences from using Twitter analysis to evaluate Norway’s contribution to the peace process in Colombia

Abstract

Social research has benefitted from big data and the evaluation community is embracing thinking and approaches that extract value from big data. This article describes how Twitter data was used in a recent evaluation of Norway’s contribution to the Colombian peace process brokered between the Government of Colombia and the FARC guerrilla group in 2012–2016. Sentiment analysis, key phrase extraction and social network analysis of tweets were helpful in evaluating this complex peace process. In this article, the authors present the purpose of the Twitter analysis and discuss the evaluation process. The article shares some lessons on how to conduct this type of analysis and reflects on its usefulness for evaluative purposes.

Keywords

big data evaluation peace Twitter

Get full access to this article

View all access options for this article.

References

ACIM (2016) Boletín 2 – Ranking periódicos a nivel nacional EGM 1. Bogotá, Colombia: ACIM.

Ahmed

(2017) Using Twitter as a data source: An overview of social media research tools (updated for 2017). In: LSE Impact blog. Available at: http://blogs.lse.ac.uk/impactofsocialsciences/2017/05/08/using-twitter-as-a-data-source-an-overview-of-social-media-research-tools-updated-for-2017/ (accessed 5 November 2017).

Bastian

Heymann

Jacomy

(2009) Gephi: An open source software for exploring and manipulating networks. In: International AAAI conference on weblogs and social media, San Jose, CA, 17–20 May, 361–2. Menlo Park, CA: AAAI Publications.

Centro Nacional de Memoria Histórica (2013) ¡Basta Ya! Colombia: memorias de guerra y dignidad. Bogotá, Colombia: Imprenta Nacional.

El Tiempo (2016) Twitter aumenta en 15% el número de usuarios en Latinoamérica en 2016. El Tiempo, 2 December. Available at: http://www.eltiempo.com/tecnosfera/novedades-tecnologia/numero-de-usuarios-de-twitter-en-latinoamerica-39709 (accessed 5 November 2017).

Evaluation Department (2018) A trusted facilitator: An evaluation of the Norwegian engagement in the peace process between the Colombian government and the FARC, 2010–2016. Evaluation report 10:2018. Oslo: Norad.

Gallego

Martinez

Munger

et al . (2017) Tweeting for Peace: Experimental Evidence from the 2016 Colombian Plebiscite. Serie Documentos de Trabajo. no. 208. Bogotá, Colombia: Universidad del Rosario.

García-Perdomo

(2017a) Between peace and hate: Framing the 2014 Colombian presidential election on Twitter. Cuadernos Info 41: 57–70.

García-Perdomo

(2017b) Colombian journalists on Twitter: Opinions, gatekeeping, and transparency in political coverage. International Journal of Communication 11(2017): 1574–96.

10.

Gómez Céspedes

(2016) Comunicación política por twitter: Colombia a un tuit de la democracia. PhD Thesis, Escuela Doctoral de Economía, Gestión, Información y Comunicación, Universidad Panthéon-Assas, and Universidad Sergio Arboleda, Bogotá, Colombia.

11.

Greenwood

Perrin

Duggan

(2016) Social media update 2016: Facebook usage and engagement is on the rise, while adoption of other platforms holds steady. Report, Pew Research Center, November. Available at: http://www.pewinternet.org/2016/11/11/social-media-update-2016/ (accessed 22 May 2018).

12.

Lewicki

(2006) Trust and distrust. In: Kupfer Schneider

Honeyman

(eds) The Negotiator’s Fieldbook. Chicago, IL: American Bar Association, 191–202.

13.

Lewicki

Tomlinson

(2014) Trust, trust development, and trust repair. In: Deutsch

Coleman

Marcus

(eds) The Handbook of Conflict Resolution: Theory and Practice, 3rd edn. San Francisco, CA: Jossey Bass, 104–136.

14.

Marin

Quintero

(2018) Confianza en el proceso de paz en Colombia en Twitter. Revista Mexicana de Sociología 80(1): 115–37.

15.

Mark

Henry

(2004) The mechanisms and outcomes of evaluation influence. Evaluation 10(1): 35–7.

16.

Mason

(2007) Mediation and Facilitation in Peace Processes. Zürich: International Relations and Security Network (ISN).

17.

Mayer

Davis

Schoorman

(1995) An Integrative Model of Organizational Trust. The Academy of Management Review 20(3): 709–34.

18.

Miller

Ginnis

Stobart

et al . (2015) The Road to Representivity a Demos and Ipsos MORI Report on Sociological Research Using Twitter Demos. London: Demos.

19.

Ministry of Information Technology and Communications of Colombia (2017) Gran Encuesta TIC. August. Available at: http://colombiatic.mintic.gov.co/602/w3-article-57508.html

20.

Ministry of Information Technology and Communications of Colombia (n.d.) Colombia es uno de los países con más usuarios en redes sociales en la region. Available at: http://www.mintic.gov.co/portal/604/w3-article-2713.html (accessed 22 May 2018).

21.

Nigam

Dambanemuya

Joshi

et al . (2017) Harvesting social signals to inform peace processes implementation and monitoring. Big Data 5(4): 337–55.

22.

Otte

Rousseau

(2002) Social network analysis: A powerful strategy, also for the information sciences. Journal of Information Science 28(6): 441–2.

23.

Quora (2016) Does your social media personality reflect the real you? 12 June. Available at: https://www.huffingtonpost.com/quora/does-your-social-media-pe_b_13462644.html?guccounter=1

24.

Rodríguez

Romero

Navarro

et al . (2015) Social media and polarization in Colombia. The use of Twitter during the Colombian peace process. Available at: https://drive.google.com/file/d/0B2uKVZxfSo3dRUdMNDRDa0Y1clU/view

25.

Torres Samboni

(2015) Análisis de sentimientos sobre el postconflicto colombiano utilizando herramientas de minería de texto (Maestría en Gestión de Información). Bogotá, Colombia: Escuela Colombiana de Ingeniería Julio Garavito.