This article aims to advance the methodology for assessing the social impact of tourism research. An evaluation framework was designed to measure social impact in three stages—ex-ante, in-itinere and ex-post—and the ex-post evaluation was applied to a tourism research project, the POLITUR project, to test its validity. The collected information originated from interviews and documentary material. The analysis was structured according to six main areas—communication and promotion, policies and regulation, economic benefit, new technological resources, environment and social improvements—and four dimensions—temporal, applied, geographical and sustainability. The results are followed by a discussion of the domains and dimensions of the social impact assessment of tourism research. The need for further improvement in methods for measuring the social impact of tourism research and the importance of research that generates social impact are highlighted.
AhmadvandMKaramiE (2017) Social impacts evaluation and insider-outsider paradigm: floodwater spreading project on the Gareh-Bygone plain as an illustrative case. Evaluation and Program Planning65: 69–76.
2.
AllaKHallWDWhitefordHA, et al. (2017) Research impact for (mental) health policy. Health Res Policy Sys15: 1.
3.
Alvare-BornsteinBMontesiM (2019) Who is interacting with researchers on Twitter?: a survey in the field of information science. JLIS10(2): 87–106.
4.
AndereckKL (1995) Environmental consequences of tourism: a review of recent research. In:Linking tourism, the environment, and sustainability.Annual meeting of the national recreation and park association, 77–81.
5.
AndereckKLNyaupaneGP (2011) Exploring the nature of tourism and quality of life perceptions among residents. Journal of Travel Research50(3): 248–260.
6.
AndereckKLValentineKMKnopfRC, et al. (2005) Residents’ perceptions of community tourism impacts. Annals of Tourism Research32(4): 1056–1076.
7.
ArcherBCooperCRuhanenL (2005) The positive and negative impacts of tourism. Global Tourism3: 79–102.
8.
AucampILombardA (2018) Can social impact assessment contribute to social development outcomes in an emerging economy?Impact Assessment and Project Appraisal36(2): 173–185.
9.
BeckerHA (2001) Social impact assessment. European Journal of Operational Research128(2): 311–321.
10.
BornmannL (2012) Measuring the societal impact of research: research is less and less assessed on scientific impact alone—we should aim to quantify the increasingly important contributions of science to society. EMBO Reports13(8): 673–676.
11.
BornmannL (2013) What is sicietal impact of research and how can it be assessed? A literature Survey. Journal of American Society for Information Science and Technology64(20): 217–233.
12.
BornmannL (2014) Do altmetrics point to the broader impact of research? An overview of benefits and disadvantages of altmetrics. Journal of Informetrics8(4): 895–903.
13.
BornmannLMarxW (2014) How should the societal impact of research be generated and measured? A proposal for a simple and practicable approach to allow interdisciplinary comparisons. Scientometrics98(1): 211–219.
14.
BornmannL (2015) Usefulness of altmetrics for measuring the broader impact of research: a case study using data from PLOS and F1000Prime. Aslib J. Inf. Manag67(3): 305–319.
15.
BornmannLHaunschildRMarxW (2016) Policy documents as sources for measuring societal impact: how often is climate change research mentioned in policy-related documents?Scientometrics109(3): 1477–1495.
16.
BornmannLHaunschildR (2018) Normalization of zero-inflated data: an empirical analysis of a new indicator family and its use with altmetricsdata. Journal of Informetrics12(3): 998–1011.
17.
BornmannLHaunschildRAdamsJ (2019) Do altmetrics assess societal impact in a comparable way to case studies? An empirical test of the convergent validity of altmetrics based on data from the UK research excellence framework (REF). Journal of Informetrics13(1): 325–340.
18.
BoshoffNde JongSP (2020) Conceptualizing the societal impact of research in terms of elements of logic models: a survey of researchers in sub-Saharan Africa. Research Evaluation29(1): 48–65.
19.
BroughamJEButlerRW (1981) A segmentation analysis of resident attitudes to the social impact of tourism. Annals of Tourism Research8(4): 569–590.
20.
BurdgeRWilliamsGLlewellynL, et al. (1995) Guidelines and principles for social impact assessment. Environmental Impact Assessment Review15(1): 11–43.
21.
ChamsNGuesmiBGilJM (2020) Beyond scientific contribution: assessment of the societal impact of research and innovation to build a sustainable agri-food sector. Journal of Environmental Management264: 110455.
22.
ChoJ (2017) A comparative study of the impact of Korean research articles in four academic fields using altmetrics. Performance Measurement and Metrics18: 1467–8047.
23.
CorsiAPaganiRNKovaleskiJL, et al. (2019) Technology transfer for sustainable development: social impacts depicted and some other answers to a few questions. Journal of Cleaner Production245: 118522.
24.
CunhaJFerreiraPAraújoM, et al. (2012, April) Social return of R&D investments in manufacturing sector: some insights from an exploratory case study. AIP Conference Proceedings1431(1): 43–53. American Institute of Physics.
25.
DardasLAWoodwardAScottJ, et al. (2019) Measuring the social impact of nursing research: an insight into altmetrics. Journal of Advanced Nursing75(7): 1394–1405.
26.
De JongSBarkerKCoxD, et al. (2014) Understanding societal impact through productive interactions: ICT research as a case. Research Evaluation23(2): 89–102.
27.
De SilvaPUVanceCK (2017) Assessing the societal impact of scientific research. In: Scientific Scholarly Communication. Cham: Springer, pp. 117–132.
28.
DeeryMJagoLFredlineL (2012) Rethinking social impacts of tourism research: a new research agenda. Tourism Management33(1): 64–73.
29.
DuqueEGairalRMolinaS, et al. (2020) How the psychology of education contributes to research with a social impact on the education of students with special needs: the case of successful educational actions. Frontiers in Psychology11: 439.
30.
EschenbachCA (2017) Bridging the gap between observational oceanography and users. Ocean Science13(1): 161–173.
31.
EskoTMiettinenR (2019) Scholarly understanding, mediating artefacts and the social impact of research in the educational sciences. Research Evaluation28(4): 295–303.
32.
EskoTTuunainenJ (2019) Achieving the social impact of science: an analysis of public press debate on urban development. Science and Public Policy46(3): 404–414.
33.
FlechaGR (2018) Evaluación del impacto social de la investigación. Revista de Fomento Social: 485–502.
34.
GarcovichDAdobes MartinM (2020) Measuring the social impact of research in paediatric dentistry: an altmetric study. International Journal of Paediatric Dentistry30(1): 66–74.
35.
GómezAElbojCCapllonchM (2013) Beyond action research: the communicative methodology of research. International Review of Qualitative Research6(2): 183–197.
36.
GómezAPadrósMRíosO, et al. (2019). Reaching social impact through communicative methodology. Researching with rather than on vulnerable populations: the Roma case. Frontiers Education4: 9.
37.
HannaCRGattingLPBoydKA, et al. (2020) Evidencing the impact of cancer trials: insights from the 2014 UK research excellence framework. Trials21: 1–13.
38.
HelmingKDiehlKBachH, et al. (2011) Ex ante impact assessment of policies affecting land use, Part A: analytical framework. Ecology and Society16(1): 29.
39.
HillS (2016) Assessing (for) impact: future assessment of the societal impact of research. Palgrave Communications2(1): 1–7.
40.
HolbrookJBFrodemanR (2011) Peer review and the ex ante assessment of societal impacts. Research Evaluation20(3): 239–246.
41.
JamaliHRAlimohammadiD (2015) Blog citations as indicators of the societal impact of research: content analysis of social sciences blogs. International Journal of Knowledge Content Development & Technology5(1): 15–32.
42.
KaleBSiravuriHVAlhooriH, et al.Predicting research that will be cited in policy documents. In Proceedings of the 2017 ACM on Web Science Conference, Troy, NY, USA, 25–28 June 2017, pp. 389–390.
43.
KolahiJKhazaeiS (2018) Altmetric analysis of contemporary dental literature. British Dental Journal225(1): 68–72.
44.
KousisM (1989) Tourism and the family in a rural Cretan community. Annals of Tourism Research16(3): 318–332.
45.
KvamR (2018) Evaluación Del Impacto Social: Integrando Los Aspectos Sociales En Los Proyectos De Desarrollo. Inter-American Development Bank.
46.
LauronenJP (2020) The dilemmas and uncertainties in assessing the societal impact of research. Science and Public Policy47(2): 207–218.
47.
LiDChenHHuiECM, et al. (2014) A methodology for ex-post assessment of social impacts of an affordable housing project. Habitat International43: 32–40.
48.
LimaGDMRWoodT (2014) The social impact of research in business and public administration. Revista de Administração de Empresas54(4): 458–463.
49.
MacombeCLoeilletD (2017) Instruments to assess the social impacts of value chains. In: Sustainable Development and Tropical Agri-chains. Dordrecht: Springer, pp. 257–265.
50.
McCombesLVanclayFEversY (2015) Putting social impact assessment to the test as a method for implementing responsible tourism practice. Environmental Impact Assessment Review55: 156–168.
51.
MilanoCNovelliMCheerJM (2019) Overtourism and degrowth: a social movements perspective. Journal of Sustainable Tourism27(12): 1857–1875.
52.
Molas-GallartJTangP (2011) Tracing ‘productive interactions’ to identify social impacts: an example from the social sciences. Research Evaluation20(3): 219–226.
53.
MuhonenRBenneworthPOlmos-PeñuelaJ (2020) From productive interactions to impact pathways: understanding the key dimensions in developing SSH research societal impact. Research Evaluation29(1): 34–47.
54.
Olmos-PeñuelaJCastro-MartínezEd’EsteP (2014) Knowledge transfer activities in social sciences and humanities: explaining the interactions of research groups with non-academic agents. Research Policy43(4): 696–706.
55.
OzanneJLDavisBMurrayJB, et al. (2017) Assessing the societal impact of research: the relational engagement approach. Journal of Public Policy & Marketing36(1): 1–14.
56.
Pejić BachMPulidoCMSuša VugecD, et al. (2020) Fostering social project impact with twitter: current usage and perspectives. Sustainability12(15): 6290.
57.
PicornellC (2015) Los impactos del turismo. Papers de turisme (11): 65–91.
58.
PulidoCMMaraLCIonescuV, et al. (2020) Social impact of psychological research on well-being shared in social media. Frontiers in Psychology11: 135.
59.
RealeEAvramovDCanhialK, et al. (2018) A review of literature on evaluating the scientific, social and political impact of social sciences and humanities research. Research Evaluation27(4): 298–308
60.
Redondo-SamaGDíez-PalomarJCampdepadrósR, et al. (2020) Communicative methodology: contributions to social impact assessment in psychological research. Frontiers in Psychology11: 286.
61.
SamuelGNDerrickGE (2015) Societal impact evaluation: exploring evaluator perceptions of the characterization of impact under the REF2014. Research Evaluation24(3): 229–241.
62.
SedighiM (2020) Evaluating the impact of research using the altmetrics approach (case study: the field of scientometrics). Global Knowledge, Memory and Communication. in press.
63.
SeetanahB (2011) Assessing the dynamic economic impact of tourism for island economies. Annals of Tourism Research38(1): 291–308.
64.
SIOR (2017) Social Impact Open Repository. Available athttps://sior.ub.edu/(accessed on 1 June 2021).
65.
SivertsenGMeijerI (2020) Normal versus extraordinary societal impact: how to understand, evaluate, and improve research activities in their relations to society?Research Evaluation29(1): 66–70.
66.
SmithR (2001) Measuring the Social Impact of Research: Difficult but Necessary. BMJ.
67.
Sordé MartíTFlechaRRodríguezJA, et al. (2020) Qualitative inquiry: a key element for assessing the social impact of research. Qualitative Inquiry26(8–9): 948–954.
68.
SpaapenJVan DroogeL (2011) Introducing ‘productive interactions’ in social impact assessment. Research Evaluation20(3): 211–218.
69.
TahamtanIBornmannL (2020) Altmetrics and societal impact measurements: match or mismatch? A literature review. El profesional de la información (EPI)29(1): e290102.
70.
TelladoILeporiBMorla-FolchT (2020) WIEGO: communicative daily life stories to assess social impact in the lives of informal workers. Qualitative Inquiry26(8–9): 962–969.
71.
TonettiMS (2019) Leadership in publishing. Journal of Dentistry87: 28–31.
Van den BesselaarPAAFlechaRRadauerA (2018) Monitoring the Impact of EU Framework Programmes. Brussel: European Commission.
74.
Van der WeijdenIVerbreeMVan Den BesselaarP (2012) From bench to bedside: the societal orientation of research leaders: the case of biomedical and health research in the Netherlands. Science and Public Policy39(3): 285–303.
75.
VanclayF (2002) Conceptualising social impacts. Environmental Impact Assessment Review22(3): 183–211.
76.
VanclayFEstevesAMAucampI, et al. (2015) Evaluación de Impacto Social: Lineamientos para la evaluación y gestión de impactos sociales en proyectos (BID, trad.). Fargo, Dakota del Norte: Asociación Internacional para la Evaluación de Impactos.
77.
Viana-LoraANel·lo-AndreuMG (2020) Alternative Metrics for Assessing the Social Impact of Tourism Research. Sustainability12(10): 4299.
78.
Viana-LoraANel·lo-AndreuMG (2021) Approaching the social impact of research through a literature review. International Journal of Qualitative Methods20.
79.
WilsdonJAllenLBelfioreE, et al. (2015) The Metric Tide: Report of the Independent Review of the Role of Metrics in Research Assessment and Management. DOI: 10.13140/RG.2.1.4929.1363
80.
WolfCP (1982) Social impact assessment. Impact Assessment1(1): 9–19.
81.
YenIYKerstetterD (2008) Residents’ view of expected tourism impact, attitude, and behavioral intention. Tourism Analysis13(5–6): 545–564.
