Despite previous research, the field of counter-violent-extremism has not benefited significantly from evaluation. By comparison, and despite a number of challenges, the evidence-based healthcare movement has an established track record of using evaluation to develop practice. We seek lessons from the evidence-based healthcare movement about what it might take to develop evaluation capacity in the emerging field of counter-violent-extremism. Based on this, we offer a framework for measurement in counter-violent-extremism: the ‘Violent Extremism Evaluation Measurement Framework’. We map out states and manifestations associated with violent extremism and radicalisation, then suggest how to measure levels and changes in relevant attributes.
AlonsoRBjørgoTDella PortaDet al. (2008) Radicalisation processes leading to acts of terrorism: A concise report prepared by the European Commission’s expert group on violent radicalisation. Report prepared by the European Commission’s Expert Group on Violent Radicalisation. Brussels: European Commission.
2.
AltemeyerBHunsbergerBE (2004) A revised religious fundamentalism scale: The short and sweet of it. International Journal for the Psychology of Religion14: 47–54.
3.
AmjadNWoodAM (2009) Identifying and changing the normative beliefs about aggression which lead young Muslim adults to join extremist anti-Semitic groups in Pakistan. Aggressive Behavior35: 514–19.
4.
AmpofoLCollisterSO’LoughlinBet al. (2015) Text mining and social media: When quantitative meets qualitative and software meets people. In: HalfpennyPProcterR (eds) Innovations in Digital Research Methods. Thousand Oaks, CA: SAGE.
5.
AndreVHarris-HoganS (2013) Mohamed Merah: From petty criminal to neojihadist politics. Religion and Ideology14: 307–19.
6.
AslamM (2012) Gender-based Explosions: The Nexus Between Muslim Masculinities, Jihadist Islamism and Terrorism. Tokyo: UNU Press.
7.
AverillJR (1983) Studies on anger and aggression: Implications for theories of emotion. American Psychologist38: 1145–60.
8.
BalesRF (1950) Interaction Process Analysis: A Method for the Study of Small Groups. Cambridge: Addison-Wesley Press.
9.
BalesRF (1970) Personality and Interpersonal Behavior. New York: Holt, Rinehart, and Winston.
10.
BambergerM (2000) The evaluation of international development programs: A view from the front. American Journal of Evaluation21: 95–102.
11.
BartlettMSLittlewortGFrankMet al. (2005) Recognizing facial expression: Machine learning and application to spontaneous behavior. 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition2: 568–73.
12.
BeaghleySHelmusTCMatthewsMet al. (2017) Development and Pilot Test of the RAND Program Evaluation Toolkit for Countering Violent Extremism. Santa Monica: RAND Corporation.
13.
BhuiKWarfaNJonesE (2014) Is violent radicalisation associated with poverty, migration, poor self-reported health and common mental disorders?PLoS ONE9: e90718.
14.
BloomM (2012) Bombshell: Women and Terrorism. Philadelphia: University of Pennsylvania Press.
BorumR (2011) Radicalization into violent extremism I: A review of social science theories. Journal of Strategic Security4: 7–36.
17.
BoulianneS (2015) Social media use and participation: A meta-analysis of current research. Information, Communication & Society18: 524–38.
18.
BraunDHutterS (2016) Political trust, extra-representational participation and the openness of political systems. International Political Science Review37: 151–65.
19.
CantorDLynchJP (2000) Self-report surveys as measures of crime and criminal victimization. Criminal Justice4: 85–138.
20.
ChaturvediMChanderR (2010) Development of emotional stability scale. Industrial Psychiatry Journal19: 37.
ClandininDJConnellyFM (2000) Narrative Inquiry: Experience and Story in Qualitative Research. San Francisco, CA: Jossey-Bass Publishers.
23.
DahlbergLLToalSBSwahnMet al. (2005) Measuring Violence-Related Attitudes, Behaviors, and Influences Among Youths: A Compendium of Assessment Tools, 2nd ed.Atlanta, GA: Centers for Disease Control and Prevention.
24.
DaviesMWarnesRHofmanJ (2017) Exploring the transferability and applicability of gang evaluation methodologies to counter-violent radicalisation 2017. Available at: https://www.rand.org/pubs/research_reports/RR2120.html (accessed February 2018).
DerricottRParsellG (1991) Entering a new field: Evaluation in the workplace. Studies in Educational Evaluation17: 341–53.
27.
EagerPW (2016) From Freedom Fighters to Terrorists: Women and Political Violence. London & New York: Routledge.
28.
El-SaidHHarriganJ (2012) Deradicalizing Violent Extremists: Counter-Radicalization and De-Radicalization Programmes and Their Impact in Muslim Majority States. London & New York: Taylor and Francis Ltd.
29.
FeddesARMannLDoosjeB (2015) Increasing self-esteem and empathy to prevent violent radicalization: A longitudinal quantitative evaluation of a resilience training focused on adolescents with a dual identity. Journal of Applied Social Psychology45: 400–11.
30.
GallieWB (1964) Philosophy and the Historical Understanding. London: Chatto & Windus.
31.
GielenAJ (2017) Countering violent extremism: A realist review for assessing what works, for whom, in what circumstances, and how?Terrorism and Political Violence. Epub ahead of print 3 May 2017. DOI: 10.1080/09546553.2017.1313736.
32.
GlasgowRE (2013) What does it mean to be pragmatic? Pragmatic methods, measures, and models to facilitate research translation. Health Education and Behaviour40: 257–65.
33.
GreenhalghTHowickJMaskreyN (2014) Evidence based medicine: A movement in crisis?BMJ348: g3725.
34.
GrossmanMTahiriHStephensonP (2014) Harnessing Resilience Capital: An Investigation of Resilience and Cultural Diversity in Countering Violent Extremism. Canberra: Australia-New Zealand Counter-terrorism Committee.
HarringtonN (2005) The frustration discomfort scale: Development and psychometric properties. Clinical Psychology and Psychotherapy12: 374–87.
37.
HelmusTMatthewsMRamchandRet al. (2017) RAND program evaluation toolkit for countering violent extremism. Available at: https://www.rand.org/pubs/tools/TL243.html (accessed May 2017).
HorganJ (2008) From profiles to pathways and roots to routes: Perspectives from psychology on radicalization into terrorism. The ANNALS of the American Academy of Political and Social Science618: 80–94.
JacquesKTaylorPJ (2009) Female terrorism: A review. Terrorism and Political Violence21: 499–515.
42.
JamesPvan SeetersP (2014) Globalization and Politics, 2: Global Social Movements and Global Civil Society. London: SAGE.
43.
JessorRJessorS (1977) Problem Behavior and Psychosocial Development. New York: Academic Press.
44.
KellyJJNjukiFLanePLet al. (2005) Design of a questionnaire to measure trust in an emergency department. Academic Emergency Medicine12: 147–51.
45.
KessnerDMKalkCE (1973) A Strategy for Evaluating Health Services. Washington, DC: Institute of Medicine (U.S.) Panel on Health Services Research.
46.
KumarKBeyerleinM (1991) Construction and validation of an instrument for measuring ingratiatory behaviors in organizational settings. Journal of Applied Psychology76: 619–27.
47.
LatourB (1993) We Have Never Been Modern. Cambridge, MA: Harvard University Press.
48.
LeeuwFSchmeetsH (2016) Empirical Legal Research: A Guidance Book for Lawyers, Legislators and Regulators. Cheltenham: Edward Elgar Publishing.
49.
MacDonaldE (1991) Shoot the Women First. New York: Random House.
50.
MarmotM (2010) Fair Society, Healthy Lives: The Marmot Review: Strategic Review of Health Inequalities in England Post-2010. London: Institute of Health Equity.
51.
MayCRapleyTMairFSet al. (2015) Normalization Process Theory on-line users manual, toolkit and NoMAD instrument. Available at: http://www.normalizationprocess.org (accessed August 2016).
52.
McCauleyCMoskalenkoS (2008) Mechanisms of political radicalization: Pathways toward terrorism. Terrorism and Political Violence20: 415–33.
53.
NaefMSchuppJ (2009) Measuring trust: Experiments and surveys in contrast and combination IZA DP No. 4087 Forschungsinstitut zur Zukunft der Arbeit. Available at: http://ftp.iza.org/dp4087.pdf (accessed August 2016).
54.
National Consortium for the Study of Terrorism and Responses to Terrorism I-VEO Knowledge Matrix website (undated) Available at: http://start.foxtrotdev.com (accessed January 2018).
55.
NoordegraafMDouglasSBosAet al. (2017) How to evaluate the governance of transboundary problems? Assessing a national counterterrorism strategy. Evaluation23: 389–406.
RamidNStuppertWTeuneS (2012) Protest und Demokratie. Kritik am repräsentativen Regieren und die Entdeckung der Straße durch die GegnerInnen von Stuttgart 21. Berlin: Social Science Research Center.
RonanGFDreerLMaurelliKet al. (2013) Practitioner’s Guide to Empirically Supported Measures of Anger, Aggression, and Violence. Springer.
61.
RosenbergM (1956) Misanthropy and political ideology. American Sociological Review21: 690–5.
62.
RosenbergM (1965) Society and the Adolescent Self-image. Princeton, NJ: Princeton University Press.
63.
SafipourJTessmaMKHigginbottomGet al. (2010) Measuring social alienation in adolescence: Translation and validation of the Jessor and Jessor social alienation scale. Scandinavian Journal of Psychology. 51: 517–24.
64.
SavageSKhanALihtJ (2014) Preventing violent extremism in Kenya through value complexity: Being Kenyan being Muslim. Journal of Strategic Security7(3): 1–26.
65.
SchmidAJongmanP (1984) Political Terrorism: A Research Guide to Concepts, Theories, Data Bases and Literature. Amsterdam: SWIDOC.
66.
SchmidAJongmanP (1988) Political Terrorism: A New Guide to Actors, Authors, Concepts, Data Bases, Theories and Literature. New Brunswick, NJ: Transaction.
67.
ScottJ (2013) Social Network Analysis, 3rd ed.London: SAGE.
SinclairVGWallstonKA (2004) The development and psychometric evaluation of the Brief Resilient Coping Scale. Assessment11: 94–101.
70.
SpielbergerCDReheiserEC (2010) The nature and measurement of anger. In: StemmlerGPotegalMSpielbergerC (eds) International Handbook of Anger. New York: Springer, 403–12.
71.
SteinA (2017) Terror, Love and Brainwashing: Attachment in Cults and Totalitarian Systems. London & New York: Routledge.
SturgisPSmithP (2010) Assessing the validity of generalized trust questions: What kind of trust are we measuring?International Journal of Public Opinion Research22: 74–92.
74.
ThomasJLBondKD (2015) Women’s participation in violent political organizations. American Political Science Review109: 488–506.
van HemertDAvan den BergHvanVlietTet al. (2014) Innovative method and procedure to assess counter-violent-radicalisation techniques in Europe: Synthesis report on the state-of-the-art in evaluating the effectiveness of counter-violent extremism interventions. EU Consortium IMPACT Europe. Available at: http://impacteurope.eu/portfolio/synthesis-report/ (accessed August 2016).
77.
WatsonDClarkLATellegenA (1988) Development and validation of brief measures of positive and negative affect: The PANAS Scales. Journal of Personality and Social Psychology54: 1063–70.
78.
WeickKE (2005) Organizing and failures of imagination. International Public Management Journal8: 425–38.
79.
WilliamsDRYuYJacksonJSet al. (1997) Racial differences in physical and mental health: Socioeconomic status, stress, and discrimination. Journal of Health Psychology2: 335–51.
