Abstract
We propose the use of discussion structures as tools for analyzing policy debates in a way that enables the increased participation of lay stakeholders. Discussion structures are argumentation-theoretical tools that can be employed to tackle three barriers that separate lay stakeholders from policy debates: difficulty, magnitude, and complexity. We exemplify the use of these tools on a debate in research policy on the question of responsibility. By making use of discussion structures, we focus on the argumentative moves performed by the parties involved in this debate. We conclude by discussing advantages and limitations of discussion structures and we trace several opportunities for further research on these instruments.
Keywords
1. Introduction
A wide variety of methods have been developed for engaging the public in science and policy (Fishkin, 2011; Rowe and Frewer, 2005; Ryfe, 2002; Selin et al., 2017). These methods share the challenge of finding ways to translate the knowledge that each group brings to the proverbial round table. Famously difficult is the translation of scientific discourse to lay stakeholders (Irwin and Wynne, 2003). Indeed, the question of how science should interact with its publics has been one of the central themes in the field of public engagement since its early days (Bohman, 1996; Burgess, 2014; Eden, 1996; Irwin, 1995).
Yet scientific discourse is to an important extent
It is plausible, then, that the field of public engagement has a lot to gain from insights stemming from argumentation theory (see van Eemeren et al., 2014). Public engagement in science and policy can be enriched by employing tools that are designed to make sense of complex argumentative discourse of the kind we often find in science. Conversely, argumentation theory can benefit from closer inquiry into the use of their main product—analyses of argumentation—in real-life. In this article, we want to help trigger the cross-fertilization between these two fields by illustrating the utility of such an effort within a contemporary debate. Employing insights from argumentation theory, particularly the pragma-dialectical approach of van Eemeren and Snoeck Henkemans (2016), we will show how
As a case in point, we analyze a policy discussion recently gaining much attention in Europe: responsible research and innovation (RRI). Since the early 2000s, researchers, policy makers, and other stakeholders have been interested in the question of scientists’ responsibility. RRI has been proposed as a framework to achieve this responsibility and the development of RRI has taken place between related fields such as technology assessment, public understanding of science, responsible innovation and science studies. But why do we need
Our plan is as follows: In
2. Argumentative discussions, their reconstruction and visualization
Argumentative discussions
Since we are focusing on the reconstruction of debates and debates are argumentative exchanges, we will start by taking a closer look at argumentative exchanges. An argumentative exchange is a form of communicative interaction that is triggered by an explicit or implicit difference of opinion (van Eemeren and Grootendorst, 2004). A difference of opinion is a relationship between two discussants in which one discussant holds a positive standpoint with regard to a statement
Having discovered that they are not in agreement regarding the acceptability of
Among the many types of speech acts that are performed during such an exchange, one is particularly important: that of explicitizing the reasons one holds in support of, or against,
Let us make all this more concrete by giving an example of an argumentative exchange:
Can we go to restaurant A tonight?
Why not B?
A is cheaper
But B is closer!
The example above illustrates a difference of opinion on the “policy issue” of going to a restaurant. The speech acts performed by Maria and John are directed toward clarifying their difference of opinion, that is, understanding what reasons each party has to support their standpoint. Pre-theoretically, we can also intuit that those discussion moves are linked in a structured way—2 is some form of attack on 1, 3 is some form of defense of 1, and 4 is some form of attack on 3. In order to make these intuitions more precise and to represent the structure in question, we can employ tools from argumentation theory.
Reconstructing argumentative discussions
In the example above, John and Maria carried out their argumentative discussion without being explicit about the argumentative function of their moves (i.e. whether a contribution is an argument, counter-argument, standpoint, concession etc.). For example, John’s reaction to Maria’s proposal is a counter-argument, which is a type of assertive, but it is formulated as a question, which is a type of directive (Searle, 1975). In order to extract this argumentative function and understand what kind of moves are performed, an
The process of reconstructing argumentative discussions is an iterative one: the analyst goes back and forth between the text under analysis and context in which the text was produced (Popa, 2016). Since this process is dependent on the particularities of the data under analysis, it is very difficult, if not impossible, to write down “reconstruction procedures” (van Eemeren and Garssen, 2016; van Eemeren and Snoeck Henkemans, 2016). Beyond establishing the text as a point of departure, we can also list the kind of insights that can be employed during the reconstruction as follows: (1) syntax, semantics, and pragmatics of the language; (2) institutional context in which the exchange takes place (legal, political, commercial etc.); (3) previous interactions between the actors within the same context; (4) the distinct event in which the interaction took place (convention, meeting, anniversary etc.); (5) goals that can be ascribed to the discussants; (6) argumentative strategies we can ascribe to discussants.
Policy discussions of the kind we will be addressing are thus more complex than the imaginary Maria–John exchange we introduced. As pieces of scientific and political discourse, they are institutionally embedded in highly conventionalized practices (academic writing, legal writing, political commentary etc.). By deploying the aforementioned resources (1–6), the analyst can extract these policy discussions from their context and present them in a way that is accessible to the general public. This presentation is further discussed in the next section.
Visualizing a reconstruction
Traditionally, reconstruction of argumentative texts leads to a tree-like structure underneath the main standpoint. Such representations are called “argument schemes” (Walton, 2013), “argument diagrams” (Peldszus and Stede, 2013), “argumentation structures” (Snoeck Henkemans, 2000). Other visualizations seek to represent not just one party’s viewpoint but both sides of the discussion using “discussion structures” (Popa, 2016). Each tool has its advantages and disadvantages, and it is not the purpose of this article to rank them. We choose
In our approach, a discussion structure is built out of three simple types of moves: arguments, counter-arguments, and rebuttals, illustrated in Figure 1 above in the three segments respectively. We use the restaurant example to illustrate:
An
A
A

Basic combinations and associated labels.
In argumentation analysis, labeling contributions with numbers once they have been reconstructed is a standard practice undertaken in most approaches (Snoeck Henkemans, 2000). The advantage of labeling statements is twofold. First, it removes the need to mention the content of the statements in referring to statements. Participants can refer to “11-white” and “111-black” as opposed to “the argument about x being the case” or “when A said that B is wrong because such and such.” Second, the numbering is an indication of
An
A
A
Next, we will exemplify the use of these tools by looking at a real-life example of a policy debate—specifically, the debate in the field of research policy on the responsibility of stakeholders engaged in R&D.
3. Case in point: Reconstructing the RRI discussion
The RRI discussion
In this section, we will reconstruct the (research-)policy discussion around the idea of responsibility. The discussion can best be captured by the following question: How can research and innovation be made more responsible toward society? Since the early 2000s, a framework known as “Responsible Research and Innovation” (RRI) has been proposed as an answer to the aforementioned question. This proposed answer has been increasingly discussed in academic circles (Asveld, 2017; Grunwald, 2011; Koops et al., 2015; Nielsen, 2016; Owen et al., 2012; Rip, 2014). The phrase RRI “has become increasingly fashionable” (Owen et al., 2013b: 39) and “catapulted from an obscure phrase to an issue in the European Commission’s Horizon 2020 Program” (Rip, 2014: 2).
The central claim in this movement is that research and innovation need to be more responsible, that is, more inclusive and more responsive to societal challenges (Owen et al., 2013b). While this claim is acceptable, it does seem to be immunized against critique, for who would hold
Nevertheless citizens, policy makers, businesses, associations, and the media might stubbornly ask: why should research and innovation be stirred in this direction (Timmermans and Blok, 2018)? What are the reasons for and against such a policy? Delving into the body of academic literature, lay stakeholders will encounter the three barriers mentioned in the introduction (difficulty, magnitude, and complexity).
First, regarding the
Second, regarding the magnitude of the task, finding answers to the “Why so responsible?” question would involve plowing through a sizable literature. The RRI story started before the term “RRI” with the beginnings of STS and technology assessment; additionally, the movement has grown exponentially since RRI’s adoption at a European policy level (Burget et al., 2017). To give only one example, the paper
Third, the discussion on RRI has not proceeded in an orderly fashion and as many as four different conceptions can be distinguished behind the label, each with its own paradigmatic assumptions (Timmermans and Blok, 2018).
In what follows, we illustrate how discussion structures can be employed to reconstruct the RRI discussion so as to address the three issues mentioned above. To this end, we analyze the following academic works on the subject:
Jonas’ (1984)
Douglas’ (2003)
Fiorino’s (1990)
Blok and Lemmens’ (2015)
These texts have been chosen because of their involvement in the debate around RRI. They tackle the question we formulated above: “Why so responsible?.” We are not claiming that the arguments advanced in these works are advanced frequently or that they are the most acceptable (or the most accepted nowadays). Our selection was made based on these criteria: the four works are often employed in the RRI literature, they have been advanced at different junctures in the RRI history, and they are diverse enough to serve our illustrative goals. We should note that we are already outside the realm of what lay stakeholders can be expected to do by themselves. In making this selection, the analyst is already engaged in reconstructing the discussion by reducing it to four (more or less representative) focal points. This point will be discussed further in the section
Hans Jonas
Hans Jonas’ 1984 book
It is well known that the “argument from apocalypse” is not Jonas’ strongest line of defense (Cosans, 2016; Groves and Adam, 2011).
2
He therefore opens a second line by an appeal to our moral duty. This line of defense is more appropriate for an ethicist, he claims, and indeed is referred to in the subtitle of his book: “In Search of
At this point in
The discussion as summarized here is represented in Figure 2. In selecting these arguments, we have left aside some of the deeper philosophical discussions opened by Jonas, but these can, if needed, be added to complete the discussion structure. 4

Jonas’ discussion on responsibility.
Heather Douglas
Heather Douglas is a philosopher of science best known for her works on the interplay between science, values, and policymaking (Douglas, 2000, 2009). For the present purposes, we will focus on a paper that is often cited as a philosophical contribution to the RRI literature: her 2003 paper entitled
Let us start with the defense of scientists’ autonomy (i.e. the moves made by Douglas’ opponents). According to some arguments originating in the 1940s, scientists need considerable autonomy to develop their creativity and sustain the innovation process (Douglas, 2003: 60). Proponents claim that external restrictions such as those imposed by the call for responsibility are a handicap to innovation.
Douglas’ response runs as follows:
First, she points out that scientists already accept the hampering of science by moral values. In defense of this claim she brings the example of experimentation on living subjects. Concretely, although it would greatly improve the speed of the discovery trajectory to be able to subject, for example, new born babies to toxicity tests, it is unanimously accepted that such improvements are not worth its risk (p. 64).
Second, Douglas discusses the claim that the consideration of societal consequences falls outside the scope of science
Third, in refusing to subject their work to social norms of responsibility, scientists are in fact running the risk of
Douglas’ arguments for responsibility are represented in Figure 3.

Douglas’ arguments for responsibility.
Integrating two accounts into one structure
In this last example, we want to show how contributions to the discussions from different works can be combined. For this purpose, we will focus on a specific aspect of RRI, namely stakeholder inclusion (Owen et al., 2013b: 1571). Although stakeholder inclusion is but one aspect of RRI, this aspect has been referred to as “the conceptual dimension that characterizes RRI the most” (Burget et al., 2017: 10). Furthermore, a much-employed definition of responsible science describes it as a process in which “societal actors and innovators become mutually responsive to each other” (Owen et al., 2013a), meaning that these actors are thereby included in the process of research and development.
The call for inclusion is typically defended with three arguments, dubbed the
Starting with Fiorino (1990), we notice that his account is built as a defense against the freedom argument, according to which experts need not be checked by society since experts “will make more rational decisions” while other stakeholders lack “the time, information and inclination to take part in technically based problems” (p. 227). Fiorino advances the three arguments as follows:
The
The
The
Turning to the contribution of Blok and Lemmens (2015), we first notice that the authors construct their defense without using Fiorino’s threefold distinction between substantive, normative, and instrumental. Rather, they organize their attack as follows: they divide their critique according to the stage of the R&D process to which the call for responsibility pertains, namely the
When the input of the R&D process is a complex problem (a “grand challenge”), it is questionable whether RRI is even possible because “there is no consensus about the scope of the grand challenges and the goal of the innovation process among stakeholder” (Blok and Lemmens, 2015: 23). 6 Specifically, the responsiveness toward stakeholders and their inclusion in the R&D process is impossible because fundamental differences and conflicts that are associated with grand challenges. Given these fundamental differences, then, the authors ask whether the stakeholder involvement urged by the RRI literature is even possible.
Concerning the throughput of the R&D process, it is questionable whether RRI is desirable to stakeholders. This is because, through collaboration, stakeholders minimize their advantage of
Concerning the output of the R&D process, it is questionable whether “stakeholder involvement may result in more desirable outcomes, the involvement of stakeholders doesn’t necessarily guarantee a more responsible output of the innovation process” (Blok and Lemmens, 2015: 26). The authors give the example of biofuels which had negative effects (increased food prices) even though stakeholders from many sectors participated in their development. Thus, since the outcome of innovation is essentially unpredictable, stakeholder involvement may, against all predictions, result in
If we seek to elucidate the interaction between the two accounts, we need to find arguments that are

Fiorino versus Blok & Lemmens.
4. Using structures as participation tools
In this section, we exemplify the use of reconstructed discussions for engagement exercises. We do not wish to suggest that this is the
Step 1: Using the structure for a walking exercise
In this exercise, the discussion structure is placed at the center of the group and employed as a point of departure for various types of interventions. Before the dialogue, the discussion structure is created based on available literature and inter-subjectively checked by stakeholders for accuracy and fair representation of arguments. The resulting structure is placed on a poster around which a small group (7–12 people) takes a seat. This constitutes the stating position.
When signaled, participants begin to switch sides by walking from one side of the discussion to the other. Walking from one side to the other for several minutes, stakeholders make sure they understand the text given on the poster and prepare 1–2 questions. Participants are asked to prepare both descriptive questions and normative questions. Descriptive questions pertain to assumed matters of fact (What is the case? Who does what? How many?); normative questions pertain to matters of value (What is best? Who should do what? Which principle is more important? What rights are relevant?). These questions are not meant to be answered right away. Rather, they are placed on a common surface as a preparatory step to moving forward. Throughout this time, the participants are allowed to keep walking. After all the questions have been marked, participants sit down to answer the informative questions.
The objective of such an exercise is to give participants the chance to express off-the-bat thoughts on the represented discussion. Moreover, walking is a cooperative activity but at the same time it creates a disruptive dynamics in which the environment is, more or less literally, not yet set. The walking exercise can be employed as a preliminary exercise to various forms of subsequent dialogues. Two such continuations are given in what follows.
Step 2: Co-constructing the discussion
Having elicited reactions to a discussion structure via the walking exercises, stakeholders can now participate in the discussion by co-constructing it: they can add new arguments, counter-arguments, and rebuttals. The co-construction of the discussion runs in cycles and each new cycle starts with the person who spoke last in the previous cycle (so that the advantage of seeing what others are adding/deleting is balanced out). Notice that stakeholders cannot flat-out
Step 3: Co-constructing the meta-discussion
Having engaged with the discussion, we can expect participants to be better equipped to engage with the meta-discussion, that is, the discussion about the rules, rights, and obligations that govern the discussion (Finocchiaro, 2007). In the meta-discussion, we can ask questions that refer to these elements: Who has power to settle this discussion? What code of conduct is needed for making reasonable discussion moves? What are the uncertain/implicit risks concerning the result of this discussion. The literature on rhetorical citizenship (Kock and Villadsen, 2012) can provide insights into the kind of topics that might be relevant for the meta-discussion. Also, given that these meta-discussions would touch upon the system embedding of the policy/issue in question, system-analytical perspective such as the multi-level system perspective (Geels, 2006) can be employed to “zoom out” after the discussion, and tackle more abstract or general issues. For example, in the case of RRI, stakeholders can stop and discuss
5. Discussion
The RRI discussion reopened: The three barriers
The present endeavor started with the identification of three barriers for public participation in science and policy: difficulty, magnitude, and complexity. RRI functioned as a case in point. Although discussion structures do not solve every aspect arising from these barriers, they constitute an important step in the right direction.
Discussion structures address the problem of difficulty because the text in the source is translated in a non-technical language before it is inserted in the structure. Thus, if Jonas’ book is virtually intangible given its complex language, the discussion structure that summarizes its main arguments is comprehensible within minutes. It goes without saying that some nuance is lost in this translation process, but we would argue that nuance is not always relevant, at least not from the very beginning. More subtle distinctions can always be introduced later in the participation process (see Further developments below). For example, nuance does seem to be needed in the case of the “argument from apocalypse”: hazards come in various shapes and sizes and thus the appeal to apocalypse (roughly, “If irresponsibility, then apocalypse”) might need some hedging. These are issues that can be brought in later in the participation process and do not interfere with the gist of Jonas’ pragmatic argumentation from risks: we need to be more responsible because otherwise we will destroy the planet and ourselves. Our intuition tells us that, in the trade-off between participation in a somewhat simplified discussion, on the one hand, and lack of participation, on the other hand, the former can be preferred since nuance can be introduced during the participation process if it becomes relevant.
Discussion structures address the problem of magnitude because the analyst is forced to compress the discussion and focus on the
Finally, discussion structures solve the problem of complexity because they leave aside deviations, side-tracks, tangents, repetitions, and all other “anomalies” that are normal in scientific discourse and yet irrelevant for capturing the gist of the argumentative exchange. Going through a discussion structure, the reader follows the discussion from the highest level (main difference of opinion white1 vs black1) to the lowest levels and can do so using the text accompanying the structures. Also, in working with discussion structure, one can pick up a discussion from where others have left it, avoiding talking past each other and adding to the problem of complexity.
What have we gained from looking at the “why-so-responsible” debate through argumentation-theoretical lenses?
First, we have re-focused analytical attention on the Few would disagree that science and innovation should be undertaken responsibly. “Responsible innovation” intuitively feels right in sentiment, as an ideal or aspiration. It has positive, constructive overtones, where science and innovation are directed at, and undertaken towards, socially desirable and socially acceptable ends, with connotations of trust and integrity. However, in reality, it lacks definition and clarity, both in concept and practice: What might it involve? Who might it involve? When might it be applied? (Owen et al., 2013a: 27)
Phrases such as “few would disagree,” “intuitively feels right,” “positive,” “constructive”, and “socially desirable” are discussion stoppers. They bypass the
Second, we have reconstructed a complex discussion in research policy in such a way that laypersons can understand and participate it. Each main argument divides the discussion into what might be called issue: for Jonas there is the practical issue of responsibility (being irresponsible brings about unwanted effects), and the moral issue of responsibility (being responsible is a moral imperative); for Douglas, there is the issue of responsibility versus freedom (how do we maintain inventiveness if responsibility curbs innovation); and in the Fiorino versus Blok & Lemmens interaction we see a repetition of the practical and moral issues but with more “push back” from the negative side (is extra responsibility really practical?). Much needs to be said on these issues, and many sub-arguments can be discussed, but what is said here can be more systematically “placed” within the respective areas of the discussion represented by the aforementioned issues. In this way, we can organize the discussion more clearly by identifying, for example, unvisited issues, issues on which there is too much repetition of known arguments, issues on which the discussion is too shallow or too deep and so on. In short, the systematization of the debate up to a certain point allows for a more systematic continuation of that debate.
Further developments
In this section, we want to address several aspects of discussion structure that can be developed in further research.
First, the risk of framing needs to be addressed. Since discussion structures are created by experts who have a bird’s-eye view of the topic under analysis, they might engender a framing of the discussion in a way that is more advantageous for some stakeholder groups. The issue of framing-by-experts is a known theme in the literature on public participation (Andy, 2008; Goven, 2006) and since experts are needed in our case to analyze the existing policy issue and extract the discussion moves from the source, a significant degree of framing and agenda setting conceivably could occur. The risk of framing cannot be fully avoided, but it can be minimized by employing
Second, steps to avoid stakeholder self-selection can be developed. Working with discussion requires a set of skills (understanding the structure, co-constructing the structure) and might therefore lead to a self-selection of those A-type members of society that are proficient with those skills. It has been claimed, along these lines, that “the emphasis within the theory of participation and deliberation on discourse, reasoned argument and consensus-building can itself be undemocratic” (Davies, 2016: 167). Would discussion structures, with their emphasis on argumentation (“reasoned argument”) open the way exclusively for those at ease in this practice? Prophylactic steps can be taken. Discussion structures can be deployed in a variety of interactions and need not monopolize the discussion or turn it invariably into a debate. After all, we can discuss a debate without debating. In this sense, the third step in the proposed discussion procedure is not even directly about the discussion moves themselves but rather seeks to access the meta-themes that are made relevant by those moves (power, fairness, ideology, fears etc.) We can imagine an implementation of the proposed discussion procedure in which, during Step 3, one is deterred from pressing the issue further and asked to merely bring about themes for reflection. This part need not be argumentative at all.
Third, the use of discussion structures in public deliberation methods needs empirical validation. Here we have undertaken the task of explaining the tool and illustrating its use, but the proof of the pudding is in the eating. A more systematic empirical investigation of the advantages and pitfalls of using discussion structures is needed in order to understand how the instrument can further be developed and improved.
6. Conclusion
The translation of scientific discourse for lay stakeholders has been a constant theme in the field of public understanding of science. Since scientific discourse has predominantly an argumentative function, we see benefits from cross-fertilization between the fields of public understanding of science and argumentation theory. Public engagement in science and policy can be further enriched by considering public engagement with/in scientific
Footnotes
Funding
The author(s) received no financial support for the research, authorship, and/or publication of this article.
