We tested 44 variations in profiles of climate change activists to see what affected willingness to associate with them. The largest effects were from activists’ perspectives on climate change, how often they pressure others, gun control views, and party affiliation. If implemented as a traditional factorial experiment, this experiment would require 648,000 conditions and an infeasibly large sample. We obtained our results much more efficiently via an experimental design rare in communication research. Conjoint experiments will be useful to science communication researchers who wish to simultaneously test many factors of complex stimuli, such as individuals, organizations, technologies, or policies.
BansakK.HainmuellerJ.HopkinsD. J.YamamotoT. (2018). The number of choice tasks and survey satisficing in conjoint experiments. Political Analysis, 26, 112-119.
BashirN. Y.LockwoodP.ChasteenA. L.NadolnyD.NoyesI. (2013). The ironic impact of activists: Negative stereotypes reduce social change influence. European Journal of Social Psychology, 43, 614-626.
4.
BechtelM. M.ScheveK. F. (2013). Mass support for global climate agreements depends on institutional design. Proceedings of the National Academy of Sciences of the United States of America, 110, 13763-13768.
BullockJ. G.GreenD. P.HaS. E. (2010). Yes, but what’s the mechanism? (don’t expect an easy answer). Journal of Personality and Social Psychology, 98, 550-558.
7.
DafoeA.ZhangB.CaugheyD. (2018). Information equivalence in survey experiments. Political Analysis, 26, 399-416.
8.
FeinbergM.WillerR.KovacheffC. (2017). Extreme protest tactics reduce popular support for social movements (Working Paper No. 2911177). Toronto, Ontario, Canada: Rotman School of Management. doi:10.2139/ssrn.2911177
9.
FiskeS. T.DupreeC. (2014). Gaining trust as well as respect in communicating to motivated audiences about science topics. Proceedings of the National Academy of Sciences of the United States of America, 111(Suppl. 4), 13593-13597.
10.
FiskeS. T.LinM.NeubergS. (1999). The continuum model. In ChaikenS.TropeY. (Eds.), Dual-process theories in social psychology (pp. 321-254). New York, NY: Guilford.
11.
GrossmannM. (2012). The not-so-special interests: Interest groups, public representation, and American governance. Stanford, CA: Stanford University Press.
12.
HainmuellerJ.HangartnerD.YamamotoT. (2015). Validating vignette and conjoint survey experiments against real-world behavior. Proceedings of the National Academy of Sciences of the United States of America, 112, 2395-2400.
13.
HainmuellerJ.HopkinsD. J. (2015). The hidden American immigration consensus: A conjoint analysis of attitudes toward immigrants. American Journal of Political Science, 59, 529-548.
14.
HainmuellerJ.HopkinsD. J.YamamotoT. (2014). Causal inference in conjoint analysis: Understanding multidimensional choices via stated preference experiments. Political Analysis, 22, 1-30.
15.
IyengarS.WestwoodS. J. (2015). Fear and loathing across party lines: New evidence on group polarization. American Journal of Political Science, 59, 690-707.
16.
KlasA.ZinkiewiczL.ZhouJ.ClarkeE. J. (2018). “Not all environmentalists are like that . . .”: Unpacking the negative and positive beliefs and perceptions of environmentalists. Environmental Communication. Advance online publication. doi:10.1080/17524032.2018.1488755
17.
KnudsenE.JohannessonM. P. (2018). Beyond the limits of survey experiments: How conjoint designs advance causal inference in political communication research. Political Communication. Advance online publication. doi:10.1080/10584609.2018.1493009
18.
LelkesY. (2019). Policy over party: Comparing the effects of candidate ideology and party on affective polarization. Forthcoming, Political Science Research and Methods.
19.
LongM.SteinkeJ.ApplegateB.Knight LapinskiM.JohnsonM. J.GhoshS. (2010). Portrayals of male and female scientists in television programs popular among middle school-age children. Science Communication, 32, 356-382.
20.
MasonL. (2018). Uncivil agreement: How politics became our identity. Chicago, IL: University of Chicago Press.
21.
MerkleyE.StecułaD. A. (2018). Party elites or manufactured doubt? The informational context of climate change polarization. Science Communication, 40, 258-274.
MontoyaR. M.HortonR. S. (2004). On the importance of cognitive evaluation as a determinant of interpersonal attraction. Journal of Personality and Social Psychology, 86, 696-712.
24.
MottaM. (2018). The polarizing effect of the March for Science on attitudes toward scientists. PS: Political Science & Politics, 51, 782-788.
25.
MyersT.KotcherJ.CookJ.BeallL.MaibachE. (2018, April). March for Science 2017: A survey of participants and followers. Fairfax, VA: George Mason University Center for Climate Change Communication.
26.
O’KeefeD. J. (2003). Message properties, mediating states, and manipulation checks: Claims, evidence, and data analysis in experimental persuasive message effects research. Communication Theory, 13, 251-274.
RossA. D.StrumingerR.WinkingJ.Wedemeyer-StrombelK. R. (2018). Science as a public good: Findings from a survey of March for Science participants. Science Communication, 40, 228-245.
32.
ScheufeleD. A. (2011). Modern citizenship or policy dead end? Evaluating the need for public participation in science policy making, and why public meetings may not be the answer (Paper No. R-34, Joan Shorenstein Center on the Press, Politics and Public Policy Research Paper Series). Retrieved from https://shorensteincenter.org/modern-citizenship-or-policy-dead-end-dietram-scheufele/
33.
SedikidesC.GreggA. P. (2008). Self-enhancement: Food for thought. Perspectives on Psychological Science, 3, 102-116.
34.
SkurkaC.NiederdeppeJ.Romero-CanyasR.AcupD. (2018). Pathways of influence in emotional appeals: Benefits and tradeoffs of using fear or humor to promote climate change-related intentions and risk perceptions. Journal of Communication, 68, 169-193.
35.
SlaterD. M.PeterJ.ValkenburgP. M. (2015). Message variability and heterogeneity: A core challenge for communication research. Annals of the International Communication Association, 39, 3-31.
36.
SobierajS. (2011). Soundbitten: The perils of media-centered political activism. New York: NYU Press.
37.
StuartA.ThomasE. F.DonaghueN. (2018). “I don’t really want to be associated with the self-righteous left extreme”: Disincentives to participation in collective action. Journal of Social and Political Psychology, 6, 242-270.
Van TilburgW. A. P.IgouE. R. (2014). From Van Gogh to Lady Gaga: Artist eccentricity increases perceived artistic skill and art appreciation. European Journal of Social Psychology, 44, 93-103.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
