Field studies provide much ecological validity but are limited with regard to randomization and control. What can be and what is done about it? Because so few psychologists do field experiments, little is known about it. In our reply to Wicherts and Bakker (in press), we show what goes on behind the scene in doing field research, and we discuss the importance of cumulative results by inclusive replications that cover strict replications, but also replications in different settings, using different paradigms.
BurkleyM.BlantonH. (2008). The dilemmatics approach to applied research design: A case study of violent video game effects and aggression. In StegL.BuunkB.RothengatterT. (Eds.). Applied social psychology: Understanding and managing social problems (pp. 87–116). Cambridge, UK: Cambridge University Press.
2.
CialdiniR. B. (2009). We have to break up. Perspectives on Psychological Science, 4, 5–6. doi:10.1111/j.1745-6924.2009.01091.x
3.
CialdiniR. B.RenoR. R.KallgrenC. A. (1990). A focus theory of normative conduct: Recycling the concept of norms to reduce littering in public places. Journal of Personality and Social Psychology, 58(6), 1015–1026. doi:10.1037/0022-3514.58.6.1015
4.
KeizerK.LindenbergS.StegL. (2008). The spreading of disorder. Science, 322, 1681–1685. doi:10.1126/science.1161405
5.
KeizerK.LindenbergS.StegL. (2011). The reversal effects of prohibition signs. Group Processes & Intergroup Relations, 14(5), 681–688. doi:10.1177/1368430211398505
6.
KeizerK.LindenbergS.StegL. (2013). The importance of demonstratively restoring order. PLoS ONE, 8(6), e65137. doi:10.1371/journal.pone.0065137
7.
LindenbergS.StegL. (2007). Normative, gain and hedonic goal frames guiding environmental behavior. Journal of Social Issues, 63(1), 117–137. doi:10.1111/j.1540-4560.2007.00499.x
8.
McGrathJ. E. (1982). Dilemmatics: The study of research choices and dilemmas. In McGrathJ. E.MartinJ.KulkaR. A. (Eds.), Judgment calls in research (pp. 69–102). Beverly Hills, CA: Sage.
9.
RamosJ.TorglerB. (2012). Are academics messy? Testing the broken windows theory with a field experiment in the work environment. Review of Law & Economics, 8(3), 563–577. doi:10.1515/1555–5879.1617
10.
ReiterS. M.SamuelW. (1980). Littering as a function of prior litter and the presence or absence of prohibitive signs. Journal of Applied Social Psychology, 10, 45–55. doi:10.1111/j.1559–1816.1980.tb00692.x
11.
TorglerB. (2010). Comment on “The Spreading of Disorder.”Economics Bulletin, 30(1), 519–523.
12.
WichertsJ.BakkerM. (in press). Broken windows, mediocre methods, and substandard statistics. Group Processes & Intergroup Relations.
13.
WilsonJ. Q.KellingG. L. (1982, March). Broken windows. The Atlantic Monthly, 29–38.
