The authors conducted an experiment with a group of military officers and replicated it with a group of students at a public university in the United States. The experimental scenario dealt with a decision problem in the area of counterterrorism. The authors found that while more than one-third of students recommended doing nothing, the overwhelming majority of military officers (more than 90 percent) recommended doing something. Also, military officers exhibited less maximizing and more satisfacing decision making than students. The results show that relying on experiments with students “playing” the role of real-world national security policy makers may bias the results. The two groups are, in fact, very different. Based on student samples, it is possible to accept propositions that would not be found with samples of elite decision makers and reject propositions that may be right. However, it is possible that students can be assigned to experiments where they represent the “public” and not elites.
Aronson, Elliot, and J. Merrill Carlsmith. 1968. Experimentation and social psychology. In The handbook of social psychology, edited by Gardner Lindzey and Elliot Aronson. Reading, MA: Addison-Wesley.
2.
Astorino-Courtois, Allison. 1996. Transforming international agreements into national realities: Marketing Arab-Israeli peace in Jordan. Journal of Politics58: 1035-1054.
3.
Astorino-Courtois, Allison. 2000. The effects of stakes and threat on foreign policy decision-making. Political Psychology21: 489-510.
4.
Billings, Robert S., and Lisa L. Scherer. 1988. The effects of response mode and importance on decision-making strategies: Judgment versus choice. Organizational Behavior and Human Decision Processes41: 1-19.
5.
Ford, J. Kevin, Neal Schmitt, Susan L. Schechtman, Brian M. Hults, and Mary L. Doherty. 1989. Process tracing methods: Contributions, problems, and neglected research questions. Organizational Behavior and Human Decision Processes43: 75-117.
6.
Forsythe, Robert, Forrest Nelson, George R. Neumann, and Jack Wright. 1992. Anatomy of an experimental political stock market. American Economic Review82: 1142-1161.
7.
Frisch, Deborah. 1993. Reasons for framing effects. Organizational Behavior and Human Decision Processes54: 399-429.
8.
George, Alexander L., and Andrew Bennett. 2005. Case studies and theory development in the social sciences. Cambridge, MA: MIT Press.
9.
Green, Donald P., and Alan S. Gerber. 2002. Reclaiming the experimental tradition in political science. In Political science: The state of the discipline, 3rd ed., edited by Helen V. Milner and Ira Katznelson. New York: W. W. Norton.
10.
Iyengar, Shanto. 2000. Experimental designs for political communication research: From shopping malls to the Internet. Paper presented at the Experimental Methods Conference, May 11-12, Cambridge, MA.
11.
James, Patrick, and John R. Oneal. 1991. The influence of domestic and international politics on the president’s use of force. Journal of Conflict Resolution35: 307-332.
12.
Johnson, Mitzi M. S., and Ellen D. B. Riggle. 1994. Age-related differences in processing information for attitude-laden decisions. Paper presented at the Cognitive Aging Conference, April, Atlanta, GA.
13.
Khong, Yuen Foong. 1992. Analogies at war: Korea, Munich, Dien Bien Phu, and the Vietnam decisions of 1965. Princeton, NJ: Princeton University Press.
14.
Kinder, Donald R., and Thomas R. Palfrey. 1993. On behalf of an experimental political science. In Experimental foundations of political science, edited by Donald R. Kinder and Thomas R. Palfrey. Ann Arbor: University of Michigan Press.
15.
Kuklinski, James H., Paul M. Sniderman, Kathleen Knight, Thomas Piazza, Philip E. Tetlock, Gordon R. Lawrence, and Barbara Mellers. 1997. Racial prejudice and attitudes toward affirmative action. American Journal of Political Science41: 402-419.
16.
Larson, Deborah Welch. 1985. Origins of containment: A psychological explanation. Princeton, NJ: Princeton University Press.
17.
Lau, Richard R.1995. Information search during an election campaign: Introducing a processing-tracing methodology for political scientists. In Political judgment, edited by Milton Lodge and Kathleen M. McGraw. Ann Arbor: University of Michigan Press.
18.
Lau, Richard R., David O. Sears, and Richard Centers. 1979. The “positivity bias” in evaluations of public figures: Evidence against the instrument artifacts. Public Opinion Quarterly43: 347-358.
19.
McDermott, Rose. 2002a. Experimental methodology in political science. Political Analysis10: 325-342.
20.
McDermott, Rose. 2002b. Experimental methods in political science. Annual Review of Political Science5: 31-61.
21.
McDermott, Rose, and Jonathan Cowden. 2001. The effects of sex and uncertainty in a crisis simulation game. International Interactions27: 353-380.
22.
Mintz, Alex. 2004a. Foreign policy decision making in familiar and unfamiliar settings: An experimental study of high-ranking military officers. Journal of Conflict Resolution48: 91-104.
23.
Mintz, Alex. 2004b. How do leaders make decisions? A poliheuristic perspective. Journal of Conflict Resolution48: 3-13.
24.
Mintz, Alex, and Nehemia Geva. 1997. The poliheuristic theory of foreign policy decision-making. In Decisionmaking on war and peace: The cognitive rational debate, edited by Nehemia Geva and Alex Mintz. Boulder, CO: Lynne Rienner.
25.
Mintz, Alex, and Nehemia Geva. 1998. A prospect-based analysis of war termination. In Conflict in world politics: Advances in the study of crisis, war and peace, edited by Frank P. Harvey and Ben D. Mor. New York: St. Martin’s.
26.
Mintz, Alex, Nehemia Geva, Steven B. Redd, and Amy Carnes. 1997. The effect of dynamic and static choice sets on political decision making: An analysis using the Decision Board platform. American Political Science Review91: 553-566.
27.
Morgan, T. Clifton, and Kenneth N. Bickers. 1992. Domestic discontent and the external use of force. Journal of Conflict Resolution36: 25-52.
28.
Ostrom, Charles W., Jr., and Brian L. Job. 1986. The president and the political use of force. American Political Science Review80: 541-566.
29.
Palfrey, Thomas R., and Howard Rosenthal. 1985. Voter participation and strategic uncertainty. American Political Science Review79: 62-78.
30.
Payne, John W.1976. Task complexity and contingent processing in decision making: An information search and protocol analysis. Organizational Behavior and Human Performance16: 66-87.
31.
Redd, Steven B. 2000. The influence of advisers on decision strategies and choice in foreign policy decision making. PhD diss., Texas A&M University.
32.
Redd, Steven B.. 2002. The influence of advisers on foreign policy decision making. Journal of Conflict Resolution46: 335-364.
33.
Riggle, Ellen D. B., and Mitzi M. S. Johnson. 1996. Age difference in political decision making: Strategies for evaluating political candidates. Political Behavior18: 99-118.
34.
Russo, J. Edward, and Barbara Anne Dosher. 1983. Strategies for multiattribute binary choice. Journal of Experimental Psychology: Learning, Memory, and Cognition9: 676-696.
35.
Sears, David O.1986. College sophomores in the laboratory: Influences of a narrow data base on social psychology’s view of human nature. Journal of Personality and Social Psychology51: 515-530.
36.
Simon, Herbert A.1955. A behavioral model of rational choice. Quarterly Journal of Economics69: 99-118.
37.
Simon, Herbert A.1957. Models of man. New York: John Wiley.
38.
Stoll, Richard J.2004. Conclusion: Multiple paths to knowledge? Integrating methodology and substance in the study of conflict management and conflict resolution. In Multiple paths to knowledge in international relations: Methodology in the study of conflict management and conflict resolution, edited by Zeev Maoz, Alex Mintz, T.Clifton Morgan, Glenn Palmer, and Richard J. Stoll. Lanham, MD: Lexington Books.
39.
Taber, Charles S., and Marco R. Steenbergen. 1995. Computational experiments in electoral behavior. In Political judgment, edited by Milton Lodge and Kathleen M.McGraw. Ann Arbor: University of Michigan Press.
40.
Tetlock, Philip E.1983. Psychological research on foreign policy: A methodological overview. In Review of personality and social psychology, vol. 4, edited by Ladd Wheeler and Phillip Shaver. Beverly Hills, CA: Sage.
41.
Tversky, Amos, and Daniel Kahneman. 1981. The framing of decisions and the psychology of choice. Science211: 453-458.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
