Validation is the most important tool in evaluating the effectiveness of a simulation model. An integral subset of validation is external validation. Through a historical philosophical discussion and examples, the authors provide a road map to navigate approaches to this topic. The authors also provide methodology suggestions by reconciling foundational philosophical approaches and incorporating a hermeneutical perspective to increase the usability, validity, and generalizability of simulation models.
Get full access to this article
View all access options for this article.
References
1.
Ashby, W. R. (1970). Analysis of the system to be modeled. In R. M. Stogdill (Ed.), The process of model-building in the behavioral sciences. Columbus: Ohio State University Press.
2.
Bernstein, R. J. (1983) Beyond objectivism and relativism: Science hermeneutics, and praxis. Philadelphia: University of Pennsylvania Press.
3.
Boocock, S. S. (1972). Validity-testing of an intergenerational relations game. Simulation & Games, 3, 29-40.
4.
Carvalho, G. F. (1991). Evaluating computerized business simulators for objective learning validity. Simulation & Gaming, 22(3), 328-348.
5.
Cook, T. D., & Campbell, D. T. (1979). Quasi-experimentation: Design and analysis issues for field settings. Boston: Houghton Mifflin.
6.
Colby, K. M. (1977). On the way people and models do it. Perspectives in Biology and Medicine, 21,99-104.
7.
Dukes, R. L., & Waller, S. J. (1976). Toward a general evaluation model for simulation games: GEM. Simulation & Games, 7, 75-96.
8.
Emshoff, J. R., & Sisson, R. L. (1970). Design and use of computer simulation models. New York: Macmillan.
9.
Feinstein, A. H., & Cannon, H. (2002). Constructs of simulation evaluation. Simulation & Gaming, 33(4), 425-440.
10.
Friedman, M. (1953). The methodology of positive economics. In Essays in positive economics (pp. 3-43). Chicago: University of Chicago Press.
11.
Feyerabend, P. (1993). Against method (3rd ed.). New York: Verso.
12.
Gadamer, H. G. (1975). Truth and method (G. Barden & J. Cumming, Trans., Eds.). New York: Seabury.
13.
Gadamer, H. G. (1976). Philosophical hermeneutics (D. E. Linge, Trans.). Berkeley: University of California Press.
14.
Henshaw, R. C., & Jackson, J. R. (1989). THE EXECUTIVE GAME (5th ed.). Homewood, IL: Irwin.
15.
Irvine, S. R., Levary, R. R., & McCoy, M. S. (1998). The impact of judgmental biases on the validation of simulation models. Simulation & Gaming, 29(2), 152-164.
16.
Kleindorfer, G. B., O'Neil, L., & Ganeshan, R. (1998). Validation in simulation: Various positions in the philosophy of science. Management Science, 44(8), 1087-1099.
17.
Kuhn, T. S. (1962). The structure of scientific revolutions. Chicago: University of Chicago Press.
18.
Lakatos, I., & Musgrave, A. (1970). Criticism and the growth of knowledge. Cambridge, UK: Cambridge University Press.
19.
Law, A. M., & Kelton, W. D. (1991). Simulation modeling and analysis (2nd ed.). New York: McGraw-Hill.
20.
Martin, J. E., & Kleindorfer, G. B. (1991). The argumentum ad hominem and two theses about evolutionary epistemology: Godelian reflections. Metaphilosophy, 22, 63-88.
21.
Mihram, G. A. (1972). Some practical aspects of the verification and validation of simulation models. Operations Research, 23, 17-29.
22.
Naylor, T. H., & Finger, J. M. (1967). Verification of computer simulation models. Management Science, 14, B92-B101.
23.
Norlen, U. (1975). Simulation model building. New York: John Wiley.
24.
Norris, D. R. (1986). External validity of business games. Simulation & Games, 17(4), 447-459.
25.
Norris, D. R., & Snyder, C. A. (1982). External validation of simulation games. Simulation & Games, 13, 73-85.
26.
Pegden, C. D., Shannon, R. E., & Sadowski, R. P. (1995). Introduction to simulation using SIMAN (2nd ed.). Hightstown, NJ: McGraw-Hill.
27.
Peters, V., Vissers, G., & Heijne, G. (1998). The validity of games. Simulation & Gaming, 29(1), 20-30.
28.
Popper, K. R. (1959). The logic of scientific discovery. New York: Routledge.
29.
Stanislaw, H. (1986). Tests of computer simulation validity: What do they measure? Simulation & Games, 17(2), 173-191.
30.
Vandierendonck, A. (1975). Inferential simulation: Hypothesis-testing by computer simulation. Nederlands Tijdschrift voor de Psychologie (Amsterdam), 30, 677-700.
31.
Weinberg, J. R. (1936). An examination of logical positivism. New York: Harcourt, Brace.
32.
Wolfe, J., & Roberts, C. R. (1986). The external validity of a business management game: A five-year longitudinal study. Simulation & Games, 17(1), 45-59.
33.
Wolfe, J., & Roberts, C. R. (1993). A further study of the external validity of business games: Five-year peer group indicators. Simulation & Gaming, 24(1), 21-33.
