There are many situations in which parametric statistical techniques are less than ideal for evaluating a simulated system. For most simulation output, one must rely heavily on the central limit theorein in order to apply parametric statistical techniques. The bootstrap statistic is a nonparametric sample-resample technique that makes no distributional assumptions and may be used for estimation and hypothesis testing. The authors propose the bootstrap as a valuable tool for the analysis of simulation output data since it can be used in situations in which either the distribution is not known or normal approximations are inappropriate. Furthermore, since bootstrapping is itself a simulation technique it is inherently satisfying as a tool for the analysis of simulation output data. Illustrations are presented.
Banks, J. and J.S. Carson II.1984. Discrete-Event System Simulation . Englewood Cliffs, NJ: Prentice-Hall .
2.
Bruce, P.C.1991. Resampling Stats User Guide. Arlington, VA: Resampling Stats.
3.
C.A.C.I.1983. SIMSCRIPT II.5 Programming Language. Los Angeles, CA: C.A.C.I., Inc.
4.
Doan, T.A.1992. RATS User's Manual, Version 4. Evanston, IL: Estima.
5.
Efron, B.1981. "Nonparametric Estimates of Standard Error: The Jackknife, the Bootstrap and Other Methods" Biometrika,68, 589-99.
6.
Efron, B.1982. The Jackknife, the Bootstrap and Other Resampling Plans . Philadelphia, PA: SIAM.
7.
Efron, B. and R. Tibshirani.1991. "Statistical Data Analysis in the Computer Age," Science, 253 (July), 390-395.
8.
Friedman, L.W. and H.H. Friedman.1984. "Statistical Considerations in Computer Simulation: The State of the Art" Journal of Statistical Computation and Simulation,19, 237-263.
9.
Friedman, L.W. and H.H. Friedman.1985. "The Probability Distribution as a Performance Criterion When Comparing Alternative Systems" SIMULATION,44:72-74.
10.
Friedman, H.H., L.W. Friedman and I. Pressman.1991. "The Median in Simulation Output Analysis ." Proceedings of the SCS Multiconference on Simulation in Engineering Education, 111-115.
11.
Gross, D. and C.M. Harris.1974. Fundamentals of Queuing Theory. New York: Wiley.
12.
Kim, Y.B.1992. "Output Analysis of Single Replication Methods in Simulation Experiments." Unpublished PhD Dissertation, Department of Decision Sciences, Rensselaer Polytechnic Institute, Troy, NY.
13.
Kim, Y.B., T.R. Willemain, J. Haddock, and G.C. Runger.1993. "The Threshold Bootstrap: A New Approach to Simulation Output Analysis," Proceedings of the 1993 Winter Simulation Conference, 498-502.
14.
Law, A.M.1980. "Statistical Analysis of the Output Data from Terminating Simulations." Naval Research Logistics Quarterly27:131-143.
15.
Law, A.M. and W.D.Kelton.1982. "Confidence Intervals for Steady-State Simulations, II: A Survey of Sequential Procedures." Management Science28:550-562.
16.
Mooney, Christopher Z. and Robert D. Duval .1993. Bootstrapping: A Nonparametric Approach to Statistical Inference. Newbury Park, CA: Sage Publications.
17.
Sas.1991. SAS User's Guide. Raleigh, NC: SAS Institute Inc.
18.
Simon, J.L.1991. Resampling: Probability and Statistics a Radically Different Way. Arlington, VA: Resampling Stats .
19.
Spss.1988. SPSSx User's Guide . New York: McGraw-Hill.
