In simulation studies, means, percentiles, or pro portions are often used to summarize measurements of system performance. We describe procedures for estimating confidence intervals for each of these three statistics. We conclude that proportions are generally best suited to computer simulation studies. We present empirical data that clarifies the proce dures and justifies the recommendation of proportions.
Amer, P.D.Mamrak , S.A.Statistical Methods in Computer Performance Evaluation: a Binomial Approach to the Comparison Problem Proceedings Computer Science and Statistics: Eleventh Annual Symposium on the InterfaceRaleigh, North Carolina March 1978 pp. 314-319
2.
Amer, P.D.Experimental Design for Computer Comparison and Selection PhD dissertationDepartment of Computer and Information Science Ohio State University March 1979
3.
Anderson, M.A., Jr.Sargent, R.G.A Statistical Evaluation of the Scheduler of an Experimental Interactive Computing System In W. Freiberg, editor, Statistical Computer Performance Evaluation (Academic Press, New York, 1972), pp. 73-98
4.
Brown, R.S.A Case Study of a Multi-Access Scientific Benchmarking Application In N. Benwall, editor, Benchmarking ( Hemisphere Publishing Company, Washington, D.C., 1975), pp. 133-147
5.
Dixon, W.J.Massey, F.J., Jr.Introduction to Statistical AnalysisMcGraw-HillNew York19693rd edition
6.
Dudewicz, E.J.Statistical Inference with Unknown and Unequal Variances Transactions of the Annual Quality Control Conference of the Rochester Society for Quality Control vol. 28 1972 pp. 71-85 Submitted to The American Statistician
7.
Dudewicz, E.J.Introduction to Statistics and ProbabilityHolt, Rinehart and WinstonNew York1976 p. 215
8.
Guidelines for the Measurement of interactive Computer Service Turnaround Time and Response Time AFIPS Publication 57National Bureau of StandardsWashington, D.C. August 1978
9.
10.
Mamrak, S.A.DeRuyter, P.A.statistical Methods for Comparison of Computer Services Computer vol. 10 no. 11 November 1977 pp. 32-39
11.
Mamrak , S.A.Amer, P.D.A Methodology for the Selection of Interactive Computer Services NBS Special Publication 500-44National Bureau of StandardsWashington, D.D. January 1979
12.
Olsson, D.M.Nelson, L.S.The Nelder-Mead Simplex Procedure for Function Minimization Technometrics vol. 17 1975 pp. 45-51
13.
Ramberg, J.S.Schmeiser, B.W.An Approximate Method for Generating Asymmetric Random Variables Communications of the ACM vol. 17 no. 2 February 1974 pp. 78-82
14.
Ramberg, J.S.Dudewicz, E.J.Tadikamalla, P.R.Mykytka, E.F.A Probability Distribution and Its Uses in Fitting Data Technometrics vol 21 1979 pp. 201-214
15.
Shapiro, S.S.How to Test Normaility and Other Distributional Assumptions In E.J. Dudewicz, editor, ASQC Basic References in Quality Control: statistical Techniques ( American Society for Quality Control, Milwaukee, Wisconsin , 1980), vol. 3
