This report presents a methodology for measuring the performance of supercomputers. It includes 13 Fortran programs that total over 50,000 lines of source code. They represent applications in several areas of engi neering and scientific computing, and in many cases the codes are currently being used by computational re search and development groups. We also present the PERFECT Fortran standard, a set of guidelines that allow portability to several types of machines. Furthermore, we present some performance measures and a method ology for recording and sharing results among diverse users on different machines. The results presented in this paper should not be used to compare machines, except in a preliminary sense. Rather, they are presented to show how the methodology has been applied, and to encourage others to join us in this effort. The results should be regarded as the first step toward our objec tive, which is to develop a publicly accessible data base of performance information of this type.
Get full access to this article
View all access options for this article.
References
1.
Arakawa, A., and Mintz, Y.1974. The UCLA Atmospheric Circulation Model. Los Angeles: University of California, Dept. of Meteorology .
2.
Bailey, D., and Barton, J.1985. The NAS kernel benchmark program. NASA Technical Memorandum86711. Moffett Field, Calif.: Ames Research Center, National Aeronautics and Space Administration.
3.
Bartlett, R., Shavitt, I., and Purvis, G.1979. J. Chem. Phys.71:281.
4.
Beam, R., and Warming, R.1976. An implicit finite
5.
difference algorithm for hyperbolic systems in conservative law form. J. Comput. Phys.22:87.
6.
Bourke, W.1974. A multilevel spectral model. Formulation and hemispheric integrations. Monthly Weather Review102:687.
7.
Cabbibo, N., and Marinari, E.1982. A new method of updating SU(N) matrices in computer simulations of gauge theories. Phys. Lett. B 119:387.
8.
Christidis, Z.1986. Hydrodynamic mesoscale modeling of atmospheric transport and pollutant deposition in the vicinity of a lake. Ph.D. thesis, Atmospheric and Oceanic Science Department, University of Michigan , Ann Arbor.
9.
Christidis, Z., and Sonnad, V.1987. Parallel implementation of a pseudo-spectral method on a loosely coupled array of processors. Technical Report KGN-143. Kingston, N.Y.: IBM.
10.
Curry, J., Herring, J., Loncaric, J., and Orszag, S.1984. Order and disorder in two- and three-dimensional Bénard convection. J. Fluid. Mech.174:1.
11.
Denning, J., and Adams, G.1988. Research questions for performance analysis of supercomputers . In Performance evaluation of supercomputers , edited by J. Martin.Amsterdam: North-Holland, p. 403.
12.
Dongarra, J.1987. Performance of various computers using standard linear equations software in a Fortran environment. Technical Report MCS-RM-23Argonne, Ill.: Argonne National Laboratory.
13.
Dongarra, J., Martin, J., and Worlton, J.1987. Computer benchmarking: paths and pitfalls. IEEE Spectrum July: 38.
14.
Dupuis, M., Watts, J., Villar, H., and Hurst, G.1988. HONDO: version 7.0 documentation. Quantum Chemistry Program Exchange Bulletin8:2 (IBM Technical Report KGN-169, Kingston, N.Y.).
15.
Eliasen, E., Machenhauer, B., and Rasmusen, E.1970. On a numerical method for integration of the hydrodynamic equations with a spectral representation of the horizontal fields. Report No. 2. Copenhagen: University of Copenhagen, Institute for Theoretical Meteorology.
16.
Flattery, T.1967. Hough functions. Technical Report 20Chicago: University of Chicago, Dept. of Geophysical Sciences.
17.
Gallivan, K., Jalby, W., and Meier, U.1987. The use of BLAS3 in linear algebra on a parallel processor with a hierarchical memory. SIAM J. Sci. Statist. Comput.8(6):1079.
18.
Gear, C.1971. Numerical initial value problems in ordinary differential equations. Englewood Cliffs, N.J.: Prentice-Hall.
19.
Gottschalk, T.1987. A new multi-target tracking model. Presented at the third conf. on hypercube concurrent computers and applications , ACM, New York City (Caltech Report C3P-480).
20.
Gottschalk, T.1988. Concurrent multiple target tracking. Presented at the third conf. on hypercube concurrent computers and applications , ACM, New York City (Caltech report C3P-567).
21.
Infante, E. (Committee Chairman).1986. An agenda for improved evaluation of supercomputer performance . Washington, D.C. : Energy Engineering Board, Commission on Engineering and Technical Systems, National Research Council (2101 Constitution Ave. NW).
22.
Jameson, A.1983. Solution of the Euler equations for a two-dimensional transonic flow by a multigrid method. Appl. Math. Comput.13:327.
23.
Jamieson, L.1988. Using algorithm characteristics to evaluate parallel architectures . In Performance evaluation of supercomputers , edited by J. Martin.Amsterdam: North-Holland, p. 21.
24.
Kuck, D., and Sameh, A.1987. A supercomputing performance evaluation plan. Presented at the first internal, conf. on supercomputing, Athens, Greece.
25.
Kuo, H.1965. On formation and intensification of tropical cyclones through latent heat release by cumulus convection. J. Atmos. Sci.22:40.
26.
Lie, G., and Clementi, E.1986. Molecular dynamics simulation of liquid water with an ab initio flexible water-water interaction potential. Phys. Rev. A 33:2679.
27.
Lorenz, E.1963. Deterministic non-periodic flow. J. Atmos. Sci.20:130.
28.
Lubeck, O.1988. Supercomputer performance: the theory, practice, and results. Technical Report LA-11204-MS. Los Alamos, N.M.: Los Alamos National Laboratory.
29.
Lubeck, O., Moore, J., and Mendez, R.1985. A benchmark comparison of three supercomputers: Fujitsu VP-200, Hitachi S810/20, and CRAY X-MP/2. Computer18:12.
30.
Martin, J., and Mueller-Wichards, D.1987. Supercomputer performance evaluation: status and directions. J. Supercmnput.1:87.
31.
Martin, J., and Riganati, J.1988. On benchmarking standards for high performance computing . IEEE Comput.21:9:68.
32.
Matsuoka, O., Clementi, E., and Yoshimine, M.1976. J. Chem. Phys.64:1351.
33.
McMahon, F.1988. The Livermore Fortran kernels test of the numerical performance range. In Performance evaluation of supercomputers , edited by J. Martin.Amsterdam : North-Holland, p. 143.
34.
Mueller-Wichards, D., and Gentzsch, W.1982. Performance comparisons among several parallel and vector computers on a set of fluid flow problems. Technical Report IB 262-82 R01. Göttingen, West Germany: DFVLR.
35.
Nagel, L.1975. SPICE2: a computer program to simulate semiconductor circuits . Memorandum ERL-M520. Berkeley: University of California, College of Engineering, Electronics Research Laboratory .
36.
Neves, K., and Simon, H.1987. Supercomputer performance evaluation: benchmarking applications on supercomputers. In Proceedings of the second internat. conf. on supercomputing. St. Petersburg, Fla. : International Supercomputing Institute, p. 374.
37.
Newton, R., and Sangiovanni-Vincentelli, A.1983. Relaxation-based circuit simulation. IEEE Trans. ED 30(9):1184.
38.
Noor, A., and Camin, R.1976. Symmetry considerations for anisotropic shells . Comp. Meth. Appl. Mech. Engrg.9:31.
39.
Noor, A., and Peters, J.1985. Model-size reduction techniques for the analysis of symmetric anisotropic structures. Engrg. Comp.2(4):285.
40.
Orszag, S.1970. Transform methods for calculation of vector coupled sums: application to the spectral form of the vorticity equations. J. Atmos. Sci.27:890.
41.
Orszag, S.1971. Numerical simulation of incompressible flows within simple boundaries, Galerkin (spectral) representations. Stud. Appl. Math.50:293.
42.
Otto, S., Baillie, C., Ding, H-Q., Apostolakis, J., Gupta, R., Kilcup, G., Patel, A., and Sharpe, S.1987. Lattice gauge theory benchmarks. Report C3P-405RPasadena: California Institute of Technology.
43.
Pulliam, T., and Steger, J.1980. Implicit finite-difference simulations of three-dimensional compressible flow. AIAA J.18:159.
44.
Pulliam, T., and Steger, J.1985. Recent improvements in efficiency, accuracy, and convergence for implicit approximate factorization algorithms. AIAA-85-0360. Presented at the 23rd aerospace science meeting, January 14—17, Reno, Nevada.
45.
Reshef, M., and Kessler, D.1989. Practical implementation of three-dimensional post-stack depth migration. Geophysics, in press.
46.
Sela, J.1980. Spectral modeling at the National Meteorological Center . Mmuhly Weather Review180:1279.
47.
Sela, J.1982. The NMC spectral model. Technical Report NWS 30 (May). National Oceanic and AtmosphericAdministration.
48.
Swamy, K., and Clementi, E.1987a. BIOMOL—a molecular dynamics simulation package for nucleic add hydration. Report KGN-97. Kingston, N.Y. : IBM.
49.
Swamy, K., and Clementi, E.1987b. Hydration structure and the dynamics of B- and Z-DNA in the presence of counterions via molecular dynamics simulations. Report KGN-94. Kingston, N.Y.: IBM.
50.
Uhr, L.1984. On benchmarks: dynamically improving experimental comparisons. Computer Sciences Technical Report No. 571. Madison: University of Wisconsin-Madison.
51.
Watts, J., and Dupuis, M.1987. Towards efficient parallel computation of correlated wave functions. Implementation of the two-electron integral transformation on the LCAP parallel supercomputer. Technical Report KGN-100. Kingston, N.Y.: IBM.
