Designing a high-performance microprocessor is extremely time-consuming, taking at least several years. In this article, the authors discuss these issues and propose a solution for each of them. As such, they present a new simulation methodology for designing high-performance microprocessors by combining several recently proposed techniques, such as statistical simulation, representative workload design, trace sampling, and reduced input sets. The major contribution of this study is to present a holistic view on speeding up the architectural design phase in which the above-mentioned techniques are integrated in one single architectural design framework. In this methodology, the authors first identify a region of interest in the huge design space through statistical simulation. As such, the authors conclude that this methodology can reduce the total simulation time considerably. In addition to presenting this new architectural modeling and simulation approach, a survey of related work of this fast-growing research field is presented.
Mukherjee, S. S. , S.V. Adve , T. Austin , J. Emer , and P. S. Magnusson . 2002. Performance simulation tools: Guest editors’ introduction . IEEE Computer35 (2): 38-39 .
2.
Bose, P. , and T. M. Conte . 1998. Performance analysis and its impact on design . IEEE Computer31 (5): 41-49 .
3.
Bose, P. , T. M. Conte , and T. M. Austin . 1999. Challenges in processor modeling and validation . IEEE Micro19 (3): 9-14 .
Bose, P. 1998. Performance test case generation for microprocessors . In Proceedings of the 16th IEEE VLSI Test Symposium, pp. 50-58 .
6.
Hennessy, J. L. , and D. A. Patterson . 2003. Computer architecture: A quantitative approach. 3d ed.New York: Morgan Kaufmann .
7.
Henning, J. L.2000. SPEC CPU2000: Measuring CPU performance in the new millennium . IEEE Computer33 (7): 28-35 .
8.
Bose, P. 1999. Performance evaluation and validation of microprocessors . In Proceedings of the International Conference on Measurement and Modeling of Computer Systems (SIGMETRICS ’99), pp. 226-227 .
9.
Austin, T. , E. Larson , and D. Ernst . 2002. Simple Scalar: An infrastructure for computer system modeling . IEEE Computer35 (2): 59-67 .
10.
Eeckhout, L. 2002. Accurate statistical workload modeling. Ph.D. diss., Ghent University, Belgium.
11.
Kessler, R. E. , E. J. McLellan , and D. A. Webb . 1998. The Alpha 21264 microprocessor architecture . In Proceedings of the 1998 International Conference on Computer Design (ICCD-98), pp. 90-95 .
12.
Desikan, R. , D. Burger , and S. W. Keckler . 2001. Measuring experimental error in microprocessor simulation . In Proceedings of the 28th Annual International Symposium on Computer Architecture (ISCA-28), pp. 266-277 .
13.
Sugumar, R. A. , and S. G. Abraham . 1993. Efficient simulation of caches under optimal replacement with applications to miss characterization . In Proceedings of the 1993 ACM Conference on Measurement and Modeling of Computer Systems (SIGMETRICS ’93), pp. 24-35 .
14.
Uhlig, R. , D. Nagle , T. Mudge , S. Sechrest , and J. Emer . 1995. Instruction fetching: Coping with code bloat . In Proceedings of the 22nd Annual International Symposium on Computer Architecture (ISCA-22), pp. 345-356 .
15.
Eeckhout, L. , D. Stroobandt , and K. De Bosschere . 2003. Efficient microprocessor design space exploration through statistical simulation . In 36th Annual Simulation Symposium, April. Accepted for publication.
16.
Brooks, D. , P. Bose , S. E. Schuster , H. Jacobson , P. N. Kudva , A. Buyuktosunoglu , J.-D. Wellman , V. Zyuban , M. Gupta , and P. W. Cook . 2000. Power-aware microarchitecture: Design and modeling challenges for next-generation microprocessors . IEEE Micro20 (6): 26-44 .
17.
Noonburg, D. B. , and J. P. Shen . 1997. A framework for statistical modeling of superscalar processor performance . In Proceedings of the third International Symposium on High-Performance Computer Architecture (HPCA-3), pp. 298-309 .
18.
Hsieh, C. , and M. Pedram . 1998. Micro-processor power estimation using profile-driven program synthesis . IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems17 (11): 1080-1089 .
19.
Carl, R. , and J. E. Smith . 1998. Modeling superscalar processors via statistical simulation . In Workshop on Performance Analysis and its Impact on Design (PAID-98), in conjunction with the 25th Annual International Symposium on Computer Architecture (ISCA-25), June.
20.
Nussbaum, S. , and J. E. Smith . 2001. Modeling superscalar processors via statistical simulation . In Proceedings of the 2001 International Conference on Parallel Architectures and Compilation Techniques (PACT-2001), pp. 15-24 .
21.
Nussbaum, S. , and J. E. Smith . 2002. Statistical simulation of symmetric multiprocessor systems . In Proceedings of the 35th Annual Simulation Symposium 2002, pp. 89-97 .
22.
Oskin, M. , F. T. Chong , and M. Farrens . 2000. HLS: Combining statistical and symbolic simulation to guide microprocessor design . In Proceedings of the 27th Annual International Symposium on Computer Architecture (ISCA-27), pp. 71-82 .
Noonburg, D. B. , and J. P. Shen . 1994. Theoretical modeling of superscalar processor performance . In Proceedings of the 27th Annual International Symposium on Microarchitecture (MICRO-27), pp. 52-62 .
25.
Dubey, P.K. , G.B. Adams III , and M.J. Flynn . 1994. Instruction window size trade-offs and characterization of program parallelism . IEEE Transactions on Computers43 (4): 431-442 .
26.
Kamin, R. A., III , G. B. Adams III , and P. K. Dubey . 1994. Dynamic trace analysis for analytic modeling of superscalar performance . Performance Evaluation19 (2-3): 259-276 .
27.
Eeckhout, L. , and K. De Bosschere . 2001. Hybrid analytical-statistical modeling for efficiently exploring architecture and workload design spaces . In Proceedings of the 2001 International Conference on Parallel Architectures and Compilation Techniques (PACT-2001), pp. 25-34 .
28.
Squillante, M. S. , D. R. Kaeli , and H. Sinha . 1997. Analytic models of workload behavior and pipeline performance . In Proceedings of the IEEE International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunications Systems (MASCOTTS-1997), pp. 91-96 .
29.
Sorin, D. J. , V. S. Pai , S. V. Adve , M. K. Vernon , and D. A. Wood . 1998. Analytic evaluation of shared-memory systems with ILP processors . In Proceedings of the 25th Annual International Symposium on Computer Architecture (ISCA-25), pp. 380-391 .
30.
Emma, P. G.1997. Understanding some simple processor-performance limits . IBM Journal of Research and Development41 (3): 215-232 .
31.
Flynn, M. J. , P. Hung , and K. W. Rudd . 1999. Deep-submicron microprocessor design issues . IEEE Micro19 (4): 11-22 .
32.
Hartstein, A. , and T. R. Puzak . 2002. The optimal pipeline depth for a microprocessor . In Proceedings of the 29th Annual International Symposium on Computer Architecture (ISCA-29), pp. 7-13 .
33.
Michaud, P. , A. Seznec , and S. Jourdan . 1999. Exploring instruction-fetch bandwidth requirement in wide-issue superscalar processors . In Proceedings of the 1999 International Conference on Parallel Architectures and Compilation Techniques (PACT-1999), pp. 2-10 .
34.
Neefs, H. , H. Vandierendonck , and K. De Bosschere . 2000. A technique for high bandwidth and deterministic low latency load/store accesses to multiple cache banks . In Proceedings of the Sixth International Symposium on High-Performance Computer Architecture (HPCA-6), pp. 313-324 .
35.
Conte, T. M. 1992. Systematic computer architecture prototyping. Ph.D. diss., University of Illinois at Urbana-Champaign.
36.
Brooks, D. , M. Martonosi , and P. Bose . 2000. Abstraction via separable components: An empirical study of absolute and relative accuracy in processor performance modeling. Technical Report RC 21909, IBM Research Division, T. J. Watson Research Center .
37.
Eeckhout, L. , H. Vandierendonck , and K. DeBosschere . 2002. Work-load design: Selecting representative program-input pairs . In Proceedings of the 2002 International Conference on Parallel Architectures and Compilation Techniques (PACT-2002), pp. 83-94 .
38.
Manly, B. F. J.1994. Multivariate statistical methods: A primer.2d ed.London: Chapman & Hall .
39.
Eeckhout, L. , H. Vandierendonck , and K. DeBosschere . 2003. Quantifying the impact of input data sets on program behavior and its applications . Journal of Instruction-Level Parallelism. Retrieved from http://www.jilp.org
40.
Saavedra, R. H. , and A. J. Smith . 1996. Analysis of benchmark characteristics and benchmark performance prediction . ACM Transactions on Computer Systems14 (4): 344-384 .
41.
Yi, J. J. , D. L. Lilja , and D. M. Hawkins . 2003.A statistically rigorous approach for improving simulation methodology . In Proceedings of the Ninth International Symposium on High Performance Computer Architecture (HPCA-9), February.
42.
Sherwood, T. , E. Perelman , and B. Calder . 2001. Basic block distribution analysis to find periodic behavior and simulation points in applications . In Proceedings of the 2001 International Conference on Parallel Architectures and Compilation Techniques (PACT-2001), pp. 3-14 .
43.
Skadron, K. , P. S. Ahuja , M. Martonosi , and D. W. Clark . 1999. Branch prediction, instruction-window size, and cache size: Performance tradeoffs and simulation techniques . IEEE Transactions on Computers48 (11): 1260-1281 .
44.
Dubey, P. K. , and R. Nair . 1995. Profile-driven sampled trace generation. Technical Report RC 20041, IBM Research Division, T. J. Watson Research Center .
45.
Iyengar, V. S. , and L. H. Trevillyan . 1996. Evaluation and generation of reduced traces for benchmarks. Technical Report RC 20610, IBM Research Division, T. J. Watson Research Center .
46.
Iyengar, V. S. , L. H. Trevillyan , and P. Bose . 1996. Representative traces for processor models with infinite cache . In Proceedings of the Second International Symposium on High-Performance Computer Architecture (HPCA-2), pp. 62-73 .
Lafage, T. , and A. Seznec . 2000. Choosing representative slices of program execution for microarchitecture simulations: A preliminary application to the data stream . In IEEE 3rd Annual Workshop on Workload Characterization (WWC-2000), in conjunction with the International Conference on Computer Design (ICCD-2000), September.
49.
Laha, S. , J. H. Patel , and R. K. Iyer . 1988. Accurate low-cost methods for performance evaluation of cache memory systems . IEEE Transactions on Computers37 (11): 1325-1336 .
50.
Lauterbach, G.1993. Accelerating architectural simulation by parallel execution of trace samples. Technical Report SMLI TR-93-22, Sun Microsystems Laboratories, Inc.
51.
Martonosi, M. , A. Gupta , and T. Anderson . 1993. Effectiveness of trace sampling for performance debugging tools . In Proceedings of the 1993 ACM SIGMETRICS Conference on Measurement and Modeling of Computer Systems, pp. 248-259 .
52.
Poursepanj, A.1994. The PowerPC performance modeling methodology . Communications of the ACM37 (6): 47-55 .
53.
Sherwood, T. , and B. Calder . 1999. Time varying behavior of programs. Technical Report UCSD CS99-630, Department of Computer Science and Engineering, University of California, San Diego .
54.
Sherwood, T. , E. Perelman , G. Hamerly , and B. Calder . 2002. Automatically characterizing large scale program behavior . In Proceedings of the Tenth International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS-X), pp. 45-57 .
55.
Crowley, P. , and J.-L. Baer . 1998. Trace sampling for desktop applications on Windows NT . In Proceedings of the First Workshop on Workload Characterization (WWC-1998), in conjunction with the 31st ACM/IEEE Annual International Symposium on Microarchitecture (MICRO-31), November.
56.
Conte, T. M. , M. A. Hirsch , and K. N. Menezes . 1996. Reducing state loss for effective trace sampling of superscalar processors . In Proceedings of the 1996 International Conference on Computer Design (ICCD-96), pp. 468-477 .
57.
Kessler, R. E. , M. D. Hill , and D. A. Wood . 1994. A comparison of trace-sampling techniques for multi-megabyte caches . IEEE Transactions on Computers43 (6): 664-675 .
58.
Wood, D. A. , M. D. Hill , and R. E. Kessler . 1991. A model for estimating trace-sample miss ratios . In Proceedings of the 1991 SIG-METRICS Conference on Measurement and Modeling of Computer Systems, pp. 79-89 .
59.
Nguyen, A.-T. , P. Bose , K. Ekanadham , A. Nanda , and M. Michael . 1997. Accuracy and speed-up of parallel trace-driven architectural simulation . In Proceedings of the 11th International Parallel Processing Symposium (IPPS ’97), pp. 39-44 .
60.
Haskins, J.W., Jr. , and K. Skadron . 2001. Minimal subset evaluation: Rapid warm-up for simulated hardware state . In Proceedings of the 2001 International Conference on Computer Design (ICCD-2001), pp. 32-39 .
61.
Haskins, J. W., Jr. , and K. Skadron . 2002. Memory reference reuse latency: Accelerated sampled microarchitecture simulation. Technical Report CS-2002-19, Department of Computer Science, University of Virginia .
62.
Eeckhout, L. , S. Eyerman , B. Callens , and K. De Bosschere . 2003. Accurately warmed-up trace samples for the evaluation of cache memories . In High Performance Computing Symposium (HPC-2003), April. Accepted for publication.
63.
KleinOsowski, A. J. , J. Flynn , N. Meares , and D. J. Lilja . 2000. Adapting the SPEC 2000 benchmark suite for simulation-based computer architecture research . In Workload Characterization of Emerging Computer Applications, Proceedings of the IEEE 3rd Annual Workshop on Workload Characterization (WWC-2000), in conjunction with the International Conference on Computer Design (ICCD-2000), pp. 83-100 .
64.
KleinOsowski, A. J. , and D. J. Lilja . 2002. MinneSPEC: A new SPEC benchmark workload for simulation-based computer architecture research. Computer Architecture Letters, June.
65.
Eeckhout, L. , H. Vandierendonck , and K. De Bosschere . 2003. Designing workloads for computer architecture research . IEEE Computer36 (2): 65-71 .
66.
Haskins, J. W., Jr. , K. Skadron , A. J. KleinOsowski , and D. J. Lilja . 2002. Techniques for accurate, accelerated processor simulation: An analysis of reduced inputs and sampling. Technical Report CS-2002-01, University of Virginia, Department of Computer Science .
67.
Emer, J. , P. Ahuja , E. Borch , A. Klauser , C.-K. Luk , S. Manne , S. S. Mukherjee , H. Patil , S. Wallace , N. Binkert , R. Espasa , and T. Juan . 2002. Asim: A performance model framework . IEEE Computer35 (2): 68-76 .
68.
Reilly, M. , and J. Edmondson . 1998. Performance simulation of an Alpha microprocessor . IEEE Computer31 (5): 50-58 .
69.
Moudgill, M. 1998. Techniques for implementing fast processor simulators . In Proceedings of the 31st Annual Simulation Symposium, pp. 83-90 .
70.
Moudgill, M. , J.-D. Wellman , and J. H. Moreno . 1999. Environment for PowerPC microarchitecture exploration . IEEE Micro19 (3): 15-25 .
71.
Magnusson, P. S. , M. Christensson , J. Eskilson , D. Forsgren , G. Hallberg , J. H. F. Larsson , A. Moestedt , and B. Werner . 2002. Simics: A full system simulation platform . IEEE Computer35 (2): 50-58 .
72.
Burger, D. C. , and T. M. Austin . 1997. The SimpleScalar tool set . Computer Architecture News, 1997. See also http://www.simplescalar.com for more information
73.
Hughes, C. J. , V. S. Pai , P. Ranganathan , and S.V. Adve . 2002. Rsim: Simulating shared-memory multiprocessors with ILP processors . IEEE Computer35 (2): 40-49 .
74.
Rosenblum, M. , E. Bugnion , S. Devine , and S. A. Herrod . 1997. Using the SimOS machine simulator to study complex computer systems . ACM Transactions on Modeling and Computer Simulation (TOMACS)7 (1): 78-103 .
75.
Bechem, C. , J. Combs , N. Utamaphetai , B. Black , R. D. S. Blanton , and J. P. Shen . 1999. An integrated functional performance simulator . IEEE Micro19 (3): 26-35 .
76.
Mauer, C. J. , M. D. Hill , and D.A. Wood . 2002. Full-system timing-first simulation . In Proceedings of the 2002 ACM SIGMETRICS Conference on Measurement and Modeling of Computer Systems, pp. 108-116 .
77.
Black, B. , and J. P. Shen . 1998. Calibration of microprocessor performance models . IEEE Computer31 (5): 59-65 .
78.
Gibson, J. , R. Kunz , D. Ofelt , M. Horowitz , J. Hennessy , and M. Heinrich . 2000. FLASH vs. (simulated) FLASH: Closing the simulation loop . In Proceedings of the 9th International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS-IX), pp. 49-58 .
79.
Bhargava, R. , L. K. John , and F. Matus . 1999. Accurately modeling speculative instruction fetching in trace-driven simulation . In Proceedings of the IEEE Performance, Computers, and Communications Conference (IPCCC-1999), pp. 65-71 .
80.
Black, B. , A. S. Huang , M. H. Lipasti , and J. P. Shen . 1996. Can trace-driven simulators accurately predict superscalar performance? In Proceedings of the 1996 International Conference on Computer Design (ICCD-96), October.
81.
Combs, J. , C. B. Combs , and J. P. Shen . 1999. Mispredicted path cache effects . In Proceedings of the 1999 Euro-Par Conference, pp. 1322-1331 .
82.
Schnarr, E. , and J. R. Larus . 1998. Fast out-of-order processor simulation using memoization . In Proceedings of the Eighth International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOSVIII), pp. 283-294 .
83.
Bose, P.2000. Performance evaluation of processor operation using trace pre-processing. U.S. Patent 6,059,835.
84.
Loh, G. 2001. A time-stamping algorithm for efficient performance estimation of superscalar processors . In Proceedings of the International Conference on Measurement and Modeling of Computer Systems (SIGMETRICS-2001), pp. 72-81 .
85.
Ofelt, D. J. , and J. L. Hennessy . 2000. Efficient performance prediction for modern microprocessors . In Proceedings of the International Conference on Measurement and Modeling of Computer Systems (SIGMETRICS-2000), pp. 229-239 .
86.
Ofelt, D. J. 1999. Efficient performance prediction for modern microprocessors. Ph.D. diss., Stanford University.
