Efficient Performance Prediction for Large-Scale,Data-Intensive Applications

Abstract

This paper presents a simulation-based performance prediction framework for large-scale, data-intensive applications on large-scale machines. The framework consists of two components: application emulators and a suite of simulators. Application emulators provide a parameterized model of data access and computation patterns of the applications and enable changing critical application components (input data partitioning, data declustering, processing structure, etc.). The suite of simulators executes quickly on a high performance workstation to allow performance prediction of large-scale parallel machine configurations. The key to efficient simulation of very large configurations is to elide the majority of low-level hardware events while preserving data dependencies and distributions. The authors evaluate their performance prediction tool using a set of three data-intensive applications.

Get full access to this article

View all access options for this article.

References

Acharya, A. , Uysal, M. , Bennett, R. , Mendelson, A. , Beynon, M. , Hollingsworth, J. K. , Saltz, J. , and Sussman, A. 1996. Tuning the performance of I/O intensive parallel applications . In Proceedings of the Fourth Annual Workshop on I/O in Parallel and Distributed Systems (IOPADS). Philadelphia: ACM Press.

Afework, A. , Beynon, M. D. , Bustamante, F. , Demarzo, A. , Ferreira, R. , Miller, R. , Silberman, M. , Saltz, J. , Sussman, A. , and Tsang, H. 1998. Digital dynamic telepathology—the Virtual Microscope . In Proceedings of the 1998 AMIA Annual Fall Symposium. Orlando, FL: American Medical Informatics Association.

Agrawal, R. , and Shafer, J. 1996. Parallel mining of association rules . IEEE Transactions on Knowledge and Data Engineering 8 (6): 962-969 .

Bagrodia, R. , Docy, S. , and Kahn, A. 1997. Parallel simulation of parallel file systems and I/O programs . In Proceedings of the 1997 ACM/IEEE SC97 Conference. San Jose, CA: ACM Press.

Brehm, J. , Madhukar, M. , Smirni, E. , and Dowdy, L. 1995. PerPreT—a performance prediction tool for massively parallel systems . In Proceedings of the Joint Conference on Performance Tools/MMB 1995, pp. 284-298 . New York: Springer-Verlag.

Chang, C. , Ferreira, R. , Sussman, A. , and Saltz, J. 1999. Infrastructure for building parallel database systems for multidimensional data . In Proceedings of the Second Merged IPPS/SPDP Symposiums. San Juan, Puerto Rico: IEEE Computer Society Press.

Chang, C. , Moon, B. , Acharya, A. , Shock, C. , Sussman, A. , and Saltz, J. 1997. Titan: A high-performance remote-sensing database . In Proceedings of the 13th International Conference on Data Engineering. Birmingham, UK: IEEE Computer Society Press.

Clement, M. J. , and Quinn, M. J. 1995. Using analytical performance prediction for architectural scaling. Technical Report TR BYU-NCL-95-102, Networked Computing Lab, Brigham Young University .

Eom, H. , and Hollingsworth, J. K. 2000. Speed vs. accuracy in simulation for I/O-intensive applications . In Proceedings of the 2000 International Parallel and Distributed Processing Symposium. Cancun, Mexico: IEEE Computer Society Press.

10.

Gürsoy, A. , and Kalé, L. V. 1996. Simulating message-driven programs . In Proceedings of Int. Conference on Parallel Processing, vol. 3, pp. 223-230 . Bloomingdale, IL: IEEE Computer Society Press.

11.

Herrod, S. 1993. Tango Lite: A multiprocessor simulation environment. Technical report, Computer Systems Laboratory, Stanford University .

12.

Kurc, T. M. , Sussman, A. , and Saltz, J. 1999. Coupling multiple simulations via a high performance customizable database system . In Proceedings of the Ninth SIAM Conference on Parallel Processing for Scientific Computing. Philadelphia, PA: SIAM.

13.

Mendes, C. L. 1993. Performance prediction by trace transformation . In Fifth Brazilian Symposium on Computer Architecture. Florianapolis, Brazil.

14.

Reinhardt, S. , Hill, M. , Larus, J. , Lebeck, A. , Lewis, J. , and Wood, D. 1993. The Wisconsin Wind Tunnel: Virtual prototyping of parallel computers . In Proceedings of the 1993 ACM SIGMETRICS Conference on Measuring and Modeling of Computer Systems. Santa Clara, CA: ACM Press.

15.

Rosenblum, M. , Herrod, S. , Witchel, E. , and Gupta, A. 1995. Complete computer system simulation: The SimOS approach . IEEE Parallel and Distributed Technology 3 (4): 34-43 .

16.

Ruemmler, C. , and Wilkes, J. 1994. An introduction to disk drive modeling . IEEE Computer 27 (3): 17-29 .

17.

Schopf, J. M. 1997. Structural prediction models for high-performance distributed applications . In Cluster Computing Conference [Online]. Available: http://www.mathcs.emory.edu/ccc97/sessions.html

18.

Shock, C. T. , Chang, C. , Moon, B. , Acharya, A. , Davis, L. , Saltz, J. , and Sussman, A. 1998. The design and evaluation of a high-performance earth science database . Parallel Computing 24 (1): 65-90 .

19.

Simon, J. , and Wierum, J.-M. 1996. Accurate performance prediction for massively parallel systems and its applications . In Proceedings of Euro-Par’96, pp. 675-688 . New York: Springer-Verlag.

20.

Uysal, M. , Kurc, T. M. , Sussman, A. , and Saltz, J. 1998. A performance prediction framework for data intensive applications on large scale parallel machines . In Proceedings of the Fourth Workshop on Languages, Compilers and Run-Time Systems for Scalable Computers, pp. 243-258 . New York: Springer-Verlag.

21.

Yan, Y. , Zhang, X. , and Song, Y. 1996. An effective and practical performance prediction model for parallel computing on non-dedicated heterogeneous NOW . Journal of Parallel and Distributed Computing 38: 63-80 .