Sage Journals: Discover world-class research

Abstract

We report on the development of a new computational framework for efficiently carrying out parallel data redistribution in a limited memory environment. This new library, MADRE (Memory-Aware Data Redistribution Engine), is an open-source, C/MPI-based toolkit designed for quick and easy integration into application codes that have demanding data migration needs. At the same time, MADRE exposes a lower-level application programming interface that greatly facilitates the development and incorporation of new algorithms into the MADRE framework, thus serving as a potential organizing entity for continued research in this area. Finally, we develop, describe, and test in detail several new parallel redistribution algorithms that are incorporated into the MADRE distribution.

Keywords

MPI parallel programming redistribution collective communication

Get full access to this article

View all access options for this article.

References

Catalyurek, U. et al. (2007). Hypergraph-based dynamic load balancing for adaptive scientific computations. In Proceedings of 21st International Parallel and Distributed Processing Symposium (IPDPS’07) . Piscataway, NJ: IEEE Press.

deCougny, H.L. et al. (1994). Load balancing for the parallel adaptive solution of partial differential equations. Appl. Numer. Math. 16(1-2): 157-182.

Howie, J.M. ( 1995). Fundamentals of Semigroup Theory. Oxford: Oxford University Press.

Lipscomb, S. ( 1986). Cyclic subsemigroups of symmetric inverse semigroups . Semigroup Forum 34: 243-248.

Lipscomb, S. ( 1996). Symmetric Inverse Semigroups. Providence, RI: American Mathematical Society.

Nieter, C. and Cary, J.R. ( 2004). Vorpal: a versatile plasma simulation code. J. Comput. Phys. 196(2): 448-473.

Pinar, A. and Hendrickson, B. ( 2004). Interprocessor communication with limited memory. IEEE Trans. Parallel Distrib. Syst. 15(7): 606-616.

Ricker, P.M. et al. (1999). FLASH: a multidimensional hydrodynamics code for modeling astrophysical thermonuclear flashes. Bull. Am. Astron. Soc. 31: 1431.

Siegel, S.F. ( 2008). The MADRE web page. http://vsl.cis.udel.edu/madre.

10.

Siegel, S. F. and Avrunin, G. S. (2007). Verification of halting properties for MPI programs using nonblocking operations. In Proceedings of Recent Advances in Parallel Virtual Machine and Message Passing Interface, 14th European PVM/MPI User’s Group Meeting, Paris, France, 30 September-3 October 2007, edited by F. Cappello, T. Hérault and J. Dongarra (Lecture Notes in Computer Science, Vol. 4757). Berlin: Springer, pp. 326-334.

11.

Zaki, O. et al. (1999). Toward scalable performance visualization with Jumpshot. Int. J. High Perform. Comput. Appl. 13(3): 277-288.

Madre: the Memory-Aware Data Redistribution Engine

Abstract

Keywords

Get full access to this article

References