Multilevel Parallel Programming for Three-Dimensional Voronoi Cell Finite Element Modeling of Heterogeneous Materials

Abstract

In this paper we present work aimed at implementing an efficient parallel model for the three-dimensional Voronoi cell finite element model (VCFEM), which has been developed as an effective tool for modeling heterogeneous microstructures of composite, porous or polycrystalline materials, on SMP cluster systems. In these systems, multiprocessor nodes offer shared memory on the node and distributed memory between the nodes. The approach uses multiple parallel models to efficiently decompose the problem based on computational requirements. The Message Passing Interface (MPI) library is used for distributed memory decomposition between nodes, and multithreading using the OpenMP (OMP) library is used for shared memory decomposition on each node. The results presented show the improvement in performance using just OpenMP programming for a problem with a single element in the simulation, and using the multilevel programming approach for a simulation using multiple elements in the VCFEM. The scalability of the multilevel parallel programming method is also discussed.

Keywords

Multilevel parallel programming MPI OpenMP three-dimensional finite elements Voronoi cell finite elements

Get full access to this article

View all access options for this article.

References

Annamalai, V. , Krishnamoorthy, C.S. , and Kamakoti, V. 1999. Adaptive finite element analysis on a parallel and distributed environment . Parallel Computing 25(12): 1413–1434 .

Buyya, R. , editor. 1999. High Performance Cluster Computing, Prentice-Hall, Englewood Cliffs, NJ .

Cognard, J.Y. , Thomas, F. , and Verpeaux, P. 2000. An integrated approach to solving mechanical problems on parallel computers . Advances in Engineering Software 31(12): 885–899 .

Eder, P. , Giuliani, J. , and Ghosh, S. 2004. Multi-level parallel programming for multi-scale adaptive finite element modeling of heterogeneous materials . International Journal of Multiscale Computational Engineering 2(3): 421–443 .

Ennis, D. 2001. Parallel Programming Using MPI, Ohio Supercomputer Center (http://oscinfo.osc.edu/training/mpi/).

Fan, J. 2001. 3D Voronoi Cell Finite Element Method for Composite and Porous Materials. Master's Thesis, The Ohio State University.

Ghosh, S. and Moorthy, S. 1995. Elastic–plastic analysis of arbitrary heterogeneous materials with the Voronoi cell finite element method . Computer Methods in Applied Mechanics and Engineering 121: 373–409 .

Ghosh, S. and Moorthy, S. 2004. Three-dimensional Voronoi cell finite element model for modeling microstructures with ellipsoidal heterogeneities . Computational Mechanics 34(6): 510–531 .

Ghosh, S. , Nowak, Z. , and Lee, K. 1997. Tessellation-based computational methods for the characterization and analysis of heterogeneous microstructures . Composite Science and Technology 57: 1187–1210 .

10.

Giuliani, J. 2001. Multilevel Parallel Programming, Ohio Supercomputer Center (http://oscinfo.osc.edu/training/multi/).

11.

Gropp, W. , Lusk, E. , Skjellum, A. , and Doss, N. 1996. MPICH: a high performance, portable implementation for the MPI message-passing interface . Parallel Computing 22: 789– 828 (version 1.2.1).

12.

Kanapady, H. , Tamma, K.K. , Baddouran, M. , and Mark, A. 1998. High performance computing on a symmetric multiprocessor (SMP) environment for RTM process modeling of large complex structural geometries . Advances in Engineering Software 29(3–6): 399–408 .

13.

Kardenstuncer, H. , editor. 1987. Finite Element Handbook, McGraw-Hill, New York .

14.

Masters, I. , Usamani, A.S. , Cross, J.T. , and Lewis, R.W. 1997. Finite element analysis of solidification using object-oriented and parallel techniques . International Journal for Numerical Methods in Engineering 40(15): 2891–2909 .

15.

Moorthy, S. and Ghosh, S. 2000. Adaptivity and convergence in the Voronoi cell finite element model for analyzing heterogeneous materials . Computer Methods in Applied Mechanics and Engineering 185: 37–74 .

16.

Novaes de Rezende, M. and Batista de Paiva, J. 2000. A parallel algorithm for stiffness matrix assembly in a shared memory environment . Computers and Structures 76(5): 593–602 .

17.

PavanaChand, Ch. and Ghosh, S. 1998. A 3D Voronoi cell finite element model for particulate reinforced composites. Modeling and Simulation Based Engineering 1450– 1455.

18.

Plaskacz, E.J. 1997. Parallel finite element analysis via message passing . Microcomputers in Civil Engineering 12(2): 101–118 .

19.

Robertson, D. 2000. Parallel Programming Using OpenMP, Ohio Supercomputer Center (http://oscinfo.osc.edu/training/openmp/).