Sage Journals: Discover world-class research

Abstract

In this paper, we report the implementation and measured performance of our extreme-scale whole planetary ring simulation code on Sunway TaihuLight and two PEZY-SC2 systems: Shoubu System B and Gyoukou. The numerical algorithm is the parallel Barnes-Hut tree algorithm, which has been used in many large-scale astrophysical particle-based simulations. Our implementation is based on our FDPS framework. However, the extremely large numbers of cores of the systems used (10 M on TaihuLight and 16 M on Gyoukou) and their relatively poor memory and network bandwidth pose new challenges. We describe the new algorithms introduced to achieve high efficiency on machines with low memory bandwidth. The measured performance is 47.9, 10.6 PF, and 1.01PF on TaihuLight, Gyoukou and Shoubu System B (efficiency 40%, 23.5% and 35.5%). The current code is developed for the simulation of planetary rings, but most of the new algorithms are useful for other simulations, and are now available in the FDPS framework.

Keywords

HPC planetary ring heterogeneous many-core architecture Sunway TaihuLight PEZY-SC

Get full access to this article

View all access options for this article.

References

Barnes

Hut

(1986) A hiearchical o(nlogn) force calculation algorithm. Nature 324: 446–449.

Barnes

(1990) A modified tree code: don’t laugh; it runs. Journal of Computational Physics 87: 161–170.

Bédorf

Gaburov

Fujii

, et al. (2014) 24.77 pflops on a gravitational tree-code to simulate the milky way galaxy with 18600 gpus. In: SC14: International Conference for High Performance Computing, Networking, Storage and Analysis, 16–21 November 2014. New Orleans, LA, United States. pp. 54–65. Louisiana (C14-11-16).

Blelloch

Leiserson

Maggs

, et al. (1991) A comparison of sorting algorithms for the Connection Machine CM-2. In: Proceedings Symposium on Parallel Algorithms and Architectures. Hilton Head, SC, pp. 3–16.

Cai

Wang

Tang

, et al. (2018) Openacc vs the native programming on sunway taihulight: a case study with gtc-p. In: Proceedings of the IEEE International Conference on Cluster Computing, 1–4 December 2003, Hong Kong, China. pp. 88–97. IEEE.

Liao

Yang

, et al. (2016) The sunway taihulight supercomputer: system and applications. Science China Information Sciences 59(7): 072001.

Hamada

Narumi

Yokota

, et al. (2009) 42 tflops hierarchical n-body simulations on gpus with applications in both astrophysics and turbulence. In: Proceedings of the Conference on High Performance Computing Networking, Storage and Analysis, SC ‘09 . New York, NY, USA: ACM, pp. 62:1–62:12. ISBN 978-1-60558-744-8.

Ishiyama

(2014) Hierarchical Formation of Dark Matter Halos and the Free Streaming Scale. The Astrophysical Journal 788: 27.

Ishiyama

Nitadori

Makino

(2012) 4.45 pflops astrophysical n-body simulation on k computer: The gravitational trillion-body problem. In: Proceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis, SC ‘12 . Los Alamitos, CA, USA: IEEE Computer Society Press, pp. 5:1–5:10. ISBN 978-1-4673-0804-5.

10.

Iwasawa

Tanikawa

Hosono

, et al. (2016) Implementation and performance of FDPS: a framework for developing parallel particle simulation codes. Publications of the Astronomical Society of Japan 68: 54.

11.

Makino

(1991) Treecode with a special-purpose processor. Publications of the Astronomical Society of Japan 43: 621–638.

12.

Makino

(2004) A Fast Parallel Treecode with GRAPE. Publications of the Astronomical Society of Japan 56: 521–531.

13.

McMillan

SLW

Aarseth

(1993) An O(N log N) integration scheme for collisional stellar systems. The Astrophysical Journal 414: 200–212.

14.

Michikoshi

Kokubo

(2017) Simulating the smallest ring world of Chariklo. The Astrophysical Journal Letters 837: L13.

15.

Namekata

Iwasawa

Nitadori

, et al. (2018) Fortran interface layer of the framework for developing particle simulator FDPS. Publications of the Astronomical Society of Japan 70: 70.

16.

Portegies Zwart

Bédorf

(2014) Computational gravitational dynamics with modern numerical accelerators. ArXiv e-prints .

17.

Rein

Latter

(2013) Large-scale N-body simulations of the viscous overstability in Saturn’s rings. Monthly Notices of the Royal Astronomical Society 431: 145–158.

18.

Rein

Liu

(2012) REBOUND: an open-source multi-purpose N-body code for collisional dynamics. Astronomy & Astrophysics 537: A128.

19.

Salmon

Quinn

Warren

(1990) Using Parallel Computers for Very Large N-Body Simulations: Shell Formation Using 180 K Particles. Berlin, Heidelberg: Springer Berlin Heidelberg , pp. 216–218. ISBN 978-3-642-75273-5.

20.

Warren

Salmon

(1992) Astrophysical N-body simulations using hierarchical tree data structures. In: Supercomputing ‘92. Los Alamitos: IEEE Comp. Soc., pp. 570–576.

21.

Wisdom

Tremaine

(1988) Local simulations of planetary rings. The Astronomical Journa 95: 925–940.

22.

Zebker

Marouf

Tyler

(1985) Saturn’s rings: Particle size distributions for thin layer models. Icarus 64(3): 531–548.

Implementation and performance of Barnes-hut n-body algorithm on extreme-scale heterogeneous many-core architectures

Abstract

Keywords

Get full access to this article

References