We introduce PVSC-DTM (Parallel Vectorized Stencil Code for Dirac and Topological Materials), a library and code generator based on a domain-specific language tailored to implement the specific stencil-like algorithms that can describe Dirac and topological materials such as graphene and topological insulators in a matrix-free way. The generated hybrid-parallel (MPI+OpenMP) code is fully vectorized using Single Instruction Multiple Data (SIMD) extensions. It is significantly faster than matrix-based approaches on the node level and performs in accordance with the roofline model. We demonstrate the chip-level performance and distributed-memory scalability of basic building blocks such as sparse matrix-(multiple-) vector multiplication on modern multicore CPUs. As an application example, we use the PVSC-DTM scheme to (i) explore the scattering of a Dirac wave on an array of gate-defined quantum dots, to (ii) calculate a bunch of interior eigenvalues for strong topological insulators, and to (iii) discuss the photoemission spectra of a disordered Weyl semimetal.
AlvermannAFehskeH (2008) Chebyshev approach to quantum systems coupled to a bath. Physical Review B77: 045125.
2.
AlvermannAFehskeH (2011) High-order commutator-free exponential time-propagation of driven quantum systems. Journal of Computational Physics230(15): 5930–5956.
3.
BandishtiVPananilathIBondhugulaU (2012) Tiling stencil computations to maximize parallelism. In: Proceedings of the international conference for high performance computing, networking, storage and analysis, Salt Lake City, UT, USA, 10–16 November 2012, pp. 1–11.
4.
BasuPVenkatAHallM, et al. (2013) Compiler generation and autotuning of communication-avoiding operators for geometric multigrid. In: 20th Annual international conference on high performance computing, Bangalore, India, 18–21 December 2013, pp. 452–461.
5.
CaridadJMConnaughtonSOttC, et al. (2016) An electrical analogy to Mie scatterings. Nature Communications7: 12894.
6.
Castro NetoAHGuineaFPeresNMR, et al. (2009) The electronic properties of graphene. Reviews of Modern Physics81: 109–162.
7.
ChamonCGoerbigMOMoessnerR, et al. (eds) (2014) Topological Aspects of Condensed Matter Physics, Lecture Notes of the Les Houches Summer School, vol. 103. Oxford: Oxford University Press.
8.
ChenCZSongJJiangH, et al. (2015) Disorder and metal-insulator transitions in Weyl semimetals. Physical Review Letters115: 246603.
9.
DattaKKamilSWilliamsS, et al. (2009) Optimization and performance modeling of stencil computations on modern microprocessors. SIAM Review51(1): 129–159.
10.
DattaKMurphyMVolkovV, et al. (2008) Stencil computation optimization and auto-tuning on state-of-the-art multicore architectures. In: Proceedings of the 2008 ACM/IEEE conference on supercomputing, SC ‘08. Piscataway, NJ, USA: IEEE Press. ISBN 978-1-4244-2835-9, pp. 4:1–4:12. Available at: http://dl.acm.org/citation.cfm?id=1413370.1413375 (accessed 12 September 2020).
11.
FehskeHHagerGPieperA (2015) Electron confinement in graphene with gate-defined quantum dots. Physica Status Solidi (B)252(8): 1868–1871.
12.
FehskeHSchleedeJSchubertG, et al. (2009) Numerical approaches to time evolution of complex quantum systems. Physics Letters A373: 2182–2188.
13.
FuLKaneCLMeleEJ (2007) Topological insulators in three dimensions. Physical Review Letters98: 106803.
14.
GoerbigMO (2011) Electronic properties of graphene in a strong magnetic field. Reviews of Modern Physics83: 1193–1243.
15.
GroppWDKaushikDKKeyesDE, et al. (2000) Towards realistic performance bounds for implicit CFD codes. In: KeyesDPeriauxJEcerASatofukaNFoxP (eds) Parallel Computational Fluid Dynamics 1999. Amsterdam: Elsevier. ISBN 978-0-444-82851-4, pp. 241–248. DOI: 10.1016/B978-044482851-4.50030-X.
16.
HasanMZKaneCL (2010) Colloquium: topological insulators. Reviews of Modern Physics82: 3045–3067.
17.
HasanMZXuSYBelopolskiI, et al. (2017) Discovery of Weyl fermion semimetals and topological Fermi arc states. Annual Review of Condensed Matter Physics8(1): 289–309.
18.
HeinischRLBronoldFXFehskeH (2013) Mie scattering analog in graphene: lensing, particle confinement, and depletion of Klein tunneling. Physical Review B87: 155409.
KamilSChanCOlikerL, et al. (2010) An auto-tuning framework for parallel multicore stencil computations. In: 2010 IEEE international symposium on parallel distributed processing (IPDPS), Atlanta, GA, USA, 19–23 April 2010, pp. 1–12.
KreutzerMErnstDBishopAR, et al. (2018) Chebyshev filter diagonalization on modern manycore processors and GPGPUs. In: YokotaRWeilandMKeyesDTrinitisC (eds) High Performance Computing. Cham: Springer International Publishing. ISBN 978-3-319-92040-5, pp. 329–349.
23.
KreutzerMPieperAHagerG, et al. (2015) Performance engineering of the kernel polynomial method on large-scale CPU-GPU systems. In: 2015 IEEE international parallel and distributed processing symposium, Hyderabad, India, 25–29 May 2015, pp. 417–426.
24.
KreutzerMThiesJRöhrig-ZöllnerM, et al. (2017) GHOST: building blocks for high performance sparse linear algebra on heterogeneous systems. International Journal of Parallel Programming45(5): 1046–1072.
25.
L’EcuyerPSimardR (2007) TestU01: a C library for empirical testing of random number generators. ACM Transactions on Mathematical Software33(4): 22:1–22:40.
26.
LiRXiYVecharynskiE, et al. (2016) A thick-restart Lanczos algorithm with polynomial filtering for Hermitian eigenvalue problems. SIAM Journal on Scientific Computing38(4): A2512–A2534.
27.
LiuSOhtsukiTShindouR (2016) Effect of disorder in a three-dimensional layered Chern insulator. Physical Review Letters116: 066401.
28.
MalasTMHagerGLtaiefH, et al. (2017) Multidimensional intratile parallelization for memory-starved stencil computations. ACM Transactions on Parallel Computing4(3): 12:1–12:32.
29.
MarsagliaG (2003) Xorshift RNGs. Journal of Statistical Software8(1): 1–6.
30.
McCalpinJD (1991–2007) STREAM: sustainable memory bandwidth in high performance computers. Technical report, University of Virginia, Charlottesville, VA. Available at: http://www.cs.virginia.edu/stream/. A continually updated technical report (accessed 12 September 2020).
PieperAFehskeH (2016) Topological insulators in random potentials. Physical Review B93: 035123.
33.
PieperAHeinischRLFehskeH (2013) Electron dynamics in graphene with gate-defined quantum dots. EPL (Europhysics Letters)104(4): 47010.
34.
PieperAKreutzerMAlvermannA, et al. (2016) High-performance implementation of Chebyshev filter diagonalization for interior eigenvalue computations. Journal of Computational Physics325: 226–243.
35.
PixleyJHGoswamiPDas SarmaS (2015) Anderson localization and the quantum phase diagram of three dimensional disordered Dirac semimetals. Physical Review Letters115: 076601.
36.
QiXLZhangSC (2011) Topological insulators and superconductors. Reviews of Modern Physics83: 1057–1110.
37.
Ragan-KelleyJBarnesCAdamsA, et al. (2013) Halide: a language and compiler for optimizing parallelism, locality, and recomputation in image processing pipelines. In: Proceedings of the 34th ACM SIGPLAN conference on programming language design and implementation, PLDI ‘13. New York, NY, USA: ACM. ISBN 978-1-4503-2014-6, pp. 519–530.
38.
RandlesAPKaleVHammondJ, et al. (2013) Performance analysis of the lattice Boltzmann model beyond Navier-Stokes. In: 2013 IEEE 27th international symposium on parallel and distributed processing, Boston, MA, USA, 20–24 May 2013, pp. 1063–1074.
39.
RiveraGTsengCW (2000) Tiling optimizations for 3D scientific computations. In: Supercomputing, ACM/IEEE 2000 conference, Dallas, TX, USA, USA, 4–10 November 2000, pp. 32–32.
40.
SchmittCKuckukSHannigF, et al. (2014) ExaSlang: a domain-specific language for highly scalable multigrid solvers. In: 2014 Fourth international workshop on domain-specific languages and high-level frameworks for high performance computing, pp. 42–51. DOI: 10.1109/WOLFHPC.2014.11.
41.
SchubertGFehskeH (2012) Metal-to-insulator transition and electron-hole puddle formation in disordered graphene nanoribbons. Physical Review Letters108: 066402.
42.
SchubertGFehskeHFritzL, et al. (2012) Fate of topological-insulator surface states under strong disorder. Physical Review B85: 201105.
43.
SchubertGSchleedeJFehskeH (2009) Anderson disorder in graphene nanoribbons: a local distribution approach. Physical Review B79: 235116.
SitteMRoschAAltmanE, et al. (2012) Topological insulators in magnetic fields: Quantum Hall effect and edge channels with a nonquantized θ term. Physical Review Letters108: 126807.
46.
StengelHTreibigJHagerG, et al. (2015) Quantifying performance bottlenecks of stencil computations using the Execution-Cache-Memory model. In: Proceedings of the 29th ACM international conference on supercomputing, ICS ‘15. New York, NY, USA: ACM. DOI: 10.1145/2751205.2751240.
47.
SuYWangXSWangSR (2017) A generic phase between disordered Weyl semimetal and diffusive metal. Scientific Reports7: 14382.
48.
Tal-EzerHKosloffR (1984) An accurate and efficient scheme for propagating the time dependent Schrödinger equation. The Journal of Chemical Physics81(9): 3967–3971.
49.
TangYCaoXGuoR, et al. (2016) Flat-lens focusing of electron beams in graphene. Scientific Reports6: 33522.
50.
TangYChowdhuryRAKuszmaulBC, et al. (2011) The Pochoir stencil compiler. In: Proceedings of the twenty-third annual ACM symposium on parallelism in algorithms and architectures, SPAA ‘11. New York, NY, USA: ACM. ISBN 978-1-4503-0743-7, pp. 117–128.
51.
VignaS (2017) Further scramblings of Marsaglia’s xorshift generators. Journal of Computational and Applied Mathematics315: 175–181.
52.
WallsJHadadD (2015) Suppressing Klein tunneling in graphene using a one-dimensional array of localized scatterers. Scientific Reports5: 8435.
53.
WanXTurnerAMVishwanathA, et al. (2011) Topological semimetal and Fermi-arc surface states in the electronic structure of pyrochlore iridates. Physical Review B83: 205101.
WeißeAWelleinGAlvermannA, et al. (2006) The kernel polynomial method. Reviews of Modern Physics78: 275–306.
56.
WilliamsSWatermanAPattersonD (2009) Roofline: an insightful visual performance model for multicore architectures. Communications of the ACM52(4): 65–76.
57.
WonnacottDG (2000) Using time skewing to eliminate idle time due to memory bandwidth and network limitations. In: International parallel and distributed processing symposium, Cancun, Mexico, 1–5 May 2000, pp. 171–180.
58.
XuSYBelopolskiIAlidoustN, et al. (2015) Discovery of a Weyl fermion semimetal and topological Fermi arcs. Science349(6248): 613–617.
59.
YangKYLuYMRanY (2011) Quantum Hall effects in a Weyl semimetal: possible application in pyrochlore iridates. Physical Review B84: 075129.
60.
ZhangNDriscollMMarkleyC, et al. (2017) Snowflake: a lightweight portable stencil DSL. In: 2017 IEEE international parallel and distributed processing symposium workshops (IPDPSW), Lake Buena Vista, FL, USA, 29 May–2 June 2017, pp. 795–804.
61.
ZhaoYXWangZD (2015) Disordered Weyl semimetals and their topological family. Physical Review Letters114: 206602.
