A significant challenge on an exascale computer is the speed at which we compute results exceeds by many orders of magnitude the speed at which we save these results. Therefore the Exascale Computing Project (ECP) ALPINE project focuses on providing exascale-ready visualization solutions including in situ processing. In situ visualization and analysis runs as the simulation is run, on simulations results are they are generated avoiding the need to save entire simulations to storage for later analysis. The ALPINE project made post hoc visualization tools, ParaView and VisIt, exascale ready and developed in situ algorithms and infrastructures. The suite of ALPINE algorithms developed under ECP includes novel approaches to enable automated data analysis and visualization to focus on the most important aspects of the simulation. Many of the algorithms also provide data reduction benefits to meet the I/O challenges at exascale. ALPINE developed a new lightweight in situ infrastructure, Ascent.
AhrensJPGeveciBLawCC (2005) Paraview: an end-user tool for large-data visualization. The Visualization Handbook. München: Elsevier, Vol. 717, 717–731. ISBN 9780123875822.
3.
AhrensJJourdainSO’LearyP, et al. (2015) An image-based approach to extreme scale in situ visualization and analysis. In: International conference for high performance computing, networking, storage and analysis, SC 2015, Austin, TX, 20 November 2015. DOI: 10.1109/SC.2014.40.
4.
AlbertFCouprieMEDebusA, et al. (2021) 2020 roadmap on plasma accelerators. New Journal of Physics23(3): 031101. DOI: 10.1088/1367-2630/abcc62.
5.
AlexanderFJAngJBilbreyJA, et al. (2021) Co-design center for exascale machine learning technologies (exalearn). The International Journal of High Performance Computing Applications35(6): 598–616. DOI: 10.1177/10943420211029302.
6.
AndersonRAndrejJBarkerA, et al. (2021) Mfem: a modular finite element methods library. Computers & Mathematics with Applications81: 42–74. DOI: 10.1016/j.camwa.2020.06.009. https://www.sciencedirect.com/science/article/pii/S0898122120302583Development and Application of Open-source Software for Problems with Numerical PDEs.
7.
AyachitUBauerACBoeckelB, et al. (2021) Catalyst revised: rethinking the ParaView in situ analysis and visualization API. In: JagodeHAnztHLtaiefH, et al. (eds) High Performance Computing. Cham: Springer International Publishing, 484–494. ISBN 978-3-030-90539-2.
8.
BeckingsaleDABurmarkJHornungR, et al. (2019) Raja: portable performance for large-scale scientific applications2019 IEEE/ACM international workshop on performance, portability and productivity in HPC (P3HPC), Denver, CO, USA, 22 November 2019. DOI: 10.1109/P3HPC49587.2019.00012.
9.
BiswasADuttaSLawrenceE, et al. (2021) Probabilistic data-driven sampling via multi-criteria importance analysis. IEEE Transactions on Visualization and Computer Graphics27(12): 4439–4454. DOI: 10.1109/TVCG.2020.3006426.
10.
BiswasADuttaSTurtonTL, et al. (2022) Sampling for scientific data analysis and reduction. In: ChildsHBennettJCGarthC (eds) In Situ Visualization for Computational Science. Cham: Springer International Publishing, 11–36.
11.
BorghesiGKrismanALuT, et al. (2018) Direct numerical simulation of a temporally evolving air/n-dodecane jet at low-temperature diesel-relevant conditions. Combustion and Flame195: 183–202. DOI: 10.1016/j.combustflame.2018.02.020. https://www.sciencedirect.com/science/article/pii/S0010218018300920Special Commemorative Issue: Professor Chung King.
12.
BujackRHagenH (2017) Moment invariants for multi-dimensional data. Modeling, Analysis, and Visualization of Anisotropy. Berlin: Springer, 43–64.
13.
BujackRRogersDHAhrensJ (2018) Reducing occlusion in cinema databases through feature-centric visualizations. Leipzig Symposium on Visualization In Applications (LEVIA), Leipzig, Germany, 3 July 2018, Vol. 2.
14.
BujackRZhangXSukT, et al. (2022) Systematic generation of moment invariant bases for 2d and 3d tensor fields. Pattern Recognition123: 108313.
15.
CarrHSnoeyinkJAxenU (2003) Computing contour trees in all dimensions. Computational Geometry: Theory and Applications24(2): 75–94.
16.
CarrHAWeberGHSewellCM, et al. (2021) Scalable contour tree computation by data parallel peak pruning. IEEE Transactions on Visualization and Computer Graphics27(4): 2437–2454. DOI: 10.1109/TVCG.2019.2948616.
17.
CarrHARubelOWeberGH, et al. (2022a) Optimization and augmentation for data parallel contour trees. IEEE Transactions on Visualization and Computer Graphics28(10): 3471–3485. DOI: 10.1109/TVCG.2021.3064385.
18.
CarrHARübelOWeberGH (2022b) Distributed hierarchical contour trees. 2022 IEEE 12th symposium on large data analysis and visualization (LDAV), Oklahoma City, OK, USA, 16 October 2022. DOI: 10.1109/LDAV57265.2022.9966394.
19.
ChildsHBruggerEWhitlockB, et al. (2012) Visit: an end-user tool for visualizing and analyzing very large data. High Performance Visualization–Enabling Extreme-Scale Scientific Insight. Boca Raton, FL, USA: Chapman and Hall/CRC, 357–372. DOI: 10.1201/b12985.
DiSCappelloF (2016) Fast error-bounded lossy hpc data compression with sz. 2016 IEEE international parallel and distributed processing symposium (IPDPS), Chicago, Illinois USA, 23 May 2016. DOI: 10.1109/IPDPS.2016.11.
22.
DuttaSLipsaDTurtonTL, et al. (2022a) In situ analysis and visualization of extreme-scale particle simulations. In: AnztHBienzALuszczekP, et al. (eds) High Performance Computing. ISC High Performance 2022 International Workshops. Cham: Springer International Publishing, 283–294.
FedeliLHueblABoillod-CerneuxF, et al. (2022) Pushing the frontier in the design of laser-based electron accelerators with groundbreaking mesh-refined particle-in-cell simulations on exascale-class supercomputers. SC22: International Conference for High Performance Computing, Networking, Storage and Analysis. New York: ACM Gordon Bell Prize, 1–12. Winning Paper, 2022. DOI: 10.1109/SC41404.2022.00008.
25.
HarrisonCLarsenMRyujinBS, et al. (2022) Conduit: a successful strategy for describing and sharing data in situ. In: 2022 IEEE/ACM International Workshop on in Situ Infrastructures for Enabling Extreme-Scale Analysis and Visualization (ISAV). Los Alamitos, CA, USA: IEEE Computer Society, pp. 1–6. DOI: 10.1109/ISAV56555.2022.00006. https://doi.ieeecomputersociety.org/10.1109/ISAV56555.2022.00006.
26.
Henry de FrahanMTEsclapezLRoodJ, et al. (2024) The Pele Simulation Suite for Reacting Flows at Exascale Proceedings of the 2024 SIAM Conference on Parallel Processing for Scientific Computing. New Delhi: SIAM. DOI: 10.1137/1.9781611977967.2.
27.
HerouxMShendeSWillenbringJ (2023) The Extreme-Scale Scientific Software Stack. https://ecp-data-vis-sdk.github.io/.
28.
HristovPWeberGHCarrHA, et al. (2020) Data parallel hypersweeps for in situ topological analysis. 2020 IEEE 10th symposium on large data analysis and visualization (LDAV), Salt Lake City, UT, USA, 25 October 2020. DOI: 10.1109/LDAV51489.2020.00008.
29.
LarsenMBruggerEChildsH, et al. (2015) Strawman: a batch in situ visualization and analysis infrastructure for multi-physics simulation codes. Proceedings of the First Workshop on in Situ Infrastructures for Enabling Extreme-Scale Analysis and Visualization, ISAV2015. New York, NY, USA: Association for Computing Machinery, 30–35. ISBN 9781450340038. DOI: 10.1145/2828612.2828625.
30.
LarsenMAhrensJAyachitU, et al. (2017) The alpine in situ infrastructure: ascending from the ashes of strawman. Proceedings of the in Situ Infrastructures on Enabling Extreme-Scale Analysis and Visualization, ISAV’17. New York, NY, USA: Association for Computing Machinery, 42–46. ISBN 9781450351393. DOI: 10.1145/3144769.3144778.
31.
LarsenMWoodsAMarsagliaN, et al. (2018) A flexible system for in situ triggers. Proceedings of the Workshop on in Situ Infrastructures for Enabling Extreme-Scale Analysis and Visualization, ISAV ’18. New York, NY, USA: Association for Computing Machinery, 1–6. ISBN 9781450365796. DOI: 10.1145/3281464.3281468.
32.
LarsenMHarrisonCTurtonTL, et al. (2021) Trigger happy: assessing the viability of trigger-based in situ analysis. 2021 IEEE 11th symposium on large data analysis and visualization (LDAV), New Orleans, LA, USA, 25 October 2021. DOI: 10.1109/LDAV53230.2021.00010.
33.
LawsonMHarrisonCBruggerE, et al. (2021) Automated in situ computational steering using ascent’s capable yes-no machine. ISAV’21: In Situ Infrastructures for Enabling Extreme-Scale Analysis and Visualization, ISAV’21. New York, NY, USA: Association for Computing Machinery, 24–30. ISBN 9781450387156. DOI: 10.1145/3490138.3490144.
34.
LindstromP (2014) Fixed-rate compressed floating-point arrays. IEEE Transactions on Visualization and Computer Graphics20(12): 2674–2683. DOI: 10.1109/TVCG.2014.2346458.
35.
MarsagliaNKawakamiYSchwartzSD, et al. (2021) An entropy-based approach for identifying user-preferred camera positions. 2021 IEEE 11th symposium on large data analysis and visualization (LDAV), New Orleans, LA, USA, 25 October 2021. DOI: 10.1109/LDAV53230.2021.00015.
36.
MarsagliaNMajumderMChildsH (2022a) A trigger-based approach for optimizing camera placement over time. 2022 IEEE/ACM international workshop on in situ infrastructures for enabling extreme-scale analysis and visualization (ISAV), Dallas, TX, USA, 13 November 2022. DOI: 10.1109/ISAV56555.2022.00008.
37.
MarsagliaNMathaiMFieldsS, et al. (2022b) Automatic in situ camera placement for isosurfaces of large-scale scientific simulations. In: BujackRTiernyJSadloF (eds) Eurographics Symposium on Parallel Graphics and Visualization. Bangor, Wales: The Eurographics Association, 49–59. ISBN 978-3-03868-175-5. DOI: 10.2312/pgv.20221065.
38.
MorelandKSewellCUsherW, et al. (2016) Vtk-m: accelerating the visualization toolkit for massively threaded architectures. IEEE Computer Graphics and Applications36(3): 48–58. DOI: 10.1109/MCG.2016.48.
MorozovDPeterkaT (2016) Block-parallel data analysis with DIY2. 6th IEEE symposium on large data analysis and visualization (LDAV), Baltimore, MD, USA, 23 October 2016. DOI: 10.1109/LDAV.2016.7874307.
41.
MusserJAlmgrenASFullmerWD, et al. (2022) Mfix-exa: a path toward exascale cfd-dem simulations. The International Journal of High Performance Computing Applications36(1): 40–58. DOI: 10.1177/10943420211009293.
42.
PetruzzaSTreichlerSPascucciV, et al. (2018) Babelflow: an embedded domain specific language for parallel analysis and visualization. 2018 IEEE international parallel and distributed processing symposium (IPDPS), Vancouver, BC, Canada, 21 May 2018.
SaneSChildsH (2022) Exploratory time-dependent flow visualization via in situ extracted Lagrangian representations. In: ChildsHBennettJCGarthC (eds) In Situ Visualization for Computational Science. Cham: Springer International Publishing, 91–109.
45.
SaneSBujackRChildsH (2018) Revisiting the evaluation of in situ Lagrangian analysis. EGPGV@ EuroVis, Odense, Denmark, 27 May 2018.
46.
SaneSJohnsonCRChildsH (2021a) Investigating in situ reduction via Lagrangian representations for cosmology and seismology applications. In: PaszynskiMKranzlmüllerDKrzhizhanovskayaVV, et al. (eds) Computational Science – ICCS 2021. Cham: Springer International Publishing, 436–450.
47.
SaneSYenpureABujackR, et al. (2021b) Scalable in situ computation of Lagrangian representations via local flow maps. In: LarsenMSadloF (eds) Eurographics Symposium on Parallel Graphics and Visualization. Yarmouth Port: The Eurographics Association, 19–29. ISBN 978-3-03868-138-0. DOI: 10.2312/pgv.20211040.
ShudlerSBremerPT (2022) Streaming Statistics. Livermore, CA (United States): Lawrence Livermore National Lab.(LLNL). Technical report.
50.
ShudlerSPetruzzaSPascucciV, et al. (2021) Portable and composable flow graphs for in situ analytics. 2021 IEEE 11th symposium on large data analysis and visualization (LDAV), New Orleans, LA, USA, 25 October 2021.
TsaiKCBujackRGeveciB, et al. (2020) Approaches for in situ computation of moments in a data-parallel environment. In: FreySHuangJSadloF (eds) Eurographics Symposium on Parallel Graphics and Visualization. Yarmouth Port: The Eurographics Association, 57–68. ISBN 978-3-03868-107-6. DOI: 10.2312/pgv.20201075.
53.
VTK-h (2019) VTK-h – a Toolkit of Scientific Visualization Algorithms for Emerging Processor Architectures. https://github.com/Alpine-DAV/vtk-h.
54.
WestfallPH (2014) Kurtosis as peakedness, 1905 - 2014. R.I.P. The American Statistician68(3): 191–195. DOI:10.1080/00031305.2014.917055.
55.
ZhangWAlmgrenABecknerV, et al. (2019) AMReX: a framework for block-structured adaptive mesh refinement. Journal of Open Source Software4(37): 1370.
