The term “in situ processing” has evolved over the last decade to mean both a specific strategy for visualizing and analyzing data and an umbrella term for a processing paradigm. The resulting confusion makes it difficult for visualization and analysis scientists to communicate with each other and with their stakeholders. To address this problem, a group of over 50 experts convened with the goal of standardizing terminology. This paper summarizes their findings and proposes a new terminology for describing in situ systems. An important finding from this group was that in situ systems are best described via multiple, distinct axes: integration type, proximity, access, division of execution, operation controls, and output type. This paper discusses these axes, evaluates existing systems within the axes, and explores how currently used terms relate to the axes.
AgranovskyACampDGarthC, et al. (2014) Improved post hoc flow analysis via Lagrangian representations. In: Proceedings of the IEEE Symposium on Large Data Visualization and Analysis (LDAV). Paris, France, pp. 67–75.
2.
AyachitU (2015) The ParaView Guide: A Parallel Visualization Application. New York: Kitware. ISBN 978-1930934306.
3.
AyachitUBauerADuqueEPN, et al. (2016a) Performance analysis, design considerations, and applications of extreme-scale in situ infrastructures. In: Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis (SC16), pp. 79:1–79:12.
4.
AyachitUWhitlockBWolfM, et al. (2016b) The SENSEI Generic In Situ Interface. In: Proceedings of the Workshop on In Situ Infrastructures for Enabling Extreme-scale Analysis and Visualization (ISAV). IEEE Press, pp. 40–44.
5.
BauerACGeveciBSchroederW (2015) The ParaView Catalyst User’s Guide v2.0. New York: Kitware, Inc.
6.
ChildsHBruggerEWhitlockB, et al. (2012) VisIt: an end-user tool for visualizing and analyzing very large data. In: High Performance Visualization–Enabling Extreme-Scale Scientific Insight, pp. 357–372.
7.
ChoiJYWuKWuJC, et al. (2013) Icee: wide-area in transit data processing framework for near real-time scientific applications. In: Workshop on Petascale (Big) Data Analytics: Challenges and Opportunities, held in conjunction with SC13.
8.
DayalJBratcherDEisenhauerG, et al. (2014) Flexpath: type-based publish/subscribe system for large-scale science analytics. In: IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing, pp. 245–255.
9.
DeelmanEPeterkaTAltintasI, et al. (2015) The Future of Scientific Workflows. Technical report, Report of the DOE NFNS/CS Scientific Workflows Workshop.
10.
DiSCappelloF (2016) Fast error-bounded lossy hpc data compression with sz. In: IEEE International Parallel and Distributed Processing Symposium (IPDPS), pp. 730–739.
11.
DocanCParasharMKlaskyS (2012) Dataspaces: an interaction and coordination framework for coupled simulation workflows. Cluster Computing15(2): 163–181.
12.
DorierMAntoniuGCappelloF, et al. (2016) Damaris: addressing performance variability in data management for Post-Petascale simulations. ACM Transactions on Parallel Computing (ToPC)3(3): 15:1–15:43.
13.
EllsworthDGreenBHenzeC, et al. (2006) Concurrent visualization in a production supercomputing environment. IEEE Transactions on Visualization and Computer Graphics12(5): 997–1004.
14.
FabianNMorelandKThompsonD, et al. (2011) The Paraview Coprocessing library: a scalable, general purpose in situ visualization library. In: IEEE Symposium on Large Data Analysis and Visualization (LDAV), pp. 89–96.
15.
FogalTProchFSchieweA, et al. (2014) Freeprocessing: transparent in situ visualization via data interception. In: Eurographics Symposium on Parallel Graphics and Visualization, pp. 49–56.
16.
FrankRKroghMF (2012) The EnSight visualization application. In: High Performance Visualization-Enabling Extreme-Scale Scientific Insight, pp. 429–442.
17.
HaimesR (1994) pv3-a distributed system for large-scale unsteady cfd visualization. In: 32nd Aerospace Sciences Meeting and Exhibit, p. 321.
18.
HaimesRBarthT (1995) Application of the pV3 Co-processing visualization environment to 3-D unstructured mesh calculations on the IBM SP2 parallel computer. In: Proc. CAS Workshop.
19.
HaimesREdwardsDE (1997) Visualization in a parallel processing environment. In: 35th Aerospace Sciences Meeting and Exhibit, p. 348.
20.
HeineCLeitteHHlawitschkaM, et al. (2016) A survey of topology-based methods in visualization. Computer Graphics Forum35(3): 643–667.
21.
IbrahimSStittTLarsenM, et al. (2019) Interactive In situ visualization and analysis using ascent and Jupyter. In: Proceedings of the In Situ Infrastructures on Enabling Extreme-Scale Analysis and Visualization (ISAV), pp. 44–48.
22.
InsleyJAPapkaMEDongS, et al. (2007) Runtime visualization of the human arterial tree. IEEE Transactions on Visualization and Computer Graphics13(4): 810–821.
23.
JinTZhangFSunQ, et al. (2015) Exploring data staging across deep memory hierarchies for coupled data intensive simulation workflows. In: Proceedings of the IEEE International Parallel and Distributed Processing Symposium (IPDPS), pp. 1033–1042.
24.
JohnsonCParkerSWeinsteinD (2000) Large-scale computational science applications using the SCIRun problem solving environment. In: Proceedings of the 2000 ACM/IEEE conference on Supercomputing. Available at:http://www.sci.utah.edu/publications/crj00/super00_final.pdf. (accessed 15 June 2020)
25.
KaleLVKrishnanS (1993) Charm++: a portable concurrent object oriented system based On C++. In: Proceedings of the Eighth Annual Conference on Object-oriented Programming Systems, Languages, and Applications, pp. 91–108.
26.
KneževićJMundaniRPRankE, et al. (2012) Extending the SCIRun problem solving environment to large-scale applications. In: Proc. of The IADIS Applied Computing 2012.
27.
KressJLarsenMChoiJ, et al. (2019) Comparing the efficiency of in situ visualization paradigms at scale. In: ISC High Performance. Frankfurt, Germany, pp. 99–117.
28.
LarsenMAhrensJAyachitU, et al. (2017) The ALPINE In situ infrastructure: ascending from the ashes of Strawman. In: Proceedings of the In Situ Infrastructures on Enabling Extreme-Scale Analysis and Visualization (ISAV), pp. 42–46.
29.
LarsenMWoodsAMarsagliaN, et al. (2018) A Flexible system for in situ triggers. In: Proceedings of the Workshop on In Situ Infrastructures for Enabling Extreme-Scale Analysis and Visualization (ISAV), pp. 1–6.
30.
LindstromP (2014) Fixed-rate compressed floating-point arrays. IEEE Transactions on Visualization and Computer Graphics20(12): 2674–2683.
31.
LiuQLoganJTianY, et al. (2014) Hello ADIOS: the challenges and lessons of developing leadership class I/O frameworks. Concurrency and Computation: Practice and Experience26(7): 1453–1473.
32.
LorensenWEClineHE (1987) Marching cubes: a high resolution 3d surface construction algorithm. ACM siggraph computer graphics21(4): 163–169.
33.
MaKL (1996) Runtime volume visualization for parallel CFD. In: Parallel Computational Fluid Dynamics. Elsevier, pp. 307–314.
34.
MalakarPNatarajanVVadhiyarSS (2010) An adaptive framework for simulation and online remote visualization of critical climate applications in resource-constrained environments. In: Conference on High Performance Computing Networking, Storage and Analysis (SC).
35.
MalakarPNatarajanVVadhiyarSS (2011) Inst: an integrated steering framework for critical weather applications. In: Proceedings of the International Conference on Computational Science, ICCS 2011, pp. 116–125.
36.
MeredithJSAhernSPugmireD, et al. (2012) EAVL: the extreme-scale analysis and visualization library. In: Eurographics Symposium on Parallel Graphics and Visualization, pp. 21–30.
37.
MorelandKSewellCUsherW, et al. (2016) VTK-m: accelerating the visualization toolkit for massively threaded architectures. IEEE Computer Graphics and Applications (CG&A36(3): 48–58.
38.
OldfieldRAWombleDEOberCC (1998) Efficient parallel I/O in seismic imaging. The International Journal of High Performance Computing Applications12(3): 333–344.
39.
ParkerSBeazleyDJohnsonC (1997a) Computational steering software systems and strategies. IEEE Computational Science and Engineering4(4): 50–59.
40.
ParkerSWeinsteinDJohnsonC (1997b) The SCIRun computational steering software system. In: Modern Software Tools in Scientific Computing. Boston: Birkhauser Press, pp. 1–40.
41.
ParkerSGJohnsonCR (1995) SCIRun: a scientific programming environment for computational steering. In: Supercomputing ‘95: Proceedings of the 1995 ACM/IEEE Conference on Supercomputing, p. 52. Available at:https://ieeexplore.ieee.org/document/1383188. (accessed 15 June 2020)
42.
PebayPBennettJCHollmanD, et al. (2016) Towards asynchronous many-task in situ data analysis using legion. IEEE International Parallel and Distributed Processing Symposium Workshops (IPDPSW), pp. 1033–1037.
43.
PetersonBDasariHKHumphreyA, et al. (2015) Reducing overhead in the Uintah framework to support short-lived tasks on GPU-heterogeneous architectures. In: International Workshop on Domain-Specific Languages and High-Level Frameworks for High Performance Computing (WOLFHPC’15), pp. 4:1–4:8.
44.
SchroederWMartinKLorensenB (2004) The Visualization Toolkit: An Object Oriented Approach to 3D Graphics. 4th edn. Kitware, Inc. ISBN 1-930934-19-X.
45.
StockingerKShalfJWuK, et al. (2005) In: Proceedings of IEEE Visualization 2005 Conference (VIS’05), pp. 167–174.
46.
SubediPDavisPDuanS, et al. (2018) Scalable data resilience for in-memory data staging. In: Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis (SC18).
47.
TikhonovaACorreaCDMaKL (2010a) Explorable images for visualizing volume data. In: Proceedings of PacificVis, pp. 177–184.
48.
TikhonovaACorreaCDMaKL (2010b) Visualization by proxy: a novel framework for deferred interaction with volume data. IEEE Transactions on Visualization & Computer Graphics16(6): 1551–1559.
49.
TuTYuHRamirez-GuzmanL, et al. (2006) From mesh generation to scientific visualization: An end-to-end approach to parallel supercomputing. In: Proceedings of the ACM/IEEE Conference on Supercomputing (SC06), pp. 91:1–91:15.
50.
UsherWRizziSWaldI, et al. (2018) libIS: a lightweight library for flexible in transit visualization. In: Proceedings of the Workshop on In Situ Infrastructures for Enabling Extreme-Scale Analysis and Visualization (ISAV).
51.
VishwanathVHereldMMorozovV, et al. (2011) Topology-aware data movement and staging for i/o acceleration on blue gene/p supercomputing systems. In: Proceedings of International Conference for High Performance Computing, Networking, Storage and Analysis (SC11), pp. 19:1–19:11.
52.
WhitlockBFavreJMMeredithJS (2011) Parallel in situ coupling of simulation with a fully featured visualization system. In: Eurographics Symposium on Parallel Graphics and Visualization (EGPGV), pp. 101–109.
YeYMillerRMaKL (2013) In situ pathtube visualization with explorable images. In: Eurographics Symposium on Parallel Graphics and Visualization (EGPGV), pp. 9–16.
55.
YeYCNeurothTSauerF, et al. (2016) In situ generated probability distribution functions for interactive post hoc visualization and analysis. In: IEEE Symposium on Large Data Analysis and Visualization (LDAV), pp. 65–74.
56.
ZiegelerSAtkinsCBauerAPetteyL (2015) In situ analysis as a parallel i/o problem. In: Proceedings of the Workshop on In Situ Infrastructures for Enabling Extreme-Scale Analysis and Visualization (ISAV), pp. 13–18.
