Hands on Software Seminar | Franz Pöschel | 2023.04.20 скачать в хорошем качестве

Hands on Software Seminar | Franz Pöschel | 2023.04.20

TITLE: openPMD – F.A.I.R. Scientific I/O at the Exascale ABSTRACT: This seminar talk presents openPMD, an open and F.A.I.R. standard for particle-mesh data, and its impact in heterogeneous scientific workflows. Modern scientific compute models often consist of multiple distinct stages, leading to data processing pipelines consisting of multiple heterogeneous codes. Standardization of scientific data helps bridging the different models with a commonly-understood markup, creating interoperable and flexible workflows. The openPMD standard is made accessible to scientific software via the openPMD-api, a library for the description of scientific data. The backend implementations of the openPMD-api are based on established I/O framworks such as HDF5 and ADIOS2, and also include a scalable streaming backend for HPC workflows, provided by ADIOS2. The talk gives an insight into the existing ecosystem of openPMD and describes the basic concepts of the data markup. Within the talk Franz will illuminate recent trends and challenges in large-scale I/O and their impact on scientific compute workflows. While traditional attempts at counteracting such trends, e.g. through compression, remain available in the openPMD-api, Franz and his team propose loose coupling and online analysis via streaming workflows as a sustainable solution that avoids parallel filesystem bottlenecks. A short hands-on session will demonstrate how to create and interact with openPMD data. LICENSE: CC BY-SA 4.0 CASUS – Center for Advanced Systems Understanding Helmholtz-Zentrum Dresden-Rossendorf e.V. (HZDR) Untermarkt 20 D-02826 Görlitz