ADIOS Storage and in situ I:O Tutorial

April 13, 2021 all-day
Ashley Barker

This tutorial was held on April 13, 2021, as part of the 2021 ECP Annual Meeting.

As concurrency and complexity continue to increase on high-end machines, I/O performance is rapidly becoming a fundamental challenge to achieving exascale computing. To address this challenge, wider adoption of higher-level I/O abstractions will be critically important. The ADIOS I/O framework provides data models, portable APIs, storage abstractions, in situ infrastructure, and self-describing data containers. These capabilities enable reproducible science, allow for more effective data management throughout the data life cycle, and facilitate parallel I/O with high performance and scalability.

In this tutorial, participants learned about the ADIOS concept and APIs and we showed a pipeline of a simulation, analysis and visualization, using both storage I/O and in situ data staging. Participants also learned how to use state-of-the art compression techniques with ADIOS. Finally, we discussed how to use ADIOS on the LCFs for the best storage performance, in situ data analysis and code coupling. This is a short, 2-hour long tutorial that aimed to teach the basic concepts, demonstrated the capabilities and provided pointers to interested parties to incorporate ADIOS into their science applications.