The IDEAS Productivity project, in partnership with the DOE Computing Facilities of the ALCF, OLCF, and NERSC and the DOE Exascale Computing Project (ECP) is resuming the webinar series on Best Practices for HPC Software Developers, which we began in 2016.
As part of this series, we will offer one-hour webinars on topics in scientific software development and high-performance computing, approximately once a month. Participation is free and open to the public, but registration will be required for each event.
The next webinar in the series was titled “Managing Defects in HPC Software Development”, and was be presented by Dr. Tom Evans of the Oak Ridge National Laboratory and PI of the ECP Application Development Project titled, Coupled Monte Carlo Neutronics and Fluid Flow Simulation of Small Modular Reactors (ExaSMR). The webinar took place on Wednesday, November 1, at 1:00 pm ET.
Software Quality Engineering (SQE) and methods research and scientific investigation are often thought to be incompatible. However, in reality they are not only compatible, but required in order to have confidence in the results of even basic scientific computations. This is especially true for parallel software. In this talk we will look at methods for performing software verification. Software verification is a method for removing defects at code construction time; these techniques can help in both algorithm and method development, as well as increased productivity.
The DOE Exascale Computing Project (ECP) is pleased to have sponsored a webinar presented by Sameer Shende of the University of Oregon on the TAU Performance System. The webinar took place on Wednesday, November 8, at 1:00 pm ET. You will find the presentation materials including the slides and video below.
Abstract: The complex nature of HPC platforms and the application development environment, combining multiple languages, programming paradigms, hardware, and compilers, make effective performance engineering a challenging task. To meet the needs of computational scientists in performance engineering their codes, we present a webinar on the TAU Performance System.
TAU is a powerful profiling and tracing toolkit that covers multiple aspects of performance instrumentation, measurement, and analysis. After describing and demonstrating how performance data is collected using TAU’s automated instrumentation, the workshop will present ways to analyze the performance data collected and to drill down to find performance bottlenecks. Topics will cover generating performance profiles and traces with memory and system load utilization metrics, I/O, communication, and hardware performance counter data using PAPI, compiler-based instrumentation, callsite-profiling, generating OTF2 traces natively, using TAU for evaluating CUDA and Python based applications, and the advances in TAU that are being designed as part of the ECP Proteas project. The workshop will cover instrumentation of Hybrid MPI and OpenMP codes, and the use of TAU for profiling Kokkos based applications using the Kokkos Profiling Interface.
This BoF explores the challenges and opportunities of Exascale Computing. The motivations for exascale are centered on drivers such as economic competitiveness, national security, health care, energy, manufacturing, materials, and science. This session gathers a forum of HPC experts to identify what they consider to be key challenges in achieving exascale computing and how they would best propose to meet them, with special attention to collaboration opportunities. A few of the key topics include: exascale eco-system elements, lessons from establishing public/private partnerships, impact of exascale R&D investments on the broader HPC community. Significant audience participation will be encouraged.
Join us and meet the ECP leadership team for a lively discussion on the challenges and opportunities of Exascale Computing.
BOF will be held in the Colorado Convention Center rooms 301, 302, and 303.
The IDEAS Productivity project, in partnership with the DOE Computing Facilities of the ALCF, OLCF, and NERSC and the DOE Exascale Computing Project (ECP) is resuming the webinar series on Best Practices for HPC Software Developers, which we began in 2016.
As part of this series, we will offer one-hour webinars on topics in scientific software development and high-performance computing, approximately once a month. Participation is free and open to the public, but registration will be required for each event.
The next webinar in the series took place on December 6, 2017 and was titled “Better Scientific Software”.
Better Scientific Software (BSSw) is an organization dedicated to improving developer productivity and software sustainability for computational science and engineering (CSE). This presentation introduced a new website (https://bssw.io)—a community exchange for scientific software improvement. We’re creating a clearinghouse to gather, discuss, and disseminate experiences, techniques, tools, and other resources to improve software productivity and sustainability for CSE. Site users can find information on scientific software topics and can propose to curate or create new content based on their own experiences. The backend enables collaborative content development using standard GitHub tools and processes. We need your contributions to build the BSSw site into a vibrant resource, with content and editorial processes provided by volunteers throughout the international CSE community.
The IDEAS Productivity project, in partnership with the DOE Computing Facilities of the ALCF, OLCF, and NERSC and the DOE Exascale Computing Project (ECP) has resumed the webinar series on Best Practices for HPC Software Developers, which we began in 2016.
As part of this series, we offer one-hour webinars on topics in scientific software development and high-performance computing, approximately once a month. Participation is free and open to the public, but registration is required for each event.
The next webinar in the series was titled “Bringing Best Practices to a Long-Lived Production Code“, and was presented by Dr. Charles R. Ferenbaugh of Los Alamos National Laboratory. The webinar took place on Wednesday, January 17, 2018 at 1:00 pm ET.
Abstract:
How can you introduce best software practices to a long-lived scientific production code, with a significant user base, that has “gotten along fine” for years doing things its own way? Often developers in such projects must struggle with overly complex code, inadequate documentation, little or no software process, and a “just write the code fast” culture; these are challenges to software quality that are generally not issues for new projects. In this presentation the speaker discussed some of the peculiar problems faced by long-lived codes, and present a case study of how they are dealing with these issues in the xRage code at LANL.
The IDEAS Productivity project, in partnership with the DOE Computing Facilities of the ALCF, OLCF, and NERSC and the DOE Exascale Computing Project (ECP) has resumed the webinar series on Best Practices for HPC Software Developers, which we began in 2016.
As part of this series, we offer one-hour webinars on topics in scientific software development and high-performance computing, approximately once a month. Participation is free and open to the public, but registration is required for each event. The next webinar in the series was titled “Jupyter and HPC: Current State and Future Roadmap”, and was presented by Matthias Bussonnier (UC Berkeley), Shreyas Cholia (LBNL), and Suhas Somnath (ORNL). The webinar took place on Wednesday, February 28, 2018 at 1:00 pm ET.
Abstract:
During the last few years the Jupyter notebook has become one of the tools of choice for the data science and high-performance computing (HPC) communities. This webinar will provide an overview of why Jupyter is gaining traction in education, data science, and HPC, with emphasis on how notebooks can be used as interactive documents for exploration and reporting. We will present an overview of how Jupyter works and how the network protocol can be leveraged for both a local single machine and remote-cluster work. We will discuss the nuts and bolts of how Jupyter has been deployed at NERSC as a case study in implementation of Jupyter in an HPC environment. This work implies learning the Jupyter ecosystem to take advantage of its powerful abstractions to develop custom infrastructure to satisfy policies and user needs. The webinar showed, as a use case, how Jupyter notebooks have transformed data discovery, visualization, and interactive analysis for the scanning probe and electron microscopy communities at Oak Ridge National Laboratory. It also showed how notebooks can seamlessly accommodate measurements from a wide variety of instruments through Pycroscopy, a framework for instrument agnostic data storage and analysis.
The IDEAS Productivity project, in partnership with the DOE Computing Facilities of the ALCF, OLCF, and NERSC and the DOE Exascale Computing Project (ECP) has resumed the webinar series on Best Practices for HPC Software Developers, which we began in 2016.
As part of this series, we offer one-hour webinars on topics in scientific software development and high-performance computing, approximately once a month. Participation is free and open to the public, but registration is required for each event. The next webinar in the series was titled “Scientific Software Development with Eclipse”, and was presented by Gregory Watson of ORNL. The webinar took place on Wednesday, March 21, 2018 at 1:00 pm ET.
Abstract:
The Eclipse IDE is one of the most popular IDEs available, and its support for multiple languages, particularly C, C++ and Fortran has made it the go to IDE for scientific software development. Although an IDE like Eclipse can provide advanced development capabilities such as code recommendation and refactoring, these features can be difficult to utilize for complex code bases. Other challenges, such as ease of installation and use, reliability, and compatibility with existing development practices also play a role. Ultimately the usefulness of the tool is a tradeoff between the capabilities it provides and the challenges of incorporating it into the development workflow. This webinar will demonstrate some of the latest features available in Eclipse that are particularly useful for scientific application development, and examine how they can be used in a variety of different scenarios using realistic sample codes.
The IDEAS Productivity project, in partnership with the DOE Computing Facilities of the ALCF, OLCF, and NERSC and the DOE Exascale Computing Project (ECP) has resumed the webinar series on Best Practices for HPC Software Developers, which we began in 2016.
As part of this series, we offer one-hour webinars on topics in scientific software development and high-performance computing, approximately once a month. Participation is free and open to the public, but registration is required for each event. The next webinar in the series was titled “Software Citation Today and Tomorrow”, and was presented by Dan Katz. The webinar took place on Wednesday, April 18, 2018 at 1:00 pm ET.
Abstract:
Software is increasingly important in research, and some of the scholarly communications community, for example, in FORCE11, has been pushing the concept of software citations as a method to allow software developers and maintainers to get academic credit for their work: software releases are published and assigned DOIs, and software users then cite these releases when they publish research that uses the software. This webinar discussed the state of software citation, starting with history of work done by the FORCE11 Software Citation Working Group, leading to a published set of software citation principles (https://doi.org/10.7717/peerj-cs.86), as well as other prior work. It will also talk about where the community is going, what the obstacles to progress are, and how they may be overcome.
The IDEAS Productivity project, in partnership with the DOE Computing Facilities of the ALCF, OLCF, and NERSC and the DOE Exascale Computing Project (ECP) has resumed the webinar series on Best Practices for HPC Software Developers, which we began in 2016.
As part of this series, we offer one-hour webinars on topics in scientific software development and high-performance computing, approximately once a month. Participation is free and open to the public, but registration is required for each event. The next webinar in the series was titled “On-demand Learning for Better Scientific Software: How to Use Resources & Technology to Optimize your Productivity”, and was presented by Dr. Elaine Raybourn. The webinar took place on Wednesday, May 9, 2018 at 1:00 pm ET.
Abstract:
Continual advances in new technologies for computational science often require members of the HPC community to learn new tools, techniques, or processes on-demand, or outside of a formal education setting. While the variety of media and deluge of content make on-demand learning a reality, very few learners apply guiding principles from learning science to set themselves up for success. Applying on-demand learning strategies for self-paced “learning in the wild” can augment professional learning courses from EdX, Udacity, and YouTube. Employing use cases and examples from Python and Git, this webinar will demonstrate how to develop a personalized learning framework leveraging massively open online courses (MOOC), podcasts, social media, videos, and more. A walk through of relevant learning applications will be provided. Participants of this webinar will take away practical strategies, resources, and tools that can be applied toward learning more productively in general, and specifically to software development.
The IDEAS Productivity project, in partnership with the DOE Computing Facilities of the ALCF, OLCF, and NERSC and the DOE Exascale Computing Project (ECP) has resumed the webinar series on Best Practices for HPC Software Developers, which we began in 2016.
As part of this series, we offer one-hour webinars on topics in scientific software development and high-performance computing, approximately once a month. The next webinar in the series is titled “Popper: Creating Reproducible Computational and Data Science Experimentation Pipelines”, and was presented by Ivo Jimenez of UC Santa Cruz. The webinar took place on Wednesday, June 13, 2018 at 1:00 pm ET.
Abstract:
Current approaches used in computational and data science research may require significant time without necessarily advancing scientific understanding. For example, researchers may spend countless hours reformatting data and writing code to attempt to reproduce previously published research. What if the scientific community could find a better way to create and publish workflows, data, and models that are easy to reproduce, thus streamlining scientific analysis? Popper is a protocol and command language interpreter (CLI) tool for implementing scientific exploration pipelines following a DevOps approach of unifying software development and operation in order to handle complexity in large codebases. Popper repurposes DevOps practices in the context of scientific explorations, so that researchers can leverage existing tools and technologies to enable reproducibility. This webinar will introduce the Popper protocol, including a demo of the CLI tool and HPC examples.
