2017 CHPC National Conference

Session

4 Dec 2017, 11:00

Velmoré Hotel Estate

Conveners

Storage and I/O: I

• Jay Lofstead (Sandia National Laboratories)
• Peter Braam (-)

Description

Understanding and Customizing Storage Systems:

General purpose storage systems aim to offer a least common denominator that works well enough for a variety of workloads. With inevitable failures and potential data loss at scale, it is important to understand what the chances are for data loss to minimize the probability. With this kind of knowledge, robust storage with interfaces customized to particular application requirements can be deployed. Through programmable storage systems interfaces, custom service features can be combined limiting overheads from unnecessary services. Using these tools, new kinds of storage services focused on data contents and quality of service requirements can be addressed. This session presents talks investigating understanding storage system component failures, programmable storage, and user-defined metadata services.

Organiser: Jay Lofstead (SANDIA)

Contribution list Timetable

211. Scientific Modeling of Storage System Reliability

Dr Matthew Curry (Sandia National Laboratories)

04/12/2017, 11:00

Storage and I/O

Talk

When designing large scale storage systems, failure is always a serious concern that demands constant attention. However, the ability for system designers to objectively evaluate their risk of data loss for a given storage system is minimal. Instead, they must enumerate possible failure modes, estimate their relative probability, identify possible mitigations, and decide whether the expense is...

212. Programmable Storage Systems

Prof. Carlos Maltzahn (University of California, Santa Cruz)

04/12/2017, 11:25

Storage and I/O

Talk

Storage systems need to support high-performance for special-purpose data processing applications that run on an evolving storage device technology landscape. This puts tremendous pressure on storage systems to support rapid change both in terms of their interfaces and their performance. But adapting storage systems can be difficult because unprincipled changes might jeopardize years of...

213. EMPRESS--Extensible Metadata PRovider for Extreme-scale Scientific Simulations

Dr Jay Lofstead (Sandia National Laboratories)

04/12/2017, 11:50

Storage and I/O

Talk

Significant challenges exist in the efficient retrieval of data from extreme-scale simulations. An important and evolving method of addressing these challenges is application-level metadata management. Historically, HDF5 and NetCDF have eased data retrieval by offering rudimentary attribute capabilities that provide basic metadata. ADIOS simplified data retrieval by utilizing metadata for each...

226. HPC Storage – the two distinct challenges

Dr Wolfgang Mertz (CTO HPC Dell EMC Isilon)

04/12/2017, 12:15

Storage and I/O

Talk

Traditionally when architecting the storage for an HPC environment the focus is on performance of the file system. There is another challenge though, as one has to manage all the files that are used for input or created as output, typically over a long period of time. There is even value in this data that can be mined via modern analytics methods (aka Hadoop) or used for AI/ML. This session...