30 November 2022 to 2 December 2022
Africa/Johannesburg timezone
The conference is now live. Late registrations for the physical conference can be made at the conference venue in Pretoria.

The role of storage target allocation in applications’ I/O performance with BeeGFS - a medium-sized cluster experience

2 Dec 2022, 14:00
ICC-G-Emerald - Emerald Auditorium (CSIR ICC)

ICC-G-Emerald - Emerald Auditorium


Talk Storage and IO HPC


Dr Francieli Boito (University of Bordeaux, Inria)Dr Luan Teylo (Inria)


Parallel file systems are at the core of HPC I/O infrastructures. Those systems minimize the I/O time of applications by separating files into fixed-size chunks and distributing them across multiple storage targets. Therefore, the I/O performance experienced with a PFS is directly linked to the capacity to retrieve these chunks in parallel. In this work, we conduct an in-depth evaluation of the impact of the stripe count (the number of targets used for striping) on the write performance of BeeGFS, one of the most popular parallel file systems today. We consider different network configurations and show the fundamental role played by this parameter, in addition to the number of compute nodes, processes and storage targets.
Through a rigorous experimental evaluation, we directly contradict conclusions from related work. Notably, we show that sharing I/O targets does not lead to performance degradation and that applications should use as many storage targets as possible. Our recommendations have the potential to significantly improve the overall write performance of BeeGFS deployments and also provide valuable information for future work on storage target allocation and stripe count tuning.

Primary authors

Dr Francieli Boito (University of Bordeaux, Inria) Dr Guillaume Pallez (Inria) Dr Luan Teylo (Inria)

Presentation Materials

There are no materials yet.