1-4 December 2024
Boardwalk Convention Centre
Africa/Johannesburg timezone
Keynote starting now at 19:00.

Resource Scheduling and Allocation in HPC Cyberinfrastructure

4 Dec 2024, 11:20
20m
BICC.G-D2 - D2 Tsitsikamma (Boardwalk Convention Centre)

BICC.G-D2 - D2 Tsitsikamma

Boardwalk Convention Centre

120
Talk DIRISA DIRISA

Speaker

Dr Olalekan Samuel Ogunleye* (University of Mpumalanga)

Description

Abstract
High-Performance Computing (HPC) systems play a pivotal role in modern scientific research, enabling complex simulations, data analysis, and large-scale modelling across disciplines such as climate science, genomics, physics, and engineering. As these systems grow in scale and sophistication, the efficient scheduling and allocation of computational resources become crucial for ensuring optimal system performance, maximising resource utilisation, and meeting the needs of diverse user communities. In HPC environments, resource scheduling and allocation determine how tasks are assigned to hardware resources such as CPUs, GPUs, memory, storage, and network bandwidth. Effective scheduling strategies are critical for maintaining fairness among users, optimising job throughput, reducing waiting times, and enhancing energy efficiency.
Cyberinfrastructure, the integration of advanced computing platforms with large-scale data storage and high-speed networks, addlayers of complexity to resource management. The heterogeneity of hardware, dynamic workload demands, and multi-user environments require advanced resource scheduling algorithms. Traditional approaches like First-Come, First-Served (FCFS), Shortest Job First (SJF), and Backfilling have evolved to meet these challenges, while more advanced strategies like Priority Scheduling, Gang Scheduling, and Hybrid Scheduling offer increased flexibility and efficiency. Energy-aware scheduling has also gained importance, given the significant portion of operational costs that energy consumption in large HPC systems can account for.

Primary author

Dr Olalekan Samuel Ogunleye* (University of Mpumalanga)

Presentation Materials