From the source
From the source
Ai2 replaced a priority-based GPU scheduler with budgets and fair-share allocation.
Ai2's AI Infrastructure team replaced a priority-based GPU scheduler with a system using GPU time budgets, hierarchical fair-share allocation, and a time-slicing contract.
The change shifted GPU time allocation from case-by-case operational decisions to a transparent administrative budgeting process, aiming to prioritize high-impact research while maintaining full cluster occupancy.
From the source
We recently replaced a priority-based scheduler with a system including GPU time budgets, hierarchical fair-share allocation, and a time-slicing contract. As a result, we shifted the debate about how much GPU time each research project deserves from a case-by-case operational task to a transparent administrative budgeting process.
allenai.org
