Borrowing the Night: Reclaiming Idle Inference GPUs for Research

Runway built a capacity controller called deckard that reallocates GPUs between production inference and research based on daily demand cycles, using queueing theory to optimize allocations so that production tracks demand without over-provisioning and more GPUs are available for research overnight.