Lead story
Ask your AI
Top stories
Models & availability
Latest
Lead story
Ask your AI
Top stories
Models & availability
Latest
Runway built a system called NCCLBack that reduces model cold-start times from minutes to seconds by broadcasting weights between GPUs instead of downloading them from storage.
From the source
How we cut model cold-start times from minutes to seconds by broadcasting weights between GPUs instead of downloading them from storage, and the sharp edges we found along the way.
runway.com