Lead story
Models & availability
Latest
← Feed
Copy✕ Close copy menu
Torch compile caching for inference speed
Replicate announces caching of torch.compile artifacts to reduce boot times for models using PyTorch, with specific models starting 2-3x faster and cold boot times reduced by 50-62%.
From the source
We now cache torch.compile artifacts to reduce boot times for models that use PyTorch.
replicate.com
Visit source ↗replicate.com
- Announced
- 08 Sep 2025 00:00 UTC
- Detected
- 03 Aug 2026 21:12 UTC (+329d after)
