# Lovable — Routing Billions of Tokens per Minute

- Company: Lovable (lovable.dev)
- Announced: 2026-03-04T23:00:00+00:00
- Category: not stated
- Coverage: not counted
- Announcement: no
- Group: routine
- Source: https://lovable.dev/blog/routing-billions-of-tokens-per-minute
- Record: https://forck.live/items/12101-routing-billions-of-tokens-per-minute
- Subject: Lovable / AI app builder

Lovable's infrastructure team describes how it routes traffic across multiple LLM providers at over one billion tokens per minute, using multiple fallback chains with project-level affinity to preserve prompt caching and automatically adjusting provider weights via a PID controller to handle outages and rate limits.

## Evidence

Verbatim from https://lovable.dev/blog/routing-billions-of-tokens-per-minute:

> To preserve prompt caching while still handling failures, we don't rely on a single global fallback chain. Instead, we generate multiple fallback chains with different providers as the first choice. Each project is assigned one of these chains and keeps it for a short window of time, so that consecutive requests for the project are routed consistently.

---

Record: https://forck.live/items/12101-routing-billions-of-tokens-per-minute
Catalogue: https://forck.live/llms.txt
Current issue: https://forck.live/feed.md