From the source
Supabase is announcing DBArena, a site that publishes reproducible benchmarks of hosted Postgres providers, with Supabase sponsoring the project and releasing the methodology and tooling as open source.
- The first results compare Supabase Postgres with default storage, Supabase Postgres with OrioleDB,
Amazon RDS and
Google Cloud SQL at up to seven compute tiers, measured on throughput, price-performance and latency.
- Supabase says most published database benchmarks come from vendors, use mismatched instance sizes and tuned configurations, and are hard to reproduce, so DBArena runs every provider on the same workload at matched vCPU counts and I/O configuration with each provider's defaults, normalizing results for cost.
- Each product is tested in a cache-fit scenario, where the data set fits in memory with a buffer cache hit ratio of at least 99%, and a cache-exceeding scenario, where the data set is four times larger than available RAM.
