serverless vector and full-text search built from first principles on object storage: fast, 10x cheaper, and extremely scalable
╔═ turbopuffer ════════════════════════════╗
╔════════════╗ ║ ║░
║ ║░ ║ ┏━━━━━━━━━━━━━━━┓ ┏━━━━━━━━━━━━━━┓ ║░
║ client ║░───API──▶║ ┃ Memory/ ┃────▶┃ Object ┃ ║░
║ ║░ ║ ┃ SSD Cache ┃ ┃ Storage (S3) ┃ ║░
╚════════════╝░ ║ ┗━━━━━━━━━━━━━━━┛ ┗━━━━━━━━━━━━━━┛ ║░
░░░░░░░░░░░░░░ ║ ║░
╚══════════════════════════════════════════╝░
░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░
╔════════════╗
║ ║░
┌──║ client ║░
│ ║ ║░
API ╚════════════╝░
│ ░░░░░░░░░░░░░░
└─────────┐
│
▼
╔═ turbopuffer ════════════════╗
║ ║░
║ ┏━━━━━━━━━━━━━━━━━━━━━━━━┓ ║░
║ ┃ Memory/ ┃ ║░
║ ┃ SSD Cache ┃ ║░
║ ┗━━━━━━━━━━━━━━━━━━━━━━━━┛ ║░
║ │ ║░
║ ▼ ║░
║ ┏━━━━━━━━━━━━━━━━━━━┓ ║░
║ ┃Object storage (S3)┃ ║░
║ ┗━━━━━━━━━━━━━━━━━━━┛ ║░
║ ║░
╚══════════════════════════════╝░
░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░
Storage | <=$0.33 per GB/GB | 500K docs (~3 GB) | |
Writes | <=$2.00 per GB/GB | 10K writes, ~13 WPH (~0.07 GB) | |
Queries | <=$0.05 per TB/TB | 10K queries, ~13 QPH (~3 GB) | |
Namespaces | 5K docs per namespace/NS | 100 | Included |
Estimated cost
Approach: 3 QPS with topk=10 for 10 minutes. Reproduce with turbopuffer/tpuf-benchmark
Aman Sanger
Co-founder
Justin Watts
Distinguished Engineer
Metric | Max seen in production | Production limits (current) | Production limits (soon) |
---|---|---|---|
Max documents (global) | 125B+ | Unlimited | |
Max documents (per namespace) | 200M | 100M | 1B+ |
Number of namespaces | 35M+ | Unlimited | |
Max dimensions | 10,752 | ||
Max inactive time in cache | ~3 days | Contact us for custom | |
Write rate (global) | 1,000,000 doc/s | Unlimited | |
Write rate (per namespace) | 10,000 doc/s | 10,000 doc/s | |
Max upsert batch request size | 256 MB | 256 MB | |
Queries (global) | 6K+ queries/s | Unlimited | |
Max queries/second (per namespace) | 100+ queries/s | 100+ queries/s | 10,000 QPS |
Vector search recall@10 | 90-100% | 90-100% | Configurable |
Max attribute value | 8 MiB | 8 MiB | |
See full list and workloads that are a great fit for turbopuffer 🐡 |