Navigation
serverless vector and full-text search built from first principles on object storage: fast, 10x cheaper, and extremely scalable
╔═ turbopuffer ════════════════════════════╗
╔════════════╗ ║ ║░
║ ║░ ║ ┏━━━━━━━━━━━━━━━┓ ┏━━━━━━━━━━━━━━┓ ║░
║ client ║░───API──▶║ ┃ Memory/ ┃────▶┃ Object ┃ ║░
║ ║░ ║ ┃ SSD Cache ┃ ┃ Storage (S3) ┃ ║░
╚════════════╝░ ║ ┗━━━━━━━━━━━━━━━┛ ┗━━━━━━━━━━━━━━┛ ║░
░░░░░░░░░░░░░░ ║ ║░
╚══════════════════════════════════════════╝░
░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░
╔════════════╗
║ ║░
┌──║ client ║░
│ ║ ║░
API ╚════════════╝░
│ ░░░░░░░░░░░░░░
└─────────┐
│
▼
╔═ turbopuffer ════════════════╗
║ ║░
║ ┏━━━━━━━━━━━━━━━━━━━━━━━━┓ ║░
║ ┃ Memory/ ┃ ║░
║ ┃ SSD Cache ┃ ║░
║ ┗━━━━━━━━━━━━━━━━━━━━━━━━┛ ║░
║ │ ║░
║ ▼ ║░
║ ┏━━━━━━━━━━━━━━━━━━━┓ ║░
║ ┃Object storage (S3)┃ ║░
║ ┗━━━━━━━━━━━━━━━━━━━┛ ║░
║ ║░
╚══════════════════════════════╝░
░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░Approach: 3 QPS with topk=10 for 10 minutes. Reproduce with turbopuffer/tpuf-benchmark
Aman Sanger
Co-founder
Justin Watts
Distinguished Engineer
Moving to turbopuffer felt less like an upgrade and more like discovering a new paradigm. We didn't just save costs; we turned once-prohibitive features into standard tools in our arsenal. Vectorize all the things and say goodbye to sharding
MTL 🇨🇦
single-tenant cluster
| Metric | Max seen in production | Production limits (current) | Production limits (soon) |
|---|---|---|---|
| Max documents (global) | 125B+ | Unlimited | |
| Max documents (per namespace) | 200M | 100M | 1B+ |
| Number of namespaces | 35M+ | Unlimited | |
| Max dimensions | 10,752 | ||
| Max inactive time in cache | ~3 days | Contact us for custom | |
| Write rate (global) | 200,000 doc/s | Unlimited | |
| Write rate (per namespace) | 5,000 doc/s | 5,000 doc/s | |
| Max upsert batch request size | 256 MB | 256 MB | |
| Queries (global) | 6K+ queries/s | Unlimited | |
| Max queries/second (per namespace) | 100+ queries/s | 100+ queries/s | 10,000 QPS |
| Vector search recall@10 | 90-100% | 90-100% | Configurable |
| Max attribute value | 8 MiB | 8 MiB | |
| See full list and workloads that are a great fit for turbopuffer 🐡 |
FAQ
Yes, turbopuffer is production quality. We have powered production applications since November '23 at 99.99% uptime. We host billions of production vectors at thousands of writes per second.
We maintain SOC2 Type 2 certification and HIPAA compliance.
turbopuffer accounts are not yet generally available. We are currently focused on providing high bandwidth support to make our select early customers successful, while removing limitations. See if your workload is a good fit for turbopuffer here.
