Standard Vault Overview
A Standard Vault is a Cohere-managed, single-tenant inference environment. You get dedicated infrastructure with full control over model selection, scaling, and performance monitoring, without operating the underlying serving stack. Your data is protected in transit and at rest, and Cohere manages maintenance, deployments, updates, and scaling.
Choose Standard Vault when you want dedicated inference and don't require hardware-backed protection of data in use or verifiable remote attestation. If you do, see Encrypted Vaults.
Deploying and using a Standard Vault
Section titled “Deploying and using a Standard Vault”Standard vaults use the shared vault flow:
What's specific to Standard Vault
Section titled “What's specific to Standard Vault”Architecture
Section titled “Architecture”These are a Standard Vault's core architectural components:
- Logically isolated: Isolates all infrastructure components, including the network load balancer, reverse proxy, serving middleware, inference servers, and GPU accelerators.
- Minimal shared components: Shared infrastructure is limited to authentication and underlying Kubernetes/compute resources (nodes, CPU, and memory).
- Cohere-managed operations: Cohere handles maintenance, deployments, updates, and scaling.