Deployment Options
There are many options for where you use Cohere's models including:
- Cohere Platform
- Cloud AI Platforms
- Amazon
- Oracle
- Private Deployment (on cloud or on-premises)
Cohere Platform
Section titled “Cohere Platform”Get started with LLMs instantly through Cohere's Software as a Service (SaaS) platform, all without managing backend infrastructure.
Cloud AI Platforms
Section titled “Cloud AI Platforms”Use Cohere's models through a variety of platforms such as Amazon SageMaker, Amazon Bedrock and OCI Generative AI.
Amazon
Section titled “Amazon”Developers can access a range of Cohere’s language models in a private environment via Amazon’s AWS Cloud platform. Cohere’s models are supported on two Amazon services: Amazon SageMaker and Amazon Bedrock.
Amazon SageMaker
Section titled “Amazon SageMaker”Amazon SageMaker is a service that allows customers to prepare data and build, train, and deploy machine learning (ML) models for any use case with fully managed infrastructure, tools, and workflows. Read about SageMaker here.
Cohere offers a comprehensive suite of generative and embedding models through SageMaker on a range of hardware options, many of which support finetuning for deeper customization and performance.
View Cohere's products on Amazon SageMaker. See here for more detailson how to use Cohere with SageMaker.
Amazon Bedrock
Section titled “Amazon Bedrock”Amazon Bedrock is a fully managed service where foundational models from Cohere are made available through a single, server less API. Read about Bedrock here.
Cohere has two flagship offerings available on-demand through Bedrock: Command and the Embed v3 family of models. Fine tuning is also supported for the Command and Command-Light models. Cohere will continue to add products and services to Bedrock in the coming months.
View Cohere’s products on Amazon Bedrock. See here for more details on how to use Cohere with Bedrock.
Pricing
Section titled “Pricing”The latest pricing for Cohere’s models can all be viewed directly from from the listing pages on our Amazon Bedrock and Amazon SageMaker marketplaces. If you have any questions about pricing or deployment options, please contact our sales team.
Oracle Cloud Infrastructure Generative AI is a fully managed service that enables you to use Cohere's generative and embedding models through an API. See here for more detailson how to use Cohere with Oracle.
Private Deployments
Section titled “Private Deployments”Bring Cohere's models into your own infrastructure, whether in the cloud or on-premises. You will need a license and image tag provided by Cohere in order to proceed with private deployments. To get this contact sales here.. See here for more details on how to use Cohere with your own infrastructure.