Private Deployment – Setting Up

When you sign up for private deployment, you will receive two key pieces of information:

1. A license key for authenticating and pulling model containers
2. A list of artifacts (docker containers) that you can pull using the license key

You can then use the license to pull and run the images, as described in the provisioning guide.

Different models require different hardware requirements, depending on the model types (for example, Command, Embed, and Rerank) and their different versions.

During the engagement, you will be provided with the specific requirements, which will include:

• GPU model, count, and interconnect requirements
• System requirements
• Software and driver versions