Training and deploying a fine-tuned Cohere model.

In this section, we will walk through how you can start training a fine-tuning model for Classification with both the Web UI and the Python SDK.

Creating a fine-tuned model for Classification with the Web UI consists of a few simple steps, which we'll walk through now.

Go to the fine-tuning page and click on 'Create a Classify model'.

Upload your custom dataset data by going to 'Training data' and clicking on the upload file button. Your data should be in csv or .jsonl format with exactly two columns—the first column consisting of the examples, and the second consisting of the labels.

You also have the option of uploading a validation dataset. This will not be used during training, but will be used for evaluating the model’s performance post-training. To upload a validation set, go to 'Upload validation set (optional)' and repeat the same steps you just went through with the training dataset. If you don’t upload a validation dataset, the platform will automatically set aside part of the training dataset to use for validation.

At this point in time, if there are labels in the training set with less than five unique examples, those labels will be removed.

Once done, click 'Next'.

The preview window will show a few samples of your custom training dataset, and your validation dataset (if you uploaded it).

Toggle between the 'Training' and 'Validation' tabs to see a sample of your respective datasets.

At the bottom of this page, the distribution of labels in each respective dataset is shown.

If you are happy with how the samples look, click 'Continue'.

Now, everything is set for training to begin! Click 'Start training' to proceed.

Once your model completes training, you can call it via the API. See here for an example using the Python SDK.

Text classification is one of the most common language understanding tasks. A lot of business use cases can be mapped to text classification. Examples include:

• Evaluating the tone and sentiment of an incoming customer message (e.g. classes: 'positive' and 'negative').
• Routing incoming customer messages to the appropriate agent (e.g. classes: 'billing', 'tech support', 'other').
• Evaluating if a user comment needs to be flagged for moderator attention (e.g. classes: 'flag for moderation', 'neutral').
• Evaluating which science topic a given piece of text is related to (e.g. classes: 'biology', 'physics'). Since a given piece of text might be germane to more than one topic, this is an example of 'multilabel' classification, which is discussed in more detail at the end of this document.

In addition to using the Web UI for fine-tuning models, customers can also kick off fine-tuning jobs programmatically using the Cohere Python SDK. This can be useful for fine-tuning jobs that happen on a regular cadence, such as nightly jobs on newly-acquired data.

Using co.finetuning.create_finetuned_model(), you can create a fine-tuned model using either a single-label or multi-label dataset.

Here are some example code snippets for you to use.

# create dataset
single_label_dataset = co.datasets.create(
    name="single-label-dataset",
    data=open("single_label_dataset.jsonl", "rb"),
    type="single-label-classification-finetune-input",
)

print(co.wait(single_label_dataset).dataset.validation_status)

# start the fine-tune job using this dataset
from cohere.finetuning.finetuning import (
    BaseModel,
    FinetunedModel,
    Settings,
)

single_label_finetune = co.finetuning.create_finetuned_model(
    request=FinetunedModel(
        name="single-label-finetune",
        settings=Settings(
            base_model=BaseModel(
                base_type="BASE_TYPE_CLASSIFICATION",
            ),
            dataset_id=single_label_dataset.id,
        ),
    ),
)

print(
    f"fine-tune ID: {single_label_finetune.finetuned_model.id}, fine-tune status: {single_label_finetune.finetuned_model.status}"
)

# create dataset
multi_label_dataset = co.datasets.create(
    name="multi-label-dataset",
    data=open("multi_label_dataset.jsonl", "rb"),
    type="multi-label-classification-finetune-input",
)

print(co.wait(multi_label_dataset).dataset.validation_status)

# start the fine-tune job using this dataset
from cohere.finetuning.finetuning import (
    BaseModel,
    FinetunedModel,
    Settings,
)

multi_label_finetune = co.finetuning.create_finetuned_model(
    request=FinetunedModel(
        name="multi-label-finetune",
        settings=Settings(
            base_model=BaseModel(
                base_type="BASE_TYPE_CLASSIFICATION",
            ),
            dataset_id=multi_label_dataset.id,
        ),
    ),
)

print(
    f"fine-tune ID: {multi_label_finetune.finetuned_model.id}, fine-tune status: {multi_label_finetune.finetuned_model.status}"
)

import cohere

co = cohere.Client("Your API key")
# get the custom model object (replace with your finetune name e.g. multi_label_finetune)
model_id = single_label_finetune.finetuned_model.id


response = co.classify(
    inputs=["classify this!"], model=model_id + "-ft"
)

print(response)

We can’t wait to see what you start building! Share your projects or find support on our Discord.