Interface Metadata

interface Metadata {
    cost?: number;
    model_family?: string;
    recommender_label?: string;
    region?: string;
}

Properties

cost? model_family? recommender_label? region?

Properties

Optional cost

cost?: number

The cost per 1000 tokens for the model. This represents the pricing in USD for processing 1000 tokens. A nil value indicates the cost is not available or applicable.

Optional model_family

model_family?: string

The family or series that this model belongs to. Examples:

  • "gpt-3.5" for GPT-3.5 series models
  • "gpt-4" for GPT-4 series models
  • "llama-2" for Llama 2 series models.

Optional recommender_label

recommender_label?: string

When calling the Recommender API, this value is used to map to the supported model in the Recommender API. For example, "openai-gpt-4o-mini" could be the recommender label for a specific model.

Optional region

region?: string

The region where this model is deployed in. This indicates the geographical location of the model deployment. Important for data residency requirements and latency considerations.

Settings

Member Visibility

Theme

On This Page

costmodel_familyrecommender_labelregion