Interface CompletionsCache

Caching configuration for the request. Cache is only supported for non-streaming requests.

interface CompletionsCache {
    enabled: boolean;
    filter?: JSONObject;
    threshold?: number;
}

Properties

enabled: boolean

Indicates whether caching is enabled.

Filter criteria for caching.

threshold?: number

Threshold for caching the request; required if caching is enabled.