Caching configuration for a request. Cache is only supported for non-streaming requests.

interface ChatsCache {
    enabled?: boolean;
    filter?: JSONObject;
    threshold?: number;
}

Properties

enabled?: boolean

Whether to enable caching for the current request.

filter?: JSONObject

Filter criteria for caching.

threshold?: number

Threshold for caching the request; required if cache is enabled.