The configuration for a Predicted Output, which can greatly improve response times when large parts of the model response are known ahead of time. This is most common when you are regenerating a file with only minor changes to most of the content.

interface ChatsPrediction {
    content: string | ChatsTextContentPart[];
    type: string;
}

Properties

Properties

content: string | ChatsTextContentPart[]

Content that should be matched when generating a model response. If generated tokens would match this content, the entire model response can be returned much more quickly.

type: string

Type of predicted content you want to provide, should always be "content".