The configuration for a Predicted Output, which can greatly improve response times when large parts of the model
response are known ahead of time. This is most common when you are regenerating a file with only minor changes to
most of the content.
Content that should be matched when generating a model response. If generated tokens would match this
content, the entire model response can be returned much more quickly.
type
type:string
Type of predicted content you want to provide, should always be "content".
The configuration for a Predicted Output, which can greatly improve response times when large parts of the model response are known ahead of time. This is most common when you are regenerating a file with only minor changes to most of the content.