Skip to content

completionargs.md

Latest commit

 

History

History
20 lines (16 loc) · 28.2 KB

completionargs.md

File metadata and controls

20 lines (16 loc) · 28.2 KB

CompletionArgs

White-listed arguments from the completion API

Fields

Field Type Required Description Example
stop OptionalNullable[models.CompletionArgsStop] ➖ N/A
presence_penalty OptionalNullable[float] ➖ N/A
frequency_penalty OptionalNullable[float] ➖ N/A
temperature OptionalNullable[float] ➖ N/A
top_p OptionalNullable[float] ➖ N/A
max_tokens OptionalNullable[int] ➖ N/A
random_seed OptionalNullable[int] ➖ N/A
prediction OptionalNullable[models.Prediction] ➖ N/A
response_format OptionalNullable[models.ResponseFormat] ➖ N/A Example 1: {
"type": "text"
}
Example 2: {
"type": "json_object"
}
Example 3: {
"type": "json_schema",
"json_schema": {
"schema": {
"properties": {
"name": {
"title": "Name",
"type": "string"
},
"authors": {
"items": {
"type": "string"
},
"title": "Authors",
"type": "array"
}
},
"required": [
"name",
"authors"
],
"title": "Book",
"type": "object",
"additionalProperties": false
},
"name": "book",
"strict": true
}
}
tool_choice Optional[models.ToolChoiceEnum] ➖ N/A
reasoning_effort OptionalNullable[models.ReasoningEffort] ➖ N/A