HTTP API
EvalCaseInput
Input shape of an eval case (in a request).
Shape: object
| Property | Required | Type | Description | Rules |
|---|---|---|---|---|
id |
no | string (uuid) |
The identifier of the case this entry is, or null to create a new one. |
— |
query |
yes | string |
Query text to send to the agent. | — |
expectedOutput |
no | string |
Expected output. | — |
expectedToolCalls |
no | array of EvalExpectedToolCall |
Tool calls the agent is expected to make, read by the toolCallArgsMatch check. Each entry is {"name": ..., "arguments": {...}}; without arguments the entry checks only that the tool was called. Listed arguments must all be carried by one call to that tool, which may carry others, and values compare by JSON meaning. |
— |
context |
no | string |
Text to give the model as extra context. | — |
parameters |
no | object |
Values for the target agent’s parameter schema, or null for an agent that declares none. |
— |