HTTP API
EvalCase
A single test case inside an EvalSuite.
Shape: object
| Property | Required | Type | Description | Rules |
|---|---|---|---|---|
id |
no | string (uuid) |
The case identifier. | — |
suiteId |
yes | string (uuid) |
The identifier of the suite this case belongs to. | — |
seq |
yes | integer (int32) |
The sequence number within the suite (starts at 0). | pattern `^-?(?:0\ |
query |
yes | string |
The query text sent to the agent. | — |
expectedOutput |
no | string |
The expected output. Referenced by the containsExpected check. |
— |
expectedToolCalls |
no | array of EvalExpectedToolCall |
The tool calls this case expects, by name and optionally by arguments. | — |
context |
no | string |
Text given to the model as extra context. | — |
sourceRunId |
no | string (uuid) |
The run the case was generated from. null when hand-written. |
— |
sourceKind |
no | null oneOf EvalCaseSource |
— | — |
promotedAt |
no | string (date-time) |
The promotion time. null when hand-written. |
— |
parameters |
no | object |
Values for the target agent’s IReadOnlyList<AgentParameter> AgentDefinition.Parameters schema. null for an agent that declares no parameters. |
— |