# EvalStoreContract > Tracon documentation. Tracon is a .NET package family that adds a control > plane on Microsoft Agent Framework, published as NuGet packages that run > inside your own ASP.NET Core application. > > Page: https://tracon.dev/api/tracon.testing.contracts.storage.evalstorecontract/ > Summary: EvalStoreContract: Behavior tests for the IEvalStore contract.

Namespace Tracon.Testing.Contracts.Storage · Assembly Tracon.Testing.Contracts.Xunit.dll

Behavior tests for the [IEvalStore](/api/tracon.ievalstore/) contract. ```csharp public abstract class EvalStoreContract : TenantIsolationContract, IAsyncLifetime, IAsyncDisposable ```

Inheritance: object ← StoreCancellationContract<IEvalStore> ← TenantIsolationContract<IEvalStore> ← EvalStoreContract
Implements: IAsyncLifetime, IAsyncDisposable
Inherited Members: TenantIsolationContract<IEvalStore>.TenantA, TenantIsolationContract<IEvalStore>.TenantB, TenantIsolationContract<IEvalStore>.UseAmbientTenant(MutableTenantContext), TenantIsolationContract<IEvalStore>.SeedAsync(string, string, CancellationToken), TenantIsolationContract<IEvalStore>.ExistsAsync(string, object), TenantIsolationContract<IEvalStore>.CountAsync(string, CancellationToken), TenantIsolationContract<IEvalStore>.TryDeleteAsync(string, object), TenantIsolationContract<IEvalStore>.TryOverwriteAsync(string, string), TenantIsolationContract<IEvalStore>.CancellableReadAsync(CancellationToken), TenantIsolationContract<IEvalStore>.CancellableWriteAsync(CancellationToken), TenantIsolationContract<IEvalStore>.WroteAnythingAsync(), TenantIsolationContract<IEvalStore>.Tenant_cannot_read_another_tenants_record(), TenantIsolationContract<IEvalStore>.Tenant_reads_its_own_record(), TenantIsolationContract<IEvalStore>.Tenant_does_not_see_another_tenants_record_in_the_list(), TenantIsolationContract<IEvalStore>.Tenant_cannot_delete_another_tenants_record(), TenantIsolationContract<IEvalStore>.Same_name_lives_independently_across_two_tenants(), TenantIsolationContract<IEvalStore>.AmbientTenant, StoreCancellationContract<IEvalStore>.CreateStoreAsync(), StoreCancellationContract<IEvalStore>.InitializeAsync(), StoreCancellationContract<IEvalStore>.DisposeAsync(), StoreCancellationContract<IEvalStore>.OnDisposeAsync(), StoreCancellationContract<IEvalStore>.CancellableReadAsync(CancellationToken), StoreCancellationContract<IEvalStore>.CancellableWriteAsync(CancellationToken), StoreCancellationContract<IEvalStore>.WroteAnythingAsync(), StoreCancellationContract<IEvalStore>.Canceled_token_throws_on_read(), StoreCancellationContract<IEvalStore>.The_write_this_contract_checks_can_be_read_back(), StoreCancellationContract<IEvalStore>.Canceled_token_throws_on_write_and_leaves_no_trace(), StoreCancellationContract<IEvalStore>.Store, object.GetType(), object.MemberwiseClone(), object.ToString(), object.Equals(object?), object.Equals(object?, object?), object.ReferenceEquals(object?, object?), object.GetHashCode()

## Constructors ### EvalStoreContract\(\) ```csharp protected EvalStoreContract() ``` ## Properties ### QualifiedEvalCasesTable The fully qualified `eval_cases` table reference this provider's raw SQL should use. ```csharp protected virtual string QualifiedEvalCasesTable { get; } ``` #### Property Value [string](https://learn.microsoft.com/dotnet/api/system.string) ### SupportsRawSql Whether this store's backing state can be written to directly (SQL providers only). ```csharp protected virtual bool SupportsRawSql { get; } ``` #### Property Value [bool](https://learn.microsoft.com/dotnet/api/system.boolean) ## Methods ### A\_row\_written\_before\_expected\_tool\_calls\_existed\_reads\_back\_its\_names\(\) A row written before `expected_tool_calls` existed holds only the comma separated names of `expected_tools`; it reads back as calls without arguments. ```csharp [Fact] public Task A_row_written_before_expected_tool_calls_existed_reads_back_its_names() ``` #### Returns [Task](https://learn.microsoft.com/dotnet/api/system.threading.tasks.task) The test task. ### AddCaseAsync\_assigns\_seq\_atomically\(\) ```csharp [Fact] public Task AddCaseAsync_assigns_seq_atomically() ``` #### Returns [Task](https://learn.microsoft.com/dotnet/api/system.threading.tasks.task) ### AddCaseAsync\_concurrent\_promotions\_produce\_distinct\_seq\(\) ```csharp [Fact] public Task AddCaseAsync_concurrent_promotions_produce_distinct_seq() ``` #### Returns [Task](https://learn.microsoft.com/dotnet/api/system.threading.tasks.task) ### AddCaseAsync\_does\_not\_separate\_sourceless\_cases\_from\_hand\_written\_ones\(\) ```csharp [Fact] public Task AddCaseAsync_does_not_separate_sourceless_cases_from_hand_written_ones() ``` #### Returns [Task](https://learn.microsoft.com/dotnet/api/system.threading.tasks.task) ### AddCaseAsync\_returns\_the\_existing\_case\_the\_second\_time\_for\_the\_same\_source\_run\_id\(\) ```csharp [Fact] public Task AddCaseAsync_returns_the_existing_case_the_second_time_for_the_same_source_run_id() ``` #### Returns [Task](https://learn.microsoft.com/dotnet/api/system.threading.tasks.task) ### AddCaseAsync\_stores\_source\_fields\_and\_expected\_fields\(\) ```csharp [Fact] public Task AddCaseAsync_stores_source_fields_and_expected_fields() ``` #### Returns [Task](https://learn.microsoft.com/dotnet/api/system.threading.tasks.task) ### AddCaseAsync\_stores\_the\_parameter\_values\_of\_a\_promoted\_run\(\) A promoted case carries the parameter values its source run recorded, and they survive the read back. ```csharp [Fact] public Task AddCaseAsync_stores_the_parameter_values_of_a_promoted_run() ``` #### Returns [Task](https://learn.microsoft.com/dotnet/api/system.threading.tasks.task) The test task. #### Remarks Without them a promoted case of a parameterized agent fails on a missing value, or runs on a default the production run never used. ### Case\_result\_is\_recorded\_and\_filtered\_by\_tenant\(\) ```csharp [Fact] public Task Case_result_is_recorded_and_filtered_by_tenant() ``` #### Returns [Task](https://learn.microsoft.com/dotnet/api/system.threading.tasks.task) ### CountAsync\(string, CancellationToken\) Reports how many records the given tenant sees through the listing endpoint. ```csharp protected override ValueTask CountAsync(string tenantId, CancellationToken cancellationToken) ``` #### Parameters `tenantId` [string](https://learn.microsoft.com/dotnet/api/system.string) The reading tenant. `cancellationToken` [CancellationToken](https://learn.microsoft.com/dotnet/api/system.threading.cancellationtoken) The token every store call inside the hook must be handed; see [TenantIsolationContract.SeedAsync](/api/tracon.testing.contracts.storage/). #### Returns [ValueTask](https://learn.microsoft.com/dotnet/api/system.threading.tasks.valuetask\-1)<[int](https://learn.microsoft.com/dotnet/api/system.int32)\> The number of records seen. ### DeleteSuiteAsync\_also\_deletes\_its\_cases\_and\_runs\(\) ```csharp [Fact] public Task DeleteSuiteAsync_also_deletes_its_cases_and_runs() ``` #### Returns [Task](https://learn.microsoft.com/dotnet/api/system.threading.tasks.task) ### DiffRunsAsync\_counts\_a\_case\_recorded\_twice\_once\(\) ```csharp [Fact] public Task DiffRunsAsync_counts_a_case_recorded_twice_once() ``` #### Returns [Task](https://learn.microsoft.com/dotnet/api/system.threading.tasks.task) ### DiffRunsAsync\_refuses\_an\_unfinished\_run\(\) ```csharp [Fact] public Task DiffRunsAsync_refuses_an_unfinished_run() ``` #### Returns [Task](https://learn.microsoft.com/dotnet/api/system.threading.tasks.task) ### DiffRunsAsync\_refuses\_two\_runs\_of\_different\_suites\(\) ```csharp [Fact] public Task DiffRunsAsync_refuses_two_runs_of_different_suites() ``` #### Returns [Task](https://learn.microsoft.com/dotnet/api/system.threading.tasks.task) ### DiffRunsAsync\_returns\_null\_for\_an\_unknown\_run\(\) ```csharp [Fact] public Task DiffRunsAsync_returns_null_for_an_unknown_run() ``` #### Returns [Task](https://learn.microsoft.com/dotnet/api/system.threading.tasks.task) ### DiffRunsAsync\_returns\_null\_for\_another\_tenants\_run\(\) ```csharp [Fact] public Task DiffRunsAsync_returns_null_for_another_tenants_run() ``` #### Returns [Task](https://learn.microsoft.com/dotnet/api/system.threading.tasks.task) ### DiffRunsAsync\_separates\_the\_six\_buckets\(\) ```csharp [Fact] public Task DiffRunsAsync_separates_the_six_buckets() ``` #### Returns [Task](https://learn.microsoft.com/dotnet/api/system.threading.tasks.task) ### DiffRunsAsync\_throws\_when\_retention\_removed\_only\_SOME\_of\_the\_results\(\) ```csharp [Fact] public Task DiffRunsAsync_throws_when_retention_removed_only_SOME_of_the_results() ``` #### Returns [Task](https://learn.microsoft.com/dotnet/api/system.threading.tasks.task) ### DiffRunsAsync\_throws\_when\_the\_baseline\_details\_were\_removed\_by\_retention\(\) ```csharp [Fact] public Task DiffRunsAsync_throws_when_the_baseline_details_were_removed_by_retention() ``` #### Returns [Task](https://learn.microsoft.com/dotnet/api/system.threading.tasks.task) ### DiffRunsAsync\_throws\_when\_the\_candidate\_details\_were\_removed\_by\_retention\(\) ```csharp [Fact] public Task DiffRunsAsync_throws_when_the_candidate_details_were_removed_by_retention() ``` #### Returns [Task](https://learn.microsoft.com/dotnet/api/system.threading.tasks.task) ### ExecuteRawAsync\(string\) Runs raw SQL against the backing store. Only called when [EvalStoreContract.SupportsRawSql](/api/tracon.testing.contracts.storage.evalstorecontract/#Tracon_Testing_Contracts_Storage_EvalStoreContract_SupportsRawSql) is [true](https://learn.microsoft.com/dotnet/csharp/language-reference/builtin-types/bool). ```csharp protected virtual ValueTask ExecuteRawAsync(string sql) ``` #### Parameters `sql` [string](https://learn.microsoft.com/dotnet/api/system.string) The statement. #### Returns [ValueTask](https://learn.microsoft.com/dotnet/api/system.threading.tasks.valuetask) A task that completes when the statement has run. ### ExistsAsync\(string, object\) Reports whether the record is visible from the given tenant's viewpoint. ```csharp protected override ValueTask ExistsAsync(string tenantId, object key) ``` #### Parameters `tenantId` [string](https://learn.microsoft.com/dotnet/api/system.string) The reading tenant. `key` [object](https://learn.microsoft.com/dotnet/api/system.object) The key returned by [TenantIsolationContract.SeedAsync](/api/tracon.testing.contracts.storage/). #### Returns [ValueTask](https://learn.microsoft.com/dotnet/api/system.threading.tasks.valuetask\-1)<[bool](https://learn.microsoft.com/dotnet/api/system.boolean)\> [true](https://learn.microsoft.com/dotnet/csharp/language-reference/builtin-types/bool) if the record is visible. ### FormatIdForRawSql\(Guid\) Formats an id for embedding in raw SQL. A provider that stores a [Guid](https://learn.microsoft.com/dotnet/api/system.guid) as text and compares case-sensitively (SQLite, in uppercase) must override the default (lowercase [Guid.ToString](https://learn.microsoft.com/dotnet/api/system.guid)). ```csharp protected virtual string FormatIdForRawSql(Guid id) ``` #### Parameters `id` [Guid](https://learn.microsoft.com/dotnet/api/system.guid) The id. #### Returns [string](https://learn.microsoft.com/dotnet/api/system.string) The id as the provider spells it. ### GetSuiteAsync\_returns\_null\_for\_another\_tenant\(\) ```csharp [Fact] public Task GetSuiteAsync_returns_null_for_another_tenant() ``` #### Returns [Task](https://learn.microsoft.com/dotnet/api/system.threading.tasks.task) ### ListSuitesAsync\_returns\_only\_that\_tenant\(\) ```csharp [Fact] public Task ListSuitesAsync_returns_only_that_tenant() ``` #### Returns [Task](https://learn.microsoft.com/dotnet/api/system.threading.tasks.task) ### QueryRunsAsync\_filters\_by\_suite\_and\_puts\_the\_newest\_first\(\) ```csharp [Fact] public Task QueryRunsAsync_filters_by_suite_and_puts_the_newest_first() ``` #### Returns [Task](https://learn.microsoft.com/dotnet/api/system.threading.tasks.task) ### ReplaceCasesAsync\_assigns\_sequence\_numbers\_and\_replaces\_previous\_cases\(\) ```csharp [Fact] public Task ReplaceCasesAsync_assigns_sequence_numbers_and_replaces_previous_cases() ``` #### Returns [Task](https://learn.microsoft.com/dotnet/api/system.threading.tasks.task) ### ReplaceCasesAsync\_keeps\_an\_identifier\_it\_was\_given\(\) ```csharp [Fact] public Task ReplaceCasesAsync_keeps_an_identifier_it_was_given() ``` #### Returns [Task](https://learn.microsoft.com/dotnet/api/system.threading.tasks.task) ### ReplaceCasesAsync\_keeps\_the\_promotion\_fields\_it\_was\_given\(\) ```csharp [Fact] public Task ReplaceCasesAsync_keeps_the_promotion_fields_it_was_given() ``` #### Returns [Task](https://learn.microsoft.com/dotnet/api/system.threading.tasks.task) ### ReplaceCasesAsync\_leaves\_parameters\_null\_for\_a\_case\_that\_declares\_none\(\) ```csharp [Fact] public Task ReplaceCasesAsync_leaves_parameters_null_for_a_case_that_declares_none() ``` #### Returns [Task](https://learn.microsoft.com/dotnet/api/system.threading.tasks.task) ### ReplaceCasesAsync\_reads\_back\_an\_empty\_list\_for\_a\_case\_that\_expects\_no\_tool\_call\(\) A case that expects no tool call reads back an empty list, never [null](https://learn.microsoft.com/dotnet/csharp/language-reference/keywords/null). ```csharp [Fact] public Task ReplaceCasesAsync_reads_back_an_empty_list_for_a_case_that_expects_no_tool_call() ``` #### Returns [Task](https://learn.microsoft.com/dotnet/api/system.threading.tasks.task) The test task. ### ReplaceCasesAsync\_round\_trips\_an\_expected\_argument\_of\_every\_json\_kind\(\) An argument of every JSON kind survives the round trip, and a call without arguments stays distinct from one with an empty set. ```csharp [Fact] public Task ReplaceCasesAsync_round_trips_an_expected_argument_of_every_json_kind() ``` #### Returns [Task](https://learn.microsoft.com/dotnet/api/system.threading.tasks.task) The test task. #### Remarks The column is `jsonb` in PostgreSQL and text elsewhere. `jsonb` normalizes number spelling and object member order, so the comparison is by JSON meaning; an argument that comes back as a different KIND (a number as a string, a nested object as text) is the failure this guards. ### ReplaceCasesAsync\_stores\_expected\_tool\_calls\_and\_context\(\) ```csharp [Fact] public Task ReplaceCasesAsync_stores_expected_tool_calls_and_context() ``` #### Returns [Task](https://learn.microsoft.com/dotnet/api/system.threading.tasks.task) ### ReplaceCasesAsync\_stores\_parameter\_values\_for\_a\_parameterized\_agent\(\) ```csharp [Fact] public Task ReplaceCasesAsync_stores_parameter_values_for_a_parameterized_agent() ``` #### Returns [Task](https://learn.microsoft.com/dotnet/api/system.threading.tasks.task) ### Run\_lifecycle\_transitions\_from\_running\_to\_completed\(\) ```csharp [Fact] public Task Run_lifecycle_transitions_from_running_to_completed() ``` #### Returns [Task](https://learn.microsoft.com/dotnet/api/system.threading.tasks.task) ### Run\_reads\_do\_not\_leak\_across\_tenants\(\) ```csharp [Fact] public Task Run_reads_do_not_leak_across_tenants() ``` #### Returns [Task](https://learn.microsoft.com/dotnet/api/system.threading.tasks.task) ### SaveSuiteAsync\_assigns\_an\_id\_to\_a\_new\_suite\(\) ```csharp [Fact] public Task SaveSuiteAsync_assigns_an_id_to_a_new_suite() ``` #### Returns [Task](https://learn.microsoft.com/dotnet/api/system.threading.tasks.task) ### SaveSuiteAsync\_keeps\_the\_id\_for\_the\_same\_name\_and\_updates\(\) ```csharp [Fact] public Task SaveSuiteAsync_keeps_the_id_for_the_same_name_and_updates() ``` #### Returns [Task](https://learn.microsoft.com/dotnet/api/system.threading.tasks.task) ### SaveSuiteAsync\_round\_trips\_a\_suite\_that\_carries\_no\_checks\(\) A suite saved with no checks round-trips through every provider. ```csharp [Fact] public Task SaveSuiteAsync_round_trips_a_suite_that_carries_no_checks() ``` #### Returns [Task](https://learn.microsoft.com/dotnet/api/system.threading.tasks.task) #### Remarks The eval side of the same class as the schedule payload: the unset value used to reach the column as the literal `null`, which SQL Server's `CHECK (ISJSON(checks) = 1)` rejects. ### SeedAsync\(string, string, CancellationToken\) Writes a sample record for the given tenant. ```csharp protected override ValueTask