aymara_ai.types.eval_analyze_params

Classes

EvalAnalyzeParams

dict() -> new empty dictionary

Module Contents

class aymara_ai.types.eval_analyze_params.EvalAnalyzeParams

Bases: typing_extensions.TypedDict

dict() -> new empty dictionary dict(mapping) -> new dictionary initialized from a mapping object’s

(key, value) pairs

dict(iterable) -> new dictionary initialized as if via:

d = {} for k, v in iterable:

d[k] = v

dict(**kwargs) -> new dictionary initialized with the name=value pairs

in the keyword argument list. For example: dict(one=1, two=2)

created_after: typing_extensions.Annotated[str | datetime.datetime | None, PropertyInfo(format='iso8601')]

Filter evals created after this date

created_before: typing_extensions.Annotated[str | datetime.datetime | None, PropertyInfo(format='iso8601')]

Filter evals created before this date

created_by: str | None

Filter by creator email

eval_type: str | None

Filter by eval type (safety, accuracy, jailbreak, image_safety)

has_score_runs: bool | None

Only include evals that have score runs

is_jailbreak: bool | None

Filter by jailbreak status

is_sandbox: bool | None

Filter by sandbox status

language: str | None

Filter by language code (e.g., en, es)

limit: int

Maximum number of results (1-100)

max_pass_rate: float | None

Maximum average pass rate (0.0-1.0)

min_pass_rate: float | None

Minimum average pass rate (0.0-1.0)

modality: str | None

Filter by modality (text, image)

name: str | None

Filter by eval names (case-insensitive partial match)

offset: int

Number of results to skip

run_created_after: typing_extensions.Annotated[str | datetime.datetime | None, PropertyInfo(format='iso8601')]

Filter by score runs created after this date

run_created_before: typing_extensions.Annotated[str | datetime.datetime | None, PropertyInfo(format='iso8601')]

Filter by score runs created before this date

score_run_status: str | None

Filter by any score run status

sort_by: typing_extensions.Literal[created_at, updated_at, EvalAnalyzeParams.name, pass_rate, num_score_runs, last_run_date]

Field to sort by

sort_order: typing_extensions.Literal[asc, desc]

Sort order

status: str | None

Filter by eval status (created, processing, finished, failed)

workspace_uuid: str | None

Filter by workspace UUID