aymara_ai.lib.df

Functions

to_prompts_df(eval, prompts)	Create a prompts DataFrame.
to_scores_df(eval_run, prompts, responses)	Create a scores DataFrame.
to_df(results)	Convert a BaseModel or Dict to a DataFrame.
to_reports_df(suite_report)	Create report dataframe by prompt category.

Module Contents

aymara_ai.lib.df.to_prompts_df(eval, prompts)

Create a prompts DataFrame.

Parameters:

• eval (aymara_ai.types.eval.Eval)

• prompts (List[aymara_ai.types.eval_prompt.EvalPrompt])

Return type:

pandas.DataFrame

aymara_ai.lib.df.to_scores_df(eval_run, prompts, responses)

Create a scores DataFrame.

Parameters:

• eval_run (aymara_ai.types.evals.eval_run_result.EvalRunResult)

• prompts (List[aymara_ai.types.eval_prompt.EvalPrompt])

• responses (List[aymara_ai.types.evals.scored_response.ScoredResponse])

Return type:

pandas.DataFrame

aymara_ai.lib.df.to_df(results)

Convert a BaseModel or Dict to a DataFrame.

Parameters:

results (Union[List[Union[aymara_ai._models.BaseModel, Dict[str, Any]]], Dict[str, Any], aymara_ai._models.BaseModel])

Return type:

pandas.DataFrame

aymara_ai.lib.df.to_reports_df(suite_report)

Create report dataframe by prompt category.

Parameters:

suite_report (aymara_ai.types.eval_suite_report.EvalSuiteReport)

Return type:

pandas.DataFrame