# Aymara Python SDK

Hi! 👋 We're [Aymara](https://aymara.ai), and we help teams at AI labs and Fortune 50 companies measure and improve the alignment of any generative AI model (e.g., a fine-tuned Llama) or application (e.g., a GPT-powered chatbot).

## What You Can Do

Use Aymara to create custom evals across safety, quality, and modalities:

<div class="eval-table">

| Eval | What it measures | Status |
| --- | --- | --- |
| 🛡️ Safety | Content policy compliance and refusals | Available |
| 🧨 Jailbreaks | Resilience to adversarial prompts | Available |
| 🤖 Agent | Tool use, planning, and multi-step execution | Available |
| 🎯 Accuracy | Knowledge grounding and hallucination control | Available |
| 🎬 Multimodal | Text-to-image and text-to-video | Available |
| 🌐 Multilingual | EN, ES, FR, IT, PT, DE | Available |
| 🗣️ Tone | Politeness, professionalism, de-escalation | Coming soon |
| 🫡&nbsp;Sycophancy | Undue agreement vs. truthful disagreement | Coming soon |
| 🚨 Escalation | Proper refusal/hand-off for risky requests | Coming soon |
| 🔄 Multiturn | Multi-step conversations and follow-ups | Coming soon |

</div>

Aymara scores responses, explains failures in plain language, and surfaces actionable fixes to boost safety and accuracy.

You can see our tools in action in two recent research projects:

<div class="research-table">

| LLM Risk & Responsibility Matrix | Gender Bias in Text‑to‑Image |
| --- | --- |
| [Key findings](https://medium.com/aymara-ai/the-aymara-llm-risk-responsibility-matrix-5a243fcf7e38) · [arXiv report](https://arxiv.org/abs/2507.14719) | [Key findings](https://medium.com/aymara-ai/we-tested-13-ai-image-generators-we-found-gender-bias-that-poses-a-major-business-risk-8b5d7e35756a) · [arXiv report](https://arxiv.org/abs/2509.07050) |
| ![LLM Safety Benchmark matrix](images/safety_matrix.png) | ![Text-to-Image gender bias graph](images/bias_graph.png) |

</div>

---

## Getting Started

1. **Sign up and secure your API key**
   Start with a [free trial](https://www.aymara.ai/risk-snapshot) or request full access via a [demo](https://aymara.ai/demo), then [create an account](https://auth.aymara.ai/en/signup) to generate your key.
2. **Install the Python SDK**

   ```bash
   pip install aymara-ai-sdk
   ```

   See the [Python SDK README](aymara-sdk-python/README.md) and [SDK Reference](sdk_reference.md) for comprehensive usage details.
3. **Explore guided workflows**  
   Browse our [User Guides](user_guides) to walk through real evaluation pipelines end to end.

---

## Community & Support

- Track issues and feature requests on [GitHub](https://github.com/aymara-ai/aymara-sdk-python/issues)
- Reach us at <support@aymara.ai> for help, feedback, or partnerships
- Check the [FAQs](faq.md) for quick troubleshooting tips

---

```{toctree}
:maxdepth: 1
:caption: Contents:

user_guides/user_guides
workspaces/workspaces.md
aymara-sdk-python/README.md
sdk_reference
faq.md
```