Aymara Python SDK#

Hi! 👋 We’re Aymara. We help you measure and improve the alignment of any generative AI model (e.g., a fine-tuned Llama) or application (e.g., a GPT-powered chatbot).

What You Can Do#

Use Aymara to create custom evals for:

  • 🦺 Safety: Input a content policy, and evaluate an AI’s compliance.

  • 🧨 Jailbreaks: Evaluate an AI’s resilience against hundreds of jailbreak attempts.

  • 🎯 Accuracy: Evaluate an AI’s understanding of a knowledge base and detect hallucinations.

  • 🖼️ Multimodal: Evaluate text-to-image AI as well as text-to-text AI.

  • 🌐 Multilingual: Evaluate AI across English, Spanish, French, Italian, Portuguse, and German.

  • 🔄 Multiturn (coming soon): Run automated multi-turn conversations to evaluate an AI more deeply.

Aymara scores an AI’s responses, explains failures in plain language, and gives actionable guidance to improve safety and accuracy.


Getting Started#

  1. Sign Up & Get Your API Key

  1. Install the Python SDK

pip install aymara-ai-sdk

      For full details, see the Python SDK README and SDK Reference.

  1. Explore User Guides

      Check out our User Guides to see full workflows from start to finish.


Community & Support#