Aymara Python SDK#
Hi! 👋 We’re Aymara. We help you measure and improve the alignment of any generative AI model (e.g., a fine-tuned Llama) or application (e.g., a GPT-powered chatbot).
What You Can Do#
Use Aymara to create custom evals for:
🦺 Safety: Input a content policy, and evaluate an AI’s compliance.
🧨 Jailbreaks: Evaluate an AI’s resilience against hundreds of jailbreak attempts.
🎯 Accuracy: Evaluate an AI’s understanding of a knowledge base and detect hallucinations.
🖼️ Multimodal: Evaluate text-to-image AI as well as text-to-text AI.
🌐 Multilingual: Evaluate AI across English, Spanish, French, Italian, Portuguse, and German.
🔄 Multiturn (coming soon): Run automated multi-turn conversations to evaluate an AI more deeply.
Aymara scores an AI’s responses, explains failures in plain language, and gives actionable guidance to improve safety and accuracy.
Getting Started#
Sign Up & Get Your API Key
Start with a free trial (limited functionality), or unlock full features with the paid version.
Sign up here to get your API key.
Install the Python SDK
pip install aymara-ai-sdk
For full details, see the Python SDK README and SDK Reference.
Explore User Guides
Check out our User Guides to see full workflows from start to finish.
Community & Support#
See GitHub Issues for bug reports & feature requests
Contact us at support@aymara.ai for help or feedback
Browse the FAQs for common questions and troubleshooting