# Agenta

> Open-source LLMOps platform for prompt management, evaluation, and observability for developer and product teams.

Agenta is an open-source LLMOps platform that helps developers and product teams build reliable LLM applications. It covers the LLM development lifecycle with tools for prompt management, evaluation, and observability. Agenta provides a web UI, APIs, and SDKs so teams can collaborate, run systematic evaluations, and monitor production behavior.

- **Prompt management**: Organize, version, and collaborate on prompts so subject-matter experts can edit prompts outside the codebase; use the playground to iterate and run side-by-side comparisons.
- **Evaluation**: Run automatic evaluations at scale, human annotation workflows, and online evaluation against production traffic to validate changes before and after deployment.
- **Observability & tracing**: Capture traces and user feedback via API, debug agent execution flows, and track cost and failure cases over time to add to test sets.
- **Playground and test sets**: Experiment with prompts and test sets inside the UI to reproduce and fix edge cases, then promote validated prompts to production.
- **Integrations and SDKs**: Integrate with major LLM providers and frameworks via API and SDKs; Agenta is OpenTelemetry-compliant for tracing and supports adding custom or self-hosted models.

To get started, sign up for the web product or self-host the MIT-licensed project, add your model providers and prompts, create test sets, and run evaluations from the UI or via the API/SDK.

## Features
- Prompt management and versioning
- Playground for prompt experimentation
- Automatic evaluation at scale
- Human evaluation workflows
- Online evaluation for production
- Tracing and observability (OpenTelemetry-compatible)
- Test sets and A/B testing
- Cost tracking and retention controls
- Role-based access control and enterprise features
- Self-hostable MIT-licensed deployment

## Integrations
OpenAI, Anthropic, Cohere, OpenRouter, Anyscale, Perplexity AI, TogetherAI, DeepInfra, Aleph Alpha, Groq, Gemini, Mistral, Ollama, AWS Bedrock, Azure OpenAI, Vertex AI, LangChain, LlamaIndex, OpenTelemetry

## Platforms
WEB, API, DEVELOPER_SDK

## Pricing
Open Source, Free tier available

## Links
- Website: https://agenta.ai
- Documentation: https://docs.agenta.ai
- Repository: https://github.com/Agenta-AI/agenta
- EveryDev.ai: https://www.everydev.ai/tools/agenta