Lunary

Lunary is an open-source control plane for enterprise AI applications that unifies observability, prompt management, alerts, evaluations, and product analytics. It enables teams to monitor LLM performance in real-time, debug AI agents, track costs, and understand user interactions with their AI-powered applications. The platform is SOC 2 Type II and ISO 27001 certified, making it suitable for enterprise deployments.

• LLM Observability provides comprehensive logging of all prompts and results, with traces, error stack traces, instant search, and filters to debug agent behavior in production.

• Analytics Dashboard tracks and analyzes performance and costs of GenAI projects, including model usage, frequent topics, user satisfaction metrics, and custom dashboards.

• Prompt Management enables creating templates and collaborating on prompts with non-technical teammates, featuring versioning and A/B testing capabilities.

• Agent Tracing logs all agent interactions with full trace visibility, helping teams understand how autonomous agents execute complex tasks.

• PII Masking safeguards user personal information automatically, ensuring GDPR compliance without manual intervention.

• Topic Classification automatically groups chats into topics to uncover trends and understand what users are asking about.

• Human Reviews allows teams to judge and score LLM responses for quality assurance and fine-tuning data collection.

• AI Playground lets users experiment with prompts and different LLM models without writing code.

• Self-Hosting Option enables deployment in your own VPC with Kubernetes or Docker for maximum data control and security.

• Multi-Modal Support handles text, audio, and images for comprehensive AI application monitoring.

To get started, integrate Lunary with a single line of code using SDKs for Python, JavaScript, and frameworks like OpenAI, LangChain, and LiteLLM. The platform runs asynchronously and does not impact the latency of LLM calls. Data is hosted in Europe and compliant with GDPR, with options for on-premises hosting for enterprise customers.