Laminar

Laminar is an open-source platform designed to help developers build reliable AI agents by providing comprehensive tracing, evaluation, and analysis capabilities. It enables teams to monitor agents in production, understand failure modes, and create evaluations to improve agent performance. Backed by Y Combinator, Laminar offers both cloud-hosted and self-hosted deployment options.

Key Features:

• Real-time Tracing - See traces of long-running agents as they happen in real time, without waiting until the end of the run to start debugging. Automatically captures application-level exceptions and tracks tool calls and structured output.

• Browser Agent Observability - Automatically captures browser window recordings and syncs them with agent traces to help you see what browser agents see. Supports Browser Use, Stagehand, and Playwright integrations.

• SQL Access to All Data - Query traces, evals, datasets, and events with a built-in SQL editor. Bulk create datasets from queries and access platform data via SQL API.

• Custom Dashboards - Turn SQL queries into custom dashboards to track custom metrics of your agent without complex dashboard builders.

• Zero Boilerplate Evaluation SDK - Write your agent function and evaluator, pass in your data, and run. Automatic handling of parallelism and retries.

• Playground for Prompt Iteration - Open LLM calls in the Playground to iterate fast, test new prompts, try different models, and validate improvements without touching your codebase.

• Highly Scalable Architecture - Rust-powered backend optimized for performance and scalability, capable of ingesting hundreds of millions of traces per day.

• Extensive Integrations - Works with OpenTelemetry, LangGraph, CrewAI, Vercel AI SDK, LiteLLM, OpenAI, Anthropic, Gemini, Mistral, Bedrock, Groq, and more.

To get started, simply initialize Laminar at the top of your project and popular LLM frameworks and SDKs will be automatically traced. Use the SDK to add comprehensive tracing to your agent and begin monitoring performance immediately.