AI Topic: Monitoring Tools

AI observability platform for building, evaluating, monitoring, and shipping quality AI products.

Helicone provides observability and analytics for large language model usage via a web dashboard and API to capture telemetry, metrics, and logs from LLM calls.

Full-stack observability platform that consolidates logs, metrics, traces, RUM, and synthetic tests and uses AI to detect and automatically remediate issues.

AI-native product analytics for Supabase. Build reports, dashboards, and health checks directly from your Postgres data—no third-party BI or ETL.

Comprehensive platform for LLM application development with tools for prompt engineering, workflow orchestration, testing, and deployment

Open-source data logging library for AI observability and data quality monitoring

AI observability platform for monitoring and securing ML models and LLM applications

Open-source LLM engineering platform for observability, tracing, and analytics

Fast and flexible Python framework for orchestrating role-playing, autonomous AI agents

Experience optimization platform featuring AdaptML, a centralized AI system for automating decision making and intensifying personalization.