EveryDev.ai
Subscribe
Home
Tools

5,901+ AI tools

  • Featured
  • Gems
  • Trending
  • New
  • Rate tools
  • Compare
  • Arena
Categories
  • Agents2972
  • Coding2248
  • Infrastructure1067
  • Projects818
  • MCP794
  • Research744
  • Analytics565
  • Marketing527
  • Design488
  • Testing476
  • Data442
  • Security412
  • Integration288
  • Communication284
  • Prompts283
  • Extensions238
  • Voice213
  • DevOps190
  • Commerce183
  • Web128
  • Learning123
  • Finance44
AI Tools by Topic
  • AI Coding Assistants
  • Agent Frameworks
  • MCP Servers
  • AI Prompt Tools
  • Vibe Coding Tools
  • AI Design Tools
  • AI Database Tools
  • AI Website Builders
  • AI Testing Tools
  • LLM Evaluations
Follow Us
  • X / Twitter
  • LinkedIn
  • Reddit
  • Discord
  • Threads
  • Bluesky
  • Mastodon
  • YouTube
  • GitHub
  • Instagram
Get Started
  • Users
  • Rate Tools
  • About
  • Editorial Standards
  • Corrections & Disclosures
  • Community Guidelines
  • Advertise
  • Contact Us
  • Newsletter
  • Submit a Tool
  • Start a Discussion
  • Write A Blog
  • Share A Build
  • Terms of Service
  • Privacy Policy
Explore with AI
  • ChatGPT
  • Gemini
  • Claude
  • Grok
  • Perplexity
Agent Experience
  • llms.txt
Theme
With AI, Everyone is a Dev. EveryDev.ai ©
    1. Home
    2. Tools
    3. three.dev
    three.dev icon

    three.dev

    Observability Platforms

    Scores live AI agent traffic, groups failures into failure modes, and hands fixes to your coding agent.

    Visit Website

    At a Glance

    Pricing
    Free tier available

    Permanent free plan with room for about 50,000 requests a month at 5k tokens each.

    Starter: $79/mo
    Pro: $249/mo
    Enterprise: Custom/contact

    Engagement

    Available On

    Web
    API

    Resources

    WebsiteDocsllms.txt

    Topics

    Observability PlatformsMCP IntegrationLLM Evaluations

    Alternatives

    HoneyHivePandaProbePrefactor
    Developer
    round3New York, NYEst. 2025

    Listed Nov 2026

    About three.dev

    three.dev is a product from round3 that detects failures in AI agents running in production. It scores live conversations, groups issues into failure modes, and lets a coding agent such as Claude Code, Codex, or Cursor apply fixes, then compares traffic before and after.

    What It Is

    three.dev is an agent quality and observability tool. Your app's LLM calls are routed through a three.dev proxy to providers such as OpenAI, Anthropic, Gemini, or Azure OpenAI. Each response goes to your app and to an evaluator at once, so the site says scoring adds no latency. Issues are detected automatically with evidence attached, such as the rule violated and the system prompt line that supports it.

    From failures to fixes

    Issues are grouped by root cause into failure modes, ranked by severity and frequency, with counts of how often each occurs. A coding agent can read a failure mode through the MCP server (list_failure_modes, get_failure_mode, get_request_conversation) and propose a code change. Teams can merge or reshape failure modes, ask questions in a Chat interface, and compare any two slices of traffic, such as before and after a fix or two prompt versions, with new failure modes shown alongside.

    Setup path

    Setup is one prompt pasted into a coding agent, which installs the three.dev skills from the round3ai GitHub repository, finds LLM calls, routes them through the proxy, and names the use case.

    Early access features

    The site lists Experiments (replaying v4 on recorded traffic or splitting live sessions) and Specialized Language Models trained on your own traffic as early access.

    three.dev - 1

    Community Discussions

    Be the first to start a conversation about three.dev

    Share your experience with three.dev, ask questions, or help others learn from your insights.

    Pricing

    FREE

    Free

    Permanent free plan with room for about 50,000 requests a month at 5k tokens each.

    • Issues with evidence
    • Failure modes
    • Your coding agent, over MCP
    • Chat
    • 1 GB of data a month (Upgrade to send more)

    Starter

    Popular

    Room for about 250,000 requests a month at 5k tokens each. Launch offer: free for 6 months for teams who sign up by November 22.

    $79
    per month
    • Issues with evidence
    • Failure modes
    • Your coding agent, over MCP
    • Chat
    • 5 GB of data a month, then $3 per GB
    • 10k requests scored a month, then $2.50 per 1k
    • 90 days of history
    • Unlimited seats
    • Sampling you control
    • Launch offer: Starter free for 6 months (sign up between November 9 and 22 and send first request within a week)

    Pro

    Room for about 1,000,000 requests a month at 5k tokens each.

    $249
    per month
    • Issues with evidence
    • Failure modes
    • Your coding agent, over MCP
    • Chat
    • 20 GB of data a month, then $2 per GB
    • 25k requests scored a month, then $1.50 per 1k
    • 180 days of history
    • Unlimited seats
    • Sampling you control

    Enterprise

    Built for high volume with custom limits, sized to your traffic.

    Custom
    contact sales
    • Issues with evidence
    • Failure modes
    • Your coding agent, over MCP
    • Chat
    • Custom data a month
    • Custom scoring a month
    • Custom history
    • Unlimited seats
    View official pricing

    Capabilities

    Key Features

    • Live scoring of production agent conversations
    • Evidence-backed issue detection
    • Failure mode grouping with severity ranking
    • Fix with your coding agent
    • MCP server integration
    • Before and after comparison
    • Merge and manage failure modes
    • Chat over traffic
    • Experiments (early access)
    • Specialized language models (early access)

    Integrations

    Claude Code
    Codex
    Cursor
    OpenAI
    Anthropic
    Gemini
    Azure OpenAI
    MCP
    API Available
    View Docs

    Ratings & Reviews

    No ratings yet

    Be the first to rate three.dev and help others make informed decisions.

    Rate other tools you’ve used

    Developer

    round3

    round3 builds tools for self-owned AI, and three.dev is its first product. The founding team has worked at Microsoft, Telefónica, Docker, and Datadog. Co-founders Borja Burgos (CEO) and Ximo Guanter (CTO) lead the company.

    Founded 2025
    New York
    7 employees

    Used by

    LanguaTalk: used three.dev to compare…
    Read more about round3
    WebsiteGitHub
    1 tool in directory

    Similar Tools

    HoneyHive icon

    HoneyHive

    Agent observability and evaluation platform for tracing, evaluating, monitoring, and improving AI agents in production.

    PandaProbe icon

    PandaProbe

    Open source agent engineering platform providing traces, evals, metrics, and live monitoring to debug and improve AI agents.

    Prefactor icon

    Prefactor

    Prefactor evaluates every AI agent run in real time, scoring quality, drift, and risk in production, then enforces policies to hold, approve, or block failing agents automatically.

    Browse all tools

    Related Topics

    Observability Platforms

    Comprehensive platforms that combine metrics, logs, and traces with AI-powered analytics to provide deep insights into complex distributed systems and application behavior.

    192 tools

    MCP Integration

    Tools for integrating MCP with existing AI systems and applications.

    183 tools

    LLM Evaluations

    Platforms and frameworks for evaluating, testing, and benchmarking LLM systems and AI applications. These tools provide evaluators and evaluation models to score AI outputs, measure hallucinations, assess RAG quality, detect failures, and optimize model performance. Features include automated testing with LLM-as-a-judge metrics, component-level evaluation with tracing, regression testing in CI/CD pipelines, custom evaluator creation, dataset curation, and real-time monitoring of production systems. Teams use these solutions to validate prompt effectiveness, compare models side-by-side, ensure answer correctness and relevance, identify bias and toxicity, prevent PII leakage, and continuously improve AI product quality through experiments, benchmarks, and performance analytics.

    246 tools
    Browse all topics
    Back to all toolsSuggest an edit
    ratings
    discussions