EveryDev.ai
Subscribe
Home
Tools

5,901+ AI tools

  • Featured
  • Gems
  • Trending
  • New
  • Rate tools
  • Compare
  • Arena
Categories
  • Agents2972
  • Coding2248
  • Infrastructure1067
  • Projects818
  • MCP794
  • Research744
  • Analytics565
  • Marketing527
  • Design488
  • Testing476
  • Data442
  • Security412
  • Integration288
  • Communication284
  • Prompts283
  • Extensions238
  • Voice213
  • DevOps190
  • Commerce183
  • Web128
  • Learning123
  • Finance44
AI Tools by Topic
  • AI Coding Assistants
  • Agent Frameworks
  • MCP Servers
  • AI Prompt Tools
  • Vibe Coding Tools
  • AI Design Tools
  • AI Database Tools
  • AI Website Builders
  • AI Testing Tools
  • LLM Evaluations
Follow Us
  • X / Twitter
  • LinkedIn
  • Reddit
  • Discord
  • Threads
  • Bluesky
  • Mastodon
  • YouTube
  • GitHub
  • Instagram
Get Started
  • Users
  • Rate Tools
  • About
  • Editorial Standards
  • Corrections & Disclosures
  • Community Guidelines
  • Advertise
  • Contact Us
  • Newsletter
  • Submit a Tool
  • Start a Discussion
  • Write A Blog
  • Share A Build
  • Terms of Service
  • Privacy Policy
Explore with AI
  • ChatGPT
  • Gemini
  • Claude
  • Grok
  • Perplexity
Agent Experience
  • llms.txt
Theme
With AI, Everyone is a Dev. EveryDev.ai ©
    1. Home
    2. Tools
    3. Metrum AI Router
    Metrum AI Router icon

    Metrum AI Router

    Unified API

    Open-source, self-hosted LLM gateway and smart router that selects an upstream model per request from a deployment-owned policy and records why.

    Visit Website

    At a Glance

    Pricing
    Open Source

    Self-hosted core router under Apache-2.0; no license key required.

    Engagement

    Available On

    macOS
    Linux
    Web
    API
    CLI

    Resources

    WebsiteDocsGitHubllms.txt

    Topics

    Unified APILLM OrchestrationModel Management

    Alternatives

    Martian GatewayTrustedRouterLLM Gateway
    Developer
    Metrum AIRound Rock, TXEst. 2021

    Listed Nov 2026

    About Metrum AI Router

    Metrum AI Router is an open-source, self-hosted LLM gateway from Metrum AI. It selects a different upstream model for each request based on a deployment-owned policy and records the reason for each decision, while keeping provider keys, budgets, telemetry and request-time cost accounting under platform control. The source is released under Apache-2.0, and the documentation lists v4.7.1 as the latest docs version.

    What It Is

    The router sits between GenAI clients and upstream models. Clients call one governed endpoint using OpenAI Chat, OpenAI Responses or Anthropic Messages shapes, including SDKs, Codex CLI and Claude Code. Platform teams define model groups, which are quality and cost contracts, instead of exposing raw provider IDs. Routing picks the cheapest eligible candidate that has evidence of meeting the contract.

    Upstreams can be hosted providers or enterprise-owned vLLM, SGLang and other OpenAI-compatible services, mixed behind one API.

    How Routing Works

    Before a strategy runs, request-shape eligibility filters targets by tool support, images, dialect, structured outputs and max-token requirements. If no target remains, the router returns a no-eligible-target error without calling an upstream. Group strategies include static, weighted, failover, dynamic_score and external policy services.

    Optional contracts can require tags, minimum evaluation quality and pass rate, and a maximum evaluation age, so stale validation removes a target from eligibility. Token budgets and quotas are admitted before any cache-miss upstream call.

    Learned Routing Policy

    An optional Learned Routing Policy trains offline on operator outcome data, using LightGBM quality and output-token models. It chooses only among router-eligible targets and abstains when uncertainty is high. It is promoted through explicit shadow and enforce modes, and rollback is a single config change. The README's published results come from a synthetic holdout and are documented as not authorizing live promotion.

    Operations and Evidence

    Usage rows record provider and model, tokens, cache, latency, attempts, fallbacks and request-time cost. An admin reports dashboard and a request-evidence endpoint join this data by request ID. Prompts and responses are not retained by default, and content capture is opt-in, redacted and encrypted. Documented runtimes are a Linux binary, Docker Compose and Kubernetes.

    Tradeoffs to Know

    The project is aimed at teams that run the gateway themselves rather than a hosted service. Its documentation states that it does not guarantee provider uptime, model quality or compliance outcomes. SQLite state is not meant for horizontally scaled replicas, and the in-process response cache is cleared on restart.

    Metrum AI Router - 1

    Community Discussions

    Be the first to start a conversation about Metrum AI Router

    Share your experience with Metrum AI Router, ask questions, or help others learn from your insights.

    Pricing

    OPEN SOURCE

    Open Source (Apache-2.0)

    Self-hosted core router under Apache-2.0; no license key required.

    • Apache-2.0 licensed core
    • No license key required
    • Self-hosted: Linux binary, Compose, Kubernetes
    • On-premises or air-gapped operation
    • Bring your own provider keys (external provider costs apply)

    Capabilities

    Key Features

    • Per-request upstream model selection from deployment-owned policy
    • Policy-owned model groups with quality and cost contracts
    • Request-shape eligibility filtering (tools, images, dialect, max tokens)
    • Pre-call token budget admission and quotas
    • Learned Routing Policy with abstention and shadow/enforce modes
    • Dynamic score, weighted, failover, static and external routing strategies
    • Request-time cost capture and usage reports
    • Admin reports dashboard and request evidence endpoint
    • PII filtering with redaction
    • Response cache
    • Runtime model-group swap via Admin API and routerctl
    • Mixed private and hosted upstreams with fallback
    • Claude Code and Codex CLI support

    Integrations

    OpenAI
    Anthropic
    Claude Code
    Codex CLI
    vLLM
    SGLang
    Baseten
    Fireworks
    OpenRouter
    MiniMax
    Moonshot
    xAI
    Crusoe
    Replicate
    AWS Bedrock
    Docker Compose
    Kubernetes
    PostgreSQL
    SQLite
    API Available
    View Docs

    Ratings & Reviews

    No ratings yet

    Be the first to rate Metrum AI Router and help others make informed decisions.

    Rate other tools you’ve used

    Developer

    Metrum AI

    Founded 2021
    Round Rock, TX
    27 employees

    Used by

    Dell-Broadcom AI Lab / Pikes Peak AI…
    Oregon State University academic…
    Vultr case study using Vultr bare…
    Read more about Metrum AI
    WebsiteGitHub
    1 tool in directory

    Similar Tools

    Martian Gateway icon

    Martian Gateway

    A unified API gateway providing access to 200+ AI models from leading providers, compatible with OpenAI and Anthropic SDKs.

    TrustedRouter icon

    TrustedRouter

    A privacy-first AI gateway that routes requests across 600+ models from 90+ providers through one OpenAI-compatible API, with an attested prompt path that never logs prompt or output content.

    LLM Gateway icon

    LLM Gateway

    An open-source API gateway that routes requests across 200+ LLMs from 40+ providers through a single OpenAI-compatible endpoint, with real-time cost tracking and analytics.

    Browse all tools

    Related Topics

    Unified API

    AI-enhanced API aggregation services that provide a single, intelligent interface for accessing and managing multiple APIs with automatic version management.

    40 tools

    LLM Orchestration

    Platforms and frameworks for designing, managing, and deploying complex LLM workflows with visual interfaces, allowing for the coordination of multiple AI models and services.

    313 tools

    Model Management

    Tools for managing, versioning, and deploying AI models.

    148 tools
    Browse all topics
    Back to all toolsSuggest an edit
    ratings
    discussions