# RunInfra

> Hosted open-model inference API for AI agents with session-aware cache routing, compatible with the OpenAI and Anthropic SDKs.

RunInfra, made by RightNow AI, Inc., is a hosted Model API service that serves open models to AI agents and coding tools through a single API key. Chat completions and Responses endpoints are OpenAI-compatible, and a Messages endpoint is Anthropic-compatible. The homepage lists models such as Ornith, DeepSeek, GLM, Qwen and Nemotron variants.

## What It Is

RunInfra is an inference gateway for open models. Developers set the base URL to the RunInfra API, use a workspace API key, and pass a model id, so existing OpenAI or Anthropic SDK code can call hosted models. The model library shows per-model input, cached input and output prices, output speed, and capabilities such as tool calling, JSON mode, streaming and image input.

## How Cache-Aware Routing Works

RunInfra describes session-aware routing that sends repeat calls from one agent session to the replica already holding its cached context. Routing is automatic from the conversation or workspace, or callers can send a session ID to keep calls together. Cache hits are reported in usage and billed at the cached rate, and the site notes hits are best effort. The site publishes a cache measurement method and shows effective input rates based on measured cache share over the last 24 hours.

## Coding Agent Setup

A CLI and a copy-paste setup prompt let coding agents such as Claude Code, Codex, OpenCode, Cline, Droid and Grok Build configure RunInfra models. The agent reads the setup docs, the user approves sign-in in the browser, and the user confirms a setup plan before anything is installed or changed. Docs also cover OpenAI compatibility with LangChain, LiteLLM, LlamaIndex and the AI SDK, rate limits and troubleshooting.

## Data Handling and Security

RunInfra states that hosted Model APIs never store prompts, with zero data retention by default and no training on prompts or completions. It lists TLS in transit, AES-256 at rest, workspace roles with row-level security, and a SOC 2 Type II attestation with the report available under NDA. The site also references an enterprise serving package license for deploying optimized serving packages in a licensee's own products.

## Features
- OpenAI-compatible chat completions and Responses endpoints
- Anthropic-compatible Messages endpoint
- Session-aware routing to warm cached replicas
- Cached input billing with reported cache hits
- Hosted open model library with tool calling, JSON mode, streaming and image input
- CLI and prompt-based setup for coding agents
- Zero data retention by default for hosted Model APIs
- Workspace API keys and roles
- Published cache measurement methodology

## Integrations
OpenAI SDK, Anthropic SDK, Claude Code, Codex, OpenCode, Cline, Droid, Grok Build, LangChain, LiteLLM, LlamaIndex, AI SDK

## Platforms
API, CLI, WEB

## Pricing
Subscription-based

## Links
- Website: https://runinfra.ai
- Documentation: https://runinfra.ai/docs
- EveryDev.ai: https://www.everydev.ai/tools/runinfra