EveryDev.ai
Subscribe
Home
Tools

5,901+ AI tools

  • Featured
  • Gems
  • Trending
  • New
  • Rate tools
  • Compare
  • Arena
Categories
  • Agents2972
  • Coding2248
  • Infrastructure1067
  • Projects818
  • MCP794
  • Research744
  • Analytics565
  • Marketing527
  • Design488
  • Testing476
  • Data442
  • Security412
  • Integration288
  • Communication284
  • Prompts283
  • Extensions238
  • Voice213
  • DevOps190
  • Commerce183
  • Web128
  • Learning123
  • Finance44
AI Tools by Topic
  • AI Coding Assistants
  • Agent Frameworks
  • MCP Servers
  • AI Prompt Tools
  • Vibe Coding Tools
  • AI Design Tools
  • AI Database Tools
  • AI Website Builders
  • AI Testing Tools
  • LLM Evaluations
Follow Us
  • X / Twitter
  • LinkedIn
  • Reddit
  • Discord
  • Threads
  • Bluesky
  • Mastodon
  • YouTube
  • GitHub
  • Instagram
Get Started
  • Users
  • Rate Tools
  • About
  • Editorial Standards
  • Corrections & Disclosures
  • Community Guidelines
  • Advertise
  • Contact Us
  • Newsletter
  • Submit a Tool
  • Start a Discussion
  • Write A Blog
  • Share A Build
  • Terms of Service
  • Privacy Policy
Explore with AI
  • ChatGPT
  • Gemini
  • Claude
  • Grok
  • Perplexity
Agent Experience
  • llms.txt
Theme
With AI, Everyone is a Dev. EveryDev.ai ©
    1. Home
    2. Tools
    3. Miles
    Miles icon

    Miles

    Agent Frameworks

    Open-source reinforcement learning framework for large-scale LLM and VLM post-training, pairing SGLang rollout with Megatron-LM training.

    Visit Website

    At a Glance

    Pricing
    Open Source

    Self-hosted Miles RL framework released under the Apache License 2.0; hardware and infrastructure costs are external.

    Engagement

    Available On

    Linux
    API
    SDK
    CLI

    Resources

    WebsiteDocsGitHubllms.txt

    Topics

    Agent FrameworksAI InfrastructureAI Development Libraries

    Alternatives

    OpenRLHFverlMolt
    Developer
    radixarkRedwood City, CAEst. 2025$100M raised

    Updated Oct 2026

    About Miles

    Miles is an open-source reinforcement learning framework for large-scale model post-training, developed under the radixark GitHub organization and released under the Apache 2.0 license. It pairs SGLang for high-throughput rollout with Megatron-LM for scalable training, and also supports FSDP2 and torchtitan backends. The latest GitHub release listed is v0.1.2.

    What It Is

    Miles is a post-training framework for LLMs, VLMs and diffusion models, with a focus on reinforcement learning and agentic workloads. Users launch recipe scripts that run rollout and training on infrastructure they control, on Ray or as a Helm release on Kubernetes. Recipes cover GRPO, GSPO, PPO, REINFORCE++, supervised fine-tuning and on-policy distillation, in full-parameter or LoRA form. Rewards, advantage computation, loss and data selection are customizable.

    Agentic Rollout and Environments

    Miles manages full trajectories of model responses, tool calls, observations and environment interactions. Its token-in-token-out (TITO) data path preserves the exact tokens produced during rollout, including with black-box agent harnesses. Connectors are provided for Harbor, HUD, NeMo Gym, OpenEnv and Verifiers, with task sandboxes on AgentENV, Daytona, E2B or Modal. Synchronous and fully asynchronous RL are both supported.

    Performance and Stability Features

    The docs describe decoupled rollout and training workers, P2P RDMA weight updates, and MXFP8, NVFP4, FP8 and INT4 QAT low-precision training. Rollout Routing Replay (R3) replays MoE expert routing in the trainer's forward pass. Fault tolerance recovers a failed SGLang engine and resumes the run in place. LoRA and multi-LoRA adapters load directly into SGLang for rollout.

    Models and Hardware

    Recipes exist for DeepSeek, Kimi, GLM, Qwen, Nemotron, Gemma, MiMo, JoyAI, gpt-oss and Inkling. Diffusion recipes (Flow-GRPO, DiffusionNFT, SFT) live in the companion Miles-diffusion project. Supported hardware is NVIDIA A100 through GB300 and AMD MI300X through MI355X via ROCm. The docs recommend a Docker-based quick start that runs a complete GRPO loop.

    Miles - 1

    Community Discussions

    Be the first to start a conversation about Miles

    Share your experience with Miles, ask questions, or help others learn from your insights.

    Pricing

    OPEN SOURCE

    Open Source (Apache-2.0)

    Self-hosted Miles RL framework released under the Apache License 2.0; hardware and infrastructure costs are external.

    • Apache License 2.0
    • Fully async RL with SGLang rollout
    • Megatron-LM, FSDP2 and torchtitan training backends
    • SFT, RL and on-policy distillation recipes
    • LoRA and multi-LoRA support

    Capabilities

    Key Features

    • Fully asynchronous RL with decoupled rollout and training
    • SGLang-based agentic rollout with router
    • Token-in-Token-Out (TITO) data path
    • Rollout Routing Replay (R3) for MoE
    • P2P RDMA weight updates
    • MXFP8, NVFP4, FP8 and INT4 QAT low-precision training
    • LoRA and multi-LoRA
    • Fault tolerance with in-place engine recovery
    • GRPO, GSPO, PPO, REINFORCE++, SFT and on-policy distillation recipes
    • Megatron-LM, FSDP2 and torchtitan training backends
    • Ray and Kubernetes (Helm) deployment
    • Day-0 recipes for frontier open models
    • Diffusion model post-training via Miles-diffusion

    Integrations

    SGLang
    Megatron-LM
    FSDP2
    torchtitan
    Harbor
    HUD
    NeMo Gym
    OpenEnv
    Verifiers
    AgentENV
    Daytona
    E2B
    Modal
    Ray
    Kubernetes
    Docker
    API Available
    View Docs

    Ratings & Reviews

    No ratings yet

    Be the first to rate Miles and help others make informed decisions.

    Rate other tools you’ve used

    Developer

    radixark

    radixark builds enterprise-grade open-source infrastructure for large-scale AI model training. The organization develops Miles, a reinforcement learning framework for LLM and VLM post-training, in collaboration with InfiXAI, Ant Group, and the SGLang RL Team. Miles focuses on production stability, low-precision training, and high-throughput rollout for models at the 1TB+ parameter scale.

    Founded 2025
    Redwood City, CA
    $100M raised
    30 employees

    Used by

    DeepLearning.AI (Educational partner)
    LMSYS Org (Collaboration)
    Open-source developers using SGLang
    Read more about radixark
    WebsiteGitHub
    1 tool in directory

    Similar Tools

    OpenRLHF icon

    OpenRLHF

    Open-source RLHF and agentic reinforcement learning framework for LLMs and VLMs built on Ray, vLLM and DeepSpeed.

    verl icon

    verl

    Open-source RL training library for large language models implementing the HybridFlow framework, with support for PPO, GRPO and multiple training and rollout backends.

    Molt icon

    Molt

    A PyTorch-native, agentic-first reinforcement learning framework for research, built on Ray, vLLM and NVIDIA AutoModel.

    Browse all tools

    Related Topics

    Agent Frameworks

    Tools and platforms for building and deploying custom AI agents.

    947 tools

    AI Infrastructure

    Infrastructure designed for deploying and running AI models.

    589 tools

    AI Development Libraries

    Programming libraries and frameworks that provide machine learning capabilities, model integration, and AI functionality for developers.

    573 tools
    Browse all topics
    Back to all toolsSuggest an edit
    ratings
    discussions
    20views
    1upvote