Main Menu
  • Tools
  • Developers
  • Topics
  • Discussions
  • Communities
  • News
  • Podcasts
  • Blogs
  • Builds
  • Contests
  • Compare
  • Arena
Create
    EveryDev.ai
    Sign inSubscribe
    Home
    Topics

    215 topics

    • Trending
    AI Topics
    • Agents1228
    • Coding1045
    • Infrastructure455
    • Marketing414
    • Design374
    • Projects340
    • Analytics319
    • Research306
    • Testing200
    • Data171
    • Integration169
    • Security169
    • MCP164
    • Learning146
    • Communication131
    • Prompts122
    • Extensions120
    • Commerce116
    • Voice107
    • DevOps92
    • Web73
    • Finance19
    1. Home
    2. Topics
    3. Infrastructure
    4. Local Inference

    AI Tools & Discussions in Local Inference

    Tools and platforms for running AI inference locally without cloud dependence.

    Local Inference Tools (98)

    View Keel
    Keel tool icon

    Keel

    Local AI Desktop Assistant

    Agent MemoryKnowledge MgmtLocal Inference
    View ds4.c
    ds4.c tool icon

    ds4.c

    Metal Inference Engine for DeepSeek

    Local InferenceAI InfrastructureLLM Orchestration
    View DeepSpeed
    DeepSpeed tool icon

    DeepSpeed

    Deep Learning Training Optimizer

    AI InfrastructureAI Dev LibrariesLocal Inference
    View Vane
    Vane tool icon

    Vane

    Private Self Hosted AI Search

    Web ResearchLocal InferenceRAG
    View Jarvis
    Jarvis tool icon

    Jarvis

    Local AI Voice Assistant

    Voice AssistantLocal InferenceMCP Integration
    View Rapid-MLX
    Rapid-MLX tool icon

    Rapid-MLX

    Local AI Inference for Apple Silicon

    Local InferenceAI InfrastructureLLM Orchestration
    View AgenticSeek
    AgenticSeek tool icon

    AgenticSeek

    Local Self Hosted AI Agent

    Autonomous SystemsLocal InferenceBrowser Automation
    View KarmaBox
    KarmaBox tool icon

    KarmaBox

    Autonomous AI Agents On Device

    Autonomous SystemsMulti-agent SystemsLocal Inference
    View ZeroClaw
    ZeroClaw tool icon

    ZeroClaw

    Featured

    Self Hosted AI Agent Runtime

    Autonomous SystemsAgent FrameworksLocal Inference
    View Project N.O.M.A.D.
    Project N.O.M.A.D. tool icon

    Project N.O.M.A.D.

    Offline Self Hosted AI Server

    Local InferenceKnowledge MgmtRAG

    Top Tools in Local Inference

    Highest trending score

    Hermes Desktop by fathah

    A native desktop app for installing, configuring, and chatting with Hermes Agent — a self-improving AI assistant with tool use, multi-platform messaging, and a closed learning loop.

    CanIRun.ai

    A web tool that helps you find out which AI models your machine can actually run locally, based on your GPU, VRAM, and memory bandwidth.

    OpenClaude

    A fork of Claude Code that adds an OpenAI-compatible provider shim, letting you use GPT-4o, DeepSeek, Gemini, Llama, Mistral, or any OpenAI chat completions-compatible model.

    New in Local Inference

    Keel17h agods4.c1d agoDeepSpeed3d ago

    Featured Tool

    Hermes Workspace screenshot
    Hermes Workspace

    An open-source AI agent command center combining chat, file management, memory browsing, skills, and a terminal in one web-based workspace.

    Last 7 Days

    7
    New Tools
    35
    Featured
    13
    Upvotes

    Related Topics

    AI Infrastructure225 tools
    DevOps Infrastructure52 tools
    Cloud Computing Platforms47 tools
    Model Management34 tools
    Compute Optimization17 tools

    Local Inference Discussions

    No discussions yet

    Be the first to start a discussion about Local Inference

    Weekly Newsletter

    One weekly email. New AI dev tools, news, and trends.

    No spam — unsubscribe anytime

    Explore AI Tools
    • AI Coding Assistants
    • Agent Frameworks
    • MCP Servers
    • AI Prompt Tools
    • Vibe Coding Tools
    • AI Design Tools
    • AI Database Tools
    • AI Website Builders
    • AI Testing Tools
    • LLM Evaluations
    Follow Us
    • X / Twitter
    • LinkedIn
    • Reddit
    • Discord
    • Threads
    • Bluesky
    • Mastodon
    • YouTube
    • GitHub
    • Instagram
    Get Started
    • About
    • Editorial Standards
    • Corrections & Disclosures
    • Community Guidelines
    • Advertise
    • Contact Us
    • Newsletter
    • Submit a Tool
    • Start a Discussion
    • Write A Blog
    • Share A Build
    • Terms of Service
    • Privacy Policy
    Explore with AI
    • ChatGPT
    • Gemini
    • Claude
    • Grok
    • Perplexity
    Agent Experience
    • llms.txt
    Theme
    With AI, Everyone is a Dev. EveryDev.ai © 2026