Main Menu
  • Tools
  • Developers
  • Topics
  • Discussions
  • News
  • Blogs
  • Builds
  • Contests
  • Compare
  • Arena
Create
    EveryDev.ai
    Sign inSubscribe
    Home
    Topics

    215 topics

    • Trending
    AI Topics
    • Agents1104
    • Coding995
    • Infrastructure429
    • Marketing408
    • Design354
    • Projects323
    • Analytics311
    • Research297
    • Testing194
    • Data166
    • Integration164
    • Security162
    • MCP152
    • Learning143
    • Communication126
    • Extensions118
    • Commerce112
    • Prompts109
    • Voice105
    • DevOps89
    • Web73
    • Finance19
    1. Home
    2. Topics
    3. Infrastructure
    4. Local Inference

    AI Tools & Discussions in Local Inference

    Tools and platforms for running AI inference locally without cloud dependence.

    Local Inference Tools (78)

    View Msty Studio
    Msty Studio tool icon

    Msty Studio

    Local and Online AI Studio

    Local InferenceLLM OrchestrationWorkflow Automation
    View KoboldCpp
    KoboldCpp tool icon

    KoboldCpp

    Local AI Text Generation Runtime

    Local InferenceGenerative MediaConversational AI
    View Unsloth Studio
    Unsloth Studio tool icon

    Unsloth Studio

    Featured

    No Code LLM Fine Tuning UI

    Local InferenceModel ManagementAI Dev Libraries
    View llamafile
    llamafile tool icon

    llamafile

    Single File Local LLM Runner

    Local InferenceLLM OrchestrationSpeech Recognition
    View RamaLama
    RamaLama tool icon

    RamaLama

    AI Models via OCI Containers

    Local InferenceAI InfrastructureModel Management
    View Hermes Workspace
    Hermes Workspace tool icon

    Hermes Workspace

    Featured

    Open Source AI Agent Workspace

    Agent FrameworksAgent MemoryLocal Inference
    View Hermes Desktop by fathah
    Hermes Desktop by fathah tool icon

    Hermes Desktop by fathah

    GUI for Hermes Agent CLI

    Conversational AIAgent FrameworksLocal Inference
    View Darkbloom
    Darkbloom tool icon

    Darkbloom

    Featured

    Decentralized AI Inference Network

    Local InferenceAI InfrastructureAPI Integrations
    View Wafer
    Wafer tool icon

    Wafer

    AI Inference Optimization Platform

    AI InfrastructureLocal InferenceCompute Opt.
    View GAIA
    GAIA tool icon

    GAIA

    AMD Ryzen AI Agent Framework

    Agent FrameworksLocal InferenceRAG

    Top Tools in Local Inference

    Highest trending score

    OpenClaude

    A fork of Claude Code that adds an OpenAI-compatible provider shim, letting you use GPT-4o, DeepSeek, Gemini, Llama, Mistral, or any OpenAI chat completions-compatible model.

    CanIRun.ai

    A web tool that helps you find out which AI models your machine can actually run locally, based on your GPU, VRAM, and memory bandwidth.

    apfel

    A free, open-source CLI tool that unlocks Apple's on-device LLM on macOS 26+ as a terminal command, OpenAI-compatible HTTP server, and interactive chat.

    New in Local Inference

    Msty Studio7h agoKoboldCpp7h agoUnsloth Studio7h ago

    Featured Tool

    apfel screenshot
    apfel

    A free, open-source CLI tool that unlocks Apple's on-device LLM on macOS 26+ as a terminal command, OpenAI-compatible HTTP server, and interactive chat.

    Last 7 Days

    10
    New Tools
    32
    Featured
    13
    Upvotes

    Related Topics

    AI Infrastructure191 tools
    DevOps Infrastructure50 tools
    Cloud Computing Platforms45 tools
    Model Management28 tools
    Compute Optimization15 tools

    Local Inference Discussions

    No discussions yet

    Be the first to start a discussion about Local Inference

    Weekly Newsletter

    One weekly email. New AI dev tools, news, and trends.

    No spam — unsubscribe anytime

    Explore AI Tools
    • AI Coding Assistants
    • Agent Frameworks
    • MCP Servers
    • AI Prompt Tools
    • Vibe Coding Tools
    • AI Design Tools
    • AI Database Tools
    • AI Website Builders
    • AI Testing Tools
    • LLM Evaluations
    Follow Us
    • X / Twitter
    • LinkedIn
    • Reddit
    • Discord
    • Threads
    • Bluesky
    • Mastodon
    • YouTube
    • GitHub
    • Instagram
    Get Started
    • About
    • Editorial Standards
    • Corrections & Disclosures
    • Community Guidelines
    • Advertise
    • Contact Us
    • Newsletter
    • Submit a Tool
    • Start a Discussion
    • Write A Blog
    • Share A Build
    • Terms of Service
    • Privacy Policy
    Explore with AI
    • ChatGPT
    • Gemini
    • Claude
    • Grok
    • Perplexity
    Agent Experience
    • llms.txt
    Theme
    With AI, Everyone is a Dev. EveryDev.ai © 2026