EveryDev.ai
Sign inSubscribe
Home
Topics

213 topics

  • Trending
AI Topics
  • Coding733
  • Agents640
  • Marketing302
  • Infrastructure298
  • Design239
  • Analytics228
  • Research224
  • Projects207
  • Integration148
  • Testing129
  • Data125
  • Learning115
  • MCP113
  • Security107
  • Extensions94
  • Prompts79
  • Communication73
  • Voice71
  • Commerce70
  • Web59
  • DevOps46
  • Finance12
Sign In
  1. Home
  2. Topics
  3. Infrastructure
  4. Local Inference

AI Tools & Discussions in Local Inference

Tools and platforms for running AI inference locally without cloud dependence.

Local Inference Tools (45)

View Locally AI
Locally AI tool icon

Locally AI

FeaturedFeatured tool

Run AI Models on Device

Local InferenceConversational AIVoice Assistant
View parakeet.cpp
parakeet.cpp tool icon

parakeet.cpp

Local ASR Inference C++ Library

Speech RecognitionLocal InferenceAI Dev Libraries
View QMD
QMD tool icon

QMD

FeaturedFeatured tool

Local Search Engine for AI Agent Memory

Agent MemoryLocal InferenceMCP Tools
View Inception Labs
Inception Labs tool icon

Inception Labs

FeaturedFeatured tool

Diffusion Based LLM Platform

AI InfrastructureAI Coding Asst.Local Inference
View TIMPs
TIMPs tool icon

TIMPs

AI Agent With Persistent Memory

Agent MemoryAI Coding Asst.Local Inference
View trnscrb
trnscrb tool icon

trnscrb

Local Meeting Transcription for macOS

Speech RecognitionMCP ToolsLocal Inference
View MLX LM
MLX LM tool icon

MLX LM

LLMs on Apple Silicon

Local InferenceAI Dev LibrariesAI Coding Asst.
View MLX-VLM
MLX-VLM tool icon

MLX-VLM

VLM Inference on Apple Silicon

Local InferenceAI Dev LibrariesMultimodal Gen.
View SGLang
SGLang tool icon

SGLang

FeaturedFeatured tool

LLM and VLM Serving Framework

Local InferenceAI InfrastructureAI Dev Libraries
View llama.cpp
llama.cpp tool icon

llama.cpp

FeaturedFeatured tool

LLM Inference C/C++ Library

Local InferenceAI Dev LibrariesAI Infrastructure

Top Tools in Local Inference

Highest trending score

QMD

QMD is a local search engine that indexes Markdown files and combines BM25 keyword search, vector semantic search, and LLM re-ranking for AI agent memory and retrieval.

Osaurus

Osaurus is a local-first AI runtime optimized for Apple Silicon that runs open-source models on Mac with privacy and no cloud dependency.

SillyTavern

A self-hosted interface for interacting with AI language models for roleplay, creative writing, and character-based conversations.

New in Local Inference

Locally AI13h agoparakeet.cpp1d agoQMD4d ago

Featured Tool

QMD screenshot
QMD

QMD is a local search engine that indexes Markdown files and combines BM25 keyword search, vector semantic search, and LLM re-ranking for AI agent memory and retrieval.

Last 7 Days

3
New Tools
20
Featured
12
Upvotes

Related Topics

AI Infrastructure133 tools
DevOps Infrastructure41 tools
Cloud Computing Platforms38 tools
Serverless Computing12 tools
Compute Optimization11 tools

Local Inference Discussions

No discussions yet

Be the first to start a discussion about Local Inference

Weekly Newsletter

AI tools & insights, every week

No spam — unsubscribe anytime

Explore AI Tools
  • AI Coding Assistants
  • Agent Frameworks
  • MCP Servers
  • AI Prompt Tools
  • Vibe Coding Tools
  • AI Design Tools
  • AI Database Tools
  • AI Website Builders
  • AI Testing Tools
  • LLM Evaluations
Follow Us
  • X / Twitter
  • LinkedIn
  • Reddit
  • Discord
  • Threads
  • Bluesky
  • Mastodon
  • YouTube
  • GitHub
  • Instagram
Get Started
  • About
  • Editorial Standards
  • Corrections & Disclosures
  • Community Guidelines
  • Advertise
  • Contact Us
  • Newsletter
  • Submit a Tool
  • Start a Discussion
  • Write A Blog
  • Share A Build
  • Terms of Service
  • Privacy Policy
Explore with AI
  • ChatGPT
  • Gemini
  • Claude
  • Grok
  • Perplexity
Agent Experience
  • llms.txt
Theme
With AI, Everyone is a Dev. EveryDev.ai © 2026
Main Menu
  • Tools
  • Developers
  • Topics
  • Discussions
  • News
  • Blogs
  • Builds
  • Contests
Create
Sign In
    Sign in