AI Tools & Discussions in Local Inference
Tools and platforms for running AI inference locally without cloud dependence.
Local Inference Tools (45)
Locally AI
FeaturedFeatured toolRun AI Models on Device
parakeet.cpp
Local ASR Inference C++ Library
QMD
FeaturedFeatured toolLocal Search Engine for AI Agent Memory
Inception Labs
FeaturedFeatured toolDiffusion Based LLM Platform
TIMPs
AI Agent With Persistent Memory
trnscrb
Local Meeting Transcription for macOS
MLX LM
LLMs on Apple Silicon
MLX-VLM
VLM Inference on Apple Silicon
SGLang
FeaturedFeatured toolLLM and VLM Serving Framework
llama.cpp
FeaturedFeatured toolLLM Inference C/C++ Library