AI Tools & Discussions in Local Inference

Tools and platforms for running AI inference locally without cloud dependence.

Local Inference Tools (145)

LM Studio Bionic

Local AI agent for open models

Local Inference AI Coding Asst.Autonomous Systems

Olares

Open Source Self Hosted Cloud OS

AI Infrastructure Local Inference Knowledge Mgmt

LocalGPT

Private Local Document Q&A

RAG Local Inference Document Management

Reame

LLM Inference Server for CPU

Local Inference AI Infrastructure LLM Orchestration

tinbase

Lightweight Local Supabase Backend

DBaaS Dev Environments Local Inference

Subtext

Real Time LLM Activation Viewer

Local Inference AI Dev Libraries LLM Evaluations

QbitOS

Efficient LLM for Consumer Hardware

Agent Frameworks Multi-agent Systems Local Inference

Ornith-1

Open Source Agentic Coding LLMs

AI Coding Asst.Agent Frameworks Local Inference

RunMat

GPU Accelerated MATLAB Runtime

AI Dev Libraries Local Inference Vibe Coding

FluidVoice

macOS AI Dictation App

Speech Recognition Voice Control Local Inference