AI Tools & Discussions in Local Inference

Tools and platforms for running AI inference locally without cloud dependence.

Local Inference Tools (115)

DuckDB

Open Source Analytical SQL Database

Database Tools Data Processing Local Inference

Odysseus

Self Hosted AI Chat Workspace

Local Inference Conversational AI Knowledge Mgmt

Memory OS

Local Memory OS for AI Agents

Agent Memory Agent Frameworks Local Inference

Local Deep Research

Local AI Research Assistant

Research Assistants Local Inference RAG

tiny-vllm

LLM Inference Engine From Scratch

Local Inference AI Courses AI Infrastructure

SmallCode

Terminal Agent for Local LLMs

AI Coding Asst.Local Inference CLI Assistants

little-coder

Coding Agent for Small Local LLMs

AI Coding Asst.Local Inference Autonomous Systems

ModelHub

Local LLM Manager for macOS

Local Inference Model Management AI Infrastructure

ggml

C++ Tensor Library for ML

AI Dev Libraries Local Inference LLM Orchestration

Claw Code Agent

Local AI Coding Agent Python

AI Coding Asst.Agent Frameworks Local Inference