AI Topic: Local Inference

Tools and platforms for running AI inference locally without cloud dependence.

AI Tools in Local Inference (14)

Liner tool icon
AI Development Libraries

Free desktop tool for training machine learning models without code using your own data.

0
PaddlePaddle tool icon
AI Development Libraries

An open-source deep learning platform developed by Baidu for industrial-grade AI development and deployment.

0
Perplexica tool icon
Search and Discovery

An open-source AI-powered search engine that uses advanced machine learning to understand queries and provide accurate, source-cited answers.

0
Chutes AI tool icon
Serverless Computing

Serverless GPU inference platform for deploying and running AI models with pay-per-use pricing.

0
Dyad tool icon

Dyad

25d
Development Environments

Free, local, open-source AI app builder that lets you download and run full-stack AI apps on macOS and Windows without sign-up.

0
jax-js tool icon
AI Development Libraries

A pure JavaScript port of Google's JAX ML framework that compiles and runs neural networks directly in the browser via auto-generated WebGPU kernels—with autodiff, JIT, and vectorization built in.

0
Jan tool icon

Jan

1mo
Local Inference

Open-source AI desktop and web app that runs local and cloud models, provides assistants, connectors, and a local OpenAI-compatible API for self-hosted workflows.

0
Keras tool icon
AI Development Libraries

Keras is an open-source, high-level deep learning API that enables building, training, and deploying neural networks across JAX, TensorFlow, and PyTorch backends.

0
vLLM tool icon

vLLM

2mo
Local Inference

An open-source, high-performance library for serving and running large language models with GPU-optimized inference and efficient memory and batch management.

0
AI Backends tool icon
AI Infrastructure

Self-hosted open-source AI API server that exposes unified REST endpoints and supports multiple LLM providers for integration into applications.

0

AI Discussions in Local Inference

Discussions

No discussions yet

Be the first to start a discussion about Local Inference