Raullen Chai
Raullen Chai is an individual developer and creator, not a company. His public work focuses on building open intelligence for the physical world, including local AI inference on Apple Silicon and an ESP32 voice-assistant project.
At a Glance
- Apple Silicon Mac users
- Developers building coding agents and local AI applications
- Privacy-conscious users who want inference to stay on-device
- MLX and open-source model researchers
- +2 more
AI Tools by Raullen Chai
(2)esp32-thinks
ESP32 Voice Assistant Firmware
Rapid-MLX
MLX LLM Server for Apple Silicon
Discussions
No discussions yet
Be the first to start a discussion about Raullen Chai
Latest News
Products & Services
Open-source Apache-2.0 local LLM inference server and Mac desktop/CLI engine for Apple Silicon. It serves MLX models through OpenAI- and Anthropic-compatible APIs, supports coding agents and tool calling, and runs without an account or cloud inference.
A multi-model personal AI voice assistant for ESP32-S3/Muse Gadget hardware, especially the Seeed SenseCAP Watcher W1-B. It combines wake-word or knob interaction with configurable OpenAI-compatible speech-to-text, chat and text-to-speech endpoints, streaming replies and an optional openmuse agent.
An optional agent component included in esp32-thinks that keeps extra context such as location, memory and tools on the user's own machine and exposes an OpenAI-compatible chat endpoint for the device.
Market Position
Rapid-MLX positions itself as a faster, agent-focused local inference alternative to Apple's mlx-lm and as an alternative to oMLX, LM Studio, Ollama and llama.cpp on Apple Silicon. Its differentiation is the combination of MLX-native performance, OpenAI/Anthropic API compatibility, schema-valid tool calling, MCP support, multimodal runtimes and local-first privacy. The official comparison pages report direct same-model comparisons against oMLX and LM Studio, while the blog also benchmarks against Ollama and llama.cpp.
Leadership
Founders
Raullen Chai
Cryptographer and software engineer with a Ph.D. in Electrical and Computer Engineering from the University of Waterloo (2011). Previously worked as a Member of Technical Staff at Oracle, Senior Software Engineer/Tech Lead at Google, and Lead of Crypto R&D and Engineering Security at Uber. He is also identified by CryptoSlate and IoTeX as a co-founder and former CEO of IoTeX and MachineFi Lab.
Executive Team
Raullen Chai
CEO
Cryptography expert, former Uber and Google security leader.
Aaron Basi
Head of Product
Focuses on product strategy for DePIN infrastructure.
Board of Directors
Founding Story
In a Show HN post, Chai said he built Rapid-MLX to run coding agents locally on Apple Silicon after repeatedly encountering two problems: models failing at structured tool calling and existing MLX servers being slow. The project's stated vision is a fast, local, privacy-preserving backend that works with agent workflows rather than a cloud API.
Business Model
Revenue Model
The publicly documented projects are free and open source. Rapid-MLX is Apache-2.0 licensed, and the website says the engine and Desktop app are free with local models running on the user's Mac; no paid API or cloud-inference model is described.
Pricing Tiers
Free download and open-source engine; macOS 14+ and Apple Silicon are required for the Desktop download described on the official site.
Target Markets
- Apple Silicon Mac users
- Developers building coding agents and local AI applications
- Privacy-conscious users who want inference to stay on-device
- MLX and open-source model researchers
- ESP32/Muse Gadget makers and edge-AI developers
- Users wanting local speech, vision and multimodal AI
- Private local LLM inference and chat on Mac computers
- Local coding agents and pair-programming workflows
- Connecting Claude Code, Cursor, Cline, Continue, Goose, OpenCode, Pi, Aider and Codex CLI to local models
- Local MCP tool use and agent workflows
- Running local speech, vision and multimodal models
- Building an offline-first or privacy-preserving ESP32 voice assistant
- Samsung Next
- Bosch
- Helium
- Polygon