Xuan-Son Nguyen
Xuan-Son Nguyen is an individual software engineer and open-source creator, not a company. He focuses on machine learning, low-level systems, and privacy-preserving/on-device AI; his stated personal motto is “AI for fun, not for profit.”
At a Glance
- Open-source developers and JavaScript/TypeScript engineers
- Researchers and hobbyists experimenting with local and browser-based LLMs
- Privacy-conscious users who prefer on-device AI
- Teams building web AI demos and client-side inference applications
- +1 more
AI Tools by Xuan-Son Nguyen
(1)
wllama
Browser LLM Inference via WebAssembly
Discussions
No discussions yet
Be the first to start a discussion about Xuan-Son Nguyen
Latest News
wllama 3.8.1 released with decision-model support through the systemone-compat API
wllama 3.6.1 released with upstream llama.cpp synchronization and removal of pre-built WASM from the repository
wllama 3.6.0 released with updated llama.cpp synchronization, n_parallel support, and partially downloaded-file fixes
wllama 3.1 released with WebGPU support and a single pre-built WASM binary for single- and multi-thread use
Products & Services
A WebAssembly binding and TypeScript/JavaScript library for llama.cpp that runs GGUF large-language-model inference directly in the browser without a backend or external API. It is maintained by Xuan-Son Nguyen and distributed as a pre-built npm package, with a Hugging Face demo and documentation.
An Android application created by Nguyen; it attracted more than 100 users and was later removed from Google Play because of compatibility issues, with source code retained on GitHub.
A modified Android/Linux kernel project providing low-level controls including overclocking, underclocking, voltage control, and LED manipulation.
A Facebook Messenger chatbot for anonymous conversations with strangers; it reached more than 200 users on its first day and evolved into bespoke chatbot and web-development work.
Market Position
wllama brings llama.cpp to the browser through WebAssembly and WebGPU, emphasizing local execution, privacy, and an OpenAI-compatible interface. The browser-inference alternatives identified in the associated technical material include ONNX Runtime/Transformers.js and WebLLM; wllama differentiates through its llama.cpp/GGUF compatibility, multimodal support, tool calling, model splitting, and worker-based execution.
Leadership
Founders
Xuan-Son Nguyen
Software engineer from Vietnam who studied at Université d’Aix-Marseille and INSA Centre Val de Loire in France. His background spans web development, machine learning, cybersecurity, C++, Linux/kernel work, and open-source AI; he worked at Botfuel and Snowpack before joining Hugging Face in August 2024.
Founding Story
This is a personal portfolio and independent open-source body of work rather than a formally founded company. Nguyen describes starting with coding and electronics as a child, then building increasingly ambitious software, hardware, web, cybersecurity, and AI projects; his stated motivation is impact and exploration rather than profit.
Business Model
Revenue Model
Nguyen’s work is primarily open source and explicitly described as “AI for fun, not for profit.” The personal site links to GitHub Sponsors and Buy Me a Coffee, indicating optional sponsorship and donations rather than a paid product subscription model.
Target Markets
- Open-source developers and JavaScript/TypeScript engineers
- Researchers and hobbyists experimenting with local and browser-based LLMs
- Privacy-conscious users who prefer on-device AI
- Teams building web AI demos and client-side inference applications
- Users and developers of llama.cpp, GGUF models, Hugging Face, and Ollama ecosystems
- Private, local LLM inference in a web browser
- Browser-based chat, completion, and embedding applications
- Client-side multimodal AI using image or audio input
- Web demos and prototypes that need on-device inference without a server
- Tool-calling and decision-model experiments
- Developers integrating llama.cpp capabilities into JavaScript or TypeScript applications