noonghunna
noonghunna maintains club-3090, an open-source community project providing recipes and Docker Compose configs for serving large language models locally on consumer NVIDIA GPUs. The project ships verified multi-engine configs (vLLM, llama.cpp, SGLang, and more), benchmark data, and tooling to get an OpenAI-compatible API running on RTX 3090s and similar hardware with a single command. Development is community-driven, with contributors submitting benchmark results, patches, and new model configs via GitHub.
AI Tools by noonghunna
(1)club-3090
Local LLM Docker GPU Configs
Discussions
No discussions yet
Be the first to start a discussion about noonghunna
AI Topics
3
noonghunna focuses on these topics:
Know more about noonghunna? Start a discussion to share what you know.