Osaurus

Osaurus is a local-first AI runtime designed specifically for Apple Silicon Macs, offering blazing fast performance, privacy by default, and open flexibility. It enables users to run state-of-the-art open-source AI models directly on their Mac without relying on cloud services, ensuring data privacy and zero latency. The runtime is lightweight, developer-friendly, and integrates seamlessly with Apple's MLX ecosystem.

Blazing Fast Performance: Optimized for M-series chips and written in Swift for seamless local inference.

Privacy by Default: All AI inference runs locally on your device, ensuring your data never leaves your machine.

Open & Flexible: MIT-licensed and API-compatible with OpenAI and Ollama, supporting extensibility through plugins and models.

Developer Friendly: Simple installation, clean APIs, and both CLI and GUI interfaces for full control.

Community Driven: Open source with active community support and contributions.

To get started, install Osaurus on your Apple Silicon Mac, run your preferred MLX-compatible model, and explore integrations to connect with your favorite tools.