AI Topic: AI Infrastructure

An open-source, high-performance library for serving and running large language models with GPU-optimized inference and efficient memory and batch management.

Replicate provides a developer platform and API to run, fine-tune, deploy, and scale machine learning models with pay‑for‑what‑you‑use hardware billing.

Cloud inference platform providing low-cost, scalable APIs and infrastructure to run, host, and deploy machine learning models and custom LLMs.

Self-hosted open-source AI API server that exposes unified REST endpoints and supports multiple LLM providers for integration into applications.

Privacy-preserving decentralized intelligence: attested TEEs + Solana PDAs for on-chain sessions and payments, with an open marketplace of service agents.

Osaurus is a local-first AI runtime optimized for Apple Silicon that runs open-source models on Mac with privacy and no cloud dependency.

LLM model router and unified API that selects the best model per request to improve performance and reduce cost.

Microsoft's comprehensive suite of AI services including computer vision, speech, language, search, and Azure OpenAI for building intelligent applications.