AI Topic: Infrastructure

An open-source, high-performance library for serving and running large language models with GPU-optimized inference and efficient memory and batch management.

Open-source LLM gateway that provides unified API compatibility, multi-LLM management, load balancing, and fine-grained traffic controls for production deployments.

AI-powered Kubernetes management IDE that automates cluster operations, investigates incidents, and provides agent-driven workflows for developers and DevOps teams.

Open-source, all-in-one backend development platform providing auth, databases, storage, serverless functions, realtime messaging and hosting for web and mobile applications.

CI reliability platform that detects and quarantines flaky tests and runs parallel merge queues to speed up CI, reduce reruns, and automate failure analysis for engineering teams.

Replicate provides a developer platform and API to run, fine-tune, deploy, and scale machine learning models with pay‑for‑what‑you‑use hardware billing.

Cloud inference platform providing low-cost, scalable APIs and infrastructure to run, host, and deploy machine learning models and custom LLMs.

Full-stack observability platform that consolidates logs, metrics, traces, RUM, and synthetic tests and uses AI to detect and automatically remediate issues.

Self-hosted open-source AI API server that exposes unified REST endpoints and supports multiple LLM providers for integration into applications.

Open-source AI-powered browser that automates web tasks via natural language agents while prioritizing privacy and local model support.