BerriAI
LiteLLM acts as an AI Gateway to simplify model access, spend tracking, and fallbacks across over 100 LLMs using a standardized OpenAI format.
At a Glance
- Gen AI Enablement Teams
- ML Platform Teams
- Software Development companies
- Enterprise organizations
- +3 more
AI Tools by BerriAI
(1)
LiteLLM
Open Source LLM Gateway Proxy
Discussions
No discussions yet
Be the first to start a discussion about BerriAI
Latest News
v1.81.0-stable - Claude Code Web Search Support Released
v1.80.15-stable - Manus API Support with 50% Overhead Reduction
v1.80.10 - Agent Gateway Launch with A2A Support and Cost Tracking
v1.80.8 - Introducing A2A Agent Gateway with Guardrails API v2
Products & Services
Open-source Python SDK that allows developers to call 100+ LLM APIs using OpenAI format with unified interface, cost tracking, and error handling
Python FastAPI server acting as a centralized AI gateway to manage multiple LLM providers with authentication, load balancing, logging, and observability
Hosted version of LiteLLM with enterprise features and managed infrastructure
Self-hosted deployment option for companies requiring full control over data and infrastructure
Market Position
LiteLLM is positioned as an open-source, self-hosted AI gateway that provides an OpenAI-compatible interface for routing requests across multiple LLM providers. It distinguishes itself through its self-hosted nature and open-source model, offering full control over deployment and data flow. Key strengths include unified access to 100+ LLM providers, extensible architecture for custom integrations, and strong community adoption with 28K+ GitHub stars. Competitors include Portkey, OpenRouter, TrueFoundry Gateway, Kong AI Gateway, and Cloudflare AI Gateway. While ideal for fast setup and experimentation, it requires manual infrastructure management compared to fully managed alternatives.
Leadership
Founders
Krrish Dholakia
Former project manager at Microsoft. Currently serves as CEO and Co-Founder of BerriAI/LiteLLM.
Ishaan Jaffer
Former software engineer at Coinbase. Currently serves as CTO and Co-Founder of BerriAI/LiteLLM.
Executive Team
Krrish Dholakia
CEO and Co-Founder
Former project manager at Microsoft
Ishaan Jaffer
CTO and Co-Founder
Former software engineer at Coinbase
Founding Story
Founded in 2023 as part of Y Combinator's W23 batch, BerriAI created LiteLLM to simplify the complexity of managing and translating calls between diverse LLM providers like Azure, OpenAI, and Cohere. The company emerged just when GPT-4 was initially released, recognizing the need for a unified interface to call multiple LLM APIs.
Business Model
Revenue Model
Freemium model with open-source Community Edition and paid Enterprise Edition. Revenue from enterprise licenses, custom integrations, professional support, and managed hosting.
Pricing Tiers
Includes Docker image, 100+ LLM provider integrations, logging tools (Langfuse, Arize Phoenix, Langsmith, OTEL), virtual keys, budgets, teams, load balancing, and guardrails. Users pay for their own infrastructure (AWS/GCP) to host it. Does not include admin UI for managing teams, SSO, or advanced data retention policies.
Includes all Open Source features plus Enterprise license, governance features, Okta/Google SSO (free for up to 5 users), granular RBAC (Role-Based Access Control), JWT authentication, audit logs, enterprise support, custom SLAs, and corporate-compliant platform tools.
Target Markets
- Gen AI Enablement Teams
- ML Platform Teams
- Software Development companies
- Enterprise organizations
- AI/ML Engineering teams
- DevOps teams
- Gen AI Enablement/ML Platform Teams using Proxy Server as central service for organization-wide LLM access
- Developers building LLM-powered applications with multi-provider support
- Cost management and budget tracking for LLM usage across projects and teams
- Reliability engineering with fallbacks and retries for high availability
- Enterprise teams needing centralized authentication and access control
- Organizations requiring observability and logging for LLM operations
- Netflix
- NASA
- Adobe
- Rocket Money