AI Topic: LLM Orchestration
Platforms and frameworks for designing, managing, and deploying complex LLM workflows with visual interfaces, allowing for the coordination of multiple AI models and services.
AI Tools in LLM Orchestration (14)
APIPark
16hOpen-source LLM gateway that provides unified API compatibility, multi-LLM management, load balancing, and fine-grained traffic controls for production deployments.
Inngest
11dDurable execution and workflow orchestration platform for building scalable, fault-tolerant serverless and AI agent workflows.
Loyal
13dPrivacy-preserving decentralized intelligence: attested TEEs + Solana PDAs for on-chain sessions and payments, with an open marketplace of service agents.
Mastra
19dA TypeScript-first AI agent framework and cloud platform for building, orchestrating, and observing production AI agents and workflows.
HumanLayer
2moAPI + SDK for adding human-in-the-loop approvals, feedback, and outreach to AI agents across Slack, Email, and more.
BAML
2moDomain-specific language and toolchain for type-safe LLM functions, structured outputs, and multi-provider orchestration.
AI-assisted workflow diagramming to map processes and generate Zaps. Canvas is currently free for Zapier users.
LiteLLM
3moOpen-source LLM gateway and Python SDK that unifies 100+ providers behind an OpenAI-compatible API with cost tracking, budgets, rate limits, and fallbacks.

Martian
3moLLM model router and unified API that selects the best model per request to improve performance and reduce cost.

Agency Swarm
3moOpen-source multi-agent framework for building and deploying collaborative AI agents with natural language interfaces.
AI Discussions in LLM Orchestration
No discussions yet
Be the first to start a discussion about LLM Orchestration