Explore AI Tools & Discussions in LLM Orchestration
Platforms and frameworks for designing, managing, and deploying complex LLM workflows with visual interfaces, allowing for the coordination of multiple AI models and services.
AI Tools in LLM Orchestration (31)
An open-source SDK from Microsoft that integrates large language models with conventional programming languages for AI application development.

Miniloop
15hAI workflow platform for building production-ready orchestrated pipelines with explicit contracts and automatic validation.

Opik
5dOpen-source platform for evaluating, testing, and monitoring LLM applications with tracing and observability features.

A Python library for structured data extraction from LLMs using Pydantic validation and automatic retries.

SemTools
3dA Python library by LlamaIndex for building semantic tools and structured data extraction pipelines using LLMs.

OrKa
3dOpen-source tool for building AI workflows using YAML configuration instead of Python code, with built-in memory and local LLM support.

HeyToken
25dAI infrastructure platform providing unified API access to top-tier LLMs at 30% lower cost with OpenAI SDK compatibility.

Itzam
30dOpen-source platform for AI integration that enables developers to create AI features in applications using workflows, multiple AI models, and knowledge bases.

Portkey
30dProduction stack for GenAI builders with AI Gateway, Observability, Guardrails, Governance, and Prompt Management in one platform.

LLM Gateway
30dUnified API gateway to route, manage, and analyze LLM requests across multiple providers like OpenAI, Anthropic, and Google.
