Pezzo

Pezzo is an open-source LLMOps platform from pezzolabs, released under the Apache 2.0 license. It centralizes prompt design, version management, collaboration, observability and troubleshooting for AI operations. The latest GitHub release listed is v0.9.2, published 2024-05-15.

What It Is

Pezzo is a developer-first platform for managing and monitoring LLM-powered applications. Teams manage prompts in one place and deliver prompt changes instantly. They also observe and monitor AI operations to troubleshoot issues. The README says it can save up to 90% on costs and latency, which is a vendor claim.

Clients and Integrations

Pezzo provides a Node.js client (@pezzo/client on npm) and a Python client. LangChain is listed as supported. According to the README's client table, all three clients cover prompt management, observability and caching.

Self-Hosting Setup

Pezzo is built on open-source technologies: PostgreSQL, ClickHouse, Redis and Supertokens. The full stack can be run locally with Docker Compose. Development mode requires Node.js 18+ and Docker. It runs a server (NestJS/TypeScript) and a web console, with GraphQL codegen used during development. A hosted Pezzo Cloud option is also referenced.