openlayer-ai

openlayer-ai builds open-source tooling for evaluating and monitoring AI agents and LLM pipelines. The organization develops jevals, a Python library that replaces expensive LLM judges with fast, calibrated decision models for agent evals and guardrails. Their work focuses on making production-grade evaluation practical at scale — cheap enough to run on every trace and fast enough to run inside the agent loop.