AISA Group

The AISA Group conducts AI safety and research automation research at ELLIS Institute Tübingen, Max Planck Institute for Intelligent Systems, and Tübingen AI Center. The group builds open-source benchmarks and evaluation frameworks to measure the capabilities and failure modes of frontier AI agents. InferenceBench is their benchmark for evaluating whether coding agents can act as ML systems engineers in open-ended inference optimization tasks.