CMU / Zico Kolter
Providing enterprise-grade security solutions for LLMs and AI-powered applications through cutting-edge risk assessment and mitigation tools.
At a Glance
- Enterprise companies deploying AI
- Frontier AI labs
- Model developers
- Security researchers
AI Tools by CMU / Zico Kolter
(1)
10-202: Introduction to Modern AI
CMU AI and LLM Course
Discussions
No discussions yet
Be the first to start a discussion about CMU / Zico Kolter
Latest News
Gray Swan appoints Rob Jenks as Chief Strategy Officer
Study: AI agents outperform human cybersecurity professionals
UK AISI × Gray Swan Agent Red-Teaming Challenge results published
Featured in Forbes: Bulletproofing AI models for OpenAI/Anthropic
Products & Services
Comprehensive adaptive AI defense system including components Cygnal and Shade.
Real-time AI input and output filtering component for securing deployments.
Automated testing component for vulnerability assessment and policy enforcement.
A competition and research platform for threat discovery and AI vulnerability exploitation.
Market Position
Pioneers of AI vulnerability research (GCG discovery) providing academic-grade security expertise for industrial AI deployments.
Leadership
Founders
Zico Kolter
Professor and Director of the Machine Learning Department at Carnegie Mellon University; OpenAI Board Member; Qualcomm Board Member; previously Chief Expert at Bosch.
Matt Fredrikson
Associate Professor of Computer Science at Carnegie Mellon University; expert in security and privacy in machine learning.
Andy Zou
Researcher at Carnegie Mellon University; lead author of the 'Greedy Coordinate Gradient' (GCG) jailbreak paper.
Executive Team
Matt Fredrikson
Co-founder & Chief Executive Officer
CMU CS Professor and expert in ML security.
Zico Kolter
Co-founder & Chief Scientist
CMU ML Dept Director and OpenAI/Qualcomm Board Member.
Board of Directors
Founding Story
Founded by the researchers who discovered the GCG jailbreak method, which bypassed safety filters on all major LLMs. The team launched Gray Swan AI to transition their academic discoveries into a comprehensive security suite for enterprises and AI labs.
Business Model
Revenue Model
B2B SaaS and API-based usage model for security services and enterprise subscriptions.
Pricing Tiers
Full access to Security Suite, Cygnal, and Shade with API support.
Free/community access for researchers and bounty programs.
Target Markets
- Enterprise companies deploying AI
- Frontier AI labs
- Model developers
- Security researchers
- Enterprise AI security for autonomous agents
- Protecting tool/database/API integrations (MCP)
- Model safety evaluation for AI labs
- Regulatory and compliance testing
- AI red-teaming career training (Proving Ground)
- OpenAI
- Anthropic
- US AI Safety Institute
- UK AI Safety Institute