promptfoo

Promptfoo is an open-source AI security testing platform used by 127 of the Fortune 500 to proactively identify and remediate vulnerabilities in LLM applications, agents, and RAG pipelines. It provides automated red teaming, real-time guardrails, model security testing, and prompt/model evaluations — all integrated directly into developer workflows and CI/CD pipelines. Backed by Andreessen Horowitz and Insight Partners, Promptfoo is built by practitioners who scaled generative AI to hundreds of millions of users. With over 300,000 open-source users and 134,000+ weekly downloads, it represents the world's largest AI security community.

• Automated Red Teaming — Run npx promptfoo@latest redteam setup to generate thousands of context-aware attacks including prompt injections, jailbreaks, PII leaks, and business rule violations tailored to your application.
• Real-Time Guardrails — Deploy runtime protection against jailbreaks and adversarial attacks to shield production AI applications from live threats.
• Model Security Testing — Conduct comprehensive security assessments across foundation models and custom deployments to benchmark safety and compliance.
• LLM Evaluations — Test and compare prompts, models, and RAG pipelines with configurable YAML-based test suites and view results locally or in the cloud.
• MCP Proxy — Secure Model Context Protocol communications with a dedicated proxy layer for agent frameworks.
• Code Scanning — Find LLM vulnerabilities directly in your IDE and CI/CD pipeline before they reach production.
• CI/CD Integration — Connect to GitHub, GitLab, Jenkins, and more to run continuous security testing as part of your development lifecycle.
• Compliance Dashboards — Verify adherence to industry frameworks (HIPAA, FINRA, etc.) with centralized reporting and issue tracking.
• Threat Intelligence — Leverage real-time attack data from a community of 300,000+ developers, with contributors from OpenAI, Google, Microsoft, and Amazon.
• Enterprise Controls — SSO, granular permissions, team-based access control, webhooks, and managed cloud or on-premise deployment options.