EveryDev.ai
Subscribe
Home
Tools

5,901+ AI tools

  • Featured
  • Gems
  • Trending
  • New
  • Rate tools
  • Compare
  • Arena
Categories
  • Agents2972
  • Coding2248
  • Infrastructure1067
  • Projects818
  • MCP794
  • Research744
  • Analytics565
  • Marketing527
  • Design488
  • Testing476
  • Data442
  • Security412
  • Integration288
  • Communication284
  • Prompts283
  • Extensions238
  • Voice213
  • DevOps190
  • Commerce183
  • Web128
  • Learning123
  • Finance44
AI Tools by Topic
  • AI Coding Assistants
  • Agent Frameworks
  • MCP Servers
  • AI Prompt Tools
  • Vibe Coding Tools
  • AI Design Tools
  • AI Database Tools
  • AI Website Builders
  • AI Testing Tools
  • LLM Evaluations
Follow Us
  • X / Twitter
  • LinkedIn
  • Reddit
  • Discord
  • Threads
  • Bluesky
  • Mastodon
  • YouTube
  • GitHub
  • Instagram
Get Started
  • Users
  • Rate Tools
  • About
  • Editorial Standards
  • Corrections & Disclosures
  • Community Guidelines
  • Advertise
  • Contact Us
  • Newsletter
  • Submit a Tool
  • Start a Discussion
  • Write A Blog
  • Share A Build
  • Terms of Service
  • Privacy Policy
Explore with AI
  • ChatGPT
  • Gemini
  • Claude
  • Grok
  • Perplexity
Agent Experience
  • llms.txt
Theme
With AI, Everyone is a Dev. EveryDev.ai ©
    1. Home
    2. Tools
    3. SWE-CoWork
    SWE-CoWork icon

    SWE-CoWork

    AI Coding Assistants

    A benchmark that evaluates coding agents taking over engineering assignments inside simulated software organizations.

    Visit Website

    At a Glance

    Pricing
    Free

    Download the benchmark and evaluation tools to run on your own infrastructure. Model API usage and compute costs are separate. Task assets retain their upstream licenses.

    Engagement

    Available On

    Linux
    API
    CLI

    Resources

    WebsiteDocsGitHubllms.txt

    Topics

    AI Coding AssistantsMulti-agent SystemsLLM Evaluations

    Alternatives

    SWE-benchProgramBenchDeepSWE
    Developer
    TokenWave AIPalo Alto, United States

    Listed Nov 2026

    About SWE-CoWork

    SWE-CoWork is a benchmark from TokenWave AI that tests whether a coding agent can inherit an ongoing engineering assignment and finish it as a dependable teammate. The agent receives a short handoff, a real repository, and access to a simulated workplace, then must recover requirements, implement changes, and verify delivery. The project page and README describe 101 assignments across 11 programming languages and 12 application domains.

    What It Is

    SWE-CoWork is an evaluation suite for coding agents rather than an agent itself. Instead of a fully specified issue, each task gives the agent a team note, a repository, and workplace records. Per the README, 82% of requirements are held only by simulated colleagues, so the agent has to find the right people and ask them.

    How a Task Works

    The agent reads a handoff at /task/README.md and works in the repository at /app/code. It searches board cards, design documents, reviews, artifacts, and chat threads through a single MCP server exposing 17 workplace tools plus a terminal. LLM-simulated colleagues answer questions from their private knowledge. The agent writes /app/SOLUTION.md, and the harness replays its changes in a fresh grading container and runs hidden tests, with eight hours allowed per assignment.

    Scoring and Reported Results

    Fail-to-pass tests measure newly required behavior and pass-to-pass tests measure preserved behavior. A task counts as resolved only when every test node passes. The manuscript reports results for eleven models; the two highest F2P scores, Claude-Opus-5.5 at 63.84% and GPT-6 Astra at 62.91%, resolve 6.93% and 7.92% of tasks. These are manuscript-reported results that were not independently reproduced. A paired Oracle-Spec condition that supplies the full requirements up front was evaluated for two models.

    Setup Path

    The repository ships a ./cowork CLI plus Claude Code and Codex campaign harnesses. It needs a Linux/amd64 host with Docker Engine, Python 3.10+, and a Responses API endpoint for the colleague model. Two tasks additionally require a root controller, systemd, cgroup v2, and runc.

    SWE-CoWork - 1

    Community Discussions

    Be the first to start a conversation about SWE-CoWork

    Share your experience with SWE-CoWork, ask questions, or help others learn from your insights.

    Pricing

    FREE

    Public Benchmark

    Download the benchmark and evaluation tools to run on your own infrastructure. Model API usage and compute costs are separate. Task assets retain their upstream licenses.

    • 101 software engineering assignments
    • Simulated workplace with colleague interactions
    • Containerized evaluation environments
    • Tools for running tasks and grading results

    Capabilities

    Key Features

    • 101 engineering assignments across 101 repositories, 11 languages, and 12 domains
    • 26 simulated colleagues per assignment with bounded knowledge
    • 17 workplace tools exposed through one MCP server
    • Hidden fail-to-pass and pass-to-pass test grading
    • Eight-hour budget per assignment with digest-pinned container images
    • Claude Code and Codex campaign harnesses
    • Oracle-Spec condition providing full requirements up front
    • Baseline and reference-solution validation controls

    Integrations

    Claude Code
    Codex
    MCP
    Docker
    Hugging Face
    API Available
    View Docs

    Ratings & Reviews

    No ratings yet

    Be the first to rate SWE-CoWork and help others make informed decisions.

    Rate other tools you’ve used

    Developer

    TokenWave AI

    Palo Alto
    Read more about TokenWave AI
    WebsiteGitHub
    1 tool in directory

    Similar Tools

    SWE-bench icon

    SWE-bench

    A benchmark for evaluating large language models on real-world GitHub issues, tasking models to generate patches that resolve described software problems.

    ProgramBench icon

    ProgramBench

    A benchmark that tests whether AI agents can rebuild real-world programs from scratch given only a compiled binary and its documentation, with no access to source code.

    DeepSWE icon

    DeepSWE

    A benchmark for measuring frontier coding agents on 113 original, long-horizon software engineering tasks drawn from active open-source repositories across 5 languages.

    Browse all tools

    Related Topics

    AI Coding Assistants

    AI tools that help write, edit, and understand code with intelligent suggestions.

    1229 tools

    Multi-agent Systems

    Platforms for creating and managing teams of AI agents that can collaborate.

    676 tools

    LLM Evaluations

    Platforms and frameworks for evaluating, testing, and benchmarking LLM systems and AI applications. These tools provide evaluators and evaluation models to score AI outputs, measure hallucinations, assess RAG quality, detect failures, and optimize model performance. Features include automated testing with LLM-as-a-judge metrics, component-level evaluation with tracing, regression testing in CI/CD pipelines, custom evaluator creation, dataset curation, and real-time monitoring of production systems. Teams use these solutions to validate prompt effectiveness, compare models side-by-side, ensure answer correctness and relevance, identify bias and toxicity, prevent PII leakage, and continuously improve AI product quality through experiments, benchmarks, and performance analytics.

    249 tools
    Browse all topics
    Back to all toolsSuggest an edit
    ratings
    discussions