EveryDev.ai
Subscribe
Home
Tools

5,901+ AI tools

  • Featured
  • Gems
  • Trending
  • New
  • Rate tools
  • Compare
  • Arena
Categories
  • Agents2972
  • Coding2248
  • Infrastructure1067
  • Projects818
  • MCP794
  • Research744
  • Analytics565
  • Marketing527
  • Design488
  • Testing476
  • Data442
  • Security412
  • Integration288
  • Communication284
  • Prompts283
  • Extensions238
  • Voice213
  • DevOps190
  • Commerce183
  • Web128
  • Learning123
  • Finance44
AI Tools by Topic
  • AI Coding Assistants
  • Agent Frameworks
  • MCP Servers
  • AI Prompt Tools
  • Vibe Coding Tools
  • AI Design Tools
  • AI Database Tools
  • AI Website Builders
  • AI Testing Tools
  • LLM Evaluations
Follow Us
  • X / Twitter
  • LinkedIn
  • Reddit
  • Discord
  • Threads
  • Bluesky
  • Mastodon
  • YouTube
  • GitHub
  • Instagram
Get Started
  • Users
  • Rate Tools
  • About
  • Editorial Standards
  • Corrections & Disclosures
  • Community Guidelines
  • Advertise
  • Contact Us
  • Newsletter
  • Submit a Tool
  • Start a Discussion
  • Write A Blog
  • Share A Build
  • Terms of Service
  • Privacy Policy
Explore with AI
  • ChatGPT
  • Gemini
  • Claude
  • Grok
  • Perplexity
Agent Experience
  • llms.txt
Theme
With AI, Everyone is a Dev. EveryDev.ai ©
    1. Home
    2. Tools
    3. MACaQ
    MACaQ icon

    MACaQ

    Model Management

    Open-source model-agnostic calibrated quantizer for 4-bit weights and activations across text, image, video, audio and 3D models.

    Visit Website

    At a Glance

    Pricing
    Open Source

    MACaQ is open source under the Apache License 2.0, free to use, modify and distribute. Bundled third-party components retain their own licenses.

    Engagement

    Available On

    Linux
    API
    SDK
    CLI

    Resources

    WebsiteDocsGitHubllms.txt

    Topics

    Model ManagementCompute OptimizationLocal Inference

    Alternatives

    AWQ (llm-awq)llama-modchipSPECTRA
    Developer
    Huawei Computing Systems LabZürich, Switzerland

    Listed Nov 2026

    About MACaQ

    MACaQ (Model Agnostic Calibrated Quantization) is an open-source quantization toolkit from Huawei Computing Systems Lab in Switzerland. It calibrates low-precision weights and activations one linear layer at a time, and it targets text, image, video, audio and 3D reconstruction models. It ships workflows for llama.cpp, vLLM, Diffusers and PyTorch under the Apache 2.0 license.

    What It Is

    MACaQ is a post-training quantizer. For each linear layer it applies channel balancing, small Hadamard transforms and weight refinement (Flip-Refinement), and every change stays inside that layer. Calibration and refinement happen offline, and the saved checkpoint is then served or run without recalibration. The 4-bit formats it uses include MXFP4 with W4A4 and W4A8 configurations, and it can also produce 2-, 3- and 4-bit GGUF files.

    Workflow and Backends

    Users install a separate Python 3.12 environment per backend, supply representative calibration text or data, quantize, and then run or serve the result.

    • llama.cpp: quantizes text models to GGUF and runs them with the bundled runtime. CPU execution is also supported.
    • vLLM: produces compact checkpoints for generation or HTTP chat serving.
    • Diffusers: quantizes diffusion transformers for image, video and audio generation.
    • PyTorch: quantizes speech generators such as Qwen3-TTS and Chatterbox Turbo.

    The docs list example models including Qwen3 variants, FLUX.2 klein 4B, Wan2.2 and MapAnything.

    MACaQ-R

    MACaQ-R refines the weight codes of an existing quantized GGUF while preserving its native formats and block scales. The resulting files run on a standard llama.cpp installation. The README publishes a Qwen3.6-35B-A3B MACaQ-R GGUF on Hugging Face.

    Reported Results and Ascend Kernels

    The README states that MACaQ can quantize a 122B-parameter model in 64 minutes using 32.5 GB of device memory. It also reports lower KL divergence than other published Qwen3-4B GGUFs at comparable file sizes. These figures come from the authors. MACaQ W4A4 dense and grouped matmul kernels for Ascend are available through CANN pull requests, and full-model execution there needs integration with an Ascend inference runtime.

    MACaQ - 1

    Community Discussions

    Be the first to start a conversation about MACaQ

    Share your experience with MACaQ, ask questions, or help others learn from your insights.

    Pricing

    OPEN SOURCE

    Open Source (Apache 2.0)

    MACaQ is open source under the Apache License 2.0, free to use, modify and distribute. Bundled third-party components retain their own licenses.

    • Apache License 2.0
    • Quantize text, image, video and audio models
    • Backends: llama.cpp, vLLM, Diffusers, PyTorch
    • MACaQ-R to refine existing GGUF models
    • Bundled third-party components retain their respective licenses

    Capabilities

    Key Features

    • Layer-local calibrated quantization with channel balancing, block-Hadamard transforms and Flip-Refinement
    • 4-bit weight and activation (W4A4/W4A8 MXFP4) quantization
    • 2-, 3- and 4-bit GGUF export for llama.cpp
    • vLLM checkpoint quantization and HTTP serving
    • Diffusers support for image, video and audio generation models
    • PyTorch speech generator quantization
    • MACaQ-R refinement of existing GGUF models for standard llama.cpp
    • Ascend W4A4 dense and grouped matmul kernels via CANN pull requests

    Integrations

    llama.cpp
    vLLM
    Diffusers
    PyTorch
    Hugging Face
    Ascend CANN
    API Available
    View Docs

    Ratings & Reviews

    No ratings yet

    Be the first to rate MACaQ and help others make informed decisions.

    Rate other tools you’ve used

    Developer

    Huawei Computing Systems Lab

    Huawei Computing Systems Lab is a research group within Huawei Technologies Switzerland AG, based in Zürich and Lausanne. It works across the computing stack, from AI algorithms and graphics to processors, memory and systems software. The lab runs five teams: AI, CPU, Graphics, Memory and Software. It publishes papers and open-source artifacts, often with academic partners at European universities.

    Zürich, Switzerland
    Read more about Huawei Computing Systems Lab
    WebsiteGitHub
    1 tool in directory

    Similar Tools

    AWQ (llm-awq) icon

    AWQ (llm-awq)

    Activation-aware Weight Quantization toolkit for low-bit (INT3/INT4) compression and acceleration of LLMs and multi-modal models.

    llama-modchip icon

    llama-modchip

    Kernel patches, quantization transcoders, and runtime tools for running large Mixture-of-Experts models such as DeepSeek-V4-Flash 284B and 30B MoEs on CPU-only systems.

    SPECTRA icon

    SPECTRA

    Calibration-free 4-bit LLM compression engine and Triton-based GPU serving runtime for running models on consumer and edge GPUs.

    Browse all tools

    Related Topics

    Model Management

    Tools for managing, versioning, and deploying AI models.

    149 tools

    Compute Optimization

    Tools for optimizing computational resources and performance.

    94 tools

    Local Inference

    Tools and platforms for running AI inference locally without cloud dependence.

    359 tools
    Browse all topics
    Back to all toolsSuggest an edit
    ratings
    discussions