跳到正文
HuggingFace Daily Papers(社區熱門論文)·· 2026-10-22AI 評分41

擴散語言模型的任務感知時間量化:不同任務,不同時間步

Different Tasks, Different Timesteps: Temporal Task-Aware Quantization for Diffusion Language Models

AI 導讀

T²Quant 是一套面向擴散語言模型的混合精度量化框架,按不同任務在去噪步驟中的精度需求分配激活值精度。它只需少量無標註校準提示詞,並在固定位元寬度預算下,令現有量化方法的表現提升最多 6.7 個百分點,而不增加平均精度預算。測試涵蓋 3 個擴散語言模型和 6 個基準測試。

正文

Excited to share our new paper: Different Tasks, Different Timesteps: Temporal Task-Aware Quantization for Diffusion Language Models! 🚀

We reveal that quantization sensitivity is both task and time-dependent, with different downstream tasks exhibiting distinct precision requirements across denoising steps.

Building on this finding, we introduce T²Quant, a mixed-precision framework that:

  • 🔍 Predicts precision sensitivity using only a few unlabeled calibration prompts.
  • ⚙️ Allocates activation precision across denoising steps under a fixed bit-width budget.
  • 📈 Improves existing quantization methods by up to 6.7 percentage points, without increasing the average precision budget.

Evaluated across 3 diffusion language models and 6 benchmarks.

📄 Paper: https://arxiv.org/abs/2610.31198

We welcome feedback, questions, and discussions!

來源:HuggingFace Daily Papers(社區熱門論文) · huggingface.co