擴散語言模型的任務感知時間量化:不同任務,不同時間步
Different Tasks, Different Timesteps: Temporal Task-Aware Quantization for Diffusion Language Models
T²Quant 是一套面向擴散語言模型的混合精度量化框架,按不同任務在去噪步驟中的精度需求分配激活值精度。它只需少量無標註校準提示詞,並在固定位元寬度預算下,令現有量化方法的表現提升最多 6.7 個百分點,而不增加平均精度預算。測試涵蓋 3 個擴散語言模型和 6 個基準測試。
Excited to share our new paper: Different Tasks, Different Timesteps: Temporal Task-Aware Quantization for Diffusion Language Models! 🚀
We reveal that quantization sensitivity is both task and time-dependent, with different downstream tasks exhibiting distinct precision requirements across denoising steps.
Building on this finding, we introduce T²Quant, a mixed-precision framework that:
- 🔍 Predicts precision sensitivity using only a few unlabeled calibration prompts.
- ⚙️ Allocates activation precision across denoising steps under a fixed bit-width budget.
- 📈 Improves existing quantization methods by up to 6.7 percentage points, without increasing the average precision budget.
Evaluated across 3 diffusion language models and 6 benchmarks.
📄 Paper: https://arxiv.org/abs/2610.31198
We welcome feedback, questions, and discussions!
來源:HuggingFace Daily Papers(社區熱門論文) · huggingface.co