ICLR · 2026
Beyond Fixed: Training-Free Variable-Length Denoising for Diffusion Large Language Models
Key takeaway
DAEDAL enables training-free variable-length generation in diffusion language models by expanding the response length before and during denoising when internal signals indicate insufficient space. arXiv abstract · v2
Abstract
Diffusion Large Language Models (DLLMs) are emerging as a powerful alternative to the dominant Autoregressive Large Language Models, offering efficient parallel generation and capable global context modeling. However, the practical application of DLLMs is hindered by a critical architectural constraint: the need for a statically predefined generation length. This static length allocation leads to a problematic trade-off: insufficient lengths cripple performance on complex tasks, while excessive lengths incur significant computational overhead and sometimes result in performance degradation. While the inference framework is rigid, we observe that the model itself possesses internal signals that correlate with the optimal response length for a given task. To bridge this gap, we leverage these latent signals and introduce DAEDAL, a novel training-free denoising strategy that enables Dynamic Adaptive Length Expansion for Diffusion Large Language Models. DAEDAL operates in two phases: 1) Before the denoising process, DAEDAL starts from a short initial length and iteratively expands it to a coarse task-appropriate length, guided by a sequence completion metric. 2) During the denoising process, DAEDAL dynamically intervenes by pinpointing and expanding insufficient generation regions through mask token insertion, ensuring the final output is fully developed. Extensive experiments on DLLMs demonstrate that DAEDAL achieves performance comparable, and in some cases superior, to meticulously tuned fixed-length baselines, while simultaneously enhancing computational efficiency by achieving a higher effective token ratio. By resolving the static length constraint, DAEDAL unlocks new potential for DLLMs, bridging a critical gap with their Autoregressive counterparts and paving the way for more efficient and capable generation.
Author abstract · arXiv abstract · v2
Publication
International Conference on Learning Representations (ICLR), 2026
Paper and resources
Research topics
DAEDAL · Diffusion language models · Variable-length generation · Adaptive denoising · Mask-token insertion · Training-free inference · Generation efficiency · Dynamic length expansion
Research problem and approach
A fixed output length either truncates difficult responses or wastes computation. DAEDAL uses completion signals to choose a coarse initial length and inserts mask tokens into underdeveloped regions during generation. arXiv abstract · v2
Main contributions
- Separates initial length selection from local expansion during denoising. arXiv abstract · v2
- Uses signals already present in the model without additional training. arXiv abstract · v2
Method comparison
| Approach | Key difference |
|---|---|
| Fixed-length diffusion generation | Allocates one response length, risking truncation or unused decoding capacity. |
| DAEDAL | Chooses an initial length from internal signals and expands underdeveloped regions during denoising. |
Selected results
- On GSM8K, DAEDAL reaches 85.8% accuracy with an average total length of 363 tokens, versus 83.8% at the best fixed-length baseline of 1,024 tokens. The four-task accuracy average rises from 52.05% at that fixed length to 54.75%. Table 1 · LLaDA-Instruct-8B · arXiv v2
- On GSM8K with an initial length of 64, Stage 1 alone achieves 84.1% accuracy with 311 total tokens, while both DAEDAL stages reach 85.8% with 363. This isolates the accuracy–length trade-off introduced by the second stage. Table 3 · adaptive-length stage ablation · arXiv v2
Cite this paper
Jinsong Li, Xiaoyi Dong, Yuhang Zang, Yuhang Cao, Jiaqi Wang, Dahua Lin. Beyond Fixed: Training-Free Variable-Length Denoising for Diffusion Large Language Models. International Conference on Learning Representations, 2026, 2026, pp. 91715–91731.
@inproceedings{arxiv250800819,
title = {{Beyond Fixed: Training-Free Variable-Length Denoising for Diffusion Large Language Models}},
author = {Jinsong Li and Xiaoyi Dong and Yuhang Zang and Yuhang Cao and Jiaqi Wang and Dahua Lin},
booktitle = {International Conference on Learning Representations},
year = {2026},
volume = {2026},
pages = {91715--91731},
url = {https://proceedings.iclr.cc/paper_files/paper/2026/hash/940380c12da75e64351cceff4c880557-Abstract-Conference.html}
}