DiCache: Let Diffusion Model Determine Its Own Cache

Abstract

Recent years have witnessed the rapid development of acceleration techniques for diffusion models, especially caching-based acceleration methods. These studies seek to answer two fundamental questions: "When to cache" and "How to use cache", typically relying on predefined empirical laws or dataset-level priors to determine caching timings and adopting handcrafted rules for multi-step cache utilization. However, given the highly dynamic nature of the diffusion process, they often exhibit limited generalizability and fail to cope with diverse samples. In this paper, a strong sample-specific correlation is revealed between the variation patterns of the shallow-layer feature differences in the diffusion model and those of deep-layer features. Moreover, we have observed that the features from different model layers form similar trajectories. Based on these observations, we present DiCache, a novel training-free adaptive caching strategy for accelerating diffusion models at runtime, answering both when and how to cache within a unified framework. Specifically, DiCache is composed of two principal components: (1) Online Probe Profiling Scheme leverages a shallow-layer online probe to obtain an on-the-fly indicator for the caching error in real time, enabling the model to dynamically customize the caching schedule for each sample. (2) Dynamic Cache Trajectory Alignment adaptively approximates the deep-layer feature output from multi-step historical caches based on the shallow-layer feature trajectory, facilitating higher visual quality. Extensive experiments validate DiCache's capability in achieving higher efficiency and improved fidelity over state-of-the-art approaches on various leading diffusion models including WAN 2.1, HunyuanVideo and Flux.

Author abstract · arXiv abstract · v2

Publication

International Conference on Learning Representations (ICLR), 2026

Paper and resources

• Paper · arXiv v2 (PDF)
• arXiv:2508.17356
• Google Scholar
• Code · Bujiazi/DiCache

Research topics

DiCache · Diffusion acceleration · Adaptive caching · Online feature probes · Cache trajectory alignment · Training-free inference · Video generation · Image generation

Research problem and approach

Dataset-level caching schedules cannot fully capture sample-specific diffusion dynamics. DiCache exploits correlations between shallow- and deep-layer feature trajectories to estimate caching error online. arXiv abstract · v2

Main contributions

• Uses Online Probe Profiling to select when cached features can be reused. arXiv abstract · v2
• Applies Dynamic Cache Trajectory Alignment to approximate deeper features from historical caches. arXiv abstract · v2

Method comparison

arXiv abstract · v2

Selected results

• For FLUX, DiCache reduces latency from 15.11 to 4.69 seconds (3.22× speedup), with LPIPS 0.2704 relative to vanilla output. For HunyuanVideo, latency falls from 1,186.32 to 507.24 seconds (2.34×), with LPIPS 0.1492. Table 1 · A800 80GB inference benchmark · arXiv v2
• On HunyuanVideo, increasing the reuse threshold from 0.05 to 0.20 raises speedup from 1.76× to 2.90× but increases LPIPS from 0.1047 to 0.1886. The default threshold of 0.10 yields 2.34× speedup and LPIPS 0.1492. Table 2 · reuse-threshold ablation · arXiv v2

Cite this paper

Jiazi Bu, Pengyang Ling, Yujie Zhou, Yibin Wang, Yuhang Zang, Dahua Lin, Jiaqi Wang. DiCache: Let Diffusion Model Determine Its Own Cache. International Conference on Learning Representations, 2026, 2026, pp. 73778–73803.

@inproceedings{arxiv250817356,
  title     = {{DiCache: Let Diffusion Model Determine Its Own Cache}},
  author    = {Jiazi Bu and Pengyang Ling and Yujie Zhou and Yibin Wang and Yuhang Zang and Dahua Lin and Jiaqi Wang},
  booktitle = {International Conference on Learning Representations},
  year      = {2026},
  volume    = {2026},
  pages     = {73778--73803},
  url       = {https://proceedings.iclr.cc/paper_files/paper/2026/hash/78288ef33b18a351c3cd679dc9a15c8d-Abstract-Conference.html}
}