EndoCoT: Scaling Endogenous Chain-of-Thought Reasoning in Diffusion Models

Xuanlang Dai; Yujie Zhou; Long Xing; Jiazi Bu; Xilin Wei; Yuhong Liu; Beichen Zhang; Kai Chen; Yuhang Zang

ECCV · 2026

EndoCoT: Scaling Endogenous Chain-of-Thought Reasoning in Diffusion Models

Xuanlang Dai, Yujie Zhou, Long Xing, Jiazi Bu, Xilin Wei, Yuhong Liu, Beichen Zhang, Kai Chen(corresponding author), Yuhang Zang(corresponding author)

Corresponding author

Key takeaway

EndoCoT couples iterative latent reasoning with diffusion generation, achieving 92.1% average accuracy under task-specific training across the visual reasoning settings in Table 1, compared with 83.8% for DiffThinker. Table 1

Abstract

Recently, Multimodal Large Language Models (MLLMs) have been widely integrated into diffusion frameworks primarily as text encoders to tackle complex tasks such as spatial reasoning. However, this paradigm suffers from two critical limitations: (i) MLLMs text encoder exhibit insufficient reasoning depth. Single-step encoding fails to activate the Chain-of-Thought process, which is essential for MLLMs to provide accurate guidance for complex tasks. (ii) The guidance remains invariant during the decoding process. Invariant guidance during decoding prevents DiT from progressively decomposing complex instructions into actionable denoising steps, even with correct MLLM encodings. To this end, we propose Endogenous Chain-of-Thought (EndoCoT), a novel framework that first activates MLLMs’ reasoning potential by iteratively refining latent thought states through an iterative thought guidance module, and then bridges these states to the DiT’s denoising process. Second, a terminal thought grounding module is applied to ensure the reasoning trajectory remains grounded in textual supervision by aligning the final state with ground-truth answers. With these two components, the MLLM text encoder delivers meticulously reasoned guidance, enabling the DiT to execute it progressively and ultimately solve complex tasks in a step-by-step manner. Extensive evaluations across diverse benchmarks (e.g., Maze, TSP, VSP, and Sudoku) achieve an average accuracy of 92.1%, outperforming the strongest baseline by 8.3 percentage points.

Author abstract · Author abstract

Publication

European Conference on Computer Vision (ECCV), 2026

Paper and resources

Research topics

Endogenous chain-of-thought · Latent reasoning · Diffusion models · Diffusion Transformers (DiT) · Multimodal large language models · Visual reasoning · Spatial planning · Iterative thought guidance · Terminal thought grounding · Progressive training · Test-time scaling · Image-to-image generation

Research problem and approach

Using an MLLM as a single-pass text encoder leaves diffusion generation with shallow reasoning and fixed guidance. EndoCoT repeatedly updates latent thought states, uses them to condition the diffusion model, and grounds the final state in textual supervision so that generation can follow a multi-step reasoning process. Section 4.2

Main contributions

Iterative thought guidance updates latent reasoning states and conditions visual generation at each reasoning step; LoRA adapts both the MLLM and the diffusion transformer. Section 4.2.1
Terminal thought grounding aligns the final latent state with a reference representation of the ground-truth reasoning, complementing visual supervision. Section 4.2.2
Progressive training first supervises intermediate and final reasoning steps, then optimizes the terminal output. At inference, latent thought states can be updated without decoding every intermediate image. Sections 4.2.3–4.2.4

Method comparison

Approach	Conditioning	Reasoning process	Supervision
Standard diffusion conditioning	Static text embeddings	Denoising under fixed guidance	Final visual target
EndoCoT	Iteratively refined latent thought states	Multiple latent reasoning steps guide generation	Intermediate visual targets and textual grounding of the final state

Section 4.2

Selected results

Qwen-Image-Edit-2511 · arXiv v4, Table 1. Comparisons use the same training setting in each row.
Setting / metric	DiffThinker	EndoCoT	Gain	Source
Task-specific training · all evaluated settings Average accuracy (%)	83.8	92.1	+8.3	Table 1
Unified training · one model for all tasks Average accuracy (%)	77.1	84.2	+7.1	Table 1
Task-specific training · Maze, scale 32 Accuracy (%)	65.0	90.0	+25.0	Table 1
Task-specific training · Sudoku, scale 35 Accuracy (%)	55.0	95.0	+40.0	Table 1

Average accuracy follows the 18 settings reported in Table 1, covering Maze, TSP, Sudoku and VSP (including VSP-Super). Gains are percentage points over DiffThinker.

Cite this paper

Xuanlang Dai, Yujie Zhou, Long Xing, Jiazi Bu, Xilin Wei, Yuhong Liu, Beichen Zhang, Kai Chen, Yuhang Zang. EndoCoT: Scaling Endogenous Chain-of-Thought Reasoning in Diffusion Models. arXiv preprint arXiv:2603.12252, 2026.

Download BibTeX arXiv record

@article{dai2026endocot,
  title     = {{EndoCoT: Scaling Endogenous Chain-of-Thought Reasoning in Diffusion Models}},
  author    = {Xuanlang Dai and Yujie Zhou and Long Xing and Jiazi Bu and Xilin Wei and Yuhong Liu and Beichen Zhang and Kai Chen and Yuhang Zang},
  journal   = {arXiv preprint arXiv:2603.12252},
  year      = {2026},
  url       = {https://arxiv.org/abs/2603.12252}
}