ICCV · 2025
Bootstrap3D: Improving Multi-view Diffusion Model with Synthetic Data
Key takeaway
Bootstrap3D uses filtered and recaptioned synthetic multi-view images to improve 3D generation while preserving the strengths of pretrained 2D diffusion models. arXiv abstract · v2
Abstract
Recent years have witnessed remarkable progress in multi-view diffusion models for 3D content creation. However, there remains a significant gap in image quality and prompt-following ability compared to 2D diffusion models. A critical bottleneck is the scarcity of high-quality 3D objects with detailed captions. To address this challenge, we propose Bootstrap3D, a novel framework that automatically generates an arbitrary quantity of multi-view images to assist in training multi-view diffusion models. Specifically, we introduce a data generation pipeline that employs (1) 2D and video diffusion models to generate multi-view images based on constructed text prompts, and (2) our fine-tuned 3D-aware MV-LLaVA for filtering high-quality data and rewriting inaccurate captions. Leveraging this pipeline, we have generated 1 million high-quality synthetic multi-view images with dense descriptive captions to address the shortage of high-quality 3D data. Furthermore, we present a Training Timestep Reschedule (TTR) strategy that leverages the denoising process to learn multi-view consistency while maintaining the original 2D diffusion prior. Extensive experiments demonstrate that Bootstrap3D can generate high-quality multi-view images with superior aesthetic quality, image-text alignment, and maintained view consistency.
Author abstract · arXiv abstract · v2
Publication
IEEE International Conference on Computer Vision (ICCV), 2025
Paper and resources
Research topics
Bootstrap3D · Multi-view diffusion · Synthetic 3D training data · MV-LLaVA · Dense captions · View consistency · Training Timestep Reschedule · 3D content generation
Research problem and approach
Multi-view diffusion is limited by scarce, well-captioned 3D data. Bootstrap3D creates multi-view images using image and video generators, then filters and recaptions them with a 3D-aware vision-language model. arXiv abstract · v2
Main contributions
- Generates one million synthetic multi-view images with dense captions using MV-LLaVA-based quality control. arXiv abstract · v2
- Introduces Training Timestep Reschedule to balance view consistency with the 2D diffusion prior. arXiv abstract · v2
Method comparison
| Approach | Key difference |
|---|---|
| Multi-view learning from scarce 3D data | Faces limited coverage and caption quality in available multi-view supervision. |
| Bootstrap3D | Adds filtered, recaptioned synthetic multi-view images and reschedules training timesteps to retain the 2D prior. |
Selected results
- On four-view generation, Bootstrap3D improves CLIP-L/14 retrieval score from MVDream’s 84.8 to 88.8 and lowers FID against the PixArt reference distribution from 59.2 to 31.0. CLIP evaluation uses 110 GPTeval3D prompts; FID uses 30k object-centric reference images. Table 1 · four-view generation · arXiv v2
- With 100k synthetic images and Cap3D captions, enabling TTR lowers multi-view FID from 92.0 to 60.8 and generated-object FID from 134.6 to 70.6. Adding dense recaptioning further lowers these values to 50.2 and 50.9. Table 3 · synthetic-data ablation · arXiv v2
Cite this paper
Zeyi Sun, Tong Wu, Pan Zhang, Yuhang Zang, Xiaoyi Dong, Yuanjun Xiong, Dahua Lin, Jiaqi Wang. Bootstrap3D: Improving Multi-view Diffusion Model with Synthetic Data. Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 2025, pp. 15714–15726.
@inproceedings{arxiv240600093,
title = {{Bootstrap3D: Improving Multi-view Diffusion Model with Synthetic Data}},
author = {Zeyi Sun and Tong Wu and Pan Zhang and Yuhang Zang and Xiaoyi Dong and Yuanjun Xiong and Dahua Lin and Jiaqi Wang},
booktitle = {Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV)},
month = {October},
year = {2025},
pages = {15714--15726},
url = {https://openaccess.thecvf.com/content/ICCV2025/html/Sun_Bootstrap3D_Improving_Multi-view_Diffusion_Model_with_Synthetic_Data_ICCV_2025_paper.html}
}