CVPR · 2026
Spatial-SSRL: Enhancing Spatial Understanding via Self-Supervised Reinforcement Learning
Key takeaway
Spatial-SSRL derives verifiable spatial rewards from ordinary RGB or RGB-D images, improving spatial understanding without human or LVLM annotations for its pretext tasks. arXiv abstract · v2
Abstract
Spatial understanding remains a weakness of Large Vision-Language Models (LVLMs). Existing supervised fine-tuning (SFT) and recent reinforcement learning with verifiable rewards (RLVR) pipelines depend on costly supervision, specialized tools, or constrained environments that limit scale. We introduce Spatial-SSRL, a self-supervised RL paradigm that derives verifiable signals directly from ordinary RGB or RGB-D images. Spatial-SSRL automatically formulates five pretext tasks that capture 2D and 3D spatial structure: shuffled patch reordering, flipped patch recognition, cropped patch inpainting, regional depth ordering, and relative 3D position prediction. These tasks provide ground-truth answers that are easy to verify and require no human or LVLM annotation. Training on our tasks substantially improves spatial reasoning while preserving general visual capabilities. On seven spatial understanding benchmarks in both image and video settings, Spatial-SSRL delivers average accuracy gains of 4.63% (3B) and 3.89% (7B) over the Qwen2.5-VL baselines. Our results show that simple, intrinsic supervision enables RLVR at scale and provides a practical route to stronger spatial intelligence in LVLMs.
Author abstract · arXiv abstract · v2
Publication
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2026
Paper and resources
Research topics
Spatial-SSRL · Spatial understanding · Self-supervised reinforcement learning · Verifiable rewards · RGB-D images · Relative depth · 3D position prediction · Spatial pretext tasks
Research problem and approach
Spatial reinforcement learning often depends on expensive labels, tools or constrained environments. Spatial-SSRL constructs self-supervised tasks whose answers follow directly from image transformations and depth information. arXiv abstract · v2
Main contributions
- Defines patch reordering, flip recognition, crop inpainting, depth ordering and relative 3D-position tasks. arXiv abstract · v2
- Uses these intrinsic verification signals to scale spatial RLVR training. arXiv abstract · v2
Method comparison
| Approach | Key difference |
|---|---|
| Annotation- or tool-dependent spatial RL | Obtains supervision from labeled spatial data, external tools or constrained task environments. |
| Spatial-SSRL | Derives verifiable pretext-task rewards from RGB or RGB-D inputs without human or LVLM annotations. |
Selected results
- Spatial-SSRL-3B improves the seven-benchmark average from the non-reasoning Qwen2.5-VL-3B baseline’s 45.91 to 50.54; the 7B model improves from 52.69 to 56.58. The reasoning-prompted baselines score 44.85 and 49.58, respectively. Table 1 · seven spatial benchmarks · arXiv v2
- Depth-only training reaches 63.48 on the 3DSR-Height subset versus 58.91 for all five tasks, while all-task training reaches 74.11 on 3DSR-Location versus 72.94 for depth only. The task mixture improves breadth but does not dominate every specialized subset. Table 4 · task ablation, 7B backbone · arXiv v2
Cite this paper
Yuhong Liu, Beichen Zhang, Yuhang Zang, Yuhang Cao, Long Xing, Xiaoyi Dong, Haodong Duan, Dahua Lin, Jiaqi Wang. Spatial-SSRL: Enhancing Spatial Understanding via Self-Supervised Reinforcement Learning. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2026, pp. 9570–9581.
@inproceedings{arxiv251027606,
title = {{Spatial-SSRL: Enhancing Spatial Understanding via Self-Supervised Reinforcement Learning}},
author = {Yuhong Liu and Beichen Zhang and Yuhang Zang and Yuhang Cao and Long Xing and Xiaoyi Dong and Haodong Duan and Dahua Lin and Jiaqi Wang},
booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)},
month = {June},
year = {2026},
pages = {9570--9581},
url = {https://openaccess.thecvf.com/content/CVPR2026/html/Liu_Spatial-SSRL_Enhancing_Spatial_Understanding_via_Self-Supervised_Reinforcement_Learning_CVPR_2026_paper.html}
}