EMNLP · 2026
Demo-ICL: In-Context Learning for Procedural Video Knowledge Acquisition
Key takeaway
Demo-ICL trains video-language models to acquire procedural knowledge from in-context demonstrations, rather than relying only on knowledge already stored in their parameters. arXiv abstract · v1
Abstract
Despite the growing video understanding capabilities of recent Multimodal Large Language Models (MLLMs), existing video benchmarks primarily assess understanding based on models' static, internal knowledge, rather than their ability to learn and adapt from dynamic, novel contexts from few examples. To bridge this gap, we present Demo-driven Video In-Context Learning, a novel task focused on learning from in-context demonstrations to answer questions about the target videos. Alongside this, we propose Demo-ICL-Bench, a challenging benchmark designed to evaluate demo-driven video in-context learning capabilities. Demo-ICL-Bench is constructed from 1200 instructional YouTube videos with associated questions, from which two types of demonstrations are derived: (i) summarizing video subtitles for text demonstration; and (ii) corresponding instructional videos as video demonstrations. To effectively tackle this new challenge, we develop Demo-ICL, an MLLM with a two-stage training strategy: video-supervised fine-tuning and information-assisted direct preference optimization, jointly enhancing the model's ability to learn from in-context examples. Extensive experiments with state-of-the-art MLLMs confirm the difficulty of Demo-ICL-Bench, demonstrate the effectiveness of Demo-ICL, and thereby unveil future research directions.
Author abstract · arXiv abstract · v1
Publication
Findings of Empirical Methods in Natural Language Processing (Findings of EMNLP), 2026
Paper and resources
Research topics
Demo-ICL · Video in-context learning · Procedural knowledge · Instructional videos · Demonstration learning · Video question answering · Direct preference optimization · Multimodal adaptation
Research problem and approach
Existing video benchmarks mainly test static knowledge. Demo-ICL-Bench asks whether a model can learn from text or video demonstrations and apply that knowledge to questions about a target video. arXiv abstract · v1
Main contributions
- Builds a demonstration-driven benchmark from 1,200 instructional YouTube videos. arXiv abstract · v1
- Combines video-supervised fine-tuning with information-assisted direct preference optimization. arXiv abstract · v1
Method comparison
| Approach | Key difference |
|---|---|
| Static-knowledge video question answering | Primarily tests information already available in model parameters and the target video. |
| Demo-ICL | Supplies demonstrations as context and trains the model to acquire and apply procedural information from them. |
Selected results
- With the 7B Ola-VideoBase backbone and 32-frame input, Demo-ICL raises the reported task average from 24.8 to 33.1. Text-demonstration performance rises from 31.4 to 43.4, and video-demonstration performance from 25.0 to 32.0. Table 1 · demonstration-conditioned evaluation · arXiv v1
- The task average is 26.4 without instructional-video training, 29.8 after Demo-ICL SFT, 30.7 with vanilla DPO, and 33.1 with the final method. The ablation separates the contributions of instructional data and preference optimization. Table 4 · training ablation · arXiv v1
Cite this paper
Yuhao Dong, Shulin Tian, Shuai Liu, Shuangrui Ding, Yuhang Zang, Xiaoyi Dong, Yuhang Cao, Jiaqi Wang, Ziwei Liu. Demo-ICL: In-Context Learning for Procedural Video Knowledge Acquisition. arXiv preprint arXiv:2602.08439, 2026.
@article{arxiv260208439,
title = {{Demo-ICL: In-Context Learning for Procedural Video Knowledge Acquisition}},
author = {Yuhao Dong and Shulin Tian and Shuai Liu and Shuangrui Ding and Yuhang Zang and Xiaoyi Dong and Yuhang Cao and Jiaqi Wang and Ziwei Liu},
journal = {arXiv preprint arXiv:2602.08439},
year = {2026},
url = {https://arxiv.org/abs/2602.08439}
}