2025

Towards Storage-Efficient Visual Document Retrieval: An Empirical Study on Reducing Patch-Level Embeddings Yubo Ma, Jinsong Li, Yuhang Zang✉, Xiaobao Wu, Xiaoyi Dong, Pan Zhang, Yuhang Cao, Haodong Duan, Jiaqi Wang, Yixin Cao, Aixin Sun Findings of the Association for Computational Linguistics (Findings of ACL), 2025

InternLM-XComposer2.5-Reward: A Simple Yet Effective Multi-Modal Reward Model Yuhang Zang*, Xiaoyi Dong*, Pan Zhang*, Yuhang Cao*, Ziyu Liu, Shengyuan Ding, Shenxi Wu, Yubo Ma, Haodong Duan, Wenwei Zhang, Kai Chen, Dahua Lin, Jiaqi Wang Findings of the Association for Computational Linguistics (Findings of ACL), 2025

VideoRoPE: What Makes for Good Video Rotary Position Embedding? Xilin Wei*, Xiaoran Liu*, Yuhang Zang✉, Xiaoyi Dong, Pan Zhang, Yuhang Cao, Jian Tong, Haodong Duan, Qipeng Guo✉, Jiaqi Wang✉, Xipeng Qiu, Dahua Lin International Conference on Machine Learning (ICML), 2025 (Oral) Star

SongGen: A Single Stage Auto-regressive Transformer for Text-to-Song Generation Way Zihan Liu, Shuangrui Ding, Zhixiong Zhang, Xiaoyi Dong, Pan Zhang, Yuhang Zang, Yuhang Cao, Dahua Lin, Jiaqi Wang International Conference on Machine Learning (ICML), 2025 Star

ByTheWay: Boost Your Text-to-Video Generation Model to Higher Quality in a Training-free Way Jiazi Bu*, Pengyang Ling*, Pan Zhang, Tong Wu, Xiaoyi Dong, Yuhang Zang, Yuhang Cao, Dahua Lin, Jiaqi Wang IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2025 Star

OVOBench: How Far is Your Video-LLMs from Real-World Online Video Understanding? Yifei Li*, Junbo Niu*, Ziyang Miao, Chunjiang Ge, Yuanhang Zhou, Qihao He, Xiaoyi Dong, Haodong Duan, Shuangrui Ding, Rui Qian, Pan Zhang, Yuhang Zang, Yuhang Cao, Conghui He, Jiaqi Wang IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2025 Star

Dispider: Enabling Video LLMs with Active Real-Time Interaction via Disentangled Perception, Decision, and Reaction Rui Qian*, Shuangrui Ding*, Xiaoyi Dong, Pan Zhang, Yuhang Zang, Yuhang Cao, Dahua Lin, Jiaqi Wang IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2025 Star

PyramidDrop: Accelerating Your Large Vision-Language Models via Pyramid Visual Redundancy Reduction Long Xing, Qidong Huang, Xiaoyi Dong, Jiajie Lu, Pan Zhang, Yuhang Zang, Yuhang Cao, Conghui He, Jiaqi Wang, Feng Wu, Dahua Lin IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2025 Star

WildAvatar: Web-scale In-the-wild Video Dataset for 3D Avatar Creation Zihao Huang, ShouKang Hu, Guangcong Wang, Tianqi Liu, Yuhang Zang, Zhiguo Cao, Wei Li, Ziwei Liu IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2025 Star

MIA-DPO: Multi-Image Augmented Direct Preference Optimization For Large Vision-Language Models Ziyu Liu, Yuhang Zang✉, Xiaoyi Dong, Pan Zhang, Yuhang Cao, Haodong Duan, Conghui He, Yuanjun Xiong, Dahua Lin, Jiaqi Wang✉ International Conference on Learning Representations (ICLR), 2025 Star

MotionClone: Training-Free Motion Cloning for Controllable Video Generation Pengyang Ling*, Jiazi Bu*, Pan Zhang, Xiaoyi Dong, Yuhang Zang, Tong Wu, Huaian Chen, Jiaqi Wang, Yi Jin International Conference on Learning Representations (ICLR), 2025 Star

2024

VLMEvalKit: An Open-Source Toolkit for Evaluating Large Multi-Modality Models Haodong Duan, Junming Yang, Yuxuan Qiao, Xinyu Fang, Lin Chen, Yuan Liu, Xiaoyi Dong, Yuhang Zang, Pan Zhang, Jiaqi Wang, Dahua Lin, Kai Chen ACM Multimedia (ACM MM), 2024 (Open Source Software Competition) Star

InternLM-XComposer-2.5: A Versatile Large Vision Language Model Supporting Long-Contextual Input and Output Pan Zhang*, Xiaoyi Dong*, Yuhang Zang*, Yuhang Cao, Rui Qian, Lin Chen, Qipeng Guo, Haodong Duan, Bin Wang, Linke Ouyang, Songyang Zhang, Wenwei Zhang, Yining Li, Yang Gao, Peng Sun, Xinyue Zhang, Wei Li, Jingwen Li, Wenhai Wang, Hang Yan, Conghui He, Xingcheng Zhang, Kai Chen, Jifeng Dai, Yu Qiao, Dahua Lin, Jiaqi Wang arXiv, 2024 Star

MMLongBench-Doc: Benchmarking Long-context Document Understanding with Visualizations Yubo Ma, Yuhang Zang✉, Liangyu Chen, Meiqi Chen, Yizhu Jiao, Xinze Li, Xinyuan Lu, Ziyu Liu, Yan Ma, Xiaoyi Dong, Pan Zhang, Liangming Pan, Yu-Gang Jiang, Jiaqi Wang, Yixin Cao✉, Aixin Sun Neural Information Processing Systems (NeurIPS), 2024 (Datasets and Benchmarks Track) (Spotlight)

MMDU: A Multi-Turn Multi-Image Dialog Understanding Benchmark and Instruction-Tuning Dataset for LVLMs Ziyu Liu, Tao Chu, Yuhang Zang✉, Xilin Wei, Xiaoyi Dong, Pan Zhang, Zijian Liang, Yuanjun Xiong, Yu Qiao, Dahua Lin, Jiaqi Wang✉ Neural Information Processing Systems (NeurIPS), 2024 (Datasets and Benchmarks Track) Star

ShareGPT4Video: Improving Video Understanding and Generation with Better Captions Lin Chen*, Xilin Wei*, Jinsong Li*, Xiaoyi Dong, Pan Zhang, Yuhang Zang, Zehui Chen, Haodong Duan, Bin Lin, Zhenyu Tang, Li Yuan, Yu Qiao, Dahua Lin, Feng Zhao, Jiaqi Wang Neural Information Processing Systems (NeurIPS), 2024 (Datasets and Benchmarks Track) Star

Streaming Long Video Understanding with Large Language Models Rui Qian, Xiaoyi Dong, Pan Zhang, Yuhang Zang, Shuangrui Ding, Dahua Lin, Jiaqi Wang Neural Information Processing Systems (NeurIPS), 2024

Fast Generalizable Gaussian Splatting Reconstruction from Multi-View Stereo Tianqi Liu, Guangcong Wang, Shoukang Hu, Liao Shen, Xinyi Ye, Yuhang Zang, Zhiguo Cao, Wei Li, Ziwei Liu European Conference on Computer Vision (ECCV), 2024

InternLM-XComposer2-4KHD: A Pioneering Large Vision-Language Model Handling Resolutions from 336 Pixels to 4K HD Xiaoyi Dong*, Pan Zhang*, Yuhang Zang*, Yuhang Cao, Bin Wang, Linke Ouyang, Songyang Zhang, Haodong Duan, Wenwei Zhang, Yining Li, Hang Yan, Yang Gao, Zhe Chen, Xinyue Zhang, Wei Li, Jingwen Li, Wenhai Wang, Kai Chen, Conghui He, Xingcheng Zhang, Jifeng Dai, Yu Qiao, Dahua Lin, Jiaqi Wang Neural Information Processing Systems (NeurIPS), 2024 Star

Are We on the Right Way for Evaluating Large Vision-Language Models? Lin Chen*, Jinsong Li*, Xiaoyi Dong, Pan Zhang, Yuhang Zang, Zehui Chen, Haodong Duan, Jiaqi Wang, Yu Qiao, Dahua Lin, Feng Zhao Neural Information Processing Systems (NeurIPS), 2024 Star

InternLM2 Technical Report Zheng Cai, Maosong Cao, Haojiong Chen, Kai Chen, Keyu Chen, Xin Chen, Xun Chen, Zehui Chen, Zhi Chen, Pei Chu, Xiaoyi Dong, Haodong Duan, Qi Fan, Zhaoye Fei, Yang Gao, Jiaye Ge, Chenya Gu, Yuzhe Gu, Tao Gui, Aijia Guo, Qipeng Guo, Conghui He, Yingfan Hu, Ting Huang, Tao Jiang, Penglong Jiao, Zhenjiang Jin, Zhikai Lei, Jiaxing Li, Jingwen Li, Linyang Li, Shuaibin Li, Wei Li, Yining Li, Hongwei Liu, Jiangning Liu, Jiawei Hong, Kaiwen Liu, Kuikun Liu, Xiaoran Liu, Chengqi Lv, Haijun Lv, Kai Lv, Li Ma, Runyuan Ma, Zerun Ma, Wenchang Ning, Linke Ouyang, Jiantao Qiu, Yuan Qu, Fukai Shang, Yunfan Shao, Demin Song, Zifan Song, Zhihao Sui, Peng Sun, Yu Sun, Huanze Tang, Bin Wang, Guoteng Wang, Jiaqi Wang, Jiayu Wang, Rui Wang, Yudong Wang, Ziyi Wang, Xingjian Wei, Qizhen Weng, Fan Wu, Yingtong Xiong, Chao Xu, Ruiliang Xu, Hang Yan, Yirong Yan, Xiaogui Yang, Haochen Ye, Huaiyuan Ying, Jia Yu, Jing Yu, Yuhang Zang, Chuyu Zhang, Li Zhang, Pan Zhang, Peng Zhang, Ruijie Zhang, Shuo Zhang, Songyang Zhang, Wenjian Zhang, Wenwei Zhang, Xingcheng Zhang, Xinyue Zhang, Hui Zhao, Qian Zhao, Xiaomeng Zhao, Fengzhe Zhou, Zaida Zhou, Jingming Zhuo, Yicheng Zou, Xipeng Qiu, Yu Qiao, Dahua Lin arXiv, 2024 Star

Long-CLIP: Unlocking the Long-Text Capability of CLIP Beichen Zhang, Pan Zhang, Xiaoyi Dong, Yuhang Zang, Jiaqi Wang European Conference on Computer Vision (ECCV), 2024 Star

InternLM-XComposer2: Mastering Free-form Text-Image Composition and Comprehension in Vision-Language Large Model Xiaoyi Dong*, Pan Zhang*, Yuhang Zang*, Yuhang Cao, Bin Wang, Linke Ouyang, Xilin Wei, Songyang Zhang, Haodong Duan, Maosong Cao, Wenwei Zhang, Yining Li, Hang Yan, Yang Gao, Xinyue Zhang, Wei Li, Jingwen Li, Kai Chen, Conghui He, Xingcheng Zhang, Yu Qiao, Dahua Lin, Jiaqi Wang arXiv, 2024 Star

Overcoming the Pitfalls of Vision-Language Model Finetuning for OOD Generalization Yuhang Zang, Hanlin Goh, Josh Susskind, Chen Huang International Conference on Learning Representations (ICLR), 2024

Alpha-CLIP: A CLIP Model Focusing on Wherever You Want Zeyi Sun, Ye Fang, Tong Wu, Pan Zhang, Yuhang Zang, Shu Kong, Yuanjun Xiong, Dahua Lin, Jiaqi Wang IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2024 Star

Contextual Object Detection with Multimodal Large Language Models Yuhang Zang, Wei Li, Jun Han, Kaiyang Zhou, Chen Change Loy International Journal of Computer Vision (IJCV), 2024 Star

2023

Real-World Object Detection Yuhang Zang PhD Thesis, Nanyang Technological University, 2023

Semi-Supervised and Long-Tailed Object Detection with CascadeMatch Yuhang Zang, Kaiyang Zhou, Chen Huang, Chen Change Loy International Journal of Computer Vision (IJCV), 2023

2022

Unified Vision and Language Prompt Learning Yuhang Zang, Wei Li, Kaiyang Zhou, Chen Huang, Chen Change Loy arXiv 2022 Star

Open-Vocabulary DETR with Conditional Matching Yuhang Zang, Wei Li, Kaiyang Zhou, Chen Huang, Chen Change Loy European Conference on Computer Vision (ECCV), 2022 (Oral) Star

2021

FASA: Feature Augmentation and Sampling Adaptation for Long-Tailed Instance Segmentation Yuhang Zang, Chen Huang, Chen Change Loy IEEE International Conference on Computer Vision (ICCV), 2021 Star

Seesaw Loss for Long-Tailed Instance Segmentation Jiaqi Wang, Wenwei Zhang, Yuhang Zang, Yuhang Cao, Jiangmiao Pang, Tao Gong, Kai Chen, Ziwei Liu, Chen Change Loy, Dahua Lin IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2021 Star

2020

KPNet: Towards Minimal Face Detector Guanglu Song, Yu Liu, Yuhang Zang, Xiaogang Wang, Biao Leng, Qingsheng Yuan AAAI Conference on Artificial Intelligence (AAAI), 2020

2019

Efficient and Accurate Arbitrary-Shaped Text Detection with Pixel Aggregation Network Wenhai Wang, Enze Xie, Xiaoge Song, Yuhang Zang, Wenjia Wang, Tong Lu, Gang Yu, Chunhua Shen IEEE International Conference on Computer Vision (ICCV), 2019 Star

Scene Text Detection with Supervised Pyramid Context Network Enze Xie*, Yuhang Zang*, Shuai Shao, Gang Yu, Cong Yao, Guangyao Li AAAI Conference on Artificial Intelligence (AAAI), 2019