English
Related papers

Related papers: Are Video Reasoning Models Ready to Go Outside?

200 papers

Extracting a Bird's Eye View (BEV) representation from multiple camera images offers a cost-effective, scalable alternative to LIDAR-based solutions in autonomous driving. However, the performance of the existing BEV methods drops…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Merve Rabia Barın , Görkay Aydemir , Fatma Güney

Existing Video Anomaly Detection (VAD) methods typically rely on task-specific training, leading to strong domain dependency and high training costs. Moreover, most existing methods output only scalar anomaly scores, providing limited…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Hyeongmuk Lim , Youngbum Hur

Reinforcement learning with verifiable rewards (RLVR) has become central to post-training reasoning models, yet a key limitation of existing studies is their narrow view of the reasoning space: difficulty is treated as reasoning depth…

Computation and Language · Computer Science 2026-05-27 Yihua Zhu , Qianying Liu , Fei Cheng , Jiaxin Wang , Akiko Aizawa , Sadao Kurohashi , Hidetoshi Shimodaira

Integrating visual-language instructions into visuomotor policies is gaining momentum in robot learning for enhancing open-world generalization. Despite promising advances, existing approaches face two challenges: limited language…

Robotics · Computer Science 2025-10-24 Wenhui Huang , Changhe Chen , Han Qi , Chen Lv , Yilun Du , Heng Yang

We present Skywork R1V2, a next-generation multimodal reasoning model and a major leap forward from its predecessor, Skywork R1V. At its core, R1V2 introduces a hybrid reinforcement learning paradigm that jointly leverages the Mixed…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Peiyu Wang , Yichen Wei , Yi Peng , Xiaokun Wang , Weijie Qiu , Wei Shen , Tianyidan Xie , Jiangbo Pei , Jianhao Zhang , Yunzhuo Hao , Xuchen Song , Yang Liu , Yahui Zhou

Reinforcement learning (RL) has recently shown strong potential in improving the reasoning capabilities of large language models and is now being actively extended to vision-language models (VLMs). However, existing RL applications in VLMs…

Machine Learning · Computer Science 2025-04-07 Yan Ma , Steffi Chern , Xuyang Shen , Yiran Zhong , Pengfei Liu

Temporal Sentence Grounding in Videos (TSGV), which aims to ground a natural language sentence in an untrimmed video, has drawn widespread attention over the past few years. However, recent studies have found that current benchmark datasets…

Computer Vision and Pattern Recognition · Computer Science 2022-03-11 Xiaohan Lan , Yitian Yuan , Xin Wang , Long Chen , Zhi Wang , Lin Ma , Wenwu Zhu

Large Vision-Language Models (LVLMs) exhibit strong multimodal capabilities but remain vulnerable to hallucinations from intrinsic errors and adversarial attacks from external exploitations, limiting their reliability in real-world…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Chung-En Johnny Yu , Brian Jalaian , Nathaniel D. Bastian

Audio-Visual Question Answering (AVQA) is a challenging multimodal reasoning task requiring intelligent systems to answer natural language queries based on paired audio-video inputs accurately. However, existing AVQA approaches often suffer…

Multimedia · Computer Science 2025-04-03 Jie Ma , Zhitao Gao , Qi Chai , Jun Liu , Pinghui Wang , Jing Tao , Zhou Su

Temporal Awareness, the ability to reason dynamically based on the timestamp when a question is raised, is the key distinction between offline and online video LLMs. Unlike offline models, which rely on complete videos for static, post hoc…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Yifei Li , Junbo Niu , Ziyang Miao , Chunjiang Ge , Yuanhang Zhou , Qihao He , Xiaoyi Dong , Haodong Duan , Shuangrui Ding , Rui Qian , Pan Zhang , Yuhang Zang , Yuhang Cao , Conghui He , Jiaqi Wang

Recent advances in text-only "slow-thinking" reasoning have prompted efforts to transfer this capability to vision-language models (VLMs), for training visual reasoning models (\textbf{VRMs}). owever, such transfer faces critical…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Pu Jian , Junhong Wu , Wei Sun , Chen Wang , Shuo Ren , Jiajun Zhang

Vision-Language-Action (VLA) models achieve strong performance in robotic manipulation by leveraging pre-trained vision-language backbones. However, in downstream robotic settings, they are typically fine-tuned with limited data, leading to…

Machine Learning · Computer Science 2026-03-31 Chanyoung Kim , Minwoo Kim , Minseok Kang , Hyunwoo Kim , Dahuin Jung

Recent advances in Vision-Language Models (VLMs) and large language models (LLMs) have greatly enhanced visual reasoning, a key capability for embodied AI agents like robots. However, existing visual reasoning benchmarks often suffer from…

Computer Vision and Pattern Recognition · Computer Science 2025-08-21 Simindokht Jahangard , Mehrzad Mohammadi , Yi Shen , Zhixi Cai , Hamid Rezatofighi

Reward models play an essential role in training vision-language models (VLMs) by assessing output quality to enable aligning with human preferences. Despite their importance, the research community lacks comprehensive open benchmarks for…

Computer Vision and Pattern Recognition · Computer Science 2025-02-21 Michihiro Yasunaga , Luke Zettlemoyer , Marjan Ghazvininejad

Reasoning is a fundamental capability for solving complex multi-step problems, particularly in visual contexts where sequential step-wise understanding is essential. Existing approaches lack a comprehensive framework for evaluating visual…

Vision-Language Models (VLMs) face significant challenges when dealing with the diverse resolutions and aspect ratios of real-world images, as most existing models rely on fixed, low-resolution inputs. While recent studies have explored…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Junbo Niu , Yuanhong Zheng , Ziyang Miao , Hejun Dong , Chunjiang Ge , Hao Liang , Ma Lu , Bohan Zeng , Qiahao Zheng , Conghui He , Wentao Zhang

Current Vision-Language Model (VLM)-based end-to-end autonomous driving systems often leverage large language models to generate driving decisions directly based on their understanding of the current scene. However, such systems introduce…

Artificial Intelligence · Computer Science 2025-12-02 Dacheng Liao , Mengshi Qi , Peng Shu , Zhining Zhang , Yuxin Lin , Liang Liu , Huadong Ma

Causal autoregressive video diffusion models support real-time streaming generation by extrapolating future chunks from previously generated content. Distilling such generators from high-fidelity bidirectional teachers yields competitive…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Yanzuo Lu , Ronglai Zuo , Jiankang Deng

Vision-Language-Action (VLA) models have gained much attention from the research community thanks to their strength in translating multimodal observations with linguistic instructions into desired robotic actions. Despite their…

The main issue with most evaluation schemes today is their "static" nature: the same problems are reused repeatedly, allowing for memorization, format exploitation, and eventual saturation. To measure genuine AI progress, we need evaluation…

Artificial Intelligence · Computer Science 2026-02-17 Zerui Cheng , Jiashuo Liu , Chunjie Wu , Jianzhu Yao , Pramod Viswanath , Ge Zhang , Wenhao Huang