中文
相关论文

相关论文: Are Video Reasoning Models Ready to Go Outside?

200 篇论文

Extracting a Bird's Eye View (BEV) representation from multiple camera images offers a cost-effective, scalable alternative to LIDAR-based solutions in autonomous driving. However, the performance of the existing BEV methods drops…

计算机视觉与模式识别 · 计算机科学 2024-09-17 Merve Rabia Barın , Görkay Aydemir , Fatma Güney

Existing Video Anomaly Detection (VAD) methods typically rely on task-specific training, leading to strong domain dependency and high training costs. Moreover, most existing methods output only scalar anomaly scores, providing limited…

计算机视觉与模式识别 · 计算机科学 2026-05-25 Hyeongmuk Lim , Youngbum Hur

Reinforcement learning with verifiable rewards (RLVR) has become central to post-training reasoning models, yet a key limitation of existing studies is their narrow view of the reasoning space: difficulty is treated as reasoning depth…

计算与语言 · 计算机科学 2026-05-27 Yihua Zhu , Qianying Liu , Fei Cheng , Jiaxin Wang , Akiko Aizawa , Sadao Kurohashi , Hidetoshi Shimodaira

Integrating visual-language instructions into visuomotor policies is gaining momentum in robot learning for enhancing open-world generalization. Despite promising advances, existing approaches face two challenges: limited language…

机器人学 · 计算机科学 2025-10-24 Wenhui Huang , Changhe Chen , Han Qi , Chen Lv , Yilun Du , Heng Yang

We present Skywork R1V2, a next-generation multimodal reasoning model and a major leap forward from its predecessor, Skywork R1V. At its core, R1V2 introduces a hybrid reinforcement learning paradigm that jointly leverages the Mixed…

计算机视觉与模式识别 · 计算机科学 2025-06-09 Peiyu Wang , Yichen Wei , Yi Peng , Xiaokun Wang , Weijie Qiu , Wei Shen , Tianyidan Xie , Jiangbo Pei , Jianhao Zhang , Yunzhuo Hao , Xuchen Song , Yang Liu , Yahui Zhou

Reinforcement learning (RL) has recently shown strong potential in improving the reasoning capabilities of large language models and is now being actively extended to vision-language models (VLMs). However, existing RL applications in VLMs…

机器学习 · 计算机科学 2025-04-07 Yan Ma , Steffi Chern , Xuyang Shen , Yiran Zhong , Pengfei Liu

Temporal Sentence Grounding in Videos (TSGV), which aims to ground a natural language sentence in an untrimmed video, has drawn widespread attention over the past few years. However, recent studies have found that current benchmark datasets…

计算机视觉与模式识别 · 计算机科学 2022-03-11 Xiaohan Lan , Yitian Yuan , Xin Wang , Long Chen , Zhi Wang , Lin Ma , Wenwu Zhu

Large Vision-Language Models (LVLMs) exhibit strong multimodal capabilities but remain vulnerable to hallucinations from intrinsic errors and adversarial attacks from external exploitations, limiting their reliability in real-world…

计算机视觉与模式识别 · 计算机科学 2026-05-20 Chung-En Johnny Yu , Brian Jalaian , Nathaniel D. Bastian

Audio-Visual Question Answering (AVQA) is a challenging multimodal reasoning task requiring intelligent systems to answer natural language queries based on paired audio-video inputs accurately. However, existing AVQA approaches often suffer…

多媒体 · 计算机科学 2025-04-03 Jie Ma , Zhitao Gao , Qi Chai , Jun Liu , Pinghui Wang , Jing Tao , Zhou Su

Temporal Awareness, the ability to reason dynamically based on the timestamp when a question is raised, is the key distinction between offline and online video LLMs. Unlike offline models, which rely on complete videos for static, post hoc…

计算机视觉与模式识别 · 计算机科学 2025-03-28 Yifei Li , Junbo Niu , Ziyang Miao , Chunjiang Ge , Yuanhang Zhou , Qihao He , Xiaoyi Dong , Haodong Duan , Shuangrui Ding , Rui Qian , Pan Zhang , Yuhang Zang , Yuhang Cao , Conghui He , Jiaqi Wang

Recent advances in text-only "slow-thinking" reasoning have prompted efforts to transfer this capability to vision-language models (VLMs), for training visual reasoning models (\textbf{VRMs}). owever, such transfer faces critical…

计算机视觉与模式识别 · 计算机科学 2025-09-16 Pu Jian , Junhong Wu , Wei Sun , Chen Wang , Shuo Ren , Jiajun Zhang

Vision-Language-Action (VLA) models achieve strong performance in robotic manipulation by leveraging pre-trained vision-language backbones. However, in downstream robotic settings, they are typically fine-tuned with limited data, leading to…

机器学习 · 计算机科学 2026-03-31 Chanyoung Kim , Minwoo Kim , Minseok Kang , Hyunwoo Kim , Dahuin Jung

Recent advances in Vision-Language Models (VLMs) and large language models (LLMs) have greatly enhanced visual reasoning, a key capability for embodied AI agents like robots. However, existing visual reasoning benchmarks often suffer from…

计算机视觉与模式识别 · 计算机科学 2025-08-21 Simindokht Jahangard , Mehrzad Mohammadi , Yi Shen , Zhixi Cai , Hamid Rezatofighi

Reward models play an essential role in training vision-language models (VLMs) by assessing output quality to enable aligning with human preferences. Despite their importance, the research community lacks comprehensive open benchmarks for…

计算机视觉与模式识别 · 计算机科学 2025-02-21 Michihiro Yasunaga , Luke Zettlemoyer , Marjan Ghazvininejad

Reasoning is a fundamental capability for solving complex multi-step problems, particularly in visual contexts where sequential step-wise understanding is essential. Existing approaches lack a comprehensive framework for evaluating visual…

Vision-Language Models (VLMs) face significant challenges when dealing with the diverse resolutions and aspect ratios of real-world images, as most existing models rely on fixed, low-resolution inputs. While recent studies have explored…

计算机视觉与模式识别 · 计算机科学 2025-06-17 Junbo Niu , Yuanhong Zheng , Ziyang Miao , Hejun Dong , Chunjiang Ge , Hao Liang , Ma Lu , Bohan Zeng , Qiahao Zheng , Conghui He , Wentao Zhang

Current Vision-Language Model (VLM)-based end-to-end autonomous driving systems often leverage large language models to generate driving decisions directly based on their understanding of the current scene. However, such systems introduce…

人工智能 · 计算机科学 2025-12-02 Dacheng Liao , Mengshi Qi , Peng Shu , Zhining Zhang , Yuxin Lin , Liang Liu , Huadong Ma

Causal autoregressive video diffusion models support real-time streaming generation by extrapolating future chunks from previously generated content. Distilling such generators from high-fidelity bidirectional teachers yields competitive…

计算机视觉与模式识别 · 计算机科学 2026-05-15 Yanzuo Lu , Ronglai Zuo , Jiankang Deng

Vision-Language-Action (VLA) models have gained much attention from the research community thanks to their strength in translating multimodal observations with linguistic instructions into desired robotic actions. Despite their…

机器人学 · 计算机科学 2026-04-21 Tuan Van Vo , Tan Q. Nguyen , Khang Nguyen , Nhat Xuan Tran , Duy H. M. Nguyen , An T. Le , Ngo Anh Vien , Minh Nhat Vu

The main issue with most evaluation schemes today is their "static" nature: the same problems are reused repeatedly, allowing for memorization, format exploitation, and eventual saturation. To measure genuine AI progress, we need evaluation…

人工智能 · 计算机科学 2026-02-17 Zerui Cheng , Jiashuo Liu , Chunjie Wu , Jianzhu Yao , Pramod Viswanath , Ge Zhang , Wenhao Huang