中文
相关论文

相关论文: Are Video Reasoning Models Ready to Go Outside?

200 篇论文

Large multimodal reasoning models have achieved rapid progress, but their advancement is constrained by two major limitations: the absence of open, large-scale, high-quality long chain-of-thought (CoT) data, and the instability of…

计算机视觉与模式识别 · 计算机科学 2025-09-26 Sicong Leng , Jing Wang , Jiaxi Li , Hao Zhang , Zhiqiang Hu , Boqiang Zhang , Yuming Jiang , Hang Zhang , Xin Li , Lidong Bing , Deli Zhao , Wei Lu , Yu Rong , Aixin Sun , Shijian Lu

Video Anomaly Understanding (VAU) is essential for applications such as smart cities, security surveillance, and disaster alert systems, yet remains challenging due to its demand for fine-grained spatio-temporal perception and robust…

计算机视觉与模式识别 · 计算机科学 2025-05-30 Liyun Zhu , Qixiang Chen , Xi Shen , Xiaodong Cun

Achieving truly adaptive embodied intelligence requires agents that learn not just by imitating static demonstrations, but by continuously improving through environmental interaction, which is akin to how humans master skills through…

机器人学 · 计算机科学 2025-12-17 Zechen Bai , Chen Gao , Mike Zheng Shou

Reinforcement Learning with Verifiable Rewards (RLVR) improves reasoning in large language models but treats all correct solutions equally, potentially reinforcing flawed traces that get correct answers by chance. We observe that better…

机器学习 · 计算机科学 2026-03-11 Tiehua Mei , Minxuan Lv , Leiyu Pan , Zhenpeng Su , Hongru Hou , Hengrui Chen , Ao Xu , Deqing Yang

Despite the recent success of large language models (LLMs) in reasoning such as DeepSeek, we for the first time identify a key dilemma in reasoning robustness and generalization: significant performance degradation on novel or incomplete…

人工智能 · 计算机科学 2025-03-07 Tong Yu , Yongcheng Jing , Xikun Zhang , Wentao Jiang , Wenjie Wu , Yingjie Wang , Wenbin Hu , Bo Du , Dacheng Tao

Video quality assessment (VQA) aims to objectively quantify perceptual quality degradation in alignment with human visual perception. Despite recent advances, existing VQA models still suffer from two critical limitations: \textit{poor…

计算机视觉与模式识别 · 计算机科学 2026-02-03 Linhan Cao , Wei Sun , Weixia Zhang , Xiangyang Zhu , Jun Jia , Kaiwei Zhang , Dandan Zhu , Guangtao Zhai , Xiongkuo Min

Visual reasoning, the capability to interpret visual input in response to implicit text query through multi-step reasoning, remains a challenge for deep learning models due to the lack of relevant benchmarks. Previous work in visual…

计算机视觉与模式识别 · 计算机科学 2025-05-20 Yiqing Shen , Chenjia Li , Chenxiao Fan , Mathias Unberath

Advances in large reasoning models have shown strong performance on complex reasoning tasks by scaling test-time compute through extended reasoning. However, recent studies observe that in vision-dependent tasks, extended textual reasoning…

计算机视觉与模式识别 · 计算机科学 2026-03-03 Soumya Suvra Ghosal , Youngeun Kim , Zhuowei Li , Ritwick Chaudhry , Linghan Xu , Hongjing Zhang , Jakub Zablocki , Yifan Xing , Qin Zhang

Visual question answering requires a system to provide an accurate natural language answer given an image and a natural language question. However, it is widely recognized that previous generic VQA methods often exhibit a tendency to…

计算机视觉与模式识别 · 计算机科学 2024-02-20 Jie Ma , Pinghui Wang , Dechen Kong , Zewei Wang , Jun Liu , Hongbin Pei , Junzhou Zhao

Chain-of-Thought (CoT) techniques have significantly enhanced reasoning in Vision-Language Models (VLMs). Extending this paradigm, Visual CoT integrates explicit visual edits, such as cropping or annotating regions of interest, into the…

机器学习 · 计算机科学 2025-09-30 Chunxue Xu , Yiwei Wang , Yujun Cai , Bryan Hooi , Songze Li

We study the process through which reasoning models trained with reinforcement learning on verifiable rewards (RLVR) can learn to solve new problems. We find that RLVR drives performance in two main ways: (1) by compressing pass@$k$ into…

机器学习 · 计算机科学 2025-06-23 Vaskar Nath , Elaine Lau , Anisha Gunjal , Manasi Sharma , Nikhil Baharte , Sean Hendryx

While recent advancements in reasoning optimization have significantly enhanced the capabilities of large language models (LLMs), existing efforts to improve reasoning have been limited to solving mathematical problems and focusing on…

计算机视觉与模式识别 · 计算机科学 2025-02-18 Guangzhi Sun , Yudong Yang , Jimin Zhuang , Changli Tang , Yixuan Li , Wei Li , Zejun MA , Chao Zhang

Recent work shows that text-only reinforcement learning with verifiable rewards (RLVR) can match or outperform image-text RLVR on multimodal medical VQA benchmarks, suggesting current evaluation protocols may fail to measure causal visual…

计算机视觉与模式识别 · 计算机科学 2026-03-05 Anas Zafar , Leema Krishna Murali , Ashish Vashist

Reinforcement Learning with Verifiable Rewards (RLVR) has proven to be a highly effective strategy for endowing Large Language Models (LLMs) with robust multi-step reasoning abilities. However, its design and optimizations remain tailored…

Recent progress in large language models and access to large-scale robotic datasets has sparked a paradigm shift in robotics models transforming them into generalists able to adapt to various tasks, scenes, and robot modalities. A large…

计算机视觉与模式识别 · 计算机科学 2025-05-21 Sombit Dey , Jan-Nico Zaech , Nikolay Nikolov , Luc Van Gool , Danda Pani Paudel

Recent advancements in reinforcement learning, particularly through Group Relative Policy Optimization (GRPO), have significantly improved multimodal large language models for complex reasoning tasks. However, two critical limitations…

计算机视觉与模式识别 · 计算机科学 2025-06-10 Jisheng Dang , Jingze Wu , Teng Wang , Xuanhui Lin , Nannan Zhu , Hongbo Chen , Wei-Shi Zheng , Meng Wang , Tat-Seng Chua

Large language models (LLMs) increasingly rely on explicit reasoning to solve coding tasks, yet evaluating the quality of this reasoning remains challenging. Existing reasoning evaluators are not designed for coding, and current benchmarks…

软件工程 · 计算机科学 2026-04-15 Yuangang Li , Justin Tian Jin Chen , Ethan Yu , David Hong , Iftekhar Ahmed

Robustness against uncertain and ambiguous inputs is a critical challenge for deep learning models. While recent advancements in large scale vision language models (VLMs, e.g. GPT4o) might suggest that increasing model and training dataset…

计算机视觉与模式识别 · 计算机科学 2025-05-20 Xi Wang , Eric Nalisnick

Despite significant progress in Visual Question Answering over the years, robustness of today's VQA models leave much to be desired. We introduce a new evaluation protocol and associated dataset (VQA-Rephrasings) and show that…

计算机视觉与模式识别 · 计算机科学 2019-02-18 Meet Shah , Xinlei Chen , Marcus Rohrbach , Devi Parikh

Multimodal reward models have advanced substantially in text and image domains, yet progress in video understanding reward modeling remains severely limited by the lack of robust evaluation benchmarks and high-quality preference data. To…

计算机视觉与模式识别 · 计算机科学 2026-05-11 Yuancheng Wei , Linli Yao , Lei Li , Haojie Zhang , Hao Zhou , Fandong Meng , Xu Sun