English
Related papers

Related papers: TIR-Flow: Active Video Search and Reasoning with F…

200 papers

Although Long Reasoning Models (LRMs) have achieved superior performance on various reasoning scenarios, they often suffer from increased computational costs and inference latency caused by overthinking. To address these limitations, we…

Artificial Intelligence · Computer Science 2025-10-15 Yujian Zhang , Keyu Chen , Zhifeng Shen , Ruizhi Qiao , Xing Sun

Autonomous Vehicles (AVs) have entered the commercialization stage, but their limited ability to interact and express intentions still poses challenges in interactions with Human-driven Vehicles (HVs). Recent advances in large language…

Robotics · Computer Science 2025-03-04 Shiyu Fang , Jiaqi Liu , Chengkai Xu , Chen Lv , Peng Hang , Jian Sun

Understanding long-form video content presents significant challenges due to its temporal complexity and the substantial computational resources required. In this work, we propose an agent-based approach to enhance both the efficiency and…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Sullam Jeoung , Goeric Huybrechts , Bhavana Ganesh , Aram Galstyan , Sravan Bodapati

Long-video understanding~(LVU) is a challenging problem in computer vision. Existing methods either downsample frames for single-pass reasoning, sacrificing fine-grained details, or depend on textual reasoning over task-agnostic…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Huaying Yuan , Zheng Liu , Junjie Zhou , Hongjin Qian , Yan Shu , Nicu Sebe , Ji-Rong Wen , Zhicheng Dou

Large language models (LLMs) have increasingly leveraged tool invocation to enhance their reasoning capabilities. However, existing approaches typically tightly couple tool invocation with immediate execution. Such immediate tool…

Computation and Language · Computer Science 2026-05-19 Li Wang , Xiaohan Wang , Xiaodong Lu , Zipeng Zhang , Jinyang Wu , Jiajun Chai , Wei Lin , Guojun Yin

Tool-integrated reasoning (TIR) has become a key approach for improving large reasoning models (LRMs) on complex problems. Prior work has mainly studied when to invoke tools, while overlooking how tools are applied. We identify two common…

Artificial Intelligence · Computer Science 2026-01-12 Ningning Xu , Yuxuan Jiang , Shubhashis Roy Dipta , Hengyuan Zhang

Vision-Language-Action (VLA) models in autonomous driving systems have recently demonstrated transformative potential by integrating multimodal perception with decision-making capabilities. However, the interpretability and coherence of the…

Current Reinforcement Learning (RL) methodologies for Large Language Models (LLMs) often rely on simplistic, outcome-based reward signals (e.g., final answer correctness), which limits the depth of learning from each interaction. This paper…

Artificial Intelligence · Computer Science 2025-06-17 Xiangfan Wu

Accurate process supervision remains a critical challenge for long-horizon robotic manipulation. A primary bottleneck is that current video MLLMs, trained primarily under a Supervised Fine-Tuning (SFT) paradigm, function as passive…

Robotics · Computer Science 2026-03-17 Yibin Liu , Yaxing Lyu , Daqi Gao , Zhixuan Liang , Weiliang Tang , Shilong Mu , Xiaokang Yang , Yao Mu

Recent efforts in video reasoning segmentation (VRS) integrate large language models (LLMs) with perception models to localize and track objects via textual instructions, achieving barely satisfactory results in simple scenarios. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Rongkun Zheng , Lu Qi , Xi Chen , Yi Wang , Kun Wang , Yu Qiao , Hengshuang Zhao

Scaling multimodal large language models (MLLMs) to long videos is constrained by limited context windows. While retrieval-augmented generation (RAG) is a promising remedy by organizing query-relevant visual evidence into a compact context,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-17 Honghao Fu , Miao Xu , Yiwei Wang , Dailing Zhang , Jun Liu , Yujun Cai

Video understanding plays a vital role in bridging low-level visual signals with high-level cognitive reasoning, and is fundamental to applications such as autonomous driving, embodied AI, and the broader pursuit of AGI. The rapid…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Yongheng Zhang , Xu Liu , Ruihan Tao , Qiguang Chen , Hao Fei , Wanxiang Che , Libo Qin

Reinforcement Learning (RL) has proven to be an effective post-training strategy for enhancing reasoning in vision-language models (VLMs). Group Relative Policy Optimization (GRPO) is a recent prominent method that encourages models to…

Artificial Intelligence · Computer Science 2025-10-30 Jiaqi Wang , Kevin Qinghong Lin , James Cheng , Mike Zheng Shou

Active learning (AL) accelerates scientific discovery by prioritizing the most informative experiments, but traditional machine learning (ML) models used in AL suffer from cold-start limitations and domain-specific feature engineering,…

Machine Learning · Computer Science 2025-12-05 Hongchen Wang , Rafael Espinosa Castañeda , Jay R. Werber , Yao Fehlis , Edward Kim , Jason Hattrick-Simpers

Reasoning is increasingly crucial for various tasks. While chain-of-thought prompting enables large language models to leverage reasoning effectively, harnessing the reasoning capabilities of Vision-Language Models (VLMs) remains…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Guande Wu , Huan Song , Yawei Wang , Qiaojing Yan , Yijun Tian , Lin Lee Cheong , Panpan Xu

Visual agents operating in the wild must respond to queries precisely when sufficient evidence first appears in a video stream, a critical capability that is overlooked by conventional video LLMs evaluated in offline settings. The shift to…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Kecheng Zhang , Zongxin Yang , Mingfei Han , Haihong Hao , Yunzhi Zhuge , Changlin Li , Junhan Zhao , Zhihui Li , Xiaojun Chang

Recently, large language models (LLMs) have shown remarkable reasoning capabilities via large-scale reinforcement learning (RL). However, leveraging the RL algorithm to empower effective multi-tool collaborative reasoning in LLMs remains an…

Computation and Language · Computer Science 2025-05-23 Guanting Dong , Yifei Chen , Xiaoxi Li , Jiajie Jin , Hongjin Qian , Yutao Zhu , Hangyu Mao , Guorui Zhou , Zhicheng Dou , Ji-Rong Wen

Video understanding is fundamental to tasks such as action recognition, video reasoning, and robotic control. Early video understanding methods based on large vision-language models (LVLMs) typically adopt a single-pass reasoning paradigm…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Yiyang Zhou , Yangfan He , Yaofeng Su , Siwei Han , Joel Jang , Gedas Bertasius , Mohit Bansal , Huaxiu Yao

Reinforcement learning (RL) has proven highly effective in eliciting the reasoning capabilities of large language models (LLMs). Inspired by this success, recent studies have explored applying similar techniques to vision-language models…

Computer Vision and Pattern Recognition · Computer Science 2025-10-20 Yan Chen , Long Li , Teng Xi , Long Zeng , Jingdong Wang

While contemporary Vision-Language Models (VLMs) excel at 2D visual understanding, they remain constrained by a passive, 2D-centric paradigm that severely limits genuine 3D spatial reasoning. To bridge this gap, we introduce Think3D, a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Zaibin Zhang , Yuhan Wu , Lianjie Jia , Yifan Wang , Zhongbo Zhang , Yijiang Li , Binghao Ran , Fuxi Zhang , Zhuohan Sun , Zhenfei Yin , Lijun Wang , Huchuan Lu