中文
相关论文

相关论文: Video-MTR: Reinforced Multi-Turn Reasoning for Lon…

200 篇论文

Reinforcement learning (RL) has shown strong potential for enhancing reasoning in multimodal large language models, yet existing video reasoning methods often rely on coarse sequence-level rewards or single-factor token selection,…

计算机视觉与模式识别 · 计算机科学 2026-01-28 Ziyue Wang , Sheng Jin , Zhongrong Zuo , Jiawei Wu , Han Qiu , Qi She , Hao Zhang , Xudong Jiang

Understanding real-world videos with complex semantics and long temporal dependencies remains a fundamental challenge in computer vision. Recent progress in multimodal large language models (MLLMs) has demonstrated strong capabilities in…

计算机视觉与模式识别 · 计算机科学 2025-06-03 Hongyu Li , Songhao Han , Yue Liao , Junfeng Luo , Jialin Gao , Shuicheng Yan , Si Liu

Video understanding represents the most challenging frontier in computer vision, requiring models to reason about complex spatiotemporal relationships, long-term dependencies, and multimodal evidence. The recent emergence of Video-Large…

The rapid development of multimodal large-language models (MLLMs) has significantly expanded the scope of visual language reasoning, enabling unified systems to interpret and describe complex visual content. However, applying these models…

计算机视觉与模式识别 · 计算机科学 2025-12-11 Xinkui Zhao , Zuxin Wang , Yifan Zhang , Guanjie Cheng , Yueshen Xu , Shuiguang Deng , Chang Liu , Naibo Wang , Jianwei Yin

Reinforcement fine-tuning (RFT) has shown great promise in achieving humanlevel reasoning capabilities of Large Language Models (LLMs), and has recently been extended to MLLMs. Nevertheless, reasoning about videos, which is a fundamental…

计算机视觉与模式识别 · 计算机科学 2025-10-15 Qi Wang , Yanrui Yu , Ye Yuan , Rui Mao , Tianfei Zhou

While Large Vision-Language Models (LVLMs) have achieved substantial progress in video understanding, their application to long video reasoning is hindered by uniform frame sampling and static textual reasoning, which are inefficient and…

计算机视觉与模式识别 · 计算机科学 2025-10-01 Zefeng He , Xiaoye Qu , Yafu Li , Siyuan Huang , Daizong Liu , Yu Cheng

The video reasoning ability of multimodal large language models (MLLMs) is crucial for downstream tasks like video question answering and temporal grounding. While recent approaches have explored text-based chain-of-thought (CoT) reasoning…

计算机视觉与模式识别 · 计算机科学 2025-09-04 Haoji Zhang , Xin Gu , Jiawen Li , Chixiang Ma , Sule Bai , Chubin Zhang , Bowen Zhang , Zhichao Zhou , Dongliang He , Yansong Tang

Video reasoning has emerged as a critical capability for multimodal large language models (MLLMs), requiring models to move beyond static perception toward coherent understanding of temporal dynamics in complex scenes. Yet existing MLLMs…

计算机视觉与模式识别 · 计算机科学 2025-09-29 Sicheng Tao , Jungang Li , Yibo Yan , Junyan Zhang , Yubo Gao , Hanqian Li , ShuHang Xun , Yuxuan Fan , Hong Chen , Jianxiang He , Xuming Hu

Multi-modal Large language models (MLLMs) show remarkable ability in video understanding. Nevertheless, understanding long videos remains challenging as the models can only process a finite number of frames in a single inference,…

计算机视觉与模式识别 · 计算机科学 2025-03-27 Yucheng Suo , Fan Ma , Linchao Zhu , Tianyi Wang , Fengyun Rao , Yi Yang

Despite advances in reinforcement learning (RL)-based video reasoning with large language models (LLMs), data collection and fine-tuning remain significant challenges. These methods often rely on large-scale supervised fine-tuning (SFT)…

计算机视觉与模式识别 · 计算机科学 2025-10-27 Ziyang Wang , Jaehong Yoon , Shoubin Yu , Md Mohaiminul Islam , Gedas Bertasius , Mohit Bansal

Long-form video understanding is complicated by the high redundancy of video data and the abundance of query-irrelevant information. To tackle these challenges, we propose VideoTree, a training-free framework which builds a query-adaptive…

计算机视觉与模式识别 · 计算机科学 2025-03-17 Ziyang Wang , Shoubin Yu , Elias Stengel-Eskin , Jaehong Yoon , Feng Cheng , Gedas Bertasius , Mohit Bansal

Despite recent advances in Vision-Language Models (VLMs), long-video understanding remains a challenging problem. Although state-of-the-art long-context VLMs can process around 1000 input frames, they still struggle to effectively leverage…

机器学习 · 计算机科学 2025-07-04 Anurag Arnab , Ahmet Iscen , Mathilde Caron , Alireza Fathi , Cordelia Schmid

The sequential structure of videos poses a challenge to the ability of multimodal large language models (MLLMs) to locate multi-frame evidence and conduct multimodal reasoning. However, existing video benchmarks mainly focus on…

计算机视觉与模式识别 · 计算机科学 2025-06-05 Kejian Zhu , Zhuoran Jin , Hongbang Yuan , Jiachun Li , Shangqing Tu , Pengfei Cao , Yubo Chen , Kang Liu , Jun Zhao

Ultra long video understanding remains an open challenge, as existing vision language models (VLMs) falter on such content due to limited context length and inefficient long term memory retention. To address this, recent works have…

计算机视觉与模式识别 · 计算机科学 2025-12-17 Hongbo Jin , Qingyuan Wang , Wenhao Zhang , Yang Liu , Sijie Cheng

Recent advances in test-time optimization have led to remarkable reasoning capabilities in Large Language Models (LLMs), enabling them to solve highly complex problems in math and coding. However, the reasoning capabilities of multimodal…

计算机视觉与模式识别 · 计算机科学 2026-04-16 Ce Zhang , Yan-Bo Lin , Ziyang Wang , Mohit Bansal , Gedas Bertasius

Reinforcement Learning (RL) benefits Large Language Models (LLMs) for complex reasoning. Inspired by this, we explore integrating spatio-temporal specific rewards into Multimodal Large Language Models (MLLMs) to address the unique…

计算机视觉与模式识别 · 计算机科学 2025-11-12 Xinhao Li , Ziang Yan , Desen Meng , Lu Dong , Xiangyu Zeng , Yinan He , Yali Wang , Yu Qiao , Yi Wang , Limin Wang

Existing Multimodal Large Language Models (MLLMs) often suffer from hallucinations in long video understanding (LVU), primarily due to the imbalance between textual and visual tokens. Observing that MLLMs handle short visual inputs well,…

计算机视觉与模式识别 · 计算机科学 2026-04-08 Zhe Gao , Shiyu Shen , Taifeng Chai , Weinong Wang , Haotian Xu , Xing W , Wenbin Li , Qi Fan , Yang Gao , Dacheng Tao

Self-reflection mechanisms that rely on purely text-based rethinking processes perform well in most multimodal tasks. However, when directly applied to long-form video understanding scenarios, they exhibit clear limitations. The fundamental…

计算机视觉与模式识别 · 计算机科学 2026-05-15 Jiaze Li , Hao Yin , Wenhui Tan , Jingyang Chen , Boshen Xu , Yuxun Qu , Yijing Chen , Jianzhong Ju , Zhenbo Luo , Jian Luan

Existing Video Large Language Models (Video LLMs) struggle with complex video understanding, exhibiting limited reasoning capabilities and potential hallucinations. In particular, these methods tend to perform reasoning solely relying on…

计算机视觉与模式识别 · 计算机科学 2026-04-23 Qizhong Tan , Zhuotao Tian , Guangming Lu , Jun Yu , Wenjie Pei

Multimodal large language models via reinforcement learning (RL) have demonstrated remarkable capabilities in complex visual reasoning tasks, yet they remain limited in long-horizon multimodal scenarios, often suffering from visual…

计算机视觉与模式识别 · 计算机科学 2026-05-26 Chenghao Li , Fusheng Hao , Xikai Zhang , Likang Xiao , Yanwei Ren , Fuxiang Wu , Quan Chen , Liu Liu
‹ 上一页 1 2 3 10 下一页 ›