中文
相关论文

相关论文: VideoRFT: Incentivizing Video Reasoning Capability…

200 篇论文

Visual reasoning abilities play a crucial role in understanding complex multimodal data, advancing both domain-specific applications and artificial general intelligence (AGI). Existing methods enhance Vision-Language Models (VLMs) through…

计算机视觉与模式识别 · 计算机科学 2025-10-07 Huajie Tan , Yuheng Ji , Xiaoshuai Hao , Xiansheng Chen , Pengwei Wang , Zhongyuan Wang , Shanghang Zhang

Reinforcement fine-tuning (RFT), a two-stage framework consisting of supervised fine-tuning (SFT) and reinforcement learning (RL) has shown promising results on improving reasoning ability of large language models (LLMs). Yet extending RFT…

计算机视觉与模式识别 · 计算机科学 2026-04-21 Yifan Jiang , Yueying Wang , Rui Zhao , Toufiq Parag , Zhimin Chen , Zhenyu Liao , Jayakrishnan Unnikrishnan

Understanding real-world videos with complex semantics and long temporal dependencies remains a fundamental challenge in computer vision. Recent progress in multimodal large language models (MLLMs) has demonstrated strong capabilities in…

计算机视觉与模式识别 · 计算机科学 2025-06-03 Hongyu Li , Songhao Han , Yue Liao , Junfeng Luo , Jialin Gao , Shuicheng Yan , Si Liu

Reinforcement Learning (RL) benefits Large Language Models (LLMs) for complex reasoning. Inspired by this, we explore integrating spatio-temporal specific rewards into Multimodal Large Language Models (MLLMs) to address the unique…

计算机视觉与模式识别 · 计算机科学 2025-11-12 Xinhao Li , Ziang Yan , Desen Meng , Lu Dong , Xiangyu Zeng , Yinan He , Yali Wang , Yu Qiao , Yi Wang , Limin Wang

Despite advances in reinforcement learning (RL)-based video reasoning with large language models (LLMs), data collection and fine-tuning remain significant challenges. These methods often rely on large-scale supervised fine-tuning (SFT)…

计算机视觉与模式识别 · 计算机科学 2025-10-27 Ziyang Wang , Jaehong Yoon , Shoubin Yu , Md Mohaiminul Islam , Gedas Bertasius , Mohit Bansal

Recent advances in large language models have significantly improved textual reasoning through the effective use of Chain-of-Thought (CoT) and reinforcement learning. However, extending these successes to vision-language tasks remains…

计算机视觉与模式识别 · 计算机科学 2025-05-27 Minheng Ni , Zhengyuan Yang , Linjie Li , Chung-Ching Lin , Kevin Lin , Wangmeng Zuo , Lijuan Wang

Reinforcement Learning with Verifiable Rewards ( RLVR ) has emerged as a transformative paradigm for enhancing the reasoning capabilities of Large Language Models ( LLMs), yet its potential in 3D scene understanding remains under-explored.…

计算机视觉与模式识别 · 计算机科学 2026-03-06 Xiongkun Linghu , Jiangyong Huang , Baoxiong Jia , Siyuan Huang

Reinforcement Learning Finetuning (RFT) has significantly advanced the reasoning capabilities of large language models (LLMs) by enabling long chains of thought, self-correction, and effective tool use. While recent works attempt to extend…

Vision Language Models (VLMs) are becoming increasingly integral to multimedia understanding; however, they often struggle with domain-specific video classification tasks, particularly in cases with limited data. This stems from a critical…

计算机视觉与模式识别 · 计算机科学 2025-11-21 Meilong Xu , Di Fu , Jiaxing Zhang , Gong Yu , Jiayu Zheng , Xiaoling Hu , Dongdi Zhao , Feiyang Li , Chao Chen , Yong Cao

While state-of-the-art vision-language models (VLMs) have demonstrated remarkable capabilities in complex visual-text tasks, their success heavily relies on massive model scaling, limiting their practical deployment. Small-scale VLMs offer…

计算机视觉与模式识别 · 计算机科学 2025-03-11 Huilin Deng , Ding Zou , Rui Ma , Hongchen Luo , Yang Cao , Yu Kang

Reinforcement Fine-Tuning (RFT) in Large Reasoning Models like OpenAI o1 learns from feedback on its answers, which is especially useful in applications when fine-tuning data is scarce. Recent open-source work like DeepSeek-R1 demonstrates…

计算机视觉与模式识别 · 计算机科学 2025-03-04 Ziyu Liu , Zeyi Sun , Yuhang Zang , Xiaoyi Dong , Yuhang Cao , Haodong Duan , Dahua Lin , Jiaqi Wang

Recent studies have demonstrated the effectiveness of Large Language Models (LLMs) as reasoning modules that can deconstruct complex tasks into more manageable sub-tasks, particularly when applied to visual reasoning tasks for images. In…

计算机视觉与模式识别 · 计算机科学 2025-03-11 Ahmad Mahmood , Ashmal Vayani , Muzammal Naseer , Salman Khan , Fahad Shahbaz Khan

Reinforcement Fine-Tuning (RFT) is proved to be greatly valuable for enhancing the reasoning ability of LLMs. Researchers have been starting to apply RFT to MLLMs, hoping it will also enhance the capabilities of visual understanding.…

计算机视觉与模式识别 · 计算机科学 2025-09-23 Xiaxu Chen , Wei Li , Chunxu Liu , Chi Xie , Xiaoyan Hu , Chengqian Ma , Feng Zhu , Rui Zhao

One way to enhance the reasoning capability of Large Language Models (LLMs) is to conduct Supervised Fine-Tuning (SFT) using Chain-of-Thought (CoT) annotations. This approach does not show sufficiently strong generalization ability,…

计算与语言 · 计算机科学 2024-12-16 Trung Quoc Luong , Xinbo Zhang , Zhanming Jie , Peng Sun , Xiaoran Jin , Hang Li

While recent advances in Reinforcement Fine-Tuning (RFT) have shown that rule-based reward schemes can enable effective post-training for large language models, their extension to cross-modal, vision-centric domains remains largely…

计算机视觉与模式识别 · 计算机科学 2026-03-05 Guangjing Yang , ZhangYuan Yu , Ziyuan Qin , Xinyuan Song , Huahui Yi , Qingbo Kang , Jun Gao , Yiyue Li , Chenlin Du , Qicheng Lao

Recent advancements in Chain of Thought (COT) generation have significantly improved the reasoning capabilities of Large Language Models (LLMs), with reinforcement learning (RL) emerging as an effective post-training approach. Multimodal…

计算机视觉与模式识别 · 计算机科学 2025-04-01 Yi Chen , Yuying Ge , Rui Wang , Yixiao Ge , Lu Qiu , Ying Shan , Xihui Liu

Reasoning capability plays a significantly critical role in the the broad applications of Large Language Models (LLMs). To enhance the reasoning performance of LLMs, diverse Reinforcement Learning (RL)-based fine-tuning approaches have been…

计算与语言 · 计算机科学 2025-09-09 Wenqiao Zhu , Ji Liu , Rongjuncheng Zhang , Haipang Wu , Yulun Zhang

Recent advances in vision-language models (VLMs) reasoning have been largely attributed to the rise of reinforcement Learning (RL), which has shifted the community's focus away from the supervised fine-tuning (SFT) paradigm. Many studies…

While Reinforcement Learning with Verifiable Rewards has enhanced the reasoning of large-scale language models (LLMs), its efficacy for lightweight multimodal language models (MLLMs) with fewer than seven billion parameters remains…

计算机视觉与模式识别 · 计算机科学 2025-10-10 Linyu Ou , YuYang Yin

Vision-Language Models (VLMs) struggle with complex image annotation tasks, such as emotion classification and context-driven object detection, which demand sophisticated reasoning. Standard Supervised Fine-Tuning (SFT) focuses solely on…

机器学习 · 计算机科学 2025-09-16 Suhang Hu , Wei Hu , Yuhang Su , Fan Zhang
‹ 上一页 1 2 3 10 下一页 ›