English
Related papers

Related papers: On the Suitability of Reinforcement Fine-Tuning to…

200 papers

Recent advances in vision-language models (VLMs) reasoning have been largely attributed to the rise of reinforcement Learning (RL), which has shifted the community's focus away from the supervised fine-tuning (SFT) paradigm. Many studies…

This paper investigates the role of explicit thinking process in rule-based reinforcement fine-tuning (RFT) for MLLMs. We first propose CLS-RL for MLLM image classification, using verifiable rewards for fine-tuning. Experiments show CLS-RL…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Ming Li , Jike Zhong , Shitian Zhao , Yuxiang Lai , Haoquan Zhang , Wang Bill Zhu , Kaipeng Zhang

Visual reasoning abilities play a crucial role in understanding complex multimodal data, advancing both domain-specific applications and artificial general intelligence (AGI). Existing methods enhance Vision-Language Models (VLMs) through…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Huajie Tan , Yuheng Ji , Xiaoshuai Hao , Xiansheng Chen , Pengwei Wang , Zhongyuan Wang , Shanghang Zhang

Reinforcement fine-tuning (RFT) has shown great promise in achieving humanlevel reasoning capabilities of Large Language Models (LLMs), and has recently been extended to MLLMs. Nevertheless, reasoning about videos, which is a fundamental…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Qi Wang , Yanrui Yu , Ye Yuan , Rui Mao , Tianfei Zhou

Reinforcement Fine-Tuning (RFT) in Large Reasoning Models like OpenAI o1 learns from feedback on its answers, which is especially useful in applications when fine-tuning data is scarce. Recent open-source work like DeepSeek-R1 demonstrates…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Ziyu Liu , Zeyi Sun , Yuhang Zang , Xiaoyi Dong , Yuhang Cao , Haodong Duan , Dahua Lin , Jiaqi Wang

Reinforcement Learning Finetuning (RFT) has significantly advanced the reasoning capabilities of large language models (LLMs) by enabling long chains of thought, self-correction, and effective tool use. While recent works attempt to extend…

Machine Learning · Computer Science 2026-03-06 Mingyuan Wu , Jingcheng Yang , Jize Jiang , Meitang Li , Kaizhuo Yan , Hanchao Yu , Minjia Zhang , Chengxiang Zhai , Klara Nahrstedt

Standing in 2025, at a critical juncture in the pursuit of Artificial General Intelligence (AGI), reinforcement fine-tuning (RFT) has demonstrated significant potential in enhancing the reasoning capability of large language models (LLMs)…

Computation and Language · Computer Science 2025-05-27 Haoyuan Sun , Jiaqi Wu , Bo Xia , Yifu Luo , Yifei Zhao , Kai Qin , Xufei Lv , Tiantian Zhang , Yongzhe Chang , Xueqian Wang

Post-training has demonstrated its importance in enhancing the reasoning capabilities of large language models (LLMs). The primary post-training methods can be categorized into supervised fine-tuning (SFT) and reinforcement fine-tuning…

Machine Learning · Computer Science 2025-10-21 Mingyang Liu , Gabriele Farina , Asuman Ozdaglar

While recent advances in Reinforcement Fine-Tuning (RFT) have shown that rule-based reward schemes can enable effective post-training for large language models, their extension to cross-modal, vision-centric domains remains largely…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Guangjing Yang , ZhangYuan Yu , Ziyuan Qin , Xinyuan Song , Huahui Yi , Qingbo Kang , Jun Gao , Yiyue Li , Chenlin Du , Qicheng Lao

Reinforcement Learning with Verifiable Rewards ( RLVR ) has emerged as a transformative paradigm for enhancing the reasoning capabilities of Large Language Models ( LLMs), yet its potential in 3D scene understanding remains under-explored.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Xiongkun Linghu , Jiangyong Huang , Baoxiong Jia , Siyuan Huang

Post-training algorithms such as Supervised Fine-Tuning (SFT) and Reinforcement Fine-Tuning (RFT) are widely used to adapt (multimodal) large language models to downstream tasks. While effective at task adaptation, their impact on retaining…

Computation and Language · Computer Science 2026-03-06 Zhihao Zhang , Qiaole Dong , Qi Zhang , Jun Zhao , Enyu Zhou , Zhiheng Xi , Senjie Jin , Xiaoran Fan , Yuhao Zhou , Mingqi Wu , Yanwei Fu , Tao Ji , Tao Gui , Xuanjing Huang , Kai Chen

Intelligent agents should have the ability to leverage knowledge from previously learned tasks in order to learn new ones quickly and efficiently. Meta-learning approaches have emerged as a popular solution to achieve this. However,…

Machine Learning · Computer Science 2023-02-17 Zhao Mandi , Pieter Abbeel , Stephen James

One way to enhance the reasoning capability of Large Language Models (LLMs) is to conduct Supervised Fine-Tuning (SFT) using Chain-of-Thought (CoT) annotations. This approach does not show sufficiently strong generalization ability,…

Computation and Language · Computer Science 2024-12-16 Trung Quoc Luong , Xinbo Zhang , Zhanming Jie , Peng Sun , Xiaoran Jin , Hang Li

Reinforcement fine-tuning (RFT) has shown promise for training LLM agents to perform multi-turn decision-making based on environment feedback. However, most existing evaluations remain largely in-domain: training and testing are conducted…

Understanding real-world videos with complex semantics and long temporal dependencies remains a fundamental challenge in computer vision. Recent progress in multimodal large language models (MLLMs) has demonstrated strong capabilities in…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Hongyu Li , Songhao Han , Yue Liao , Junfeng Luo , Jialin Gao , Shuicheng Yan , Si Liu

Reinforcement Learning (RL) benefits Large Language Models (LLMs) for complex reasoning. Inspired by this, we explore integrating spatio-temporal specific rewards into Multimodal Large Language Models (MLLMs) to address the unique…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Xinhao Li , Ziang Yan , Desen Meng , Lu Dong , Xiangyu Zeng , Yinan He , Yali Wang , Yu Qiao , Yi Wang , Limin Wang

Explorations in fine-tuning Vision-Language Models (VLMs), such as Low-Rank Adaptation (LoRA) from Parameter Efficient Fine-Tuning (PEFT), have made impressive progress. However, most approaches rely on explicit weight updates, overlooking…

Machine Learning · Computer Science 2025-12-30 Mingyuan Zhang , Yue Bai , Yifan Wang , Yiyang Huang , Yun Fu

Recent advances in vision-language models (VLMs) have improved Chest X-ray (CXR) interpretation in multiple aspects. However, many medical VLMs rely solely on supervised fine-tuning (SFT), which optimizes next-token prediction without…

Reinforcement Learning (RL) has played a central role in the recent surge of LLMs' math abilities by enabling self-improvement through binary verifier signals. In contrast, Supervised Learning (SL) is rarely considered for such…

Machine Learning · Computer Science 2026-03-03 Huayu Chen , Kaiwen Zheng , Qinsheng Zhang , Ganqu Cui , Lifan Yuan , Yin Cui , Haotian Ye , Tsung-Yi Lin , Ming-Yu Liu , Jun Zhu , Haoxiang Wang

Pre-trained Large Language Model (LLM) exhibits broad capabilities, yet, for specific tasks or domains their attainment of higher accuracy and more reliable reasoning generally depends on post-training through Supervised Fine-Tuning (SFT)…

Artificial Intelligence · Computer Science 2026-03-17 Haitao Jiang , Wenbo Zhang , Jiarui Yao , Hengrui Cai , Sheng Wang , Rui Song
‹ Prev 1 2 3 10 Next ›