English
Related papers

Related papers: DUEL: Adversarial Self-Play for Multimodal Reasoni…

200 papers

Large language models (LLMs) possess strong multilingual capabilities, and combining Reinforcement Learning from Human Feedback (RLHF) with translation tasks has shown great potential. However, we observe that this paradigm performs…

Computation and Language · Computer Science 2025-08-06 Tianjiao Li , Mengran Yu , Chenyu Shi , Yanjun Zhao , Xiaojing Liu , Qiang Zhang , Qi Zhang , Xuanjing Huang , Jiayin Wang

Large Language Models (LLMs) have achieved remarkable progress through Reinforcement Learning with Verifiable Rewards (RLVR), yet still rely heavily on external supervision (e.g., curated labels). Adversarial learning, particularly through…

Machine Learning · Computer Science 2026-01-19 Zhengxin Zhang , Chengyu Huang , Aochong Oliver Li , Claire Cardie

Reinforcement Learning (RL) methods have emerged as a popular choice for training an efficient and effective dialogue policy. However, these methods suffer from sparse and unstable reward signals returned by a user simulator only when a…

Artificial Intelligence · Computer Science 2020-09-18 Ziming Li , Sungjin Lee , Baolin Peng , Jinchao Li , Julia Kiseleva , Maarten de Rijke , Shahin Shayandeh , Jianfeng Gao

We propose an adversarial deep reinforcement learning (ADRL) algorithm for high-dimensional stochastic control problems. Inspired by the information relaxation duality, ADRL reformulates the control problem as a min-max optimization between…

Optimization and Control · Mathematics 2025-07-03 Nan Chen , Mengzhou Liu , Xiaoyan Wang , Nanyi Zhang

Training a deep neural network to maximize a target objective has become the standard recipe for successful machine learning over the last decade. These networks can be optimized with supervised learning, if the target objective is…

Machine Learning · Computer Science 2025-05-12 Bernhard Jaeger , Andreas Geiger

Large language models are increasingly used for complex reasoning tasks where high-quality offline data such as expert-annotated solutions and distilled reasoning traces are often available. However, in environments with sparse rewards,…

Artificial Intelligence · Computer Science 2025-08-11 Yihao Liu , Shuocheng Li , Lang Cao , Yuhang Xie , Mengyu Zhou , Haoyu Dong , Xiaojun Ma , Shi Han , Dongmei Zhang

Instruction-driven image editing with unified multimodal generative models has advanced rapidly, yet their underlying visual reasoning remains limited, leading to suboptimal performance on reasoning-centric edits. Reinforcement learning…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Hengjia Li , Liming Jiang , Qing Yan , Yizhi Song , Hao Kang , Zichuan Liu , Xin Lu , Boxi Wu , Deng Cai

Vision-language models (VLMs) have shown remarkable abilities by integrating large language models with visual inputs. However, they often fail to utilize visual evidence adequately, either depending on linguistic priors in vision-centric…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Xiaojun Guo , Runyu Zhou , Yifei Wang , Qi Zhang , Chenheng Zhang , Stefanie Jegelka , Xiaohan Wang , Jiajun Chai , Guojun Yin , Wei Lin , Yisen Wang

Reinforcement learning (RL) has emerged as a promising approach for eliciting reasoning chains before generating final answers. However, multimodal large language models (MLLMs) generate reasoning that lacks integration of visual…

Computer Vision and Pattern Recognition · Computer Science 2026-01-05 Omar Sharif , Eftekhar Hossain , Patrick Ng

Reinforcement learning (RL) provides a principled framework for improving Vision-Language Models (VLMs) on complex reasoning tasks. However, existing RL approaches often rely on human-annotated labels or task-specific heuristics to define…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Yicheng He , Chengsong Huang , Zongxia Li , Jiaxin Huang , Yonghui Yang

Inspired by the impressive reasoning capabilities demonstrated by reinforcement learning approaches like DeepSeek-R1, recent emerging research has begun exploring the use of reinforcement learning (RL) to enhance vision-language models…

Computer Vision and Pattern Recognition · Computer Science 2025-06-19 Yizhen Zhang , Yang Ding , Shuoshuo Zhang , Xinchen Zhang , Haoling Li , Zhong-zhi Li , Peijie Wang , Jie Wu , Lei Ji , Yelong Shen , Yujiu Yang , Yeyun Gong

Understanding real-world videos with complex semantics and long temporal dependencies remains a fundamental challenge in computer vision. Recent progress in multimodal large language models (MLLMs) has demonstrated strong capabilities in…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Hongyu Li , Songhao Han , Yue Liao , Junfeng Luo , Jialin Gao , Shuicheng Yan , Si Liu

Large Language Models (LLMs) demonstrate transformative potential, yet their reasoning remains inconsistent and unreliable. Reinforcement learning (RL)-based fine-tuning is a key mechanism for improvement, but its effectiveness is…

Machine Learning · Computer Science 2026-02-11 Pei-Chi Pan , Yingbin Liang , Sen Lin

Training Large Language Models (LLMs) to reason often relies on Reinforcement Learning (RL) with task-specific verifiers. However, many real-world reasoning-intensive tasks lack verifiers, despite offering abundant expert demonstrations…

Machine Learning · Computer Science 2025-12-10 Locke Cai , Ivan Provilkov

Post-training with Reinforcement Learning (RL) has substantially improved reasoning in Large Language Models (LLMs) via test-time scaling. However, extending this paradigm to Multimodal LLMs (MLLMs) through verbose rationales yields limited…

Computation and Language · Computer Science 2026-02-16 Bangzheng Li , Jianmo Ni , Chen Qu , Ian Miao , Liu Yang , Xingyu Fu , Muhao Chen , Derek Zhiyuan Cheng

Video reasoning has advanced with large multimodal models (LMMs), yet their inference is often a single pass that returns an answer without verifying whether the reasoning is evidence-aligned. We introduce Reinforce to Learn, Elect to…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Songyuan Yang , Weijiang Yu , Jilin Ma , Ziyu Liu , Guijian Tang , Wenjing Yang , Huibin Tan , Nong Xiao

Deep neural networks coupled with fast simulation and improved computation have led to recent successes in the field of reinforcement learning (RL). However, most current RL-based approaches fail to generalize since: (a) the gap between…

Machine Learning · Computer Science 2017-03-09 Lerrel Pinto , James Davidson , Rahul Sukthankar , Abhinav Gupta

While reinforcement learning with verifiable rewards (RLVR) is effective to improve the reasoning ability of large language models (LLMs), its reliance on human-annotated labels leads to the scaling up dilemma, especially for complex tasks.…

Machine Learning · Computer Science 2026-03-17 Zizhuo Zhang , Jianing Zhu , Xinmu Ge , Zihua Zhao , Zhanke Zhou , Xuan Li , Xiao Feng , Jiangchao Yao , Bo Han

We introduce SAIL-RL, a reinforcement learning (RL) post-training framework that enhances the reasoning capabilities of multimodal large language models (MLLMs) by teaching them when and how to think. Existing approaches are limited by…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Fangxun Shu , Yongjie Ye , Yue Liao , Zijian Kang , Weijie Yin , Jiacong Wang , Xiao Liang , Shuicheng Yan , Chao Feng

Reinforcement Learning (RL) has been shown to improve the capabilities of large language models (LLMs). However, applying RL to open-domain tasks faces two key challenges: (1) the inherent subjectivity of these tasks prevents the verifiable…

Machine Learning · Computer Science 2026-02-26 Weixuan Ou , Yanzhao Zheng , Shuoshuo Sun , Wei Zhang , Baohua Dong , Hangcheng Zhu , Ruohui Huang , Gang Yu , Pengwei Yan , Yifan Qiao
‹ Prev 1 2 3 10 Next ›