English
Related papers

Related papers: EditScore: Unlocking Online RL for Image Editing v…

200 papers

The application of reinforcement learning (RL) to enhance the reasoning capabilities of Multimodal Large Language Models (MLLMs) constitutes a rapidly advancing research area. While MLLMs extend Large Language Models (LLMs) to handle…

Artificial Intelligence · Computer Science 2025-05-22 Guanghao Zhou , Panjia Qiu , Cen Chen , Jie Wang , Zheming Yang , Jian Xu , Minghui Qiu

While reinforcement learning (RL) has the potential to enable robots to autonomously acquire a wide range of skills, in practice, RL usually requires manual, per-task engineering of reward functions, especially in real world settings where…

Robotics · Computer Science 2019-02-15 Tianhe Yu , Gleb Shevchuk , Dorsa Sadigh , Chelsea Finn

Recent neural theorem provers use reinforcement learning with verifiable rewards (RLVR), where proof assistants provide binary correctness signals. While verifiable rewards are cheap and scalable without reward hacking issues, they suffer…

Artificial Intelligence · Computer Science 2026-05-12 Zeynel A. Uluşan , Burak S. Akbudak , Can S. Erer , Gözde Gül Şahin

Reinforcement Learning (RL) agents require the specification of a reward signal for learning behaviours. However, introduction of corrupt or stochastic rewards can yield high variance in learning. Such corruption may be a direct result of…

Machine Learning · Computer Science 2018-11-09 Joshua Romoff , Peter Henderson , Alexandre Piché , Vincent Francois-Lavet , Joelle Pineau

While reinforcement learning with verifiable rewards (RLVR) is effective to improve the reasoning ability of large language models (LLMs), its reliance on human-annotated labels leads to the scaling up dilemma, especially for complex tasks.…

Machine Learning · Computer Science 2026-03-17 Zizhuo Zhang , Jianing Zhu , Xinmu Ge , Zihua Zhao , Zhanke Zhou , Xuan Li , Xiao Feng , Jiangchao Yao , Bo Han

Reinforcement Learning from Verifiable Rewards (RLVR) has emerged as a powerful paradigm for enhancing Large Language Models (LLMs), exemplified by the success of OpenAI's o-series. In RLVR, rewards are derived from verifiable signals-such…

Reinforcement learning (RL) with verifiable rewards (RLVR) has demonstrated the great potential of enhancing the reasoning abilities in multimodal large language models (MLLMs). However, the reliance on language-centric priors and expensive…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Jiahao Xie , Alessio Tonioni , Nathalie Rauschmayr , Federico Tombari , Bernt Schiele

Recent works have demonstrated that using reinforcement learning (RL) with multiple quality rewards can improve the quality of generated images in text-to-image (T2I) generation. However, manually adjusting reward weights poses challenges…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Seung Hyun Lee , Yinxiao Li , Junjie Ke , Innfarn Yoo , Han Zhang , Jiahui Yu , Qifei Wang , Fei Deng , Glenn Entis , Junfeng He , Gang Li , Sangpil Kim , Irfan Essa , Feng Yang

Instruction-based image editing has emerged as a prominent research area, which, benefiting from image generation foundation models, have achieved high aesthetic quality, making instruction-following capability the primary challenge.…

Computer Vision and Pattern Recognition · Computer Science 2025-12-08 Hongyu Li , Manyuan Zhang , Dian Zheng , Ziyu Guo , Yimeng Jia , Kaituo Feng , Hao Yu , Yexin Liu , Yan Feng , Peng Pei , Xunliang Cai , Linjiang Huang , Hongsheng Li , Si Liu

Reward shaping is one of the most effective methods to tackle the crucial yet challenging problem of credit assignment in Reinforcement Learning (RL). However, designing shaping functions usually requires much expert knowledge and…

Machine Learning · Computer Science 2019-01-29 Haosheng Zou , Tongzheng Ren , Dong Yan , Hang Su , Jun Zhu

Reinforcement Learning with Verifiable Rewards (RLVR) improves instruction following capabilities of large language models (LLMs), but suffers from training inefficiency due to inadequate difficulty assessment. Moreover, RLVR is prone to…

Computation and Language · Computer Science 2025-08-08 Xu Guo , Tianyi Liang , Tong Jian , Xiaogui Yang , Ling-I Wu , Chenhui Li , Zhihui Lu , Qipeng Guo , Kai Chen

Reward models have become a staple in modern NLP, serving as not only a scalable text evaluator, but also an indispensable component in many alignment recipes and inference-time algorithms. However, while recent reward models increase…

Computation and Language · Computer Science 2025-09-22 Zhaofeng Wu , Michihiro Yasunaga , Andrew Cohen , Yoon Kim , Asli Celikyilmaz , Marjan Ghazvininejad

Text-to-image diffusion models are a class of deep generative models that have demonstrated an impressive capacity for high-quality image generation. However, these models are susceptible to implicit biases that arise from web-scale…

Computer Vision and Pattern Recognition · Computer Science 2024-01-24 Yinan Zhang , Eric Tzeng , Yilun Du , Dmitry Kislyuk

Designing rewards for Reinforcement Learning (RL) is challenging because it needs to convey the desired task, be efficient to optimize, and be easy to compute. The latter is particularly problematic when applying RL to robotics, where…

Machine Learning · Computer Science 2020-05-28 Yiming Ding , Carlos Florensa , Mariano Phielipp , Pieter Abbeel

The development of autonomous agents for complex, long-horizon tasks is a central goal in AI. However, dominant training paradigms face a critical limitation: reinforcement learning (RL) methods that optimize solely for final task success…

Machine Learning · Computer Science 2025-07-31 Zijing Zhang , Ziyang Chen , Mingxiao Li , Zhaopeng Tu , Xiaolong Li

While reinforcement learning (RL) has proven highly effective for general reasoning in vision-language models, its application to tasks requiring deep understanding of information-rich images and structured output generation remains…

Artificial Intelligence · Computer Science 2026-03-17 Lei Chen , Xuanle Zhao , Zhixiong Zeng , Jing Huang , Liming Zheng , Yufeng Zhong , Lin Ma

This paper presents a novel approach to e-commerce payment fraud detection by integrating reinforcement learning (RL) with Large Language Models (LLMs). By framing transaction risk as a multi-step Markov Decision Process (MDP), RL optimizes…

Machine Learning · Computer Science 2025-09-24 Bo Qu , Zhurong Wang , Daisuke Yagi , Zhen Xu , Yang Zhao , Yinan Shan , Frank Zahradnik

Evaluation of text generation to date has primarily focused on content created sequentially, rather than improvements on a piece of text. Writing, however, is naturally an iterative and incremental process that requires expertise in…

Computation and Language · Computer Science 2022-09-28 Jane Dwivedi-Yu , Timo Schick , Zhengbao Jiang , Maria Lomeli , Patrick Lewis , Gautier Izacard , Edouard Grave , Sebastian Riedel , Fabio Petroni

Despite strong image-generation performance, diffusion models' reconstruction objectives limit alignment with human preferences. RL enables such alignment through explicit rewards. However, most studies apply RL to the full denoising…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Renye Yan , Jikang Cheng , Shikun Sun , Yi Sun , You Wu , Wei Peng , Zongwei Wang , Ling Liang , Junliang Xing , Yimao Cai

Reward models play an essential role in training vision-language models (VLMs) by assessing output quality to enable aligning with human preferences. Despite their importance, the research community lacks comprehensive open benchmarks for…

Computer Vision and Pattern Recognition · Computer Science 2025-02-21 Michihiro Yasunaga , Luke Zettlemoyer , Marjan Ghazvininejad