English
Related papers

Related papers: Generative Adversarial Post-Training Mitigates Rew…

200 papers

This study explores the application of evolutionary generative algorithms in music production to preserve and enhance human creativity. By integrating human feedback into Differential Evolution algorithms, we produced six songs that were…

Neural and Evolutionary Computing · Computer Science 2024-06-11 Justin Kilb , Caroline Ellis

In this paper we propose an adversarial generative grammar model for future prediction. The objective is to learn a model that explicitly captures temporal dependencies, providing a capability to forecast multiple, distinct future…

Computer Vision and Pattern Recognition · Computer Science 2020-08-17 AJ Piergiovanni , Anelia Angelova , Alexander Toshev , Michael S. Ryoo

Deep reinforcement learning (RL) policies are known to be vulnerable to adversarial perturbations to their observations, similar to adversarial examples for classifiers. However, an attacker is not usually able to directly modify another…

Machine Learning · Computer Science 2021-01-19 Adam Gleave , Michael Dennis , Cody Wild , Neel Kant , Sergey Levine , Stuart Russell

In this article, we introduce a game-theoretic learning framework for the multi-agent wireless network. By combining learning in artificial intelligence (AI) with game theory, several promising properties emerge such as obtaining high…

Computer Science and Game Theory · Computer Science 2019-04-18 Ximing Wang , Jinlong Wang , Jin Chen , Yijun Yang , Lijun Kong , Xin Liu , Luliang Jia , Yuhua Xu

In multi-vehicle cooperative driving tasks involving high-frequency continuous control, traditional state-based reward functions suffer from the issue of vanishing reward differences. This phenomenon results in a low signal-to-noise ratio…

Artificial Intelligence · Computer Science 2025-11-24 Ye Han , Lijun Zhang , Dejian Meng , Zhuang Zhang

Reinforcement Learning (RL) has demonstrated significant potential in certain real-world industrial applications, yet its broader deployment remains limited by inherent challenges such as sample inefficiency and unstable learning dynamics.…

Machine Learning · Computer Science 2025-07-03 Tom Maus , Asma Atamna , Tobias Glasmachers

Reinforcement learning from human feedback (RLHF) has become a powerful post-training paradigm for aligning large language models with human preferences. A core challenge in RLHF is constructing accurate reward signals, where the…

Machine Learning · Computer Science 2025-05-23 Ilgee Hong , Changlong Yu , Liang Qiu , Weixiang Yan , Zhenghao Xu , Haoming Jiang , Qingru Zhang , Qin Lu , Xin Liu , Chao Zhang , Tuo Zhao

Recently, generative AI and reinforcement learning (RL) have been redefining what is possible for AI agents that take information flows as input and produce intelligent behavior. As a result, we are seeing similar advancements in embodied…

Robotics · Computer Science 2025-12-04 Angelo Moroncelli , Vishal Soni , Marco Forgione , Dario Piga , Blerina Spahiu , Loris Roveda

An AI system for professional floor plan design must precisely control room dimensions and areas while respecting the desired connectivity between rooms and maintaining functional and aesthetic quality. Existing generative approaches focus…

Computation and Language · Computer Science 2026-05-15 Luis Lara , Aristides Milios , Zhi Hao Luo , Aditya Sharma , Ge Ya Luo , Christopher Beckham , Florian Golemo , Christopher Pal

We show that when large language models learn to reward hack on production RL environments, this can result in egregious emergent misalignment. We start with a pretrained model, impart knowledge of reward hacking strategies via synthetic…

Retrieval-Augmented Generation (RAG) enhances large language models (LLMs) by retrieving relevant documents from external sources to improve factual accuracy and verifiability. However, this reliance introduces new attack surfaces within…

Computer Vision and Pattern Recognition · Computer Science 2025-09-19 Saket S. Chaturvedi , Gaurav Bagwe , Lan Zhang , Xiaoyong Yuan

Large Language Models (LLMs) exhibit impressive capabilities but require careful alignment with human preferences. Traditional training-time methods finetune LLMs using human preference datasets but incur significant training costs and…

Computation and Language · Computer Science 2025-07-16 Yuancheng Xu , Udari Madhushani Sehwag , Alec Koppel , Sicheng Zhu , Bang An , Furong Huang , Sumitra Ganesh

As conversational search engines increasingly adopt generation-based paradigms powered by Large Language Models (LLMs) and Retrieval-Augmented Generation (RAG), the integration of advertisements into generated responses presents both…

Computation and Language · Computer Science 2025-07-02 To Eun Kim , João Coelho , Gbemileke Onilude , Jai Singh

Attention-based sequential recommendation methods have shown promise in accurately capturing users' evolving interests from their past interactions. Recent research has also explored the integration of reinforcement learning (RL) into these…

Machine Learning · Computer Science 2024-04-19 Melissa Mozifian , Tristan Sylvain , Dave Evans , Lili Meng

Conventional Generative Adversarial Networks (GANs) for text generation tend to have issues of reward sparsity and mode collapse that affect the quality and diversity of generated samples. To address the issues, we propose a novel…

Computation and Language · Computer Science 2020-02-13 Wangchunshu Zhou , Tao Ge , Ke Xu , Furu Wei , Ming Zhou

We consider the problem of imitation learning from a finite set of expert trajectories, without access to reinforcement signals. The classical approach of extracting the expert's reward function via inverse reinforcement learning, followed…

Machine Learning · Computer Science 2019-06-10 Ruohan Wang , Carlo Ciliberto , Pierluigi Amadori , Yiannis Demiris

In the same way that generative models today conduct most of their training in a self-supervised fashion, how can agentic models conduct their training in a self-supervised fashion, interactively exploring, learning, and preparing to…

Machine Learning · Computer Science 2025-10-21 Kathryn Wantlin , Chongyi Zheng , Benjamin Eysenbach

Reinforcement learning is well suited for optimizing policies of recommender systems. Current solutions mostly focus on model-free approaches, which require frequent interactions with the real environment, and thus are expensive in model…

Machine Learning · Computer Science 2020-01-22 Xueying Bai , Jian Guan , Hongning Wang

In cooperative multi-agent reinforcement learning (MARL), how to design a suitable reward signal to accelerate learning and stabilize convergence is a critical problem. The global reward signal assigns the same global reward to all agents…

Artificial Intelligence · Computer Science 2020-03-10 Hangyu Mao , Zhibo Gong , Zhen Xiao

Reinforcement learning for code generation relies on verifiable rewards from unit test pass rates. Yet high-quality test suites are scarce, existing datasets offer limited coverage, and static rewards fail to adapt as models improve. Recent…

Computation and Language · Computer Science 2026-03-17 Aozhe Wang , Yuchen Yan , Nan Zhou , Zhengxi Lu , Weiming Lu , Jun Xiao , Yueting Zhuang , Yongliang Shen