中文
相关论文

相关论文: Generative Adversarial Post-Training Mitigates Rew…

200 篇论文

This study explores the application of evolutionary generative algorithms in music production to preserve and enhance human creativity. By integrating human feedback into Differential Evolution algorithms, we produced six songs that were…

神经与进化计算 · 计算机科学 2024-06-11 Justin Kilb , Caroline Ellis

In this paper we propose an adversarial generative grammar model for future prediction. The objective is to learn a model that explicitly captures temporal dependencies, providing a capability to forecast multiple, distinct future…

计算机视觉与模式识别 · 计算机科学 2020-08-17 AJ Piergiovanni , Anelia Angelova , Alexander Toshev , Michael S. Ryoo

Deep reinforcement learning (RL) policies are known to be vulnerable to adversarial perturbations to their observations, similar to adversarial examples for classifiers. However, an attacker is not usually able to directly modify another…

机器学习 · 计算机科学 2021-01-19 Adam Gleave , Michael Dennis , Cody Wild , Neel Kant , Sergey Levine , Stuart Russell

In this article, we introduce a game-theoretic learning framework for the multi-agent wireless network. By combining learning in artificial intelligence (AI) with game theory, several promising properties emerge such as obtaining high…

计算机科学与博弈论 · 计算机科学 2019-04-18 Ximing Wang , Jinlong Wang , Jin Chen , Yijun Yang , Lijun Kong , Xin Liu , Luliang Jia , Yuhua Xu

In multi-vehicle cooperative driving tasks involving high-frequency continuous control, traditional state-based reward functions suffer from the issue of vanishing reward differences. This phenomenon results in a low signal-to-noise ratio…

人工智能 · 计算机科学 2025-11-24 Ye Han , Lijun Zhang , Dejian Meng , Zhuang Zhang

Reinforcement Learning (RL) has demonstrated significant potential in certain real-world industrial applications, yet its broader deployment remains limited by inherent challenges such as sample inefficiency and unstable learning dynamics.…

机器学习 · 计算机科学 2025-07-03 Tom Maus , Asma Atamna , Tobias Glasmachers

Reinforcement learning from human feedback (RLHF) has become a powerful post-training paradigm for aligning large language models with human preferences. A core challenge in RLHF is constructing accurate reward signals, where the…

机器学习 · 计算机科学 2025-05-23 Ilgee Hong , Changlong Yu , Liang Qiu , Weixiang Yan , Zhenghao Xu , Haoming Jiang , Qingru Zhang , Qin Lu , Xin Liu , Chao Zhang , Tuo Zhao

Recently, generative AI and reinforcement learning (RL) have been redefining what is possible for AI agents that take information flows as input and produce intelligent behavior. As a result, we are seeing similar advancements in embodied…

机器人学 · 计算机科学 2025-12-04 Angelo Moroncelli , Vishal Soni , Marco Forgione , Dario Piga , Blerina Spahiu , Loris Roveda

An AI system for professional floor plan design must precisely control room dimensions and areas while respecting the desired connectivity between rooms and maintaining functional and aesthetic quality. Existing generative approaches focus…

We show that when large language models learn to reward hack on production RL environments, this can result in egregious emergent misalignment. We start with a pretrained model, impart knowledge of reward hacking strategies via synthetic…

Retrieval-Augmented Generation (RAG) enhances large language models (LLMs) by retrieving relevant documents from external sources to improve factual accuracy and verifiability. However, this reliance introduces new attack surfaces within…

计算机视觉与模式识别 · 计算机科学 2025-09-19 Saket S. Chaturvedi , Gaurav Bagwe , Lan Zhang , Xiaoyong Yuan

Large Language Models (LLMs) exhibit impressive capabilities but require careful alignment with human preferences. Traditional training-time methods finetune LLMs using human preference datasets but incur significant training costs and…

计算与语言 · 计算机科学 2025-07-16 Yuancheng Xu , Udari Madhushani Sehwag , Alec Koppel , Sicheng Zhu , Bang An , Furong Huang , Sumitra Ganesh

As conversational search engines increasingly adopt generation-based paradigms powered by Large Language Models (LLMs) and Retrieval-Augmented Generation (RAG), the integration of advertisements into generated responses presents both…

计算与语言 · 计算机科学 2025-07-02 To Eun Kim , João Coelho , Gbemileke Onilude , Jai Singh

Attention-based sequential recommendation methods have shown promise in accurately capturing users' evolving interests from their past interactions. Recent research has also explored the integration of reinforcement learning (RL) into these…

机器学习 · 计算机科学 2024-04-19 Melissa Mozifian , Tristan Sylvain , Dave Evans , Lili Meng

Conventional Generative Adversarial Networks (GANs) for text generation tend to have issues of reward sparsity and mode collapse that affect the quality and diversity of generated samples. To address the issues, we propose a novel…

计算与语言 · 计算机科学 2020-02-13 Wangchunshu Zhou , Tao Ge , Ke Xu , Furu Wei , Ming Zhou

We consider the problem of imitation learning from a finite set of expert trajectories, without access to reinforcement signals. The classical approach of extracting the expert's reward function via inverse reinforcement learning, followed…

机器学习 · 计算机科学 2019-06-10 Ruohan Wang , Carlo Ciliberto , Pierluigi Amadori , Yiannis Demiris

In the same way that generative models today conduct most of their training in a self-supervised fashion, how can agentic models conduct their training in a self-supervised fashion, interactively exploring, learning, and preparing to…

机器学习 · 计算机科学 2025-10-21 Kathryn Wantlin , Chongyi Zheng , Benjamin Eysenbach

Reinforcement learning is well suited for optimizing policies of recommender systems. Current solutions mostly focus on model-free approaches, which require frequent interactions with the real environment, and thus are expensive in model…

机器学习 · 计算机科学 2020-01-22 Xueying Bai , Jian Guan , Hongning Wang

In cooperative multi-agent reinforcement learning (MARL), how to design a suitable reward signal to accelerate learning and stabilize convergence is a critical problem. The global reward signal assigns the same global reward to all agents…

人工智能 · 计算机科学 2020-03-10 Hangyu Mao , Zhibo Gong , Zhen Xiao

Reinforcement learning for code generation relies on verifiable rewards from unit test pass rates. Yet high-quality test suites are scarce, existing datasets offer limited coverage, and static rewards fail to adapt as models improve. Recent…

计算与语言 · 计算机科学 2026-03-17 Aozhe Wang , Yuchen Yan , Nan Zhou , Zhengxi Lu , Weiming Lu , Jun Xiao , Yueting Zhuang , Yongliang Shen