中文
相关论文

相关论文: Distributional Reinforcement Learning for Efficien…

200 篇论文

Reward models are central to both reinforcement learning (RL) with language models and inference-time verification. However, existing reward models often lack temporal consistency, leading to ineffective policy updates and unstable RL…

机器学习 · 计算机科学 2025-09-30 Dan Zhang , Min Cai , Jonathan Light , Ziniu Hu , Yisong Yue , Jie Tang

Although Deep Reinforcement Learning (DRL) has been popular in many disciplines including robotics, state-of-the-art DRL algorithms still struggle to learn long-horizon, multi-step and sparse reward tasks, such as stacking several blocks…

机器人学 · 计算机科学 2023-03-10 Xintong Yang , Ze Ji , Jing Wu , Yu-kun Lai

Bias problems in the estimation of $Q$-values are a well-known obstacle that slows down convergence of $Q$-learning and actor-critic methods. One of the reasons of the success of modern RL algorithms is partially a direct or indirect…

机器学习 · 计算机科学 2025-06-26 Leif Döring , Benedikt Wille , Maximilian Birr , Mihail Bîrsan , Martin Slowik

In 2015, Google's DeepMind announced an advancement in creating an autonomous agent based on deep reinforcement learning (DRL) that could beat a professional player in a series of 49 Atari games. However, the current manifestation of DRL is…

机器学习 · 计算机科学 2019-07-30 Ngoc Duy Nguyen , Saeid Nahavandi , Thanh Nguyen

Deep reinforcement learning (DRL) agents excel in solving complex decision-making tasks across various domains. However, they often require a substantial number of training steps and a vast experience replay buffer, leading to significant…

机器学习 · 计算机科学 2025-10-20 Tal Fiskus , Uri Shaham

In reinforcement learning (RL), the consideration of multivariate reward signals has led to fundamental advancements in multi-objective decision-making, transfer learning, and representation learning. This work introduces the first…

机器学习 · 计算机科学 2024-09-05 Harley Wiltzer , Jesse Farebrother , Arthur Gretton , Mark Rowland

We introduce Random Reward Perturbation (RRP), a novel exploration strategy for reinforcement learning (RL). Our theoretical analyses demonstrate that adding zero-mean noise to environmental rewards effectively enhances policy diversity…

机器学习 · 计算机科学 2025-06-11 Haozhe Ma , Guoji Fu , Zhengding Luo , Jiele Wu , Tze-Yun Leong

Reinforcement learning with sparse rewards is still an open challenge. Classic methods rely on getting feedback via extrinsic rewards to train the agent, and in situations where this occurs very rarely the agent learns slowly or cannot…

机器学习 · 计算机科学 2022-03-04 Simone Parisi , Davide Tateo , Maximilian Hensel , Carlo D'Eramo , Jan Peters , Joni Pajarinen

To mitigate the limitation that the classical reinforcement learning (RL) framework heavily relies on identical training and test environments, Distributionally Robust RL (DRRL) has been proposed to enhance performance across a range of…

机器学习 · 统计学 2024-09-24 Zhipeng Liang , Xiaoteng Ma , Jose Blanchet , Jiheng Zhang , Zhengyuan Zhou

Frontier models have demonstrated exceptional capabilities following the integration of task-reward-based reinforcement learning (RL) into their training pipelines, enabling systems to evolve from pure reasoning models into sophisticated…

机器学习 · 计算机科学 2026-04-20 Sarthak Mittal , Leo Gagnon , Guillaume Lajoie

The rapid growth of heterogeneous and massive wireless connectivity in 6G networks demands intelligent solutions to ensure scalability, reliability, privacy, ultra-low latency, and effective control. Although artificial intelligence (AI)…

机器学习 · 计算机科学 2025-04-08 Eslam Eldeeb , Hirley Alves

Discovering causal structure among a set of variables is a fundamental problem in many empirical sciences. Traditional score-based casual discovery methods rely on various local heuristics to search for a Directed Acyclic Graph (DAG)…

机器学习 · 计算机科学 2020-06-09 Shengyu Zhu , Ignavier Ng , Zhitang Chen

Reinforcement learning algorithms typically assume rewards to be sampled from light-tailed distributions, such as Gaussian or bounded. However, a wide variety of real-world systems generate rewards that follow heavy-tailed distributions. We…

机器学习 · 计算机科学 2021-02-26 Vincent Zhuang , Yanan Sui

Reinforcement learning (RL) enables an agent to learn from trial-and-error experiences toward achieving long-term goals; automated planning aims to compute plans for accomplishing tasks using action knowledge. Despite their shared goal of…

机器人学 · 计算机科学 2021-03-17 Yohei Hayamizu , Saeid Amiri , Kishan Chandan , Keiki Takadama , Shiqi Zhang

We propose a new reinforcement learning (RL) formulation for training continuous-time score-based diffusion models for generative AI to generate samples that maximize reward functions while keeping the generated distributions close to the…

机器学习 · 计算机科学 2025-08-12 Xuefeng Gao , Jiale Zha , Xun Yu Zhou

One of the main challenges in reinforcement learning (RL) is generalisation. In typical deep RL methods this is achieved by approximating the optimal value function with a low-dimensional representation using a deep network. While this…

机器学习 · 计算机科学 2017-11-29 Harm van Seijen , Mehdi Fatemi , Joshua Romoff , Romain Laroche , Tavian Barnes , Jeffrey Tsang

A deep learning approach to reinforcement learning led to a general learner able to train on visual input to play a variety of arcade games at the human and superhuman levels. Its creators at the Google DeepMind's team called the approach:…

机器学习 · 计算机科学 2015-12-08 Ivan Sorokin , Alexey Seleznev , Mikhail Pavlov , Aleksandr Fedorov , Anastasiia Ignateva

For many reinforcement learning (RL) applications, specifying a reward is difficult. This paper considers an RL setting where the agent obtains information about the reward only by querying an expert that can, for example, evaluate…

机器学习 · 计算机科学 2022-02-01 David Lindner , Matteo Turchetta , Sebastian Tschiatschek , Kamil Ciosek , Andreas Krause

Reinforcement learning (RL) with sparse and deceptive rewards is challenging because non-zero rewards are rarely obtained. Hence, the gradient calculated by the agent can be stochastic and without valid information. Recent studies that…

机器学习 · 计算机科学 2024-02-08 Guojian Wang , Faguo Wu , Xiao Zhang , Jianxiang Liu

We investigate reinforcement learning (RL) in the presence of distributional mismatch between training and deployment, where policies trained in simulators often underperform in practice due to mismatches between training and deployment…

机器学习 · 计算机科学 2025-11-12 Debamita Ghosh , George K. Atia , Yue Wang