中文
相关论文

相关论文: Exploration from a Primal-Dual Lens: Value-Incenti…

200 篇论文

In this paper, a unified framework for exploration in reinforcement learning (RL) is proposed based on an option-critic model. The proposed framework learns to integrate a set of diverse exploration strategies so that the agent can…

机器学习 · 计算机科学 2024-09-10 Woojun Kim , Jeonghye Kim , Youngchul Sung

The multi-agent setting is intricate and unpredictable since the behaviors of multiple agents influence one another. To address this environmental uncertainty, distributional reinforcement learning algorithms that incorporate uncertainty…

机器学习 · 计算机科学 2023-03-06 Jihwan Oh , Joonkee Kim , Minchan Jeong , Se-Young Yun

Reinforcement learning (RL) and model predictive control (MPC) offer a wealth of distinct approaches for automatic decision-making under uncertainty. Given the impact both fields have had independently across numerous domains, there is…

系统与控制 · 电气工程与系统科学 2025-10-13 Nathan P. Lawrence , Philip D. Loewen , Michael G. Forbes , R. Bhushan Gopaluni , Ali Mesbah

Deep reinforcement learning (RL) has achieved remarkable success, yet its deployment in real-world scenarios is often limited by vulnerability to environmental uncertainties. Distributionally robust RL (DR-RL) algorithms have been proposed…

机器学习 · 计算机科学 2026-04-21 Mingxuan Cui , Duo Zhou , Yuxuan Han , Grani A. Hanasusanto , Qiong Wang , Huan Zhang , Zhengyuan Zhou

Recent advances in Reinforcement Learning with Verifiable Rewards (RLVR) have empowered large language models (LLMs) to tackle challenging reasoning tasks such as mathematics and programming. Despite its promise, the RLVR paradigm poses…

计算与语言 · 计算机科学 2026-02-17 Jiaming Li , Longze Chen , Ze Gong , Yukun Chen , Lu Wang , Wanwei He , Run Luo , Min Yang

In recommendation systems, diversity and novelty are essential for capturing varied user preferences and encouraging exploration, yet many systems prioritize click relevance. While reinforcement learning (RL) has been explored to improve…

机器学习 · 计算机科学 2025-07-30 Jiin Woo , Alireza Bagheri Garakani , Tianchen Zhou , Zhishen Huang , Yan Gao

While Reinforcement Learning with Verifiable Rewards (RLVR) enhances complex reasoning in LLMs, current methods struggle to balance exploration and exploitation. This leads to critical issues like inaccurate credit assignment for…

机器学习 · 计算机科学 2025-10-13 Junxi Yin , Haisen Luo , Zhenyu Li , Yihua Liu , Dan Liu , Zequn Li , Xiaohang Xu

Many real world tasks require multiple agents to work together. Multi-agent reinforcement learning (RL) methods have been proposed in recent years to solve these tasks, but current methods often fail to efficiently learn policies. We thus…

机器学习 · 计算机科学 2019-12-03 Johannes Ackermann , Volker Gabler , Takayuki Osa , Masashi Sugiyama

Reinforcement learning (RL) has achieved impressive performance in a variety of online settings in which an agent's ability to query the environment for transitions and rewards is effectively unlimited. However, in many practical…

机器学习 · 计算机科学 2021-05-06 Anurag Ajay , Aviral Kumar , Pulkit Agrawal , Sergey Levine , Ofir Nachum

Model-free deep reinforcement learning (RL) algorithms have been successfully applied to a range of challenging sequential decision making and control tasks. However, these methods typically suffer from two major challenges: high sample…

We present MEM: Multi-view Exploration Maximization for tackling complex visual control tasks. To the best of our knowledge, MEM is the first approach that combines multi-view representation learning and intrinsic reward-driven exploration…

机器学习 · 计算机科学 2022-11-29 Mingqi Yuan , Xin Jin , Bo Li , Wenjun Zeng

Interactive multimodal agents must convert raw visual observations into coherent sequences of language-conditioned actions -- a capability that current vision-language models (VLMs) still lack. Earlier reinforcement-learning (RL) efforts…

机器学习 · 计算机科学 2025-08-07 George Bredis , Stanislav Dereka , Viacheslav Sinii , Ruslan Rakhimov , Daniil Gavrilov

In this paper, we study the continuous-time multi-asset mean-variance (MV) portfolio selection using a reinforcement learning (RL) algorithm, specifically the soft actor-critic (SAC) algorithm, in the time-varying financial market. A family…

数理金融 · 定量金融 2025-05-13 Yu Li , Yuhan Wu , Shuhua Zhang

Reinforcement learning is a powerful technique for learning from trial and error, but it often requires a large number of interactions to achieve good performance. In some domains, such as sparse-reward tasks, an oracle that can provide…

人工智能 · 计算机科学 2023-09-22 Zhourui Guo , Meng Yao , Yang Yu , Qiyue Yin

Intrinsic motivation enables reinforcement learning (RL) agents to explore when rewards are very sparse, where traditional exploration heuristics such as Boltzmann or e-greedy would typically fail. However, intrinsic exploration is…

机器学习 · 计算机科学 2020-04-07 Philippe Morere , Fabio Ramos

Model-based reinforcement learning algorithms with probabilistic dynamical models are amongst the most data-efficient learning methods. This is often attributed to their ability to distinguish between epistemic and aleatoric uncertainty.…

机器学习 · 计算机科学 2020-12-02 Sebastian Curi , Felix Berkenkamp , Andreas Krause

Learning complex robot behavior through interactions with the environment necessitates principled exploration. Effective strategies should prioritize exploring regions of the state-action space that maximize rewards, with optimistic…

机器学习 · 计算机科学 2025-03-12 Jasmine Bayrooti , Carl Henrik Ek , Amanda Prorok

Primal-dual safe RL methods commonly perform iterations between the primal update of the policy and the dual update of the Lagrange Multiplier. Such a training paradigm is highly susceptible to the error in cumulative cost estimation since…

机器学习 · 计算机科学 2024-04-16 Zifan Wu , Bo Tang , Qian Lin , Chao Yu , Shangqin Mao , Qianlong Xie , Xingxing Wang , Dong Wang

Reinforcement learning algorithms are typically geared towards optimizing the expected return of an agent. However, in many practical applications, low variance in the return is desired to ensure the reliability of an algorithm. In this…

机器学习 · 计算机科学 2021-02-04 Arushi Jain , Gandharv Patil , Ayush Jain , Khimya Khetarpal , Doina Precup

Online reinforcement learning (RL) with sparse rewards poses a challenge partly because of the lack of feedback on states leading to the goal. Furthermore, expert offline data with reward signal is rarely available to provide this feedback…

机器学习 · 计算机科学 2025-03-25 Nitish Dashora , Dibya Ghosh , Sergey Levine