English
Related papers

Related papers: GEP-PG: Decoupling Exploration and Exploitation in…

200 papers

One of the bottlenecks preventing Deep Reinforcement Learning algorithms (DRL) from real-world applications is how to explore the environment and collect informative transitions efficiently. The present paper describes bounded exploration,…

Machine Learning · Computer Science 2024-12-10 Ting Qiao , Henry Williams , David Valencia , Bruce MacDonald

Today's high-stakes adversarial interactions feature attackers who constantly breach the ever-improving security measures. Deception mitigates the defender's loss by misleading the attacker to make suboptimal decisions. In order to formally…

Artificial Intelligence · Computer Science 2020-06-11 Zheyuan Ryan Shi , Ariel D. Procaccia , Kevin S. Chan , Sridhar Venkatesan , Noam Ben-Asher , Nandi O. Leslie , Charles Kamhoua , Fei Fang

The objective of a reinforcement learning agent is to discover better actions through exploration. However, typical exploration techniques aim to maximize rewards, often incurring high costs in both exploration and learning processes. We…

Machine Learning · Computer Science 2024-12-24 Akane Tsuboya , Yu Kono , Tatsuji Takahashi

Reinforcement Learning (RL) algorithms have led to recent successes in solving complex games, such as Atari or Starcraft, and to a huge impact in real-world applications, such as cybersecurity or autonomous driving. In the side of the…

Machine Learning · Computer Science 2021-02-15 Rubén Majadas , Javier García , Fernando Fernández

Efficient exploration remains a challenging problem in reinforcement learning, especially for those tasks where rewards from environments are sparse. A commonly used approach for exploring such environments is to introduce some "intrinsic"…

Machine Learning · Computer Science 2020-07-16 Neale Ratzlaff , Qinxun Bai , Li Fuxin , Wei Xu

One of the remaining challenges in reinforcement learning is to develop agents that can generalise to novel scenarios they might encounter once deployed. This challenge is often framed in a multi-task setting where agents train on a fixed…

Machine Learning · Computer Science 2024-09-19 Max Weltevrede , Felix Kaubek , Matthijs T. J. Spaan , Wendelin Böhmer

Standard reinforcement learning (RL) agents never intelligently explore like a human (i.e. taking into account complex domain priors and adapting quickly based on previous exploration). Across episodes, RL agents struggle to perform even…

Machine Learning · Computer Science 2024-11-06 Ben Norman , Jeff Clune

Deep learning has achieved tremendous success by training increasingly large models, which are then compressed for practical deployment. We propose a drastically different approach to compact and optimal deep learning: We decouple the…

Computer Vision and Pattern Recognition · Computer Science 2022-10-28 Jiayun Wang , Yubei Chen , Stella X. Yu , Brian Cheung , Yann LeCun

Balancing exploration and exploitation remains a key challenge in reinforcement learning (RL). State-of-the-art RL algorithms suffer from high sample complexity, particularly in the sparse reward case, where they can do no better than to…

Machine Learning · Computer Science 2020-01-22 Philippe Morere , Gilad Francis , Tom Blau , Fabio Ramos

In this paper, a new population-guided parallel learning scheme is proposed to enhance the performance of off-policy reinforcement learning (RL). In the proposed scheme, multiple identical learners with their own value-functions and…

Machine Learning · Computer Science 2020-01-10 Whiyoung Jung , Giseung Park , Youngchul Sung

Reinforcement learning from human feedback (RLHF) shows promise for aligning diffusion and flow models, yet policy optimization methods such as GRPO suffer from inefficient and static sampling strategies. These methods treat all prompts and…

Machine Learning · Computer Science 2026-02-09 Yuming Li , Qingyu Li , Chengyu Bai , Xiangyang Luo , Zeyue Xue , Wenyu Qin , Meng Wang , Yikai Wang , Shanghang Zhang

In recent years, deep Reinforcement Learning (RL) has been successful in various combinatorial search domains, such as two-player games and scientific discovery. However, directly applying deep RL in planning domains is still challenging.…

Artificial Intelligence · Computer Science 2022-09-21 Dieqiao Feng , Carla P. Gomes , Bart Selman

Off-Policy reinforcement learning (RL) is an important class of methods for many problem domains, such as robotics, where the cost of collecting data is high and on-policy methods are consequently intractable. Standard methods for applying…

Artificial Intelligence · Computer Science 2019-07-03 Riley Simmons-Edler , Ben Eisner , Eric Mitchell , Sebastian Seung , Daniel Lee

This paper introduces two novel modifications to the Dynamic sAmpling Policy Optimization (DAPO) algorithm [1], approached from a mixed-policy perspective. Standard policy gradient methods can suffer from instability and sample…

Machine Learning · Computer Science 2025-08-20 Hongze Tan , Yuchen Li

In many sequential decision-making problems, the goal is to optimize a utility function while satisfying a set of constraints on different utilities. This learning problem is formalized through Constrained Markov Decision Processes (CMDPs).…

Machine Learning · Computer Science 2020-03-05 Yonathan Efroni , Shie Mannor , Matteo Pirotta

Group Relative Policy Optimization (GRPO) has been shown to be an effective algorithm when an accurate reward model is available. However, such a highly reliable reward model is not available in many real-world tasks. In this paper, we…

Machine Learning · Computer Science 2026-01-12 Yuki Ichihara , Yuu Jinnai , Tetsuro Morimura , Mitsuki Sakamoto , Ryota Mitsuhashi , Eiji Uchibe

The federated learning (FL) framework enables multiple clients to collaboratively train machine learning models without sharing their raw data, but it remains vulnerable to privacy attacks. One promising approach is to incorporate…

Machine Learning · Computer Science 2025-04-15 Shokichi Takakura , Seng Pei Liew , Satoshi Hasegawa

Achieving efficient and scalable exploration in complex domains poses a major challenge in reinforcement learning. While Bayesian and PAC-MDP approaches to the exploration problem offer strong formal guarantees, they are often impractical…

Artificial Intelligence · Computer Science 2015-11-23 Bradly C. Stadie , Sergey Levine , Pieter Abbeel

Reinforcement learning has recently shown promise in improving retrieval-augmented generation (RAG). Despite these advances, its effectiveness in multi-hop question answering (QA) remains limited by two fundamental limitations: (i) global…

Computation and Language · Computer Science 2026-03-17 Jinchang Luo , Mingquan Cheng , Fan Wan , Ni Li , Xiaoling Xia , Shuangshuang Tian , Tingcheng Bian , Haiwei Wang , Haohuan Fu , Yan Tao

A commonly cited inefficiency of neural network training using back-propagation is the update locking problem: each layer must wait for the signal to propagate through the full network before updating. Several alternatives that can…

Machine Learning · Computer Science 2021-06-14 Eugene Belilovsky , Louis Leconte , Lucas Caccia , Michael Eickenberg , Edouard Oyallon