English
Related papers

Related papers: Learning to Explore in Diverse Reward Settings via…

200 papers

Deep learning has achieved remarkable success in graph-related tasks, yet this accomplishment heavily relies on large-scale high-quality annotated datasets. However, acquiring such datasets can be cost-prohibitive, leading to the practical…

Machine Learning · Computer Science 2024-03-11 Ling-Hao Chen , Yuanshuo Zhang , Taohua Huang , Liangcai Su , Zeyi Lin , Xi Xiao , Xiaobo Xia , Tongliang Liu

Exploration is widely regarded as one of the most challenging aspects of reinforcement learning (RL), with many naive approaches succumbing to exponential sample complexity. To isolate the challenges of exploration, we propose a new…

Machine Learning · Computer Science 2020-02-10 Chi Jin , Akshay Krishnamurthy , Max Simchowitz , Tiancheng Yu

To overcome the sparse reward challenge in reinforcement learning (RL) for agents based on large language models (LLMs), we propose Mutual Information Self-Evaluation (MISE), an RL paradigm that utilizes hindsight generative self-evaluation…

Computation and Language · Computer Science 2026-04-14 Jiashu Yao , Heyan Huang , Zeming Liu , Yuhang Guo

In the realm of multi-agent reinforcement learning, intrinsic motivations have emerged as a pivotal tool for exploration. While the computation of many intrinsic rewards relies on estimating variational posteriors using neural network…

Machine Learning · Computer Science 2023-08-22 Chenghao Li , Tonghan Wang , Chongjie Zhang , Qianchuan Zhao

In continuous control, exploration is often performed through undirected strategies in which parameters of the networks or selected actions are perturbed by random noise. Although the deep setting of undirected exploration has been shown to…

Machine Learning · Computer Science 2022-10-04 Baturay Saglam , Suleyman S. Kozat

This work proposes a unified control architecture that couples a Reinforcement Learning (RL)-driven controller with a disturbance-rejection Extended State Observer (ESO), complemented by an Event-Triggered Mechanism (ETM) to limit…

Optimization and Control · Mathematics 2026-01-01 Ningwei Bai , Chi Pui Chan , Qichen Yin , Tengyang Gong , Yunda Yan , Zezhi Tang

A default assumption in the design of reinforcement-learning algorithms is that a decision-making agent always explores to learn optimal behavior. In sufficiently complex environments that approach the vastness and scale of the real world,…

Machine Learning · Computer Science 2024-07-23 Dilip Arumugam , Saurabh Kumar , Ramki Gummadi , Benjamin Van Roy

In multi-goal reinforcement learning (RL) settings, the reward for each goal is sparse, and located in a small neighborhood of the goal. In large dimension, the probability of reaching a reward vanishes and the agent receives little…

Machine Learning · Computer Science 2021-06-17 Léonard Blier , Yann Ollivier

Dealing with environments with sparse rewards has always been crucial for systems developed to operate in autonomous open-ended learning settings. Intrinsic Motivations could be an effective way to help Deep Reinforcement Learning…

Machine Learning · Computer Science 2025-04-07 Gianluca Maselli , Vieri Giuliano Santucci

Meta-Reinforcement learning approaches aim to develop learning procedures that can adapt quickly to a distribution of tasks with the help of a few examples. Developing efficient exploration strategies capable of finding the most useful…

Machine Learning · Computer Science 2019-11-12 Swaminathan Gurumurthy , Sumit Kumar , Katia Sycara

In the Multi-Armed Bandit (MAB) problem, there is a given set of arms with unknown reward models. At each time, a player selects one arm to play, aiming to maximize the total expected reward over a horizon of length T. An approach based on…

Optimization and Control · Mathematics 2013-03-12 Sattar Vakili , Keqin Liu , Qing Zhao

Detecting anomalies in multivariate time series is essential for monitoring complex industrial systems, where high dimensionality, limited labeled data, and subtle dependencies between sensors cause significant challenges. This paper…

Machine Learning · Computer Science 2025-11-18 Bahareh Golchin , Banafsheh Rekabdar

Efficient exploration remains a challenging problem in reinforcement learning, especially for those tasks where rewards from environments are sparse. A commonly used approach for exploring such environments is to introduce some "intrinsic"…

Machine Learning · Computer Science 2020-07-16 Neale Ratzlaff , Qinxun Bai , Li Fuxin , Wei Xu

The most data-efficient algorithms for reinforcement learning in robotics are model-based policy search algorithms, which alternate between learning a dynamical model of the robot and optimizing a policy to maximize the expected return…

Machine Learning · Computer Science 2020-03-05 Rituraj Kaushik , Konstantinos Chatzilygeroudis , Jean-Baptiste Mouret

Many task-oriented dialogue systems use deep reinforcement learning (DRL) to learn policies that respond to the user appropriately and complete the tasks successfully. Training DRL agents with diverse dialogue trajectories prepare them well…

Computation and Language · Computer Science 2021-06-10 Zhiwen Tang , Hrishikesh Kulkarni , Grace Hui Yang

The Exploration-Exploitation tradeoff arises in Reinforcement Learning when one cannot tell if a policy is optimal. Then, there is a constant need to explore new actions instead of exploiting past experience. In practice, it is common to…

Machine Learning · Computer Science 2019-09-10 Lior Shani , Yonathan Efroni , Shie Mannor

We propose Deep Q-Networks (DQN) with model-based exploration, an algorithm combining both model-free and model-based approaches that explores better and learns environments with sparse rewards more efficiently. DQN is a general-purpose,…

Machine Learning · Computer Science 2019-03-25 Stephen Zhen Gou , Yuyang Liu

Reinforcement learning (RL) agents often face challenges in balancing exploration and exploitation, particularly in environments where sparse or dense rewards bias learning. Biological systems, such as human toddlers, naturally navigate…

Machine Learning · Computer Science 2025-01-30 Junseok Park , Hyeonseo Yang , Min Whoo Lee , Won-Seok Choi , Minsu Lee , Byoung-Tak Zhang

Large language model (LLM) agents that follow the sequential "reason-then-act" paradigm have achieved superior performance in many complex tasks.However, these methods suffer from limited exploration and incomplete environmental…

Computation and Language · Computer Science 2026-04-28 Junshuo Zhang , Chengrui Huang , Feng Guo , Zihan Li , Ke Shi , Menghua Jiang , Jiguo Yu , Shuo Shang , Shen Gao

Conveying complex objectives to reinforcement learning (RL) agents often requires meticulous reward engineering. Preference-based RL methods are able to learn a more flexible reward model based on human preferences by actively incorporating…

Machine Learning · Computer Science 2022-05-26 Xinran Liang , Katherine Shu , Kimin Lee , Pieter Abbeel