English
Related papers

Related papers: Maximum Entropy Diverse Exploration: Disentangling…

200 papers

We study the cross-entropy method (CEM) for the non-convex optimization of a continuous and parameterized objective function and introduce a differentiable variant that enables us to differentiate the output of CEM with respect to the…

Machine Learning · Computer Science 2020-08-18 Brandon Amos , Denis Yarats

Researchers have integrated exploration techniques into multi-agent reinforcement learning (MARL) algorithms, drawing on their remarkable success in deep reinforcement learning. Nonetheless, exploration in MARL presents a more substantial…

Multiagent Systems · Computer Science 2023-06-13 Jian Tao , Yang Zhang , Yangkun Chen , Xiu Li

The Centralized Training with Decentralized Execution (CTDE) paradigm is widely used in cooperative multi-agent reinforcement learning. However, conventional methods based on CTDE can suffer from value underestimation and converge to…

Multiagent Systems · Computer Science 2026-05-05 Ruoning Zhang , Siying Wang , Wenyu Chen , Yang Zhou , Zhitong Zhao , Zixuan Zhang , Ruijie Zhang , Stefano V. Albrecht

Scalable and effective exploration remains a key challenge in reinforcement learning (RL). While there are methods with optimality guarantees in the setting of discrete state and action spaces, these methods cannot be applied in…

Machine Learning · Computer Science 2017-01-30 Rein Houthooft , Xi Chen , Yan Duan , John Schulman , Filip De Turck , Pieter Abbeel

We propose a novel framework for multi-task reinforcement learning (MTRL). Using a variational inference formulation, we learn policies that generalize across both changing dynamics and goals. The resulting policies are parametrized by…

Machine Learning · Computer Science 2019-06-24 Janith C. Petangoda , Sergio Pascual-Diaz , Vincent Adam , Peter Vrancx , Jordi Grau-Moya

Exploration algorithms for reinforcement learning typically replace or augment the reward function with an additional ``intrinsic'' reward that trains the agent to seek previously unseen states of the environment. Here, we consider an…

Machine Learning · Computer Science 2025-09-30 Kevin McKee , Eric Alt , Andrew Grebenisan , Mick van Gelderen , Gary Miguel

Model-based deep reinforcement learning has achieved success in various domains that require high sample efficiencies, such as Go and robotics. However, there are some remaining issues, such as planning efficient explorations to learn more…

Machine Learning · Computer Science 2021-07-06 Yao Yao , Li Xiao , Zhicheng An , Wanpeng Zhang , Dijun Luo

Many environments contain numerous available niches of variable value, each associated with a different local optimum in the space of behaviors (policy space). In such situations it is often difficult to design a learning process capable of…

Artificial Intelligence · Computer Science 2023-02-06 Peter Sunehag , Alexander Sasha Vezhnevets , Edgar Duéñez-Guzmán , Igor Mordach , Joel Z. Leibo

Large-scale multimodal contrastive learning has recently achieved impressive success in learning rich and transferable representations, yet it remains fundamentally limited by the uniform treatment of feature dimensions and the neglect of…

Machine Learning · Computer Science 2026-02-11 Jinjin Guo , Yexin Li , Zhichao Huang , Jun Fang , Zhiyuan Liu , Chao Liu , Pengzhang Liu , Qixia Jiang

Reinforcement learning agents need a reward signal to learn successful policies. When this signal is sparse or the corresponding gradient is deceptive, such agents need a dedicated mechanism to efficiently explore their search space without…

Artificial Intelligence · Computer Science 2021-04-13 Alexandre Chenu , Nicolas Perrin-Gilbert , Stéphane Doncieux , Olivier Sigaud

Most reinforcement learning algorithms seek a single optimal strategy that solves a given task. However, it can often be valuable to learn a diverse set of solutions, for instance, to make an agent's interaction with users more engaging, or…

Machine Learning · Computer Science 2024-01-09 Wentse Chen , Shiyu Huang , Yuan Chiang , Tim Pearce , Wei-Wei Tu , Ting Chen , Jun Zhu

Exploration is critical for good results in deep reinforcement learning and has attracted much attention. However, existing multi-agent deep reinforcement learning algorithms still use mostly noise-based techniques. Very recently,…

Artificial Intelligence · Computer Science 2021-07-27 Iou-Jen Liu , Unnat Jain , Raymond A. Yeh , Alexander G. Schwing

Effective exploration is a key challenge in reinforcement learning for large language models: discovering high-quality trajectories within a limited sampling budget from the vast natural language sequence space. Existing methods face…

Machine Learning · Computer Science 2026-02-17 Yiran Guo , Zhongjian Qiao , Yingqi Xie , Jie Liu , Dan Ye , Ruiqing Zhang , Shuang Qiu , Lijie Xu

We study the inverse reinforcement learning (IRL) problem under a transition dynamics mismatch between the expert and the learner. Specifically, we consider the Maximum Causal Entropy (MCE) IRL learner model and provide a tight upper bound…

Machine Learning · Computer Science 2021-12-01 Luca Viano , Yu-Ting Huang , Parameswaran Kamalaruban , Adrian Weller , Volkan Cevher

Balancing policy expressiveness with the exploration-exploitation trade-off is a core challenge in online Reinforcement Learning (RL). While Stochastic Differential Equation (SDE)-based diffusion policies can represent complex, multimodal…

Machine Learning · Computer Science 2026-05-27 Ting Gao , Stavros Orfanoudakis , Nan Lin , Winnie Daamen , Serge Hoogendoorn , Elvin Isufi

We present MEM: Multi-view Exploration Maximization for tackling complex visual control tasks. To the best of our knowledge, MEM is the first approach that combines multi-view representation learning and intrinsic reward-driven exploration…

Machine Learning · Computer Science 2022-11-29 Mingqi Yuan , Xin Jin , Bo Li , Wenjun Zeng

Meta-Reinforcement learning approaches aim to develop learning procedures that can adapt quickly to a distribution of tasks with the help of a few examples. Developing efficient exploration strategies capable of finding the most useful…

Machine Learning · Computer Science 2019-11-12 Swaminathan Gurumurthy , Sumit Kumar , Katia Sycara

Differential Evolution (DE) is a renowned optimization stratagem that can easily solve nonlinear and comprehensive problems. DE is a well known and uncomplicated population based probabilistic approach for comprehensive optimization. It has…

Neural and Evolutionary Computing · Computer Science 2015-06-22 Sandeep Kumar , Vivek Kumar Sharma , Rajani Kumari

Deep reinforcement learning was instigated with the presence of trust region methods, being scalable and efficient. However, the pessimism of such algorithms, among which it forces to constrain in a trust region by all means, has been…

Machine Learning · Computer Science 2023-03-06 Jianfei Ma

Entropy Search (ES) and Predictive Entropy Search (PES) are popular and empirically successful Bayesian Optimization techniques. Both rely on a compelling information-theoretic motivation, and maximize the information gained about the…

Machine Learning · Statistics 2018-08-06 Zi Wang , Stefanie Jegelka