中文
相关论文

相关论文: Sparse Reward Exploration via Novelty Search and E…

200 篇论文

Accelerating exploration in visual reinforcement learning under sparse rewards remains challenging due to the substantial task-irrelevant variations. Despite advances in intrinsic exploration, many methods either assume access to…

人工智能 · 计算机科学 2026-02-24 Dayang Liang , Ruihan Liu , Lipeng Wan , Yunlong Liu , Bo An

Both computational and experimental material discovery bring forth the challenge of exploring multidimensional and multimodal parameter spaces, such as phase diagrams of Hamiltonians with multiple interactions, composition spaces of…

机器学习 · 计算机科学 2024-09-20 Arpan Biswas , Rama Vasudevan , Rohit Pant , Ichiro Takeuchi , Hiroshi Funakubo , Yongtao Liu

Dealing with sparse rewards is a long-standing challenge in reinforcement learning (RL). Hindsight Experience Replay (HER) addresses this problem by reusing failed trajectories for one goal as successful trajectories for another. This…

机器学习 · 计算机科学 2022-07-05 Liam Schramm , Yunfu Deng , Edgar Granados , Abdeslam Boularias

Exploration in environments with continuous control and sparse rewards remains a key challenge in reinforcement learning (RL). Recently, surprise has been used as an intrinsic reward that encourages systematic and efficient exploration. We…

机器学习 · 计算机科学 2019-11-01 Haitao Xu , Brendan McCane , Lech Szymanski

Training neural network models with discrete (categorical or structured) latent variables can be computationally challenging, due to the need for marginalization over large or combinatorial sets. To circumvent this issue, one typically…

机器学习 · 计算机科学 2020-12-29 Gonçalo M. Correia , Vlad Niculae , Wilker Aziz , André F. T. Martins

Exploration is critical for deep reinforcement learning in complex environments with high-dimensional observations and sparse rewards. To address this problem, recent approaches proposed to leverage intrinsic rewards to improve exploration,…

机器学习 · 计算机科学 2022-11-11 Mingqi Yuan , Bo Li , Xin Jin , Wenjun Zeng

Conveying complex objectives to reinforcement learning (RL) agents often requires meticulous reward engineering. Preference-based RL methods are able to learn a more flexible reward model based on human preferences by actively incorporating…

机器学习 · 计算机科学 2022-05-26 Xinran Liang , Katherine Shu , Kimin Lee , Pieter Abbeel

This paper focuses on detection tasks in information extraction, where positive instances are sparsely distributed and models are usually evaluated using F-measure on positive classes. These characteristics often result in deficient…

计算与语言 · 计算机科学 2018-05-29 Hongyu Lin , Yaojie Lu , Xianpei Han , Le Sun

We consider the problem of learning from sparse and underspecified rewards, where an agent receives a complex input, such as a natural language instruction, and needs to generate a complex response, such as an action sequence, while only…

机器学习 · 计算机科学 2020-06-23 Rishabh Agarwal , Chen Liang , Dale Schuurmans , Mohammad Norouzi

Greedy Pursuits are very popular in Compressed Sensing for sparse signal recovery. Though many of the Greedy Pursuits possess elegant theoretical guarantees for performance, it is well known that their performance depends on the statistical…

应用统计 · 统计学 2012-06-20 Sooraj K. Ambat , Saikat Chatterjee , K. V. S. Hari

Learning dynamical systems is a promising avenue for scientific discoveries. However, capturing the governing dynamics in multiple environments still remains a challenge: model-based approaches rely on the fidelity of assumptions made for a…

机器学习 · 计算机科学 2023-03-09 MoonJeong Park , Youngbin Choi , Namhoon Lee , Dongwoo Kim

Reinforcement learning usually uses the feedback rewards of environmental to train agents. But the rewards in the actual environment are sparse, and even some environments will not rewards. Most of the current methods are difficult to get…

机器学习 · 计算机科学 2020-01-13 Kai Jiang , XiaoLong Qin

Evolution strategies (ES) are a family of black-box optimization algorithms able to train deep neural networks roughly as well as Q-learning and policy gradient methods on challenging deep reinforcement learning (RL) problems, but are much…

人工智能 · 计算机科学 2018-10-31 Edoardo Conti , Vashisht Madhavan , Felipe Petroski Such , Joel Lehman , Kenneth O. Stanley , Jeff Clune

Efficient exploration remains one of the longstanding problems of deep reinforcement learning. Instead of depending solely on extrinsic rewards from the environments, existing methods use intrinsic rewards to enhance exploration. However,…

机器学习 · 计算机科学 2024-12-09 SuMin Oh , WanSoo Kim , HyunJin Kim

Exploration in high-dimensional, continuous spaces with sparse rewards is an open problem in reinforcement learning. Artificial curiosity algorithms address this by creating rewards that lead to exploration. Given a reinforcement learning…

机器学习 · 计算机科学 2023-11-08 Alexander Nedergaard , Matthew Cook

In recent years Landmark Complexes have been successfully employed for localization-free and metric-free autonomous exploration using a group of sensing-limited and communication-limited robots in a GPS-denied environment. To ensure rapid…

机器人学 · 计算机科学 2022-09-27 Xiatao Sun , Yuwei Wu , Subhrajit Bhattacharya , Vijay Kumar

Sparsifying neural networks often suffers from seemingly inevitable performance degradation, and it remains challenging to restore the original performance despite much recent progress. Motivated by recent studies in robust optimization, we…

机器学习 · 计算机科学 2025-06-17 Dongyeop Lee , Kwanhee Lee , Jinseok Chung , Namhoon Lee

Recently, greedy algorithm has received much attention as a cost-effective means to reconstruct the sparse signals from compressed measurements. Much of previous work has focused on the investigation of a single candidate to identify the…

信息论 · 计算机科学 2014-09-22 Jaeseok Lee , Suhyuk Kwon , Jun Won Choi , Byonghyo Shim

Intrinsic rewards have been increasingly used to mitigate the sparse reward problem in single-agent reinforcement learning. These intrinsic rewards encourage the agent to look for novel experiences, guiding the agent to explore the…

人工智能 · 计算机科学 2022-11-01 Roben Delos Reyes , Kyunghwan Son , Jinhwan Jung , Wan Ju Kang , Yung Yi

In this work, we deal with the problem of computing a comprehensive front of efficient solutions in multi-objective portfolio optimization problems in presence of sparsity constraints. We start the discussion pointing out some weaknesses of…

最优化与控制 · 数学 2025-09-23 Arturo Annunziata , Matteo Lapucci , Pieluigi Mansueto , Davide Pucci