English
Related papers

Related papers: Learning Achievement Structure for Structured Expl…

200 papers

Artificial Intelligence frameworks should allow for ever more autonomous and general systems in contrast to very narrow and restricted (human pre-defined) domain systems, in analogy to how the brain works. Self-constructive Artificial…

Neural and Evolutionary Computing · Computer Science 2025-03-24 Fernando J. Corbacho

Problems which require both long-horizon planning and continuous control capabilities pose significant challenges to existing reinforcement learning agents. In this paper we introduce a novel hierarchical reinforcement learning agent which…

Machine Learning · Computer Science 2023-07-25 Jan Achterhold , Markus Krimmel , Joerg Stueckler

We describe MELEE, a meta-learning algorithm for learning a good exploration policy in the interactive contextual bandit setting. Here, an algorithm must take actions based on contexts, and learn based only on a reward signal from the…

Machine Learning · Computer Science 2019-01-25 Amr Sharaf , Hal Daumé

Exploration bonuses in reinforcement learning guide long-horizon exploration by defining custom intrinsic objectives. Several exploration objectives like count-based bonuses, pseudo-counts, and state-entropy maximization are non-stationary…

Machine Learning · Computer Science 2024-04-24 Roger Creus Castanyer , Joshua Romoff , Glen Berseth

Contextual bandit problems are a natural fit for many information retrieval tasks, such as learning to rank, text classification, recommendation, etc. However, existing learning methods for contextual bandit problems have one of two…

Information Retrieval · Computer Science 2020-02-06 Rolf Jagerman , Ilya Markov , Maarten de Rijke

Current LLM-based agents demonstrate strong performance in episodic task execution but remain constrained by static toolsets and episodic amnesia, failing to accumulate experience across task boundaries. This paper formalizes the…

Artificial Intelligence · Computer Science 2026-05-26 Sihang Jiang , Lipeng Ma , Zhonghua Hong , Keyi Wang , Zhiyu Lu , Tengfei Wang , Shisong Chen , Jinghao Zhang , Tianjun Pan , Weijia Li , Jiaqing Liang , Yanghua Xiao

In structured output prediction tasks, labeling ground-truth training output is often expensive. However, for many tasks, even when the true output is unknown, we can evaluate predictions using a scalar reward function, which may be easily…

Machine Learning · Computer Science 2021-10-19 Amirmohammad Rooshenas , Dongxu Zhang , Gopal Sharma , Andrew McCallum

Finding an object of a specific class in an unseen environment remains an unsolved navigation problem. Hence, we propose a hierarchical learning-based method for object navigation. The top-level is capable of high-level planning, and…

Artificial Intelligence · Computer Science 2022-11-17 Matthias Hutsebaut-Buysse , Kevin Mets , Tom De Schepper , Steven Latré

Improving sample efficiency is central to Reinforcement Learning (RL), especially in environments where the rewards are sparse. Some recent approaches have proposed to specify reward functions as manually designed or learned reward…

Machine Learning · Computer Science 2024-01-26 Shuai Han , Mehdi Dastani , Shihan Wang

Learning hierarchical features in Sparse Autoencoders (SAEs) is essential for capturing the structured nature of real-world data and mitigating issues like feature absorption or splitting. Existing works attempt to identify hierarchical…

Machine Learning · Computer Science 2026-05-12 Tue M. Cao , Hoang X. Nhat , Raed Alharbi , Phi Le Nguyen , My T. Thai

We present Searn, an algorithm for integrating search and learning to solve complex structured prediction problems such as those that occur in natural language, speech, computational biology, and vision. Searn is a meta-algorithm that…

Machine Learning · Computer Science 2009-07-07 Hal Daumé , John Langford , Daniel Marcu

Exploration in multi-agent reinforcement learning is a challenging problem, especially in environments with sparse rewards. We propose a general method for efficient exploration by sharing experience amongst agents. Our proposed algorithm,…

Multiagent Systems · Computer Science 2021-05-20 Filippos Christianos , Lukas Schäfer , Stefano V. Albrecht

Dynamic Bayesian networks have been well explored in the literature as discrete-time models: however, their continuous-time extensions have seen comparatively little attention. In this paper, we propose the first constraint-based algorithm…

Artificial Intelligence · Computer Science 2021-06-04 Alessandro Bregoli , Marco Scutari , Fabio Stella

Sparse-reward reinforcement learning (RL) remains fundamentally hard: without structure, any agent needs $\Omega(|\mathcal{S}||\mathcal{A}|/p)$ samples to recover rewards. We introduce Policy-Aware Matrix Completion (PAMC) as a first…

Machine Learning · Computer Science 2025-09-10 Ibne Farabi Shihab , Sanjeda Akter , Anuj Sharma

Reinforcement learning usually uses the feedback rewards of environmental to train agents. But the rewards in the actual environment are sparse, and even some environments will not rewards. Most of the current methods are difficult to get…

Machine Learning · Computer Science 2020-01-13 Kai Jiang , XiaoLong Qin

Model-based reinforcement learning algorithms are typically more sample efficient than their model-free counterparts, especially in sparse reward problems. Unfortunately, many interesting domains are too complex to specify the complete…

Machine Learning · Computer Science 2022-03-11 Andrew Chester , Michael Dann , Fabio Zambetta , John Thangarajah

Action chunking can improve exploration and value estimation in long horizon reinforcement learning, but makes learning substantially harder since the critic must evaluate action sequences rather than single actions, greatly increasing…

Diffusion-based generative methods have shown promising potential for modeling trajectories from offline reinforcement learning (RL) datasets, and hierarchical diffusion has been introduced to mitigate variance accumulation and…

Machine Learning · Computer Science 2025-09-29 Xianghua Zeng , Hao Peng , Angsheng Li , Yicheng Pan

We address the problem of Bayesian reinforcement learning using efficient model-based online planning. We propose an optimism-free Bayes-adaptive algorithm to induce deeper and sparser exploration with a theoretical bound on its performance…

Machine Learning · Computer Science 2020-06-30 Divya Grover , Debabrota Basu , Christos Dimitrakakis

In recent years Landmark Complexes have been successfully employed for localization-free and metric-free autonomous exploration using a group of sensing-limited and communication-limited robots in a GPS-denied environment. To ensure rapid…

Robotics · Computer Science 2022-09-27 Xiatao Sun , Yuwei Wu , Subhrajit Bhattacharya , Vijay Kumar