English
Related papers

Related papers: Adaptive Multi-Goal Exploration

200 papers

It is of significance for an agent to learn a widely applicable and general-purpose policy that can achieve diverse goals including images and text descriptions. Considering such perceptually-specific goals, the frontier of deep…

Machine Learning · Computer Science 2021-12-14 Jinxin Liu , Donglin Wang , Qiangxing Tian , Zhengyu Chen

We study tabular reinforcement learning problems with multiple steps of lookahead information. Before acting, the learner observes $\ell$ steps of future transition and reward realizations: the exact state the agent would reach and the…

Machine Learning · Computer Science 2026-01-16 Nadav Merlis

A central problem in the theory of multi-agent reinforcement learning (MARL) is to understand what structural conditions and algorithmic principles lead to sample-efficient learning guarantees, and how these considerations change as we move…

Machine Learning · Computer Science 2023-05-02 Dylan J. Foster , Dean P. Foster , Noah Golowich , Alexander Rakhlin

We present an adaptive step-size method, which does not include line-search techniques, for solving a wide class of nonconvex multiobjective programming problems on an unbounded constraint set. We also prove convergence of a general…

Optimization and Control · Mathematics 2024-02-12 Nguyen Anh Minh , Le Dung Muu , Tran Ngoc Thang

Meta-Reinforcement learning approaches aim to develop learning procedures that can adapt quickly to a distribution of tasks with the help of a few examples. Developing efficient exploration strategies capable of finding the most useful…

Machine Learning · Computer Science 2019-11-12 Swaminathan Gurumurthy , Sumit Kumar , Katia Sycara

We present a data-driven framework for reachability analysis of nonlinear dynamical systems that requires no explicit model. A denoising diffusion probabilistic model learns the time-evolving state distribution of a dynamical system from…

Systems and Control · Electrical Eng. & Systems 2026-04-02 Yanliang Huang , Peng Xie , Wenyuan Wu , Zhuoqi Zeng , Amr Alanwar

We consider concurrent games played on graphs. At every round of a game, each player simultaneously and independently selects a move; the moves jointly determine the transition to a successor state. Two basic objectives are the safety…

Computer Science and Game Theory · Computer Science 2012-07-03 Krishnendu Chatterjee , Luca de Alfaro , Thomas A. Henzinger

Pool-based active learning (AL) is a promising technology for increasing data-efficiency of machine learning models. However, surveys show that performance of recent AL methods is very sensitive to the choice of dataset and training…

Machine Learning · Computer Science 2023-09-12 Tim Bakker , Herke van Hoof , Max Welling

A stochastic search method, the so-called Adaptive Subspace (AdaSub) method, is proposed for variable selection in high-dimensional linear regression models. The method aims at finding the best model with respect to a certain model…

Computation · Statistics 2021-04-20 Christian Staerk , Maria Kateri , Ioannis Ntzoufras

The recently proposed Muon optimizer updates weight matrices via orthogonalized momentum and has demonstrated strong empirical success in large language model training. However, it remains unclear how to determine the learning rates for…

Machine Learning · Computer Science 2025-09-09 Minxin Zhang , Yuxuan Liu , Hayden Schaeffer

Some of the most powerful reinforcement learning frameworks use planning for action selection. Interestingly, their planning horizon is either fixed or determined arbitrarily by the state visitation history. Here, we expand beyond the naive…

Machine Learning · Computer Science 2023-01-19 Aviv Rosenberg , Assaf Hallak , Shie Mannor , Gal Chechik , Gal Dalal

We consider deep deterministic policy gradient (DDPG) in the context of reinforcement learning with sparse rewards. To enhance exploration, we introduce a search procedure, \emph{${\epsilon}{t}$-greedy}, which generates exploratory options…

Machine Learning · Computer Science 2026-02-18 Ehsan Futuhi , Shayan Karimi , Chao Gao , Martin Müller

Solving stochastic optimization problems under partial observability, where one needs to adaptively make decisions with uncertain outcomes, is a fundamental but notoriously difficult challenge. In this paper, we introduce the concept of…

Machine Learning · Computer Science 2017-12-07 Daniel Golovin , Andreas Krause

We design a self-decision goal-oriented multiple access scheme, where sensing agents observe a common event and individually decide to communicate the event's attributes as updates to the monitoring agents, to satisfy a certain goal.…

Information Theory · Computer Science 2024-06-17 Pouya Agheli , Nikolaos Pappas , Marios Kountouris

Consider an agent exploring an unknown graph in search of some goal state. As it walks around the graph, it learns the nodes and their neighbors. The agent only knows where the goal state is when it reaches it. How do we reach this goal…

Data Structures and Algorithms · Computer Science 2023-01-02 Siddhartha Banerjee , Vincent Cohen-Addad , Anupam Gupta , Zhouzi Li

Goal-conditioned hierarchical reinforcement learning (GCHRL) provides a promising approach to solving long-horizon tasks. Recently, its success has been extended to more general settings by concurrently learning hierarchical policies and…

Machine Learning · Computer Science 2022-03-08 Siyuan Li , Jin Zhang , Jianhao Wang , Yang Yu , Chongjie Zhang

One of the significant challenges to generating value-aligned behavior is to not only account for the specified user objectives but also any implicit or unspecified user requirements. The existence of such implicit requirements could be…

Artificial Intelligence · Computer Science 2025-01-30 Silvia Tulli , Stylianos Loukas Vasileiou , Mohamed Chetouani , Sarath Sreedharan

Effective exploration continues to be a significant challenge that prevents the deployment of reinforcement learning for many physical systems. This is particularly true for systems with continuous and high-dimensional state and action…

Machine Learning · Computer Science 2022-07-21 Trevor Ablett , Bryan Chan , Jonathan Kelly

Planning problems where effects of actions are non-deterministic can be modeled as Markov decision processes. Planning problems are usually goal-directed. This paper proposes several techniques for exploiting the goal-directedness to…

Artificial Intelligence · Computer Science 2013-02-08 Nevin Lianwen Zhang , Weihong Zhang

Active learning (AL) strategies aim to train high-performance models with minimal labeling efforts, only selecting the most informative instances for annotation. Current approaches to evaluating data informativeness predominantly focus on…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Zhixuan Liang , Xingyu Zeng , Rui Zhao , Ping Luo