English
Related papers

Related papers: Rate optimal learning of equilibria from data

200 papers

Many reinforcement learning algorithms, particularly those that rely on return estimates for policy improvement, can suffer from poor sample efficiency and training instability due to high-variance return estimates. In this paper we…

Machine Learning · Computer Science 2026-01-06 Alexander W. Goodall , Edwin Hamel-De le Court , Francesco Belardinelli

In this paper, we present a novel algorithm named synchronous integral Q-learning, which is based on synchronous policy iteration, to solve the continuous-time infinite horizon optimal control problems of input-affine system dynamics. The…

Systems and Control · Electrical Eng. & Systems 2021-05-20 Lei Guo , Han Zhao

Model-based reinforcement learning is an effective approach for controlling an unknown system. It is based on a longstanding pipeline familiar to the control community in which one performs experiments on the environment to collect a…

Systems and Control · Electrical Eng. & Systems 2024-08-14 Bruce D. Lee , Ingvar Ziemann , George J. Pappas , Nikolai Matni

We study transfer learning for matrix completion in a Missing Not-at-Random (MNAR) setting that is motivated by biological problems. The target matrix $Q$ has entire rows and columns missing, making estimation impossible without side…

Machine Learning · Computer Science 2025-03-04 Akhil Jalan , Yassir Jedra , Arya Mazumdar , Soumendu Sundar Mukherjee , Purnamrita Sarkar

Offline Imitation Learning (IL) with imperfect demonstrations has garnered increasing attention owing to the scarcity of expert data in many real-world domains. A fundamental problem in this scenario is how to extract positive behaviors…

Machine Learning · Computer Science 2024-05-31 Sheng Yue , Jiani Liu , Xingyuan Hua , Ju Ren , Sen Lin , Junshan Zhang , Yaoxue Zhang

We study best-policy identification for finite-horizon risk-sensitive reinforcement learning under the entropic risk measure. Recent work established a constant gap in the exponential horizon dependence between lower and upper bounds on the…

Machine Learning · Computer Science 2026-05-14 Amer Essakine , Claire Vernade

In tabular multi-agent reinforcement learning with average-cost criterion, a team of agents sequentially interacts with the environment and observes local incentives. We focus on the case that the global reward is a sum of local rewards,…

Optimization and Control · Mathematics 2021-10-26 Alec Koppel , Amrit Singh Bedi , Bhargav Ganguly , Vaneet Aggarwal

The iterative selection of examples for labeling in active machine learning is conceptually similar to feedback channel coding in information theory: in both tasks, the objective is to seek a minimal sequence of actions to encode…

Machine Learning · Statistics 2021-03-02 Gregory Canal , Matthieu Bloch , Christopher Rozell

Reinforcement learning (RL) algorithms still suffer from high sample complexity despite outstanding recent successes. The need for intensive interactions with the environment is especially observed in many widely popular policy gradient…

Machine Learning · Computer Science 2020-08-04 Samuele Tosatto , Joao Carvalho , Hany Abdulsamad , Jan Peters

This paper introduces an active learning approach to the fitting of machine learning interatomic potentials. Our approach is based on the D-optimality criterion for selecting atomic configurations on which the potential is fitted. It is…

Computational Physics · Physics 2017-09-19 Evgeny V. Podryabinkin , Alexander V. Shapeev

Learning-based methods have enabled robots to acquire bio-inspired movements with increasing levels of naturalness and adaptability. Among these, Imitation Learning (IL) has proven effective in transferring complex motion patterns from…

Robotics · Computer Science 2025-09-30 Nayari Marie Lessa , Melya Boukheddimi , Frank Kirchner

We consider active learning for binary classification in the agnostic pool-based setting. The vast majority of works in active learning in the agnostic setting are inspired by the CAL algorithm where each query is uniformly sampled from the…

Machine Learning · Computer Science 2021-05-17 Julian Katz-Samuels , Jifan Zhang , Lalit Jain , Kevin Jamieson

Despite massive empirical evaluations, one of the fundamental questions in imitation learning is still not fully settled: does AIL (adversarial imitation learning) provably generalize better than BC (behavioral cloning)? We study this open…

Machine Learning · Computer Science 2022-02-14 Tian Xu , Ziniu Li , Yang Yu , Zhi-Quan Luo

Reinforcement learning (RL) is a central problem in artificial intelligence. This problem consists of defining artificial agents that can learn optimal behaviour by interacting with an environment -- where the optimal behaviour is defined…

We consider online learning with feedback graphs, a sequential decision-making framework where the learner's feedback is determined by a directed graph over the action set. We present a computationally efficient algorithm for learning in…

Machine Learning · Computer Science 2022-06-02 Chloé Rouyer , Dirk van der Hoeven , Nicolò Cesa-Bianchi , Yevgeny Seldin

We consider multi-armed bandit problems in social groups wherein each individual has bounded memory and shares the common goal of learning the best arm/option. We say an individual learns the best option if eventually (as $t\to \infty$) it…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-12-27 Lili Su , Martin Zubeldia , Nancy Lynch

In this paper, we introduce MAAD, a novel, sample-efficient on-policy algorithm for Imitation Learning from Observations. MAAD utilizes a surrogate reward signal, which can be derived from various sources such as adversarial games,…

Machine Learning · Computer Science 2025-10-01 João A. Cândido Ramos , Lionel Blondé , Naoya Takeishi , Alexandros Kalousis

Active learning allows machine learning models to be trained using fewer labels while retaining similar performance to traditional supervised learning. An active learner selects the most informative data points, requests their labels, and…

Machine Learning · Computer Science 2023-11-22 Zac Pullar-Strecker , Katharina Dost , Eibe Frank , Jörg Wicker

We consider the problem of learning the underlying graph of an unknown Ising model on p spins from a collection of i.i.d. samples generated from the model. We suggest a new estimator that is computationally efficient and requires a number…

Machine Learning · Computer Science 2017-04-17 Marc Vuffray , Sidhant Misra , Andrey Y. Lokhov , Michael Chertkov

In meta reinforcement learning (meta RL), an agent learns from a set of training tasks how to quickly solve a new task, drawn from the same task distribution. The optimal meta RL policy, a.k.a. the Bayes-optimal behavior, is well defined,…

Machine Learning · Computer Science 2024-04-01 Zohar Rimon , Aviv Tamar , Gilad Adler