English
Related papers

Related papers: Robust Learning with Private Information

200 papers

The key challenge in multiagent learning is learning a best response to the behaviour of other agents, which may be non-stationary: if the other agents adapt their strategy as well, the learning target moves. Disparate streams of research…

Multiagent Systems · Computer Science 2019-03-13 Pablo Hernandez-Leal , Michael Kaisers , Tim Baarslag , Enrique Munoz de Cote

Many payment platforms hold large-scale marketing campaigns, which allocate incentives to encourage users to pay through their applications. To maximize the return on investment, incentive allocations are commonly solved in a two-stage…

Machine Learning · Computer Science 2022-01-03 Xuanying Chen , Zhining Liu , Li Yu , Sen Li , Lihong Gu , Xiaodong Zeng , Yize Tan , Jinjie Gu

Strategic learning studies how decision rules interact with agents who may strategically change their inputs/features to achieve better outcomes. In standard settings, models assume that the decision-maker's sole scope is to learn a…

Computer Science and Game Theory · Computer Science 2025-10-23 Valia Efthymiou , Ekaterina Fedorova , Chara Podimata

Machine learning assumes a pivotal role in our data-driven world. The increasing scale of models and datasets necessitates quick and reliable algorithms for model training. This dissertation investigates adaptivity in machine learning…

Machine Learning · Computer Science 2023-11-20 Slavomír Hanzely

Robust reinforcement learning aims to produce policies that have strong guarantees even in the face of environments/transition models whose parameters have strong uncertainty. Existing work uses value-based methods and the usual primitive…

Artificial Intelligence · Computer Science 2018-02-12 Daniel J. Mankowitz , Timothy A. Mann , Pierre-Luc Bacon , Doina Precup , Shie Mannor

When dealing with time series with complex non-stationarities, low retrospective regret on individual realizations is a more appropriate goal than low prospective risk in expectation. Online learning algorithms provide powerful guarantees…

Machine Learning · Statistics 2011-06-30 Cosma Rohilla Shalizi , Abigail Z. Jacobs , Kristina Lisa Klinkner , Aaron Clauset

The setting of an agent making decisions under uncertainty and under dynamic constraints is common for the fields of optimal control, reinforcement learning, and recently also for online learning. In the online learning setting, the quality…

Systems and Control · Electrical Eng. & Systems 2023-04-18 Aren Karapetyan , Anastasios Tsiamis , Efe C. Balta , Andrea Iannelli , John Lygeros

Behavioral skills or policies for autonomous agents are conventionally learned from reward functions, via reinforcement learning, or from demonstrations, via imitation learning. However, both modes of task specification have their…

A key challenge in online learning is that classical algorithms can be slow to adapt to changing environments. Recent studies have proposed "meta" algorithms that convert any online learning algorithm to one that is adaptive to changing…

Machine Learning · Statistics 2017-11-08 Kwang-Sung Jun , Francesco Orabona , Stephen Wright , Rebecca Willett

One of the main strengths of online algorithms is their ability to adapt to arbitrary data sequences. This is especially important in nonparametric settings, where performance is measured against rich classes of comparator functions that…

Machine Learning · Computer Science 2020-11-03 Ilja Kuzborskij , Nicolò Cesa-Bianchi

Reinforcement learning in complex environments may require supervision to prevent the agent from attempting dangerous actions. As a result of supervisor intervention, the executed action may differ from the action specified by the policy.…

Artificial Intelligence · Computer Science 2021-07-01 Eric D. Langlois , Tom Everitt

Online learning algorithms have been successfully used to design caching policies with sublinear regret in the total number of requests, with no statistical assumption about the request sequence. Most existing algorithms involve…

Machine Learning · Computer Science 2025-03-05 Younes Ben Mazziane , Francescomaria Faticanti , Sara Alouf , Giovanni Neglia

Imitation learning is an effective alternative approach to learn a policy when the reward function is sparse. In this paper, we consider a challenging setting where an agent and an expert use different actions from each other. We assume…

Machine Learning · Computer Science 2019-08-27 Konrad Zolna , Negar Rostamzadeh , Yoshua Bengio , Sungjin Ahn , Pedro O. Pinheiro

Designing a stabilizing controller for nonlinear systems is a challenging task, especially for high-dimensional problems with unknown dynamics. Traditional reinforcement learning algorithms applied to stabilization tasks tend to drive the…

Systems and Control · Electrical Eng. & Systems 2024-09-16 Thanin Quartz , Ruikun Zhou , Hans De Sterck , Jun Liu

Neural networks are typically trained with a single learning rate across all layers. While recent empirical evidence suggests that assigning layer-specific learning rates can accelerate training, a principled understanding of the conditions…

Machine Learning · Computer Science 2026-05-26 Sihan Zeng , Sujay Bhatt , Sumitra Ganesh

The theory of deep learning focuses almost exclusively on supervised learning, non-convex optimization using stochastic gradient descent, and overparametrized neural networks. It is common belief that the optimizer dynamics, network…

Machine Learning · Computer Science 2022-02-18 Xinyi Chen , Edgar Minasyan , Jason D. Lee , Elad Hazan

The goal of this research is to develop agents that are adaptive and predictable and timely. At first blush, these three requirements seem contradictory. For example, adaptation risks introducing undesirable side effects, thereby making…

Artificial Intelligence · Computer Science 2011-06-02 D. F. Gordon

Fine-tuning policies learned offline remains a major challenge in application domains. Monotonic performance improvement during \emph{fine-tuning} is often challenging, as agents typically experience performance degradation at the early…

Machine Learning · Computer Science 2025-05-05 Han Wang , Adam White , Martha White

Online lending, a phenomenon which is becoming mainstream due to the migration of consumer finance to the Internet and the adoption of AI based lending models, is an example of learning by doing. This paper studies optimal policies for a…

Theoretical Economics · Economics 2025-11-18 Mendelson Haim , Zhu Mingxi

We study learning in a dynamically evolving environment modeled as a Markov game between a learner and a strategic opponent that can adapt to the learner's strategies. While most existing works in Markov games focus on external regret as…

Machine Learning · Computer Science 2024-12-11 Thanh Nguyen-Tang , Raman Arora