English
Related papers

Related papers: Mirror Descent and the Information Ratio

200 papers

Distributed optimization often requires finding the minimum of a global objective function written as a sum of local functions. A group of agents work collectively to minimize the global function. We study a continuous-time decentralized…

Optimization and Control · Mathematics 2020-11-25 Youbang Sun , Shahin Shahrampour

We consider a robust aggregation problem in the presence of both truthful and adversarial experts. The truthful experts will report their private signals truthfully, while the adversarial experts can report arbitrarily. We assume experts…

Machine Learning · Computer Science 2025-02-07 Yongkang Guo , Yuqing Kong

We consider the infinitely many-armed bandit problem with rotting rewards, where the mean reward of an arm decreases at each pull of the arm according to an arbitrary trend with maximum rotting rate $\varrho=o(1)$. We show that this…

Machine Learning · Computer Science 2023-12-19 Jung-hun Kim , Milan Vojnovic , Se-Young Yun

We study how to make decisions that minimize Bayesian regret in offline linear bandits. Prior work suggests that one must take actions with maximum lower confidence bound (LCB) on their reward. We argue that the reliance on LCB is…

Machine Learning · Computer Science 2024-07-04 Marek Petrik , Guy Tennenholtz , Mohammad Ghavamzadeh

Decision-making from offline datasets typically warm-starts a policy or score model from fixed offline data and then refines it with limited online interaction. Offline data reduces uncertainty, but it does not remove the need for…

Machine Learning · Computer Science 2026-05-29 Keru Chen

We develop a model selection approach to tackle reinforcement learning with adversarial corruption in both transition and reward. For finite-horizon tabular MDPs, without prior knowledge on the total amount of corruption, our algorithm…

Machine Learning · Computer Science 2024-12-31 Chen-Yu Wei , Christoph Dann , Julian Zimmert

We investigate the regret-minimisation problem in a multi-armed bandit setting with arbitrary corruptions. Similar to the classical setup, the agent receives rewards generated independently from the distribution of the arm chosen at each…

Machine Learning · Statistics 2023-09-29 Shubhada Agrawal , Timothée Mathieu , Debabrota Basu , Odalric-Ambrym Maillard

The bandit problem with graph feedback, proposed in [Mannor and Shamir, NeurIPS 2011], is modeled by a directed graph $G=(V,E)$ where $V$ is the collection of bandit arms, and once an arm is triggered, all its incident arms are observed. A…

Machine Learning · Computer Science 2021-11-02 Houshuang Chen , Zengfeng Huang , Shuai Li , Chihao Zhang

First-order optimization methods tend to inherently favor certain solutions over others when minimizing an underdetermined training objective that has multiple global optima. This phenomenon, known as implicit bias, plays a critical role in…

Machine Learning · Computer Science 2024-04-09 Guanghui Wang , Zihao Hu , Claudio Gentile , Vidya Muthukumar , Jacob Abernethy

Unconscious bias has been shown to influence how we assess our peers, with consequences for hiring, promotions and admissions. In this work, we focus on affinity bias, the component of unconscious bias which leads us to prefer people who…

Machine Learning · Statistics 2025-03-10 Matthew Faw , Constantine Caramanis , Jessica Hoffmann

Bayesian bandit algorithms with approximate Bayesian inference have been widely used in real-world applications. Despite the superior practical performance, their theoretical justification is less investigated in the literature, especially…

Machine Learning · Statistics 2025-05-23 Ziyi Huang , Henry Lam , Haofeng Zhang

This paper initiates the study of data-dependent regret bounds in constrained MAB settings. These bounds depend on the sequence of losses that characterize the problem instance. Thus, they can be much smaller than classical…

Machine Learning · Computer Science 2025-06-24 Gianmarco Genalti , Francesco Emanuele Stradi , Matteo Castiglioni , Alberto Marchesi , Nicola Gatti

Sequential change-point detection when the distribution parameters are unknown is a fundamental problem in statistics and machine learning. When the post-change parameters are unknown, we consider a set of detection procedures based on…

Statistics Theory · Mathematics 2017-12-06 Yang Cao , Liyan Xie , Yao Xie , Huan Xu

This letter investigates the convergence and concentration properties of the Stochastic Mirror Descent (SMD) algorithm utilizing biased stochastic subgradients. We establish the almost sure convergence of the algorithm's iterates under the…

Optimization and Control · Mathematics 2024-07-09 Anik Kumar Paul , Arun D Mahindrakar , Rachel K Kalaimani

This paper is in the field of stochastic Multi-Armed Bandits (MABs), i.e. those sequential selection techniques able to learn online using only the feedback given by the chosen option (a.k.a. $arm$). We study a particular case of the rested…

Machine Learning · Statistics 2024-11-28 Marco Fiandri , Alberto Maria Metelli , Francesco Trov`o

We study the distribution of regret in stochastic multi-armed bandits and episodic reinforcement learning through a unified framework. We formalize a distributional regret bound as a probabilistic guarantee that holds uniformly over all…

Machine Learning · Computer Science 2026-05-08 Harin Lee , Min-hwan Oh

We study bandit learning in matching markets with two-sided reward uncertainty, extending prior research primarily focused on single-sided uncertainty. Leveraging the concept of `super-stability' from Irving (1994), we demonstrate the…

Machine Learning · Computer Science 2025-06-23 Soumya Basu

Learning and computation of equilibria are central problems in game theory, theory of computation, and artificial intelligence. In this work, we introduce proximal regret, a new notion of regret based on proximal operators that lies…

Computer Science and Game Theory · Computer Science 2025-11-06 Yang Cai , Constantinos Daskalakis , Haipeng Luo , Chen-Yu Wei , Weiqiang Zheng

We investigate bandit convex optimization (BCO) with delayed feedback, where only the loss value of the action is revealed under an arbitrary delay. Let $n,T,\bar{d}$ denote the dimensionality, time horizon, and average delay, respectively.…

Machine Learning · Computer Science 2024-06-25 Yuanyu Wan , Chang Yao , Mingli Song , Lijun Zhang

On-line linear optimization on combinatorial action sets (d-dimensional actions) with bandit feedback, is known to have complexity in the order of the dimension of the problem. The exponential weighted strategy achieves the best known…

Machine Learning · Computer Science 2015-10-01 Shaona Ghosh , Adam Prugel-Bennett