English
Related papers

Related papers: Learning on the Edge: Online Learning with Stochas…

200 papers

We consider multi-armed bandit problems in social groups wherein each individual has bounded memory and shares the common goal of learning the best arm/option. We say an individual learns the best option if eventually (as $t\to \infty$) it…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-12-27 Lili Su , Martin Zubeldia , Nancy Lynch

We present a novel extension of Thompson Sampling for stochastic sequential decision problems with graph feedback, even when the graph structure itself is unknown and/or changing. We provide theoretical guarantees on the Bayesian regret of…

Machine Learning · Computer Science 2017-01-17 Aristide C. Y. Tossou , Christos Dimitrakakis , Devdatt Dubhashi

Graph-based learning is a rapidly growing sub-field of machine learning with applications in social networks, citation networks, and bioinformatics. One of the most popular models is graph attention networks. They were introduced to allow a…

Machine Learning · Computer Science 2023-05-23 Kimon Fountoulakis , Amit Levi , Shenghao Yang , Aseem Baranwal , Aukosh Jagannath

Bandits with feedback graphs are powerful online learning models that interpolate between the full information and classic bandit problems, capturing many real-life applications. A recent work by Zhang et al. (2023) studies the contextual…

Machine Learning · Computer Science 2024-02-14 Mengxiao Zhang , Yuheng Zhang , Haipeng Luo , Paul Mineiro

We consider adversarial multi-armed bandit problems where the learner is allowed to observe losses of a number of arms beside the arm that it actually chose. We study the case where all non-chosen arms reveal their loss with a fixed but…

Machine Learning · Statistics 2026-04-29 Tomáš Kocák , Gergely Neu , Michal Valko

We study online learning in the random-order model, where the multiset of loss functions is chosen adversarially but revealed in a uniformly random order. By extending the batch-to-online transformation of Dong and Yoshida (2023), we show…

Machine Learning · Statistics 2026-05-11 Shinsaku Sakaue , Yuichi Yoshida

We study the sample complexity of pure exploration in an online learning problem with a feedback graph. This graph dictates the feedback available to the learner, covering scenarios between full-information, pure bandit feedback, and…

Machine Learning · Statistics 2025-03-12 Alessio Russo , Yichen Song , Aldo Pacchiano

We consider the problem of tracking the minimum of a time-varying convex optimization problem over a dynamic graph. Motivated by target tracking and parameter estimation problems in intermittently connected robotic and sensor networks, the…

Optimization and Control · Mathematics 2019-05-20 Rishabh Dixit , Amrit Singh Bedi , Ketan Rajawat

In this paper, we study the behavior of the Hedge algorithm in the online stochastic setting. We prove that anytime Hedge with decreasing learning rate, which is one of the simplest algorithm for the problem of prediction with expert…

Machine Learning · Statistics 2019-07-10 Jaouad Mourtada , Stéphane Gaïffas

We study the generalization performance of online learning algorithms trained on samples coming from a dependent source of data. We show that the generalization error of any stable online algorithm concentrates around its regret--an easily…

Machine Learning · Statistics 2012-06-08 Alekh Agarwal , John C. Duchi

This paper studies the adversarial graphical contextual bandits, a variant of adversarial multi-armed bandits that leverage two categories of the most common side information: \emph{contexts} and \emph{side observations}. In this setting, a…

Machine Learning · Computer Science 2021-02-18 Lingda Wang , Bingcong Li , Huozhi Zhou , Georgios B. Giannakis , Lav R. Varshney , Zhizhen Zhao

The cross-learning contextual bandit problem with graphical feedback has recently attracted significant attention. In this setting, there is a contextual bandit with a feedback graph over the arms, and pulling an arm reveals the loss for…

Machine Learning · Computer Science 2025-02-10 Ruiyuan Huang , Zengfeng Huang

In this work, we improve on the upper and lower bounds for the regret of online learning with strongly observable undirected feedback graphs. The best known upper bound for this problem is $\mathcal{O}\bigl(\sqrt{\alpha T\ln K}\bigr)$,…

Machine Learning · Computer Science 2023-10-31 Khaled Eldowa , Emmanuel Esposito , Tommaso Cesari , Nicolò Cesa-Bianchi

We study distributed methods for online prediction and stochastic optimization. Our approach is iterative: in each round nodes first perform local computations and then communicate in order to aggregate information and synchronize their…

Information Theory · Computer Science 2014-03-06 Konstantinos I. Tsianos , Michael G. Rabbat

This work investigates the performance of the final iterate produced by stochastic gradient descent (SGD) under temporally dependent data. We consider two complementary sources of dependence: $(i)$ martingale-type dependence in both the…

Statistics Theory · Mathematics 2026-01-06 Yinan Shen , Yichen Zhang , Wen-Xin Zhou

We extend the latent position random graph model to the line graph of a random graph, which is formed by creating a vertex for each edge in the original random graph, and connecting each pair of edges incident to a common vertex in the…

Social and Information Networks · Computer Science 2024-02-27 Zachary Lubberts , Avanti Athreya , Youngser Park , Carey E. Priebe

The bandit problem with graph feedback, proposed in [Mannor and Shamir, NeurIPS 2011], is modeled by a directed graph $G=(V,E)$ where $V$ is the collection of bandit arms, and once an arm is triggered, all its incident arms are observed. A…

Machine Learning · Computer Science 2021-11-02 Houshuang Chen , Zengfeng Huang , Shuai Li , Chihao Zhang

A directed graph is oriented if it can be obtained by orienting the edges of a simple, undirected graph. For an oriented graph $G$, let $\beta(G)$ denote the size of a minimum feedback arc set, a smallest subset of edges whose deletion…

Combinatorics · Mathematics 2022-04-20 Jacob Fox , Zoe Himwich , Nitya Mani

We study stochastic decision-theoretic online learning with full information and event-level pure differential privacy. A COLT open problem of Hu and Mehta asks to determine the optimal gap-dependent regret rate for stochastic…

Machine Learning · Computer Science 2026-05-29 Tommaso Cesari , Roberto Colomboni

Given a network, the critical node detection problem finds a subset of nodes whose removal disrupts the network connectivity. Since many real-world systems are naturally modeled as graphs, assessing the vulnerability of the network is…

Discrete Mathematics · Computer Science 2025-12-02 Tuguldur Bayarsaikhan , Altannar Chinchuluun , Ashwin Arulselvan , Panos Pardalos