English
Related papers

Related papers: Distributed Online Optimization with Stochastic Ag…

200 papers

In this paper, we study a distributed privacy-preserving learning problem in social networks with general topology. The agents can communicate with each other over the network, which may result in privacy disclosure, since the…

Social and Information Networks · Computer Science 2023-01-30 Youming Tao , Shuzhen Chen , Feng Li , Dongxiao Yu , Jiguo Yu , Hao Sheng

We revisit the Follow the Regularized Leader (FTRL) framework for Online Convex Optimization (OCO) over compact sets, focusing on achieving dynamic regret guarantees. Prior work has highlighted the framework's limitations in dynamic…

Machine Learning · Computer Science 2026-03-19 Naram Mhaisen , George Iosifidis

Stochastic linear bandits are a fundamental model for sequential decision making, where an agent selects a vector-valued action and receives a noisy reward with expected value given by an unknown linear function. Although well studied in…

Machine Learning · Computer Science 2025-06-23 Bruce Huang , Ruida Zhou , Lin F. Yang , Suhas Diggavi

This paper examines online distributed Alternating Direction Method of Multipliers (ADMM). The goal is to distributively optimize a global objective function over a network of decision makers under linear constraints. The global objective…

Optimization and Control · Mathematics 2015-10-05 Saghar Hosseini , Airlie Chapman , Mehran Mesbahi

We consider an agent interacting with an environment in a single stream of actions, observations, and rewards, with no reset. This process is not assumed to be a Markov Decision Process (MDP). Rather, the agent has several representations…

Machine Learning · Computer Science 2013-03-19 Odalric-Ambrym Maillard , Phuong Nguyen , Ronald Ortner , Daniil Ryabko

The design of effective online caching policies is an increasingly important problem for content distribution networks, online social networks and edge computing services, among other areas. This paper proposes a new algorithmic toolbox for…

Networking and Internet Architecture · Computer Science 2022-10-21 Naram Mhaisen , George Iosifidis , Douglas Leith

We present an algorithm guaranteeing dynamic regret bounds for online omniprediction with long term constraints. The goal in this recently introduced problem is for a learner to generate a sequence of predictions which are broadcast to a…

Machine Learning · Computer Science 2025-10-09 Yahav Bechavod , Jiuyao Lu , Aaron Roth

This paper considers the distributed bandit convex optimization problem with time-varying inequality constraints over a network of agents, where the goal is to minimize network regret and cumulative constraint violation. Existing…

Optimization and Control · Mathematics 2024-06-21 Kunpeng Zhang , Xinlei Yi , Guanghui Wen , Ming Cao , Karl H. Johansson , Tianyou Chai , Tao Yang

Regret has been widely adopted as the metric of choice for evaluating the performance of online optimization algorithms for distributed, multi-agent systems. However, data/model variations associated with agents can significantly impact…

Machine Learning · Computer Science 2022-09-22 Zhanhong Jiang , Aditya Balu , Xian Yeow Lee , Young M. Lee , Chinmay Hegde , Soumik Sarkar

This paper investigates the regret associated with the Distributionally Robust Control (DRC) strategies used to address multistage optimization problems where the involved probability distributions are not known exactly, but rather are…

Optimization and Control · Mathematics 2022-12-02 Venkatraman Renganathan , Dongjun Wu

We study multitask online learning in a setting where agents can only exchange information with their neighbors on an arbitrary communication network. We introduce $\texttt{MT-CO}_2\texttt{OL}$, a decentralized algorithm for this setting…

Machine Learning · Computer Science 2024-04-09 Juliette Achddou , Nicolò Cesa-Bianchi , Pierre Laforgue

Network routing is a distributed decision problem which naturally admits numerical performance measures, such as the average time for a packet to travel from source to destination. OLPOMDP, a policy-gradient reinforcement learning…

Machine Learning · Computer Science 2025-12-04 Nigel Tao , Jonathan Baxter , Lex Weaver

We study an online mixed discrete and continuous optimization problem where a decision maker interacts with an unknown environment for a number of $T$ rounds. At each round, the decision maker needs to first jointly choose a discrete and a…

Optimization and Control · Mathematics 2024-08-27 Lintao Ye , Ming Chi , Zhi-Wei Liu , Xiaoling Wang , Vijay Gupta

Recent work on follow the perturbed leader (FTPL) algorithms for the adversarial multi-armed bandit problem has highlighted the role of the hazard rate of the distribution generating the perturbations. Assuming that the hazard rate is…

Machine Learning · Computer Science 2018-01-09 Zifan Li , Ambuj Tewari

We study the problem of online learning with non-convex losses, where the learner has access to an offline optimization oracle. We show that the classical Follow the Perturbed Leader (FTPL) algorithm achieves optimal regret rate of…

Machine Learning · Computer Science 2019-09-24 Arun Sai Suggala , Praneeth Netrapalli

We consider the problem where M agents collaboratively interact with an instance of a stochastic K-armed contextual bandit, where K>>M. The goal of the agents is to simultaneously minimize the cumulative regret over all the agents over a…

Machine Learning · Computer Science 2022-11-16 Jiabin Lin , Shana Moothedath

We design learning rate schedules that minimize regret for SGD-based online learning in the presence of a changing data distribution. We fully characterize the optimal learning rate schedule for online linear regression via a novel analysis…

Machine Learning · Computer Science 2024-06-19 Matthew Fahrbach , Adel Javanmard , Vahab Mirrokni , Pratik Worah

We study the problem of estimating an unknown parameter in a distributed and online manner. Existing work on distributed online learning typically either focuses on asymptotic analysis, or provides bounds on regret. However, these results…

Systems and Control · Electrical Eng. & Systems 2022-09-15 Lei Xin , George Chiu , Shreyas Sundaram

Inspired by real-time ad exchanges for online display advertising, we consider the problem of inferring a buyer's value distribution for a good when the buyer is repeatedly interacting with a seller through a posted-price mechanism. We…

Machine Learning · Computer Science 2013-11-28 Kareem Amin , Afshin Rostamizadeh , Umar Syed

We propose an optimal iterative scheme for federated transfer learning, where a central planner has access to datasets ${\cal D}_1,\dots,{\cal D}_N$ for the same learning model $f_{\theta}$. Our objective is to minimize the cumulative…

Machine Learning · Computer Science 2024-10-04 Xuwei Yang , Anastasis Kratsios , Florian Krach , Matheus Grasselli , Aurelien Lucchi
‹ Prev 1 3 4 5 6 7 10 Next ›