English
Related papers

Related papers: Communication-Efficient Federated Online Decision-…

200 papers

We study the problem of online non-stochastic control (ONC), which is the control of a linear system under adversarial disturbances and adversarial cost functions, with the aim of minimizing the total cost incurred. A recent line of…

Optimization and Control · Mathematics 2026-04-21 Vijeth Hebbar , Spencer Hutchinson , Mahnoosh Alizadeh , Cédric Langbort

We consider the problem of controlling an unknown linear dynamical system under adversarially changing convex costs and full feedback of both the state and cost function. We present the first computationally-efficient algorithm that attains…

Machine Learning · Computer Science 2022-06-06 Asaf Cassel , Alon Cohen , Tomer Koren

We study cost-effective communication strategies that can be used to improve the performance of distributed learning systems in resource-constrained environments. For distributed learning in sequential decision making, we propose a new…

Machine Learning · Computer Science 2020-04-15 Udari Madhushani , Naomi Ehrich Leonard

We revisit the Follow the Regularized Leader (FTRL) framework for Online Convex Optimization (OCO) over compact sets, focusing on achieving dynamic regret guarantees. Prior work has highlighted the framework's limitations in dynamic…

Machine Learning · Computer Science 2026-03-19 Naram Mhaisen , George Iosifidis

Learning at the edges has become increasingly important as large quantities of data are continually generated locally. Among others, this paradigm requires algorithms that are simple (so that they can be executed by local devices), robust…

Machine Learning · Computer Science 2024-02-06 Tuan-Anh Nguyen , Nguyen Kim Thang , Denis Trystram

Communication bottleneck and data privacy are two critical concerns in federated multi-armed bandit (MAB) problems, such as situations in decision-making and recommendations of connected vehicles via wireless. In this paper, we design the…

Machine Learning · Computer Science 2021-11-03 Tan Li , Linqi Song

We study the problem of online learning in a class of Markov decision processes known as linearly solvable MDPs. In the stationary version of this problem, a learner interacts with its environment by directly controlling the state…

Machine Learning · Computer Science 2017-06-07 Gergely Neu , Vicenç Gómez

This paper addresses an online convex optimization problem where the cost function at each step depends on a history of past decisions (i.e., memory), and the decision maker has access to limited predictions of future cost values within a…

Optimization and Control · Mathematics 2025-12-29 Zhengmiao Wang , Zhi-Wei Liu , Ming Chi , Xiaoling Wang , Housheng Su , Lintao Ye

Online convex optimization (OCO) with time-varying constraints is a critical framework for sequential decision-making in dynamic networked systems, where learners must minimize cumulative loss while satisfying regions of feasibility that…

Machine Learning · Computer Science 2026-03-17 Xiufeng Liu , Qian Chen , Zhijin Wang , Ruyu Liu

We investigate the hardness of online reinforcement learning in fixed horizon, sparse linear Markov decision process (MDP), with a special focus on the high-dimensional regime where the ambient dimension is larger than the number of…

Machine Learning · Computer Science 2021-02-11 Botao Hao , Tor Lattimore , Csaba Szepesvári , Mengdi Wang

We consider a generalization of the celebrated Online Convex Optimization (OCO) framework with adversarial online constraints. In this problem, an online learner interacts with an adversary sequentially over multiple rounds. At the…

Machine Learning · Computer Science 2026-01-07 Subhamon Supantha , Abhishek Sinha

Motivated by applications to online learning in sparse estimation and Bayesian optimization, we consider the problem of online unconstrained nonsubmodular minimization with delayed costs in both full information and bandit feedback…

Machine Learning · Computer Science 2022-06-02 Tianyi Lin , Aldo Pacchiano , Yaodong Yu , Michael I. Jordan

Online structured prediction is a task of sequentially predicting outputs with complex structures based on inputs and past observations, encompassing online classification. Recent studies showed that in the full-information setting, we can…

Machine Learning · Computer Science 2026-01-06 Yuki Shibukawa , Taira Tsuchiya , Shinsaku Sakaue , Kenji Yamanishi

We investigate online convex optimization in non-stationary environments and choose dynamic regret as the performance measure, defined as the difference between cumulative loss incurred by the online algorithm and that of any feasible…

Machine Learning · Computer Science 2024-04-09 Peng Zhao , Yu-Jie Zhang , Lijun Zhang , Zhi-Hua Zhou

We study predictive control in a setting where the dynamics are time-varying and linear, and the costs are time-varying and well-conditioned. At each time step, the controller receives the exact predictions of costs, dynamics, and…

Optimization and Control · Mathematics 2021-06-22 Yiheng Lin , Yang Hu , Haoyuan Sun , Guanya Shi , Guannan Qu , Adam Wierman

This paper considers the distributed online convex-concave optimization with constraint sets over a multiagent network, in which each agent autonomously generates a series of decision pairs through a designable mechanism to cooperatively…

Optimization and Control · Mathematics 2025-08-14 Wentao Zhang , Baoyong Zhang , Deming Yuan , Shengyuan Xu , Vincent K. N. Lau

Distributed learning, particularly Federated Learning (FL), faces a significant bottleneck in the communication cost, particularly the uplink transmission of client-to-server updates, which is often constrained by asymmetric bandwidth…

Machine Learning · Computer Science 2026-02-19 Tomas Ortega , Chun-Yin Huang , Xiaoxiao Li , Hamid Jafarkhani

Federated Learning (FL) enables multiple resource-constrained edge devices with varying levels of heterogeneity to collaboratively train a global model. However, devices with limited capacity can create bottlenecks and slow down model…

Machine Learning · Computer Science 2025-04-08 Afsaneh Mahanipour , Hana Khamfroush

Federated Learning (FL) has recently received a lot of attention for large-scale privacy-preserving machine learning. However, high communication overheads due to frequent gradient transmissions decelerate FL. To mitigate the communication…

Machine Learning · Computer Science 2021-05-27 Milad Khademi Nori , Sangseok Yun , Il-Min Kim

We introduce a collaborative learning framework allowing multiple parties having different sets of attributes about the same user to jointly build models without exposing their raw data or model parameters. In particular, we propose a…

Machine Learning · Computer Science 2020-08-03 Yang Liu , Yan Kang , Xinwei Zhang , Liping Li , Yong Cheng , Tianjian Chen , Mingyi Hong , Qiang Yang