English
Related papers

Related papers: Online Distributed Optimization with Clipped Stoch…

200 papers

This study considers online learning with general directed feedback graphs. For this problem, we present best-of-both-worlds algorithms that achieve nearly tight regret bounds for adversarial environments as well as poly-logarithmic regret…

Machine Learning · Computer Science 2022-12-29 Shinji Ito , Taira Tsuchiya , Junya Honda

This paper develops and analyzes an online distributed proximal-gradient method (DPGM) for time-varying composite convex optimization problems. Each node of the network features a local cost that includes a smooth strongly convex function…

Optimization and Control · Mathematics 2024-05-07 Nicola Bastianello , Emiliano Dall'Anese

This paper considers a distributed convex optimization problem over a time-varying multi-agent network, where each agent has its own decision variables that should be set so as to minimize its individual objective subject to local…

Optimization and Control · Mathematics 2018-05-22 Chuanye Gu , Zhiyou Wu , Jueyou Li , Yaning Guo

We consider an online learning process to forecast a sequence of outcomes for nonconvex models. A typical measure to evaluate online learning algorithms is regret but such standard definition of regret is intractable for nonconvex models…

Machine Learning · Computer Science 2018-11-30 Sergul Aydore , Lee Dicker , Dean Foster

We study the problem of dynamic regret minimization in online convex optimization, in which the objective is to minimize the difference between the cumulative loss of an algorithm and that of an arbitrary sequence of comparators. While the…

Machine Learning · Computer Science 2024-11-05 Andrew Jacobsen , Francesco Orabona

We consider online learning problems in the realizable setting, where there is a zero-loss solution, and propose new Differentially Private (DP) algorithms that obtain near-optimal regret bounds. For the problem of online prediction from…

Machine Learning · Computer Science 2023-03-01 Hilal Asi , Vitaly Feldman , Tomer Koren , Kunal Talwar

We design differentially private algorithms for the problem of prediction with expert advice under dynamic regret, also known as tracking the best expert. Our work addresses three natural types of adversaries, stochastic with shifting…

Machine Learning · Computer Science 2025-03-14 Aadirupa Saha , Vinod Raman , Hilal Asi

Distributed Optimization is an increasingly important subject area with the rise of multi-agent control and optimization. We consider a decentralized stochastic optimization problem where the agents on a graph aim to asynchronously optimize…

Optimization and Control · Mathematics 2021-10-22 Vyacheslav Kungurtsev , Mahdi Morafah , Tara Javidi , Gesualdo Scutari

We propose an algorithm based on online convex optimization for controlling discrete-time linear dynamical systems. The algorithm is data-driven, i.e., does not require a model of the system, and is able to handle a priori unknown and…

Optimization and Control · Mathematics 2022-11-17 Marko Nonhoff , Matthias A. Müller

Recent research has shown that quasar-convexity can be found in applications such as identification of linear dynamical systems and generalized linear models. Such observations have in turn spurred exciting developments in design and…

Optimization and Control · Mathematics 2024-07-08 Yuen-Man Pun , Iman Shames

This paper considers the problem of online trajectory design under time-varying environments. We formulate the general trajectory optimization problem within the framework of time-varying constrained convex optimization and proposed a novel…

Optimization and Control · Mathematics 2020-01-09 Mohan Krishna Nutalapati , Amrit Singh Bedi , Ketan Rajawat , Marceau Coupechoux

We consider a stochastic convex optimization problem that requires minimizing a sum of misspecified agentspecific expectation-valued convex functions over the intersection of a collection of agent-specific convex sets. This misspecification…

Optimization and Control · Mathematics 2015-09-22 Aswin Kannan , Angelia Nedich , Uday V. Shanbhag

In this paper, distributed convex optimization problem over non-directed dynamical networks is studied. Here, networked agents with single-integrator dynamics are supposed to rendezvous at a point that is the solution of a global convex…

Optimization and Control · Mathematics 2017-07-18 Amir Adibzadeh , Mohsen Zamani , Amir A. Suratgar , Mohammad B. Menhaj

Dynamic pricing of goods in a competitive environment to maximize revenue is a natural objective and has been a subject of research over the years. In this paper, we focus on a class of markets exhibiting the substitutes property with…

Machine Learning · Computer Science 2017-09-18 Paresh Nakhe

Making use of predictions is a crucial, but under-explored, area of online algorithms. This paper studies a class of online optimization problems where we have external noisy predictions available. We propose a stochastic prediction error…

Machine Learning · Computer Science 2015-04-28 Niangjun Chen , Anish Agarwal , Adam Wierman , Siddharth Barman , Lachlan L. H. Andrew

Some of the most compelling applications of online convex optimization, including online prediction and classification, are unconstrained: the natural feasible set is R^n. Existing algorithms fail to achieve sub-linear regret in this…

Machine Learning · Computer Science 2012-11-13 Matthew Streeter , H. Brendan McMahan

Decentralized Online Learning (online learning in decentralized networks) attracts more and more attention, since it is believed that Decentralized Online Learning can help the data providers cooperatively better solve their online problems…

Machine Learning · Computer Science 2019-05-30 Yawei Zhao , Chen Yu , Peilin Zhao , Hanlin Tang , Shuang Qiu , Ji Liu

This paper proposes a distributed algorithm for a network of agents to solve an optimization problem with separable objective function and locally coupled constraints. Our strategy is based on reformulating the original constrained problem…

Optimization and Control · Mathematics 2021-03-12 Priyank Srivastava , Jorge Cortes

We consider the problem of regularized regression in a network of communication-constrained devices. Each node has local data and objectives, and the goal is for the nodes to optimize a global objective. We develop a distributed…

Optimization and Control · Mathematics 2016-03-22 Neil McGlohon , Stacy Patterson

We consider the problem of online stochastic optimization in a distributed setting with $M$ clients connected through a central server. We develop a distributed online learning algorithm that achieves order-optimal cumulative regret with…

Machine Learning · Computer Science 2023-06-07 Sudeep Salgia , Qing Zhao , Tamir Gabay , Kobi Cohen