English
Related papers

Related papers: Online Optimization of Product-Form Networks

200 papers

Selecting the best hyperparameters for a particular optimization instance, such as the learning rate and momentum, is an important but nonconvex problem. As a result, iterative optimization methods such as hypergradient descent lack global…

Machine Learning · Computer Science 2023-12-05 Xinyi Chen , Elad Hazan

In this paper, we consider the problem of distributed online convex optimization, where a group of agents collaborate to track the global minimizers of a sum of time-varying objective functions in an online manner. Specifically, we propose…

Optimization and Control · Mathematics 2020-10-14 Yan Zhang , Robert J. Ravier , Vahid Tarokh , Michael M. Zavlanos

Natural gradient methods have been used to optimise the parameters of probability distributions in a variety of settings, often resulting in fast-converging procedures. Unfortunately, for many distributions of interest, computing the…

Machine Learning · Statistics 2024-05-28 Jonathan So , Richard E. Turner

During the last few decades, online controlled experiments (also known as A/B tests) have been adopted as a golden standard for measuring business improvements in industry. In our company, there are more than a billion users participating…

Applications · Statistics 2021-08-06 Tao Xiong , Yihan Bao , Penglei Zhao , Yong Wang

In the past few years, Online Convex Optimization (OCO) has received notable attention in the control literature thanks to its flexible real-time nature and powerful performance guarantees. In this paper, we propose new step-size rules and…

Optimization and Control · Mathematics 2023-01-18 Pedro Zattoni Scroccaro , Arman Sharifi Kolarijani , Peyman Mohajerin Esfahani

Motivated by emerging applications in machine learning, we consider an optimization problem in a general form where the gradient of the objective function is available through a biased stochastic oracle. We assume a bias-control parameter…

Optimization and Control · Mathematics 2026-02-10 Yin Liu , Sam Davanloo Tajbakhsh

In this paper we propose a novel adaptive online optimization algorithm tailored to the management of microgrids with high renewable energy penetration, which can be formulated as a constrained, online optimization problem. The proposed…

Optimization and Control · Mathematics 2025-12-05 Wouter J. A. van Weerelt , Angela Fontan , Nicola Bastianello

Correctly setting the parameters of a production machine is essential to improve product quality, increase efficiency, and reduce production costs while also supporting sustainability goals. Identifying optimal parameters involves an…

Machine Learning · Computer Science 2025-03-24 Philipp Wagner , Tobias Nagel , Philipp Leube , Marco F. Huber

We consider a distributed stochastic optimization problem in networks with finite number of nodes. Each node adjusts its action to optimize the global utility of the network, which is defined as the sum of local utilities of all nodes.…

Information Theory · Computer Science 2018-07-31 Wenjie Li , Mohamad Assaad

In this paper, the problem of distributed optimization is studied via a network of agents. Each agent only has access to a stochastic gradient of its own objective function in the previous time, and can communicate with its neighbors via a…

Optimization and Control · Mathematics 2024-01-29 Yuchen Yang , Kaihong Lu , Long Wang

This work considers the problem of decentralized online learning, where the goal is to track the optimum of the sum of time-varying functions, distributed across several nodes in a network. The local availability of the functions and their…

Machine Learning · Computer Science 2024-02-14 Shivangi Dubey Sharma , Ketan Rajawat

Hybrid quantum-classical optimization algorithms represent one of the most promising application for near-term quantum computers. In these algorithms the goal is to optimize an observable quantity with respect to some classical parameters,…

Quantum Physics · Physics 2021-01-27 Leonardo Banchi , Gavin E. Crooks

This paper presents a distributed optimization scheme over a network of agents in the presence of cost uncertainties and over switching communication topologies. Inspired by recent advances in distributed convex optimization, we propose a…

Optimization and Control · Mathematics 2016-11-15 Saghar Hosseini , Airlie Chapman , Mehran Mesbahi

Financial markets are complex environments that produce enormous amounts of noisy and non-stationary data. One fundamental problem is online portfolio selection, the goal of which is to exploit this data to sequentially select portfolios of…

Machine Learning · Statistics 2019-08-23 Favour M. Nyikosa , Michael A. Osborne , Stephen J. Roberts

Optimization is finding the best solution, which mathematically amounts to locating the global minimum of some cost function. Optimization is traditionally automated with digital or quantum computers, each having their limitations and none…

Statistical Mechanics · Physics 2021-11-16 Natalia B. Janson , Christopher J. Marsden

e consider the experimental design problem in an online environment, an important practical task for reducing the variance of estimates in randomized experiments which allows for greater precision, and in turn, improved decision making. In…

Methodology · Statistics 2022-03-07 David Arbour , Drew Dimmery , Tung Mai , Anup Rao

In this note, we discuss potential advantages in extending distributed optimization frameworks to enhance support for power grid operators managing an influx of online sequential decisions. First, we review the state-of-the-art distributed…

Optimization and Control · Mathematics 2021-09-28 Deming Yuan , Abhishek Bhardwaj , Ian Petersen , Elizabeth L. Ratnam , Guodong Shi

This paper considers optimization problems over networks where agents have individual objectives to meet, or individual parameter vectors to estimate, subject to subspace constraints that require the objectives across the network to lie in…

Multiagent Systems · Computer Science 2020-04-22 Roula Nassif , Stefan Vlaski , Ali H. Sayed

A frequently studied performance measure in online optimization is competitive analysis. It corresponds to the worst-case ratio, over all possible inputs of an algorithm, between the performance of the algorithm and the optimal offline…

Optimization and Control · Mathematics 2024-05-30 Antoine Lhomme , Nicolas Catusse , Nadia Brauner

Nonlocal operators of fractional type are a popular modeling choice for applications that do not adhere to classical diffusive behavior; however, one major challenge in nonlocal simulations is the selection of model parameters. In this work…

Optimization and Control · Mathematics 2020-10-09 Olena Burkovska , Christian Glusa , Marta D'Elia