English
Related papers

Related papers: Adaptive Mirror Descent for the Network Utility Ma…

200 papers

This paper is concerned with multi-agent optimization problem. A distributed randomized gradient-free mirror descent (DRGFMD) method is developed by introducing a randomized gradient-free oracle in the mirror descent scheme where the…

Optimization and Control · Mathematics 2019-03-12 Zhan Yu , Daniel W. C. Ho , Deming Yuan

Dual descent methods are commonly used to solve network optimization problems because their implementation can be distributed through the network. However, their convergence rates are typically very slow. This paper introduces a family of…

Optimization and Control · Mathematics 2011-04-07 M. Zargham , A. Ribeiro , A. Jadbabaie , A. Ozdaglar

Finding optimal trajectories for multiple traffic demands in a congested network is a challenging task. Optimal transport theory is a principled approach that has been used successfully to study various transportation problems. Its usage is…

Physics and Society · Physics 2024-10-10 Abdullahi Adinoyi Ibrahim , Michael Muehlebach , Caterina De Bacco

We consider the optimization problem of minimizing an objective functional, which admits a variational form and is defined over probability distributions on the constrained domain, which poses challenges to both theoretical analysis and…

Optimization and Control · Mathematics 2023-07-11 Dai Hai Nguyen , Tetsuya Sakurai

In this paper, we propose and analyse a family of generalised stochastic composite mirror descent algorithms. With adaptive step sizes, the proposed algorithms converge without requiring prior knowledge of the problem. Combined with an…

Optimization and Control · Mathematics 2022-11-22 Weijia Shao , Fikret Sivrikaya , Sahin Albayrak

In this paper, we consider the online proximal mirror descent for solving the time-varying composite optimization problems. For various applications, the algorithm naturally involves the errors in the gradient and proximal operator. We…

Optimization and Control · Mathematics 2023-04-11 Woocheol Choi , Myeong-Su Lee , Seok-Bae Yun

We address the problem of finding the optimal policy of a constrained Markov decision process (CMDP) using a gradient descent-based algorithm. Previous results have shown that a primal-dual approach can achieve an $\mathcal{O}(1/\sqrt{T})$…

Machine Learning · Computer Science 2022-02-07 Tao Liu , Ruida Zhou , Dileep Kalathil , P. R. Kumar , Chao Tian

This paper addresses a distributed optimization problem in a communication network where nodes are active sporadically. Each active node applies some learning method to control its action to maximize the global utility function, which is…

Optimization and Control · Mathematics 2021-04-20 Wenjie Li , Mohamad Assaad , Shiqi Zheng

We consider an online revenue maximization problem over a finite time horizon subject to lower and upper bounds on cost. At each period, an agent receives a context vector sampled i.i.d. from an unknown distribution and needs to make a…

Machine Learning · Computer Science 2021-04-21 Alfonso Lobos , Paul Grigas , Zheng Wen

Attention mechanisms have revolutionized several domains of artificial intelligence, such as natural language processing and computer vision, by enabling models to selectively focus on relevant parts of the input data. While recent work has…

Machine Learning · Computer Science 2026-02-03 Addison Kristanto Julistiono , Davoud Ataee Tarzanagh , Navid Azizan

A wide range of applications arising in machine learning and signal processing can be cast as convex optimization problems. These problems are often ill-posed, i.e., the optimal solution lacks a desired property such as uniqueness or…

Optimization and Control · Mathematics 2019-07-18 Mostafa Amini , Farzad Yousefian

Stochastic optimization methods such as mirror descent have wide applications due to low computational cost. Those methods have been well studied under assumption of the independent and identical distribution, and usually achieve sublinear…

Machine Learning · Computer Science 2023-09-27 Yawei Zhao

This paper introduces and examines numerical approximation schemes for computing risk budgeting portfolios associated to positive homogeneous and sub-additive risk measures. We employ Mirror Descent algorithms to determine the optimal risk…

Portfolio Management · Quantitative Finance 2024-11-20 Martin Arnaiz Iglesias , Adil Rengim Cetingoz , Noufel Frikha

We propose primal-dual stochastic mirror descent for the convex optimization problems with functional constraints. We obtain the rate of convergence in terms of probability of large deviations.

Optimization and Control · Mathematics 2017-08-01 Anastasia Bayandina , Alexander Gasnikov , Evgenia Gasnikova , Sergey Matsievsky

Constrained competitive optimization involves multiple agents trying to minimize conflicting objectives, subject to constraints. This is a highly expressive modeling language that subsumes most of modern machine learning. In this work we…

Optimization and Control · Mathematics 2020-06-19 Florian Schäfer , Anima Anandkumar , Houman Owhadi

We consider the problem of max-min fairness for uplink cell-free massive multiple-input multiple-output (MIMO) subject to per-user power constraints. The standard framework for solving the considered problem is to separately solve two…

Signal Processing · Electrical Eng. & Systems 2022-09-21 Muhammad Farooq , Hien Quoc Ngo , Le-Nam Tran

We introduce and analyze a new family of first-order optimization algorithms which generalizes and unifies both mirror descent and dual averaging. Within the framework of this family, we define new algorithms for constrained optimization…

Optimization and Control · Mathematics 2022-06-13 Anatoli Juditsky , Joon Kwon , Éric Moulines

In this letter, we propose a novel model and corresponding algorithms to address the optimal utility max-min fair link adaptation in Downlink Multi-User (DL-MU) feature of the emerging IEEE 802.11ac WLAN standard. Herein, we first propose a…

Networking and Internet Architecture · Computer Science 2014-04-24 Ali A. Khavasi , Mojtaba Aajami , Hae-Ryeon Park , Jung-Bong Suk

In this paper, we consider the network utility maximization problem with various user priorities via jointly optimizing user association, load distribution and power control in a load-coupled heterogeneous network. In order to tackle the…

Information Theory · Computer Science 2017-10-19 Zhaohui Yang , Wei Xu , Jianfeng Shi , Hao Xu , Ming Chen

Maximum entropy modeling is a flexible and popular framework for formulating statistical models given partial knowledge. In this paper, rather than the traditional method of optimizing over the continuous density directly, we learn a smooth…

Methodology · Statistics 2017-05-01 Gabriel Loaiza-Ganem , Yuanjun Gao , John P. Cunningham