English
Related papers

Related papers: Mirror Descent Methods with Weighting Scheme for O…

200 papers

This paper explores a new framework for reinforcement learning based on online convex optimization, in particular mirror descent and related algorithms. Mirror descent can be viewed as an enhanced gradient method, particularly suited to…

Machine Learning · Computer Science 2012-10-19 Sridhar Mahadevan , Bo Liu

We revisit the classical problem of estimating an unknown distribution from its samples by fitting a mixture model that minimizes cross-entropy loss. Framing the task as a stochastic convex optimization problem over the space of $ M…

Machine Learning · Statistics 2026-05-26 Mohammadreza Ahmadypour , Tara Javidi , Farinaz Koushanfar

This paper is concerned with distributed stochastic multi-agent constrained optimization problem over time-varying network with a class of communication noise. This paper considers the problem in composite optimization setting which is more…

Optimization and Control · Mathematics 2022-12-20 Zhan Yu , Daniel W. C. Ho , Deming Yuan , Jie Liu

Mirror descent, introduced by Nemirovski and Yudin in the 1970s, is a primal-dual convex optimization method that can be tailored to the geometry of the optimization problem at hand through the choice of a strongly convex potential…

Optimization and Control · Mathematics 2023-03-17 Belinda Tzen , Anant Raj , Maxim Raginsky , Francis Bach

In this paper, we consider continuous-time stochastic optimal control problems where the cost is evaluated through a coherent risk measure. We provide an explicit gradient descent-ascent algorithm which applies to problems subject to…

Optimization and Control · Mathematics 2023-06-23 Gabriel Velho , Jean Auriol , Riccardo Bonalli

In the framework of a real Hilbert space we consider the problem of approaching solutions to a class of hierarchical variational inequality problems, subsuming several other problem classes including certain mathematical programs under…

Optimization and Control · Mathematics 2026-01-27 Pavel Dvurechensky , Meggie Marschner , Shimrit Shtern , Mathias Staudigl

This paper considers stochastic monotone variational inequalities whose feasible region is the intersection of a (possibly infinite) number of convex functional level sets. A projection-based approach or direct Lagrangian-based techniques…

Optimization and Control · Mathematics 2025-10-20 Abhishek Chakraborty , Angelia Nedić

We consider an optimization problem with strongly convex objective and linear inequalities constraints. To be able to deal with a large number of constraints we provide a penalty reformulation of the problem. As penalty functions we use a…

Optimization and Control · Mathematics 2020-04-29 Angelia Nedich , Tatiana Tatarenko

We consider infinite-horizon discounted Markov decision problems with finite state and action spaces and study the convergence rates of the projected policy gradient method and a general class of policy mirror descent methods, all with…

Optimization and Control · Mathematics 2022-03-08 Lin Xiao

In order to solve an initial value problem by the variational iteration method, a sequence of functions is produced which converges to the solution under some suitable conditions. In the nonlinear case, after a few iterations the terms of…

Numerical Analysis · Mathematics 2016-06-23 Davod Khojasteh Salkuyeh , Ali Tavakoli

Variable order structures model situations in which the comparison between two points depends on a point-to-cone map. In this paper, an inexact projected gradient method for solving smooth constrained vector optimization problems on…

Optimization and Control · Mathematics 2019-08-09 Jose Yunier Bello Cruz , Gemayqzel Bouza Allende

Learning-to-optimize is an emerging framework that leverages training data to speed up the solution of certain optimization problems. One such approach is based on the classical mirror descent algorithm, where the mirror map is modelled…

Optimization and Control · Mathematics 2023-06-05 Hong Ye Tan , Subhadip Mukherjee , Junqi Tang , Andreas Hauptmann , Carola-Bibiane Schönlieb

We propose a method of bi-coordinate variations for non-stationary and non-smooth optimization problems, which involve a single linear equality and box constraints. Here only approximation sequences are known instead of exact values of the…

Optimization and Control · Mathematics 2016-08-16 I. V. Konnov

The article is devoted to some adaptive methods for variational inequalities with relatively smooth and relatively strongly monotone operators. Starting from the recently proposed proximal variant of the extragradient method for this class…

Optimization and Control · Mathematics 2023-08-02 S. S. Ablaev , F. S. Stonyakin , M. S. Alkousa , D. A. Pasechnyuk

Classical extragradient schemes and their stochastic counterpart represent a cornerstone for resolving monotone variational inequality problems. Yet, such schemes have a per-iteration complexity of two projections onto a convex set and…

Optimization and Control · Mathematics 2020-12-22 Shisheng Cui , Uday V. Shanbhag

We propose a variational regularization approach based on a multiscale representation called cylindrical shearlets aimed at dynamic imaging problems, especially dynamic tomography. The intuitive idea of our approach is to integrate a…

Numerical Analysis · Mathematics 2025-08-05 Tatiana A. Bubba , Tommi Heikkilä , Demetrio Labate , Luca Ratti

We consider minimization of the sum of a large number of convex functions, and we propose an incremental aggregated version of the proximal algorithm, which bears similarity to the incremental aggregated gradient and subgradient methods…

Systems and Control · Computer Science 2015-11-05 Dimitri P. Bertsekas

The minimax excess risk optimization (MERO) problem is a new variation of the traditional distributionally robust optimization (DRO) problem, which achieves uniformly low regret across all test distributions under suitable conditions. In…

Optimization and Control · Mathematics 2024-08-23 Zhihao Gu , Zi Xu

In this paper, we generalize the classical extragradient algorithm for solving variational inequality problems by utilizing nonzero normal vectors of the feasible set. In particular, conceptual algorithms are proposed with two different…

Optimization and Control · Mathematics 2019-02-25 J. Y. Bello Cruz , R. Díaz Millán , Hung M. Phan

We consider chance-constrained problems with discrete random distribution. We aim for problems with a large number of scenarios. We propose a novel method based on the stochastic gradient descent method which performs updates of the…

Optimization and Control · Mathematics 2019-05-28 Lukáš Adam , Martin Branda