English
Related papers

Related papers: Dual Block Gradient Ascent for Entropically Regula…

200 papers

In this paper we propose a unified two-phase scheme for convex optimization to accelerate: (1) the adaptive cubic regularization methods with exact/inexact Hessian matrices, and (2) the adaptive gradient method, without any knowledge of the…

Optimization and Control · Mathematics 2017-12-29 Bo Jiang , Tianyi Lin , Shuzhong Zhang

This paper presents a novel distributed formulation of the min-max optimization problem. Such a formulation enables enhanced flexibility among agents when optimizing their maximization variables. To address the problem, we propose two…

Optimization and Control · Mathematics 2025-05-19 Runze You , Kun Huang , Shi Pu

Consider the following distributed optimization scenario. A worker has access to training data that it uses to compute the gradients while a server decides when to stop iterative computation based on its target accuracy or delay…

Machine Learning · Computer Science 2022-04-28 Chung-Yi Lin , Victoria Kostina , Babak Hassibi

We present an efficient algorithm for regularized optimal transport. In contrast to previous methods, we use the Douglas-Rachford splitting technique to develop an efficient solver that can handle a broad class of regularizers. The…

Machine Learning · Computer Science 2023-05-31 Jacob Lindbäck , Zesen Wang , Mikael Johansson

This paper studies the network optimization problem about which a group of agents cooperates to minimize a global function under practical constraints of finite bandwidth communication. Particularly, we propose an adaptive encoding-decoding…

Optimization and Control · Mathematics 2021-11-17 Ziqin Chen , Shu Liang , Li Li , Shuming Cheng

Recently, there has been growing interest in developing optimization methods for solving large-scale machine learning problems. Most of these problems boil down to the problem of minimizing an average of a finite set of smooth and strongly…

Optimization and Control · Mathematics 2018-02-09 Aryan Mokhtari , Mert Gürbüzbalaban , Alejandro Ribeiro

We study an optimization problem related to the approximation of given data by a linear combination of transformed modes. In the simplest case, the optimization problem reduces to a minimization problem well-studied in the context of proper…

Optimization and Control · Mathematics 2021-07-12 Felix Black , Philipp Schulze , Benjamin Unger

We present a quantum algorithm for the simulation of the linear advection-diffusion equation based on block encodings of high order finite-difference operators and the quantum singular value transform. Our complexity analysis shows that the…

An analogue of the quadratic Wasserstein (or Monge-Kantorovich) distance between Borel probability measures on $\mathbf{R}^d$ has been defined in [F. Golse, C. Mouhot, T. Paul: Commun. Math. Phys. 343 (2015), 165-205] for density operators…

Mathematical Physics · Physics 2021-02-10 Emanuele Caglioti , François Golse , Thierry Paul

In this paper, we explore a specific optimization problem that combines a differentiable nonconvex function with a nondifferentiable function for multi-block variables, which is particularly relevant to tackle the multilinear…

Optimization and Control · Mathematics 2025-01-10 Zehui Liu , Qingsong Wang , Chunfeng Cui

We study the convergence rate of Sinkhorn's algorithm for solving entropy-regularized optimal transport problems when at least one of the probability measures, $\mu$, admits a density over $\mathbb{R}^d$. For a semi-concave cost function…

Optimization and Control · Mathematics 2025-07-21 Lénaïc Chizat , Alex Delalande , Tomas Vaškevičius

In this paper we propose a distributed dual gradient algorithm for minimizing linearly constrained separable convex problems and analyze its rate of convergence. In particular, we prove that under the assumption of strong convexity and…

Optimization and Control · Mathematics 2014-10-01 Ion Necoara , Valentin Nedelcu

We study the optimal transport problem for $d>2$ discrete measures. This is a linear programming problem on $d$-tensors. It gives a way to compute a "distance" between two sets of discrete measures. We introduce an entropic regularization…

Computer Vision and Pattern Recognition · Computer Science 2021-07-27 Shmuel Friedland

We revisit the classical dual ascent algorithm for minimization of convex functionals in the presence of linear constraints, and give convergence results which apply even for non-convex functionals. We describe limit points in terms of the…

Optimization and Control · Mathematics 2016-09-22 Fredrik Andersson , Marcus Carlsson , Carl Olsson

This chapter describes techniques for the numerical resolution of optimal transport problems. We will consider several discretizations of these problems, and we will put a strong focus on the mathematical analysis of the algorithms to solve…

Numerical Analysis · Mathematics 2020-03-03 Quentin Merigot , Boris Thibert

In this paper, we present an interior point algorithm with a full-Newton step for solving a linearly constrained convex optimization problem, in which we propose a generalization of the work of Kheirfam and Nasrollahi…

Numerical Analysis · Mathematics 2024-03-19 Aicha Kraria , Bachir Merikhi , Djamel Benterki

We investigate the quantum computing paradigm consisted of obtaining a target state that encodes the solution of a certain computational task by evolving the system with a combination of the problem-Hamiltonian and the driving-Hamiltonian.…

Quantum Physics · Physics 2022-06-14 Marllos E. F. Fernandes , Emanuel F. de Lima , Leonardo K. Castelano

This paper explores numerical methods for solving a convex differentiable semi-infinite program. We introduce a primal-dual gradient method which performs three updates iteratively: a momentum gradient ascend step to update the constraint…

Optimization and Control · Mathematics 2024-07-23 Yao Yao , Qihang Lin , Tianbao Yang

We study the regularity properties of the minimisers of entropic optimal transport providing a natural analogue of the $\varepsilon$-regularity theory of quadratic optimal transport in the entropic setting. More precisely, we show that if…

Analysis of PDEs · Mathematics 2025-01-14 Rishabh S. Gvalani , Lukas Koch

We introduce a novel algorithm for the task of coherently controlling a quantum mechanical system to implement any chosen unitary dynamics. It performs faster than existing state of the art methods by one to three orders of magnitude…

Quantum Physics · Physics 2015-06-04 Pierre de Fouquieres