English
Related papers

Related papers: MinMax Methods for Optimal Transport and Beyond: R…

200 papers

The minimization of a nonconvex composite function can model a variety of imaging tasks. A popular class of algorithms for solving such problems are majorization-minimization techniques which iteratively approximate the composite nonconvex…

Optimization and Control · Mathematics 2018-09-05 Jonas Geiping , Michael Moeller

Classical approach to regularization is to design norms enhancing smoothness or sparsity and then to use this norm or some power of this norm as a regularization function. The choice of the regularization function (for instance a power…

Statistics Theory · Mathematics 2018-05-21 Raphaël Deswarte , Guillaume Lecué

We study the existing algorithms that solve the multidimensional martingale optimal transport. Then we provide a new algorithm based on entropic regularization and Newton's method. Then we provide theoretical convergence rate results and we…

Probability · Mathematics 2018-12-31 Hadrien De March

We study the consequences of the equivalence between the least gradient problem and a boundary-to-boundary optimal transport problem in two dimensions. We extend the relationship between the two problems to their respective dual problems,…

Analysis of PDEs · Mathematics 2021-02-12 Wojciech Górny

The aim of this work is to develop general optimization methods for finite difference schemes used to approximate linear differential equations. The specific case of the transport equation is exposed. In particular, the minimization of the…

Analysis of PDEs · Mathematics 2007-05-23 Claire David , Pierre Sagaut

The min-max optimization problem, also known as the saddle point problem, is a classical optimization problem which is also studied in the context of zero-sum games. Given a class of objective functions, the goal is to find a value for the…

Optimization and Control · Mathematics 2021-08-11 Meisam Razaviyayn , Tianjian Huang , Songtao Lu , Maher Nouiehed , Maziar Sanjabi , Mingyi Hong

Modern deep neural network (DNN) trainings utilize various training techniques, e.g., nonlinear activation functions, batch normalization, skip-connections, etc. Despite their effectiveness, it is still mysterious how they help accelerate…

Machine Learning · Computer Science 2024-03-05 Cheng Chen , Junjie Yang , Yi Zhou

Motivated by recent increased interest in optimization algorithms for non-convex optimization in application to training deep neural networks and other optimization problems in data analysis, we give an overview of recent theoretical…

Optimization problems are ubiquitous in our societies and are present in almost every segment of the economy. Most of these optimization problems are NP-hard and computationally demanding, often requiring approximate solutions for…

Optimization and Control · Mathematics 2021-06-23 James Kotary , Ferdinando Fioretto , Pascal Van Hentenryck

The traveling salesman problem is a fundamental combinatorial optimization problem with strong exact algorithms. However, as problems scale up, these exact algorithms fail to provide a solution in a reasonable time. To resolve this, current…

Machine Learning · Computer Science 2025-01-09 Yong Liang Goh , Wee Sun Lee , Xavier Bresson , Thomas Laurent , Nicholas Lim

We introduce and study a mathematical framework for a broad class of regularization functionals for ill-posed inverse problems: Regularization Graphs. Regularization graphs allow to construct functionals using as building blocks linear…

Optimization and Control · Mathematics 2022-09-28 Kristian Bredies , Marcello Carioni , Martin Holler

Optimal transport has been one of the most exciting subjects in mathematics, starting from the 18th century. As a powerful tool to transport between two probability measures, optimal transport methods have been reinvigorated nowadays in a…

Machine Learning · Statistics 2021-05-21 Jingyi Zhang , Wenxuan Zhong , Ping Ma

The classical problem of optimal transportation can be formulated as a linear optimization problem on a convex domain: among all joint measures with fixed marginals find the optimal one, where optimality is measured against a cost function.…

Optimization and Control · Mathematics 2012-11-29 Jonathan Korman , Robert J. McCann

We present a comparative study of the application of a recently introduced heuristic algorithm to the optimization of transport on three major types of complex networks. The algorithm balances network traffic iteratively by minimizing the…

Disordered Systems and Neural Networks · Physics 2007-07-12 Bogdan Danila , Yong Yu , John A. Marsh , Kevin E. Bassler

The optimal mass transport problem gives a geometric framework for optimal allocation, and has recently gained significant interest in application areas such as signal processing, image processing, and computer vision. Even though it can be…

Optimization and Control · Mathematics 2018-02-07 Johan Karlsson , Axel Ringh

Optimal transport on a graph focuses on finding the most efficient way to transfer resources from one distribution to another while considering the graph's structure. This paper introduces a new distributed algorithm that solves the optimal…

Optimization and Control · Mathematics 2025-07-08 Yacine Mokhtari , Emmanuel Moulay , Patrick Coirault , Jérôme Le Ny

We present a novel neural-networks-based algorithm to compute optimal transport maps and plans for strong and weak transport costs. To justify the usage of neural networks, we prove that they are universal approximators of transport plans…

Machine Learning · Computer Science 2023-03-02 Alexander Korotin , Daniil Selikhanovych , Evgeny Burnaev

We investigate the problem of efficiently computing optimal transport (OT) distances, which is equivalent to the node-capacitated minimum cost maximum flow problem in a bipartite graph. We compare runtimes in computing OT distances on data…

Data Structures and Algorithms · Computer Science 2020-07-07 Yihe Dong , Yu Gao , Richard Peng , Ilya Razenshteyn , Saurabh Sawlani

We develop a novel theoretical framework for understating OT schemes respecting a class structure. For this purpose, we propose a convex OT program with a sum-of-norms regularization term, which provably recovers the underlying class…

Machine Learning · Computer Science 2023-05-23 Arman Rahbar , Ashkan Panahi , Morteza Haghir Chehreghani , Devdatt Dubhashi , Hamid Krim

We present the viewpoint that optimization problems encountered in machine learning can often be interpreted as minimizing a convex functional over a function space, but with a non-convex constraint set introduced by model parameterization.…

Machine Learning · Computer Science 2020-04-21 Yongqiang Cai , Qianxiao Li , Zuowei Shen