English
Related papers

Related papers: MinMax Methods for Optimal Transport and Beyond: R…

200 papers

The use of min-max optimization in adversarial training of deep neural network classifiers and training of generative adversarial networks has motivated the study of nonconvex-nonconcave optimization objectives, which frequently arise in…

Optimization and Control · Mathematics 2021-03-02 Jelena Diakonikolas , Constantinos Daskalakis , Michael I. Jordan

Trace norm regularization is a widely used approach for learning low rank matrices. A standard optimization strategy is based on formulating the problem as one of low rank matrix factorization which, however, leads to a non-convex problem.…

Machine Learning · Computer Science 2017-08-01 Carlo Ciliberto , Dimitris Stamos , Massimiliano Pontil

Deep Neural Networks and Reinforcement Learning methods have empirically shown great promise in tackling challenging combinatorial problems. In those methods a deep neural network is used as a solution generator which is then trained by…

Machine Learning · Computer Science 2023-11-08 Constantine Caramanis , Dimitris Fotakis , Alkis Kalavasis , Vasilis Kontonis , Christos Tzamos

The optimal transport (OT) problem is a classical optimization problem having the form of linear programming. Machine learning applications put forward new computational challenges in its solution. In particular, the OT problem defines a…

Optimization and Control · Mathematics 2022-10-25 Nazarii Tupitsa , Pavel Dvurechensky , Darina Dvinskikh , Alexander Gasnikov

The widely used nuclear norm heuristic for rank minimization problems introduces a regularization parameter which is difficult to tune. We have recently proposed a method to approximate the regularization path, i.e., the optimal solution as…

Systems and Control · Computer Science 2015-04-22 Niclas Blomberg , Cristian R. Rojas , Bo Wahlberg

Deep Neural Networks have achieved remarkable success relying on the developing high computation capability of GPUs and large-scale datasets with increasing network depth and width in image recognition, object detection and many other…

Machine Learning · Computer Science 2020-01-08 E Zhenqian , Gao Weiguo

We use the randomization idea and proof techniques from optimal transport to study optimal reinsurance problems. We start by providing conditions for a class of problems that allow us to characterize the support of optimal treaties, and…

Optimization and Control · Mathematics 2024-11-04 Beatrice Acciaio , Hansjörg Albrecher , Brandon García Flores

The goal of this paper is to settle the study of non-commutative optimal transport problems with convex regularization, in their static and finite-dimensional formulations. We consider both the balanced and unbalanced problem and show in…

Mathematical Physics · Physics 2025-06-27 Emanuele Caputo , Augusto Gerolin , Nataliia Monina , Lorenzo Portinale

We study the problem of designing hard negative sampling distributions for unsupervised contrastive representation learning. We propose and analyze a novel min-max framework that seeks a representation which minimizes the maximum…

Machine Learning · Computer Science 2023-12-18 Ruijie Jiang , Prakash Ishwar , Shuchin Aeron

Entropic regularization provides a generalization of the original optimal transport problem. It introduces a penalty term defined by the Kullback-Leibler divergence, making the problem more tractable via the celebrated Sinkhorn algorithm.…

Optimization and Control · Mathematics 2023-01-04 Dávid Terjék , Diego González-Sánchez

In this work, the authors address the Optimal Transport (OT) problem on graphs using a proximal stabilized Interior Point Method (IPM). In particular, strongly leveraging on the induced primal-dual regularization, the authors propose to…

Optimization and Control · Mathematics 2023-07-12 Stefano Cipolla , Jacek Gondzio , Filippo Zanetti

Despite the success of deep learning-based algorithms, it is widely known that neural networks may fail to be robust. A popular paradigm to enforce robustness is adversarial training (AT), however, this introduces many computational and…

Machine Learning · Computer Science 2024-01-18 Nicolas Garcia Trillos , Matt Jacobs , Jakwang Kim , Matthew Werenski

Despite huge successes on a wide range of tasks, neural networks are known to sometimes struggle to generalise to unseen data. Many approaches have been proposed over the years to promote the generalisation ability of neural networks,…

Machine Learning · Computer Science 2026-02-02 Christiaan P. Opperman , Anna S. Bosman , Katherine M. Malan

This article introduces a generalization of the discrete optimal transport, with applications to color image manipulations. This new formulation includes a relaxation of the mass conservation constraint and a regularization term. These two…

Computer Vision and Pattern Recognition · Computer Science 2013-07-23 Sira Ferradans , Nicolas Papadakis , Gabriel Peyré , Jean-François Aujol

This paper proposes a simplified version of classical models for urban transportation networks, and studies the problem of controlling intersections with the goal of optimizing network-wide congestion. Differently from traditional…

Optimization and Control · Mathematics 2018-11-08 Gianluca Bianchin , Fabio Pasqualetti

Regularization is a powerful technique for extracting useful information from noisy data. Typically, it is implemented by adding some sort of norm constraint to an objective function and then exactly optimizing the modified objective…

Data Structures and Algorithms · Computer Science 2011-04-28 Michael W. Mahoney , Lorenzo Orecchia

This chapter describes techniques for the numerical resolution of optimal transport problems. We will consider several discretizations of these problems, and we will put a strong focus on the mathematical analysis of the algorithms to solve…

Numerical Analysis · Mathematics 2020-03-03 Quentin Merigot , Boris Thibert

Adapted optimal transport (AOT) problems are optimal transport problems for distributions of a time series where couplings are constrained to have a temporal causal structure. In this paper, we develop computational tools for solving AOT…

Probability · Mathematics 2023-04-26 Stephan Eckstein , Gudmund Pammer

This paper presents a regularized Newton method (RNM) with generalized regularization terms for unconstrained convex optimization problems. The generalized regularization includes quadratic, cubic, and elastic net regularizations as special…

Optimization and Control · Mathematics 2024-07-11 Yuya Yamakawa , Nobuo Yamashita

The modeling of phenomenological structure is a crucial aspect in inverse imaging problems. One emerging modeling tool in computational imaging is the optimal transport framework. Its ability to model geometric displacements across an…

Image and Video Processing · Electrical Eng. & Systems 2020-05-12 John Lee , Nicholas P. Bertrand , Christopher J. Rozell