English
Related papers

Related papers: Unbalanced Optimal Transport through Non-negative …

200 papers

In this paper, we consider nonconvex optimization problems with nonlinear equality constraints. We assume that the objective function and the functional constraints are locally smooth. To solve this problem, we introduce a linearized…

Optimization and Control · Mathematics 2025-03-21 Lahcen El Bourkhissi , Ion Necoara

The Optimal transport (OT) problem is rapidly finding its way into machine learning. Favoring its use are its metric properties. Many problems admit solutions with guarantees only for objects embedded in metric spaces, and the use of…

Machine Learning · Computer Science 2022-12-26 Liang Mi , Azadeh Sheikholeslami , José Bento

The unsupervised task of aligning two or more distributions in a shared latent space has many applications including fair representations, batch effect mitigation, and unsupervised domain adaptation. Existing flow-based approaches estimate…

Machine Learning · Computer Science 2022-03-17 Zeyu Zhou , Ziyu Gong , Pradeep Ravikumar , David I. Inouye

When considering an unconstrained minimization problem, a standard approach is to solve the optimality system with a Newton method possibly preconditioned by, e.g., nonlinear elimination. In this contribution, we argue that nonlinear…

Numerical Analysis · Mathematics 2024-09-04 Gabriele Ciaremalla , Tommaso Vanzan

Global pooling is one of the most significant operations in many machine learning models and tasks, whose implementation, however, is often empirical in practice. In this study, we develop a novel and solid global pooling framework through…

Machine Learning · Computer Science 2022-09-30 Minjie Cheng , Hongteng Xu

Entropic regularization is quickly emerging as a new standard in optimal transport (OT). It enables to cast the OT computation as a differentiable and unconstrained convex optimization problem, which can be efficiently solved using the…

Machine Learning · Statistics 2018-02-21 Mathieu Blondel , Vivien Seguy , Antoine Rolet

Combinatorial optimization problems are one of the target applications of current quantum technology, mainly because of their industrial relevance, the difficulty of solving large instances of them classically, and their equivalence to…

Quantum Physics · Physics 2024-06-10 J. A. Montanez-Barrera , Pim van den Heuvel , Dennis Willsch , Kristel Michielsen

Optimal transport (OT) is attracting increasing attention in machine learning. It aims to transport a source distribution to a target one at minimal cost. In its vanilla form, the source and target distributions are predetermined, which…

Machine Learning · Computer Science 2024-01-23 Liangliang Shi , Zhaoqi Shen , Junchi Yan

In this note, we generalize the classical optimal partial transport (OPT) problem by modifying the mass destruction/creation term to function-based terms, introducing what we term ``generalized optimal partial transport'' problems. We then…

Optimization and Control · Mathematics 2024-07-10 Yikun Bai

We study algorithms for online linear optimization in Hilbert spaces, focusing on the case where the player is unconstrained. We develop a novel characterization of a large class of minimax algorithms, recovering, and even improving,…

Machine Learning · Computer Science 2014-05-22 H. Brendan McMahan , Francesco Orabona

Optimal transport problems pose many challenges when considering their numerical treatment. We investigate the solution of a PDE-constrained optimisation problem subject to a particular transport equation arising from the modelling of image…

Numerical Analysis · Mathematics 2018-01-15 Roland Herzog , John W. Pearson , Martin Stoll

We present a novel algorithm that allows us to gain detailed insight into the effects of sparsity in linear and nonlinear optimization, which is of great importance in many scientific areas such as image and signal processing, medical…

Optimization and Control · Mathematics 2021-09-23 Katharina Bieker , Bennet Gebken , Sebastian Peitz

Optimal transport (OT) aims to find a map $T$ that transports mass from one probability measure to another while minimizing a cost function. Recently, neural OT solvers have gained popularity in high dimensional biological applications such…

Machine Learning · Computer Science 2025-05-20 Peter Chen , Yue Xie , Qingpeng Zhang

We characterize the solution to the entropically regularized optimal transport problem by a well-posed ordinary differential equation (ODE). Our approach works for discrete marginals and general cost functions, and in addition to two…

Optimization and Control · Mathematics 2024-04-01 Joshua Zoen-Git Hiew , Luca Nenna , Brendan Pass

Many nonlinear optimal control and optimization problems involve constraints that combine continuous dynamics with discrete logic conditions. Standard approaches typically rely on mixed-integer programming, which introduces scalability…

Systems and Control · Electrical Eng. & Systems 2026-01-08 Jad Wehbeh , Eric C. Kerrigan

Recently, Neural Topic Models (NTMs) inspired by variational autoencoders have obtained increasingly research interest due to their promising results on text analysis. However, it is usually hard for existing NTMs to achieve good document…

Information Retrieval · Computer Science 2022-06-01 He Zhao , Dinh Phung , Viet Huynh , Trung Le , Wray Buntine

Data classification without access to labeled samples remains a challenging problem. It usually depends on an appropriately chosen distance between features, a topic addressed in metric learning. Recently, Huizing, Cantini and Peyr\'e…

Optimization and Control · Mathematics 2025-07-18 Janis Auffenberg , Jonas Bresch , Oleh Melnyk , Gabriele Steidl

The theory of Optimal Transport (OT) and Martingale Optimal Transport (MOT) were inspired by problems in economics and finance and have flourished over the past decades, making significant advances in theory and practice. MOT considers the…

Probability · Mathematics 2023-04-25 Tongseok Lim

In this paper, we consider a class of nonconvex problems with linear constraints appearing frequently in the area of image processing. We solve this problem by the penalty method and propose the iteratively reweighted alternating…

Optimization and Control · Mathematics 2019-02-13 Tao Sun , Dongsheng Li , Hao Jiang , Zhe Quan

An evolutionary form of a generalized Bayesian update method, which is strictly derivative- free yet directed through an additive update term based purely on the statistical moments of the design variables, is proposed for nonlinear inverse…

Methodology · Statistics 2013-12-17 M Venugopal , D Roy , R M Vasu