English
Related papers

Related papers: Low-Rank Optimal Transport through Factor Relaxati…

200 papers

Optimal transport (OT) is a popular tool in machine learning to compare probability measures geometrically, but it comes with substantial computational burden. Linear programming algorithms for computing OT distances scale cubically in the…

Machine Learning · Computer Science 2022-03-24 Gaspard Beugnot , Aude Genevay , Kristjan Greenewald , Justin Solomon

Because of the limitations of matrix factorization, such as losing spatial structure information, the concept of low-rank tensor factorization (LRTF) has been applied for the recovery of a low dimensional subspace from high dimensional…

Computer Vision and Pattern Recognition · Computer Science 2017-05-22 Xi'ai Chen , Zhi Han , Yao Wang , Qian Zhao , Deyu Meng , Lin Lin , Yandong Tang

This paper proposes an efficient HOT algorithm for solving the optimal transport (OT) problems with finite supports. We particularly focus on an efficient implementation of the HOT algorithm for the case where the supports are in…

Optimization and Control · Mathematics 2025-04-17 Guojun Zhang , Zhexuan Gu , Yancheng Yuan , Defeng Sun

Factor Analysis is about finding a low-rank plus sparse additive decomposition from a noisy estimate of the signal covariance matrix. In order to get such a decomposition, we formulate an optimization problem using the nuclear norm for the…

Optimization and Control · Mathematics 2024-11-14 Linyang Wang , Wanquan Liu , Bin Zhu

Convex relaxations of non-convex optimal power flow (OPF) problems have recently attracted significant interest. While existing relaxations globally solve many OPF problems, there are practical problems for which existing relaxations fail…

Optimization and Control · Mathematics 2014-11-18 Daniel K. Molzahn , Ian A. Hiskens

Optimal transport has gained significant attention in recent years due to its effectiveness in deep learning and computer vision. Its descendant metric, the Wasserstein distance, has been particularly successful in measuring distribution…

Optimization and Control · Mathematics 2025-02-18 Kaiwen Shi

Robust principal component analysis is an important representative method in data analysis. It is usually viewed as an optimization problem involving the rank and $\ell_0$-norm of matrices. In this paper, we study the rank and $\ell_0$…

Optimization and Control · Mathematics 2026-03-04 Wenjing Li , Wei Bian , Kim-Chuan Toh

Optimal transport (OT) provides powerful tools for comparing probability measures in various types. The Wasserstein distance which arises naturally from the idea of OT is widely used in many machine learning applications. Unfortunately,…

Optimization and Control · Mathematics 2021-06-03 Shu Liu , Haodong Sun , Hongyuan Zha

A data-driven formulation of the optimal transport problem is presented and solved using adaptively refined meshes to decompose the problem into a sequence of finite linear programming problems. Both the marginal distributions and their…

Numerical Analysis · Mathematics 2017-10-11 Weikun Chen , Esteban G. Tabak

Multi-modal large language models (MLLMs) achieve strong visual-language reasoning but suffer from high inference cost due to redundant visual tokens. Recent work explores visual token pruning to accelerate inference, while existing pruning…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Xiwen Chen , Wenhui Zhu , Gen Li , Xuanzhao Dong , Yujian Xiong , Hao Wang , Peijie Qiu , Qingquan Song , Zhipeng Wang , Shao Tang , Yalin Wang , Abolfazl Razi

Optimal Transport (OT) problem investigates a transport map that bridges two distributions while minimizing a given cost function. In this regard, OT between tractable prior distribution and data has been utilized for generative modeling…

Computer Vision and Pattern Recognition · Computer Science 2024-02-07 Jaemoo Choi , Jaewoong Choi , Myungjoo Kang

This paper considers general rank-constrained optimization problems that minimize a general objective function $f(X)$ over the set of rectangular $n\times m$ matrices that have rank at most $r$. To tackle the rank constraint and also to…

Information Theory · Computer Science 2021-09-07 Zhihui Zhu , Qiuwei Li , Gongguo Tang , Michael B. Wakin

To improve the performance of classical generative adversarial network (GAN), Wasserstein generative adversarial networks (W-GAN) was developed as a Kantorovich dual formulation of the optimal transport (OT) problem using Wasserstein-1…

Computer Vision and Pattern Recognition · Computer Science 2020-09-01 Byeongsu Sim , Gyutaek Oh , Jeongsol Kim , Chanyong Jung , Jong Chul Ye

In the realm of computer vision and graphics, accurately establishing correspondences between geometric 3D shapes is pivotal for applications like object tracking, registration, texture transfer, and statistical shape analysis. Moving…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Tung Le , Khai Nguyen , Shanlin Sun , Nhat Ho , Xiaohui Xie

Low-rank representation learning has emerged as a powerful tool for recovering missing values in power load data due to its ability to exploit the inherent low-dimensional structures of spatiotemporal measurements. Among various techniques,…

Machine Learning · Computer Science 2025-06-24 Yan Xia , Hao Feng , Hongwei Sun , Junjie Wang , Qicong Hu

In the standard formulation of the denoising problem, one is given a probabilistic model relating a latent variable $\Theta \in \Omega \subset \mathbb{R}^m \; (m\ge 1)$ and an observation $Z \in \mathbb{R}^d$ according to: $Z \mid \Theta…

Statistics Theory · Mathematics 2024-10-01 Nicolas Garcia Trillos , Bodhisattva Sen

Optimal transport (OT) is a framework that can be used to guide the optimal allocation of a limited amount of resources. The classical OT paradigm does not consider malicious attacks in its formulation and thus the designed transport plan…

Systems and Control · Electrical Eng. & Systems 2021-06-15 Jason Hughes , Juntao Chen

Optimal transport (OT) and unbalanced optimal transport (UOT) are central in many machine learning, statistics and engineering applications. 1D OT is easily solved, with complexity O(n log n), but no efficient algorithm was known for 1D…

Performance · Computer Science 2024-02-15 Gabriel Gouvine

Optimal transport (OT) aims to find a map $T$ that transports mass from one probability measure to another while minimizing a cost function. Recently, neural OT solvers have gained popularity in high dimensional biological applications such…

Machine Learning · Computer Science 2025-05-20 Peter Chen , Yue Xie , Qingpeng Zhang

We develop a fast and reliable method for solving large-scale optimal transport (OT) problems at an unprecedented combination of speed and accuracy. Built on the celebrated Douglas-Rachford splitting technique, our method tackles the…

Optimization and Control · Mathematics 2021-10-25 Vien V. Mai , Jacob Lindbäck , Mikael Johansson