English
Related papers

Related papers: Preventing Local Pitfalls in Vector Quantization v…

200 papers

Several recent applications of optimal transport (OT) theory to machine learning have relied on regularization, notably entropy and the Sinkhorn algorithm. Because matrix-vector products are pervasive in the Sinkhorn algorithm, several…

Machine Learning · Statistics 2021-03-09 Meyer Scetbon , Marco Cuturi , Gabriel Peyré

The Sinkhorn algorithm is a widely used method for solving the optimal transport problem, and the Greenkhorn algorithm is one of its variants. While there are modified versions of these two algorithms whose computational complexities are…

Optimization and Control · Mathematics 2023-10-20 Jianzhou Luo , Dingchuan Yang , Ke Wei

Optimal transport (OT) distances are finding evermore applications in machine learning and computer vision, but their wide spread use in larger-scale problems is impeded by their high computational cost. In this work we develop a family of…

Machine Learning · Statistics 2018-03-06 Brahim Khalil Abid , Robert M. Gower

The Wasserstein metric is broadly used in optimal transport for comparing two probabilistic distributions, with successful applications in various fields such as machine learning, signal processing, seismic inversion, etc. Nevertheless, the…

Optimization and Control · Mathematics 2022-02-22 Qichen Liao , Jing Chen , Zihao Wang , Bo Bai , Shi Jin , Hao Wu

Optimal transport is an important tool in machine learning, allowing to capture geometric properties of the data through a linear program on transport polytopes. We present a single-loop optimization algorithm for minimizing general convex…

Machine Learning · Computer Science 2023-06-21 Marin Ballu , Quentin Berthet

Regularized optimal transport (OT) is now increasingly used as a loss or as a matching layer in neural networks. Entropy-regularized OT can be computed using the Sinkhorn algorithm but it leads to fully-dense transportation plans, meaning…

Machine Learning · Statistics 2023-04-17 Tianlin Liu , Joan Puigcerver , Mathieu Blondel

Vector quantization(VQ) is a hardware-friendly DNN compression method that can reduce the storage cost and weight-loading datawidth of hardware accelerators. However, conventional VQ techniques lead to significant accuracy loss because the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Shuaiting Li , Chengxuan Wang , Juncan Deng , Zeyu Wang , Zewen Ye , Zongsheng Wang , Haibin Shen , Kejie Huang

Unbalanced optimal transport (UOT) extends optimal transport (OT) to take into account mass variations to compare distributions. This is crucial to make OT successful in ML applications, making it robust to data normalization and outliers.…

Optimization and Control · Mathematics 2022-01-04 Thibault Séjourné , François-Xavier Vialard , Gabriel Peyré

Optimal transport induces the Earth Mover's (Wasserstein) distance between probability distributions, a geometric divergence that is relevant to a wide range of problems. Over the last decade, two relaxations of optimal transport have been…

Optimization and Control · Mathematics 2023-01-18 Thibault Séjourné , Jean Feydy , François-Xavier Vialard , Alain Trouvé , Gabriel Peyré

The success of autoregressive models largely depends on the effectiveness of vector quantization, a technique that discretizes continuous features by mapping them to the nearest code vectors within a learnable codebook. Two critical issues…

Computer Vision and Pattern Recognition · Computer Science 2025-06-19 Xianghong Fang , Litao Guo , Hengchao Chen , Yuxuan Zhang , XiaofanXia , Dingjie Song , Yexin Liu , Hao Wang , Harry Yang , Yuan Yuan , Qiang Sun

The escalating complexity of urban transportation systems, exacerbated by factors such as traffic congestion, diverse transportation modalities, and shifting commuter preferences, necessitates the development of more sophisticated…

Quantum Physics · Physics 2025-01-24 Nouhaila Innan , Bikash K. Behera , Saif Al-Kuwari , Ahmed Farouk

Embedding vectors are widely used for representing unstructured data and searching through it for semantically similar items. However, the large size of these vectors, due to their high-dimensionality, creates problems for modern vector…

Machine Learning · Computer Science 2025-09-24 Mariano Tepper , Ted Willke

Existing vector quantization (VQ) methods struggle with scalability, largely attributed to the instability of the codebook that undergoes partial updates during training. The codebook is prone to collapse as utilization decreases, due to…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Fengyuan Shi , Zhuoyan Luo , Yixiao Ge , Yujiu Yang , Ying Shan , Limin Wang

Vector quantization(VQ) is a lossy data compression technique from signal processing for which simple competitive learning is one standard method to quantize patterns from the input space. Extending competitive learning VQ to the domain of…

Computer Vision and Pattern Recognition · Computer Science 2010-01-07 Brijnesh J. Jain , Klaus Obermayer

In 2013, Cuturi [Cut13] introduced the Sinkhorn algorithm for matrix scaling as a method to compute solutions to regularized optimal transport problems. In this paper, aiming at a better convergence rate for a high accuracy solution, we…

Data Structures and Algorithms · Computer Science 2023-04-06 Jingbang Chen , Li Chen , Yang P. Liu , Richard Peng , Arvind Ramaswami

We study the fundamental computational problem of approximating optimal transport (OT) equations using neural differential equations (Neural ODEs). More specifically, we develop a novel framework for approximating unbalanced optimal…

Numerical Analysis · Mathematics 2026-05-21 Minh-Nhat Phung , Minh-Binh Tran

The current best practice for computing optimal transport (OT) is via entropy regularization and Sinkhorn iterations. This algorithm runs in quadratic time as it requires the full pairwise cost matrix, which is prohibitively expensive for…

Machine Learning · Computer Science 2022-04-06 Johannes Gasteiger , Marten Lienen , Stephan Günnemann

In [Q. Liao et al., Commun. Math. Sci., 20(2022)], a linear-time Sinkhorn algorithm is developed based on dynamic programming, which significantly reduces the computational complexity involved in solving optimal transport problems. However,…

Optimization and Control · Mathematics 2025-03-25 Ziyuan Lyu , Zihao Wang , Hao Wu , Shuai Yang

Vector quantization (VQ) is a key technique in high-resolution and high-fidelity image synthesis, which aims to learn a codebook to encode an image with a sequence of discrete codes and then generate an image in an auto-regression manner.…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Guotao Liang , Baoquan Zhang , Yaowei Wang , Xutao Li , Yunming Ye , Huaibin Wang , Chuyao Luo , Kola Ye , linfeng Luo

In theory, vector quantization (VQ) is always better than scalar quantization (SQ) in terms of rate-distortion (R-D) performance. Recent state-of-the-art methods for neural image compression are mainly based on nonlinear transform coding…

Computer Vision and Pattern Recognition · Computer Science 2023-05-26 Runsen Feng , Zongyu Guo , Weiping Li , Zhibo Chen