English
Related papers

Related papers: Neural Estimation for Scaling Entropic Multimargin…

200 papers

We study the problem of estimating latent population flows from aggregated count data. This problem arises when individual trajectories are not available due to privacy issues or measurement fidelity. Instead, the aggregated observations…

Machine Learning · Computer Science 2023-01-02 Sikun Yang , Hongyuan Zha

Optimal transport (OT) theory provides powerful tools to compare probability measures. However, OT is limited to nonnegative measures having the same mass, and suffers serious drawbacks about its computation and statistics. This leads to…

Machine Learning · Statistics 2021-01-26 Tam Le , Truyen Nguyen

Sampling-based model predictive control methods like MPPI and CEM are essential for real-time control of nonlinear robotic systems, particularly where discontinuous dynamics preclude gradient-based optimization. However, these methods…

Robotics · Computer Science 2026-05-05 Vincent Pacelli , Akash Ratheesh , Evangelos A. Theodorou

This paper proposes a Multimarginal Optimal Transport ($MOT$) approach for simultaneously comparing $k\geq 2$ measures supported on finite subsets of $\mathbb{R}^d$, $d \geq 1$. We derive asymptotic distributions of the optimal value of the…

Statistics Theory · Mathematics 2025-09-04 Natalia Kravtsova

Adding entropic regularization to Optimal Transport (OT) problems has become a standard approach for designing efficient and scalable solvers. However, regularization introduces a bias from the true solution. To mitigate this bias while…

Optimal transport (OT) plays an essential role in various areas like machine learning and deep learning. However, computing discrete optimal transport plan for large scale problems with adequate accuracy and efficiency is still highly…

Machine Learning · Computer Science 2021-07-20 Dongsheng An , Na Lei , Xianfeng Gu

Few-Shot Remote Sensing Scene Classification (FS-RSSC) presents the challenge of classifying remote sensing images with limited labeled samples. Existing methods typically emphasize single-modal feature learning, neglecting the potential…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Zhong Ji , Ci Liu , Jingren Liu , Chen Tang , Yanwei Pang , Xuelong Li

Multi-task optimization is a powerful approach for solving a large number of tasks in parallel. However, existing algorithms face distinct limitations: Population-based methods scale poorly and remain underexplored for large task sets.…

Machine Learning · Computer Science 2026-04-27 Julian Hatzky , Thomas Bartz-Beielstein , A. E. Eiben , Anil Yaman

Multi-vehicle trajectory planning (MVTP) is one of the key challenges in multi-robot systems (MRSs) and has broad applications across various fields. This paper presents ESCoT, an enhanced step-based coordinate trajectory planning method…

Robotics · Computer Science 2025-08-14 Junkai Jiang , Yihe Chen , Yibin Yang , Ruochen Li , Shaobing Xu , Jianqiang Wang

Computing the optimal transport distance between statistical distributions is a fundamental task in machine learning. One remarkable recent advancement is entropic regularization and the Sinkhorn algorithm, which utilizes only matrix…

Optimization and Control · Mathematics 2024-01-24 Xun Tang , Michael Shavlovsky , Holakou Rahmanian , Elisa Tardini , Kiran Koshy Thekumparampil , Tesi Xiao , Lexing Ying

Neural machine translation (NMT) models are typically trained with fixed-size input and output vocabularies, which creates an important bottleneck on their accuracy and generalization capability. As a solution, various studies proposed…

Computation and Language · Computer Science 2018-05-08 Duygu Ataman , Marcello Federico

Reduced order models (ROMs) are widely used in scientific computing to tackle high-dimensional systems. However, traditional ROM methods may only partially capture the intrinsic geometric characteristics of the data. These characteristics…

Numerical Analysis · Mathematics 2025-01-13 Moaad Khamlich , Federico Pichi , Gianluigi Rozza

Kernel-based optimal transport (OT) estimators offer an alternative, functional estimation procedure to address OT problems from samples. Recent works suggest that these estimators are more statistically efficient than plug-in (linear…

Machine Learning · Computer Science 2024-02-01 Tianyi Lin , Marco Cuturi , Michael I. Jordan

Most first-order optimizers treat matrix-valued parameters as vectors, ignoring the intrinsic geometry of hidden-layer weights in neural networks. Muon addresses this mismatch by updating along the polar factor of a momentum matrix, but its…

Optimization and Control · Mathematics 2026-05-11 Sayantan Choudhury , Xiaoran Cheng , Martin Takáč , Sen Na , Mladen Kolar

We propose a discrete time formulation of the semi-martingale optimal transport problem based on multi-marginal entropic transport. This approach offers a new way to formulate and solve numerically the calibration problem proposed by [17],…

Optimization and Control · Mathematics 2024-12-03 Jean-David Benamou , Guillaume Chazareix , Grégoire Loeper

Regularized optimal transport (OT) is now increasingly used as a loss or as a matching layer in neural networks. Entropy-regularized OT can be computed using the Sinkhorn algorithm but it leads to fully-dense transportation plans, meaning…

Machine Learning · Statistics 2023-04-17 Tianlin Liu , Joan Puigcerver , Mathieu Blondel

The real-world application of small drones is mostly hampered by energy limitations. Neuromorphic computing promises extremely energy-efficient AI for autonomous flight but is still challenging to train and deploy on real robots. To reap…

Robotics · Computer Science 2025-03-24 Stein Stroobants , Christophe de Wagter , Guido C. H. E. De Croon

Inverse optimal transport (OT) refers to the problem of learning the cost function for OT from observed transport plan or its samples. In this paper, we derive an unconstrained convex optimization formulation of the inverse OT problem,…

Machine Learning · Computer Science 2021-07-06 Shaojun Ma , Haodong Sun , Xiaojing Ye , Hongyuan Zha , Haomin Zhou

Although vital to computer vision systems, few-shot action recognition is still not mature despite the wide research of few-shot image classification. Popular few-shot learning algorithms extract a transferable embedding from seen classes…

Computer Vision and Pattern Recognition · Computer Science 2021-04-09 Su Lu , Han-Jia Ye , De-Chuan Zhan

We present a novel procedure for optimization based on the combination of efficient quantized tensor train representation and a generalized maximum matrix volume principle. We demonstrate the applicability of the new Tensor Train Optimizer…

Machine Learning · Computer Science 2022-09-29 Konstantin Sozykin , Andrei Chertkov , Roman Schutski , Anh-Huy Phan , Andrzej Cichocki , Ivan Oseledets