中文
相关论文

相关论文: Energy-guided Entropic Neural Optimal Transport

200 篇论文

Adapted optimal transport (AOT) problems are optimal transport problems for distributions of a time series where couplings are constrained to have a temporal causal structure. In this paper, we develop computational tools for solving AOT…

概率论 · 数学 2023-04-26 Stephan Eckstein , Gudmund Pammer

Energy-based models (EBMs) offer a flexible framework for parameterizing probability distributions using neural networks. However, learning EBMs by exact maximum likelihood estimation (MLE) is generally intractable, due to the need to…

机器学习 · 计算机科学 2025-08-20 Michael E. Sander , Vincent Roulet , Tianlin Liu , Mathieu Blondel

This survey has been written in occasion of the School and Workshop about Optimal Transport on Quantum Structures at Erd\"os Center in September 2022. We discuss some recent results on noncommutative entropic optimal transport problems and…

数学物理 · 物理学 2023-10-17 Lorenzo Portinale

Energy-based language models (ELMs) parameterize an unnormalized distribution for natural sentences and are radically different from popular autoregressive language models (ALMs). As an important application, ELMs have been successfully…

计算与语言 · 计算机科学 2023-05-30 Hong Liu , Zhaobiao Lv , Zhijian Ou , Wenbo Zhao , Qing Xiao

We propose novel fast algorithms for optimal transport (OT) utilizing a cyclic symmetry structure of input data. Such OT with cyclic symmetry appears universally in various real-world examples: image processing, urban planning, and graph…

机器学习 · 计算机科学 2023-11-23 Shoichiro Takeda , Yasunori Akagi , Naoki Marumo , Kenta Niwa

In many unpaired image domain translation problems, e.g., style transfer or super-resolution, it is important to keep the translated image similar to its respective input image. We propose the extremal transport (ET) which is a mathematical…

机器学习 · 计算机科学 2023-11-03 Milena Gazdieva , Alexander Korotin , Daniil Selikhanovych , Evgeny Burnaev

Optimal Transport (OT) is being widely used in various fields such as machine learning and computer vision, as it is a powerful tool for measuring the similarity between probability distributions and histograms. In previous studies, OT has…

机器学习 · 统计学 2020-06-17 Yasunori Akagi , Yusuke Tanaka , Tomoharu Iwata , Takeshi Kurashima , Hiroyuki Toda

Optimal transport (OT) based data analysis is often faced with the issue that the underlying cost function is (partially) unknown. This paper is concerned with the derivation of distributional limits for the empirical OT value when the cost…

Transport systems on networks are crucial in various applications, but face a significant risk of being adversely affected by unforeseen circumstances such as disasters. The application of entropy-regularized optimal transport (OT) on graph…

机器学习 · 计算机科学 2025-05-07 Koshi Oishi , Yota Hashizume , Tomohiko Jimbo , Hirotaka Kaji , Kenji Kashima

Neural language models are probabilistic models of human text. They are predominantly trained using maximum likelihood estimation (MLE), which is equivalent to minimizing the forward cross-entropy between the empirical data distribution and…

计算与语言 · 计算机科学 2024-02-07 Siyu Ren , Zhiyong Wu , Kenny Q. Zhu

Optimal transport distances (OT) have been widely used in recent work in Machine Learning as ways to compare probability distributions. These are costly to compute when the data lives in high dimension. Recent work by Paty et al., 2019,…

机器学习 · 计算机科学 2021-11-10 Patric M. Fulop , Vincent Danos

Optimal Transport (OT) distances such as Wasserstein have been used in several areas such as GANs and domain adaptation. OT, however, is very sensitive to outliers (samples with large noise) in the data since in its objective function,…

机器学习 · 计算机科学 2020-10-13 Yogesh Balaji , Rama Chellappa , Soheil Feizi

We study unsupervised generative modeling in terms of the optimal transport (OT) problem between true (but unknown) data distribution $P_X$ and the latent variable model distribution $P_G$. We show that the OT problem can be equivalently…

This paper studies the equitable and optimal transport (EOT) problem, which has many applications such as fair division problems and optimal transport with multiple agents etc. In the discrete distributions case, the EOT problem can be…

最优化与控制 · 数学 2021-10-04 Minhui Huang , Shiqian Ma , Lifeng Lai

In recent times, an increasing number of researchers have been devoted to utilizing deep neural networks for end-to-end flight navigation. This approach has gained traction due to its ability to bridge the gap between perception and…

机器人学 · 计算机科学 2024-10-11 Zhichao Han , Long Xu , Liuao Pei , Fei Gao

We introduce a novel neural network-based algorithm to compute optimal transport (OT) plans for general cost functionals. In contrast to common Euclidean costs, i.e., $\ell^1$ or $\ell^2$, such functionals provide more flexibility and allow…

机器学习 · 计算机科学 2024-05-31 Arip Asadulaev , Alexander Korotin , Vage Egiazarian , Petr Mokrov , Evgeny Burnaev

Optimal Transport (OT) has recently emerged as a powerful framework for learning minimal-displacement maps between distributions. The predominant approach involves a neural parametrization of the Monge formulation of OT, typically assuming…

机器学习 · 计算机科学 2024-07-23 Athina Sotiropoulou , David Alvarez-Melis

Large language models (LLMs) trained via KL-regularized reinforcement learning demonstrate strong instruction following, self-correction, and reasoning abilities. Yet their theoretical underpinnings remain limited. We exploit the…

机器学习 · 计算机科学 2025-12-23 Zhiquan Tan , Yinrong Hong

Energy-based models (EBMs) implement inference as gradient descent on a learned Lyapunov function, yielding interpretable, structure-preserving alternatives to black-box neural ODEs and aligning naturally with physical AI. Yet their use in…

系统与控制 · 电气工程与系统科学 2026-04-03 Simone Betteti , Luca Laurenti

In this paper, we propose our information-theoretic equivalence of entropic multi-marginal optimal transport (MOT). This equivalence can be easily reduced to the case of entropic optimal transport (OT). Because OT is widely used to compare…

信息论 · 计算机科学 2024-02-27 Shuchan Wang