English
Related papers

Related papers: Optimal Transport-inspired Deep Learning Framework…

200 papers

We study Benamou's domain decomposition algorithm for optimal transport in the entropy regularized setting. The key observation is that the regularized variant converges to the globally optimal solution under very mild assumptions. We prove…

Optimization and Control · Mathematics 2021-11-23 Mauro Bonafini , Bernhard Schmitzer

In the reduced order modeling (ROM) framework, the solution of a parametric partial differential equation is approximated by combining the high-fidelity solutions of the problem at hand for several properly chosen configurations. Examples…

Numerical Analysis · Mathematics 2019-05-16 Nicola Demo , Marco Tezzele , Andrea Mola , Gianluigi Rozza

To speed-up the solution to parametrized differential problems, reduced order models (ROMs) have been developed over the years, including projection-based ROMs such as the reduced-basis (RB) method, deep learning-based ROMs, as well as…

Numerical Analysis · Mathematics 2022-02-08 Ludovica Cicci , Stefania Fresca , Andrea Manzoni

Although deep neural networks are well-known for their outstanding performance in tackling complex tasks, their hunger for computational resources remains a significant hurdle, posing energy-consumption issues and restricting their…

Machine Learning · Computer Science 2025-07-16 Victor Quétu , Zhu Liao , Nour Hezbri , Fabio Pizzati , Enzo Tartaglione

Optimal transport (OT) has recently found widespread interest in machine learning. It allows to define novel distances between probability measures, which have shown promise in several applications. In this work, we discuss how to…

Machine Learning · Computer Science 2021-10-11 Bamdev Mishra , N T V Satyadev , Hiroyuki Kasai , Pratik Jawanpuria

In this paper, we propose a new framework named Communication Optimal Transport (CommOT) for computing the rate distortion (RD) function. This work is motivated by observing the fact that the transition law and the relative entropy in…

Information Theory · Computer Science 2022-12-21 Shitong Wu , Wenhao Ye , Hao Wu , Huihui Wu , Wenyi Zhang , Bo Bai

We introduce a new class of convex-regularized Optimal Transport losses, which generalizes the classical Entropy-regularization of Optimal Transport and Sinkhorn divergences, and propose a generalized Sinkhorn algorithm. Our framework…

Optimization and Control · Mathematics 2020-07-03 Simone Di Marino , Augusto Gerolin

We propose a learning framework for graph kernels, which is theoretically grounded on regularizing optimal transport. This framework provides a novel optimal transport distance metric, namely Regularized Wasserstein (RW) discrepancy, which…

Machine Learning · Computer Science 2021-10-11 Asiri Wijesinghe , Qing Wang , Stephen Gould

This paper presents a nonlinear reduced-order modeling (ROM) framework that leverages deep learning and manifold learning to predict compressible flow fields with complex nonlinear features, including shock waves. The proposed DeepManifold…

Fluid Dynamics · Physics 2024-12-17 Bilal Mufti , Christian Perron , Dimitri N. Mavris

This paper studies the Partial Optimal Transport (POT) problem between two unbalanced measures with at most $n$ supports and its applications in various AI tasks such as color transfer or domain adaptation. There is hence the need for fast…

Machine Learning · Computer Science 2023-12-25 Anh Duc Nguyen , Tuan Dung Nguyen , Quang Minh Nguyen , Hoang H. Nguyen , Lam M. Nguyen , Kim-Chuan Toh

In this work, we develop reduced order models (ROMs) to predict solutions to a multiscale kinetic transport equation with a diffusion limit under the parametric setting. When the underlying scattering effect is not sufficiently strong, the…

Numerical Analysis · Mathematics 2025-05-14 Tianyu Jin , Zhichao Peng , Yang Xiang

We develop a fast and reliable method for solving large-scale optimal transport (OT) problems at an unprecedented combination of speed and accuracy. Built on the celebrated Douglas-Rachford splitting technique, our method tackles the…

Optimization and Control · Mathematics 2021-10-25 Vien V. Mai , Jacob Lindbäck , Mikael Johansson

This article presents a reduced-order modeling methodology via deep convolutional neural networks (CNNs) for shape optimization applications. The CNN provides a nonlinear mapping between the shapes and their associated attributes while…

Optimization and Control · Mathematics 2022-02-16 Wrik Mallik , Neil Farvolden , Jasmin Jelovica , Rajeev K. Jaiman

Optimal Transport (OT) has recently emerged as a powerful framework for learning minimal-displacement maps between distributions. The predominant approach involves a neural parametrization of the Monge formulation of OT, typically assuming…

Machine Learning · Computer Science 2024-07-23 Athina Sotiropoulou , David Alvarez-Melis

Sinkhorn algorithm is the de-facto standard approximation algorithm for optimal transport, which has been applied to a variety of applications, including image processing and natural language processing. In theory, the proof of its…

Data Structures and Algorithms · Computer Science 2025-01-14 Kazuki Watanabe , Noboru Isobe

POD-DL-ROMs have been recently proposed as an extremely versatile strategy to build accurate and reliable reduced order models (ROMs) for nonlinear parametrized partial differential equations, combining (i) a preliminary dimensionality…

Numerical Analysis · Mathematics 2023-05-09 Simone Brivio , Stefania Fresca , Nicola Rares Franco , Andrea Manzoni

We investigate the problem of efficiently computing optimal transport (OT) distances, which is equivalent to the node-capacitated minimum cost maximum flow problem in a bipartite graph. We compare runtimes in computing OT distances on data…

Data Structures and Algorithms · Computer Science 2020-07-07 Yihe Dong , Yu Gao , Richard Peng , Ilya Razenshteyn , Saurabh Sawlani

Traditional linear subspace reduced order models (LS-ROMs) are able to accelerate physical simulations, in which the intrinsic solution space falls into a subspace with a small dimension, i.e., the solution space has a small Kolmogorov…

Numerical Analysis · Mathematics 2025-11-06 Youngkyu Kim , Youngsoo Choi , David Widemann , Tarek Zohdi

Optimal Transport (OT) has established itself as a robust framework for quantifying differences between distributions, with applications that span fields such as machine learning, data science, and computer vision. This paper offers a…

Data Structures and Algorithms · Computer Science 2025-01-14 Sina Moradi

In [Q. Liao et al., Commun. Math. Sci., 20(2022)], a linear-time Sinkhorn algorithm is developed based on dynamic programming, which significantly reduces the computational complexity involved in solving optimal transport problems. However,…

Optimization and Control · Mathematics 2025-03-25 Ziyuan Lyu , Zihao Wang , Hao Wu , Shuai Yang