English
Related papers

Related papers: Inverse Entropic Optimal Transport Solves Semi-sup…

200 papers

The goal of this paper is to introduce a new theoretical framework for Optimal Transport (OT), using the terminology and techniques of Fully Probabilistic Design (FPD). Optimal Transport is the canonical method for comparing probability…

Artificial Intelligence · Computer Science 2022-12-29 Sarah Boufelja Y. , Anthony Quinn , Martin Corless , Robert Shorten

In recent years, two prominent paradigms have shaped distributionally robust optimization (DRO), modeling distributional ambiguity through $\phi$-divergences and Wasserstein distances, respectively. While the former focuses on ambiguity in…

Optimization and Control · Mathematics 2025-12-22 Jose Blanchet , Daniel Kuhn , Jiajin Li , Bahar Taskesen

Computing optimal transport (OT) for general high-dimensional data has been a long-standing challenge. Despite much progress, most of the efforts including neural network methods have been focused on the static formulation of the OT…

Machine Learning · Statistics 2025-03-12 Chen Xu , Xiuyuan Cheng , Yao Xie

Multimarginal optimal transport (MOT) is a powerful framework for modeling interactions between multiple distributions, yet its applicability is bottlenecked by a high computational overhead. Entropic regularization provides computational…

Machine Learning · Computer Science 2025-06-03 Dor Tsur , Ziv Goldfeld , Kristjan Greenewald , Haim Permuter

The aim of this paper is to provide several novel upper bounds on the excess risk with a primal focus on classification problems. We suggest two approaches and the obtained bounds are represented via the distribution dependent local…

Statistics Theory · Mathematics 2018-03-13 Nikita Zhivotovskiy

Estimating the reachable set of a dynamical system is a fundamental problem in control theory, particularly when control inputs are bounded. Direct simulation using randomly sampled admissible controls often leads to trajectories that…

Optimization and Control · Mathematics 2025-11-20 Karthik Elamvazhuthi , Sachin Shivakumar

The Self-Optimal-Transport (SOT) feature transform is designed to upgrade the set of features of a data instance to facilitate downstream matching or grouping related tasks. The transformed set encodes a rich representation of high order…

Computer Vision and Pattern Recognition · Computer Science 2022-04-08 Daniel Shalam , Simon Korman

Cross-domain alignment between image objects and text sequences is key to many visual-language tasks, and it poses a fundamental challenge to both computer vision and natural language processing. This paper investigates a novel approach for…

Computer Vision and Pattern Recognition · Computer Science 2020-08-18 Siyang Yuan , Ke Bai , Liqun Chen , Yizhe Zhang , Chenyang Tao , Chunyuan Li , Guoyin Wang , Ricardo Henao , Lawrence Carin

It is often desired that ordinal regression models yield unimodal predictions. However, in many recent works this characteristic is either absent, or implemented using soft targets, which do not guarantee unimodal outputs at inference. In…

Machine Learning · Statistics 2021-11-19 Uri Shaham , Igal Zaidman , Jonathan Svirsky

Learning to align multiple datasets is an important problem with many applications, and it is especially useful when we need to integrate multiple experiments or correct for confounding. Optimal transport (OT) is a principled approach to…

Machine Learning · Computer Science 2021-08-03 Ruishan Liu , Akshay Balsubramani , James Zou

Optimal Transport (OT) has fueled machine learning (ML) across many domains. When paired data measurements $(\boldsymbol{\mu}, \boldsymbol{\nu})$ are coupled to covariates, a challenging conditional distribution learning setting arises.…

We study the use of amortized optimization to predict optimal transport (OT) maps from the input measures, which we call Meta OT. This helps repeatedly solve similar OT problems between different measures by leveraging the knowledge and…

Machine Learning · Computer Science 2023-06-06 Brandon Amos , Samuel Cohen , Giulia Luise , Ievgen Redko

Optimal transport (OT) aims to find a map $T$ that transports mass from one probability measure to another while minimizing a cost function. Recently, neural OT solvers have gained popularity in high dimensional biological applications such…

Machine Learning · Computer Science 2025-05-20 Peter Chen , Yue Xie , Qingpeng Zhang

Cross-lingual semantic parsing transfers parsing capability from a high-resource language (e.g., English) to low-resource languages with scarce training data. Previous work has primarily considered silver-standard data augmentation or…

Computation and Language · Computer Science 2023-07-11 Tom Sherborne , Tom Hosking , Mirella Lapata

Offline reinforcement learning aims to learn from pre-collected datasets without active exploration. This problem faces significant challenges, including limited data availability and distributional shifts. Existing approaches adopt a…

Machine Learning · Computer Science 2024-10-01 Yue Wang , Jinjun Xiong , Shaofeng Zou

Conformal prediction (CP) constructs uncertainty sets for model outputs with finite-sample coverage guarantees. A candidate output is included in the prediction set if its non-conformity score is not considered extreme relative to the…

Machine Learning · Statistics 2025-11-20 Eugene Ndiaye

Model-free deep-reinforcement-based learning algorithms have been applied to a range of COPs~\cite{bello2016neural}~\cite{kool2018attention}~\cite{nazari2018reinforcement}. However, these approaches suffer from two key challenges when…

Machine Learning · Computer Science 2022-06-01 Nasrin Sultana , Jeffrey Chan , Tabinda Sarwar , A. K. Qin

Cross-lingual transfer of word embeddings aims to establish the semantic mappings among words in different languages by learning the transformation functions over the corresponding word embedding spaces. Successfully solving this problem…

Computation and Language · Computer Science 2018-09-12 Ruochen Xu , Yiming Yang , Naoki Otani , Yuexin Wu

Regularized optimal transport (OT) is now increasingly used as a loss or as a matching layer in neural networks. Entropy-regularized OT can be computed using the Sinkhorn algorithm but it leads to fully-dense transportation plans, meaning…

Machine Learning · Statistics 2023-04-17 Tianlin Liu , Joan Puigcerver , Mathieu Blondel

Mini-batch optimal transport (m-OT) has been successfully used in practical applications that involve probability measures with a very high number of supports. The m-OT solves several smaller optimal transport problems and then returns the…

Machine Learning · Statistics 2022-06-08 Khai Nguyen , Dang Nguyen , Quoc Nguyen , Tung Pham , Hung Bui , Dinh Phung , Trung Le , Nhat Ho