English
Related papers

Related papers: Distributional Preference Alignment of LLMs via Op…

200 papers

Optimal transport (OT) is a powerful geometric tool used to compare and align probability measures following the least effort principle. Despite its widespread use in machine learning (ML), OT problem still bears its computational burden,…

Machine Learning · Computer Science 2023-08-14 Oliver Struckmeier , Ievgen Redko , Anton Mallasto , Karol Arndt , Markus Heinonen , Ville Kyrki

Optimal Transport (OT) problem aims to find a transport plan that bridges two distributions while minimizing a given cost function. OT theory has been widely utilized in generative modeling. In the beginning, OT distance has been used as a…

Machine Learning · Computer Science 2024-03-08 Jaemoo Choi , Jaewoong Choi , Myungjoo Kang

Optimal transport on a graph focuses on finding the most efficient way to transfer resources from one distribution to another while considering the graph's structure. This paper introduces a new distributed algorithm that solves the optimal…

Optimization and Control · Mathematics 2025-07-08 Yacine Mokhtari , Emmanuel Moulay , Patrick Coirault , Jérôme Le Ny

Optimal transport (OT) is a widely used technique in machine learning, graphics, and vision that aligns two distributions or datasets using their relative geometry. In symmetry-rich settings, however, OT alignments based solely on pairwise…

Machine Learning · Computer Science 2025-09-26 Annabel Ma , Kaiying Hou , David Alvarez-Melis , Melanie Weber

Optimal Transport (OT) has established itself as a robust framework for quantifying differences between distributions, with applications that span fields such as machine learning, data science, and computer vision. This paper offers a…

Data Structures and Algorithms · Computer Science 2025-01-14 Sina Moradi

Despite the success of contrastive learning (CL) in vision and language, its theoretical foundations and mechanisms for building representations remain poorly understood. In this work, we build connections between noise contrastive…

Machine Learning · Computer Science 2025-02-28 Zihao Chen , Chi-Heng Lin , Ran Liu , Jingyun Xiao , Eva L Dyer

Text-to-image generation models have achieved remarkable progress in preference optimization, yet achieving robust alignment across diverse reward models remains a significant challenge. Existing multi-reward fusion approaches rely on…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Ying Ba , Tianyu Zhang , Mohan Zhou , Yalong Bai , Wenyi Mo , Guiwei Zhang , Bing Su , Ji-Rong Wen

Optimal transport (OT) provides effective tools for comparing and mapping probability measures. We propose to leverage the flexibility of neural networks to learn an approximate optimal transport map. More precisely, we present a new and…

Machine Learning · Computer Science 2022-07-06 Florentin Coeurdoux , Nicolas Dobigeon , Pierre Chainais

Given samples from two joint distributions, we consider the problem of Optimal Transportation (OT) between them when conditioned on a common variable. We focus on the general setting where the conditioned variable may be continuous, and the…

Machine Learning · Computer Science 2024-06-12 Piyushi Manupriya , Rachit Keerti Das , Sayantan Biswas , Saketha Nath Jagarlapudi

We study the estimation of optimal transport (OT) maps between an arbitrary source probability measure and a log-concave target probability measure. Our contributions are twofold. First, we propose a new evolution equation in the set of…

Optimization and Control · Mathematics 2026-04-13 Théo Dumont , Théo Lacombe , François-Xavier Vialard

With the advent of large datasets, offline reinforcement learning (RL) is a promising framework for learning good decision-making policies without the need to interact with the real environment. However, offline RL requires the dataset to…

Machine Learning · Computer Science 2023-03-27 Yicheng Luo , Zhengyao Jiang , Samuel Cohen , Edward Grefenstette , Marc Peter Deisenroth

The Optimal transport (OT) problem is rapidly finding its way into machine learning. Favoring its use are its metric properties. Many problems admit solutions with guarantees only for objects embedded in metric spaces, and the use of…

Machine Learning · Computer Science 2022-12-26 Liang Mi , Azadeh Sheikholeslami , José Bento

Dynamical formulations of optimal transport (OT) frame the task of comparing distributions as a variational problem which searches for a path between distributions minimizing a kinetic energy functional. In applications, it is frequently…

Optimization and Control · Mathematics 2025-12-11 Martin Bauer , Nicolas Charon , Tom Needham , Mao Nishino

Optimal transport (OT) is attracting increasing attention in machine learning. It aims to transport a source distribution to a target one at minimal cost. In its vanilla form, the source and target distributions are predetermined, which…

Machine Learning · Computer Science 2024-01-23 Liangliang Shi , Zhaoqi Shen , Junchi Yan

Optimal transport (OT) is a framework that can guide the design of efficient resource allocation strategies in a network of multiple sources and targets. To ease the computational complexity of large-scale transport design, we first develop…

Social and Information Networks · Computer Science 2022-12-01 Jason Hughes , Juntao Chen

In this paper, we focus on an asynchronous distributed optimization problem. In our problem, each node is endowed with a convex local cost function, and is able to communicate with its neighbors over a directed communication network.…

Optimization and Control · Mathematics 2023-09-12 Apostolos I. Rikos , Wei Jiang , Themistoklis Charalambous , Karl H. Johansson

In the dynamic and uncertain environments where reinforcement learning (RL) operates, risk management becomes a crucial factor in ensuring reliable decision-making. Traditional RL approaches, while effective in reward optimization, often…

Machine Learning · Computer Science 2023-09-13 Ali Baheri

Optimal Transport, a theory for optimal allocation of resources, is widely used in various fields such as astrophysics, machine learning, and imaging science. However, many applications impose elementwise constraints on the transport plan…

Optimization and Control · Mathematics 2022-06-28 Zixuan Cang , Qing Nie , Yanxiang Zhao

We present a stochastic setting for optimization problems with nonsmooth convex separable objective functions over linear equality constraints. To solve such problems, we propose a stochastic Alternating Direction Method of Multipliers…

Machine Learning · Computer Science 2013-01-23 Hua Ouyang , Niao He , Alexander Gray

Ensuring AI models align with human values is essential for their safety and functionality. Reinforcement learning from human feedback (RLHF) leverages human preferences to achieve this alignment. However, when preferences are sourced from…

Machine Learning · Computer Science 2025-02-10 Ryan Bahlous-Boldi , Li Ding , Lee Spector , Scott Niekum