中文
相关论文

相关论文: Logarithmic divergences: geometry and interpretati…

200 篇论文

Divergences, also known as contrast functions, are distance-like quantities defined on manifolds of non-negative or probability measures. Using the duality in optimal transport, we introduce and study the one-parameter family of $L^{(\pm…

概率论 · 数学 2018-09-05 Ting-Kam Leonard Wong

The logarithmic divergence is an extension of the Bregman divergence motivated by optimal transport and a generalized convex duality, and satisfies many remarkable properties. Using the geometry induced by the logarithmic divergence, we…

最优化与控制 · 数学 2022-09-08 Amanjit Singh Kainth , Ting-Kam Leonard Wong , Frank Rudzicz

In information geometry, generalized exponential families and statistical manifolds with curvature are under active investigation in recent years. In this paper we consider the statistical manifold induced by a logarithmic…

微分几何 · 数学 2021-05-18 Zhixu Tao , Ting-Kam Leonard Wong

A function is exponentially concave if its exponential is concave. We consider exponentially concave functions on the unit simplex. In a previous paper we showed that gradient maps of exponentially concave functions provide solutions to a…

概率论 · 数学 2017-06-01 Soumik Pal , Ting-Kam Leonard Wong

Optimal transport and information geometry both study geometric structures on spaces of probability distributions. Optimal transport characterizes the cost-minimizing movement from one distribution to another, while information geometry…

微分几何 · 数学 2021-05-07 Ting-Kam Leonard Wong , Jiaowen Yang

Many problems in machine learning can be formulated as optimizing a convex functional over a vector space of measures. This paper studies the convergence of the mirror descent algorithm in this infinite-dimensional setting. Defining Bregman…

最优化与控制 · 数学 2022-10-12 Pierre-Cyril Aubin-Frankowski , Anna Korba , Flavien Léger

The Bregman-Wasserstein divergence is the optimal transport cost when the underlying cost function is given by a Bregman divergence, and arises naturally in fields such as statistics and machine learning. We establish fundamental properties…

概率论 · 数学 2025-04-14 Amanjit Singh Kainth , Cale Rankin , Ting-Kam Leonard Wong

An optimal transport problem on finite spaces is a linear program. Recently, a relaxation of the optimal transport problem via strictly convex functions, especially via the Kullback--Leibler divergence, sheds new light on data sciences.…

最优化与控制 · 数学 2021-03-03 Asuka Takatsu

The asymmetric skew divergence smooths one of the distributions by mixing it, to a degree determined by the parameter $\lambda$, with the other distribution. Such divergence is an approximation of the KL divergence that does not require the…

信息论 · 计算机科学 2021-04-27 Masanari Kimura , Hideitsu Hino

A loss function measures the discrepancy between the true values and their estimated fits, for a given instance of data. In classification problems, a loss function is said to be proper if a minimizer of the expected loss is the true…

信息论 · 计算机科学 2020-01-03 Amichai Painsky , Gregory W. Wornell

We study Bregman divergences in probability density space embedded with the $L^2$-Wasserstein metric. Several properties and dualities of transport Bregman divergences are provided. In particular, we derive the transport Kullback-Leibler…

信息论 · 计算机科学 2025-04-08 Wuchen Li

Four problems related to information divergence measures defined on finite alphabets are considered. In three of the cases we consider, we illustrate a contrast which arises between the binary-alphabet and larger-alphabet settings. This is…

信息论 · 计算机科学 2016-11-17 Jiantao Jiao , Thomas Courtade , Albert No , Kartik Venkat , Tsachy Weissman

In this note we prove estimates for the average cost in the quadratic optimal transport problem on the two-dimensional flat torus which are optimal up to a double logarithm. We also prove sharp estimates on the displacement. This is based…

偏微分方程分析 · 数学 2023-12-14 Michael Goldman , Martin Huesmann , Felix Otto

Optimal transport is a geometrically intuitive, robust and flexible metric for sample comparison in data analysis and machine learning. Its formal Riemannian structure allows for a local linearization via a tangent space approximation. This…

最优化与控制 · 数学 2024-06-07 Clément Sarrazin , Bernhard Schmitzer

We introduce the proximal optimal transport divergence, a novel discrepancy measure that interpolates between information divergences and optimal transport distances via an infimal convolution formulation. This divergence provides a…

We analyze a variational time discretization of geodesic calculus on finite- and certain classes of infinite-dimensional Riemannian manifolds. We investigate the fundamental properties of discrete geodesics, the associated discrete…

数值分析 · 数学 2013-03-25 Martin Rumpf , Benedikt Wirth

The branched transport problem, a popular recent variant of optimal transport, is a non-convex and non-smooth variational problem on Radon measures. The so-called urban planning problem, on the contrary, is a shape optimization problem that…

最优化与控制 · 数学 2022-06-15 Julius Lohmann , Bernhard Schmitzer , Benedikt Wirth

This article details a general numerical framework to approximate so-lutions to linear programs related to optimal transport. The general idea is to introduce an entropic regularization of the initial linear program. This regularized…

数值分析 · 数学 2014-12-17 Jean-David Benamou , Guillaume Carlier , Marco Cuturi , Luca Nenna , Gabriel Peyré

Information geometry and optimal transport are two distinct geometric frameworks for modeling families of probability measures. During the recent years, there has been a surge of research endeavors that cut across these two areas and…

最优化与控制 · 数学 2022-07-01 Gabriel Khan , Jun Zhang

The purpose of this paper is twofold. On a technical side, we propose an extension of the Hausdorff distance from metric spaces to spaces equipped with asymmetric distance measures. Specifically, we focus on the family of Bregman…

机器学习 · 计算机科学 2025-04-11 Tuyen Pham , Hana Dal Poz Kouřimská , Hubert Wagner
‹ 上一页 1 2 3 10 下一页 ›