中文
相关论文

相关论文: Scalable Nearest Neighbor Search for Optimal Trans…

200 篇论文

Fixed-radius near neighbor search is a fundamental data operation that retrieves all data points within a user-specified distance to a query point. There are efficient algorithms that can provide fast approximate query responses, but they…

信息检索 · 计算机科学 2024-01-30 Xinye Chen , Stefan Güttel

The current best practice for computing optimal transport (OT) is via entropy regularization and Sinkhorn iterations. This algorithm runs in quadratic time as it requires the full pairwise cost matrix, which is prohibitively expensive for…

机器学习 · 计算机科学 2022-04-06 Johannes Gasteiger , Marten Lienen , Stephan Günnemann

Approximate K nearest neighbor (AKNN) search is a fundamental and challenging problem. We observe that in high-dimensional space, the time consumption of nearly all AKNN algorithms is dominated by that of the distance comparison operations…

数据结构与算法 · 计算机科学 2023-03-20 Jianyang Gao , Cheng Long

Optimal transport (OT) and the related Wasserstein metric (W) are powerful and ubiquitous tools for comparing distributions. However, computing pairwise Wasserstein distances rapidly becomes intractable as cohort size grows. An attractive…

机器学习 · 计算机科学 2024-06-05 Doron Haviv , Russell Zhang Kunes , Thomas Dougherty , Cassandra Burdziak , Tal Nawy , Anna Gilbert , Dana Pe'er

Wasserstein gradient flows are continuous time dynamics that define curves of steepest descent to minimize an objective function over the space of probability measures (i.e., the Wasserstein space). This objective is typically a divergence…

最优化与控制 · 数学 2021-02-23 Adil Salim , Anna Korba , Giulia Luise

Flow Matching has recently gained attention in generative modeling as a simple and flexible alternative to diffusion models. While existing statistical guarantees adapt tools from the analysis of diffusion models, we take a different…

机器学习 · 统计学 2026-03-18 Lea Kunkel , Mathias Trabs

Uniformity testing and the more general identity testing are well studied problems in distributional property testing. Most previous work focuses on testing under $L_1$-distance. However, when the support is very large or even continuous,…

机器学习 · 计算机科学 2017-10-31 Shichuan Deng , Wenzheng Li , Xuan Wu

Wasserstein distances are metrics on probability distributions inspired by the problem of optimal mass transportation. Roughly speaking, they measure the minimal effort required to reconfigure the probability mass of one distribution in…

统计方法学 · 统计学 2019-04-10 Victor M. Panaretos , Yoav Zemel

A growing number of generative statistical models do not permit the numerical evaluation of their likelihood functions. Approximate Bayesian computation (ABC) has become a popular approach to overcome this issue, in which one simulates…

统计方法学 · 统计学 2019-05-10 Espen Bernton , Pierre E. Jacob , Mathieu Gerber , Christian P. Robert

In this work, we provide faster algorithms for approximating the optimal transport distance, e.g. earth mover's distance, between two discrete probability distributions $\mu, \nu \in \Delta^n$. Given a cost function $C : [n] \times [n] \to…

数据结构与算法 · 计算机科学 2020-01-29 Jose Blanchet , Arun Jambulapati , Carson Kent , Aaron Sidford

Consider the natural question of how to measure the similarity of curves in the plane by a quantity that is invariant under translations of the curves. Such a measure is justified whenever we aim to quantify the similarity of the curves'…

计算几何 · 计算机科学 2020-08-18 Karl Bringmann , Marvin Künnemann , André Nusser

The sliced-Wasserstein flow is an evolution equation where a probability density evolves in time, advected by a velocity field computed as the average among directions in the unit sphere of the optimal transport displacements from its 1D…

最优化与控制 · 数学 2024-05-13 Giacomo Cozzi , Filippo Santambogio

Word embeddings are high dimensional vector representations of words that capture their semantic similarity in the vector space. There exist several algorithms for learning such embeddings both for a single language as well as for several…

计算与语言 · 计算机科学 2019-11-12 Georgios Balikas , Ioannis Partalas

Collaborative learning has recently achieved very significant results. It still suffers, however, from several issues, including the type of information that needs to be exchanged, the criteria for stopping and how to choose the right…

机器学习 · 计算机科学 2021-03-29 Fatima Ezzahraa Ben Bouazza , Younès Bennani

Optimal Transport is a popular distance metric for measuring similarity between distributions. Exact algorithms for computing Optimal Transport can be slow, which has motivated the development of approximate numerical solvers (e.g. Sinkhorn…

机器学习 · 计算机科学 2022-03-09 Nathaniel Lahn , Sharath Raghvendra , Kaiyi Zhang

Approximate nearest neighbor algorithms are used to speed up nearest neighbor search in a wide array of applications. However, current indexing methods feature several hyperparameters that need to be tuned to reach an acceptable…

数据结构与算法 · 计算机科学 2019-04-25 Elias Jääsaari , Ville Hyvönen , Teemu Roos

Optimal transportation theory and the related $p$-Wasserstein distance ($W_p$, $p\geq 1$) are widely-applied in statistics and machine learning. In spite of their popularity, inference based on these tools has some issues. For instance, it…

统计理论 · 数学 2024-03-01 Yiming Ma , Hang Liu , Davide La Vecchia , Metthieu Lerasle

Most natural language processing tasks can be formulated as the approximated nearest neighbor search problem, such as word analogy, document similarity, machine translation. Take the question-answering task as an example, given a question…

人工智能 · 计算机科学 2017-08-28 Jing Wang

The challenge of approximating functions in infinite-dimensional spaces from finite samples is widely regarded as formidable. We delve into the challenging problem of the numerical approximation of Sobolev-smooth functions defined on…

最优化与控制 · 数学 2024-10-11 Massimo Fornasier , Pascal Heid , Giacomo Enrico Sodini

We consider machine learning in a comparison-based setting where we are given a set of points in a metric space, but we have no access to the actual distances between the points. Instead, we can only ask an oracle whether the distance…

机器学习 · 统计学 2017-04-06 Siavash Haghiri , Debarghya Ghoshdastidar , Ulrike von Luxburg