English
Related papers

Related papers: Hierarchical Optimal Transport for Document Repres…

200 papers

A topic model is often formulated as a generative model that explains how each word of a document is generated given a set of topics and document-specific topic proportions. It is focused on capturing the word co-occurrences in a document…

Machine Learning · Computer Science 2022-03-16 Dongsheng Wang , Dandan Guo , He Zhao , Huangjie Zheng , Korawat Tanwisuth , Bo Chen , Mingyuan Zhou

Optimal Transport has recently gained interest in machine learning for applications ranging from domain adaptation, sentence similarities to deep learning. Yet, its ability to capture frequently occurring structure beyond the "ground…

Machine Learning · Statistics 2017-12-19 David Alvarez-Melis , Tommi S. Jaakkola , Stefanie Jegelka

Top-K queries are an established heuristic in information retrieval. This paper presents an approach for optimal tiered storage allocation under stream processing workloads using this heuristic: those requiring the analysis of only the…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-03-13 Ben Blamey , Fredrik Wrede , Johan Karlsson , Andreas Hellander , Salman Toor

The number of documents available into Internet moves each day up. For this reason, processing this amount of information effectively and expressibly becomes a major concern for companies and scientists. Methods that represent a textual…

Information Retrieval · Computer Science 2017-03-21 Mohamed Morchid , Juan-Manuel Torres-Moreno , Richard Dufour , Javier Ramírez-Rodríguez , Georges Linarès

We present a novel neural-networks-based algorithm to compute optimal transport maps and plans for strong and weak transport costs. To justify the usage of neural networks, we prove that they are universal approximators of transport plans…

Machine Learning · Computer Science 2023-03-02 Alexander Korotin , Daniil Selikhanovych , Evgeny Burnaev

We compare several approaches to learn an Optimal Map, represented as a neural network, between probability distributions. The approaches fall into two categories: ``Heuristics'' and approaches with a more sound mathematical justification,…

Machine Learning · Computer Science 2019-08-06 Andrea Schioppa

The graph parameters highway dimension and skeleton dimension were introduced to capture the properties of transportation networks. As many important optimization problems like Travelling Salesperson, Steiner Tree or $k$-Center arise in…

Discrete Mathematics · Computer Science 2019-11-20 Johannes Blum

Optimal transport aligns samples across distributions by minimizing the transportation cost between them, e.g., the geometric distances. Yet, it ignores coherence structure in the data such as clusters, does not handle outliers well, and…

Machine Learning · Computer Science 2023-05-31 Ching-Yao Chuang , Stefanie Jegelka , David Alvarez-Melis

Machine learning (ML) techniques have recently enabled enormous gains in sensitivity to new phenomena across the sciences. In particle physics, much of this progress has relied on excellent simulations of a wide range of physical processes.…

Data Analysis, Statistics and Probability · Physics 2025-10-20 Malte Algren , Tobias Golling , Francesco Armando Di Bello , Christopher Pollard

This work is about the use of regularized optimal-transport distances for convex, histogram-based image segmentation. In the considered framework, fixed exemplar histograms define a prior on the statistical features of the two regions in…

Computer Vision and Pattern Recognition · Computer Science 2015-03-17 Julien Rabin , Nicolas Papadakis

Measuring similarity between texts is an important task for several applications. Available approaches to measure document similarity are inadequate for document pairs that have non-comparable lengths, such as a long document and its…

Computation and Language · Computer Science 2019-03-27 Hongyu Gong , Tarek Sakakini , Suma Bhat , Jinjun Xiong

To remedy the drawbacks of full-mass or fixed-mass constraints in classical optimal transport, we propose adaptive optimal transport which is distinctive from the classical optimal transport in its ability of adaptive-mass preserving. It…

Machine Learning · Computer Science 2025-03-10 Pei Yang , Qi Tan , Guihua Wen

Hypergraphs capture multi-way relationships in data, and they have consequently seen a number of applications in higher-order network analysis, computer vision, geometry processing, and machine learning. In this paper, we develop…

Metric Geometry · Mathematics 2023-02-06 Samir Chowdhury , Tom Needham , Ethan Semrad , Bei Wang , Youjia Zhou

This article presents a general approximation-theoretic framework to analyze measure transport algorithms for probabilistic modeling. A primary motivating application for such algorithms is sampling -- a central task in statistical…

Numerical Analysis · Mathematics 2024-09-19 Ricardo Baptista , Bamdad Hosseini , Nikola B. Kovachki , Youssef M. Marzouk , Amir Sagiv

We investigate the problem of efficiently computing optimal transport (OT) distances, which is equivalent to the node-capacitated minimum cost maximum flow problem in a bipartite graph. We compare runtimes in computing OT distances on data…

Data Structures and Algorithms · Computer Science 2020-07-07 Yihe Dong , Yu Gao , Richard Peng , Ilya Razenshteyn , Saurabh Sawlani

We develop the relational topic model (RTM), a hierarchical model of both network structure and node attributes. We focus on document networks, where the attributes of each document are its words, that is, discrete observations taken from a…

Applications · Statistics 2010-10-07 Jonathan Chang , David M. Blei

The optimal transport problem has many applications in machine learning, physics, biology, economics, etc. Although its goal is very clear and mathematically well-defined, finding its optimal solution can be challenging for large datasets…

Numerical Analysis · Mathematics 2021-12-14 Roozbeh Yousefzadeh

Optimal Transport is a popular distance metric for measuring similarity between distributions. Exact algorithms for computing Optimal Transport can be slow, which has motivated the development of approximate numerical solvers (e.g. Sinkhorn…

Machine Learning · Computer Science 2022-03-09 Nathaniel Lahn , Sharath Raghvendra , Kaiyi Zhang

We describe a new method for summarizing similarities and differences in a pair of related documents using a graph representation for text. Concepts denoted by words, phrases, and proper names in the document are represented positionally as…

cmp-lg · Computer Science 2007-05-23 Inderjeet Mani , Eric Bloedorn

While the celebrated Word2Vec technique yields semantically rich representations for individual words, there has been relatively less success in extending to generate unsupervised sentences or documents embeddings. Recent work has…

Computation and Language · Computer Science 2018-11-06 Lingfei Wu , Ian E. H. Yen , Kun Xu , Fangli Xu , Avinash Balakrishnan , Pin-Yu Chen , Pradeep Ravikumar , Michael J. Witbrock