English
Related papers

Related papers: Differentiable Ranks and Sorting using Optimal Tra…

200 papers

Optimal transport is a powerful framework for the efficient allocation of resources between sources and targets. However, traditional models often struggle to scale effectively in the presence of large and heterogeneous populations. In this…

Artificial Intelligence · Computer Science 2024-11-13 Navpreet Kaur , Juntao Chen , Yingdong Lu

Assume that an $N$-bit sequence $S$ of $k$ numbers encoded as Elias gamma codes is given as input. We present space-efficient algorithms for sorting, dense ranking and competitive ranking on $S$ in the word RAM model with word size…

Data Structures and Algorithms · Computer Science 2024-09-04 Frank Kammer , Johannes Meintrup , Andrej Sajenko

Optimal transport (OT) has become a widely used tool in the machine learning field to measure the discrepancy between probability distributions. For instance, OT is a popular loss function that quantifies the discrepancy between an…

Machine Learning · Computer Science 2022-12-27 Shintaro Nakamura , Han Bao , Masashi Sugiyama

Sorting input objects is an important step in many machine learning pipelines. However, the sorting operator is non-differentiable with respect to its inputs, which prohibits end-to-end gradient-based optimization. In this work, we propose…

Machine Learning · Statistics 2019-04-30 Aditya Grover , Eric Wang , Aaron Zweig , Stefano Ermon

We examine sorting algorithms for $n$ elements whose basic operation is comparing $t$ elements simultaneously (a $t$-comparator). We focus on algorithms that use only a single round or two rounds -- comparisons performed in the second round…

Data Structures and Algorithms · Computer Science 2024-05-22 Ran Gelles , Zvi Lotker , Frederik Mallmann-Trenn

We explore the fundamental problem of sorting through the lens of learning-augmented algorithms, where algorithms can leverage possibly erroneous predictions to improve their efficiency. We consider two different settings: In the first…

Data Structures and Algorithms · Computer Science 2023-11-03 Xingjian Bai , Christian Coester

We study the fundamental computational problem of approximating optimal transport (OT) equations using neural differential equations (Neural ODEs). More specifically, we develop a novel framework for approximating unbalanced optimal…

Numerical Analysis · Mathematics 2026-05-21 Minh-Nhat Phung , Minh-Binh Tran

Optimal Transport (OT) has fueled machine learning (ML) across many domains. When paired data measurements $(\boldsymbol{\mu}, \boldsymbol{\nu})$ are coupled to covariates, a challenging conditional distribution learning setting arises.…

In this paper, we revisit the classic problem of run generation. Run generation is the first phase of external-memory sorting, where the objective is to scan through the data, reorder elements using a small buffer of size M , and output…

Data Structures and Algorithms · Computer Science 2015-04-27 Michael A. Bender , Samuel McCauley , Andrew McGregor , Shikha Singh , Hoa T. Vu

In temporal ordered clustering, given a single snapshot of a dynamic network in which nodes arrive at distinct time instants, we aim at partitioning its nodes into $K$ ordered clusters $\mathcal{C}_1 \prec \cdots \prec \mathcal{C}_K$ such…

Social and Information Networks · Computer Science 2020-08-10 Krzysztof Turowski , Jithin K. Sreedharan , Wojciech Szpankowski

Sorting is a fundamental algorithmic pre-processing technique which often allows to represent data more compactly and, at the same time, speeds up search queries on it. In this paper, we focus on the well-studied problem of sorting and…

Data Structures and Algorithms · Computer Science 2023-04-24 Sung-Hwan Kim , Francisco Olivares , Nicola Prezza

One of the most basic techniques in algorithm design consists of breaking a problem into subproblems and then proceeding recursively. In the case of graph algorithms, one way to implement this approach is through separator sets. Given a…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-03-13 Benjamin Jauregui , Pedro Montealegre , Ivan Rapaport

LearnedSort is a novel sorting algorithm that, unlike traditional methods, uses fast ML models to boost the sorting speed. The models learn to estimate the input's distribution and arrange the keys in sorted order by predicting their…

Data Structures and Algorithms · Computer Science 2021-07-08 Ani Kristo , Kapil Vaidya , Tim Kraska

Imbalanced data pose challenges for deep learning based classification models. One of the most widely-used approaches for tackling imbalanced data is re-weighting, where training samples are associated with different weights in the loss…

Machine Learning · Computer Science 2022-08-08 Dandan Guo , Zhuo Li , Meixi Zheng , He Zhao , Mingyuan Zhou , Hongyuan Zha

We study sorting in the evolving data model, introduced by [AKMU11], where the true total order changes while the sorting algorithm is processing the input. More precisely, each comparison operation of the algorithm is followed by a…

Data Structures and Algorithms · Computer Science 2024-09-24 George Giakkoupis , Marcos Kiwi , Dimitrios Los

Optimal transport (OT) is a general framework for finding a minimum-cost transport plan, or coupling, between probability distributions, and has many applications in machine learning. A key challenge in applying OT to massive datasets is…

Machine Learning · Computer Science 2024-11-19 Peter Halmos , Xinhao Liu , Julian Gold , Benjamin J Raphael

This article introduces a new class of fast algorithms to approximate variational problems involving unbalanced optimal transport. While classical optimal transport considers only normalized probability distributions, it is important for…

Optimization and Control · Mathematics 2017-05-23 Lenaic Chizat , Gabriel Peyré , Bernhard Schmitzer , François-Xavier Vialard

In this paper we introduce a new classification algorithm called Optimization of Distributions Differences (ODD). The algorithm aims to find a transformation from the feature space to a new space where the instances in the same class are as…

Machine Learning · Computer Science 2017-03-06 Mohammad Reza Bonyadi , Quang M. Tieng , David C. Reutens

In the first place, a novel, yet straightforward in-place integer value-sorting algorithm is presented. It sorts in linear time using constant amount of additional memory for storing counters and indices beside the input array. The…

Data Structures and Algorithms · Computer Science 2013-07-11 A. Emre Cetin

Optimal transport (OT) theory underlies many emerging machine learning (ML) methods nowadays solving a wide range of tasks such as generative modeling, transfer learning and information retrieval. These latter works, however, usually build…

Machine Learning · Statistics 2021-12-03 Quang Huy Tran , Hicham Janati , Ievgen Redko , Rémi Flamary , Nicolas Courty