English
Related papers

Related papers: Fast Differentiable Sorting and Ranking

200 papers

We derive new time-space tradeoff lower bounds and algorithms for exactly computing statistics of input data, including frequency moments, element distinctness, and order statistics, that are simple to calculate for sorted data. We develop…

Computational Complexity · Computer Science 2013-09-17 Paul Beame , Raphael Clifford , Widad Machmouchi

In 1937, biologists Sturtevant and Tan posed a computational question: transform a chromosome represented by a permutation of genes, into a second permutation, using a minimum-length sequence of reversals, each inverting the order of a…

Data Structures and Algorithms · Computer Science 2024-04-01 Krister M. Swenson

The aim of the paper is to introduce general techniques in order to optimize the parallel execution time of sorting on a distributed architectures with processors of various speeds. Such an application requires a partitioning step. For…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-08-16 Christophe Cérin , Jean-Christophe Dubacq , Jean-Louis Roch , the SafeScale Collaboration

The problem of determining which permutations can be sorted using certain switchyard networks dates back to Knuth in 1968. In this work, we are interested in permutations which are sortable on a double-ended queue (called a deque), or on…

Combinatorics · Mathematics 2012-08-16 Daniel Denton

We give the first data structure for the problem of maintaining a dynamic set of n elements drawn from a partially ordered universe described by a tree. We define the Line-Leaf Tree, a linear-sized data structure that supports the…

Data Structures and Algorithms · Computer Science 2011-05-03 Brent Heeringa , Marius Catalin Iordan , Louis Theran

Sorting a set of items is a task that can be useful by itself or as a building block for more complex operations. That is why a lot of effort has been put into finding sorting algorithms that sort large sets as fast as possible. But the…

Data Structures and Algorithms · Computer Science 2020-10-05 Timo Bingmann , Jasper Marianczuk , Peter Sanders

The sorting problem is one of the most relevant problems in computer science. Within the scope of modern computer science it has been studied for more than 70 years. In spite of these facts, new sorting algorithms have been developed in…

Data Structures and Algorithms · Computer Science 2014-11-04 Luis A. A. Meira , Rogério H. B. de Lima

In this article we describe a new Hermite series based sequential estimator for the Spearman rank correlation coefficient and provide algorithms applicable in both the stationary and non-stationary settings. To treat the non-stationary…

Methodology · Statistics 2021-07-07 Michael Stephanou , Melvin Varughese

We prove the first polynomial separation between randomized and deterministic time-space tradeoffs of multi-output functions. In particular, we present a total function that on the input of $n$ elements in $[n]$, outputs $O(n)$ elements,…

Computational Complexity · Computer Science 2023-06-29 Huacheng Yu , Wei Zhan

This paper introduces a new comparison base stable sorting algorithm, named RS sort. RS Sort involves only the comparison of pair of elements in an array which ultimately sorts the array and does not involve the comparison of each element…

Data Structures and Algorithms · Computer Science 2014-07-23 Harsh Ranjan , Sumit Agarwal , Niraj Kumar Singh

Spike sorting is a class of algorithms used in neuroscience to attribute the time occurences of particular electric signals, called action potential or spike, to neurons. We rephrase this problem as a particular optimization problem : Lasso…

Statistics Theory · Mathematics 2022-04-12 Laurent Dragoni , Rémi Flamary , Karim Lounici , Patricia Reynaud-Bouret

We introduce a new family of priority-queue data structures: partition-based simple heaps. The structures consist of $O(\log n)$ doubly-linked lists; order is enforced among data in different lists, but the individual lists are unordered.…

Data Structures and Algorithms · Computer Science 2026-03-03 Gerth Stølting Brodal , John Iacono , Casper Moldrup Rysgaard , Sebastian Wild

Clinicians need ranking systems that work in real time and still justify their choices. Motivated by the need for a low-latency, decoder-based reranker, we present OG-Rank, a single-decoder approach that pairs a pooled first-token scoring…

Artificial Intelligence · Computer Science 2025-10-21 Praphul Singh , Corey Barrett , Sumana Srivasta , Irfan Bulu , Sri Gadde , Krishnaram Kenthapadi

We consider the assortment optimization problem with disjoint-cardinality constraints under two-level nested logit model. To solve this problem, we first identify a candidate set with $O(mn^2)$ assortments and show that at least one optimal…

Optimization and Control · Mathematics 2016-03-31 Tian Xie

A very simple first-order algorithm is proposed for solving nonlinear optimization problems with deterministic nonlinear equality constraints. This algorithm adaptively selects steps in the plane tangent to the constraints or steps that…

Optimization and Control · Mathematics 2026-03-11 Serge Gratton , Philippe L. Toint

We propose a first-order method for stochastic strongly convex optimization that attains $O(1/n)$ rate of convergence, analysis show that the proposed method is simple, easily to implement, and in worst case, asymptotically four times…

Optimization and Control · Mathematics 2011-10-14 Peng Cheng

We consider $(\epsilon,\delta)$-PAC maximum-selection and ranking for general probabilistic models whose comparisons probabilities satisfy strong stochastic transitivity and stochastic triangle inequality. Modifying the popular knockout…

Machine Learning · Computer Science 2017-05-16 Moein Falahatgar , Alon Orlitsky , Venkatadheeraj Pichapati , Ananda Theertha Suresh

Sorting input objects is an important step in many machine learning pipelines. However, the sorting operator is non-differentiable with respect to its inputs, which prohibits end-to-end gradient-based optimization. In this work, we propose…

Machine Learning · Statistics 2019-04-30 Aditya Grover , Eric Wang , Aaron Zweig , Stefano Ermon

We consider the two-dimensional sorted range reporting problem. Our data structure requires O(n lglg n) words of space and O(lglg n + k lglg n) query time, where k is the number of points in the query range. This data structure improves a…

Data Structures and Algorithms · Computer Science 2013-08-16 Gelin Zhou

One approach for reducing run time and improving efficiency of machine learning is to reduce the convergence rate of the optimization algorithm used. Shuffling is an algorithm technique that is widely used in machine learning, but it only…

Machine Learning · Computer Science 2023-06-29 Yuetong Xu , Baharan Mirzasoleiman