English
Related papers

Related papers: A Sub-linear Time Algorithm for Approximating k-Ne…

200 papers

We study the computational complexity of approximating general constrained Markov decision processes. Our primary contribution is the design of a polynomial time $(0,\epsilon)$-additive bicriteria approximation algorithm for finding optimal…

Data Structures and Algorithms · Computer Science 2025-02-12 Jeremy McMahan

We provide a general framework for getting expected linear time constant factor approximations (and in many cases FPTASs) to several well-known problems in Computational Geometry, such as $k$-center clustering and farthest nearest neighbor.…

Computational Geometry · Computer Science 2026-03-04 Sariel Har-Peled , Banjamin Raichel

We study the fundamental problem of approximating the edit distance of two strings. After an extensive line of research led to the development of a constant-factor approximation algorithm in almost-linear time, recent years have witnessed a…

Data Structures and Algorithms · Computer Science 2023-12-05 Karl Bringmann , Alejandro Cassis , Nick Fischer , Tomasz Kociumaka

Many combinatorial optimization problems can be formulated as the search for a subgraph that satisfies certain properties and minimizes the total weight. We assume here that the vertices correspond to points in a metric space and can take…

Data Structures and Algorithms · Computer Science 2024-12-25 Marin Bougeret , Jérémy Omer , Michael Poss

Monotonicity is a simple yet significant qualitative characteristic. We consider the problem of segmenting an array in up to K segments. We want segments to be as monotonic as possible and to alternate signs. We propose a quality metric for…

Data Structures and Algorithms · Computer Science 2007-05-23 Daniel Lemire , Martin Brooks , Yuhong Yan

Linear regression analysis focuses on predicting a numeric regressand value based on certain regressor values. In this context, k-Nearest Neighbors (k-NN) is a common non-parametric regression algorithm, which achieves efficient performance…

In this paper we present the first provable approximate nearest-neighbor (ANN) algorithms for Bregman divergences. Our first algorithm processes queries in O(log^d n) time using O(n log^d n) space and only uses general properties of the…

Computational Geometry · Computer Science 2013-09-17 Amirali Abdullah , John Moeller , Suresh Venkatasubramanian

Confidence intervals are a standard technique for analyzing data. When applied to time series, confidence intervals are computed for each time point separately. Alternatively, we can compute confidence bands, where we are required to find…

Machine Learning · Computer Science 2021-12-14 Nikolaj Tatti

Approximate nearest neighbor algorithms are used to speed up nearest neighbor search in a wide array of applications. However, current indexing methods feature several hyperparameters that need to be tuned to reach an acceptable…

Data Structures and Algorithms · Computer Science 2019-04-25 Elias Jääsaari , Ville Hyvönen , Teemu Roos

In this paper we consider the coupled task scheduling problem with exact delay times on a single machine with the objective of minimizing the total completion time of the jobs. We provide constant-factor approximation algorithms for several…

Optimization and Control · Mathematics 2024-05-03 David Fischer , Péter Györgyi

We study sublinear time algorithms for estimating the size of maximum matching. After a long line of research, the problem was finally settled by Behnezhad [FOCS'22], in the regime where one is willing to pay an approximation factor of $2$.…

Data Structures and Algorithms · Computer Science 2023-04-28 Sayan Bhattacharya , Peter Kiss , Thatchaphol Saranurak

Suppose $V$ is an $n$-element set where for each $x \in V$, the elements of $V \setminus \{x\}$ are ranked by their similarity to $x$. The $K$-nearest neighbor graph is a directed graph including an arc from each $x$ to the $K$ points of $V…

Combinatorics · Mathematics 2020-12-29 Jacob D. Baron , R. W. R. Darling

Demands for minimum parameter setup in machine learning models are desirable to avoid time-consuming optimization processes. The $k$-Nearest Neighbors is one of the most effective and straightforward models employed in numerous problems.…

Machine Learning · Computer Science 2022-10-03 Danilo Samuel Jodas , Leandro Aparecido Passos , Ahsan Adeel , João Paulo Papa

This paper proposes a spatial k-nearest neighbor method for nonparametric prediction of real-valued spatial data and supervised classification for categorical spatial data. The proposed method is based on a double nearest neighbor rule…

Statistics Theory · Mathematics 2023-01-02 Mohamed-Salem Ahmed , Mamadou N'diaye , Mohammed Kadi Attouch , Sophie Dabo-Niang

This paper describes ANN-Benchmarks, a tool for evaluating the performance of in-memory approximate nearest neighbor algorithms. It provides a standard interface for measuring the performance and quality achieved by nearest neighbor…

Information Retrieval · Computer Science 2018-07-19 Martin Aumüller , Erik Bernhardsson , Alexander Faithfull

We present the first sublinear memory sketch that can be queried to find the nearest neighbors in a dataset. Our online sketching algorithm compresses an N element dataset to a sketch of size $O(N^b \log^3 N)$ in $O(N^{(b+1)} \log^3 N)$…

Data Structures and Algorithms · Computer Science 2020-09-15 Benjamin Coleman , Richard G. Baraniuk , Anshumali Shrivastava

We consider linear recurrent neural networks, which have become a key building block of sequence modeling due to their ability for stable and effective long-range modeling. In this paper, we aim at characterizing this ability on a simple…

Machine Learning · Computer Science 2025-02-14 Alexandre François , Antonio Orvieto , Francis Bach

Estimating the density of a distribution from its samples is a fundamental problem in statistics. Hypothesis selection addresses the setting where, in addition to a sample set, we are given $n$ candidate distributions -- referred to as…

Data Structures and Algorithms · Computer Science 2025-10-23 Maryam Aliakbarpour , Zhan Shi , Ria Stevens , Vincent X. Wang

Geometric data structures have been extensively studied in the regime where the dimension is much smaller than the number of input points. But in many scenarios in Machine Learning, the dimension can be much higher than the number of points…

Data Structures and Algorithms · Computer Science 2025-04-07 Martin G. Herold , Danupon Nanongkai , Joachim Spoerhase , Nithin Varma , Zihang Wu

In this paper we propose the PCP-like theorem for sub-linear time inapproximability. Abboud et al. have devised the distributed PCP framework for proving sub-quadratic time inapproximability. Here we try to go further in this direction.…

Computational Complexity · Computer Science 2024-01-03 Hengzhao Ma , Jianzhong Li