English
Related papers

Related papers: SVD Provably Denoises Nearest Neighbor Data

200 papers

We propose a non-parametric anomaly detection algorithm for high dimensional data. We first rank scores derived from nearest neighbor graphs on $n$-point nominal training data. We then train limited complexity models to imitate these scores…

Machine Learning · Statistics 2016-01-25 Jonathan Root , Venkatesh Saligrama , Jing Qian

We consider the problem of imaging sparse scenes from a few noisy data using an $l_1$-minimization approach. This problem can be cast as a linear system of the form $A \, \rho =b$, where $A$ is an $N\times K$ measurement matrix. We assume…

Image and Video Processing · Electrical Eng. & Systems 2020-04-22 Miguel Moscoso , Alexei Novikov , George Papanicolaou , Chrysoula Tsogka

Near neighbor problems are fundamental in algorithms for high-dimensional Euclidean spaces. While classical approaches suffer from the curse of dimensionality, locality sensitive hashing (LSH) can effectively solve a-approximate r-near…

Data Structures and Algorithms · Computer Science 2016-12-15 Wenlong Mou , Liwei Wang

K-Nearest Neighbors (KNN) is one of the most used ML classifiers. However, if we observe closely, standard distance-weighted KNN and relative variants assume all 'k' neighbors are equally reliable. In heterogeneous feature space, this…

Machine Learning · Computer Science 2025-12-11 Kumarjit Pathak , Karthik K , Sachin Madan , Jitin Kapila

This paper studies the problem of exact localization of sparse (point or extended) objects with noisy data. The crux of the proposed approach consists of random illumination. Several recovery methods are analyzed: the Lasso, BPDN and the…

Information Theory · Computer Science 2015-05-19 Albert Fannjiang

In this paper, we establish sample complexity bounds for learning high-dimensional simplices in $\mathbb{R}^K$ from noisy data. Specifically, we consider $n$ i.i.d. samples uniformly drawn from an unknown simplex in $\mathbb{R}^K$, each…

Machine Learning · Statistics 2025-06-13 Seyed Amir Hossein Saberi , Amir Najafi , Abolfazl Motahari , Babak H. khalaj

In many data analysis applications the following scenario is commonplace: we are given a point set that is supposed to sample a hidden ground truth $K$ in a metric space, but it got corrupted with noise so that some of the data points lie…

Computational Geometry · Computer Science 2017-03-28 Mickaël Buchet , Tamal K. Dey , Jiayuan Wang , Yusu Wang

[See the paper for the full abstract.] We show tight upper and lower bounds for time-space trade-offs for the $c$-Approximate Near Neighbor Search problem. For the $d$-dimensional Euclidean space and $n$-point datasets, we develop a data…

Data Structures and Algorithms · Computer Science 2019-10-04 Alexandr Andoni , Thijs Laarhoven , Ilya Razenshteyn , Erik Waingarten

Finding rare information hidden in a huge amount of data from the Internet is a necessary but complex issue. Many researchers have studied this issue and have found effective methods to detect anomaly data in low dimensional space. However,…

Artificial Intelligence · Computer Science 2014-05-07 Zhana Bao

Digital sensors can lead to noisy results under many circumstances. To be able to remove the undesired noise from images, proper noise modeling and an accurate noise parameter estimation is crucial. In this project, we use a…

Image and Video Processing · Electrical Eng. & Systems 2022-12-21 Étienne Objois , Kaan Okumuş , Nicolas Bähler

$k$ Nearest Neighbors ($k$NN) is one of the most widely used supervised learning algorithms to classify Gaussian distributed data, but it does not achieve good results when it is applied to nonlinear manifold distributed data, especially…

Machine Learning · Computer Science 2016-06-06 Enmei Tu , Yaqian Zhang , Lin Zhu , Jie Yang , Nikola Kasabov

Moving target shadows among video synthetic aperture radar (Video-SAR) images are always interfered by low scattering backgrounds and cluttered noises, causing poor detec-tion-tracking accuracy. Thus, a shadow-background-noise 3D spatial…

Computer Vision and Pattern Recognition · Computer Science 2023-02-08 Xiaowo Xu , Xiaoling Zhang , Tianwen Zhang , Zhenyu Yang , Jun Shi , Xu Zhan

K-nearest neighbors (KNN) is one of the earliest and most established algorithms in machine learning. For regression tasks, KNN averages the targets within a neighborhood which poses a number of challenges: the neighborhood definition is…

Machine Learning · Computer Science 2022-05-18 Youssef Nader , Leon Sixt , Tim Landgraf

Nearest neighbor search is known as a challenging issue that has been studied for several decades. Recently, this issue becomes more and more imminent in viewing that the big data problem arises from various fields. In this paper, a…

Computer Vision and Pattern Recognition · Computer Science 2017-02-06 Wan-Lei Zhao , Jie Yang , Cheng-Hao Deng

Speech super-resolution (SSR) aims to predict a high resolution (HR) speech signal from its low resolution (LR) corresponding part. Most neural SSR models focus on producing the final result in a noise-free environment by recovering the…

Audio and Speech Processing · Electrical Eng. & Systems 2023-10-11 Junkang Yang , Hongqing Liu , Lu Gan , Yi Zhou

In the domain of network intrusion detection, robustness against contaminated and noisy data inputs remains a critical challenge. This study introduces a probabilistic version of the Temporal Graph Network Support Vector Data Description…

Machine Learning · Computer Science 2025-08-21 Aleksei Liuliakov , Alexander Schulz , Luca Hermes , Barbara Hammer

A popular class of problem in statistics deals with estimating the support of a density from $n$ observations drawn at random from a $d$-dimensional distribution. The one-dimensional case reduces to estimating the end points of a univariate…

Statistics Theory · Mathematics 2018-04-27 Victor-Emmanuel Brunel , Jason M. Klusowski , Dana Yang

The randomized singular value decomposition (R-SVD) is a popular sketching-based algorithm for efficiently computing the partial SVD of a large matrix. When the matrix is low-rank, the R-SVD produces its partial SVD exactly; but when the…

Information Theory · Computer Science 2023-07-07 Elad Romanov

We present a convolutional neural network that is capable of searching for continuous gravitational waves, quasi-monochromatic, persistent signals arising from asymmetrically rotating neutron stars, in $\sim 1$ year of simulated data that…

General Relativity and Quantum Cosmology · Physics 2022-07-27 Takahiro S. Yamamoto , Andrew L. Miller , Magdalena Sieniawska , Takahiro Tanaka

In many signal processing applications, including communications, sonar, radar, and localization, a fundamental problem is the detection of a signal of interest in background noise, known as signal detection [1] [2]. A simple version of…

Signal Processing · Electrical Eng. & Systems 2025-12-16 Tom Anders , Hiten Prakash Kothari , R. Michael Buehrer