English
Related papers

Related papers: Memory-Efficient RkNN Retrieval by Nonlinear k-Dis…

200 papers

This study combines two different learning paradigms, k-nearest neighbor (k-NN) rule, as memory-based learning paradigm and relevance vector machines (RVM), as statistical learning paradigm. This combination is performed in kernel space and…

Machine Learning · Computer Science 2021-03-09 Sara Hosseinzadeh Kassani , Farhood Rismanchian , Peyman Hosseinzadeh Kassani

We prove an inverse approximation theorem for the approximation of nonlinear sequence-to-sequence relationships using recurrent neural networks (RNNs). This is a so-called Bernstein-type result in approximation theory, which deduces…

Machine Learning · Computer Science 2024-02-07 Shida Wang , Zhong Li , Qianxiao Li

The k-Nearest Neighbor (k-NN) classification algorithm is one of the most widely-used lazy classifiers because of its simplicity and ease of implementation. It is considered to be an effective classifier and has many applications. However,…

Machine Learning · Computer Science 2014-02-13 Stefanos Ougiaroglou , Georgios Evangelidis , Dimitris A. Dervos

k-nearest neighbor (k-NN) search is a fundamental primitive in geometry processing and computer graphics. While spatial partitioning structures such as kd-trees are standard, they are often manifold-blind, failing to exploit the intrinsic…

Computational Geometry · Computer Science 2026-05-05 Pengfei Wang , Qinghao Guo , Haisen Zhao , Shiqing Xin , Shuangmin Chen , Changhe Tu , Wenping Wang

Approximate nearest-neighbor search is a fundamental algorithmic problem that continues to inspire study due its essential role in numerous contexts. In contrast to most prior work, which has focused on point sets, we consider…

Computational Geometry · Computer Science 2021-04-01 Ahmed Abdelkader , David M. Mount

Nearest-neighbor search dominates the asymptotic complexity of sampling-based motion planning algorithms and is often addressed with k-d tree data structures. While it is generally believed that the expected complexity of nearest-neighbor…

Computational Geometry · Computer Science 2017-09-25 Valerio Varricchio , Brian Paden , Dmitry Yershov , Emilio Frazzoli

k-Nearest Neighbors is one of the most fundamental but effective classification models. In this paper, we propose two families of models built on a sequence to sequence model and a memory network model to mimic the k-Nearest Neighbors…

Machine Learning · Computer Science 2019-11-28 Yiming Xu , Diego Klabjan

We are in the era where the Big Data analytics has changed the way of interpreting the various biomedical phenomena, and as the generated data increase, the need for new machine learning methods to handle this evolution grows. An indicative…

Machine Learning · Computer Science 2020-12-04 Panagiotis Anagnostou , Petros T. Barmbas , Aristidis G. Vrahatis , Sotiris K. Tasoulis

This study proposes an efficient exact k-flexible aggregate nearest neighbor (k-FANN) search algorithm in road networks using the M-tree. The state-of-the-art IER-kNN algorithm used the R-tree and pruned off unnecessary nodes based on the…

Databases · Computer Science 2021-09-14 Moonyoung Chung , Soon J. Hyun , Woong-Kee Loh

k Nearest Neighbor (kNN) method is a simple and popular statistical method for classification and regression. For both classification and regression problems, existing works have shown that, if the distribution of the feature vector has…

Statistics Theory · Mathematics 2019-10-24 Puning Zhao , Lifeng Lai

Pre-trained models are widely used in fine-tuning downstream tasks with linear classifiers optimized by the cross-entropy loss, which might face robustness and stability problems. These problems can be improved by learning representations…

Computation and Language · Computer Science 2021-10-07 Linyang Li , Demin Song , Ruotian Ma , Xipeng Qiu , Xuanjing Huang

Motivated by applications in computer vision and databases, we introduce and study the Simultaneous Nearest Neighbor Search (SNN) problem. Given a set of data points, the goal of SNN is to design a data structure that, given a collection of…

Data Structures and Algorithms · Computer Science 2016-04-11 Piotr Indyk , Robert Kleinberg , Sepideh Mahabadi , Yang Yuan

Common to all different kinds of recurrent neural networks (RNNs) is the intention to model relations between data points through time. When there is no immediate relationship between subsequent data points (like when the data points are…

Machine Learning · Computer Science 2022-12-22 Steffen Illium , Thore Schillman , Robert Müller , Thomas Gabor , Claudia Linnhoff-Popien

Algorithms often carry out equally many computations for "easy" and "hard" problem instances. In particular, algorithms for finding nearest neighbors typically have the same running time regardless of the particular problem instance. In…

Data Structures and Algorithms · Computer Science 2020-03-25 Daniel LeJeune , Richard G. Baraniuk , Reinhard Heckel

Nonparametric learning is a fundamental concept in machine learning that aims to capture complex patterns and relationships in data without making strong assumptions about the underlying data distribution. Owing to simplicity and…

Machine Learning · Computer Science 2024-02-06 Amartya Banerjee , Christopher J. Hazard , Jacob Beel , Cade Mack , Jack Xia , Michael Resnick , Will Goddin

Speech recognition performance varies by language, domain, and speaker characteristics such as accent, but fine-tuning a model on any of these categories may lead to catastrophic forgetting. Token-level $k$ nearest neighbor search ($k$NN),…

Computation and Language · Computer Science 2025-02-12 Maya K. Nachesa , Vlad Niculae

Similarity search based on a distance function in metric spaces is a fundamental problem for many applications. Queries for similar objects lead to the well-known machine learning task of nearest-neighbours identification. Many data…

Information Retrieval · Computer Science 2022-08-05 Felipe Ortega , Maria Jesus Algar , Isaac Martín de Diego , Javier M. Moguerza

Traditional route planning and k nearest neighbors queries only consider distance or travel time and ignore road safety altogether. However, many travellers prefer to avoid risky or unpleasant road conditions such as roads with high crime…

Databases · Computer Science 2022-04-28 Punam Biswas , Tanzima Hashem , Muhammad Aamir Cheema

Graphs are fundamental data structures and have been employed for centuries to model real-world systems and phenomena. Random walk with restart (RWR) provides a good proximity score between two nodes in a graph, and it has been successfully…

Databases · Computer Science 2012-02-01 Yasuhiro Fujiwara , Makoto Nakatsuji , Makoto Onizuka , Masaru Kitsuregawa

The traditional k nearest neighbor (kNN) approach uses a distance formula within a spherical region to determine the k closest training observations to a test sample point. However, this approach may not work well when test point is located…

Machine Learning · Statistics 2024-02-19 Amjad Ali , Zardad Khan , Dost Muhammad Khan , Saeed Aldahmani