English
Related papers

Related papers: Leveraging Reinforcement Learning for evaluating R…

200 papers

Deep Neural Networks (DNNs) have become key components of many safety-critical applications such as autonomous driving and medical diagnosis. However, DNNs have been shown suffering from poor robustness because of their susceptibility to…

Machine Learning · Computer Science 2020-07-28 Wenjie Wan , Zhaodi Zhang , Yiwei Zhu , Min Zhang , Fu Song

Neural Architectures Search (NAS) becomes more and more popular over these years. However, NAS-generated models tends to suffer greater vulnerability to various malicious attacks. Lots of robust NAS methods leverage adversarial training to…

Machine Learning · Computer Science 2023-04-11 Xunyu Zhu , Jian Li , Yong Liu , Weiping Wang

Nearest neighbor search has found numerous applications in machine learning, data mining and massive data processing systems. The past few years have witnessed the popularity of the graph-based nearest neighbor search paradigm because of…

Machine Learning · Computer Science 2020-12-22 Hongya Wang , Zhizheng Wang , Wei Wang , Yingyuan Xiao , Zeng Zhao , Kaixiang Yang

Nearest neighbor search (NNS) aims to locate the points in high-dimensional space that is closest to the query point. The brute-force approach for finding the nearest neighbor becomes computationally infeasible when the number of points is…

Computer Vision and Pattern Recognition · Computer Science 2022-10-06 Deepak Gupta , Russell Loane , Soumya Gayen , Dina Demner-Fushman

Nearest Neighbor Search (NNS) is a fundamental problem in data structures with wide-ranging applications, such as web search, recommendation systems, and, more recently, retrieval-augmented generations (RAG). In such recent applications, in…

Data Structures and Algorithms · Computer Science 2026-02-10 Siddharth Barman , Nirjhar Das , Shivam Gupta , Kirankumar Shiragur

We study spectral algorithms for the high-dimensional Nearest Neighbor Search problem (NNS). In particular, we consider a semi-random setting where a dataset $P$ in $\mathbb{R}^d$ is chosen arbitrarily from an unknown subspace of low…

Data Structures and Algorithms · Computer Science 2014-08-05 Amirali Abdullah , Alexandr Andoni , Ravindran Kannan , Robert Krauthgamer

The weighted k-nearest neighbors algorithm is one of the most fundamental non-parametric methods in pattern recognition and machine learning. The question of setting the optimal number of neighbors as well as the optimal weights has…

Machine Learning · Statistics 2017-01-26 Oren Anava , Kfir Y. Levy

k is the most important parameter in a text categorization system based on k-Nearest Neighbor algorithm (kNN).In the classification process, k nearest documents to the test one in the training set are determined firstly. Then, the…

Computation and Language · Computer Science 2007-05-23 Baoli Li , Shiwen Yu , Qin Lu

Many real-world systems problems require reasoning about the long term consequences of actions taken to configure and manage the system. These problems with delayed and often sequentially aggregated reward, are often inherently…

Machine Learning · Computer Science 2019-09-06 Ameer Haj-Ali , Nesreen K. Ahmed , Ted Willke , Joseph Gonzalez , Krste Asanovic , Ion Stoica

Graph-based algorithms have demonstrated state-of-the-art performance in the nearest neighbor search (NN-Search) problem. These empirical successes urge the need for theoretical results that guarantee the search quality and efficiency of…

Machine Learning · Computer Science 2023-03-14 Anshumali Shrivastava , Zhao Song , Zhaozhuo Xu

Nearest Neighbor Search (NNS) has recently drawn a rapid increase of interest due to its core role in managing high-dimensional vector data in data science and AI applications. The interest is fueled by the success of neural embedding,…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-02-01 Zhen Peng , Minjia Zhang , Kai Li , Ruoming Jin , Bin Ren

As large language models (LLMs) grow in scale and specialization, routing--selecting the best model for a given input--has become essential for efficient and effective deployment. While recent methods rely on complex learned routing…

Machine Learning · Computer Science 2026-05-18 Yang Li

Deep Neural Networks (DNNs) are everywhere, frequently performing a fairly complex task that used to be unimaginable for machines to carry out. In doing so, they do a lot of decision making which, depending on the application, may be…

Machine Learning · Computer Science 2022-11-17 Avriti Chauhan , Mohammad Afzal , Hrishikesh Karmarkar , Yizhak Elboher , Kumar Madhukar , Guy Katz

Similarity search is a fundamental building block for information retrieval on a variety of datasets. The notion of a neighbor is often based on binary considerations, such as the k nearest neighbors. However, considering that data is often…

Information Retrieval · Computer Science 2022-08-23 Cole Foster , Berk Sevilmis , Benjamin Kimia

Nearest neighbor (NN) search is inherently computationally expensive in high-dimensional spaces due to the curse of dimensionality. As a well-known solution, locality-sensitive hashing (LSH) is able to answer c-approximate NN (c-ANN)…

Databases · Computer Science 2021-07-13 Bolong Zheng , Xi Zhao , Lianggui Weng , Nguyen Quoc Viet Hung , Hang Liu , Christian S. Jensen

K-Nearest Neighbor (kNN)-based deep learning methods have been applied to many applications due to their simplicity and geometric interpretability. However, the robustness of kNN-based classification models has not been thoroughly explored…

Machine Learning · Computer Science 2022-09-27 Ren Wang , Tianqi Chen , Philip Yao , Sijia Liu , Indika Rajapakse , Alfred Hero

Deep Neural Networks require large amounts of labeled data for their training. Collecting this data at scale inevitably causes label noise.Hence,the need to develop learning algorithms that are robust to label noise. In recent years, k…

Machine Learning · Computer Science 2021-07-22 Itzik Mizrahi , Shai Avidan

K-Nearest Neighbours (k-NN) is a popular classification and regression algorithm, yet one of its main limitations is the difficulty in choosing the number of neighbours. We present a Bayesian algorithm to compute the posterior probability…

Machine Learning · Computer Science 2017-06-05 Giuseppe Nuti

Deep Neural Networks (DNNs) have advanced in many real-world applications, such as healthcare and autonomous driving. However, their high computational complexity and vulnerability to adversarial attacks are ongoing challenges. In this…

Most exact methods for k-nearest neighbour search suffer from the curse of dimensionality; that is, their query times exhibit exponential dependence on either the ambient or the intrinsic dimensionality. Dynamic Continuous Indexing (DCI)…

Machine Learning · Computer Science 2017-07-21 Ke Li , Jitendra Malik