English
Related papers

Related papers: OOD-DiskANN: Efficient and Scalable Graph ANNS for…

200 papers

Neural architecture search (NAS) is an approach for automatically designing a neural network architecture without human effort or expert knowledge. However, the high computational cost of NAS limits its use in commercial applications. Two…

Machine Learning · Computer Science 2021-03-11 Rei Sato , Jun Sakuma , Youhei Akimoto

Approximate nearest neighbor search (ANNS) in high-dimensional vector spaces has a wide range of real-world applications. Numerous methods have been proposed to handle ANNS efficiently, while graph-based indexes have gained prominence due…

Databases · Computer Science 2025-08-14 Zhonggen Li , Xiangyu Ke , Yifan Zhu , Bocheng Yu , Baihua Zheng , Yunjun Gao

In this paper, we present an experimental comparison of various graph-based approximate nearest neighbor (ANN) search algorithms deployed on edge devices for real-time nearest neighbor search applications, such as smart city infrastructure…

Data Structures and Algorithms · Computer Science 2024-11-22 Ali Ganbarov , Jicheng Yuan , Anh Le-Tuan , Manfred Hauswirth , Danh Le-Phuoc

Deep neural networks (DNN) have outstanding performance in various applications. Despite numerous efforts of the research community, out-of-distribution (OOD) samples remain a significant limitation of DNN classifiers. The ability to…

Machine Learning · Computer Science 2023-03-27 Bartlomiej Olber , Krystian Radlak , Adam Popowicz , Michal Szczepankiewicz , Krystian Chachuła

The application of the diffusion in many computer vision and artificial intelligence projects has been shown to give excellent improvements in performance. One of the main bottlenecks of this technique is the quadratic growth of the kNN…

Computer Vision and Pattern Recognition · Computer Science 2019-04-19 Federico Magliani , Kevin McGuinness , Eva Mohedano , Andrea Prati

Out-of-distribution (OOD) detection is a critical task for deploying machine learning models in the open world. Distance-based methods have demonstrated promise, where testing samples are detected as OOD if they are relatively far away from…

Machine Learning · Computer Science 2022-12-09 Yiyou Sun , Yifei Ming , Xiaojin Zhu , Yixuan Li

In the recent years, researchers proposed a number of successful methods to perform out-of-distribution (OOD) detection in deep neural networks (DNNs). So far the scope of the highly accurate methods has been limited to image level…

Computer Vision and Pattern Recognition · Computer Science 2021-04-01 Ertunc Erdil , Krishna Chaitanya , Neerav Karani , Ender Konukoglu

Deep Neural Networks (DNNs) excel in learning hierarchical representations from raw data, such as images, audio, and text. To compute these DNN models with high performance and energy efficiency, these models are usually deployed onto…

The standard paradigm in Neural Architecture Search (NAS) is to search for a fully deterministic architecture with specific operations and connections. In this work, we instead propose to search for the optimal operation distribution, thus…

Machine Learning · Computer Science 2021-11-09 Xingchen Wan , Binxin Ru , Pedro M. Esperança , Fabio M. Carlucci

Despite the efficacy of graph-based algorithms for Approximate Nearest Neighbor (ANN) searches, the optimal tuning of such systems remains unclear. This study introduces a method to tune the performance of off-the-shelf graph-based indexes,…

Information Retrieval · Computer Science 2023-09-04 Yutaro Oguri , Yusuke Matsui

Out-of-Distribution (OOD) detection is critical for safe deployment; however, existing detectors often struggle to generalize across datasets of varying scales and model architectures, and some can incur high computational costs in…

Machine Learning · Computer Science 2025-04-04 Litian Liu , Yao Qin

GNAS (Graph Neural Architecture Search) has demonstrated great effectiveness in automatically designing the optimal graph neural architectures for multiple downstream tasks, such as node classification and link prediction. However, most…

Machine Learning · Computer Science 2024-12-04 Guanghui Zhu , Zipeng Ji , Jingyan Chen , Limin Wang , Chunfeng Yuan , Yihua Huang

Approximate K nearest neighbor (AKNN) search is a fundamental and challenging problem. We observe that in high-dimensional space, the time consumption of nearly all AKNN algorithms is dominated by that of the distance comparison operations…

Data Structures and Algorithms · Computer Science 2023-03-20 Jianyang Gao , Cheng Long

In the dynamic realms of machine learning and deep learning, the robustness and reliability of models are paramount, especially in critical real-world applications. A fundamental challenge in this sphere is managing Out-of-Distribution…

Machine Learning · Computer Science 2024-03-07 Yingrui Ji , Yao Zhu , Zhigang Li , Jiansheng Chen , Yunlong Kong , Jingbo Chen

Modern retrieval systems increasingly require integrating approximate nearest neighbor search (ANNS) with complex attribute filtering to handle hybrid queries in applications such as recommendation systems and retrieval-augmented generation…

Information Retrieval · Computer Science 2026-05-11 Junjie Song , Yu Liu , Guoyu Hu , Zhongle Xie , Ming Yang , Beng Chin Ooi , Ke Zhou

High-dimensional approximate $K$ nearest neighbor search (AKNN) is a fundamental task for various applications, including information retrieval. Most existing algorithms for AKNN can be decomposed into two main components, i.e., candidate…

Databases · Computer Science 2024-12-03 Liwei Deng , Penghao Chen , Ximu Zeng , Tianfu Wang , Yan Zhao , Kai Zheng

Real-world vector embeddings are usually associated with extra labels, such as attributes and keywords. Many applications require the nearest neighbor search that contains specific labels, such as searching for product image embeddings…

Databases · Computer Science 2025-12-12 Mingyu Yang , Wenxuan Xia , Wentao Li , Raymond Chi-Wing Wong , Wei Wang

Approximate nearest neighbor search (ANNS) on GPUs is gaining increasing popularity for modern retrieval and recommendation workloads that operate over massive high-dimensional vectors. Graph-based indexes deliver high recall and throughput…

Databases · Computer Science 2026-03-02 Jifan Shi , Jianyang Gao , James Xia , Tamás Béla Fehér , Cheng Long

Out-of-distribution (OOD) detection remains a fundamental challenge for deep neural networks, particularly due to overconfident predictions on unseen OOD samples during testing. We reveal a key insight: OOD samples predicted as the same…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Yanqi Wu , Qichao Chen , Runhe Lai , Xinhua Lu , Jia-Xin Zhuang , Zhilin Zhao , Wei-Shi Zheng , Ruixuan Wang

Detecting out-of-distribution (OOD) nodes in the graph-based machine-learning field is challenging, particularly when in-distribution (ID) node multi-category labels are unavailable. Thus, we focus on feature space rather than label space…

Machine Learning · Computer Science 2025-10-24 Shenzhi Yang , Junbo Zhao , Sharon Li , Shouqing Yang , Dingyu Yang , Xiaofang Zhang , Haobo Wang