English
Related papers

Related papers: Custom 8-bit floating point value format for reduc…

200 papers

The use of low-precision fixed-point arithmetic along with stochastic rounding has been proposed as a promising alternative to the commonly used 32-bit floating point arithmetic to enhance training neural networks training in terms of…

Machine Learning · Computer Science 2018-04-17 Marc Ortiz , Adrián Cristal , Eduard Ayguadé , Marc Casas

Approximate Nearest Neighbor Search (ANNS) is the task of finding the database vector that is closest to a given query vector. Graph-based ANNS is the family of methods with the best balance of accuracy and speed for million-scale datasets.…

Information Retrieval · Computer Science 2023-11-01 Naoki Ono , Yusuke Matsui

Filtered approximate nearest neighbor search (FANNS), an extension of approximate nearest neighbor search (ANNS) that incorporates scalar filters, has been widely applied to constrained retrieval of vector data. Despite its growing…

Databases · Computer Science 2025-05-13 Yanjun Lin , Kai Zhang , Zhenying He , Yinan Jing , X. Sean Wang

Deep neural networks achieve outstanding results in challenging image classification tasks. However, the design of network topologies is a complex task and the research community makes a constant effort in discovering top-accuracy…

Machine Learning · Computer Science 2019-09-25 Florian Scheidegger , Luca Benini , Costas Bekas , Cristiano Malossi

In recent years, Approximate Nearest Neighbor Search (ANNS) has played a pivotal role in modern search and recommendation systems, especially in emerging LLM applications like Retrieval-Augmented Generation. There is a growing exploration…

Information Retrieval · Computer Science 2024-11-07 Yiping Sun , Yang Shi , Jiaolong Du

Approximate nearest neighbor search (ANNS) at billion scale is fundamentally an out-of-core problem: vectors and indexes live on SSD, so performance is dominated by I/O rather than compute. Under skewed semantic embeddings, existing…

Vector search and database systems have become a keystone component in many AI applications. While many prior research has investigated how to accelerate the performance of generic vector search, emerging AI applications require running…

Databases · Computer Science 2025-06-03 Jingyi Xi , Chenghao Mo , Benjamin Karsin , Artem Chirkin , Mingqin Li , Minjia Zhang

Deformable Attention Transformers (DAT) have shown remarkable performance in computer vision tasks by adaptively focusing on informative image regions. However, their data-dependent sampling mechanism introduces irregular memory access…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Wendong Mao , Mingfan Zhao , Jianfeng Guan , Qiwei Dong , Zhongfeng Wang

Hybrid search, which jointly optimizes vector similarity and structured predicate filtering, has become a fundamental building block for modern AI-driven systems. While recent predicate-aware ANN indices improve filtering efficiency on…

Databases · Computer Science 2026-04-21 Xinkui Zhao , Hengxuan Lou , Yifan Zhang , Junjie Dai , Shuiguang Deng , Jianwei Yin

Large-scale Nearest Neighbor (NN) search, though widely utilized in the similarity search field, remains challenged by the computational limitations inherent in processing large scale data. In an effort to decrease the computational expense…

Machine Learning · Computer Science 2026-04-24 Ashley N. Abraham , Andrew Strelzoff , Haley R. Dozier , Althea C. Henslee , Mark A. Chappell

With the growing integration of structured and unstructured data, new methods have emerged for performing similarity searches on vectors while honoring structured attribute constraints, i.e., a process known as Filtering Approximate Nearest…

Databases · Computer Science 2025-09-23 Mocheng Li , Xiao Yan , Baotong Lu , Yue Zhang , James Cheng , Chenhao Ma

K-nearest neighbor search is one of the fundamental tasks in various applications and the hierarchical navigable small world (HNSW) has recently drawn attention in large-scale cloud services, as it easily scales up the database while…

Hardware Architecture · Computer Science 2022-07-13 Ji-Hoon Kim , Yeo-Reum Park , Jaeyoung Do , Soo-Young Ji , Joo-Young Kim

Much recent work has been devoted to approximate nearest neighbor queries. Motivated by applications in recommender systems, we consider approximate furthest neighbor (AFN) queries and present a simple, fast, and highly practical data…

Data Structures and Algorithms · Computer Science 2016-11-23 Rasmus Pagh , Francesco Silvestri , Johan Sivertsen , Matthew Skala

Deploying large language models (LLMs) on edge devices requires extremely low-bit quantization. Ultra-low precision formats such as NVFP4 offer a promising solution for reducing memory footprint and accelerating computation. However,…

Machine Learning · Computer Science 2026-03-25 Hanglin Li , Shuchang Tian , Chen Lin , Zhiyong Zhao , Kun Zhan

Neighbor search is of fundamental important to many engineering and science fields such as physics simulation and computer graphics. This paper proposes to formulate neighbor search as a ray tracing problem and leverage the dedicated ray…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-03-10 Yuhao Zhu

To increase the computational efficiency of interest-point based object retrieval, researchers have put remarkable research efforts into improving the efficiency of kNN-based feature matching, pursuing to match thousands of features against…

Computer Vision and Pattern Recognition · Computer Science 2015-08-19 Johannes Niedermayer , Peer Kröger

Neural Architecture Search (NAS) has become the de-facto approach for designing accurate and efficient networks for edge devices. Since models are typically quantized for edge deployment, recent work has investigated quantization-aware NAS…

Computer Vision and Pattern Recognition · Computer Science 2024-01-24 Yao Lu , Hiram Rayo Torres Rodriguez , Sebastian Vogel , Nick van de Waterlaat , Pavol Jancura

In this paper, we present an experimental comparison of various graph-based approximate nearest neighbor (ANN) search algorithms deployed on edge devices for real-time nearest neighbor search applications, such as smart city infrastructure…

Data Structures and Algorithms · Computer Science 2024-11-22 Ali Ganbarov , Jicheng Yuan , Anh Le-Tuan , Manfred Hauswirth , Danh Le-Phuoc

Neural Architecture Search (NAS), a framework which automates the task of designing neural networks, has recently been actively studied in the field of deep learning. However, there are only a few NAS methods suitable for 3D medical image…

Image and Video Processing · Electrical Eng. & Systems 2019-09-04 Woong Bae , Seungho Lee , Yeha Lee , Beomhee Park , Minki Chung , Kyu-Hwan Jung

Indices for approximate nearest neighbor search (ANNS) are a basic component for information retrieval and widely used in database, search, recommendation and RAG systems. In these scenarios, documents or other objects are inserted into and…

Information Retrieval · Computer Science 2025-02-20 Haike Xu , Magdalen Dobson Manohar , Philip A. Bernstein , Badrish Chandramouli , Richard Wen , Harsha Vardhan Simhadri