English
Related papers

Related papers: Quantization for Vector Search under Streaming Upd…

200 papers

Modern deep learning models capture the semantics of complex data by transforming them into high-dimensional embedding vectors. Emerging applications, such as retrieval-augmented generation, use approximate nearest neighbor (ANN) search in…

Databases · Computer Science 2025-10-01 Guoyu Hu , Shaofeng Cai , Tien Tuan Anh Dinh , Zhongle Xie , Cong Yue , Gang Chen , Beng Chin Ooi

Many applications from various disciplines are now required to analyze fast evolving big data in real time. Various approaches for incremental processing of queries have been proposed over the years. Traditional approaches rely on updating…

Databases · Computer Science 2019-02-05 Iman Elghandour , Ahmet Kara , Dan Olteanu , Stijn Vansummeren

Vector databases typically rely on approximate nearest neighbor (ANN) search to retrieve the top-k closest vectors to a query in embedding space. While effective, this approach often yields semantically redundant results, missing the…

Machine Learning · Computer Science 2025-07-29 Rahul Raja , Arpita Vats

State-of-the-art algorithms for Approximate Nearest Neighbor Search (ANNS) such as DiskANN, FAISS-IVF, and HNSW build data dependent indices that offer substantially better accuracy and search efficiency over data-agnostic indices by…

Machine Learning · Computer Science 2022-12-01 Shikhar Jaiswal , Ravishankar Krishnaswamy , Ankit Garg , Harsha Vardhan Simhadri , Sheshansh Agrawal

Managing large-scale vector datasets with disk-resident graph approximate nearest neighbor search (ANNS) systems incurs substantial storage overhead due to the co-location of vector data and auxiliary index metadata, which prevents the…

Databases · Computer Science 2026-05-18 Yuanming Ren , Juncheng Zhang , Yanjing Ren , Rui Yang , Di Wu , Patrick P. C. Lee

Deep learning has made remarkable progress recently, largely due to the availability of large, well-labeled datasets. However, the training on such datasets elevates costs and computational demands. To address this, various techniques like…

Computer Vision and Pattern Recognition · Computer Science 2024-07-11 Zhenghao Zhao , Yuzhang Shang , Junyi Wu , Yan Yan

Nearest neighbor search plays a fundamental role in many disciplines such as multimedia information retrieval, data-mining, and machine learning. The graph-based search approaches show superior performance over other types of approaches in…

Information Retrieval · Computer Science 2022-04-05 Hui Wang , Yong Wang , Wan-Lei Zhao

As data volume grows extensively, data profiling helps to extract metadata of large-scale data. However, one kind of metadata, order statistics, is difficult to be computed because they are not mergeable or incremental. Thus, the limitation…

Data Structures and Algorithms · Computer Science 2020-06-29 Zhiwei Chen , Aoqian Zhang

Quality of experience (QoE) assessment for adaptive video streaming plays a significant role in advanced network management systems. It is especially challenging in case of dynamic adaptive streaming schemes over HTTP (DASH) which has…

Multimedia · Computer Science 2022-03-01 Wei Zhou , Xiongkuo Min , Hong Li , Qiuping Jiang

Quantization replaces floating point arithmetic with integer arithmetic in deep neural network models, providing more efficient on-device inference with less power and memory. In this work, we propose a framework for formally verifying…

Machine Learning · Computer Science 2023-12-29 Pei Huang , Haoze Wu , Yuting Yang , Ieva Daukantas , Min Wu , Yedi Zhang , Clark Barrett

Approximate nearest neighbor (ANN) search is a key component in many modern machine learning pipelines; recent use cases include retrieval-augmented generation (RAG) and vector databases. Clustering-based ANN algorithms, that use score…

Machine Learning · Computer Science 2024-10-25 Elias Jääsaari , Ville Hyvönen , Teemu Roos

Many databases on the web are "hidden" behind (i.e., accessible only through) their restrictive, form-like, search interfaces. Recent studies have shown that it is possible to estimate aggregate query answers over such hidden web databases…

Databases · Computer Science 2014-05-02 Weimo Liu , Saravanan Thirumuruganathan , Nan Zhang , Gautam Das

Quantization of Convolutional Neural Networks (CNNs) is a common approach to ease the computational burden involved in the deployment of CNNs, especially on low-resource edge devices. However, fixed-point arithmetic is not natural to the…

Machine Learning · Computer Science 2024-06-14 Ido Ben-Yair , Gil Ben Shalom , Moshe Eliasof , Eran Treister

This paper studies distributed Nash equilibrium (NE) seeking under Denial-of-Service (DoS) attacks and quantization. The players can only exchange information with their own direct neighbors. The transmitted information is subject to…

Systems and Control · Electrical Eng. & Systems 2025-02-11 Shuai Feng , Maojiao Ye , Lihua Xie , Shengyuan Xu

Deep Neural Networks (DNNs) typically require massive amount of computation resource in inference tasks for computer vision applications. Quantization can significantly reduce DNN computation and storage by decreasing the bitwidth of…

Graph-based approximate nearest neighbor search (ANNS) algorithms work effectively against large-scale vector retrieval. Among such methods, DiskANN achieves good recall-speed tradeoffs using both DRAM and storage. DiskANN adopts product…

Information Retrieval · Computer Science 2025-02-27 Kento Tatsuno , Daisuke Miyashita , Taiga Ikeda , Kiyoshi Ishiyama , Kazunari Sumiyoshi , Jun Deguchi

Approximate Nearest Neighbor Search (ANNS) on high-dimensional vectors has become a fundamental and essential component in various machine learning tasks. Recently, with the rapid development of deep learning models and the applications of…

Databases · Computer Science 2025-02-21 Zeyu Wang , Haoran Xiong , Qitong Wang , Zhenying He , Peng Wang , Themis Palpanas , Wei Wang

Approximate Nearest Neighbor Search (ANNS) in high dimensional spaces is crucial for many real-life applications (e.g., e-commerce, web, multimedia, etc.) dealing with an abundance of data. This paper proposes an end-to-end learning…

Machine Learning · Computer Science 2022-10-20 Abrar Fahim , Mohammed Eunus Ali , Muhammad Aamir Cheema

Search engines and recommendation systems are built to efficiently display relevant information from those massive amounts of candidates. Typically a three-stage mechanism is employed in those systems: (i) a small collection of items are…

Information Retrieval · Computer Science 2022-11-09 Weijie Zhao , Shulong Tan , Ping Li

This paper introduces a novel dynamic optimization framework for video streaming that leverages Network Digital Twin (NDT) technology to address the challenges posed by fluctuating wireless network conditions. Traditional adaptive streaming…

Networking and Internet Architecture · Computer Science 2025-08-05 Zurh Farus , Betty Searcy , Tina Nassisid , Kevin Muhammad