English
Related papers

Related papers: PDX: A Data Layout for Vector Similarity Search

200 papers

In current computer architectures, data movement (from die to network) is by far the most energy consuming part of an algorithm (10pJ/word on-die to 10,000pJ/word on the network). To increase memory locality at the hardware level and reduce…

Computational Physics · Physics 2018-01-17 H. Vincenti , R. Lehe , R. Sasanka , J-L. Vay

Visually sorted grid layouts provide an efficient method for organizing high-dimensional vectors in two-dimensional space by aligning spatial proximity with similarity relationships. This approach facilitates the effective sorting of…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Kai Uwe Barthel , Florian Tim Barthel , Peter Eisert , Nico Hezel , Konstantin Schall

Machine learning with big data often involves large optimization models. For distributed optimization over a cluster of machines, frequent communication and synchronization of all model parameters (optimization variables) can be very…

Optimization and Control · Mathematics 2017-10-17 Lin Xiao , Adams Wei Yu , Qihang Lin , Weizhu Chen

Efficient vector query processing is critical to enable AI applications at scale. Recent solutions struggle with growing vector datasets that exceed single-machine memory capacity, forcing unnecessary data movement and resource…

Databases · Computer Science 2025-05-20 Yi Liu , Fei Fang , Chen Qian

LiDAR has become one of the primary 3D object detection sensors in autonomous driving. However, LiDAR's diverging point pattern with increasing distance results in a non-uniform sampled point cloud ill-suited to discretized volumetric…

Computer Vision and Pattern Recognition · Computer Science 2022-03-23 Jordan S. K. Hu , Tianshu Kuai , Steven L. Waslander

The self-join finds all objects in a dataset within a threshold of each other defined by a similarity metric. As such, the self-join is a building block for the field of databases and data mining, and is employed in Big Data applications.…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-03-13 Michael Gowanlock , Ben Karsin

Similarity matching and join of time series data streams has gained a lot of relevance in today's world that has large streaming data. This process finds wide scale application in the areas of location tracking, sensor networks, object…

Databases · Computer Science 2013-12-11 R H Vishwanath , T V Samartha , K C Srikantaiah , K R Venugopal , L M Patnaik

3D neural networks are widely used in real-world applications (e.g., AR/VR headsets, self-driving cars). They are required to be fast and accurate; however, limited hardware resources on edge devices make these requirements rather…

Computer Vision and Pattern Recognition · Computer Science 2022-04-27 Zhijian Liu , Haotian Tang , Shengyu Zhao , Kevin Shao , Song Han

Optimization of searching the best possible action depending on various states like state of environment, system goal etc. has been a major area of study in computer systems. In any search algorithm, searching best possible solution from…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-08-10 Shubhendra Pal Singhal , M. Sridevi

Image search engines enable the retrieval of images relevant to a query image. In this work, we consider the setting where a query for similar images is derived from a collection of images. For visual search, the similarity measurements may…

Computer Vision and Pattern Recognition · Computer Science 2023-02-07 Nihal Jain , Praneetha Vaddamanu , Paridhi Maheshwari , Vishwa Vinay , Kuldeep Kulkarni

Constructing latent vector representation for nodes in a network through embedding models has shown its practicality in many graph analysis applications, such as node classification, clustering, and link prediction. However, despite the…

Human-Computer Interaction · Computer Science 2018-08-29 Quan Li , Kristanto Sean Njotoprawiro , Hammad Haleem , Qiaoan Chen , Chris Yi , Xiaojuan Ma

In recent years, considerable attention has been devoted to the regularization models due to the presence of high-dimensional data in scientific research. Sparse support vector machine (SVM) are useful tools in high-dimensional data…

Computation · Statistics 2023-12-27 Jiawei Wen

High-dimensional vector embeddings are widely used in retrieval systems, but they often suffer from noise, the curse of dimensionality, and slow runtime. However, dimensionality reduction (DR) is rarely applied due to its tendency to…

Information Retrieval · Computer Science 2025-11-25 Jiuzhou Fu , Dongfang Zhao

We present joint multi-dimension pruning (abbreviated as JointPruning), an effective method of pruning a network on three crucial aspects: spatial, depth and channel simultaneously. To tackle these three naturally different dimensions, we…

Computer Vision and Pattern Recognition · Computer Science 2021-10-04 Zechun Liu , Xiangyu Zhang , Zhiqiang Shen , Zhe Li , Yichen Wei , Kwang-Ting Cheng , Jian Sun

Huge embedding tables in modern deep learning recommender models (DLRM) require prohibitively large memory during training and inference. This paper proposes FIITED, a system to automatically reduce the memory footprint via FIne-grained…

Information Retrieval · Computer Science 2024-10-15 Qinyi Luo , Penghan Wang , Wei Zhang , Fan Lai , Jiachen Mao , Xiaohan Wei , Jun Song , Wei-Yu Tsai , Shuai Yang , Yuxi Hu , Xuehai Qian

Hashing is an efficient method for nearest neighbor search in large-scale data space by embedding high-dimensional feature descriptors into a similarity preserving Hamming space with a low dimension. However, large-scale high-speed…

Computer Vision and Pattern Recognition · Computer Science 2020-06-17 Chenggang Yan , Biao Gong , Yuxuan Wei , Yue Gao

There is an increasing demand for extending existing DBMSs with vector indices so that they become unified systems capable of supporting modern predictive applications, which require joint querying of vector embeddings together with the…

Information Retrieval · Computer Science 2025-07-01 Gaurav Sehgal , Semih Salihoglu

The backtracking line-search is an effective technique to automatically tune the step-size in smooth optimization. It guarantees similar performance to using the theoretically optimal step-size. Many approaches have been developed to…

Optimization and Control · Mathematics 2023-06-06 Frederik Kunstner , Victor S. Portella , Mark Schmidt , Nick Harvey

We propose a new algorithm for fast approximate nearest neighbor search based on the properties of ordered vectors. Data vectors are classified based on the index and sign of their largest components, thereby partitioning the space in a…

Computer Vision and Pattern Recognition · Computer Science 2016-11-01 Luisa Verdoliva , Davide Cozzolino , Giovanni Poggi

Traditional network embedding primarily focuses on learning a continuous vector representation for each node, preserving network structure and/or node content information, such that off-the-shelf machine learning algorithms can be easily…

Social and Information Networks · Computer Science 2023-01-02 Daokun Zhang , Jie Yin , Xingquan Zhu , Chengqi Zhang