English
Related papers

Related papers: Billion-scale similarity search with GPUs

200 papers

COVID-19 has shown the importance of having a fast response against pandemics. Finding a novel drug is a very long and complex procedure, and it is possible to accelerate the preliminary phases by using computer simulations. In particular,…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-09-13 Emanuele Vitali , Federico Ficarelli , Mauro Bisson , Davide Gadioli , Massimiliano Fatica , Andrea R. Beccari , Gianluca Palermo

Large-scale observational health databases are increasingly popular for conducting comparative effectiveness and safety studies of medical products. However, increasing number of patients poses computational challenges when fitting survival…

Computation · Statistics 2023-10-26 Jianxiao Yang , Martijn J. Schuemie , Xiang Ji , Marc A. Suchard

Approximate Nearest Neighbor Search (ANNS) has become fundamental to modern deep learning applications, having gained particular prominence through its integration into recent generative models that work with increasingly complex datasets…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-03-28 Yuntao Gui , Peiqi Yin , Xiao Yan , Chaorui Zhang , Weixi Zhang , James Cheng

Neighbor search is of fundamental important to many engineering and science fields such as physics simulation and computer graphics. This paper proposes to formulate neighbor search as a ray tracing problem and leverage the dedicated ray…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-03-10 Yuhao Zhu

We introduce FastGraph, a novel GPU-optimized k-nearest neighbor algorithm specifically designed to accelerate graph construction in low-dimensional spaces (2-10 dimensions), critical for high-performance graph neural networks. Our method…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-11-14 Aarush Agarwal , Raymond He , Jan Kieseler , Matteo Cremonesi , Shah Rukh Qasim

Customizing Convolution Neural Networks (CNN) for production use has been a challenging task for DL practitioners. This paper intends to expedite the model customization with a model hub that contains the optimized models tiered by their…

Computer Vision and Pattern Recognition · Computer Science 2022-05-03 Linnan Wang , Chenhan Yu , Satish Salian , Slawomir Kierat , Szymon Migacz , Alex Fit Florea

Graph neural networks (GNNs) have extended the success of deep neural networks (DNNs) to non-Euclidean graph data, achieving ground-breaking performance on various tasks such as node classification and graph property prediction.…

Machine Learning · Computer Science 2021-12-17 Tianfeng Liu , Yangrui Chen , Dan Li , Chuan Wu , Yibo Zhu , Jun He , Yanghua Peng , Hongzheng Chen , Hongzhi Chen , Chuanxiong Guo

Nearest neighbor search plays a fundamental role in many disciplines such as multimedia information retrieval, data-mining, and machine learning. The graph-based search approaches show superior performance over other types of approaches in…

Information Retrieval · Computer Science 2022-04-05 Hui Wang , Yong Wang , Wan-Lei Zhao

Computing $k$-Nearest Neighbors (KNN) is one of the core kernels used in many machine learning, data mining and scientific computing applications. Although kd-tree based $O(\log n)$ algorithms have been proposed for computing KNN, due to…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-11-17 Md. Mostofa Ali Patwary , Nadathur Rajagopalan Satish , Narayanan Sundaram , Jialin Liu , Peter Sadowski , Evan Racah , Suren Byna , Craig Tull , Wahid Bhimji , Prabhat , Pradeep Dubey

k-nearest neighbor graph is a key data structure in many disciplines such as manifold learning, machine learning and information retrieval, etc. NN-Descent was proposed as an effective solution for the graph construction problem. However,…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-03-30 Hui Wang , Wan-Lei Zhao , Xiangxiang Zeng

Approximate Nearest Neighbor Search (ANNS) plays a critical role in various disciplines spanning data mining and artificial intelligence, from information retrieval and computer vision to natural language processing and recommender systems.…

Data Structures and Algorithms · Computer Science 2024-07-10 Hiroyuki Ootomo , Akira Naruse , Corey Nolet , Ray Wang , Tamas Feher , Yong Wang

The recommendation system is a software system to predict customers' unknown preferences from known preferences. In the recommendation system, customers' preferences are encoded into vectors, and finding the nearest vectors to each vector…

Information Retrieval · Computer Science 2010-07-16 Kimikazu Kato , Tikara Hosino

This paper presents a novel nearest neighbor search algorithm achieving TPU (Google Tensor Processing Unit) peak performance, outperforming state-of-the-art GPU algorithms with similar level of recall. The design of the proposed algorithm…

Performance · Computer Science 2022-07-01 Felix Chern , Blake Hechtman , Andy Davis , Ruiqi Guo , David Majnemer , Sanjiv Kumar

Web recommendations provide personalized items from massive catalogs for users, which rely heavily on retrieval stages to trade off the effectiveness and efficiency of selecting a small relevant set from billion-scale candidates in online…

Machine Learning · Computer Science 2025-02-18 Zhuoning Guo , Guangxing Chen , Qian Gao , Xiaochao Liao , Jianjia Zheng , Lu Shen , Hao Liu

Similarity search is a key to a variety of applications including content-based search for images and video, recommendation systems, data deduplication, natural language processing, computer vision, databases, computational biology, and…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-07-11 Vincent T. Lee , Amrita Mazumdar , Carlo C. del Mundo , Armin Alaghi , Luis Ceze , Mark Oskin

We design, implement, and evaluate GPU-based algorithms for the maximum cardinality matching problem in bipartite graphs. Such algorithms have a variety of applications in computer science, scientific computing, bioinformatics, and other…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-03-07 Mehmet Deveci , Kamer Kaya , Bora Ucar , Umit V. Catalyurek

Temporal Graph Neural Networks (TGNNs) have emerged as powerful tools for modeling dynamic interactions across various domains. The design space of TGNNs is notably complex, given the unique challenges in runtime efficiency and scalability…

Machine Learning · Computer Science 2024-12-31 Yuxin Yang , Hongkuan Zhou , Rajgopal Kannan , Viktor Prasanna

Structural parameters are normally extracted from observed galaxies by fitting analytic light profiles to the observations. Obtaining accurate fits to high-resolution images is a computationally expensive task, requiring many model…

Instrumentation and Methods for Astrophysics · Physics 2015-03-17 Benjamin R. Barsdell , David G. Barnes , Christopher J. Fluke

This paper presents a novel approach for similarity search with complex filtering capabilities on billion-scale datasets, optimized for CPU inference. Our method extends the classical IVF-Flat index structure to integrate multi-dimensional…

Information Retrieval · Computer Science 2025-01-24 Simeon Emanuilov , Aleksandar Dimov

Nowadays, data is represented by vectors. Retrieving those vectors, among millions and billions, that are similar to a given query is a ubiquitous problem, known as similarity search, of relevance for a wide range of applications.…

Machine Learning · Computer Science 2023-07-26 Cecilia Aguerrebere , Ishwar Bhati , Mark Hildebrand , Mariano Tepper , Ted Willke