English
Related papers

Related papers: Scalable $k$-NN graph construction

200 papers

Graph-based approaches are empirically shown to be very successful for the nearest neighbor search (NNS). However, there has been very little research on their theoretical guarantees. We fill this gap and rigorously analyze the performance…

Data Structures and Algorithms · Computer Science 2020-08-21 Liudmila Prokhorenkova , Aleksandr Shekhovtsov

There has been significant recent interest in graph-based nearest neighbor search methods, many of which are centered on the construction of navigable graphs over high-dimensional point sets. A graph is navigable if we can successfully move…

Data Structures and Algorithms · Computer Science 2025-03-18 Haya Diwan , Jinrui Gou , Cameron Musco , Christopher Musco , Torsten Suel

We study the densest subgraph problem and its NP-hard densest at-most-$k$ subgraph variant through the lens of learning-augmented algorithms. We show that, given a reasonably accurate predictor that estimates whether a node belongs to the…

Data Structures and Algorithms · Computer Science 2026-04-16 Thai Bui , Luan Nguyen , Hoa T. Vu

Consistency training is a popular method to improve deep learning models in computer vision and natural language processing. Graph neural networks (GNNs) have achieved remarkable performance in a variety of network science learning tasks,…

Machine Learning · Computer Science 2021-10-14 Cole Hawkins , Vassilis N. Ioannidis , Soji Adeshina , George Karypis

The $k$-nearest neighbor ($k$-NN) algorithm is one of the most popular methods for nonparametric classification. However, a relevant limitation concerns the definition of the number of neighbors $k$. This parameter exerts a direct impact on…

Machine Learning · Computer Science 2024-09-10 Alexandre Luís Magalhães Levada , Frank Nielsen , Michel Ferreira Cardia Haddad

Finding the k-medianin a network involves identifying a subset of k vertices that minimize the total distance to all other vertices in a graph. This problem has been extensively studied in computer science, graph theory, operations…

Data Structures and Algorithms · Computer Science 2023-12-14 Roldan Pozo

Proximity graphs (PG) have gained increasing popularity as the state-of-the-art solutions to $k$-approximate nearest neighbor ($k$-ANN) search on high-dimensional data, which serves as a fundamental function in various fields, e.g.,…

Databases · Computer Science 2025-02-18 Shuo Yang , Jiadong Xie , Yingfan Liu , Jeffrey Xu Yu , Xiyue Gao , Qianru Wang , Yanguo Peng , Jiangtao Cui

Graph neural networks (GNNs) are a popular class of parametric model for learning over graph-structured data. Recent work has argued that GNNs primarily use the graph for feature smoothing, and have shown competitive results on benchmark…

Machine Learning · Computer Science 2020-11-20 Lingfan Yu , Jiajun Shen , Jinyang Li , Adam Lerer

Graph Neural Networks (GNNs) are powerful deep learning models to generate node embeddings on graphs. When applying deep GNNs on large graphs, it is still challenging to perform training in an efficient and scalable way. We propose a novel…

Machine Learning · Computer Science 2020-10-08 Hanqing Zeng , Hongkuan Zhou , Ajitesh Srivastava , Rajgopal Kannan , Viktor Prasanna

We propose a simple approach which, given distributed computing resources, can nearly achieve the accuracy of $k$-NN prediction, while matching (or improving) the faster prediction time of $1$-NN. The approach consists of aggregating…

Statistics Theory · Mathematics 2017-12-25 Lirong Xue , Samory Kpotufe

Dimensionality reduction is crucial both for visualization and preprocessing high dimensional data for machine learning. We introduce a novel method based on a hierarchy built on 1-nearest neighbor graphs in the original space which is used…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 M. Saquib Sarfraz , Marios Koulakis , Constantin Seibold , Rainer Stiefelhagen

The neighbourhood function N(t) of a graph G gives, for each t, the number of pairs of nodes <x, y> such that y is reachable from x in less that t hops. The neighbourhood function provides a wealth of information about the graph (e.g., it…

Data Structures and Algorithms · Computer Science 2011-01-27 Paolo Boldi , Marco Rosa , Sebastiano Vigna

Recently, Graph Neural Networks (GNNs) have greatly advanced the task of graph classification. Typically, we first build a unified GNN model with graphs in a given training set and then use this unified model to predict labels of all the…

Machine Learning · Computer Science 2021-12-15 Yiqi Wang , Yao Ma , Wei Jin , Chaozhuo Li , Charu Aggarwal , Jiliang Tang

Graph Neural Networks (GNNs) are a powerful representational tool for solving problems on graph-structured inputs. In almost all cases so far, however, they have been applied to directly recovering a final solution from raw inputs, without…

Machine Learning · Statistics 2020-01-16 Petar Veličković , Rex Ying , Matilde Padovano , Raia Hadsell , Charles Blundell

We propose an adaptive graph coarsening method to jointly learn graph neural network (GNN) parameters and merge nodes via K-means clustering during training. As real-world graphs grow larger, processing them directly becomes increasingly…

Machine Learning · Computer Science 2025-10-01 Rostyslav Olshevskyi , Madeline Navarro , Santiago Segarra

We introduce FastGraph, a novel GPU-optimized k-nearest neighbor algorithm specifically designed to accelerate graph construction in low-dimensional spaces (2-10 dimensions), critical for high-performance graph neural networks. Our method…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-11-14 Aarush Agarwal , Raymond He , Jan Kieseler , Matteo Cremonesi , Shah Rukh Qasim

Real-world graphs, such as social networks, financial transactions, and recommendation systems, often demonstrate dynamic behavior. This phenomenon, known as graph stream, involves the dynamic changes of nodes and the emergence and…

Machine Learning · Computer Science 2023-05-16 Yanping Zheng , Zhewei Wei , Jiajun Liu

Neighborhood graphs are a critical but often fragile step in spectral clustering of text embeddings. On realistic text datasets, standard $k$-NN graphs can contain many disconnected components at practical sparsity levels (small $k$),…

Machine Learning · Computer Science 2026-03-06 Marko Pranjić , Boshko Koloski , Nada Lavrač , Senja Pollak , Marko Robnik-Šikonja

Given a large graph, the densest-subgraph problem asks to find a subgraph with maximum average degree. When considering the top-$k$ version of this problem, a na\"ive solution is to iteratively find the densest subgraph and remove it in…

Data Structures and Algorithms · Computer Science 2017-08-30 Muhammad Anis Uddin Nasir , Aristides Gionis , Gianmarco De Francisci Morales , Sarunas Girdzijauskas

We address the efficiency issue for the construction of a deep graph neural network (GNN). The approach exploits the idea of representing each input graph as a fixed point of a dynamical system (implemented through a recurrent neural…

Machine Learning · Computer Science 2019-11-21 Claudio Gallicchio , Alessio Micheli