English
Related papers

Related papers: General Graph Random Features

200 papers

We introduce in this paper the mechanism of graph random features (GRFs). GRFs can be used to construct unbiased randomized estimators of several important kernels defined on graphs' nodes, in particular the regularized Laplacian kernel. As…

Machine Learning · Computer Science 2023-05-02 Krzysztof Choromanski

Graph kernels are widely used for measuring the similarity between graphs. Many existing graph kernels, which focus on local patterns within graphs rather than their global properties, suffer from significant structure information loss when…

Machine Learning · Computer Science 2019-12-02 Lingfei Wu , Ian En-Hsu Yen , Zhen Zhang , Kun Xu , Liang Zhao , Xi Peng , Yinglong Xia , Charu Aggarwal

We study the application of graph random features (GRFs) - a recently introduced stochastic estimator of graph node kernels - to scalable Gaussian processes on discrete input spaces. We prove that (under mild assumptions) Bayesian inference…

Machine Learning · Computer Science 2025-09-29 Matthew Zhang , Jihao Andreas Lin , Krzysztof Choromanski , Adrian Weller , Richard E. Turner , Isaac Reid

We present a new paradigm for creating random features to approximate bi-variate functions (in particular, kernels) defined on general manifolds. This new mechanism of Manifold Random Features (MRFs) leverages discretization of the manifold…

Machine Learning · Computer Science 2026-05-19 Ananya Parashar , Derek Long , Dwaipayan Saha , Krzysztof Choromanski

We propose refined GRFs (GRFs++), a new class of Graph Random Features (GRFs) for efficient and accurate computations involving kernels defined on the nodes of a graph. GRFs++ resolve some of the long-standing limitations of regular GRFs,…

Machine Learning · Computer Science 2025-10-10 Krzysztof Choromanski , Avinava Dubey , Arijit Sehanobish , Isaac Reid

We consider learning on graphs, guided by kernels that encode similarity between vertices. Our focus is on random walk kernels, the analogues of squared exponential kernels in Euclidean spaces. We show that on large, locally treelike,…

Machine Learning · Statistics 2013-10-01 Matthew Urry , Peter Sollich

Graph-structured data arise in wide applications, such as computer vision, bioinformatics, and social networks. Quantifying similarities among graphs is a fundamental problem. In this paper, we develop a framework for computing graph…

Machine Learning · Statistics 2018-09-11 Zhen Zhang , Mianzhi Wang , Yijian Xiang , Yan Huang , Arye Nehorai

We present Graph Random Neural Features (GRNF), a novel embedding method from graph-structured data to real vectors based on a family of graph neural networks. The embedding naturally deals with graph isomorphism and preserves the metric…

Machine Learning · Computer Science 2020-06-03 Daniele Zambon , Cesare Alippi , Lorenzo Livi

We present a novel mechanism to improve the accuracy of the recently-introduced class of graph random features (GRFs). Our method induces negative correlations between the lengths of the algorithm's random walks by imposing antithetic…

Machine Learning · Statistics 2023-05-23 Isaac Reid , Krzysztof Choromanski , Adrian Weller

Accurately analyzing graph properties of social networks is a challenging task because of access limitations to the graph data. To address this challenge, several algorithms to obtain unbiased estimates of properties from few samples via a…

Social and Information Networks · Computer Science 2020-07-14 Kazuki Nakajima , Kazuyuki Shudo

Random walks are at the heart of many existing deep learning algorithms for graph data. However, such algorithms have many limitations that arise from the use of random walks, e.g., the features resulting from these methods are unable to…

In recent years, graph neural networks (GNNs) have gained increasing popularity and have shown very promising results for data that are represented by graphs. The majority of GNN architectures are designed based on developing new…

Machine Learning · Statistics 2021-10-05 Anahita Iravanizad , Edgar Ivan Sanchez Medina , Martin Stoll

We present the first linear time complexity randomized algorithms for unbiased approximation of the celebrated family of general random walk kernels (RWKs) for sparse graphs. This includes both labelled and unlabelled instances. The…

Machine Learning · Computer Science 2024-10-16 Krzysztof Choromanski , Isaac Reid , Arijit Sehanobish , Avinava Dubey

The graphlet kernel is a classical method in graph classification. It however suffers from a high computation cost due to the isomorphism test it includes. As a generic proxy, and in general at the cost of losing some information, this test…

Machine Learning · Computer Science 2020-10-19 Hashem Ghanem , Nicolas Keriven , Nicolas Tremblay

Using random walks for sampling has proven advantageous in assessing the characteristics of large and unknown social networks. Several algorithms based on random walks have been introduced in recent years. In the practical application of…

Social and Information Networks · Computer Science 2024-09-18 Tsuyoshi Hasegawa , Shiori Hironaka , Kazuyuki Shudo

Various Graph Neural Networks (GNNs) have been successful in analyzing data in non-Euclidean spaces, however, they have limitations such as oversmoothing, i.e., information becomes excessively averaged as the number of hidden layers…

Machine Learning · Computer Science 2024-01-23 Jaeyoon Sim , Sooyeon Jeon , InJun Choi , Guorong Wu , Won Hwa Kim

The task of representing entire graphs has seen a surge of prominent results, mainly due to learning convolutional neural networks (CNNs) on graph-structured data. While CNNs demonstrate state-of-the-art performance in graph classification…

Machine Learning · Computer Science 2018-06-11 Sergey Ivanov , Evgeny Burnaev

Rethink convolution-based graph neural networks (GNN) -- they characteristically suffer from limited expressiveness, over-smoothing, and over-squashing, and require specialized sparse kernels for efficient computation. Here, we design a…

Machine Learning · Computer Science 2024-10-01 Yuanqing Wang , Kyunghyun Cho

For a graph representation of a dataset, a straightforward normality measure for a sample can be its graph degree. Considering a weighted graph, degree of a sample is the sum of the corresponding row's values in a similarity matrix. The…

Machine Learning · Computer Science 2018-02-06 Caglar Aytekin , Francesco Cricri , Lixin Fan , Emre Aksu

Modeling non-stationary processes, where statistical properties vary across the input domain, is a critical challenge in machine learning; yet most scalable methods rely on a simplifying assumption of stationarity. This forces a difficult…

Machine Learning · Computer Science 2026-02-03 Sawan Kumar , Souvik Chakraborty
‹ Prev 1 2 3 10 Next ›