English
Related papers

Related papers: Taming graph kernels with random features

200 papers

We propose a novel random walk-based algorithm for unbiased estimation of arbitrary functions of a weighted adjacency matrix, coined universal graph random features (u-GRFs). This includes many of the most popular examples of kernels…

Machine Learning · Statistics 2024-05-27 Isaac Reid , Krzysztof Choromanski , Eli Berger , Adrian Weller

We study the application of graph random features (GRFs) - a recently introduced stochastic estimator of graph node kernels - to scalable Gaussian processes on discrete input spaces. We prove that (under mild assumptions) Bayesian inference…

Machine Learning · Computer Science 2025-09-29 Matthew Zhang , Jihao Andreas Lin , Krzysztof Choromanski , Adrian Weller , Richard E. Turner , Isaac Reid

We present a novel mechanism to improve the accuracy of the recently-introduced class of graph random features (GRFs). Our method induces negative correlations between the lengths of the algorithm's random walks by imposing antithetic…

Machine Learning · Statistics 2023-05-23 Isaac Reid , Krzysztof Choromanski , Adrian Weller

We propose refined GRFs (GRFs++), a new class of Graph Random Features (GRFs) for efficient and accurate computations involving kernels defined on the nodes of a graph. GRFs++ resolve some of the long-standing limitations of regular GRFs,…

Machine Learning · Computer Science 2025-10-10 Krzysztof Choromanski , Avinava Dubey , Arijit Sehanobish , Isaac Reid

We present a new paradigm for creating random features to approximate bi-variate functions (in particular, kernels) defined on general manifolds. This new mechanism of Manifold Random Features (MRFs) leverages discretization of the manifold…

Machine Learning · Computer Science 2026-05-19 Ananya Parashar , Derek Long , Dwaipayan Saha , Krzysztof Choromanski

Graph kernels are widely used for measuring the similarity between graphs. Many existing graph kernels, which focus on local patterns within graphs rather than their global properties, suffer from significant structure information loss when…

Machine Learning · Computer Science 2019-12-02 Lingfei Wu , Ian En-Hsu Yen , Zhen Zhang , Kun Xu , Liang Zhao , Xi Peng , Yinglong Xia , Charu Aggarwal

The graphlet kernel is a classical method in graph classification. It however suffers from a high computation cost due to the isomorphism test it includes. As a generic proxy, and in general at the cost of losing some information, this test…

Machine Learning · Computer Science 2020-10-19 Hashem Ghanem , Nicolas Keriven , Nicolas Tremblay

Graph kernels have become an established and widely-used technique for solving classification tasks on graphs. This survey gives a comprehensive overview of techniques for kernel-based graph classification developed in the past 15 years. We…

Machine Learning · Computer Science 2020-02-05 Nils M. Kriege , Fredrik D. Johansson , Christopher Morris

We present a unified framework to study graph kernels, special cases of which include the random walk graph kernel \citep{GaeFlaWro03,BorOngSchVisetal05}, marginalized graph kernel \citep{KasTsuIno03,KasTsuIno04,MahUedAkuPeretal04}, and…

Machine Learning · Computer Science 2010-11-30 S. V. N. Vishwanathan , Karsten M. Borgwardt , Imre Risi Kondor , Nicol N. Schraudolph

The robustness of the much-used Graph Convolutional Networks (GCNs) to perturbations of their input is becoming a topic of increasing importance. In this paper, the random GCN is introduced for which a random matrix theory analysis is…

Machine Learning · Computer Science 2022-02-22 Mohamed El Amine Seddik , Changmin Wu , Johannes F. Lutzeyer , Michalis Vazirgiannis

In large-scale regression problems, random Fourier features (RFFs) have significantly enhanced the computational scalability and flexibility of Gaussian processes (GPs) by defining kernels through their spectral density, from which a finite…

Machine Learning · Computer Science 2024-06-05 Houston Warren , Rafael Oliveira , Fabio Ramos

Kernel methods represent one of the most powerful tools in machine learning to tackle problems expressed in terms of function values and derivatives due to their capability to represent and model complex relations. While these methods show…

Statistics Theory · Mathematics 2015-11-06 Bharath K. Sriperumbudur , Zoltan Szabo

Consider the setting of \emph{randomly weighted graphs}, namely, graphs whose edge weights are chosen independently according to probability distributions with finite support over the non-negative reals. Under this setting, properties of…

Data Structures and Algorithms · Computer Science 2010-03-30 Yuval Emek , Amos Korman , Yuval Shavitt

Graph neural networks (GNNs) are powerful machine learning models for various graph learning tasks. Recently, the limitations of the expressive power of various GNN models have been revealed. For example, GNNs cannot distinguish some…

Machine Learning · Computer Science 2021-01-19 Ryoma Sato , Makoto Yamada , Hisashi Kashima

Graph-structured data arise in wide applications, such as computer vision, bioinformatics, and social networks. Quantifying similarities among graphs is a fundamental problem. In this paper, we develop a framework for computing graph…

Machine Learning · Statistics 2018-09-11 Zhen Zhang , Mianzhi Wang , Yijian Xiang , Yan Huang , Arye Nehorai

Gaussian Conditional Random Fields (GCRF), as a structured regression model, is designed to achieve higher regression accuracy than unstructured predictors at the expense of execution time, taking into account the objects similarities and…

Machine Learning · Computer Science 2019-09-04 Milan Bašić , Branko Arsić , Zoran Obradović

The method of "random Fourier features (RFF)" has become a popular tool for approximating the "radial basis function (RBF)" kernel. The variance of RFF is actually large. Interestingly, the variance can be substantially reduced by a simple…

Machine Learning · Computer Science 2017-02-22 Ping Li

Machine learning methods on graphs have proven useful in many applications due to their ability to handle generally structured data. The framework of Gaussian Markov Random Fields (GMRFs) provides a principled way to define Gaussian models…

Machine Learning · Statistics 2022-06-13 Joel Oskarsson , Per Sidén , Fredrik Lindsten

Kernels on graphs have had limited options for node-level problems. To address this, we present a novel, generalized kernel for graphs with node feature data for semi-supervised learning. The kernel is derived from a regularization…

Machine Learning · Computer Science 2022-11-29 Yin-Cong Zhi , Felix L. Opolka , Yin Cheng Ng , Pietro Liò , Xiaowen Dong

We present the first linear time complexity randomized algorithms for unbiased approximation of the celebrated family of general random walk kernels (RWKs) for sparse graphs. This includes both labelled and unlabelled instances. The…

Machine Learning · Computer Science 2024-10-16 Krzysztof Choromanski , Isaac Reid , Arijit Sehanobish , Avinava Dubey
‹ Prev 1 2 3 10 Next ›