English
Related papers

Related papers: Kernel Based Reconstruction for Generalized Graph …

200 papers

Graph learning, or network inference, is a prominent problem in graph signal processing (GSP). GSP generalizes the Fourier transform to non-Euclidean domains, and graph learning is pivotal to applying GSP when these domains are unknown.…

Machine Learning · Computer Science 2025-05-16 Changhao Shi , Gal Mishne

The generalization error curve of certain kernel regression method aims at determining the exact order of generalization error with various source condition, noise level and choice of the regularization parameter rather than the minimax…

Machine Learning · Computer Science 2024-11-26 Yicheng Li , Weiye Gan , Zuoqiang Shi , Qian Lin

Graph vertex sampling set selection aims at selecting a set of ver-tices of a graph such that the space of graph signals that can be reconstructed exactly from those samples alone is maximal. In this context, we propose to extend sampling…

Signal Processing · Electrical Eng. & Systems 2020-04-24 Benjamin Girault , Antonio Ortega , Shrikanth S. Narayayan

Kernel and linear regression have been recently explored in the prediction of graph signals as the output, given arbitrary input signals that are agnostic to the graph. In many real-world problems, the graph expands over time as new nodes…

Machine Learning · Computer Science 2019-11-27 Arun Venkitaraman , Saikat Chatterjee , Bo Wahlberg

We consider the problem of learning a set from random samples. We show how relevant geometric and topological properties of a set can be studied analytically using concepts from the theory of reproducing kernel Hilbert spaces. A new kind of…

Machine Learning · Statistics 2014-11-26 Ernesto De Vito , Lorenzo Rosasco , Alessandro Toigo

The classical distributed storage problem can be modeled by a k-uniform {\it complete} hyper-graph where vertices represent servers and hyper-edges represent users. Hence each hyper-edge should be able to recover the full file using only…

Information Theory · Computer Science 2017-02-16 Saeid Sahraei , Michael Gastpar

Recurrent neural networks (RNNs) are brain-inspired models widely used in machine learning for analyzing sequential data. The present work is a contribution towards a deeper understanding of how RNNs process input signals using the response…

Machine Learning · Statistics 2021-02-15 Soon Hoe Lim

Kernelization is an important tool in parameterized algorithmics. Given an input instance accompanied by a parameter, the goal is to compute in polynomial time an equivalent instance of the same problem such that the size of the reduced…

Computational Complexity · Computer Science 2018-10-23 Till Fluschnik , George B. Mertzios , André Nichterlein

In this paper we study the scale-space classification of signals via the maximal set of kernels. We use a geometric approach which arises naturally when we consider parameter variations in scale-space. We derive the Fourier transform…

Classical Analysis and ODEs · Mathematics 2023-05-23 Leon A. Luxemburg , Steven B. Damelin

We present a unified framework to study graph kernels, special cases of which include the random walk graph kernel \citep{GaeFlaWro03,BorOngSchVisetal05}, marginalized graph kernel \citep{KasTsuIno03,KasTsuIno04,MahUedAkuPeretal04}, and…

Machine Learning · Computer Science 2010-11-30 S. V. N. Vishwanathan , Karsten M. Borgwardt , Imre Risi Kondor , Nicol N. Schraudolph

We address the problem of filling missing entries in a kernel Gram matrix, given a related full Gram matrix. We attack this problem from the viewpoint of regression, assuming that the two kernel matrices can be considered as explanatory…

Quantitative Methods · Quantitative Biology 2011-11-10 Yoshihiro Yamanishi , Jean-Philippe Vert

We propose a new point of view for regularizing deep neural networks by using the norm of a reproducing kernel Hilbert space (RKHS). Even though this norm cannot be computed, it admits upper and lower approximations leading to various…

Machine Learning · Statistics 2019-05-15 Alberto Bietti , Grégoire Mialon , Dexiong Chen , Julien Mairal

We consider the problem of classifying graphs using graph kernels. We define a new graph kernel, called the generalized shortest path kernel, based on the number and length of shortest paths between nodes. For our example classification…

Data Structures and Algorithms · Computer Science 2015-11-20 Linus Hermansson , Fredrik D. Johansson , Osamu Watanabe

The emerging field of graph signal processing (GSP) allows to transpose classical signal processing operations (e.g., filtering) to signals on graphs. The GSP framework is generally built upon the graph Laplacian, which plays a crucial role…

Signal Processing · Electrical Eng. & Systems 2020-08-25 Miljan Petrovic , Raphael Liegeois , Thomas A. W. Bolton , Dimitri Van De Ville

Graph kernels are conventional methods for computing graph similarities. However, the existing R-convolution graph kernels cannot resolve both of the two challenges: 1) Comparing graphs at multiple different scales, and 2) Considering the…

Machine Learning · Computer Science 2024-05-14 Wei Ye , Hao Tian , Qijun Chen

In presence of sparse noise we propose kernel regression for predicting output vectors which are smooth over a given graph. Sparse noise models the training outputs being corrupted either with missing samples or large perturbations. The…

Machine Learning · Statistics 2018-11-07 Arun Venkitaraman , Pascal Frossard , Saikat Chatterjee

Ridgeless regression has garnered attention among researchers, particularly in light of the ``Benign Overfitting'' phenomenon, where models interpolating noisy samples demonstrate robust generalization. However, kernel ridgeless regression…

Machine Learning · Computer Science 2024-06-04 Fan He , Mingzhen He , Lei Shi , Xiaolin Huang , Johan A. K. Suykens

In this paper, we investigate a divide and conquer approach to Kernel Ridge Regression (KRR). Given n samples, the division step involves separating the points based on some underlying disjoint partition of the input space (possibly via…

Machine Learning · Statistics 2016-08-08 Rashish Tandon , Si Si , Pradeep Ravikumar , Inderjit Dhillon

Graphs serve as generic tools to encode the underlying relational structure of data. Often this graph is not given, and so the task of inferring it from nodal observations becomes important. Traditional approaches formulate a convex inverse…

Machine Learning · Computer Science 2024-06-24 Max Wasserman , Gonzalo Mateos

We show that Gaussian process regression (GPR) allows representing multivariate functions with low-dimensional terms via kernel design. When using a kernel built with HDMR (High-dimensional model representation), one obtains a similar type…

Numerical Analysis · Mathematics 2023-01-27 Eita Sasaki , Manabu Ihara , Sergei Manzhos