English
Related papers

Related papers: Kernel Based Reconstruction for Generalized Graph …

200 papers

In this paper, we are interested in constructing general graph-based regularizers for multiple kernel learning (MKL) given a structure which is used to describe the way of combining basis kernels. Such structures are represented by…

Machine Learning · Statistics 2014-02-14 Ziming Zhang

We focus on the distribution regression problem: regressing to a real-valued response from a probability distribution. Although there exist a large number of similarity measures between distributions, very little is known about their…

Statistics Theory · Mathematics 2015-01-28 Zoltan Szabo , Arthur Gretton , Barnabas Poczos , Bharath Sriperumbudur

These notes provide a self-contained introduction to kernel methods and their geometric foundations in machine learning. Starting from the construction of Hilbert spaces, we develop the theory of positive definite kernels, reproducing…

We prove the statistical consistency of kernel Partial Least Squares Regression applied to a bounded regression learning problem on a reproducing kernel Hilbert space. Partial Least Squares stands out of well-known classical approaches as…

Methodology · Statistics 2010-08-13 Gilles Blanchard , Nicole Kraemer

We propose a generalized sampling framework for stochastic graph signals. Stochastic graph signals are characterized by graph wide sense stationarity (GWSS) which is an extension of wide sense stationarity (WSS) for standard time-domain…

Signal Processing · Electrical Eng. & Systems 2023-05-17 Junya Hara , Yuichi Tanaka , Yonina C. Eldar

We consider the problem of reconstructing a function from a finite set of noise-corrupted samples. Two kernel algorithms are analyzed, namely kernel ridge regression and $\varepsilon$-support vector regression. By assuming the ground-truth…

Systems and Control · Electrical Eng. & Systems 2021-08-03 Emilio T. Maddalena , Paul Scharnhorst , Colin N. Jones

This paper establishes the first polynomial convergence rates for Gaussian kernel ridge regression (KRR) with a fixed hyperparameter in both the uniform and the $L^{2}$-norm. The uniform convergence result closes a gap in the theoretical…

Machine Learning · Statistics 2025-09-12 Paul Dommel , Rajmadan Lakshmanan

Kernel methods are among the most popular techniques in machine learning. From a frequentist/discriminative perspective they play a central role in regularization theory as they provide a natural choice for the hypotheses space and the…

Machine Learning · Statistics 2012-04-17 Mauricio A. Alvarez , Lorenzo Rosasco , Neil D. Lawrence

Inference of space-time varying signals on graphs emerges naturally in a plethora of network science related applications. A frequently encountered challenge pertains to reconstructing such dynamic processes, given their values over a…

Machine Learning · Computer Science 2018-09-25 Vassilis N. Ioannidis , Daniel Romero , Georgios B. Giannakis

Graph Signal Processing (GSP) extends classical signal processing to signals defined on graphs, enabling filtering, spectral analysis, and sampling of data generated by networks of various kinds. Graphon Signal Processing (GnSP) develops…

Signal Processing · Electrical Eng. & Systems 2026-04-30 Takuma Sumi , Georgi S. Medvedev

We study in this paper a smoothness regularization method for functional linear regression and provide a unified treatment for both the prediction and estimation problems. By developing a tool on simultaneous diagonalization of two positive…

Statistics Theory · Mathematics 2012-11-13 Ming Yuan , T. Tony Cai

A structure-preserving kernel ridge regression method is presented that allows the recovery of nonlinear Hamiltonian functions out of datasets made of noisy observations of Hamiltonian vector fields. The method proposes a closed-form…

Machine Learning · Statistics 2025-04-07 Jianyu Hu , Juan-Pablo Ortega , Daiying Yin

Graph Signal Processing (GSP) is a promising framework to analyze multi-dimensional neuroimaging datasets, while taking into account both the spatial and functional dependencies between brain signals. In the present work, we apply…

Computer Vision and Pattern Recognition · Computer Science 2017-08-29 Mathilde Ménoret , Nicolas Farrugia , Bastien Pasdeloup , Vincent Gripon

Graph signals arise in various applications, ranging from sensor networks to social media data. The high-dimensional nature of these signals implies that they often need to be compressed in order to be stored and transmitted. The common…

Signal Processing · Electrical Eng. & Systems 2021-10-26 Pei Li , Nir Shlezinger , Haiyang Zhang , Baoyun Wang , Yonina C. Eldar

Hyperspectral signal reconstruction aims at recovering the original spectral input that produced a certain trichromatic (RGB) response from a capturing device or observer. Given the heavily underconstrained, non-linear nature of the…

Computer Vision and Pattern Recognition · Computer Science 2018-03-15 Aitor Alvarez-Gila , Joost van de Weijer , Estibaliz Garrote

Statistical physics approaches can be used to derive accurate predictions for the performance of inference methods learning from potentially noisy data, as quantified by the learning curve defined as the average error versus number of…

Machine Learning · Statistics 2012-11-07 Matthew J. Urry , Peter Sollich

We study efficient preprocessing for the undirected Feedback Vertex Set problem, a fundamental problem in graph theory which asks for a minimum-sized vertex set whose removal yields an acyclic graph. More precisely, we aim to determine for…

Data Structures and Algorithms · Computer Science 2022-06-10 David Dekker , Bart M. P. Jansen

Accurately representing the sound field with the high spatial resolution is critical for immersive and interactive sound field reproduction technology. To minimize experimental effort, data-driven methods have been proposed to estimate…

Audio and Speech Processing · Electrical Eng. & Systems 2023-11-10 Zining Liang , Wen Zhang , Thushara D. Abhayapala

We consider the problem of signal recovery on graphs as graphs model data with complex structure as signals on a graph. Graph signal recovery implies recovery of one or multiple smooth graph signals from noisy, corrupted, or incomplete…

Social and Information Networks · Computer Science 2015-10-28 Siheng Chen , Aliaksei Sandryhaila , José M. F. Moura , Jelena Kovačević

Deep learning, particularly convolutional neural networks (CNNs), have yielded rapid, significant improvements in computer vision and related domains. But conventional deep learning architectures perform poorly when data have an underlying…

Signal Processing · Electrical Eng. & Systems 2020-12-02 Mark Cheung , John Shi , Oren Wright , Lavender Y. Jiang , Xujin Liu , José M. F. Moura