English
Related papers

Related papers: The Gaussian Radon Transform and Machine Learning

200 papers

We develop a new framework for estimating joint probability distributions using tensor product reproducing kernel Hilbert spaces (RKHS). Our framework accommodates a low-dimensional, normalized and positive model of a Radon--Nikodym…

Machine Learning · Statistics 2024-09-25 Damir Filipovic , Michael Multerer , Paul Schneider

We are interested in a framework of online learning with kernels for low-dimensional but large-scale and potentially adversarial datasets. We study the computational and theoretical performance of online variations of kernel Ridge…

Machine Learning · Statistics 2019-05-30 Rémi Jézéquel , Pierre Gaillard , Alessandro Rudi

We consider a Gaussian process formulation of the multiple kernel learning problem. The goal is to select the convex combination of kernel matrices that best explains the data and by doing so improve the generalisation on unseen data.…

Machine Learning · Statistics 2011-10-25 Cedric Archambeau , Francis Bach

We study a statistical model for infinite dimensional Gaussian random variables with unknown parameters. For this model we derive linear estimators for the mean and the variance of the Gaussian distribution. Furthermore, we construct…

Statistics Theory · Mathematics 2025-11-21 Stefan Tappe

In this work, we develop a Bayesian framework for solving inverse problems in which the unknown parameter belongs to a space of Radon measures taking values in a separable Hilbert space. The inherent ill-posedness of such problems is…

Statistics Theory · Mathematics 2025-05-02 Phuoc-Truong Huynh

Radio-frequency (RF) Radiance Field reconstruction is a challenging problem. The difficulty lies in the interactions between the propagating signal and objects, such as reflections and diffraction, which are hard to model precisely,…

Signal Processing · Electrical Eng. & Systems 2025-04-03 Chi-Shiang Gau , Xingyu Chen , Tara Javidi , Xinyu Zhang

A machine-learnable variational scheme using Gaussian radial basis functions (GRBFs) is presented and used to approximate linear problems on bounded and unbounded domains. In contrast to standard mesh-free methods, which use GRBFs to…

Numerical Analysis · Mathematics 2024-10-10 Jonas A. Actor , Anthony Gruber , Eric C. Cyr , Nathaniel Trask

The present paper provides a new representation of the solution to the fragmentation equation as a power series in the Banach space of Radon measures endowed with the total variation norm. This representation is used to justify how the…

Analysis of PDEs · Mathematics 2023-06-19 Marie Doumic , Miguel Escobedo , Magali Tournus

The purpose of this report is a study of the algebraic approach possibilities to reconstruct images. This approach is reduced to solution of the large system of linear algebraic equations. We also point out some possible further…

General Physics · Physics 2016-01-01 E. E. Libin , S. V. Chakhlov , D. Trinca

A Hilbert space embedding of a distribution---in short, a kernel mean embedding---has recently emerged as a powerful tool for machine learning and inference. The basic idea behind this framework is to map distributions into a reproducing…

Machine Learning · Statistics 2020-12-15 Krikamol Muandet , Kenji Fukumizu , Bharath Sriperumbudur , Bernhard Schölkopf

This paper studies kernel ridge regression in high dimensions under covariate shifts and analyzes the role of importance re-weighting. We first derive the asymptotic expansion of high dimensional kernels under covariate shifts. By a…

Machine Learning · Statistics 2024-06-06 Yihang Chen , Fanghui Liu , Taiji Suzuki , Volkan Cevher

The analytic inference, e.g. predictive distribution being in closed form, may be an appealing benefit for machine learning practitioners when they treat wide neural networks as Gaussian process in Bayesian setting. The realistic widths,…

Disordered Systems and Neural Networks · Physics 2023-08-01 Chi-Ken Lu

We present a theoretical analysis of Gaussian-binary restricted Boltzmann machines (GRBMs) from the perspective of density models. The key aspect of this analysis is to show that GRBMs can be formulated as a constrained mixture of…

Neural and Evolutionary Computing · Computer Science 2017-02-06 Nan Wang , Jan Melchior , Laurenz Wiskott

This paper addresses the covariate shift problem in the context of nonparametric regression within reproducing kernel Hilbert spaces (RKHSs). Covariate shift arises in supervised learning when the input distributions of the training and…

Machine Learning · Statistics 2025-05-21 Andrea Della Vecchia , Arnaud Mavakala Watusadisi , Ernesto De Vito , Lorenzo Rosasco

Focusing on a high dimensional linear model $y = X\beta + \epsilon$ with dependent, non-stationary, and heteroskedastic errors, this paper applies the debiased and threshold ridge regression method that gives a consistent estimator for…

Statistics Theory · Mathematics 2021-10-27 Yunyi Zhang , Dimitris N. Politis

We consider the problem of learning convolution operators associated to compact Abelian groups. We study a regularization-based approach and provide corresponding learning guarantees under natural regularity conditions on the convolution…

Machine Learning · Computer Science 2025-04-11 Emilia Magnani , Ernesto De Vito , Philipp Hennig , Lorenzo Rosasco

Reconstruction of a function from noisy data is often formulated as a regularized optimization problem over an infinite-dimensional reproducing kernel Hilbert space (RKHS). The solution describes the observed data and has a small RKHS norm.…

Machine Learning · Statistics 2013-07-18 Aleksandr Y. Aravkin , Bradley M. Bell , James V. Burke , Gianluigi Pillonetto

Here we present a new non-parametric approach to density estimation and classification derived from theory in Radon transforms and image reconstruction. We start by constructing a "forward problem" in which the unknown density is mapped to…

Numerical Analysis · Mathematics 2024-12-20 James Webber , Erika Hussey , Eric Miller , Shuchin Aeron

We prove a version of the Lebesgue Differentiation Theorem for mappings that are defined on a measure space and take values into a metric space, with respect to the differentiation basis induced by a von Neumann lifting. As a consequence,…

Functional Analysis · Mathematics 2022-07-26 Danka Lučić , Enrico Pasqualetto

In this work, we propose a simple kernel ridge regression (KRR) framework with a dynamic-aware validation strategy for long-term prediction of complex dynamical systems. By employing a data-driven kernel derived from diffusion maps, the…

Machine Learning · Computer Science 2025-12-30 Jiwoo Song , Daning Huang , John Harlim