English
Related papers

Related papers: On regularized Radon-Nikodym differentiation

200 papers

Estimating Kullback Leibler (KL) divergence from samples of two distributions is essential in many machine learning problems. Variational methods using neural network discriminator have been proposed to achieve this task in a scalable…

Machine Learning · Computer Science 2021-10-01 Sandesh Ghimire , Aria Masoomi , Jennifer Dy

Bayesian inference problems require sampling or approximating high-dimensional probability distributions. The focus of this paper is on the recently introduced Stein variational gradient descent methodology, a class of algorithms that rely…

Machine Learning · Statistics 2023-02-14 A. Duncan , N. Nuesken , L. Szpruch

Let $G/K$ be a Riemannian symmetric space of noncompact type, and let $\nu_{a_j}$, $j=1,...,r$ be some orbital measures on $G$ (see the definition below). The aim of this paper is to study the $L^{2}$-regularity (resp. $C^k$-smoothness) of…

Representation Theory · Mathematics 2021-07-27 Boudjemaa Anchouche

Conditional stability estimates allow us to characterize the degree of ill-posedness of many inverse problems, but without further assumptions they are not sufficient for the stable solution in the presence of data perturbations. We here…

Numerical Analysis · Mathematics 2018-10-17 Herbert Egger , Bernd Hofmann

Random smoothing data augmentation is a unique form of regularization that can prevent overfitting by introducing noise to the input data, encouraging the model to learn more generalized features. Despite its success in various…

Machine Learning · Statistics 2023-05-15 Liang Ding , Tianyang Hu , Jiahang Jiang , Donghao Li , Wenjia Wang , Yuan Yao

We study the non-parametric estimation of a multidimensional unknown density f in a tomography problem based on independent and identically distributed observations, whose common density is proportional to the Radon transform of f. We…

Statistics Theory · Mathematics 2023-06-28 Sergio Brenner Miguel , Janine Steck

This paper establishes $L^p$-improving estimates for a variety of Radon-like transforms which integrate functions over submanifolds of intermediate dimension. In each case, the results rely on a unique notion of curvature which relates to,…

Classical Analysis and ODEs · Mathematics 2016-09-13 Philip T. Gressman

We present estimators for smooth Hilbert-valued parameters, where smoothness is characterized by a pathwise differentiability condition. When the parameter space is a reproducing kernel Hilbert space, we provide a means to obtain efficient,…

Statistics Theory · Mathematics 2023-09-28 Alex Luedtke , Incheoul Chung

Network regularization is an effective tool for incorporating structural prior knowledge to learn coherent models over networks, and has yielded provably accurate estimates in applications ranging from spatial economics to neuroimaging…

Machine Learning · Computer Science 2020-06-02 Hongyuan You , Furkan Kocayusufoglu , Ambuj K. Singh

In this paper, we show that the approximation of high-dimensional functions, which are effectively low-dimensional, does not suffer from the curse of dimensionality. This is shown first in a general reproducing kernel Hilbert space set-up…

Numerical Analysis · Mathematics 2024-11-28 Christian Rieger , Holger Wendland

This paper studies a Nystr\"om type subsampling approach to large kernel learning methods in the misspecified case, where the target function is not assumed to belong to the reproducing kernel Hilbert space generated by the underlying…

Machine Learning · Statistics 2018-06-05 Shuai Lu , Peter Mathé , Sergiy Pereverzyev

In this contribution, we are concerned with model order reduction in the context of iterative regularization methods for the solution of inverse problems arising from parameter identification in elliptic partial differential equations. Such…

Numerical Analysis · Mathematics 2024-10-14 Michael Kartmann , Tim Keil , Mario Ohlberger , Stefan Volkwein , Barbara Kaltenbacher

Algebraic convergences rates of (iterated) Tikhonov regularization for linear inverse problems in Hilbert spaces are characterized by the membership of the exact solution to intermediate spaces produced by the K-method of real…

Numerical Analysis · Mathematics 2015-09-30 Roman Andreev

In this article, we propose a novel regularization method for a class of nonlinear inverse problems that is inspired by an application in quantitative magnetic resonance imaging (qMRI). The latter is a special instance of a general…

Optimization and Control · Mathematics 2025-06-16 Guozhi Dong , Michael Hintermüller , Clemens Sirotenko

Kernel mean embeddings, a widely used technique in machine learning, map probability distributions to elements of a reproducing kernel Hilbert space (RKHS). For supervised learning problems, where input-output pairs are observed, the…

Machine Learning · Statistics 2024-10-24 Ambrus Tamás , Balázs Csanád Csáji

Modeling the localized intensive deformation in a damaged solid requires highly refined discretization for accurate prediction, which significantly increases the computational cost. Although adaptive model refinement can be employed for…

Computational Engineering, Finance, and Science · Computer Science 2022-05-18 Jonghyuk Baek , Jiun-Shyan Chen , Kristen Susuki

A growing number of RNA sequences are now known to have distributions of multiple stable sequences. Recent algorithms use the list of nucleotides in a sequence and auxiliary experimental data to predict such distributions. Although the…

Combinatorics · Mathematics 2020-09-14 Torin Greenwood , Christine E. Heitsch

The performance of adaptive estimators that employ embedding in reproducing kernel Hilbert spaces (RKHS) depends on the choice of the location of basis kernel centers. Parameter convergence and error approximation rates depend on where and…

Systems and Control · Electrical Eng. & Systems 2020-09-08 Sai Tej Paruchuri , Jia Guo , Andrew Kurdila

We extend an implicit regularization scheme to be applicable in the $n$-dimensional space-time. Within this scheme divergences involving parity violating objects can be consistently treated without recoursing to dimensional continuation.…

High Energy Physics - Theory · Physics 2016-09-06 A. P. B. Scarpelli , M. Sampaio , M. C. Nemes

Convergence rates in spectral regularization methods quantify the approximation error in inverse problems as a function of the noise level or the number of sampling points. Classical strong convergence rate results typically rely on source…

Numerical Analysis · Mathematics 2025-12-05 Sabrina Guastavino , Gabriele Santin , Francesco Marchetti , Federico Benvenuto