English
Related papers

Related papers: On regularized Radon-Nikodym differentiation

200 papers

Optimization on Riemannian manifolds widely arises in eigenvalue computation, density functional theory, Bose-Einstein condensates, low rank nearest correlation, image registration, and signal processing, etc. We propose an adaptive…

Optimization and Control · Mathematics 2017-08-08 Jiang Hu , Andre Milzarek , Zaiwen Wen , Yaxiang Yuan

Regularization approaches have demonstrated their effectiveness for solving ill-posed problems. However, in the context of variational restoration methods, a challenging question remains, which is how to find a good regularizer. While total…

Optimization and Control · Mathematics 2011-10-25 Nelly Pustelnik , Caroline Chaux , Jean-Christophe Pesquet

We consider a class of statistical inverse problems involving the estimation of a regression operator from a Polish space to a separable Hilbert space, where the target lies in a vector-valued reproducing kernel Hilbert space induced by an…

Machine Learning · Statistics 2026-04-28 Jia-Qi Yang , Lei Shi

This paper presents a new general formulation of the Radon-Nikodym theorem in the setting of abstract measure theory. We introduce the notion of weak localizability for a measure and show that this property is both necessary and sufficient…

General Mathematics · Mathematics 2025-12-03 Paolo Roselli , Michel Willem

In this paper, we present an efficient algorithm for solving a class of chance constrained optimization under non-parametric uncertainty. Our algorithm is built on the possibility of representing arbitrary distributions as functions in…

Robotics · Computer Science 2018-11-26 Bharath Gopalakrishnan , Arun Kumar Singh , K. Madhava Krishna , Dinesh Manocha

Functional linear regression is one of the fundamental and well-studied methods in functional data analysis. In this work, we investigate the functional linear regression model within the context of reproducing kernel Hilbert space by…

Statistics Theory · Mathematics 2024-12-12 Naveen Gupta , S. Sivananthan , Bharath K. Sriperumbudur

Estimation of the mean and covariance functions is a fundamental problem in functional data analysis, particularly for discretely observed functional data. In this work, we study a regularization-based framework for estimating the mean and…

Statistics Theory · Mathematics 2026-03-20 Naveen Gupta , Bharath K Sriperumbudur

Reduced modeling in high-dimensional reproducing kernel Hilbert spaces offers the opportunity to approximate efficiently non-linear dynamics. In this work, we devise an algorithm based on low rank constraint optimization and kernel-based…

Machine Learning · Computer Science 2020-02-23 Patrick Heas , Cedric Herzet , Benoit Combes

Distributionally robust optimization (DRO) has attracted attention in machine learning due to its connections to regularization, generalization, and robustness. Existing work has considered uncertainty sets based on phi-divergences and…

Machine Learning · Computer Science 2019-05-28 Matthew Staib , Stefanie Jegelka

We propose a nonparametric method to learn the L\'evy density from probability density data governed by a nonlocal Fokker-Planck equation. We recast the problem as identifying the kernel in a nonlocal integral operator from discrete data,…

Numerical Analysis · Mathematics 2025-12-30 Luxuan Yang , Fei Lu , Ting Gao , Wei Wei , Jinqiao Duan

We consider a class of regularization methods for inverse problems where a coupled regularization is employed for the simultaneous reconstruction of data from multiple sources. Applications for such a setting can be found in multi-spectral…

Optimization and Control · Mathematics 2018-08-01 Martin Holler , Richard Huber , Florian Knoll

Problems of interpolation, classification, and clustering are considered. In the tenets of Radon--Nikodym approach $\langle f(\mathbf{x})\psi^2 \rangle / \langle\psi^2\rangle$, where the $\psi(\mathbf{x})$ is a linear function on input…

Machine Learning · Computer Science 2021-09-14 Vladislav Gennadievich Malyshkin

We provide an overview of recent progress in statistical inverse problems with random experimental design, covering both linear and nonlinear inverse problems. Different regularization schemes have been studied to produce robust and stable…

Statistics Theory · Mathematics 2023-12-27 Abhishake , Tapio Helin , Nicole Mücke

Regularity estimates for an integral operator with a symmetric continuous kernel on a convex bounded domain are derived. The covariance of a mean-square continuous random field on the domain is an example of such an operator. The estimates…

Probability · Mathematics 2022-04-25 Mihály Kovács , Annika Lang , Andreas Petersson

Higher-order regularization problem formulations are popular frameworks used in machine learning, inverse problems and image/signal processing. In this paper, we consider the computational problem of finding the minimizer of the Sobolev…

Numerical Analysis · Mathematics 2023-10-20 Adrien Weihs , Jalal Fadili , Matthew Thorpe

The reconstruction of images from their corresponding noisy Radon transform is a typical example of an ill-posed linear inverse problem as arising in the application of computerized tomography (CT). As the (naive) solution does not depend…

The Radon cumulative distribution transform (R-CDT) exploits one-dimensional Wasserstein transport and the Radon transform to represent prominent features in images. It is closely related to the sliced Wasserstein distance and facilitates…

Numerical Analysis · Mathematics 2026-02-02 Matthias Beckmann , Robert Beinert , Jonas Bresch

By selecting different filter functions, spectral algorithms can generate various regularization methods to solve statistical inverse problems within the learning-from-samples framework. This paper combines distributed spectral algorithms…

Machine Learning · Statistics 2025-02-18 Jiading Liu , Lei Shi

A new Hardy space Hardy space approach of Dirichlet type problem based on Tikhonov regularization and Reproducing Hilbert kernel space is discussed in this paper, which turns out to be a typical extremal problem located on the upper…

Numerical Analysis · Mathematics 2017-05-31 Zhulin Liu , C. L. Philip Chen

This paper presents a regularized Newton method (RNM) with generalized regularization terms for unconstrained convex optimization problems. The generalized regularization includes quadratic, cubic, and elastic net regularizations as special…

Optimization and Control · Mathematics 2024-07-11 Yuya Yamakawa , Nobuo Yamashita