English
Related papers

Related papers: Implicit Regularization Effects of the Sobolev Nor…

200 papers

Sparse regression methods have been proven effective in a wide range of signal processing problems such as image compression, speech coding, channel equalization, linear regression and classification. In this paper a new convex method of…

Optimization and Control · Mathematics 2018-03-07 Victor Stefan Aldea

Regularized models are often sensitive to the scales of the features in the data and it has therefore become standard practice to normalize (center and scale) the features before fitting the model. But there are many different ways to…

Machine Learning · Statistics 2025-07-04 Johan Larsson , Jonas Wallin

We develop a kernel-based approach for estimating the spatially varying Sobolev regularity~$s$ of an unknown $d$-variate function~$f$ from scattered sampling data, which quantifies the degree of local differentiability supported by the…

Numerical Analysis · Mathematics 2026-01-29 Xiaobin Li , Leevan Ling , Yizhong Sun

Image denoising algorithms are evaluated using images corrupted by artificial noise, which may lead to incorrect conclusions about their performances on real noise. In this paper we introduce a dataset of color images corrupted by natural…

Computer Vision and Pattern Recognition · Computer Science 2018-02-06 Josue Anaya , Adrian Barbu

This work introduces a novel method for surface normal estimation from rectified stereo image pairs, leveraging affine transformations derived from disparity values to achieve fast and accurate results. We demonstrate how the rectification…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Csongor Csanad Kariko , Muhammad Rafi Faisal , Levente Hajder

Convex optimization with sparsity-promoting convex regularization is a standard approach for estimating sparse signals in noise. In order to promote sparsity more strongly than convex regularization, it is also standard practice to employ…

Computer Vision and Pattern Recognition · Computer Science 2015-06-17 Po-Yu Chen , Ivan W. Selesnick

Representing shapes as level sets of neural networks has been recently proved to be useful for different shape analysis and reconstruction tasks. So far, such representations were computed using either: (i) pre-computed implicit shape…

Machine Learning · Computer Science 2020-07-10 Amos Gropp , Lior Yariv , Niv Haim , Matan Atzmon , Yaron Lipman

Deep (neural) networks have been applied productively in a wide range of supervised and unsupervised learning tasks. Unlike classical machine learning algorithms, deep networks typically operate in the \emph{overparameterized} regime, where…

Machine Learning · Computer Science 2019-10-14 Daniel LeJeune , Randall Balestriero , Hamid Javadi , Richard G. Baraniuk

Modelling statistical relationships beyond the conditional mean is crucial in many settings. Conditional density estimation (CDE) aims to learn the full conditional probability density from data. Though highly expressive, neural network…

Machine Learning · Statistics 2020-02-17 Jonas Rothfuss , Fabio Ferreira , Simon Boehm , Simon Walther , Maxim Ulrich , Tamim Asfour , Andreas Krause

In this paper, we study the Tikhonov regularization scheme in Hilbert scales for the nonlinear statistical inverse problem with a general noise. The regularizing norm in this scheme is stronger than the norm in Hilbert space. We focus on…

Statistics Theory · Mathematics 2024-04-09 Abhishake Rastogi

The notion of implicit bias, or implicit regularization, has been suggested as a means to explain the surprising generalization ability of modern-days overparameterized learning algorithms. This notion refers to the tendency of the…

Machine Learning · Computer Science 2020-12-23 Assaf Dauber , Meir Feder , Tomer Koren , Roi Livni

We present a method for supervised learning of sparsity-promoting regularizers for denoising signals and images. Sparsity-promoting regularization is a key ingredient in solving modern signal reconstruction problems; however, the operators…

Machine Learning · Computer Science 2023-09-07 Avrajit Ghosh , Michael T. McCann , Madeline Mitchell , Saiprasad Ravishankar

In this paper we establish global well-posedness and instantaneous regularization results for the primitive equations with transport noise of H\"{o}lder regularity $ \gamma>\frac{1}{2}$. It is known that if $\gamma<1$, then the noise is too…

Analysis of PDEs · Mathematics 2024-01-11 Antonio Agresti

This paper presents a simple noise correction method for Sobol' indices estimation. Sobol' indices, especially total Sobol' indices are quite sensitive to the noise in the output and tend to be severly biased (overestimated) if no noise…

Computation · Statistics 2018-04-04 Pavel Prikhodko , Nikita Kotlyarov

In this paper, a two-step regularization method is used to solve an ill-posed spherical pseudo-differential equation in the presence of noisy data. For the first step of regularization we approximate the data by means of a spherical…

Numerical Analysis · Mathematics 2015-01-05 Hui Cao , Sergei V. Pereverzyev , Ian H. Sloan , Pavlo Tkachenko

We introduce a novel family of invariant, convex, and non-quadratic functionals that we employ to derive regularized solutions of ill-posed linear inverse imaging problems. The proposed regularizers involve the Schatten norms of the Hessian…

Optimization and Control · Mathematics 2014-02-20 Stamatios Lefkimmiatis , John Paul Ward , Michael Unser

This dissertation shows that careful injection of noise into sample data can substantially speed up Expectation-Maximization algorithms. Expectation-Maximization algorithms are a class of iterative algorithms for extracting maximum…

Machine Learning · Statistics 2014-11-26 Osonde Adekorede Osoba

Denoising by frame thresholding is one of the most basic and efficient methods for recovering a discrete signal or image from data that are corrupted by additive Gaussian white noise. The basic idea is to select a frame of analyzing…

Numerical Analysis · Mathematics 2015-01-21 Markus Haltmeier , Axel Munk

Variational segmentation algorithms require a prior imposed in the form of a regularisation term to enforce smoothness of the solution. Recently, it was shown in the Deep Image Prior work that the explicit regularisation in a model can be…

Computer Vision and Pattern Recognition · Computer Science 2021-12-03 Liam Burrows , Ke Chen , Francesco Torella

In this paper, we investigate a stochastic Hardy-Littlewood-Sobolev inequality. Due to the stochastic nature of the inequality, the relation between the exponents of intgrability is modified. This modification can be understood as a…

Analysis of PDEs · Mathematics 2017-11-21 Romain Duboscq , Anthony Réveillac