English
Related papers

Related papers: Adaptive spectral regularizations of high dimensio…

200 papers

We consider the problem of recovering a signal observed in Gaussian noise. If the set of signals is convex and compact, and can be specified beforehand, one can use classical linear estimators that achieve a risk within a constant factor of…

Statistics Theory · Mathematics 2017-06-05 Dmitry Ostrovsky , Zaid Harchaoui , Anatoli Juditsky , Arkadi Nemirovski

In this paper, the traditional model based variational method and learning based algorithms are naturally integrated to address mixed noise removal problem. To be different from single type noise (e.g. Gaussian) removal, it is a challenge…

Computer Vision and Pattern Recognition · Computer Science 2018-05-22 Faqiang Wang , Haiyang Huang , Jun Liu

Data noising is an effective technique for regularizing neural network models. While noising is widely adopted in application domains such as vision and speech, commonly used noising primitives have not been developed for discrete…

Machine Learning · Computer Science 2017-03-09 Ziang Xie , Sida I. Wang , Jiwei Li , Daniel Lévy , Aiming Nie , Dan Jurafsky , Andrew Y. Ng

B-spline models are a powerful way to represent scientific data sets with a functional approximation. However, these models can suffer from spurious oscillations when the data to be approximated are not uniformly distributed. Model…

Numerical Analysis · Mathematics 2023-01-04 David Lenz , Raine Yeh , Vijay Mahadevan , Iulian Grindeanu , Tom Peterka

The main goal in this paper is to propose a new method for deriving oracle inequalities related to the exponential weighting method. For the sake of simplicity we focus on recovering an unknown vector from noisy data with the help of a…

Statistics Theory · Mathematics 2012-11-20 Elena Chernousova , Yuri Golubev , Katerina Krymova

We consider the problem of recovering an unknown effectively $(s_1,s_2)$-sparse low-rank-$R$ matrix $X$ with possibly non-orthogonal rank-$1$ decomposition from incomplete and inaccurate linear measurements of the form $y = \mathcal A (X) +…

Numerical Analysis · Mathematics 2020-07-29 Massimo Fornasier , Johannes Maly , Valeriya Naumova

Regularization is a core component of modern inverse problems, as it helps establish the well-posedness of the solution of interest. Popular regularization approaches include variational regularization and iterative regularization. The…

Optimization and Control · Mathematics 2025-08-08 Jie Gao , Cesare Molinari , Silvia Villa , Jingwei Liang

In this paper, we propose Selective Output Smoothing Regularization, a novel regularization method for training the Convolutional Neural Networks (CNNs). Inspired by the diverse effects on training from different samples, Selective Output…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Xuan Cheng , Tianshu Xie , Xiaomin Wang , Qifeng Weng , Minghui Liu , Jiali Deng , Ming Liu

Inverse problems play a key role in modern image/signal processing methods. However, since they are generally ill-conditioned or ill-posed due to lack of observations, their solutions may have significant intrinsic uncertainty. Analysing…

Signal Processing · Electrical Eng. & Systems 2019-09-09 Xiaohao Cai , Marcelo Pereyra , Jason D. McEwen

We study empirical and hierarchical Bayes approaches to the problem of estimating an infinite-dimensional parameter in mildly ill-posed inverse problems. We consider a class of prior distributions indexed by a hyperparameter that quantifies…

Statistics Theory · Mathematics 2013-05-30 B. T. Knapik , B. T. Szabó , A. W. van der Vaart , J. H. van Zanten

Spectral embedding is a popular technique for the representation of graph data. Several regularization techniques have been proposed to improve the quality of the embedding with respect to downstream tasks like clustering. In this paper, we…

Machine Learning · Computer Science 2019-12-24 Nathan de Lara , Thomas Bonald

We consider the problem of detecting edges in piecewise smooth functions from their N-degree spectral content, which is assumed to be corrupted by noise. There are three scales involved: the "smoothness" scale of order 1/N, the noise scale…

Numerical Analysis · Mathematics 2007-05-23 Shlomo Engelberg , Eitan Tadmor

Recovering high quality surfaces from noisy triangulated surfaces is a fundamental important problem in geometry processing. Sharp features including edges and corners can not be well preserved in most existing denoising methods except the…

Computational Geometry · Computer Science 2021-01-07 Zheng Liu , Rongjie Lai , Huayan Zhang , Chunlin Wu

Discrete inverse problems correspond to solving a system of equations in a stable way with respect to noise in the data. A typical approach to enforce uniqueness and select a meaningful solution is to introduce a regularizer. While for most…

Optimization and Control · Mathematics 2022-04-22 Cristian Vega , Cesare Molinari , Lorenzo Rosasco , Silvia Villa

Recovering linear subspaces from data is a fundamental and important task in statistics and machine learning. Motivated by heterogeneity in Federated Learning settings, we study a basic formulation of this problem: the principal component…

Machine Learning · Computer Science 2022-10-26 John Duchi , Vitaly Feldman , Lunjia Hu , Kunal Talwar

Reconstructing the unknown spectrum of a given X-ray source is a common problem in a wide range of X-ray imaging tasks. For high-energy sources, transmission measurements are mostly used to recover the X-ray spectrum, as a solution to an…

Applied Physics · Physics 2023-07-13 Arthur Walker , Alexandre Friou , Kevin Ginsburger

In this paper we consider variational regularization methods for inverse problems with large noise that is in general unbounded in the image space of the forward operator. We introduce a Banach space setting that allows to define a…

Numerical Analysis · Mathematics 2018-02-09 Martin Burger , Tapio Helin , Hanne Kekkonen

In this paper, we study the hard and soft support vector regression techniques applied to a set of $n$ linear measurements of the form $y_i=\boldsymbol{\beta}_\star^{T}{\bf x}_i +n_i$ where $\boldsymbol{\beta}_\star$ is an unknown vector,…

Machine Learning · Computer Science 2021-05-24 Houssem Sifaou , Abla kammoun , Mohamed-Slim Alouini

High-dimensional inference refers to problems of statistical estimation in which the ambient dimension of the data may be comparable to or possibly even larger than the sample size. We study an instance of high-dimensional inference in…

Statistics Theory · Mathematics 2009-12-31 Sahand Negahban , Martin J. Wainwright

Optical spectra contain a wealth of information about the physical properties and formation histories of galaxies. Often though, spectra are too noisy for this information to be accurately retrieved. In this study, we explore how machine…

Astrophysics of Galaxies · Physics 2023-10-17 M. Scourfield , A. Saintonge , D. de Mijolla , S. Viti