English
Related papers

Related papers: On universal oracle inequalities related to high-d…

200 papers

Recently, model-driven deep learning unrolls a certain iterative algorithm of a regularization model into a cascade network by replacing the first-order information (i.e., (sub)gradient or proximal operator) of the regularizer with a…

Machine Learning · Computer Science 2021-12-24 Zhuo-Xu Cui , Jing Cheng , Qingyong Zhu , Yuanyuan Liu , Sen Jia , Kankan Zhao , Ziwen Ke , Wenqi Huang , Haifeng Wang , Yanjie Zhu , Dong Liang

In this work, we investigate the inverse problem of recovering a potential coefficient in an elliptic partial differential equation from the observations at deterministic sampling points in the domain subject to random noise. We employ a…

Numerical Analysis · Mathematics 2025-05-30 Bangti Jin , Qimeng Quan , Wenlong Zhang

This paper studies regularized least square recovery of signals whose samples' prior distributions are nonidentical, e.g., signals with time-variant sparsity. For this model, Bayesian framework suggests to regularize the least squares term…

Information Theory · Computer Science 2018-05-31 Ali Bereyhi , Mohammad Ali Sedaghat , Ralf R. Müller

We look at continuum solutions in optimisation problems associated to linear inverse problems $y = Ax$ with non-negativity constraint $x \geq 0$. We focus on the case where the noise model leads to maximum likelihood estimation through…

Optimization and Control · Mathematics 2023-04-20 Camille Pouchol , Olivier Verdier

We consider the problem of detecting edges in piecewise smooth functions from their N-degree spectral content, which is assumed to be corrupted by noise. There are three scales involved: the "smoothness" scale of order 1/N, the noise scale…

Numerical Analysis · Mathematics 2007-05-23 Shlomo Engelberg , Eitan Tadmor

We consider an inverse problem of recovering a potential associated to a semi-linear wave equation with a quadratic nonlinearity in $1 + 1$ dimensions. We develop a numerical scheme to determine the potential from a noisy…

Analysis of PDEs · Mathematics 2022-03-18 Matti Lassas , Tony Liimatainen , Leyter Potenciano-Machado , Teemu Tyni

Measurement noise is an integral part while collecting data of a physical process. Thus, noise removal is necessary to draw conclusions from these data, and it often becomes essential to construct dynamical models using these data. We…

Machine Learning · Computer Science 2022-05-20 Pawan Goyal , Peter Benner

We consider the problem of estimating the mean $f$ of a Gaussian vector $Y$ with independent components of common unknown variance $\sigma^{2}$. Our estimation procedure is based on estimator selection. More precisely, we start with an…

Statistics Theory · Mathematics 2011-06-24 Yannick Baraud , Christophe Giraud , Sylvie Huet

Popular machine learning estimators involve regularization parameters that can be challenging to tune, and standard strategies rely on grid search for this task. In this paper, we revisit the techniques of approximating the regularization…

Machine Learning · Statistics 2019-05-28 Eugene Ndiaye , Tam Le , Olivier Fercoq , Joseph Salmon , Ichiro Takeuchi

Our focus is on robust recovery algorithms in statistical linear inverse problem. We consider two recovery routines - the much studied linear estimate originating from Kuks and Olman [42] and polyhedral estimate introduced in [37]. It was…

Statistics Theory · Mathematics 2023-09-14 Yannis Bekri , Anatoli Juditsky , Arkadi Nemirovski

Ordinary differential equation (ODE) is widely used in modeling biological and physical processes in science. In this article, we propose a new reproducing kernel-based approach for estimation and inference of ODE given noisy observations.…

Methodology · Statistics 2021-10-26 Xiaowu Dai , Lexin Li

This paper investigates tradeoffs among optimization errors, statistical rates of convergence and the effect of heavy-tailed errors for high-dimensional robust regression with nonconvex regularization. When the additive errors in linear…

Statistics Theory · Mathematics 2021-01-01 Xiaoou Pan , Qiang Sun , Wen-Xin Zhou

Quantifying uncertainty of machine learning model predictions is essential for reliable decision-making, especially in safety-critical applications. Recently, uncertainty quantification (UQ) theory has advanced significantly, building on a…

Machine Learning · Computer Science 2025-10-01 Alexander Fishkov , Kajetan Schweighofer , Mykyta Ielanskyi , Nikita Kotelevskii , Mohsen Guizani , Maxim Panov

We consider the regression model with observation error in the design: y=X\theta* + e, Z=X+N. Here the random vector y in R^n and the random n*p matrix Z are observed, the n*p matrix X is unknown, N is an n*p random noise matrix, e in R^n…

Statistics Theory · Mathematics 2011-12-20 Mathieu Rosenbaum , Alexandre B. Tsybakov

We deal with the solution of a generic linear inverse problem in the Hilbert space setting. The exact right hand side is unknown and only accessible through discretised measurements corrupted by white noise with unknown arbitrary…

Numerical Analysis · Mathematics 2023-02-14 Bastian Harrach , Tim Jahn , Roland Potthast

Regularization in fitting regression models has been a highly active topic of research in the past few decades, but most of the existing methods are designed for particular situations, e.g. for the case of a sparse coefficient vector. We…

Methodology · Statistics 2025-05-15 Asaf Weinstein , Jonas Wallin , Daniel Yekutieli , Małgorzata Bogdan

We propose a new sparsity-smoothness penalty for high-dimensional generalized additive models. The combination of sparsity and smoothness is crucial for mathematical theory as well as performance for finite-sample data. We present a…

Machine Learning · Statistics 2009-11-18 Lukas Meier , Sara van de Geer , Peter Bühlmann

We propose a new formulation of robust regression by integrating all realizations of the uncertainty set and taking an averaged approach to obtain the optimal solution for the ordinary least squares regression problem. We show that this…

Machine Learning · Computer Science 2024-10-10 Dimitris Bertsimas , Yu Ma

In this paper, we consider estimating spot/instantaneous volatility matrices of high-frequency data collected for a large number of assets. We first combine classic nonparametric kernel-based smoothing with a generalised shrinkage technique…

Econometrics · Economics 2026-04-22 Ruijun Bu , Degui Li , Oliver Linton , Hanchao Wang

The throughout knowledge of a X-ray beam spectrum is mandatory to assess the quality of its source device. Since the techniques to directly measurement such spectra are expensive and laborious, the X-ray spectrum reconstruction using…

Computational Physics · Physics 2014-11-12 Olavo Henrique Menin , Alexandre Souto Martinez , Alessandro Martins da Costa