English
Related papers

Related papers: Information bounds for inverse problems with appli…

200 papers

In a large class of statistical inverse problems it is necessary to suppose that the transformation that is inverted is known. Although, in many applications, it is unrealistic to make this assumption, the problem is often insoluble without…

Statistics Theory · Mathematics 2008-12-18 Aurore Delaigle , Peter Hall , Alexander Meister

In this paper, we further develop the approach, originating in [14 (arXiv:1311.6765),20 (arXiv:1604.02576)], to "computation-friendly" hypothesis testing and statistical estimation via Convex Programming. Specifically, we focus on…

Statistics Theory · Mathematics 2018-04-16 Anatoli Juditsky , Arkadi Nemirovski

We consider the problem of estimating the unknown response function in the multichannel deconvolution model with long-range dependent Gaussian errors. We do not limit our consideration to a specific type of long-range dependence rather we…

Statistics Theory · Mathematics 2016-09-29 Rida Benhaddou , Rafal Kulik , Marianna Pensky , Theofanis Sapatinas

In structured prediction problems where we have indirect supervision of the output, maximum marginal likelihood faces two computational obstacles: non-convexity of the objective and intractability of even a single gradient computation. In…

Machine Learning · Statistics 2016-08-11 Aditi Raghunathan , Roy Frostig , John Duchi , Percy Liang

Asymptotic lower bounds for estimation play a fundamental role in assessing the quality of statistical procedures. In this paper we propose a framework for obtaining semi-parametric efficiency bounds for sparse high-dimensional models,…

Statistics Theory · Mathematics 2017-10-16 Jana Jankova , Sara van de Geer

We consider noisy observations of a distribution with unknown support. In the deconvolution model, it has been proved recently [19] that, under very mild assumptions, it is possible to solve the deconvolution problem without knowing the…

Statistics Theory · Mathematics 2024-06-21 Jérémie Capitao-Miniconi , Elisabeth Gassiat , Luc Lehéricy

We consider the nonparametric estimation problem of time-dependent multivariate functions observed in a presence of additive cylindrical Gaussian white noise of a small intensity. We derive minimax lower bounds for the $L^2$-risk in the…

Statistics Theory · Mathematics 2012-11-02 Jérémie Bigot , Theofanis Sapatinas

In this paper, we investigate the matrix estimation problem in the multi-response regression model with measurement errors. A nonconvex error-corrected estimator based on a combination of the amended loss function and the nuclear norm…

Statistics Theory · Mathematics 2022-09-19 Xin Li , Dongya Wu

This paper proposes and analyzes a communication-efficient distributed optimization framework for general nonconvex nonsmooth signal processing and machine learning problems under an asynchronous protocol. At each iteration, worker machines…

Optimization and Control · Mathematics 2020-07-15 Jineng Ren , Jarvis Haupt

In this paper, we study nonparametric estimation of instrumental variable (IV) regressions. Recently, many flexible machine learning methods have been developed for instrumental variable estimation. However, these methods have at least one…

Machine Learning · Statistics 2023-02-13 Andrew Bennett , Nathan Kallus , Xiaojie Mao , Whitney Newey , Vasilis Syrgkanis , Masatoshi Uehara

The present paper establishes convolution theorems for regular estimators when the limit experiment is non-Gaussian or of infnite dimension with sparse parameter space. Applications are given for Gaussian shift experiments of infnite…

Statistics Theory · Mathematics 2013-09-20 Arnold Janssen , Vladimir Ostrovski

We consider the nonparametric estimation of a periodic function that is observed in additive Gaussian white noise after convolution with a ``boxcar,'' the indicator function of an interval. This is an idealized model for the problem of…

Statistics Theory · Mathematics 2007-06-13 Iain M. Johnstone , Marc Raimondo

In the blind deconvolution problem, we observe the convolution of an unknown filter and unknown signal and attempt to reconstruct the filter and signal. The problem seems impossible in general, since there are seemingly many more unknowns…

Information Theory · Computer Science 2021-06-15 Qingyun Sun , David Donoho

We consider the problem of decision-making with side information and unbounded loss functions. Inspired by probably approximately correct learning model, we use a slightly different model that incorporates the notion of side information in…

Machine Learning · Computer Science 2007-07-13 Majid Fozunbal , Ton Kalker

We propose a general framework for solving inverse problems in the presence of noise that requires no signal prior, no noise estimate, and no clean training data. We only require that the forward model be available and that the noise be…

Computer Vision and Pattern Recognition · Computer Science 2020-06-12 Hirofumi Kobayashi , Ahmet Can Solak , Joshua Batson , Loic A. Royer

We consider debiased inference on finite-dimensional functionals of infinite-dimensional least-squares solutions to inverse problems as a way to avoid having to assume exact solutions exist. Such assumptions are substantive and not…

Machine Learning · Statistics 2026-05-27 Zikai Shen , Nathan Kallus , Dimitri Meunier , Houssam Zenati , Arthur Gretton , Aurélien Bibaut

We consider the problem of estimating the value of a linear functional in nonparametric instrumental regression, where in the presence of an instrument W a response Y is modeled in dependence of an endogenous explanatory variable Z. The…

Statistics Theory · Mathematics 2009-02-13 Christoph Breunig , Jan Johannes

We consider the multichannel blind deconvolution problem where we observe the output of multiple channels that are all excited with the same unknown input. From these observations, we wish to estimate the impulse responses of each of the…

Numerical Analysis · Mathematics 2017-10-04 Kiryung Lee , Ning Tian , Justin Romberg

This paper addresses the problem of semiparametric efficiency bounds for conditional moment restriction models with different conditioning variables. We characterize such an efficiency bound, that in general is not explicit, as a limit of…

Statistics Theory · Mathematics 2011-11-29 Marian Hristache , Valentin Patilea

We consider the problem of estimating the density of the process associated with the small jumps of a pure jump L\'evy process, possibly of infinite variation, from discrete observations of one trajectory. The interest of such a question…

Statistics Theory · Mathematics 2024-12-10 Céline Duval , Taher Jalal , Ester Mariucci