English
Related papers

Related papers: Sharp Structure-Agnostic Lower Bounds for General …

200 papers

In many semiparametric models that are parameterized by two types of parameters---a Euclidean parameter of interest and an infinite-dimensional nuisance parameter---the two parameters are bundled together, that is, the nuisance parameter is…

Statistics Theory · Mathematics 2012-03-13 Ying Ding , Bin Nan

We propose an adversarial evaluation framework for sensitive feature inference based on minimum mean-squared error (MMSE) estimation with a finite sample size and linear predictive models. Our approach establishes theoretical lower bounds…

Machine Learning · Statistics 2025-05-15 Monica Welfert , Nathan Stromberg , Mario Diaz , Lalitha Sankar

We derive an efficient stochastic algorithm for inverse problems that present an unknown linear forcing term and a set of nonlinear parameters to be recovered. It is assumed that the data is noisy and that the linear part of the problem is…

Numerical Analysis · Mathematics 2019-09-17 Darko Volkov

In this paper, we propose a novel approach to fit a functional linear regression in which both the response and the predictor are functions of a common variable such as time. We consider the case that the response and the predictor…

Methodology · Statistics 2017-11-15 Behdad Mostafaiy , MohammadReza FaridRohani , Shojaeddin Chenouri

Stochastic Approximation has been a prominent set of tools for solving problems with noise and uncertainty. Increasingly, it becomes important to solve optimization problems wherein there is noise in both a set of constraints that a…

Optimization and Control · Mathematics 2025-07-29 Francisco Facchinei , Vyacheslav Kungurtsev

In this paper we present a generic framework for the asymptotic performance analysis of subspace-based parameter estimation schemes. It is based on earlier results on an explicit first-order expansion of the estimation error in the signal…

Performance · Computer Science 2012-09-17 Florian Roemer , Martin Haardt

We consider the multivariate max-linear regression problem where the model parameters $\boldsymbol{\beta}_{1},\dotsc,\boldsymbol{\beta}_{k}\in\mathbb{R}^{p}$ need to be estimated from $n$ independent samples of the (noisy) observations $y =…

Machine Learning · Statistics 2024-02-27 Seonho Kim , Sohail Bahmani , Kiryung Lee

In this paper, we develop a method to assess the sensitivity of local average treatment effect estimates to potential violations of the monotonicity assumption of Imbens and Angrist (1994). We parameterize the degree to which monotonicity…

Econometrics · Economics 2021-06-14 Claudia Noack

In this paper we present a unified framework for solving a general class of problems arising in the context of set-membership estimation/identification theory. More precisely, the paper aims at providing an original approach for the…

Systems and Control · Computer Science 2016-11-18 Vito Cerone , Jean-Bernard Lasserre , Dario Piga , Diego Regruto

This article introduces a new estimator of average treatment effects under unobserved confounding in modern data-rich environments featuring large numbers of units and outcomes. The proposed estimator is doubly robust, combining outcome…

Econometrics · Economics 2024-10-30 Alberto Abadie , Anish Agarwal , Raaz Dwivedi , Abhin Shah

We propose a new optimization framework for aleatoric uncertainty estimation in regression problems. Existing methods can quantify the error in the target estimation, but they tend to underestimate it. To obtain the predictive uncertainty…

Computer Vision and Pattern Recognition · Computer Science 2021-03-12 Takumi Kawashima , Qing Yu , Akari Asai , Daiki Ikami , Kiyoharu Aizawa

Estimation problems in the presence of deterministic linear nuisance parameters arise in a variety of fields. To cope with those, three common methods are widely considered: (1) jointly estimating the parameters of interest and the nuisance…

Optimization and Control · Mathematics 2018-07-05 Yongchang Hu , Geert Leus

We consider debiased inference on finite-dimensional functionals of infinite-dimensional least-squares solutions to inverse problems as a way to avoid having to assume exact solutions exist. Such assumptions are substantive and not…

Machine Learning · Statistics 2026-05-27 Zikai Shen , Nathan Kallus , Dimitri Meunier , Houssam Zenati , Arthur Gretton , Aurélien Bibaut

We provide a novel computer-assisted technique for systematically analyzing first-order methods for optimization. In contrast with previous works, the approach is particularly suited for handling sublinear convergence rates and stochastic…

Optimization and Control · Mathematics 2021-12-22 Adrien Taylor , Francis Bach

We develop a general framework for generating estimators of a given quantity which are unbiased to a given order in the difference between the true value of the underlying quantity and the fiducial position in theory space around which we…

Cosmology and Nongalactic Astrophysics · Physics 2015-06-22 Mathew S. Madhavacheril , Patrick McDonald , Neelima Sehgal , Anže Slosar

Instrumental variable methods are fundamental to causal inference when treatment assignment is confounded by unobserved variables. In this article, we develop a general nonparametric causal framework for identification and learning with…

Methodology · Statistics 2026-02-10 Shuyuan Chen , Peng Zhang , Yifan Cui

This paper addresses the observability analysis and the optimal design of observation parameters in the presence of noisy measurements and parametric uncertainties. The main underlying frameworks are the nonlinear constrained moving horizon…

Systems and Control · Electrical Eng. & Systems 2021-02-05 Mazen Alamir

We propose a formal model for counterfactual estimation with unobserved confounding in "data-rich" settings, i.e., where there are a large number of units and a large number of measurements per unit. Our model provides a bridge between the…

Econometrics · Economics 2025-04-03 Alberto Abadie , Anish Agarwal , Devavrat Shah

Causal inference from observational datasets often relies on measuring and adjusting for covariates. In practice, measurements of the covariates can often be noisy and/or biased, or only measurements of their proxies may be available.…

Machine Learning · Computer Science 2022-02-23 Wenshuo Guo , Mingzhang Yin , Yixin Wang , Michael I. Jordan

We consider the task of estimating a low-rank matrix from non-linear and noisy observations. We prove a strong universality result showing that Bayes-optimal performances are characterized by an equivalent Gaussian model with an effective…

Machine Learning · Statistics 2024-03-08 Pierre Mergny , Justin Ko , Florent Krzakala , Lenka Zdeborová