English
Related papers

Related papers: Optimization-based frequentist confidence interval…

200 papers

We study confidence interval construction for linear regression under Huber's contamination model, where an unknown fraction of noise variables is arbitrarily corrupted. While robust point estimation in this setting is well understood,…

Statistics Theory · Mathematics 2026-04-03 Dong Xie , Chao Gao , John Lafferty

In this paper, we propose an abstract procedure for debiasing constrained or regularized potentially high-dimensional linear models. It is elementary to show that the proposed procedure can produce $\frac{1}{\sqrt{n}}$-confidence intervals…

Methodology · Statistics 2023-01-12 Yufei Yi , Matey Neykov

We consider the maximum likelihood estimation of sparse inverse covariance matrices. We demonstrate that current heuristic approaches primarily encourage robustness, instead of the desired sparsity. We give a novel approach that solves the…

Machine Learning · Statistics 2021-11-08 Dimitris Bertsimas , Jourdain Lamperski , Jean Pauphilet

Our work is focused on the joint sparsity recovery problem where the common sparsity pattern is corrupted by Poisson noise. We formulate the confidence-constrained optimization problem in both least squares (LS) and maximum likelihood (ML)…

Machine Learning · Statistics 2013-10-10 E. Chunikhina , R. Raich , T. Nguyen

We consider the constrained Linear Inverse Problem (LIP), where a certain atomic norm (like the $\ell_1 $ norm) is minimized subject to a quadratic constraint. Typically, such cost functions are non-differentiable, which makes them not…

Optimization and Control · Mathematics 2025-07-08 Mohammed Rayyan Sheriff , Floor Fenne Redel , Peyman Mohajerin Esfahani

Inverse optimization refers to the inference of unknown parameters of an optimization problem based on knowledge of its optimal solutions. This paper considers inverse optimization in the setting where measurements of the optimal solutions…

Optimization and Control · Mathematics 2017-12-27 Anil Aswani , Zuo-Jun Max Shen , Auyon Siddiq

The evaluation of the error to be attributed to cut efficiencies is a common question in the practice of experimental particle physics. Specifically, the need to evaluate the efficiency of the cuts for background removal, when they are…

Data Analysis, Statistics and Probability · Physics 2009-02-02 Gioacchino Ranucci

Our focus is on robust recovery algorithms in statistical linear inverse problem. We consider two recovery routines - the much studied linear estimate originating from Kuks and Olman [42] and polyhedral estimate introduced in [37]. It was…

Statistics Theory · Mathematics 2023-09-14 Yannis Bekri , Anatoli Juditsky , Arkadi Nemirovski

The upper bounds on the coverage probabilities of the confidence regions based on blockwise empirical likelihood [Kitamura (1997)] and nonstandard expansive empirical likelihood [Nordman et al. (2013)] methods for time series data are…

Methodology · Statistics 2014-08-01 Xianyang Zhang , Xiaofeng Shao

By representing the range of fair betting odds according to a pair of confidence set estimators, dual probability measures on parameter space called frequentist posteriors secure the coherence of subjective inference without any prior…

Statistics Theory · Mathematics 2012-05-02 David R. Bickel

We propose a frequentist testing procedure that maintains a defined coverage and is optimal in the sense that it gives maximal power to detect deviations from a null hypothesis when the alternative to the null hypothesis is sampled from a…

Applications · Statistics 2020-07-07 Christian Bartels , Johanna Mielke , Ekkehard Glimm

We derive computationally tractable formulations of the robust counterparts of convex quadratic and conic quadratic constraints that are concave in matrix-valued uncertain parameters. We do this for a broad range of uncertainty sets. In…

Optimization and Control · Mathematics 2022-04-07 Ahmadreza Marandi , Aharon Ben-Tal , Dick den Hertog , Bertrand Melenberg

Constructing valid confidence sets is a crucial task in statistical inference, yet traditional methods often face challenges when dealing with complex models or limited observed sample sizes. These challenges are frequently encountered in…

We consider the problem of constructing confidence intervals (CIs) for the population mean of $N$ values $\{x_1, \ldots, x_N\} \subset \Sigma^N$ based on a random sample of size $n$, denoted by $X^n \equiv (X_1, \ldots, X_n)$, drawn…

Statistics Theory · Mathematics 2026-03-17 Shubhanshu Shekhar , Aaditya Ramdas

Information-directed sampling (IDS) is a powerful framework for solving bandit problems which has shown strong results in both Bayesian and frequentist settings. However, frequentist IDS, like many other bandit algorithms, requires that one…

Machine Learning · Statistics 2025-03-10 Piotr M. Suder , Eric Laber

Conventional inverse optimization inputs a solution and finds the parameters of an optimization model that render a given solution optimal. The literature mostly focuses on inferring the objective function in linear problems when accepted…

Optimization and Control · Mathematics 2024-10-10 Houra Mahmoudzadeh , Kimia Ghobadi

In this paper, we propose and analyze a trust-region model-based algorithm for solving unconstrained stochastic optimization problems. Our framework utilizes random models of an objective function $f(x)$, obtained from stochastic…

Optimization and Control · Mathematics 2016-09-26 Ruobing Chen , Matt Menickelly , Katya Scheinberg

We present an improved Bayesian framework for performing inference of affine transformations of constrained functions. We focus on quadrature with nonnegative functions, a common task in Bayesian inference. We consider constraints on the…

Machine Learning · Computer Science 2019-02-28 Henry Chai , Roman Garnett

This paper proposes a statistically optimal approach for learning a function value using a confidence interval in a wide range of models, including general non-parametric estimation of an expected loss described as a stochastic programming…

Machine Learning · Statistics 2025-08-07 Arnab Ganguly , Tobias Sutter

Testing of hypotheses is a well studied topic in mathematical statistics. Recently, this issue has also been addressed in the context of Inverse Problems, where the quantity of interest is not directly accessible but only after the…

Statistics Theory · Mathematics 2024-04-09 Remo Kretschmann , Daniel Wachsmuth , Frank Werner