English
Related papers

Related papers: Optimization-based frequentist confidence interval…

200 papers

We consider decision-making problems that are formulated as non-convex optimization programs where uncertainty enters the constraints through an additive term, independent of the decision variables, and robustness is imposed using a finite…

Optimization and Control · Mathematics 2026-02-25 Alexander J Gallo , Massimiliano Zoggia , Alessandro Falsone , Maria Prandini , Simone Garatti

We target the problem of accuracy and robustness in causal inference from finite data sets. Some state-of-the-art algorithms produce clear output complete with solid theoretical guarantees but are susceptible to propagating erroneous…

Artificial Intelligence · Computer Science 2012-10-19 Tom Claassen , Tom Heskes

We treat uncertain linear programming problems by utilizing the notion of weighted analytic centers and notions from the area of multi-criteria decision making. After introducing our approach, we develop interactive cutting-plane algorithms…

Optimization and Control · Mathematics 2018-05-21 Mehdi Karimi , Somayeh Moazeni , Levent Tuncel

We consider the problem of guessing the realization of a random variable but under more general Tsallis' non-extensive entropic framework rather than the classical Maxwell-Boltzman-Gibbs-Shannon framework. We consider both the conditional…

Information Theory · Computer Science 2019-05-21 Abhik Ghosh

The problem of minimizing convex functionals of probability distributions is solved under the assumption that the density of every distribution is bounded from above and below. A system of sufficient and necessary first-order optimality…

Information Theory · Computer Science 2018-12-05 Michael Fauss , Abdelhak M. Zoubir

Regularization is a central tool for addressing ill-posedness in inverse problems and statistical estimation, with the choice of a suitable penalty often determining the reliability and interpretability of downstream solutions. While recent…

Optimization and Control · Mathematics 2025-10-07 Oscar Leong , Eliza O'Reilly , Yong Sheng Soh

Optimizing objective functions subject to constraints is fundamental in many real-world applications. However, these constraints are often not readily defined and must be inferred from expert agent behaviors, a problem known as Inverse…

Machine Learning · Computer Science 2025-05-19 Bo Yue , Jian Li , Guiliang Liu

We consider structural vector autoregressions subject to 'narrative restrictions', which are inequality restrictions on functions of the structural shocks in specific periods. These restrictions raise novel problems related to…

Econometrics · Economics 2021-02-15 Raffaella Giacomini , Toru Kitagawa , Matthew Read

The linear functional strategy for the regularization of inverse problems is considered. For selecting the regularization parameter therein, we propose the heuristic quasi-optimality principle and some modifications including the smoothness…

Numerical Analysis · Mathematics 2018-05-23 Stefan Kindermann , Sergiy Pereverzyev , Andrey Pilipenko

Profile likelihood confidence intervals are a robust alternative to Wald's method if the asymptotic properties of the maximum likelihood estimator are not met. However, the constrained optimization problem defining profile likelihood…

Computation · Statistics 2021-05-10 Samuel M. Fischer , Mark A. Lewis

We establish empirical risk minimization principles for active learning by deriving a family of upper bounds on the generalization error. Aligning with empirical observations, the bounds suggest that superior query algorithms can be…

Machine Learning · Statistics 2024-09-17 Vincent Menden , Yahya Saleh , Armin Iske

This paper focuses on investigating an inexact stochastic model-based optimization algorithm that integrates preconditioning techniques for solving stochastic composite optimization problems. The proposed framework unifies and extends the…

Optimization and Control · Mathematics 2025-12-12 Chenglong Bao , Yancheng Yuan , Shulan Zhu

We propose randomized confidence intervals based on the Neyman-Pearson lemma, in order to make them more broadly applicable to distributions that do not satisfy regularity conditions. This is achieved by using the definition of fuzzy…

This paper considers structural optimization under a reliability constraint, where the input distribution is only partially known. Specifically, when we only know that the expected value vector and the variance-covariance matrix of the…

Optimization and Control · Mathematics 2022-12-19 Yoshihiro Kanno

Inverse optimization has been increasingly used to estimate unknown parameters in an optimization model based on decision data. We show that such a point estimation is insufficient in a prescriptive setting where the estimated parameters…

Optimization and Control · Mathematics 2025-02-11 Bo Lin , Erick Delage , Timothy C. Y. Chan

This paper considers Bayesian optimization (BO) for problems with known outer problem structure. In contrast to the classic BO setting, where the objective function itself is unknown and needs to be iteratively estimated from noisy…

Optimization and Control · Mathematics 2025-03-19 Katrin Baumgärtner , Moritz Diehl

We provide the first global model recovery results for the IRLS (iteratively reweighted least squares) heuristic for robust regression problems. IRLS is known to offer excellent performance, despite bad initializations and data corruption,…

Machine Learning · Computer Science 2020-06-26 Bhaskar Mukhoty , Govind Gopakumar , Prateek Jain , Purushottam Kar

We propose and study three confidence intervals (CIs) centered at an estimator that is intentionally biased to reduce mean squared error. The first CI simply uses an unbiased estimator's standard error; compared to centering at the unbiased…

Econometrics · Economics 2025-02-04 David M. Kaplan , Xin Liu

In this paper, we prove that functional sliced inverse regression (FSIR) achieves the optimal (minimax) rate for estimating the central space in functional sufficient dimension reduction problems. First, we provide a concentration…

Statistics Theory · Mathematics 2025-04-16 Rui Chen , Songtao Tian , Dongming Huang , Qian Lin , Jun S. Liu

We introduce a graceful approach to probabilistic inference called bounded conditioning. Bounded conditioning monotonically refines the bounds on posterior probabilities in a belief network with computation, and converges on final…

Artificial Intelligence · Computer Science 2013-04-08 Eric J. Horvitz , Jaap Suermondt , Gregory F. Cooper