English
Related papers

Related papers: Optimal Explicit Binomial Confidence Interval with…

200 papers

This paper proposes a way of protecting probabilistic prediction models against changes in the data distribution, concentrating on the case of classification and paying particular attention to binary classification. This is important in…

Machine Learning · Computer Science 2021-10-26 Vladimir Vovk , Ivan Petej , Alex Gammerman

We present an optimization-based framework to construct confidence intervals for functionals in constrained inverse problems, ensuring valid one-at-a-time frequentist coverage guarantees. Our approach builds upon the now-called strict…

Statistics Theory · Mathematics 2024-04-18 Pau Batlle , Pratik Patil , Michael Stanley , Houman Owhadi , Mikael Kuusela

We study exact confidence intervals and two-sided hypothesis tests for univariate parameters of stochastically increasing discrete distributions, such as the binomial and Poisson distributions. It is shown that several popular methods for…

Statistics Theory · Mathematics 2016-10-03 MÅns Thulin , Silvelyn Zwanzig

Differential privacy has become a widely accepted notion of privacy, leading to the introduction and deployment of numerous privatization mechanisms. However, ensuring the privacy guarantee is an error-prone process, both in designing…

Information Theory · Computer Science 2019-05-27 Xiyang Liu , Sewoong Oh

In this paper, we introduce a new notion of guaranteed privacy that requires that the change of the range of the corresponding inclusion function to the true function is small. In particular, leveraging mixed-monotone inclusion functions,…

Optimization and Control · Mathematics 2022-09-26 Mohammad Khajenejad , Sonia Martinez

Evidential-EM (E2M) algorithm is an effective approach for computing maximum likelihood estimations under finite mixture models, especially when there is uncertain information about data. In this paper we present an extension of the E2M…

Artificial Intelligence · Computer Science 2015-01-08 Kuang Zhou , Arnaud Martin , Quan Pan

We study the fundamental task of estimating the median of an underlying distribution from a finite number of samples, under pure differential privacy constraints. We focus on distributions satisfying the minimal assumption that they have a…

Statistics Theory · Mathematics 2020-11-13 Christos Tzamos , Emmanouil-Vasileios Vlatakis-Gkaragkounis , Ilias Zadik

Using the techniques of [arXiv:0911.4271], upper bounds for a given confidence level are modified in an optimal fashion to incorporate the a priori information that the parameter being estimated is non-negative. A paradox with different…

Data Analysis, Statistics and Probability · Physics 2009-12-09 Fyodor V. Tkachov

In this paper, we introduce a method for approximating the solution to inference and optimization tasks in uncertain and deterministic reasoning. Such tasks are in general intractable for exact algorithms because of the large number of…

Artificial Intelligence · Computer Science 2012-12-12 David Ephraim Larkin

Probabilistic regression models typically use the Maximum Likelihood Estimation or Cross-Validation to fit parameters. These methods can give an advantage to the solutions that fit observations on average, but they do not pay attention to…

Applications · Statistics 2022-05-24 Naoufal Acharki , Antoine Bertoncello , Josselin Garnier

Coherent lower previsions are general probabilistic models allowing incompletely specified probability distributions. However, for complete description of a coherent lower prevision -- even on finite underlying sample spaces -- an infinite…

Probability · Mathematics 2022-09-29 Damjan Škulj

In this paper, we develop a general theory of truncated inverse binomial sampling. In this theory, the fixed-size sampling and inverse binomial sampling are accommodated as special cases. In particular, the classical Chernoff-Hoeffding…

Statistics Theory · Mathematics 2019-08-20 Xinjia Chen

We present novel bounds for estimating discrete probability distributions under the $\ell_\infty$ norm. These are nearly optimal in various precise senses, including a kind of instance-optimality. Our data-dependent convergence guarantees…

Statistics Theory · Mathematics 2024-02-14 Aryeh Kontorovich , Amichai Painsky

We introduce a pivot for exact selective inference with randomization. Not only does our pivot lead to exact inference in Gaussian regression models, but it is also available in closed form. We reduce the problem of exact selective…

Methodology · Statistics 2023-12-27 Snigdha Panigrahi , Kevin Fry , Jonathan Taylor

We propose a novel distribution-free scheme to solve optimization problems where the goal is to minimize the expected value of a cost function subject to probabilistic constraints. Unlike standard sampling-based methods, our idea consists…

Optimization and Control · Mathematics 2025-05-28 Francesco Cordiano , Matin Jafarian , Bart De Schutter

The Negative Binomial distribution becomes highly skewed under extreme dispersion. Even at moderately large sample sizes, the sample mean exhibits a heavy right tail. The standard Normal approximation often does not provide adequate…

Methodology · Statistics 2015-03-13 David Shilane , Derek Bean

This paper introduces a conformal inference method to evaluate uncertainty in classification by generating prediction sets with valid coverage conditional on adaptively chosen features. These features are carefully selected to reflect…

Machine Learning · Statistics 2024-10-31 Yanfei Zhou , Matteo Sesia

Bayesian optimization is a coherent, ubiquitous approach to decision-making under uncertainty, with applications including multi-arm bandits, active learning, and black-box optimization. Bayesian optimization selects decisions (i.e.…

Machine Learning · Computer Science 2023-12-13 Samuel Stanton , Wesley Maddox , Andrew Gordon Wilson

In this paper, we compute the tightest possible bounds on the probability that the optimal value of a combinatorial optimization problem in maximization form with a random objective exceeds a given number, assuming only knowledge of the…

Optimization and Control · Mathematics 2022-11-24 Divya Padmanabhan , Selin Damla Ahipasaoglu , Arjun Ramachandra , Karthik Natarajan

We consider the problem of distribution-free predictive inference, with the goal of producing predictive coverage guarantees that hold conditionally rather than marginally. Existing methods such as conformal prediction offer marginal…

Statistics Theory · Mathematics 2020-04-16 Rina Foygel Barber , Emmanuel J. Candès , Aaditya Ramdas , Ryan J. Tibshirani