English
Related papers

Related papers: Optimal Confidence Regions for the Multinomial Par…

200 papers

Quantifying uncertainty in model predictions is a common goal for practitioners seeking more than just point predictions. One tool for uncertainty quantification that requires minimal assumptions is conformal inference, which can help…

Machine Learning · Statistics 2021-07-08 Benjamin LeRoy , David Zhao

A reliable representation of uncertainty is essential for the application of modern machine learning methods in safety-critical settings. In this regard, the use of credal sets (i.e., convex sets of probability distributions) has recently…

Machine Learning · Computer Science 2026-03-10 Paul Hofman , Timo Löhr , Maximilian Muschalik , Yusuf Sale , Eyke Hüllermeier

High-dimensional statistical inference with general estimating equations are challenging and remain less explored. In this paper, we study two problems in the area: confidence set estimation for multiple components of the model parameters,…

Methodology · Statistics 2021-04-28 Jinyuan Chang , Song Xi Chen , Cheng Yong Tang , Tong Tong Wu

The construction of confidence intervals for the mean of a bounded random variable is a classical problem in statistics with numerous applications in machine learning and virtually all scientific fields. In particular, obtaining the…

Machine Learning · Computer Science 2025-11-12 Václav Voráček , Francesco Orabona

The most fundamental problem in statistics is the inference of an unknown probability distribution from a finite number of samples. For a specific observed data set, answers to the following questions would be desirable: (1) Estimation:…

Statistics Theory · Mathematics 2013-01-23 Ali Kinkhabwala

Prediction sets can wrap around any ML model to cover unknown test outcomes with a guaranteed probability. Yet, it remains unclear how to use them optimally for downstream decision-making. Here, we propose a decision-theoretic framework…

Machine Learning · Statistics 2026-02-10 Tao Wang , Edgar Dobriban

In the context of selective inference, confidence envelopes for the false discoveries allow the user to select any subset of null hypotheses while having a statistical guarantee on the number of false discoveries in the selected set. Many…

Statistics Theory · Mathematics 2026-04-22 Romain Périer , Gilles Blanchard , Sebastian Döhler , Guillermo Durand , Etienne Roquain

Many scientific analyses require simultaneous comparison of multiple functionals of an unknown signal at once, calling for multidimensional confidence regions with guaranteed simultaneous frequentist under structural constraints (e.g.,…

Statistics Theory · Mathematics 2025-10-14 Pau Batlle , Pratik Patil , Michael Stanley , Javier Ruiz Lupon , Houman Owhadi , Mikael Kuusela

We introduce a new framework for creating point-wise confidence intervals for the distribution of event times for current status data. Existing methods are based on asymptotics. Our framework is based on binomial properties and motivates…

Methodology · Statistics 2022-08-17 Sungwook Kim , Michael P. Fay , Michael A. Proschan

Many applications, including natural language processing, sensor networks, collaborative filtering, and federated learning, call for estimating discrete distributions from data collected in batches, some of which may be untrustworthy,…

Machine Learning · Computer Science 2020-02-26 Ayush Jain , Alon Orlitsky

The current standard for confidence interval construction in the context of a possibly misspecified model is to use an interval based on the sandwich estimate of variance. These intervals provide asymptotically correct coverage, but…

Methodology · Statistics 2015-12-31 James W. Harmon , Peter D. Hoff

Multivariate probabilistic time series forecasts are commonly evaluated via proper scoring rules, i.e., functions that are minimal in expectation for the ground-truth distribution. However, this property is not sufficient to guarantee good…

Machine Learning · Computer Science 2023-06-07 Étienne Marcotte , Valentina Zantedeschi , Alexandre Drouin , Nicolas Chapados

We study statistical estimation under local differential privacy (LDP) when users may hold heterogeneous privacy levels and accuracy must be guaranteed with high probability. Departing from the common in-expectation analyses, and for…

Machine Learning · Statistics 2025-10-15 Maryam Aliakbarpour , Alireza Fallah , Swaha Roy , Ria Stevens

We propose a method for estimating disparity confidence intervals in stereo matching problems. Confidence intervals provide complementary information to usual confidence measures. To the best of our knowledge, this is the first method…

Computer Vision and Pattern Recognition · Computer Science 2024-04-10 Roman Malinowski , Emmanuelle Sarrazin , Loïc Dumas , Emmanuel Dubois , Sébastien Destercke

We propose confidence regions for the parameters of incomplete models with exact coverage of the true parameter in finite samples. Our confidence region inverts a test, which generalizes Monte Carlo tests to incomplete models. The test…

Econometrics · Economics 2025-10-07 Lixiong Li , Marc Henry

Multivariate histograms are difficult to construct due to the curse of dimensionality. Motivated by $k$-d trees in computer science, we show how to construct an efficient data-adaptive partition of Euclidean space that possesses the…

Methodology · Statistics 2023-08-03 Guenther Walther , Qian Zhao

Let $p$ be an unknown and arbitrary probability distribution over $[0,1)$. We consider the problem of {\em density estimation}, in which a learning algorithm is given i.i.d. draws from $p$ and must (with high probability) output a…

Machine Learning · Computer Science 2014-11-04 Siu-On Chan , Ilias Diakonikolas , Rocco A. Servedio , Xiaorui Sun

While substantial advances are observed in probabilistic forecasting for power system operation and electricity market applications, most approaches are still developed in a univariate framework. This prevents from informing about the…

Applications · Statistics 2017-08-10 Faranak Golestaneh , Pierre Pinson , Rasoul Azizipanah-Abarghooee , Hoay Beng Gooi

An algorithm is proposed for solving stochastic and finite sum minimization problems. Based on a trust region methodology, the algorithm employs normalized steps, at least as long as the norms of the stochastic gradient estimates are within…

Optimization and Control · Mathematics 2018-06-27 Frank E. Curtis , Katya Scheinberg , Rui Shi

The estimation of categorical distributions under marginal constraints summarizing some sample from a population in the most-generalizable way is key for many machine-learning and data-driven approaches. We provide a parameter-agnostic…

High Energy Physics - Theory · Physics 2023-11-17 Orestis Loukas , Ho Ryun Chung