English
Related papers

Related papers: High Confidence Level Inference is Almost Free usi…

200 papers

Neural simulation-based inference is a powerful class of machine-learning-based methods for statistical inference that naturally handles high-dimensional parameter estimation without the need to bin data into low-dimensional summary…

Data Analysis, Statistics and Probability · Physics 2025-06-16 ATLAS Collaboration

We consider the problem of parametric statistical inference when likelihood computations are prohibitively expensive but sampling from the model is possible. Several so-called likelihood-free methods have been developed to perform inference…

Machine Learning · Statistics 2020-09-14 Owen Thomas , Ritabrata Dutta , Jukka Corander , Samuel Kaski , Michael U. Gutmann

Kernel-based models such as kernel ridge regression and Gaussian processes are ubiquitous in machine learning applications for regression and optimization. It is well known that a major downside for kernel-based models is the high…

Machine Learning · Computer Science 2022-06-22 Sattar Vakili , Jonathan Scarlett , Da-shan Shiu , Alberto Bernacchia

We consider the problem of constructing distribution-free prediction intervals for multi-step time series forecasting, with a focus on the temporal dependencies inherent in multi-step forecast errors. We establish that the optimal…

Methodology · Statistics 2026-02-03 Xiaoqian Wang , Rob J Hyndman

Longitudinal or panel data can be represented as a matrix with rows indexed by units and columns indexed by time. We consider inferential questions associated with the missing data version of panel data induced by staggered adoption. We…

Statistics Theory · Mathematics 2024-07-02 Yuling Yan , Martin J. Wainwright

Stochastic gradient descent (SGD) is a scalable and memory-efficient optimization algorithm for large datasets and stream data, which has drawn a great deal of attention and popularity. The applications of SGD-based estimators to…

Methodology · Statistics 2026-03-04 Ruiqi Liu , Xi Chen , Zuofeng Shang

This article presents a novel, general, and effective simulation-inspired approach, called {\it repro samples method}, to conduct statistical inference. The approach studies the performance of artificial samples, referred to as {\it repro…

Methodology · Statistics 2022-06-15 Min-ge Xie , Peng Wang

We propose a robust inferential procedure for assessing uncertainties of parameter estimation in high-dimensional linear models, where the dimension $p$ can grow exponentially fast with the sample size $n$. Our method combines the…

Machine Learning · Statistics 2015-03-19 Tianqi Zhao , Mladen Kolar , Han Liu

Deep learning models have significantly improved prediction accuracy in various fields, gaining recognition across numerous disciplines. Yet, an aspect of deep learning that remains insufficiently addressed is the assessment of prediction…

Machine Learning · Statistics 2024-12-18 Asaf Ben Arie , Malka Gorfine

Stochastic programming is often challenged by epistemic uncertainty, where critical probability distributions are poorly characterized or unknown due to a lack of data. To address this, we pioneer a novel framework for stochastic…

Optimization and Control · Mathematics 2026-05-19 Shixin Liu , Ming Gao , Jian Hu

Conformal prediction is a simple and powerful tool that can quantify uncertainty without any distributional assumptions. Many existing methods only address the average coverage guarantee, which is not ideal compared to the stronger…

Machine Learning · Statistics 2023-02-21 Xing Han , Ziyang Tang , Joydeep Ghosh , Qiang Liu

We propose a new method to construct confidence intervals for quantities that are associated with a stationary time series, which avoids direct estimation of the asymptotic variances. Unlike the existing tuning-parameter-dependent…

Methodology · Statistics 2010-05-13 Xiaofeng Shao

We report on an experimental investigation into opportunities for parallelism in beliefnet inference. Specifically, we report on a study performed of the available parallelism, on hypercube style machines, of a set of randomly generated…

Artificial Intelligence · Computer Science 2013-03-25 Bruce D'Ambrosio , Tony Fountain , Zhaoyu Li

Conformal prediction is a framework for providing prediction intervals with distribution-free validity, guaranteeing predictive coverage for data drawn from any distribution. Its two main variants are full conformal prediction and split…

Methodology · Statistics 2026-05-29 Aabesh Bhattacharyya , Boxuan Zhang , Rina Foygel Barber

Gradient boosting is widely popular due to its flexibility and predictive accuracy. However, statistical inference and uncertainty quantification for gradient boosting remain challenging and under-explored. We propose a unified framework…

Machine Learning · Statistics 2025-09-30 Haimo Fang , Kevin Tan , Giles Hooker

For time series with high temporal correlation, the empirical process converges rather slowly to its limiting distribution. Many statistics in change-point analysis, goodness-of-fit testing and uncertainty quantification admit a…

Statistics Theory · Mathematics 2025-05-26 Annika Betken , Marie-Christine Düker

Panels with large time $(T)$ and cross-sectional $(N)$ dimensions are a key data structure in social sciences and other fields. A central question in panel data analysis is whether to pool data across individuals or to estimate separate…

Methodology · Statistics 2025-12-18 Tim Kutta , Martin Schumann , Holger Dette

This paper presents a selective survey of recent developments in statistical inference and multiple testing for high-dimensional regression models, including linear and logistic regression. We examine the construction of confidence…

Methodology · Statistics 2023-01-26 T. Tony Cai , Zijian Guo , Yin Xia

Reliable uncertainty quantification is crucial for reinforcement learning (RL) in high-stakes settings. We propose a unified conformal prediction framework for infinite-horizon policy evaluation that constructs distribution-free prediction…

Machine Learning · Statistics 2025-10-31 Feichen Gan , Youcun Lu , Yingying Zhang , Yukun Liu

We present a model-agnostic algorithm for generating post-hoc explanations and uncertainty intervals for a machine learning model when only a static sample of inputs and outputs from the model is available, rather than direct access to the…

Machine Learning · Computer Science 2023-06-27 Surin Ahn , Justin Grana , Yafet Tamene , Kristian Holsheimer