English
Related papers

Related papers: Fast Uncertainty Quantification for Kernel-Based E…

200 papers

Monitoring machine learning models once they are deployed is challenging. It is even more challenging to decide when to retrain models in real-case scenarios when labeled data is beyond reach, and monitoring performance metrics becomes…

Machine Learning · Computer Science 2022-11-23 Carlos Mougan , Dan Saattrup Nielsen

Research in neural networks in the field of computer vision has achieved remarkable accuracy for point estimation. However, the uncertainty in the estimation is rarely addressed. Uncertainty quantification accompanied by point estimation…

Computer Vision and Pattern Recognition · Computer Science 2020-04-23 Min-hwan Oh , Peder A. Olsen , Karthikeyan Natesan Ramamurthy

Uncertainty quantification approaches have been more critical in large language models (LLMs), particularly high-risk applications requiring reliable outputs. However, traditional methods for uncertainty quantification, such as…

Artificial Intelligence · Computer Science 2024-07-01 Ferhat Ozgur Catak , Murat Kuzlu

Accurate approximation of the sampling distribution of nonparametric kernel density estimators is crucial for many statistical inference problems. Since these estimators have complex asymptotic distributions, bootstrap methods are often…

Statistics Theory · Mathematics 2019-09-09 Todd A. Kuffner , Stephen M. -S. Lee , G. Alastair Young

Survey data often arises from complex sampling designs, such as stratified or multistage sampling, with unequal inclusion probabilities. When sampling is informative, traditional inference methods yield biased estimators and poor coverage.…

Methodology · Statistics 2025-04-17 Snigdha Das , Dipankar Bandyopadhyay , Debdeep Pati

Uncertainty estimation is pivotal in machine learning, especially for classification tasks, as it improves the robustness and reliability of models. We introduce a novel `Epistemic Wrapping' methodology aimed at improving uncertainty…

Shapley values have emerged as a critical tool for explaining which features impact the decisions made by machine learning models. However, computing exact Shapley values is difficult, generally requiring an exponential (in the feature…

We develop a weighted Bayesian Bootstrap (WBB) for machine learning and statistics. WBB provides uncertainty quantification by sampling from a high dimensional posterior distribution. WBB is computationally fast and scalable using only…

Methodology · Statistics 2021-04-06 Michael Newton , Nicholas G. Polson , Jianeng Xu

Bootstrapping has been a primary tool for ensemble and uncertainty quantification in machine learning and statistics. However, due to its nature of multiple training and resampling, bootstrapping deep neural networks is computationally…

Machine Learning · Computer Science 2021-12-14 Minsuk Shin , Hyungjoo Cho , Hyun-seok Min , Sungbin Lim

Uncertainty quantification is essential for scientific analysis, as it allows for the evaluation and interpretation of variability and reliability in complex systems and datasets. In their original form, multivariate statistical regression…

Measuring average differences in an outcome across racial or ethnic groups is a crucial first step for equity assessments, but researchers often lack access to data on individuals' races and ethnicities to calculate them. A common solution…

Methodology · Statistics 2024-03-12 Benjamin Lu , Jia Wan , Derek Ouyang , Jacob Goldin , Daniel E. Ho

Artificial intelligence(AI)-assisted method had received much attention in the risk field such as disease diagnosis. Different from the classification of disease types, it is a fine-grained task to classify the medical images as benign or…

Computer Vision and Pattern Recognition · Computer Science 2022-06-10 Shuang Ge , Kehong Yuan , Maokun Han , Desheng Sun , Huabin Zhang , Qiongyu Ye

This work introduces the causal bootstrap, a framework for bounding smeared spectral observables from finite non-perturbative Euclidean data. The method optimizes over the convex set of positive spectral densities compatible with the data…

High Energy Physics - Lattice · Physics 2026-05-21 Ryan Abbott , Sarah Fields , William I. Jay , Patrick Oare , Matteo Saccardi

Bootstrapping is often applied to get confidence limits for semiparametric inference of a target parameter in the presence of nuisance parameters. Bootstrapping with replacement can be computationally expensive and problematic when…

Model misspecification is ubiquitous in data analysis because the data-generating process is often complex and mathematically intractable. Therefore, assessing estimation uncertainty and conducting statistical inference under a possibly…

Methodology · Statistics 2023-12-19 Rong Li , Yichen Qin , Yang Li

Uncertainty quantification in Large Language Models (LLMs) is crucial for applications where safety and reliability are important. In particular, uncertainty can be used to improve the trustworthiness of LLMs by detecting factually…

Machine Learning · Computer Science 2024-05-31 Alexander Nikitin , Jannik Kossen , Yarin Gal , Pekka Marttinen

Bayesian neural networks (BNNs) provide a formalism to quantify and calibrate uncertainty in deep learning. Current inference approaches for BNNs often resort to few-sample estimation for scalability, which can harm predictive performance,…

Machine Learning · Computer Science 2024-02-14 Zhe Zeng , Guy Van den Broeck

Uncertainty quantification is one of the most crucial tasks to obtain trustworthy and reliable machine learning models for decision making. However, most research in this domain has only focused on problems with small label spaces and…

Machine Learning · Computer Science 2022-10-20 Jyun-Yu Jiang , Wei-Cheng Chang , Jiong Zhong , Cho-Jui Hsieh , Hsiang-Fu Yu

A covariant energy density functional is calibrated using a principled Bayesian statistical framework informed by experimental binding energies and charge radii of several magic and semi-magic nuclei. The Bayesian sampling required for the…

Nuclear Theory · Physics 2022-09-28 Pablo Giuliani , Kyle Godbey , Edgard Bonilla , Frederi Viens , Jorge Piekarewicz

Kernel methods have been extensively utilized in machine learning for classification and prediction tasks due to their ability to capture complex non-linear data patterns. However, single kernel approaches are inherently limited, as they…

Machine Learning · Computer Science 2026-02-12 Qiyuan Shi , Jian Kang , Yi Li