English
Related papers

Related papers: Efficient ensemble uncertainty estimation in Gauss…

200 papers

Understanding which concepts models can and cannot represent has been fundamental to many tasks: from effective and responsible use of models to detecting out of distribution data. We introduce Gaussian process probes (GPP), a unified and…

Machine Learning · Computer Science 2023-11-07 Zi Wang , Alexander Ku , Jason Baldridge , Thomas L. Griffiths , Been Kim

Many methods have been proposed to quantify the predictive uncertainty associated with the outputs of deep neural networks. Among them, ensemble methods often lead to state-of-the-art results, though they require modifications to the…

Machine Learning · Computer Science 2021-05-11 Zhiyun Lu , Eugene Ie , Fei Sha

In the past years, deep learning has seen an increase in usage in the domain of histopathological applications. However, while these approaches have shown great potential, in high-risk environments deep learning models need to be able to…

Image and Video Processing · Electrical Eng. & Systems 2023-11-17 Hendrik A. Mehrtens , Alexander Kurz , Tabea-Clara Bucher , Titus J. Brinker

Typically, a supervised learning model is trained using passive learning by randomly selecting unlabelled instances to annotate. This approach is effective for learning a model, but can be costly in cases where acquiring labelled instances…

Machine Learning · Computer Science 2024-03-05 Zan-Kai Chong , Hiroyuki Ohsaki , Bok-Min Goi

Large Vision-Language Models (LVLMs) often produce plausible but unreliable outputs, making robust uncertainty estimation essential. Recent work on semantic uncertainty estimates relies on external models to cluster multiple sampled…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Joseph Hoche , Andrei Bursuc , David Brellmann , Gilles Louppe , Pavel Izmailov , Angela Yao , Gianni Franchi

Rigorous statistical methods, including parameter estimation with accompanying uncertainties, underpin the validity of scientific discovery, especially in the natural sciences. With increasingly complex data models such as deep learning…

Machine Learning · Computer Science 2026-02-18 Aurora Grefsrud , Nello Blaser , Trygve Buanes

Shallow ensembles provide a convenient strategy for uncertainty quantification in machine learning interatomic potentials, that is computationally efficient because the different ensemble members share a large part of the model weights. In…

Chemical Physics · Physics 2026-02-18 Moritz Schäfer , Matthias Kellner , Johannes Kästner , Michele Ceriotti

By distributing the training process, local approximation reduces the cost of the standard Gaussian Process. An ensemble technique combines local predictions from Gaussian experts trained on different partitions of the data. Ensemble…

Machine Learning · Computer Science 2024-01-09 Hamed Jalali , Gjergji Kasneci

Estimating accurate and well-calibrated predictive uncertainty is important for enhancing the reliability of computer vision models, especially in safety-critical applications like traffic scene perception. While ensemble methods are…

Computer Vision and Pattern Recognition · Computer Science 2025-09-08 Svetlana Pavlitska , Beyza Keskin , Alwin Faßbender , Christian Hubschneider , J. Marius Zöllner

For identifying the non-Gaussian impulsive noise systems, normalized LMP (NLMP) has been proposed to combat impulsive-inducing instability. However, the standard algorithm is without considering the inherent sparse structure distribution of…

Information Theory · Computer Science 2015-03-04 Wentao Ma , Hua Qu , Jihong Zhao , Badong Chen , Guan Gui

The declining response rates in probability surveys along with the widespread availability of unstructured data has led to growing research into non-probability samples. Existing robust approaches are not well-developed for non-Gaussian…

Methodology · Statistics 2022-03-29 Ali Rafei , Michael R. Elliott , Carol A. C. Flannagan

Until recently mass-mapping techniques for weak gravitational lensing convergence reconstruction have lacked a principled statistical framework upon which to quantify reconstruction uncertainties, without making strong assumptions of…

Cosmology and Nongalactic Astrophysics · Physics 2021-02-08 Matthew A. Price , Xiaohao Cai , Jason D. McEwen , Marcelo Pereyra , Thomas D. Kitching

Providing non-conservative uncertainty quantification for function estimates derived from noisy observations remains a fundamental challenge in statistical machine learning, particularly for applications in safety-critical domains. In this…

Machine Learning · Computer Science 2026-05-12 Johannes Teutsch , Oleksii Molodchyk , Marion Leibold , Timm Faulwasser , Armin Lederer

State-of-the-art lidar place recognition models exhibit unreliable performance when tested on environments different from their training dataset, which limits their use in complex and evolving environments. To address this issue, we…

Computer Vision and Pattern Recognition · Computer Science 2023-07-13 Keita Mason , Joshua Knights , Milad Ramezani , Peyman Moghadam , Dimity Miller

Ensemble models can be used to estimate prediction uncertainties in machine learning models. However, an ensemble of N models is approximately N times more computationally demanding compared to a single model when it is used for inference.…

Machine Learning · Computer Science 2026-03-04 Vidit Agrawal , Shixin Zhang , Lane E. Schultz , Dane Morgan

Estimating the uncertainty of a model's prediction on a test point is a crucial part of ensuring reliability and calibration under distribution shifts. A minimum description length approach to this problem uses the predictive normalized…

Machine Learning · Computer Science 2024-07-22 Nathan Ng , Roger Grosse , Marzyeh Ghassemi

In this study, we explore in depth a few under-studied topics at the intersection of uncertainty estimation and segmentation. Prior work has shown that the quality of uncertainty estimates can be very sensitive to a range of variables. As…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Michael Smith , Frank P. Ferrie

Graph Neural Networks have achieved impressive results across diverse network modeling tasks, but accurately estimating uncertainty on graphs remains difficult, especially under distributional shifts. Unlike traditional uncertainty…

Machine Learning · Computer Science 2025-10-15 Fred Xu , Thomas Markovich

A technique for characterizing and correcting the linearity of radiometric instruments is known by the names the "flux-addition method" and the "combinatorial technique". In this paper, we develop a rigorous uncertainty quantification…

Applications · Statistics 2023-02-22 Adam L. Pintar , Zachary H. Levine , Howard W. Yoon , Stephen E. Maxwell

Large language models (LLMs) have demonstrated remarkable capabilities in generating programs from natural language descriptions, yet ensuring their correctness without an external oracle remains a critical challenge. To solve the…

Software Engineering · Computer Science 2026-04-07 Yunxiang Wei , Tianlin Li , Yuwei Zheng , Yanni Dong , Aishan Liu , Qiang Hu , Xiaoyu Zhang , Mingfei Cheng , Jian Yang