English
Related papers

Related papers: Deep Ensembles vs. Committees for Uncertainty Esti…

200 papers

This work develops formal statistical inference procedures for machine learning ensemble methods. Ensemble methods based on bootstrapping, such as bagging and random forests, have improved the predictive accuracy of individual trees, but…

Machine Learning · Statistics 2015-09-11 Lucas Mentch , Giles Hooker

Machine learning interatomic potentials (MLIPs) enable atomistic simulations with near first-principles accuracy at substantially reduced computational cost, making them powerful tools for large-scale materials modeling. The accuracy of…

Materials Science · Physics 2025-08-11 Yonatan Kurniawan , Mingjian Wen , Ellad B. Tadmor , Mark K. Transtrum

Uncertainty quantification is at the core of the reliability and robustness of machine learning. In this paper, we provide a theoretical framework to dissect the uncertainty, especially the \textit{epistemic} component, in deep learning…

Machine Learning · Computer Science 2023-06-21 Ziyi Huang , Henry Lam , Haofeng Zhang

Deep neural networks are often ignorant about what they do not know and overconfident when they make uninformed predictions. Some recent approaches quantify classification uncertainty directly by training the model to output high…

Machine Learning · Computer Science 2020-06-09 Murat Sensoy , Lance Kaplan , Federico Cerutti , Maryam Saleki

Ensemble learning serves as a straightforward way to improve the performance of almost any machine learning algorithm. Existing deep ensemble methods usually naively train many different models and then aggregate their predictions. This is…

Computer Vision and Pattern Recognition · Computer Science 2022-12-15 Le Zhang , Qibin Hou , Yun Liu , Jia-Wang Bian , Xun Xu , Joey Tianyi Zhou , Ce Zhu

The inaccuracy of neural network models on inputs that do not stem from the training data distribution is both problematic and at times unrecognized. Model uncertainty estimation can address this issue, where uncertainty estimates are often…

Machine Learning · Computer Science 2020-02-14 Siddhartha Jain , Ge Liu , Jonas Mueller , David Gifford

Bayesian neural networks and deep ensembles represent two modern paradigms of uncertainty quantification in deep learning. Yet these approaches struggle to scale mainly due to memory inefficiency issues, since they require parameter storage…

Machine Learning · Statistics 2021-11-24 Hippolyt Ritter , Martin Kukla , Cheng Zhang , Yingzhen Li

Deep neural network ensembles hold the potential of improving generalization performance for complex learning tasks. This paper presents formal analysis and empirical evaluation to show that heterogeneous deep ensembles with high ensemble…

Computer Vision and Pattern Recognition · Computer Science 2023-10-04 Yanzhao Wu , Ka-Ho Chow , Wenqi Wei , Ling Liu

Robust optimization has been established as a leading methodology to approach decision problems under uncertainty. To derive a robust optimization model, a central ingredient is to identify a suitable model for uncertainty, which is called…

Optimization and Control · Mathematics 2021-09-10 Marc Goerigk , Jannis Kurtz

It is well known in the field of machine learning that committee models improve accuracy, provide generalization error estimates, and enable active learning strategies. In this work, we adapt these concepts to interatomic potentials based…

Chemical Physics · Physics 2020-10-21 Christoph Schran , Krystof Brezina , Ondrej Marsalek

Machine learning force fields show great promise in enabling more accurate molecular dynamics simulations compared to manually derived ones. Much of the progress in recent years was driven by exploiting prior knowledge about physical…

Machine Learning · Computer Science 2025-09-11 Andreas Burger , Luca Thiede , Alán Aspuru-Guzik , Nandita Vijaykumar

Several neurodegenerative diseases involve the accumulation of cellular DNA damage. Comet assays are a popular way of estimating the extent of DNA damage. Current literature on the use of deep learning to quantify DNA damage presents an…

Quantitative Methods · Quantitative Biology 2021-12-28 Srikanth Namuduri , Prateek Mehta , Lise Barbe , Stephanie Lam , Zohreh Faghihmonzavi , Steve Finkbeiner , Shekhar Bhansali

Bootstrapping has been a primary tool for ensemble and uncertainty quantification in machine learning and statistics. However, due to its nature of multiple training and resampling, bootstrapping deep neural networks is computationally…

Machine Learning · Computer Science 2021-12-14 Minsuk Shin , Hyungjoo Cho , Hyun-seok Min , Sungbin Lim

In this work, we propose a method for efficient learning of a multi-dimensional function. This method combines the Bayesian neural networks and the query-by-committee method. A committee made of deep Bayesian neural networks not only can…

Computational Physics · Physics 2020-11-13 Li Chen , Xiao Liang , Hui Zhai

Uncertainty quantification is a critical aspect of reinforcement learning and deep learning, with numerous applications ranging from efficient exploration and stable offline reinforcement learning to outlier detection in medical…

Machine Learning · Computer Science 2025-03-27 Moritz A. Zanger , Pascal R. Van der Vaart , Wendelin Böhmer , Matthijs T. J. Spaan

Deep neural networks (DNNs) have become the technology of choice for realizing a variety of complex tasks. However, as highlighted by many recent studies, even an imperceptible perturbation to a correctly classified input can lead to…

Machine Learning · Computer Science 2022-07-27 Guy Amir , Tom Zelazny , Guy Katz , Michael Schapira

Deep learning has become very popular for tasks such as predictive modeling and pattern recognition in handling big data. Deep learning is a powerful machine learning method that extracts lower level features and feeds them forward for the…

Machine Learning · Computer Science 2018-03-07 Steven Young , Tamer Abdou , Ayse Bener

Active learning is a unique abstraction of machine learning techniques where the model/algorithm could guide users for annotation of a set of data points that would be beneficial to the model, unlike passive machine learning. The primary…

Computer Vision and Pattern Recognition · Computer Science 2021-01-08 Vishwesh Nath , Dong Yang , Bennett A. Landman , Daguang Xu , Holger R. Roth

Visualizing the uncertainty of ensemble simulations is challenging due to the large size and multivariate and temporal features of ensemble data sets. One popular approach to studying the uncertainty of ensembles is analyzing the positional…

Machine Learning · Computer Science 2022-10-25 Mengjiao Han , Tushar M. Athawale , David Pugmire , Chris R. Johnson

Heterogeneous ensembles built from the predictions of a wide variety and large number of diverse base predictors represent a potent approach to building predictive models for problems where the ideal base/individual predictor may not be…

Machine Learning · Computer Science 2021-03-01 Ana Stanescu , Gaurav Pandey