English
Related papers

Related papers: Providing Machine Learning Potentials with High Qu…

200 papers

Machine learning interatomic potentials (MLIPs) based on a large dataset obtained by density functional theory (DFT) calculation have been developed recently. This study gives both conceptual and practical bases for the high accuracy of…

Materials Science · Physics 2017-11-08 Akira Takahashi , Atsuto Seko , Isao Tanaka

We present a novel approach for training deep neural networks in a Bayesian way. Classical, i.e. non-Bayesian, deep learning has two major drawbacks both originating from the fact that network parameters are considered to be deterministic.…

Machine Learning · Statistics 2019-03-11 Konstantin Posch , Jan Steinbrener , Jürgen Pilz

Deep neural networks (DNNs) are becoming more prevalent in important safety-critical applications, where reliability in the prediction is paramount. Despite their exceptional prediction capabilities, current DNNs do not have an implicit…

Machine Learning · Computer Science 2021-05-14 David Betancourt , Rafi Muhanna

Neural network (NN) potentials promise highly accurate molecular dynamics (MD) simulations within the computational complexity of classical MD force fields. However, when applied outside their training domain, NN potential predictions can…

Chemical Physics · Physics 2023-07-28 Stephan Thaler , Gregor Doehner , Julija Zavadlav

Neural Networks (NNs) have provided state-of-the-art results for many challenging machine learning tasks such as detection, regression and classification across the domains of computer vision, speech recognition and natural language…

Machine Learning · Statistics 2026-04-21 Ethan Goan , Clinton Fookes

While deep neural networks have become the go-to approach in computer vision, the vast majority of these models fail to properly capture the uncertainty inherent in their predictions. Estimating this predictive uncertainty can be crucial,…

Machine Learning · Computer Science 2020-04-08 Fredrik K. Gustafsson , Martin Danelljan , Thomas B. Schön

Deep neural networks (NNs) are powerful black box predictors that have recently achieved impressive performance on a wide spectrum of tasks. Quantifying predictive uncertainty in NNs is a challenging and yet unsolved problem. Bayesian NNs,…

Machine Learning · Statistics 2017-11-07 Balaji Lakshminarayanan , Alexander Pritzel , Charles Blundell

While several methods for predicting uncertainty on deep networks have been recently proposed, they do not readily translate to large and complex datasets. In this paper we utilize a simplified form of the Mixture Density Networks (MDNs) to…

Machine Learning · Computer Science 2019-12-05 Nicholas Wilkins , Michael Johnson , Ifeoma Nwogu

The ground state electron density -- obtainable using Kohn-Sham Density Functional Theory (KS-DFT) simulations -- contains a wealth of material information, making its prediction via machine learning (ML) models attractive. However, the…

Techniques for understanding the functioning of complex machine learning models are becoming increasingly popular, not only to improve the validation process, but also to extract new insights about the data via exploratory analysis. Though…

Machine Learning · Statistics 2018-11-02 Jayaraman J. Thiagarajan , Irene Kim , Rushil Anirudh , Peer-Timo Bremer

Uncertainty quantification and robustness to distribution shifts are important goals in machine learning and artificial intelligence. Although Bayesian Neural Networks (BNNs) allow for uncertainty in the predictions to be assessed,…

Machine Learning · Computer Science 2024-10-23 Michele Caprio , Souradeep Dutta , Kuk Jin Jang , Vivian Lin , Radoslav Ivanov , Oleg Sokolsky , Insup Lee

Machine Learning techniques can be used to represent high-dimensional potential energy surfaces for reactive chemical systems. Two such methods are based on a reproducing kernel Hilbert space representation or on deep neural networks. They…

Chemical Physics · Physics 2019-09-19 Oliver T. Unke , Markus Meuwly

Ensembles of neural networks (NNs) have long been used to estimate predictive uncertainty; a small number of NNs are trained from different initialisations and sometimes on differing versions of the dataset. The variance of the ensemble's…

Machine Learning · Computer Science 2018-11-30 Tim Pearce , Mohamed Zaki , Andy Neely

While deep neural networks are highly performant and successful in a wide range of real-world problems, estimating their predictive uncertainty remains a challenging task. To address this challenge, we propose and implement a loss function…

Machine Learning · Computer Science 2022-10-14 Tony Tohme , Kevin Vanslette , Kamal Youcef-Toumi

This paper concerns the study of optimal (supremum and infimum) uncertainty bounds for systems where the input (or prior) probability measure is only partially/imperfectly known (e.g., with only statistical moments and/or on a coarse…

Machine Learning · Computer Science 2023-01-02 Xingsheng Sun , Burigede Liu

Efficiently quantifying predictive uncertainty in medical images remains a challenge. While Bayesian neural networks (BNN) offer predictive uncertainty, they require substantial computational resources to train. Although Bayesian…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Zeinab Abboud , Herve Lombaert , Samuel Kadoury

Neural Linear Models (NLM) are deep Bayesian models that produce predictive uncertainties by learning features from the data and then performing Bayesian linear regression over these features. Despite their popularity, few works have…

Machine Learning · Statistics 2021-12-17 Sujay Thakur , Cooper Lorsung , Yaniv Yacoby , Finale Doshi-Velez , Weiwei Pan

Due to the growing adoption of deep neural networks in many fields of science and engineering, modeling and estimating their uncertainties has become of primary importance. Despite the growing literature about uncertainty quantification in…

Machine Learning · Computer Science 2023-02-15 Brian Staber , Sébastien Da Veiga

We present a scheme to obtain an inexpensive and reliable estimate of the uncertainty associated with the predictions of a machine-learning model of atomic and molecular properties. The scheme is based on resampling, with multiple models…

Chemical Physics · Physics 2025-10-06 Felix Musil , Michael J. Willatt , Mikhail A. Langovoy , Michele Ceriotti

Recently, combinations of generative and Bayesian machine learning have been introduced in particle physics for both fast detector simulation and inference tasks. These neural networks aim to quantify the uncertainty on the generated…

Machine Learning · Computer Science 2024-11-21 Sebastian Bieringer , Sascha Diefenbacher , Gregor Kasieczka , Mathias Trabs