English
Related papers

Related papers: Understanding Event-Generation Networks via Uncert…

200 papers

Deep neural networks have shown great achievements in solving complex problems. However, there are fundamental problems that limit their real world applications. Lack of measurable criteria for estimating uncertainty in the network outputs…

Computer Vision and Pattern Recognition · Computer Science 2018-03-02 Alireza Norouzi , Ali Emami , S. M. Reza Soroushmehr , Nader Karimi , Shadrokh Samavi , Kayvan Najarian

Evaluation of generative models is mostly based on the comparison between the estimated distribution and the ground truth distribution in a certain feature space. To embed samples into informative features, previous works often use…

Machine Learning · Computer Science 2022-12-15 Junghyuk Lee , Jun-Hyuk Kim , Jong-Seok Lee

Existing methods for estimating uncertainty in deep learning tend to require multiple forward passes, making them unsuitable for applications where computational resources are limited. To solve this, we perform probabilistic reasoning over…

Machine Learning · Statistics 2020-12-08 Javier Antorán , James Urquhart Allingham , José Miguel Hernández-Lobato

Gaining a better understanding of how and what machine learning systems learn is important to increase confidence in their decisions and catalyze further research. In this paper, we analyze the predictions made by a specific type of…

Machine Learning · Computer Science 2019-01-24 Kai Olav Ellefsen , Charles Patrick Martin , Jim Torresen

In inverse problems, we often have access to data consisting of paired samples $(x,y)\sim p_{X,Y}(x,y)$ where $y$ are partial observations of a physical system, and $x$ represents the unknowns of the problem. Under these circumstances, we…

Machine Learning · Statistics 2020-07-17 Ali Siahkoohi , Gabrio Rizzuti , Philipp A. Witte , Felix J. Herrmann

Deep neural networks(NNs) have achieved impressive performance, often exceed human performance on many computer vision tasks. However, one of the most challenging issues that still remains is that NNs are overconfident in their predictions,…

Machine Learning · Computer Science 2019-12-30 Chanwoo Park , Jae Myung Kim , Seok Hyeon Ha , Jungwoo Lee

The task of quantifying the inherent uncertainty associated with neural network predictions is a key challenge in artificial intelligence. Bayesian neural networks (BNNs) and deep ensembles are among the most prominent approaches to tackle…

Machine Learning · Computer Science 2025-05-23 Valentin Villecroze , Yixin Wang , Gabriel Loaiza-Ganem

We develop a new method for regularising neural networks. We learn a probability distribution over the activations of all layers of the model and then insert imputed values into the network during training. We obtain a posterior for an…

Machine Learning · Computer Science 2019-10-14 Matthew Willetts , Alexander Camuto , Stephen Roberts , Chris Holmes

We present a novel integrator based on normalizing flows which can be used to improve the unweighting efficiency of Monte-Carlo event generators for collider physics simulations. In contrast to machine learning approaches based on surrogate…

High Energy Physics - Phenomenology · Physics 2020-04-22 Christina Gao , Stefan Hoeche , Joshua Isaacson , Claudius Krause , Holger Schulz

Modern neural networks have proven to be powerful function approximators, providing state-of-the-art performance in a multitude of applications. They however fall short in their ability to quantify confidence in their predictions - this is…

Machine Learning · Statistics 2020-06-29 Alex J. Chan , Ahmed M. Alaa , Zhaozhi Qian , Mihaela van der Schaar

Bayesian neural networks (BNNs) have recently regained a significant amount of attention in the deep learning community due to the development of scalable approximate Bayesian inference techniques. There are several advantages of using a…

Machine Learning · Statistics 2023-05-02 Aliaksandr Hubin , Geir Storvik

Bayesian neural networks (BNNs) place distributions over the weights of a neural network to model uncertainty in the data and the network's prediction. We consider the problem of verifying safety when running a Bayesian neural network…

Machine Learning · Computer Science 2021-11-08 Mathias Lechner , Đorđe Žikelić , Krishnendu Chatterjee , Thomas A. Henzinger

There is significant need for principled uncertainty reasoning in machine learning systems as they are increasingly deployed in safety-critical domains. A new approach with uncertainty-aware neural networks (NNs), based on learning…

Machine Learning · Computer Science 2022-02-25 Nis Meinert , Alexander Lavin

We investigate the problem of learning to generate complex networks from data. Specifically, we consider whether deep belief networks, dependency networks, and members of the exponential random graph family can learn to generate networks…

Machine Learning · Computer Science 2014-11-11 James Atwood , Don Towsley , Krista Gile , David Jensen

Uncertainty-quantification methods are applied to estimate the confidence of deep-neural-networks classifiers over their predictions. However, most widely used methods are known to be overconfident. We address this problem by developing an…

Machine Learning · Computer Science 2023-05-19 Luigi Sbailò , Luca M. Ghiringhelli

Uncertainty quantification is an important task in machine learning - a task in which standardneural networks (NNs) have traditionally not excelled. This can be a limitation for safety-critical applications, where uncertainty-aware methods…

Machine Learning · Computer Science 2024-01-05 Felix Fiedler , Sergio Lucia

Generative Flow Networks (GFlowNets) learn to sample states proportional to an unnormalized reward. Despite their theoretical promise, practical training is often unstable, exhibiting severe loss spikes and mode collapse. To tackle this, we…

In many applications of LLMs, natural language responses often have an underlying structure such as representing discrete labels, numerical values, or graphs. Yet, existing decoding and uncertainty estimation methods operate only in…

Machine Learning · Computer Science 2026-05-25 Tim Tomov , Dominik Fuchsgruber , Stephan Günnemann

Modern information systems are able to collect event data in the form of event logs. Process mining techniques allow to discover a model from event data, to check the conformance of an event log against a reference model, and to perform…

Databases · Computer Science 2022-04-11 Marco Pegoraro , Merih Seran Uysal , Wil M. P. van der Aalst

Bayesian Neural Networks (BNNs) have become one of the promising approaches for uncertainty estimation due to the solid theorical foundations. However, the performance of BNNs is affected by the ability of catching uncertainty. Instead of…

Machine Learning · Computer Science 2024-04-15 Shiyu Shen , Bin Pan , Tianyang Shi , Tao Li , Zhenwei Shi