English
Related papers

Related papers: Fundamental Issues Regarding Uncertainties in Arti…

200 papers

In this paper we argue that, to its detriment, transparency research overlooks many foundational concepts of artificial intelligence. As an illustrating example we focus on uncertainty quantification in the context of counterfactual…

Machine Learning · Computer Science 2026-05-19 Kacper Sokol , Santo M. A. R. Thies , Eyke Hüllermeier

Deep Neural Networks (DNNs) achieve state-of-the-art performance on numerous applications. However, it is difficult to tell beforehand if a DNN receiving an input will deliver the correct output since their decision criteria are usually…

Machine Learning · Computer Science 2021-09-07 Julia Lust , Alexandru Paul Condurache

Techniques for understanding the functioning of complex machine learning models are becoming increasingly popular, not only to improve the validation process, but also to extract new insights about the data via exploratory analysis. Though…

Machine Learning · Statistics 2018-11-02 Jayaraman J. Thiagarajan , Irene Kim , Rushil Anirudh , Peer-Timo Bremer

We analyse and compare various empirical models of wall pressure spectra beneath turbulent boundary layers and propose an alternative machine learning approach using Artificial Neural Networks (ANN). The analysis and the training of the ANN…

Fluid Dynamics · Physics 2022-03-14 J. Dominique , J. Van den Berghe , C. Schram , M. A. Mendez

Probabilistic models often use neural networks to control their predictive uncertainty. However, when making out-of-distribution (OOD)} predictions, the often-uncontrollable extrapolation properties of neural networks yield poor uncertainty…

Machine Learning · Computer Science 2022-01-19 Pierre Segonne , Yevgen Zainchkovskyy , Søren Hauberg

Existing methods for estimating uncertainty in deep learning tend to require multiple forward passes, making them unsuitable for applications where computational resources are limited. To solve this, we perform probabilistic reasoning over…

Machine Learning · Statistics 2020-12-08 Javier Antorán , James Urquhart Allingham , José Miguel Hernández-Lobato

In real world systems, the predictions of deployed Machine Learned models affect the training data available to build subsequent models. This introduces a bias in the training data that needs to be addressed. Existing solutions to this…

Machine Learning · Computer Science 2018-04-20 John Moore , Joel Pfeiffer , Kai Wei , Rishabh Iyer , Denis Charles , Ran Gilad-Bachrach , Levi Boyles , Eren Manavoglu

In active learning, the size and complexity of the training dataset changes over time. Simple models that are well specified by the amount of data available at the start of active learning might suffer from bias as more points are actively…

Machine Learning · Computer Science 2022-05-05 Chelsea Murray , James U. Allingham , Javier Antorán , José Miguel Hernández-Lobato

Deep neural networks (DNNs) are known for extracting useful information from large amounts of data. However, the representations learned in DNNs are typically hard to interpret, especially in dense layers. One crucial issue of the classical…

Neural and Evolutionary Computing · Computer Science 2021-05-06 Yuyang Gao , Giorgio A. Ascoli , Liang Zhao

Artificial neural networks are being proposed as models of parts of the brain. The networks are compared to recordings of biological neurons, and good performance in reproducing neural responses is considered to support the model's…

Neurons and Cognition · Quantitative Biology 2023-09-01 Yena Han , Tomaso Poggio , Brian Cheung

The choice of architecture of artificial neuron network (ANN) is still a challenging task that users face every time. It greatly affects the accuracy of the built network. In fact there is no optimal method that is applicable to various…

Neural and Evolutionary Computing · Computer Science 2014-12-18 Cyrine Arouri , Engelbert Mephu Nguifo , Sabeur Aridhi , Cécile Roucelle , Gaelle Bonnet-Loosli , Norbert Tsopzé

Despite the success of convolutional neural networks (CNNs) in many academic benchmarks for computer vision tasks, their application in the real-world is still facing fundamental challenges. One of these open problems is the inherent lack…

Computer Vision and Pattern Recognition · Computer Science 2022-12-07 Julia Grabinski , Paul Gavrikov , Janis Keuper , Margret Keuper

We suggest ways to enforce given constraints in the output of a Generative Adversarial Network (GAN) generator both for interpolation and extrapolation (prediction). For the case of dynamical systems, given a time series, we wish to train…

Machine Learning · Computer Science 2019-09-04 Panos Stinis , Tobias Hagge , Alexandre M. Tartakovsky , Enoch Yeung

Calculations of nuclei are often carried out in finite model spaces. Thus, finite-size corrections enter, and it is necessary to extrapolate the computed observables to infinite model spaces. In this work, we employ extrapolation methods…

Nuclear Theory · Physics 2019-11-25 W. G. Jiang , G. Hagen , T. Papenbrock

Artificial intelligence (AI) systems accelerate medical workflows and improve diagnostic accuracy in healthcare, serving as second-opinion systems. However, the unpredictability of AI errors poses a significant challenge, particularly in…

Popular approaches for quantifying predictive uncertainty in deep neural networks often involve distributions over weights or multiple models, for instance via Markov Chain sampling, ensembling, or Monte Carlo dropout. These techniques…

Machine Learning · Computer Science 2023-03-08 Dennis Ulmer , Christian Hardmeier , Jes Frellsen

Artificial neural networks (ANNs) are highly flexible predictive models. However, reliably quantifying uncertainty for their predictions is a continuing challenge. There has been much recent work on "recalibration" of predictive…

Methodology · Statistics 2024-03-12 R. Torres , D. J. Nott , S. A. Sisson , T. Rodrigues , J. G. Reis , G. S. Rodrigues

Artificial and biological neural networks (ANNs and BNNs) can encode inputs in the form of combinations of individual neurons' activities. These combinatorial neural codes present a computational challenge for direct and efficient analysis…

Neural and Evolutionary Computing · Computer Science 2022-10-20 Thomas F Burns , Irwansyah

We suggest a general approach to quantification of different forms of aleatoric uncertainty in regression tasks performed by artificial neural networks. It is based on the simultaneous training of two neural networks with a joint loss…

Machine Learning · Statistics 2018-09-05 Pavel Gurevich , Hannes Stuke

Artificial Neural Networks (ANNs) often represent conflicts between features, arising naturally during training as the network learns to integrate diverse and potentially disagreeing inputs to better predict the target variable. Despite…

Machine Learning · Computer Science 2025-06-03 Adam Dejl , Dekai Zhang , Hamed Ayoobi , Matthew Williams , Francesca Toni