English
Related papers

Related papers: Deep Probability Estimation

200 papers

Bayesian neural networks (BNN) and deep ensembles are principled approaches to estimate the predictive uncertainty of a deep learning model. However their practicality in real-time, industrial-scale applications are limited due to their…

Machine Learning · Computer Science 2020-10-27 Jeremiah Zhe Liu , Zi Lin , Shreyas Padhy , Dustin Tran , Tania Bedrax-Weiss , Balaji Lakshminarayanan

Various problems in Engineering and Statistics require the computation of the likelihood ratio function of two probability densities. In classical approaches the two densities are assumed known or to belong to some known parametric family.…

Signal Processing · Electrical Eng. & Systems 2019-11-06 George V. Moustakides , Kalliopi Basioti

Statistical models of natural stimuli provide an important tool for researchers in the fields of machine learning and computational neuroscience. A canonical way to quantitatively assess and compare the performance of statistical models is…

Machine Learning · Statistics 2012-09-17 Lucas Theis , Sebastian Gerwinn , Fabian Sinz , Matthias Bethge

Despite the power of deep neural networks for a wide range of tasks, an overconfident prediction issue has limited their practical use in many safety-critical applications. Many recent works have been proposed to mitigate this issue, but…

Machine Learning · Computer Science 2020-08-14 Jooyoung Moon , Jihyo Kim , Younghak Shin , Sangheum Hwang

Neural Linear Models (NLM) are deep Bayesian models that produce predictive uncertainty by learning features from the data and then performing Bayesian linear regression over these features. Despite their popularity, few works have focused…

Machine Learning · Statistics 2021-06-25 Cooper Lorsung

Inferring models, predicting the future, and estimating the entropy rate of discrete-time, discrete-event processes is well-worn ground. However, a much broader class of discrete-event processes operates in continuous-time. Here, we provide…

Statistical Mechanics · Physics 2020-05-11 S. E. Marzen , J. P. Crutchfield

Terrain elevation modeling for off-road navigation aims to accurately estimate changes in terrain geometry in real-time and quantify the corresponding uncertainties. Having precise estimations and uncertainties plays a crucial role in…

Robotics · Computer Science 2025-08-11 Sanghun Jung , Daehoon Gwak , Byron Boots , James Hays

Prediction models based on deep neural networks are increasingly gaining attention for fast and accurate virtual screening systems. For decision makings in virtual screening, researchers find it useful to interpret an output of…

Machine Learning · Computer Science 2020-03-18 Soojung Yang , Kyung Hoon Lee , Seongok Ryu

Most of the methods that produce space weather forecasts are based on deterministic models. In order to generate a probabilistic forecast, a model needs to be run several times sampling the input parameter space, in order to generate an…

Space Physics · Physics 2019-05-01 Enrico Camporeale , Xiangning Chu , Oleksiy Agapitov , Jacob Bortnik

We introduce a method for using deep neural networks to amortize the cost of inference in models from the family induced by universal probabilistic programming languages, establishing a framework that combines the strengths of probabilistic…

Artificial Intelligence · Computer Science 2018-09-03 Tuan Anh Le , Atilim Gunes Baydin , Frank Wood

Uncertainty quantification is essential when dealing with ill-conditioned inverse problems due to the inherent nonuniqueness of the solution. Bayesian approaches allow us to determine how likely an estimation of the unknown parameters is…

Machine Learning · Statistics 2020-01-16 Ali Siahkoohi , Gabrio Rizzuti , Felix J. Herrmann

Optimal experimental design is a well studied field in applied science and engineering. Techniques for estimating such a design are commonly used within the framework of parameter estimation. Nonetheless, in recent years parameter…

Machine Learning · Statistics 2025-01-13 Md Shahriar Rahim Siddiqui , Arman Rahmim , Eldad Haber

We propose a novel method for closed-form predictive distribution modeling with neural nets. In quantifying prediction uncertainty, we build on Evidential Deep Learning, which has been impactful as being both simple to implement and giving…

Machine Learning · Statistics 2021-01-22 Manuel Haussmann , Sebastian Gerwinn , Melih Kandemir

Deep neural networks, when optimized with sufficient data, provide accurate representations of high-dimensional functions; in contrast, function approximation techniques that have predominated in scientific computing do not scale well with…

Data Analysis, Statistics and Probability · Physics 2021-03-15 Grant M. Rotskoff , Andrew R. Mitchell , Eric Vanden-Eijnden

Probabilistic forecasts are essential for various downstream applications such as business development, traffic planning, and electrical grid balancing. Many of these probabilistic forecasts are performed on time series data that contain…

Machine Learning · Computer Science 2023-02-07 Benedikt Heidrich , Kaleb Phipps , Oliver Neumann , Marian Turowski , Ralf Mikut , Veit Hagenmeyer

Bayesian neural networks (BNNs) have recently regained a significant amount of attention in the deep learning community due to the development of scalable approximate Bayesian inference techniques. There are several advantages of using…

Machine Learning · Statistics 2019-05-28 Aliaksandr Hubin , Geir Storvik

Deep learning models have significantly improved prediction accuracy in various fields, gaining recognition across numerous disciplines. Yet, an aspect of deep learning that remains insufficiently addressed is the assessment of prediction…

Machine Learning · Statistics 2024-12-18 Asaf Ben Arie , Malka Gorfine

Deep neural networks achieve impressive results across diverse applications, yet their overconfidence on unseen inputs necessitates reliable epistemic uncertainty modelling. Existing methods for uncertainty modelling face a fundamental…

Machine Learning · Computer Science 2026-05-04 Yao Ni , Jeremie Houssineau , Yew Soon Ong , Piotr Koniusz

In machine learning, accurately predicting the probability that a specific input is correct is crucial for risk management. This process, known as uncertainty (or confidence) estimation, is particularly important in mission-critical…

Machine Learning · Computer Science 2023-01-12 Gabriella Chouraqui , Liron Cohen , Gil Einziger , Liel Leman

The advent of fast sensing technologies allows for real-time model updates in many applications where the model parameters are uncertain. Bayesian algorithms, such as ensemble smoothers, offer a real-time probabilistic inversion accounting…

Geophysics · Physics 2022-05-26 Muzammil Hussain Rammay , Sergey Alyaev , Ahmed H Elsheikh