English
Related papers

Related papers: Soft Triangles for Expert Aggregation

200 papers

Understanding the uncertainty of a neural network's (NN) predictions is essential for many purposes. The Bayesian framework provides a principled approach to this, however applying it to NNs is challenging due to large numbers of parameters…

Machine Learning · Statistics 2020-02-27 Tim Pearce , Felix Leibfried , Alexandra Brintrup , Mohamed Zaki , Andy Neely

Maximum likelihood estimations for the parameters of extreme value distributions are discussed in this paper using fixed point iteration. The commonly used numerical approach for addressing this problem is the Newton-Raphson approach which…

Computation · Statistics 2009-02-03 Tewfik Kernane , Zohrh A. Raizah

Aggregating signals from a collection of noisy sources is a fundamental problem in many domains including crowd-sourcing, multi-agent planning, sensor networks, signal processing, voting, ensemble learning, and federated learning. The core…

Machine Learning · Computer Science 2022-06-07 Ben Abramowitz , Nicholas Mattei

Predictive uncertainty estimation remains a challenging problem precluding the use of deep neural networks as subsystems within safety-critical applications. Aleatoric uncertainty is a component of predictive uncertainty that cannot be…

Machine Learning · Computer Science 2023-12-12 Angel Daruna , Yunye Gong , Abhinav Rajvanshi , Han-Pang Chiu , Yi Yao

In this paper we consider regression problems subject to arbitrary noise in the operator or design matrix. This characterization appropriately models many physical phenomena with uncertainty in the regressors. Although the problem has been…

Computation · Statistics 2021-04-08 Richard J Clancy , Stephen Becker

We present a sampling-free approach for computing the epistemic uncertainty of a neural network. Epistemic uncertainty is an important quantity for the deployment of deep neural networks in safety-critical applications, since it represents…

Machine Learning · Computer Science 2019-12-04 Janis Postels , Francesco Ferroni , Huseyin Coskun , Nassir Navab , Federico Tombari

Uncertainty is a key feature of any machine learning model and is particularly important in neural networks, which tend to be overconfident. This overconfidence is worrying under distribution shifts, where the model performance silently…

Machine Learning · Computer Science 2024-03-18 Arthur Thuy , Dries F. Benoit

We consider a patient risk models which has access to patient features such as vital signs, lab values, and prior history but does not have access to a patient's diagnosis. For example, this occurs in a model deployed at intake time for…

Artificial Intelligence · Computer Science 2023-07-03 Alexander Peysakhovich , Rich Caruana , Yin Aphinyanaphongs

Uncertainty sampling, a popular active learning algorithm, is used to reduce the amount of data required to learn a classifier, but it has been observed in practice to converge to different parameters depending on the initialization and…

Machine Learning · Computer Science 2018-12-06 Stephen Mussmann , Percy Liang

Uncertainty quantification, once a singular task, has evolved into a spectrum of tasks, including abstained prediction, out-of-distribution detection, and aleatoric uncertainty quantification. The latest goal is disentanglement: the…

Machine Learning · Computer Science 2024-12-02 Bálint Mucsányi , Michael Kirchhof , Seong Joon Oh

The estimation of risk measures recently gained a lot of attention, partly because of the backtesting issues of expected shortfall related to elicitability. In this work we shed a new and fundamental light on optimal estimation procedures…

Risk Management · Quantitative Finance 2017-08-25 Marcin Pitera , Thorsten Schmidt

This paper presents a novel end-to-end framework for closed-form computation and visualization of critical point uncertainty in 2D uncertain scalar fields. Critical points are fundamental topological descriptors used in the visualization…

Accurately estimating uncertainties in neural network predictions is of great importance in building trusted DNNs-based models, and there is an increasing interest in providing accurate uncertainty estimation on many tasks, such as security…

Machine Learning · Computer Science 2020-07-14 Yukun Ding , Jinglan Liu , Jinjun Xiong , Yiyu Shi

We introduce a simple but effective method for managing risk in model-based reinforcement learning with trajectory sampling that involves probabilistic safety constraints and balancing of optimism in the face of epistemic uncertainty and…

Machine Learning · Computer Science 2023-09-12 Marin Vlastelica , Sebastian Blaes , Cristina Pineri , Georg Martius

In robust optimization, we would like to find a solution that is immunized against all scenarios that are modeled in an uncertainty set. Which scenarios to include in such a set is therefore of central importance for the tractability of the…

Optimization and Control · Mathematics 2024-10-14 Jamie Fairbrother , Marc Goerigk , Mohammad Khosravi

Unbiased estimators are introduced for averaged Bregman divergences which generalize Stein's Unbiased (Predictive) Risk Estimator, and the minimization of these estimators is proposed as a regularization parameter selection method for…

Numerical Analysis · Mathematics 2021-11-22 Elias S. Helou , Sandra A. Santos , Lucas E. A. Simões

This paper describes three methods for carrying out non-asymptotic inference on partially identified parameters that are solutions to a class of optimization problems. Applications in which the optimization problems arise include estimation…

Methodology · Statistics 2022-12-02 Joel L. Horowitz , Sokbae Lee

Preference elicitation plays a central role in interactive recommender systems. Most preference elicitation approaches use either item queries that ask users to select preferred items from a slate, or attribute queries that ask them to…

Information Retrieval · Computer Science 2023-11-07 Erdem Biyik , Fan Yao , Yinlam Chow , Alex Haig , Chih-wei Hsu , Mohammad Ghavamzadeh , Craig Boutilier

Simple exponential smoothing is widely used in forecasting economic time series. This is because it is quick to compute and it generally delivers accurate forecasts. On the other hand, its multivariate version has received little attention…

Computation · Statistics 2021-03-17 Federico Poloni , Giacomo Sbrana

Roughness parameters that characterize contacting surfaces with regard to friction and wear are commonly stated without uncertainties, or with an uncertainty only taking into account a very limited amount of aspects such as repeatability of…

Data Analysis, Statistics and Probability · Physics 2016-07-20 Dorothee Hüser , Jonathan Hüser , Sebastian Rief , Jörg Seewig , Peter Thomsen-Schmidt