English
Related papers

Related papers: Likelihood-ratio-based confidence intervals for ne…

200 papers

Improving the robustness of neural nets in regression tasks is key to their application in multiple domains. Deep learning-based approaches aim to achieve this goal either by improving their prediction of specific values (i.e., point…

Machine Learning · Computer Science 2021-06-22 Eli Simhayev , Gilad Katz , Lior Rokach

Confidence estimation, a task that aims to evaluate the trustworthiness of the model's prediction output during deployment, has received lots of research attention recently, due to its importance for the safe deployment of deep models.…

Computer Vision and Pattern Recognition · Computer Science 2022-10-14 Haoxuan Qu , Yanchao Li , Lin Geng Foo , Jason Kuen , Jiuxiang Gu , Jun Liu

We propose a novel deep learning approach to nonparametric statistical inference for the conditional hazard function of survival time with right-censored data. We use a deep neural network (DNN) to approximate the logarithm of a conditional…

Methodology · Statistics 2024-10-24 Wen Su , Kin-Yat Liu , Guosheng Yin , Jian Huang , Xingqiu Zhao

This study introduces the Misclassification Likelihood Matrix (MLM) as a novel tool for quantifying the reliability of neural network predictions under distribution shifts. The MLM is obtained by leveraging softmax outputs and clustering…

Deep neural networks (DNNs) are becoming more prevalent in important safety-critical applications, where reliability in the prediction is paramount. Despite their exceptional prediction capabilities, current DNNs do not have an implicit…

Machine Learning · Computer Science 2021-05-14 David Betancourt , Rafi Muhanna

Dealing with uncertainty is essential for efficient reinforcement learning. There is a growing literature on uncertainty estimation for deep learning from fixed datasets, but many of the most popular approaches are poorly-suited to…

Machine Learning · Statistics 2018-11-16 Ian Osband , John Aslanides , Albin Cassirer

The purpose of this paper is to propose methodologies for statistical inference of low-dimensional parameters with high-dimensional data. We focus on constructing confidence intervals for individual coefficients and linear combinations of…

Methodology · Statistics 2012-11-05 Cun-Hui Zhang , Stephanie S. Zhang

We present a formulation of deep learning that aims at producing a large margin classifier. The notion of margin, minimum distance to a decision boundary, has served as the foundation of several theoretically profound and empirically…

Machine Learning · Statistics 2018-12-05 Gamaleldin F. Elsayed , Dilip Krishnan , Hossein Mobahi , Kevin Regan , Samy Bengio

We propose a new inferential framework for constructing confidence regions and testing hypotheses in statistical models specified by a system of high dimensional estimating equations. We construct an influence function by projecting the…

Statistics Theory · Mathematics 2016-06-24 Matey Neykov , Yang Ning , Jun S. Liu , Han Liu

Uncertainty estimation is important for deploying LLMs in high-stakes applications such as healthcare and finance, where hallucinations can appear fluent and plausible while being factually incorrect, making it difficult for users to judge…

Machine Learning · Computer Science 2026-05-08 Mingcheng Zhu , Yu Liu , Tingting Zhu

Autonomous and semi-autonomous systems are using deep learning models to improve decision-making. However, deep classifiers can be overly confident in their incorrect predictions, a major issue especially in safety-critical domains. The…

Machine Learning · Computer Science 2024-12-05 Murat Sensoy , Lance M. Kaplan , Simon Julier , Maryam Saleki , Federico Cerutti

We present a theoretically well-founded deep learning algorithm for nonparametric regression. It uses over-parametrized deep neural networks with logistic activation function, which are fitted to the given data via gradient descent. We…

Statistics Theory · Mathematics 2025-04-14 Michael Kohler , Adam Krzyzak

Uncertainty quantification is an important and challenging problem in deep learning. Previous methods rely on dropout layers which are not present in modern deep architectures or batch normalization which is sensitive to batch sizes. In…

Computer Vision and Pattern Recognition · Computer Science 2020-07-10 Lukasz Wandzik , Raul Vicente Garcia , Jörg Krüger

Increasingly sophisticated mathematical modelling processes from Machine Learning are being used to analyse complex data. However, the performance and explainability of these models within practical critical systems requires a rigorous and…

Machine Learning · Computer Science 2020-12-08 Xingyu Zhao , Alec Banks , James Sharp , Valentin Robu , David Flynn , Michael Fisher , Xiaowei Huang

New estimates for the population risk are established for two-layer neural networks. These estimates are nearly optimal in the sense that the error rates scale in the same way as the Monte Carlo error rates. They are equally effective in…

Machine Learning · Statistics 2020-02-24 Weinan E , Chao Ma , Lei Wu

Recently, deep neural networks have become to be used in a variety of applications. While the accuracy of deep neural networks is increasing, the confidence score, which indicates the reliability of the prediction results, is becoming more…

Machine Learning · Computer Science 2021-04-20 Shohei Enomoto , Takeharu Eda

Probabilistic deep learning is deep learning that accounts for uncertainty, both model uncertainty and data uncertainty. It is based on the use of probabilistic models and deep neural networks. We distinguish two approaches to probabilistic…

Machine Learning · Computer Science 2021-06-10 Daniel T. Chang

Reliable uncertainty quantification in deep neural networks is very crucial in safety-critical applications such as automated driving for trustworthy and informed decision-making. Assessing the quality of uncertainty estimates is…

Computer Vision and Pattern Recognition · Computer Science 2022-12-12 Neslihan Kose , Ranganath Krishnan , Akash Dhamasia , Omesh Tickoo , Michael Paulitsch

Neural networks are becoming increasingly popular in applications, but our mathematical understanding of their potential and limitations is still limited. In this paper, we further this understanding by developing statistical guarantees for…

Machine Learning · Computer Science 2022-12-13 Johannes Lederer

A novel multi-level method for partial differential equations with uncertain parameters is proposed. The principle behind the method is that the error between grid levels in multi-level methods has a spatial structure that is by good…

Numerical Analysis · Mathematics 2020-04-29 Yous van Halder , Benjamin Sanderse , Barry Koren