English
Related papers

Related papers: ForeCal: Random Forest-based Calibration for DNNs

200 papers

State-of-the-art deep neural networks have achieved impressive results on many image classification tasks. However, these same architectures have been shown to be unstable to small, well sought, perturbations of the images. Despite the…

Machine Learning · Computer Science 2016-08-30 Seyed-Mohsen Moosavi-Dezfooli , Alhussein Fawzi , Pascal Frossard

In recent times, deep neural networks achieved outstanding predictive performance on various classification and pattern recognition tasks. However, many real-world prediction problems have ordinal response variables, and this ordering…

Machine Learning · Computer Science 2023-06-28 Xintong Shi , Wenzhi Cao , Sebastian Raschka

Albeit achieving high predictive accuracy across many challenging computer vision problems, recent studies suggest that deep neural networks (DNNs) tend to make overconfident predictions, rendering them poorly calibrated. Most of the…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Bimsara Pathiraja , Malitha Gunawardhana , Muhammad Haris Khan

Deep neural networks (DNNs) are poorly calibrated when trained in conventional ways. To improve confidence calibration of DNNs, we propose a novel training method, distance-based learning from errors (DBLE). DBLE bases its confidence…

Machine Learning · Computer Science 2020-02-19 Chen Xing , Sercan Arik , Zizhao Zhang , Tomas Pfister

Wildfires pose a significantly increasing hazard to global ecosystems due to the climate crisis. Due to its complex nature, there is an urgent need for innovative approaches to wildfire prediction, such as machine learning. This research…

Machine Learning · Computer Science 2024-11-18 İrem Üstek , Miguel Arana-Catania , Alexander Farr , Ivan Petrunin

Despite Graph Neural Networks (GNNs) have achieved remarkable accuracy, whether the results are trustworthy is still unexplored. Previous studies suggest that many modern neural networks are over-confident on the predictions, however,…

Machine Learning · Computer Science 2022-01-05 Xiao Wang , Hongrui Liu , Chuan Shi , Cheng Yang

Deep neural networks are behind many of the recent successes in machine learning applications. However, these models can produce overconfident decisions while encountering out-of-distribution (OOD) examples or making a wrong prediction.…

Machine Learning · Computer Science 2021-06-24 Navid Kardan , Ankit Sharma , Kenneth O. Stanley

Calibration of neural networks is a critical aspect to consider when incorporating machine learning models in real-world decision-making systems where the confidence of decisions are equally important as the decisions themselves. In recent…

Machine Learning · Computer Science 2022-02-22 Amir Rahimi , Thomas Mensink , Kartik Gupta , Thalaiyasingam Ajanthan , Cristian Sminchisescu , Richard Hartley

Rate of change of frequency (RoCoF) and frequency nadir should be considered in real-time frequency-constrained optimal power flow (FCOPF) to ensure frequency stability of the modern power systems. Since calculating the frequency response…

Systems and Control · Electrical Eng. & Systems 2025-04-09 Fan Jiang , Xingpeng Li , Pascal Van Hentenryck

We present a novel statistical approach to incorporating uncertainty awareness in model-free distributional reinforcement learning involving quantile regression-based deep Q networks. The proposed algorithm, $\textit{Calibrated Evidential…

Machine Learning · Computer Science 2024-06-05 Alex Christopher Stutts , Danilo Erricolo , Theja Tulabandhula , Amit Ranjan Trivedi

Quantifying uncertainty is crucial for robust and reliable predictions. However, existing spatiotemporal deep learning mostly focuses on deterministic prediction, overlooking the inherent uncertainty in such prediction. Particularly,…

Machine Learning · Computer Science 2024-09-16 Dingyi Zhuang , Yuheng Bu , Guang Wang , Shenhao Wang , Jinhua Zhao

Decision analytics commonly focuses on the text mining of financial news sources in order to provide managerial decision support and to predict stock market movements. Existing predictive frameworks almost exclusively apply traditional…

Machine Learning · Statistics 2018-07-05 Stefan Feuerriegel , Ralph Fehrer

Quantification of Uncertainty in predictions is a challenging problem. In the classification settings, although deep learning based models generalize well, class probabilities often lack reliability. Calibration errors are used to quantify…

Machine Learning · Computer Science 2024-05-07 Aditya Challa , Snehanshu Saha , Soma Dhavala

Preference-based alignment methods (e.g., RLHF, DPO) typically optimize a single scalar objective, implicitly averaging over heterogeneous human preferences. In practice, systematic annotator and user-group disagreement makes mean-reward…

Machine Learning · Computer Science 2026-05-19 Mingxi Zou , Jiaxiang Chen , Junfan Li , Langzhang Liang , Qifan Wang , Xu Yinghui , Zenglin Xu

While deep learning has proven to be extremely successful at supervised classification tasks at the LHC and beyond, for practical applications, raw classification accuracy is often not the only consideration. One crucial issue is the…

High Energy Physics - Phenomenology · Physics 2020-10-02 Gregor Kasieczka , David Shih

Deep convolutional neural networks (DCNN) have enjoyed great successes in many signal processing applications because they can learn complex, non-linear causal relationships from input to output. In this light, DCNNs are well suited for the…

Image and Video Processing · Electrical Eng. & Systems 2018-10-31 Xi Zhang , Xiaolin Wu

We propose a generic framework to calibrate accuracy and confidence of a prediction in deep neural networks through stochastic inferences. We interpret stochastic regularization using a Bayesian model, and analyze the relation between…

Machine Learning · Computer Science 2019-04-25 Seonguk Seo , Paul Hongsuck Seo , Bohyung Han

According to the Probability Ranking Principle (PRP), ranking documents in decreasing order of their probability of relevance leads to an optimal document ranking for ad-hoc retrieval. The PRP holds when two conditions are met: [C1] the…

Information Retrieval · Computer Science 2021-01-13 Gustavo Penha , Claudia Hauff

Deep neural networks (DNNs) are powerful types of artificial neural networks (ANNs) that use several hidden layers. They have recently gained considerable attention in the speech transcription and image recognition community (Krizhevsky et…

Machine Learning · Computer Science 2017-06-15 Matthew Dixon , Diego Klabjan , Jin Hoon Bang

Convolutional Neural Networks (CNNs) have achieved state-of-the-art performance in many computer vision tasks. However, high computational and storage demands hinder their deployment into resource-constrained environments, such as embedded…

Computer Vision and Pattern Recognition · Computer Science 2024-06-03 Pallavi Mitra , Gesina Schwalbe , Nadja Klein