English
Related papers

Related papers: Calibration of Deep Learning Classification Models…

200 papers

The unwavering success of deep learning in the past decade led to the increasing prevalence of deep learning methods in various application fields. However, the downsides of deep learning, most prominently its lack of trustworthiness, may…

Machine Learning · Computer Science 2024-08-13 Holger Boche , Vit Fojtik , Adalbert Fono , Gitta Kutyniok

Deep neural networks (DNNs) have numerous applications across various domains. Several optimization techniques, such as ResNet and SENet, have been proposed to improve model accuracy. These techniques improve the model performance by…

Computer Vision and Pattern Recognition · Computer Science 2024-11-22 Wenxiang Xu , Tian Qiu , Linyun Zhou , Zunlei Feng , Mingli Song , Huiqiong Wang

Although Neural Radiance Fields (NeRFs) have markedly improved novel view synthesis, accurate uncertainty quantification in their image predictions remains an open problem. The prevailing methods for estimating uncertainty, including the…

Computer Vision and Pattern Recognition · Computer Science 2024-09-23 Niki Amini-Naieni , Tomas Jakab , Andrea Vedaldi , Ronald Clark

There have been several attempts to use deep learning based on brain fMRI signals to classify cognitive impairment diseases. However, deep learning is a hidden black box model that makes it difficult to interpret the process of…

Machine Learning · Computer Science 2024-11-20 Jeong-Jae Kim , Yeseul Jeon , SuMin Yu , Junggu Choi , Sanghoon Han

The vulnerability of machine learning models to membership inference attacks has received much attention in recent years. However, existing attacks mostly remain impractical due to having high false positive rates, where non-member samples…

Cryptography and Security · Computer Science 2022-04-12 Lauren Watson , Chuan Guo , Graham Cormode , Alex Sablayrolles

Deep neural networks have revolutionized medical image analysis and disease diagnosis. Despite their impressive performance, it is difficult to generate well-calibrated probabilistic outputs for such networks, which makes them…

Machine Learning · Computer Science 2020-05-29 Pranav Poduval , Hrushikesh Loya , Amit Sethi

Confidence calibration - the process to calibrate the output probability distribution of neural networks - is essential for safety-critical applications of such networks. Recent works verify the link between mis-calibration and overfitting.…

Machine Learning · Computer Science 2023-05-24 Linwei Tao , Minjing Dong , Daochang Liu , Changming Sun , Chang Xu

Graphs can model real-world, complex systems by representing entities and their interactions in terms of nodes and edges. To better exploit the graph structure, graph neural networks have been developed, which learn entity and edge…

Machine Learning · Computer Science 2022-06-06 Tong Liu , Yushan Liu , Marcel Hildebrandt , Mitchell Joblin , Hang Li , Volker Tresp

This paper explores the calibration of a classifier output score in binary classification problems. A calibrator is a function that maps the arbitrary classifier score, of a testing observation, onto $[0,1]$ to provide an estimate for the…

Machine Learning · Computer Science 2022-04-29 Waleed A. Yousef , Issa Traore , William Briguglio

Rapid development in numerical modelling of materials and the complexity of new models increases quickly together with their computational demands. Despite the growing performance of modern computers and clusters, calibration of such models…

Neural and Evolutionary Computing · Computer Science 2016-03-08 Tomáš Mareš , Eliška Janouchová , Anna Kučerová

Upcoming Fast Radio Burst (FRB) surveys will search $\sim$10\,$^3$ beams on sky with very high duty cycle, generating large numbers of single-pulse candidates. The abundance of false positives presents an intractable problem if candidates…

Instrumentation and Methods for Astrophysics · Physics 2018-11-28 Liam Connor , Joeri van Leeuwen

Accurate conditional prediction in the regression setting plays an important role in many real-world problems. Typically, a point prediction often falls short since no attempt is made to quantify the prediction accuracy. Classically, under…

Methodology · Statistics 2025-09-04 Kejin Wu , Dimitris N. Politis

Accurate multi-sensor calibration is essential for deploying robust perception systems in applications such as autonomous driving and intelligent transportation. Existing LiDAR-camera calibration methods often rely on manually placed…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Lei Cheng , Lihao Guo , Tianya Zhang , Tam Bang , Austin Harris , Mustafa Hajij , Mina Sartipi , Siyang Cao

Registration is the process that computes the transformation that aligns sets of data. Commonly, a registration process can be divided into four main steps: target selection, feature extraction, feature matching, and transform computation…

Computer Vision and Pattern Recognition · Computer Science 2020-10-29 Victor Villena-Martinez , Sergiu Oprea , Marcelo Saval-Calvo , Jorge Azorin-Lopez , Andres Fuster-Guillo , Robert B. Fisher

Deep learning models have achieved state-of-the-art performance in many classification tasks. However, most of them cannot provide an interpretation for their classification results. Machine learning models that are interpretable are…

Machine Learning · Computer Science 2021-11-04 Miles Q. Li , Benjamin C. M. Fung , Adel Abusitta

Complex problems may require sophisticated, non-linear learning methods such as kernel machines or deep neural networks to achieve state of the art prediction accuracies. However, high prediction accuracies are not the only objective to…

Artificial Intelligence · Computer Science 2016-11-24 Marina M. -C. Vidovic , Nico Görnitz , Klaus-Robert Müller , Marius Kloft

Calibration of deep learning models is crucial to their trustworthiness and safe usage, and as such, has been extensively studied in supervised classification models, with methods crafted to decrease miscalibration. However, there has yet…

Computer Vision and Pattern Recognition · Computer Science 2023-04-20 Will LeVine , Benjamin Pikus , Pranav Raja , Fernando Amat Gil

The calibration of deep learning-based perception models plays a crucial role in their reliability. Our work focuses on a class-wise evaluation of several model's confidence performance for LiDAR-based semantic segmentation with the aim of…

Computer Vision and Pattern Recognition · Computer Science 2022-10-14 Mariella Dreissig , Florian Piewak , Joschka Boedecker

Despite the impressive advances achieved using deep learning for functional brain activity analysis, the heterogeneity of functional patterns and the scarcity of imaging data still pose challenges in tasks such as identifying neurological…

Image and Video Processing · Electrical Eng. & Systems 2025-05-30 Wenhui Cui , Haleh Akrami , Anand A. Joshi , Richard M. Leahy

Deep neural networks (DNNs) are poorly calibrated when trained in conventional ways. To improve confidence calibration of DNNs, we propose a novel training method, distance-based learning from errors (DBLE). DBLE bases its confidence…

Machine Learning · Computer Science 2020-02-19 Chen Xing , Sercan Arik , Zizhao Zhang , Tomas Pfister