English
Related papers

Related papers: Calibration of Deep Learning Classification Models…

200 papers

The growing use of deep learning in safety-critical applications, such as medical imaging, has raised concerns about limited labeled data, where this demand is amplified as model complexity increases, posing hurdles for domain experts to…

Machine Learning · Computer Science 2024-07-03 Lorenzo S. Querol , Hajime Nagahara , Hideaki Hayashi

Functional near-infrared spectroscopy (fNIRS) is a non-intrusive way to measure cortical hemodynamic activity. Predicting cognitive workload from fNIRS data has taken on a diffuse set of methods. To be applicable in real-world settings,…

Machine Learning · Computer Science 2024-05-02 Jiyang Wang , Ayse Altay , Senem Velipasalar

Calibration is crucial in deep learning applications, especially in fields like healthcare and autonomous driving, where accurate confidence estimates are vital for decision-making. However, deep neural networks often suffer from…

Machine Learning · Computer Science 2024-10-17 Linwei Tao , Haolan Guo , Minjing Dong , Chang Xu

Delivering meaningful uncertainty estimates is essential for a successful deployment of machine learning models in the clinical practice. A central aspect of uncertainty quantification is the ability of a model to return predictions that…

Computer Vision and Pattern Recognition · Computer Science 2023-03-03 Adrian Galdran , Johan Verjans , Gustavo Carneiro , Miguel A. González Ballester

Calibration error is commonly adopted for evaluating the quality of uncertainty estimators in deep neural networks. In this paper, we argue that such a metric is highly beneficial for training predictive models, even when we do not…

Machine Learning · Statistics 2019-11-01 Jayaraman J. Thiagarajan , Bindya Venkatesh , Deepta Rajan

Channel estimation and beamforming play critical roles in frequency-division duplexing (FDD) massive multiple-input multiple-output (MIMO) systems. However, these two modules have been treated as two stand-alone components, which makes it…

Signal Processing · Electrical Eng. & Systems 2021-08-04 Yifan Ma , Yifei Shen , Xianghao Yu , Jun Zhang , S. H. Song , Khaled B. Letaief

Deep neural networks (DNNs) have achieved significant success across various tasks, but ensuring reliable uncertainty estimates, known as model calibration, is crucial for their safe and effective deployment. Modern DNNs often suffer from…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Linwei Tao , Minjing Dong , Chang Xu

Deep metric learning has gained promising improvement in recent years following the success of deep learning. It has been successfully applied to problems in few-shot learning, image retrieval, and open-set classifications. However,…

Machine Learning · Computer Science 2020-06-11 Maryna Karpusha , Sunghee Yun , Istvan Fehervari

In chemometrics, data from infrared or near-infrared (NIR) spectroscopy are often used to identify a compound or to analyze the composition of amaterial. This involves the calibration of models that predict the concentration ofmaterial…

Neural and Evolutionary Computing · Computer Science 2015-03-20 A. Ukil , J. Bernasconi

The wide-spread adoption of representation learning technologies in clinical decision making strongly emphasizes the need for characterizing model reliability and enabling rigorous introspection of model behavior. While the former need is…

Machine Learning · Computer Science 2020-05-01 Jayaraman J. Thiagarajan , Prasanna Sattigeri , Deepta Rajan , Bindya Venkatesh

With the advancement of deep learning technology, neural networks have demonstrated their excellent ability to provide accurate predictions in many tasks. However, a lack of consideration for neural network calibration will not gain trust…

Machine Learning · Computer Science 2022-11-30 Lei Hsiung , Yung-Chen Tang , Pin-Yu Chen , Tsung-Yi Ho

Deep Neural Networks (DNNs) have achieved state-of-the-art accuracy performance in many tasks. However, recent works have pointed out that the outputs provided by these models are not well-calibrated, seriously limiting their use in…

Machine Learning · Computer Science 2020-07-16 Juan Maroñas , Roberto Paredes , Daniel Ramos

Uncertainty quantification in automated image analysis is highly desired in many applications. Typically, machine learning models in classification or segmentation are only developed to provide binary answers; however, quantifying the…

Trained DNN models are increasingly adopted as integral parts of software systems, but they often perform deficiently in the field. A particularly damaging problem is that DNN models often give false predictions with high confidence, due to…

Machine Learning · Computer Science 2020-09-16 Zenan Li , Xiaoxing Ma , Chang Xu , Jingwei Xu , Chun Cao , Jian Lü

Deep neural networks are powerful tools to detect hidden patterns in data and leverage them to make predictions, but they are not designed to understand uncertainty and estimate reliable probabilities. In particular, they tend to be…

Machine Learning · Statistics 2022-11-10 Bat-Sheva Einbinder , Yaniv Romano , Matteo Sesia , Yanfei Zhou

IR or near-infrared (NIR) spectroscopy is a method used to identify a compound or to analyze the composition of a material. Calibration of NIR spectra refers to the use of the spectra as multivariate descriptors to predict concentrations of…

Neural and Evolutionary Computing · Computer Science 2015-03-19 A. Ukil , J. Bernasconi , H. Braendle , H. Buijs , S. Bonenfant

This article presents an innovative study in exploring, evaluating, and implementing deep learning architectures for the calibration of multi-modal sensor systems. The focus behind this is to leverage the use of sensor fusion to achieve…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Venkat Karramreddy , Liam Mitchell

Low-cost gyroscope calibration is essential for ensuring the accuracy and reliability of gyroscope measurements. Stationary calibration estimates the deterministic parts of measurement errors. To this end, a common practice is to average…

Machine Learning · Computer Science 2025-11-18 Yair Stolero , Itzik Klein

Calibration is an essential prerequisite for the accurate data fusion of LiDAR and camera sensors. Traditional calibration techniques often require specific targets or suitable scenes to obtain reliable 2D-3D correspondences. To tackle the…

Computer Vision and Pattern Recognition · Computer Science 2025-01-29 Shujuan Huang , Chunyu Lin , Yao Zhao

Reliable uncertainty calibration is essential for safely deploying deep neural networks in high-stakes applications. Deep neural networks are known to exhibit systematic overconfidence, especially under distribution shifts. Although…

Machine Learning · Computer Science 2025-06-12 Achim Hekler , Lukas Kuhn , Florian Buettner