English
Related papers

Related papers: Multiclass Alignment of Confidence and Certainty f…

200 papers

Network traffic classification (NTC) models often suffer severe performance degradation when deployed in real-world environments due to distribution shifts caused by changing network conditions. Existing robustness-enhancing approaches are…

Machine Learning · Computer Science 2026-05-19 Tongze Wang , Xiaohui Xie , Wenduo Wang , Chuyi Wang , Yong Cui

Model predictive control (MPC) achieves stability and constraint satisfaction for general nonlinear systems, but requires computationally expensive online optimization. This paper studies approximations of such MPC controllers via neural…

Systems and Control · Electrical Eng. & Systems 2025-11-07 Henrik Hose , Johannes Köhler , Melanie N. Zeilinger , Sebastian Trimpe

Large Language Models (LLMs) have demonstrated inherent calibration capabilities, where predicted probabilities align well with correctness, despite prior findings that deep neural networks are often overconfident. Recent studies have…

Machine Learning · Computer Science 2025-11-04 Abhinav Joshi , Areeb Ahmad , Ashutosh Modi

Class imbalance problems manifest in domains such as financial fraud detection or network intrusion analysis, where the prevalence of one class is much higher than another. Typically, practitioners are more interested in predicting the…

Machine Learning · Statistics 2017-11-16 Peter Xenopoulos

Albeit revealing impressive predictive performance for several computer vision tasks, deep neural networks (DNNs) are prone to making overconfident predictions. This limits the adoption and wider utilization of DNNs in many safety-critical…

Computer Vision and Pattern Recognition · Computer Science 2023-11-08 Muhammad Akhtar Munir , Salman Khan , Muhammad Haris Khan , Mohsen Ali , Fahad Shahbaz Khan

Deep neural networks have achieved remarkable success across a variety of tasks, yet they often suffer from unreliable probability estimates. As a result, they can be overconfident in their predictions. Conformal Prediction (CP) offers a…

Lung cancer is one of the significant causes of cancer-related deaths globally. Early detection and treatment improve the chances of survival. Traditionally CT scans have been used to extract the most significant lung infection information…

Image and Video Processing · Electrical Eng. & Systems 2024-01-23 Mehar Prateek Kalra , Mansi Singhal , Rohan Raju Dhanakashirur

Imbalanced datasets are commonplace in modern machine learning problems. The presence of under-represented classes or groups with sensitive attributes results in concerns about generalization and fairness. Such concerns are further…

Machine Learning · Computer Science 2022-01-05 Mingchen Li , Xuechen Zhang , Christos Thrampoulidis , Jiasi Chen , Samet Oymak

Recent advances in Multi-modal Large Language Models (MLLMs) have predominantly focused on enhancing visual perception to improve accuracy. However, a critical question remains unexplored: Do models know when they do not know? Through a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Yuetian Du , Yucheng Wang , Rongyu Zhang , Zhijie Xu , Boyu Yang , Ming Kong , Jie Liu , Qiang Zhu

Deep learning has been shown to be highly effective for automatic modulation classification (AMC), which is a pivotal technology for next-generation cognitive communications. Yet, existing deep learning methods for AMC often lack robust…

Signal Processing · Electrical Eng. & Systems 2025-12-03 Huian Yang , Rajeev Sahay

Reinforcement learning post-training has substantially improved the reasoning accuracy of vision-language models, yet the resulting policies remain poorly calibrated. Terminal correctness rewards provide no gradient that penalizes confident…

Machine Learning · Computer Science 2026-05-19 Peng Cui , Boyao Yang , Jun Zhu

We study the tradeoff between computational effort and classification accuracy in a cascade of deep neural networks. During inference, the user sets the acceptable accuracy degradation which then automatically determines confidence…

Machine Learning · Computer Science 2020-11-12 Konstantin Berestizshevsky , Guy Even

As deep neural networks(DNN) become increasingly prevalent, particularly in high-stakes areas such as autonomous driving and healthcare, the ability to detect incorrect predictions of models and intervene accordingly becomes crucial for…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Ge Yan , Tsui-Wei Weng

Deep neural networks (DNNs) have become integral to a wide range of scientific and practical applications due to their flexibility and strong predictive performance. Despite their accuracy, however, DNNs frequently exhibit poor calibration,…

Machine Learning · Computer Science 2026-03-12 Sanne Ruijs , Alina Kosiakova , Farrukh Javed

Deep learning models, including modern systems like large language models, are well known to offer unreliable estimates of the uncertainty of their decisions. In order to improve the quality of the confidence levels, also known as…

Machine Learning · Computer Science 2024-04-15 Jiayi Huang , Sangwoo Park , Osvaldo Simeone

Deep neural networks have been increasingly used in safety-critical applications such as medical diagnosis and autonomous driving. However, many studies suggest that they are prone to being poorly calibrated and have a propensity for…

Machine Learning · Computer Science 2025-06-02 Chengli Tan , Yubo Zhou , Haishan Ye , Guang Dai , Junmin Liu , Zengjie Song , Jiangshe Zhang , Zixiang Zhao , Yunda Hao , Yong Xu

Deep neural networks are behind many of the recent successes in machine learning applications. However, these models can produce overconfident decisions while encountering out-of-distribution (OOD) examples or making a wrong prediction.…

Machine Learning · Computer Science 2021-06-24 Navid Kardan , Ankit Sharma , Kenneth O. Stanley

Mammographic screening is an effective method for detecting breast cancer, facilitating early diagnosis. However, the current need to manually inspect images places a heavy burden on healthcare systems, spurring a desire for automated…

Image and Video Processing · Electrical Eng. & Systems 2025-01-30 Ciaran Bench , Emir Ahmed , Spencer A. Thomas

Perturbation-based explanations are widely utilized to enhance the transparency of machine-learning models in practice. However, their reliability is often compromised by the unknown model behavior under the specific perturbations used.…

Machine Learning · Computer Science 2025-11-14 Thomas Decker , Volker Tresp , Florian Buettner

The dynamic, real-time, and accurate inference of model parameters from empirical data is of great importance in many scientific and engineering disciplines that use computational models (such as a digital twin) for the analysis and…

Signal Processing · Electrical Eng. & Systems 2020-06-11 Yuan Tian , Manuel Arias Chao , Chetan Kulkarni , Kai Goebel , Olga Fink