English
Related papers

Related papers: Enhance GNNs with Reliable Confidence Estimation v…

200 papers

Reliable uncertainty estimation is critical for deploying neural networks (NNs) in real-world applications. While existing calibration techniques often rely on post-hoc adjustments or coarse-grained binning methods, they remain limited in…

Machine Learning · Computer Science 2025-05-30 Pedro Mendes , Paolo Romano , David Garlan

Predicting properties of nodes in a graph is an important problem with applications in a variety of domains. Graph-based Semi-Supervised Learning (SSL) methods aim to address this problem by labeling a small subset of the nodes as seeds and…

Machine Learning · Computer Science 2019-02-13 Shikhar Vashishth , Prateek Yadav , Manik Bhandari , Partha Talukdar

While pre-trained language models (PLMs) have become a de-facto standard promoting the accuracy of text classification tasks, recent studies find that PLMs often predict over-confidently. Although various calibration methods have been…

Computation and Language · Computer Science 2023-02-15 Jaeyoung Kim , Dongbin Na , Sungchul Choi , Sungbin Lim

The accurate representation of epistemic uncertainty is a challenging yet essential task in machine learning. A widely used representation corresponds to convex sets of probabilistic predictors, also known as credal sets. One popular way of…

Machine Learning · Computer Science 2025-07-30 Mira Jürgens , Thomas Mortier , Eyke Hüllermeier , Viktor Bengs , Willem Waegeman

Despite continuous improvements, precipitation forecasts are still not as accurate and reliable as those of other meteorological variables. A major contributing factor to this is that several key processes affecting precipitation…

Atmospheric and Oceanic Physics · Physics 2022-11-09 Lucy Harris , Andrew T. T. McRae , Matthew Chantry , Peter D. Dueben , Tim N. Palmer

Automating arrhythmia detection from ECG requires a robust and trusted system that retains high accuracy under electrical disturbances. Many machine learning approaches have reached human-level performance in classifying arrhythmia from…

Signal Processing · Electrical Eng. & Systems 2022-10-14 Khondker Fariha Hossain , Sharif Amit Kamran , Alireza Tavakkoli , Xingjun Ma

Deploying trustworthy AI systems requires principled uncertainty quantification. Conformal prediction (CP) is a widely used framework for constructing prediction sets with distribution-free coverage guarantees. In many practical settings,…

Machine Learning · Computer Science 2026-03-18 Haifeng Wen , Osvaldo Simeone , Hong Xing

Most supervised machine learning tasks are subject to irreducible prediction errors. Probabilistic predictive models address this limitation by providing probability distributions that represent a belief over plausible targets, rather than…

Machine Learning · Statistics 2022-10-25 David Widmann , Fredrik Lindsten , Dave Zachariah

Deep neural networks (DNNs) have achieved remarkable performance in many tasks, yet they often behave as opaque black boxes. Explanation-guided learning (EGL) methods steer DNNs using human-provided explanations or supervision on model…

Machine Learning · Computer Science 2026-03-03 Chao Chen , Yanhui Chen , Shanshan Lin , Dongsheng Hong , Shu Wu , Xiangwen Liao , Chuanyi Liu

Classifier calibration has received recent attention from the machine learning community due both to its practical utility in facilitating decision making, as well as the observation that modern neural network classifiers are poorly…

Machine Learning · Computer Science 2022-05-24 John Kirchenbauer , Jacob Oaks , Eric Heim

Deep neural networks (DNNs) have numerous applications across various domains. Several optimization techniques, such as ResNet and SENet, have been proposed to improve model accuracy. These techniques improve the model performance by…

Computer Vision and Pattern Recognition · Computer Science 2024-11-22 Wenxiang Xu , Tian Qiu , Linyun Zhou , Zunlei Feng , Mingli Song , Huiqiong Wang

Confidence calibration is central to providing accurate and interpretable uncertainty estimates, especially under safety-critical scenarios. However, we find that existing calibration algorithms often overlook the issue of *proximity bias*,…

Machine Learning · Computer Science 2024-03-19 Miao Xiong , Ailin Deng , Pang Wei Koh , Jiaying Wu , Shen Li , Jianqing Xu , Bryan Hooi

We present a new algorithm to train a robust neural network against adversarial attacks. Our algorithm is motivated by the following two ideas. First, although recent work has demonstrated that fusing randomness can improve the robustness…

Machine Learning · Computer Science 2019-05-07 Xuanqing Liu , Yao Li , Chongruo Wu , Cho-Jui Hsieh

Convolutional neural networks (CNNs) have made significant advancement, however, they are widely known to be vulnerable to adversarial attacks. Adversarial training is the most widely used technique for improving adversarial robustness to…

Machine Learning · Computer Science 2021-10-12 Philipp Benz , Chaoning Zhang , Adil Karjauv , In So Kweon

For classification models based on neural networks, the maximum predicted class probability is often used as a confidence score. This score rarely predicts well the probability of making a correct prediction and requires a post-processing…

Machine Learning · Computer Science 2024-11-07 Adrien LeCoz , Stéphane Herbin , Faouzi Adjed

Different from deep neural networks for non-graph data classification, graph neural networks (GNNs) leverage the information exchange between nodes (or samples) when representing nodes. The category distribution shows an imbalance or even a…

Machine Learning · Computer Science 2021-10-19 Rui Wang , Weixuan Xiong , Qinghu Hou , Ou Wu

We present evidence for the existence and effectiveness of adversarial attacks on graph neural networks (GNNs) that aim to degrade fairness. These attacks can disadvantage a particular subgroup of nodes in GNN-based node classification,…

Machine Learning · Computer Science 2023-02-07 Hussain Hussain , Meng Cao , Sandipan Sikdar , Denis Helic , Elisabeth Lex , Markus Strohmaier , Roman Kern

Miscalibration in deep learning refers to there is a discrepancy between the predicted confidence and performance. This problem usually arises due to the overfitting problem, which is characterized by learning everything presented in the…

Machine Learning · Computer Science 2024-07-16 Zongbo Han , Yifeng Yang , Changqing Zhang , Linjun Zhang , Joey Tianyi Zhou , Qinghua Hu

Generative Adversarial Networks (GANs) have proven to be a powerful framework for learning to draw samples from complex distributions. However, GANs are also notoriously difficult to train, with mode collapse and oscillations a common…

Machine Learning · Statistics 2018-11-28 Kevin J Liang , Chunyuan Li , Guoyin Wang , Lawrence Carin

Despite the recent advances of graph neural networks (GNNs) in modeling graph data, the training of GNNs on large datasets is notoriously hard due to the overfitting. Adversarial training, which augments data with the worst-case adversarial…

Machine Learning · Computer Science 2021-10-29 Haotian Xue , Kaixiong Zhou , Tianlong Chen , Kai Guo , Xia Hu , Yi Chang , Xin Wang