English
Related papers

Related papers: Monitoring Shortcut Learning using Mutual Informat…

200 papers

Shortcuts, also described as Clever Hans behavior, spurious correlations, or confounders, present a significant challenge in machine learning and AI, critically affecting model generalization and robustness. Research in this area, however,…

Machine Learning · Computer Science 2024-12-09 David Steinmann , Felix Divo , Maurice Kraus , Antonia Wüst , Lukas Struppek , Felix Friedrich , Kristian Kersting

The ability to detect Out-of-Distribution (OOD) data is important in safety-critical applications of deep learning. The aim is to separate In-Distribution (ID) data drawn from the training distribution from OOD data using a measure of…

Machine Learning · Computer Science 2022-09-21 Guoxuan Xia , Christos-Savvas Bouganis

In this paper, we propose a novel mutual consistency network (MC-Net+) to effectively exploit the unlabeled data for semi-supervised medical image segmentation. The MC-Net+ model is motivated by the observation that deep models trained with…

Computer Vision and Pattern Recognition · Computer Science 2022-07-05 Yicheng Wu , Zongyuan Ge , Donghao Zhang , Minfeng Xu , Lei Zhang , Yong Xia , Jianfei Cai

Learning the similarity between images constitutes the foundation for numerous vision tasks. The common paradigm is discriminative metric learning, which seeks an embedding that separates different training classes. However, the main…

Computer Vision and Pattern Recognition · Computer Science 2021-09-10 Timo Milbich , Karsten Roth , Biagio Brattoli , Björn Ommer

The discrepancy between in-distribution (ID) and out-of-distribution (OOD) samples can lead to \textit{distributional vulnerability} in deep neural networks, which can subsequently lead to high-confidence predictions for OOD samples. This…

Machine Learning · Computer Science 2023-10-03 Zhilin Zhao , Longbing Cao , Kun-Yu Lin

Multimodal deep learning, especially vision-language models, have gained significant traction in recent years, greatly improving performance on many downstream tasks, including content moderation and violence detection. However, standard…

Computer Vision and Pattern Recognition · Computer Science 2024-08-05 Zhuokai Zhao , Harish Palani , Tianyi Liu , Lena Evans , Ruth Toner

An information-theoretic upper bound on the generalization error of supervised learning algorithms is derived. The bound is constructed in terms of the mutual information between each individual training sample and the output of the…

Machine Learning · Computer Science 2020-08-06 Yuheng Bu , Shaofeng Zou , Venugopal V. Veeravalli

Distributed machine learning (ML) can bring more computational resources to bear than single-machine learning, thus enabling reductions in training time. Distributed learning partitions models and data over many machines, allowing model and…

Machine Learning · Computer Science 2022-04-20 Binhang Yuan , Cameron R. Wolfe , Chen Dun , Yuxin Tang , Anastasios Kyrillidis , Christopher M. Jermaine

Mutual information (MI) is a useful information-theoretic measure to quantify the statistical dependence between two random variables: $X$ and $Y$. Often, we are interested in understanding how the dependence between $X$ and $Y$ in one set…

Information Theory · Computer Science 2025-07-22 Chetan Gohil , Oliver M Cliff , James M. Shine , Ben D. Fulcher , Joseph T. Lizier

Out-of-Distribution (OOD) generalization has become a primary metric for evaluating image analysis systems. Since deep learning models tend to capture domain-specific context, they often develop shortcut dependencies on these non-causal…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Haoran Pei , Yuguang Yang , Kexin Liu , Juan Zhang , Baochang Zhang

For real-world applications of machine learning (ML), it is essential that models make predictions based on well-generalizing features rather than spurious correlations in the data. The identification of such spurious correlations, also…

Machine Learning · Computer Science 2023-07-24 Nicolas M. Müller , Simon Roschmann , Shahbaz Khan , Philip Sperl , Konstantin Böttinger

Unsupervised Domain Adaptation (UDA) endeavors to adjust models trained on a source domain to perform well on a target domain without requiring additional annotations. In the context of domain adaptive semantic segmentation, which tackles…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Wenlve Zhou , Zhiheng Zhou , Tianlei Wang , Delu Zeng

An important pillar for safe machine learning (ML) is the systematic mitigation of weaknesses in neural networks to afford their deployment in critical applications. An ubiquitous class of safety risks are learned shortcuts, i.e. spurious…

Computer Vision and Pattern Recognition · Computer Science 2021-04-26 Julia Rosenzweig , Joachim Sicking , Sebastian Houben , Michael Mock , Maram Akila

Deep learning models frequently exploit spurious features in training data to achieve low training error, often resulting in poor generalization when faced with shifted testing distributions. To address this issue, various methods from…

Machine Learning · Computer Science 2025-02-11 Geraldin Nanfack , Eugene Belilovsky

The concepts of conditional mutual information (CMI) and normalized conditional mutual information (NCMI) are introduced to measure the concentration and separation performance of a classification deep neural network (DNN) in the output…

Machine Learning · Computer Science 2023-09-19 En-Hui Yang , Shayan Mohajer Hamidi , Linfeng Ye , Renhao Tan , Beverly Yang

The rise of Artificial Intelligence (AI) has revolutionized numerous industries and transformed the way society operates. Its widespread use has led to the distribution of AI and its underlying data across many intelligent systems. In this…

Cryptography and Security · Computer Science 2024-02-14 Yasas Supeksala , Dinh C. Nguyen , Ming Ding , Thilina Ranbaduge , Calson Chua , Jun Zhang , Jun Li , H. Vincent Poor

The volume of freely scraped data on the Internet has driven the tremendous success of deep learning. Along with this comes the growing concern about data privacy and security. Numerous methods for generating unlearnable examples have been…

Machine Learning · Computer Science 2026-03-05 Yifan Zhu , Yibo Miao , Yinpeng Dong , Xiao-Shan Gao

Neural networks are often utilised in critical domain applications (e.g. self-driving cars, financial markets, and aerospace engineering), even though they exhibit overconfident predictions for ambiguous inputs. This deficiency demonstrates…

Machine Learning · Computer Science 2023-01-03 John Mitros , Brian Mac Namee

Recent semi-supervised learning methods use pseudo supervision as core idea, especially self-training methods that generate pseudo labels. However, pseudo labels are unreliable. Self-training methods usually rely on single model prediction…

Computer Vision and Pattern Recognition · Computer Science 2022-05-12 Zhengyang Feng , Qianyu Zhou , Qiqi Gu , Xin Tan , Guangliang Cheng , Xuequan Lu , Jianping Shi , Lizhuang Ma

Mutual information (MI) is a general measure of statistical dependence with widespread application across the sciences. However, estimating MI between multi-dimensional variables is challenging because the number of samples necessary to…

Quantitative Methods · Quantitative Biology 2025-03-06 Gokul Gowri , Xiao-Kang Lun , Allon M. Klein , Peng Yin