English
Related papers

Related papers: Explanations based on the Missing: Towards Contras…

200 papers

To equip Convolutional Neural Networks (CNNs) with explainability, it is essential to interpret how opaque models take specific decisions, understand what causes the errors, improve the architecture design, and identify unethical biases in…

Computer Vision and Pattern Recognition · Computer Science 2024-02-23 Mohammad Mahdi Dehshibi , Mona Ashtari-Majlan , Gereziher Adhane , David Masip

Graph contrastive learning has shown great promise when labeled data is scarce, but large unlabeled datasets are available. However, it often does not take uncertainty estimation into account. We show that a variational Bayesian neural…

Machine Learning · Computer Science 2023-12-04 Alexander Möllers , Alexander Immer , Elvin Isufi , Vincent Fortuin

Contrastive learning has emerged as a cornerstone in recent achievements of unsupervised representation learning. Its primary paradigm involves an instance discrimination task with a mutual information loss. The loss is known as InfoNCE and…

Artificial Intelligence · Computer Science 2023-08-31 Kyungeun Lee , Jaeill Kim , Suhyun Kang , Wonjong Rhee

Missing data can pose a challenge for machine learning (ML) modeling. To address this, current approaches are categorized into feature imputation and label prediction and are primarily focused on handling missing data to enhance ML…

Machine Learning · Computer Science 2023-09-19 Laixin Xie , Yang Ouyang , Longfei Chen , Ziming Wu , Quan Li

When an image classifier outputs a wrong class label, it can be helpful to see what changes in the image would lead to a correct classification. This is the aim of algorithms generating counterfactual explanations. However, there is no…

Computer Vision and Pattern Recognition · Computer Science 2021-12-01 Benedikt Höltgen , Lisa Schut , Jan M. Brauner , Yarin Gal

The choice of negative examples is important in noise contrastive estimation. Recent works find that hard negatives -- highest-scoring incorrect examples under the model -- are effective in practice, but they are used without a formal…

Computation and Language · Computer Science 2021-04-14 Wenzheng Zhang , Karl Stratos

Contrastive learning relies on an assumption that positive pairs contain related views, e.g., patches of an image or co-occurring multimodal signals of a video, that share certain underlying information about an instance. But what if this…

Computer Vision and Pattern Recognition · Computer Science 2022-01-13 Ching-Yao Chuang , R Devon Hjelm , Xin Wang , Vibhav Vineet , Neel Joshi , Antonio Torralba , Stefanie Jegelka , Yale Song

One principal approach for illuminating a black-box neural network is feature attribution, i.e. identifying the importance of input features for the network's prediction. The predictive information of features is recently proposed as a…

Machine Learning · Computer Science 2021-12-09 Yang Zhang , Ashkan Khakzar , Yawei Li , Azade Farshad , Seong Tae Kim , Nassir Navab

Distance-based anomaly detection methods rely on compact in-distribution (ID) embeddings that are well separated from anomalies. However, conventional contrastive learning strategies often struggle to achieve this balance, either promoting…

Machine Learning · Computer Science 2026-02-02 Willian T. Lunardi , Abdulrahman Banabila , Dania Herzalla , Martin Andreoni

In contrast to human vision, common recognition algorithms often fail on partially occluded images. We propose characterizing, empirically, the algorithmic limits by finding a minimal recognizable patch (MRP) that is by itself sufficient to…

Computer Vision and Pattern Recognition · Computer Science 2020-10-13 Mark Fonaryov , Michael Lindenbaum

Pursuing realistic results according to human visual perception is the central concern in the image transformation tasks. Perceptual learning approaches like perceptual loss are empirically powerful for such tasks but they usually rely on…

Computer Vision and Pattern Recognition · Computer Science 2020-06-25 Kangfu Mei , Yao Lu , Qiaosi Yi , Haoyu Wu , Juncheng Li , Rui Huang

Video summarization aims to select the most informative subset of frames in a video to facilitate efficient video browsing. Unsupervised methods usually rely on heuristic training objectives such as diversity and representativeness.…

Computer Vision and Pattern Recognition · Computer Science 2022-11-21 Zongshang Pang , Yuta Nakashima , Mayu Otani , Hajime Nagahara

Explainability methods for NLP systems encounter a version of the fundamental problem of causal inference: for a given ground-truth input text, we never truly observe the counterfactual texts necessary for isolating the causal effects of…

Computation and Language · Computer Science 2022-09-29 Zhengxuan Wu , Karel D'Oosterlinck , Atticus Geiger , Amir Zur , Christopher Potts

With the ongoing development of deep learning, an increasing number of AI models have surpassed the performance levels of human clinical practitioners. However, the prevalence of AI diagnostic products in actual clinical practice remains…

Computer Vision and Pattern Recognition · Computer Science 2024-03-11 Chenglong Wang , Yinqiao Yi , Yida Wang , Chengxiu Zhang , Yun Liu , Kensaku Mori , Mei Yuan , Guang Yang

We evaluated whether model explanations could efficiently detect bias in image classification by highlighting discriminating features, thereby removing the reliance on sensitive attributes for fairness calculations. To this end, we…

Computer Vision and Pattern Recognition · Computer Science 2020-12-11 Schrasing Tong , Lalana Kagal

We present a method for neural network interpretability by combining feature attribution with counterfactual explanations to generate attribution maps that highlight the most discriminative features between pairs of classes. We show that…

Machine Learning · Computer Science 2021-09-29 Nils Eckstein , Alexander S. Bates , Gregory S. X. E. Jefferis , Jan Funke

Multi-label image classification presents a challenging task in many domains, including computer vision and medical imaging. Recent advancements have introduced graph-based and transformer-based methods to improve performance and capture…

Computer Vision and Pattern Recognition · Computer Science 2024-04-15 Ahmad Sajedi , Samir Khaki , Yuri A. Lawryshyn , Konstantinos N. Plataniotis

Recent advances in interpretable Machine Learning (iML) and eXplainable AI (XAI) construct explanations based on the importance of features in classification tasks. However, in a high-dimensional feature space this approach may become…

Machine Learning · Statistics 2018-06-21 Jasper van der Waa , Marcel Robeer , Jurriaan van Diggelen , Matthieu Brinkhuis , Mark Neerincx

As black box explanations are increasingly being employed to establish model credibility in high-stakes settings, it is important to ensure that these explanations are accurate and reliable. However, prior work demonstrates that…

Machine Learning · Computer Science 2021-11-09 Dylan Slack , Sophie Hilgard , Sameer Singh , Himabindu Lakkaraju

CNNs are now prevalent as the primary choice for most machine vision problems due to their superior rate of classification and the availability of user-friendly libraries. These networks effortlessly identify and select features in a…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Sai Teja Erukude