English
Related papers

Related papers: Consistent Explanations by Contrastive Learning

200 papers

Since annotating medical images for segmentation tasks commonly incurs expensive costs, it is highly desirable to design an annotation-efficient method to alleviate the annotation burden. Recently, contrastive learning has exhibited a great…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Yixuan Wu , Jintai Chen , Jiahuan Yan , Yiheng Zhu , Danny Z. Chen , Jian Wu

Contrastive learning has recently established itself as a powerful self-supervised learning framework for extracting rich and versatile data representations. Broadly speaking, contrastive learning relies on a data augmentation scheme to…

Machine Learning · Computer Science 2023-05-02 Ilgee Hong , Huy Tran , Claire Donnat

Graph matching has important applications in pattern recognition and beyond. Current approaches predominantly adopt supervised learning, demanding extensive labeled data which can be limited or costly. Meanwhile, self-supervised learning…

Machine Learning · Computer Science 2024-06-26 Jianyuan Bo , Yuan Fang

Interpreting the decisions of deep learning models has been actively studied since the explosion of deep neural networks. One of the most convincing interpretation approaches is salience-based visual interpretation, such as Grad-CAM, where…

Computer Vision and Pattern Recognition · Computer Science 2023-10-17 Yiming Lei , Zilong Li , Yangyang Li , Junping Zhang , Hongming Shan

Visual explanations are logical arguments based on visual features that justify the predictions made by neural networks. Current modes of visual explanations answer questions of the form $`Why \text{ } P?'$. These $Why$ questions operate…

Computer Vision and Pattern Recognition · Computer Science 2020-08-04 Mohit Prabhushankar , Gukyeong Kwon , Dogancan Temel , Ghassan AlRegib

Deep learning models have great potential in medical imaging, including orthodontics and skeletal maturity assessment. However, applying a model to data different from its training set can lead to unreliable predictions that may impact…

Image and Video Processing · Electrical Eng. & Systems 2025-05-15 Omid Halimi Milani , Amanda Nikho , Lauren Mills , Marouane Tliba , Ahmet Enis Cetin , Mohammed H. Elnagar

In real industrial processes, fault diagnosis methods are required to learn from limited fault samples since the procedures are mainly under normal conditions and the faults rarely occur. Although attention mechanisms have become popular in…

Machine Learning · Computer Science 2023-09-26 Mengxuan Li , Peng Peng , Jingxin Zhang , Hongwei Wang , Weiming Shen

Learning concepts that are consistent with human perception is important for Deep Neural Networks to win end-user trust. Post-hoc interpretation methods lack transparency in the feature representations learned by the models. This work…

Computer Vision and Pattern Recognition · Computer Science 2021-05-25 Sandareka Wickramanayake , Wynne Hsu , Mong Li Lee

Recently, contrastive learning (CL) has emerged as a successful method for unsupervised graph representation learning. Most graph CL methods first perform stochastic augmentation on the input graph to obtain two graph views and maximize the…

Machine Learning · Computer Science 2021-03-01 Yanqiao Zhu , Yichen Xu , Feng Yu , Qiang Liu , Shu Wu , Liang Wang

Contrastive learning is an approach to representation learning that utilizes naturally occurring similar and dissimilar pairs of data points to find useful embeddings of data. In the context of document classification under topic modeling…

Machine Learning · Computer Science 2020-03-05 Christopher Tosh , Akshay Krishnamurthy , Daniel Hsu

Intelligent medical diagnosis has shown remarkable progress based on the large-scale datasets with precise annotations. However, fewer labeled images are available due to significantly expensive cost for annotating data by experts. To fully…

Image and Video Processing · Electrical Eng. & Systems 2023-03-06 Wentao Lei , Lei Liu , Li Liu

Despite exciting progress in causal language models, the expressiveness of the representations is largely limited due to poor discrimination ability. To remedy this issue, we present ContraCLM, a novel contrastive learning framework at both…

To verify and validate networks, it is essential to gain insight into their decisions, limitations as well as possible shortcomings of training data. In this work, we propose a post-hoc, optimization based visual explanation method, which…

Computer Vision and Pattern Recognition · Computer Science 2019-08-08 Jörg Wagner , Jan Mathias Köhler , Tobias Gindele , Leon Hetzel , Jakob Thaddäus Wiedemer , Sven Behnke

Predicting socioeconomic indicators from satellite imagery with deep learning has become an increasingly popular research direction. Post-hoc concept-based explanations can be an important step towards broader adoption of these models in…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Ivica Obadic , Alex Levering , Lars Pennig , Dario Oliveira , Diego Marcos , Xiaoxiang Zhu

Post-hoc explainability methods such as Grad-CAM are popular because they do not influence the performance of a trained model. However, they mainly reveal "where" a model looks at for a given input, fail to explain "what" the model looks…

Computer Vision and Pattern Recognition · Computer Science 2024-06-06 Andong Tan , Fengtao Zhou , Hao Chen

Contrastive learning (CL) continuously achieves significant breakthroughs across multiple domains. However, the most common InfoNCE-based methods suffer from some dilemmas, such as \textit{uniformity-tolerance dilemma} (UTD) and…

Machine Learning · Computer Science 2023-06-13 Zizheng Huang , Haoxing Chen , Ziqi Wen , Chao Zhang , Huaxiong Li , Bo Wang , Chunlin Chen

Contrastive explanations clarify why an event occurred in contrast to another. They are more inherently intuitive to humans to both produce and comprehend. We propose a methodology to produce contrastive explanations for classification…

Computation and Language · Computer Science 2021-09-15 Alon Jacovi , Swabha Swayamdipta , Shauli Ravfogel , Yanai Elazar , Yejin Choi , Yoav Goldberg

Contrastive representation learning has been recently proved to be very efficient for self-supervised training. These methods have been successfully used to train encoders which perform comparably to supervised training on downstream…

Machine Learning · Computer Science 2020-12-03 Ibrahim Merad , Yiyang Yu , Emmanuel Bacry , Stéphane Gaïffas

Consistency training, which exploits both supervised and unsupervised learning with different augmentations on image, is an effective method of utilizing unlabeled data in semi-supervised learning (SSL) manner. Here, we present another…

Computer Vision and Pattern Recognition · Computer Science 2021-09-01 Juyong Lee , Seunghyuk Cho

Contrastive learning is a popular form of self-supervised learning that encourages augmentations (views) of the same input to have more similar representations compared to augmentations of different inputs. Recent attempts to theoretically…

Machine Learning · Computer Science 2022-03-01 Nikunj Saunshi , Jordan Ash , Surbhi Goel , Dipendra Misra , Cyril Zhang , Sanjeev Arora , Sham Kakade , Akshay Krishnamurthy