English
Related papers

Related papers: Interpreting ResNet-based CLIP via Neuron-Attentio…

200 papers

Model Interpretation aims at the extraction of insights from the internals of a trained model. A common approach to address this task is the characterization of relevant features internally encoded in the model that are critical for its…

Machine Learning · Computer Science 2024-10-07 Hamed Behzadi-Khormouji , José Oramas

Although neural models have achieved remarkable performance, they still encounter doubts due to the intransparency. To this end, model prediction explanation is attracting more and more attentions. However, current methods rarely…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Yong Guan , Freddy Lecue , Jiaoyan Chen , Ru Li , Jeff Z. Pan

Recent advancements in vision models have greatly improved their ability to handle complex chart understanding tasks, like chart captioning and question answering. However, it remains challenging to assess how these models process charts.…

Computer Vision and Pattern Recognition · Computer Science 2024-07-31 Soohyun Lee , Minsuk Chang , Seokhyeon Park , Jinwook Seo

Large pre-trained vision-language models, such as CLIP, have demonstrated state-of-the-art performance across a wide range of image classification tasks, without requiring retraining. Few-shot CLIP is competitive with existing specialized…

Computer Vision and Pattern Recognition · Computer Science 2024-09-06 Dominykas Seputis , Serghei Mihailov , Soham Chatterjee , Zehao Xiao

In this paper we introduce a new problem within the growing literature of interpretability for convolution neural networks (CNNs). While previous work has focused on the question of how to visually interpret CNNs, we ask what it is that we…

Computer Vision and Pattern Recognition · Computer Science 2022-01-03 Sílvia Casacuberta , Esra Suel , Seth Flaxman

Convolutional Neural Networks (CNNs) were the driving force behind many advancements in Computer Vision research in recent years. This progress has spawned many practical applications and we see an increased need to efficiently move CNNs to…

Computer Vision and Pattern Recognition · Computer Science 2020-05-13 Thomas Kurbiel , Shahrzad Khaleghian

Referring Image Segmentation (RIS) is a cross-modal task that aims to segment an instance described by a natural language expression. Recent methods leverage large-scale pretrained unimodal models as backbones along with fusion techniques…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Seoyeon Kim , Minguk Kang , Dongwon Kim , Jaesik Park , Suha Kwak

Capsule Networks, as alternatives to Convolutional Neural Networks, have been proposed to recognize objects from images. The current literature demonstrates many advantages of CapsNets over CNNs. However, how to create explanations for…

Computer Vision and Pattern Recognition · Computer Science 2021-03-09 Jindong Gu , Volker Tresp

In this paper, we propose Neural Spectrum Decomposition, a generic decomposition framework for dataset distillation. Unlike previous methods, we consider the entire dataset as a high-dimensional observation that is low-rank across all…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Shaolei Yang , Shen Cheng , Mingbo Hong , Haoqiang Fan , Xing Wei , Shuaicheng Liu

The study of the visual system of the brain has attracted the attention and interest of many neuro-scientists, that derived computational models of some types of neuron that compose it. These findings inspired researchers in image…

Computer Vision and Pattern Recognition · Computer Science 2021-03-03 Nicola Strisciuglio

The predictive power of neural networks often costs model interpretability. Several techniques have been developed for explaining model outputs in terms of input features; however, it is difficult to translate such interpretations into…

Machine Learning · Computer Science 2017-08-17 Benjamin J. Lengerich , Sandeep Konam , Eric P. Xing , Stephanie Rosenthal , Manuela Veloso

This paper presents a novel adaptively connected neural network (ACNet) to improve the traditional convolutional neural networks (CNNs) {in} two aspects. First, ACNet employs a flexible way to switch global and local inference in processing…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Guangrun Wang , Keze Wang , Liang Lin

Whereas deep neural networks were first mostly used for classification tasks, they are rapidly expanding in the realm of structured output problems, where the observed target is composed of multiple random variables that have a rich joint…

Neural and Evolutionary Computing · Computer Science 2016-11-15 Kyunghyun Cho , Aaron Courville , Yoshua Bengio

Over recent years, increasingly complex approaches based on sophisticated convolutional neural network architectures have been slowly pushing performance on well-established benchmark datasets. In this paper, we take a step back to examine…

Image and Video Processing · Electrical Eng. & Systems 2021-12-22 Tariq M Khan , Antonio Robles-Kelly , Syed S. Naqvi

Recent advances in contrastive language-image pretraining (CLIP) have demonstrated strong capabilities in zero-shot classification by aligning visual representations with target text embeddings in an image level. However, in dense…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Feng Wang , Jieru Mei , Alan Yuille

This study investigates the cognitive plausibility of a pretrained multimodal model, CLIP, in recognizing emotions evoked by abstract visual art. We employ a dataset comprising images with associated emotion labels and textual rationales of…

Computer Vision and Pattern Recognition · Computer Science 2024-05-13 Hanna-Sophia Widhoelzl , Ece Takmaz

Full attention, which generates an attention value per element of the input feature maps, has been successfully demonstrated to be beneficial in visual tasks. In this work, we propose a fully attentional network, termed {\it channel…

Computer Vision and Pattern Recognition · Computer Science 2020-10-08 Pengfei Fang , Pan Ji , Jieming Zhou , Lars Petersson , Mehrtash Harandi

Interpretability researchers have attempted to understand MLP neurons of language models based on both the contexts in which they activate and their output weight vectors. They have paid little attention to a complementary aspect: the…

Machine Learning · Computer Science 2025-05-26 Sebastian Gerstner , Hinrich Schütze

We propose a novel Convolutional Neural Network (CNN) compression algorithm based on coreset representations of filters. We exploit the redundancies extant in the space of CNN weights and neuronal activations (across samples) in order to…

Computer Vision and Pattern Recognition · Computer Science 2018-07-27 Abhimanyu Dubey , Moitreya Chatterjee , Narendra Ahuja

In recent years convolutional neural networks (CNN) have shown striking progress in various tasks. However, despite the high performance, the training and prediction process remains to be a black box, leaving it a mystery to extract what…

Computer Vision and Pattern Recognition · Computer Science 2020-10-23 Haoyue Dai