English
Related papers

Related papers: Semantically Interpretable Activation Maps: what-w…

200 papers

Novel methods of analysis are needed to help advance our understanding of the intricate interplay between landscape changes, population dynamics, and sustainable development. Self organized machine learning has been highly successful in the…

Signal Processing · Electrical Eng. & Systems 2024-05-17 John M. Wandeto , Birgitta Dresp-Langley

Today's deep learning systems deliver high performance based on end-to-end training. While they deliver strong performance, these systems are hard to interpret. To address this issue, we propose Semantic Bottleneck Networks (SBN): deep…

Computer Vision and Pattern Recognition · Computer Science 2019-07-30 Max Losch , Mario Fritz , Bernt Schiele

Most of the approaches for discovering visual attributes in images demand significant supervision, which is cumbersome to obtain. In this paper, we aim to discover visual attributes in a weakly supervised setting that is commonly…

Computer Vision and Pattern Recognition · Computer Science 2015-04-21 Sukrit Shankar , Vikas K. Garg , Roberto Cipolla

CAM-based methods are widely-used post-hoc interpretability method that produce a saliency map to explain the decision of an image classification model. The saliency map highlights the important areas of the image relevant to the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Magamed Taimeskhanov , Ronan Sicre , Damien Garreau

Explainable AI (XAI) is an active research area to interpret a neural network's decision by ensuring transparency and trust in the task-specified learned models. Recently, perturbation-based model analysis has shown better interpretation,…

Computer Vision and Pattern Recognition · Computer Science 2021-02-17 Mahesh Sudhakar , Sam Sattarzadeh , Konstantinos N. Plataniotis , Jongseong Jang , Yeonjeong Jeong , Hyunwoo Kim

Methods based on class activation maps (CAM) provide a simple mechanism to interpret predictions of convolutional neural networks by using linear combinations of feature maps as saliency maps. By contrast, masking-based methods optimize a…

Computer Vision and Pattern Recognition · Computer Science 2024-04-08 Hanwei Zhang , Felipe Torres , Ronan Sicre , Yannis Avrithis , Stephane Ayache

Convolutional neural networks (CNNs) define the current state-of-the-art for image recognition. With their emerging popularity, especially for critical applications like medical image analysis or self-driving cars, confirmability is…

Computer Vision and Pattern Recognition · Computer Science 2018-01-08 Keyang Zhou , Bernhard Kainz

Many convolutional neural networks (CNNs) rely on progressive downsampling of their feature maps to increase the network's receptive field and decrease computational cost. However, this comes at the price of losing granularity in the…

Computer Vision and Pattern Recognition · Computer Science 2023-05-17 Robin Hesse , Simone Schaub-Meyer , Stefan Roth

Convolutional Neural Networks (CNN) have become de fact state-of-the-art for the main computer vision tasks. However, due to the complex underlying structure their decisions are hard to understand which limits their use in some context of…

Computer Vision and Pattern Recognition · Computer Science 2021-07-02 Nina Schaaf , Omar de Mitri , Hang Beom Kim , Alexander Windberger , Marco F. Huber

In the past few years, convolutional neural nets (CNN) have shown incredible promise for learning visual representations. In this paper, we use CNNs for the task of predicting surface normals from a single image. But what is the right…

Computer Vision and Pattern Recognition · Computer Science 2014-11-19 Xiaolong Wang , David F. Fouhey , Abhinav Gupta

Change detection is the study of detecting changes between two different images of a scene taken at different times. By the detected change areas, however, a human cannot understand how different the two images. Therefore, a semantic…

Computer Vision and Pattern Recognition · Computer Science 2017-03-17 Teppei Suzuki , Soma Shirakabe , Yudai Miyashita , Akio Nakamura , Yutaka Satoh , Hirokatsu Kataoka

The concept of causal abstraction got recently popularised to demystify the opaque decision-making processes of machine learning models; in short, a neural network can be abstracted as a higher-level algorithm if there exists a function…

Machine Learning · Computer Science 2025-11-13 Denis Sutter , Julian Minder , Thomas Hofmann , Tiago Pimentel

With the increasing demands for accountability, interpretability is becoming an essential capability for real-world AI applications. However, most methods utilize post-hoc approaches rather than training the interpretable model. In this…

Computer Vision and Pattern Recognition · Computer Science 2022-02-04 Yoshihide Sawada , Keigo Nakamura

A variety of methods exist to explain image classification models. However, whether they provide any benefit to users over simply comparing various inputs and the model's respective predictions remains unclear. We conducted a user study…

Machine Learning · Computer Science 2022-04-26 Leon Sixt , Martin Schuessler , Oana-Iuliana Popescu , Philipp Weiß , Tim Landgraf

Human-centric explainability of AI-based Decision Support Systems (DSS) using visual input modalities is directly related to reliability and practicality of such algorithms. An otherwise accurate and robust DSS might not enjoy trust of…

Machine Learning · Computer Science 2022-01-06 Adriano Lucieri , Muhammad Naseer Bajwa , Andreas Dengel , Sheraz Ahmed

Graph neural networks have demonstrated remarkable success in predicting molecular properties by leveraging the rich structural information encoded in molecular graphs. However, their black-box nature reduces interpretability, which limits…

Machine Learning · Computer Science 2025-08-22 Sebastian Musiał , Bartosz Zieliński , Tomasz Danel

Intelligent embodied agents (e.g. robots) need to perform complex semantic tasks in unfamiliar environments. Among many skills that the agents need to possess, building and maintaining a semantic map of the environment is most crucial in…

Robotics · Computer Science 2025-08-13 Sonia Raychaudhuri , Angel X. Chang

The intermediate map responses of a Convolutional Neural Network (CNN) contain information about an image that can be used to extract contextual knowledge about it. In this paper, we present a core sampling framework that is able to use…

Computer Vision and Pattern Recognition · Computer Science 2016-12-07 Manohar Karki , Robert DiBiano , Saikat Basu , Supratik Mukhopadhyay

In recent years, algorithm research in the area of recommender systems has shifted from matrix factorization techniques and their latent factor models to neural approaches. However, given the proven power of latent factor models, some newer…

Information Retrieval · Computer Science 2020-08-07 Maurizio Ferrari Dacrema , Federico Parroni , Paolo Cremonesi , Dietmar Jannach

Line intensity maps (LIMs) are in principle sensitive to a large amount of information about faint, distant galaxies which are invisible to conventional surveys. However, actually extracting that information from a confused,…

Cosmology and Nongalactic Astrophysics · Physics 2019-05-28 Daniel N. Pfeffer , Patrick C. Breysse , George Stein