English
Related papers

Related papers: Explaining Local, Global, And Higher-Order Interac…

200 papers

We consider a light-weight method which allows to improve the explainability of localized classification networks. The method considers (Grad)CAM maps during the training process by modification of the training loss and does not require…

Computer Vision and Pattern Recognition · Computer Science 2020-09-29 Alfred Schöttl

Planet-scale photo geolocalization involves the intricate task of estimating the geographic location depicted in an image purely based on its visual features. While deep learning models, particularly convolutional neural networks (CNNs),…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 David Faget , José Luis Lisani , Miguel Colom

A deluge of new data on social, technological and biological networked systems suggests that a large number of interactions among system units are not limited to pairs, but rather involve a higher number of nodes. To properly encode such…

Physics and Society · Physics 2023-11-08 Quintino Francesco Lotito , Federico Musciotto , Alberto Montresor , Federico Battiston

The human brain is a complex system defined by multi-way, higher-order interactions invisible to traditional pairwise network models. Although a diverse array of analytical methods has been developed to address this shortcoming, the field…

Quantitative Methods · Quantitative Biology 2025-11-11 Mohamma Reza Salehi , Ali BashirGonbadi , Hamid Soltanian-Zadeh

Gaining insight into how deep convolutional neural network models perform image classification and how to explain their outputs have been a concern to computer vision researchers and decision makers. These deep models are often referred to…

Computer Vision and Pattern Recognition · Computer Science 2019-08-06 Daniel Omeiza , Skyler Speakman , Celia Cintas , Komminist Weldermariam

Explaining deep learning models is essential for clinical integration of medical image analysis systems. A good explanation highlights if a model depends on spurious features that undermines generalization and harms a subset of patients or,…

Image and Video Processing · Electrical Eng. & Systems 2025-08-18 Yoni Schirris , Eric Marcus , Jonas Teuwen , Hugo Horlings , Efstratios Gavves

Human actions often involve complex interactions across several inter-related objects in the scene. However, existing approaches to fine-grained video understanding or visual relationship detection often rely on single object representation…

Computer Vision and Pattern Recognition · Computer Science 2018-03-22 Chih-Yao Ma , Asim Kadav , Iain Melvin , Zsolt Kira , Ghassan AlRegib , Hans Peter Graf

Reasoning about objects, relations, and physics is central to human intelligence, and a key goal of artificial intelligence. Here we introduce the interaction network, a model which can reason about how objects in complex systems interact,…

Artificial Intelligence · Computer Science 2016-12-02 Peter W. Battaglia , Razvan Pascanu , Matthew Lai , Danilo Rezende , Koray Kavukcuoglu

Dynamic graphs are rife with higher-order interactions, such as co-authorship relationships and protein-protein interactions in biological networks, that naturally arise between more than two nodes at once. In spite of the ubiquitous…

Machine Learning · Computer Science 2021-02-09 Manohar Kaul , Masaaki Imaizumi

In many practical applications, deep neural networks have been typically deployed to operate as a black box predictor. Despite the high amount of work on interpretability and high demand on the reliability of these systems, they typically…

Artificial Intelligence · Computer Science 2020-12-07 Martin Stano , Wanda Benesova , Lukas Samuel Martak

Interpretation of deep learning remains a very challenging problem. Although the Class Activation Map (CAM) is widely used to interpret deep model predictions by highlighting object location, it fails to provide insight into the salient…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 Yuguang Yang , Runtang Guo , Sheng Wu , Yimi Wang , Juan Zhang , Xuan Gong , Baochang Zhang

Deep neural networks (DNNs) have achieved remarkable success across domains but remain difficult to interpret, limiting their trustworthiness in high-stakes applications. This paper focuses on deep vision models, for which a dominant line…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Qiming Zhao , Xingjian Li , Xiaoyu Cao , Xiaolong Wu , Min Xu

Understanding how cities visually differ from each others is interesting for planners, residents, and historians. We investigate the interpretation of deep features learned by convolutional neural networks (CNNs) for city recognition. Given…

Computer Vision and Pattern Recognition · Computer Science 2019-05-07 Xiangwei Shi , Seyran Khademi , Jan van Gemert

Neural IR architectures, particularly cross-encoders, are highly effective models whose internal mechanisms are mostly unknown. Most works trying to explain their behavior focused on high-level processes (e.g., what in the input influences…

Information Retrieval · Computer Science 2025-07-22 Mathias Vast , Basile Van Cooten , Laure Soulier , Benjamin Piwowarski

Recently, increasing attention has been drawn to the internal mechanisms of convolutional neural networks, and the reason why the network makes specific decisions. In this paper, we develop a novel post-hoc visual explanation method called…

Computer Vision and Pattern Recognition · Computer Science 2020-04-14 Haofan Wang , Zifan Wang , Mengnan Du , Fan Yang , Zijian Zhang , Sirui Ding , Piotr Mardziel , Xia Hu

Explainable Deep Learning has gained significant attention in the field of artificial intelligence (AI), particularly in domains such as medical imaging, where accurate and interpretable machine learning models are crucial for effective…

Image and Video Processing · Electrical Eng. & Systems 2024-09-11 Subhashis Suara , Aayush Jha , Pratik Sinha , Arif Ahmed Sekh

Class activation map (CAM) has been widely studied for visual explanation of the internal working mechanism of convolutional neural networks. The key of existing CAM-based methods is to compute effective weights to combine activation maps…

Computer Vision and Pattern Recognition · Computer Science 2022-06-20 Hui Li , Zihao Li , Rui Ma , Tieru Wu

Deep learning models as an emerging topic have shown great progress in various fields. Especially, visualization tools such as class activation mapping methods provided visual explanation on the reasoning of convolutional neural networks…

Computer Vision and Pattern Recognition · Computer Science 2023-08-24 Ali Caglayan , Nevrez Imamoglu , Oguzhan Guclu , Ali Osman Serhatoglu , Weimin Wang , Ahmet Burak Can , Ryosuke Nakamura

Conventionally, AI models are thought to trade off explainability for lower accuracy. We develop a training strategy that not only leads to a more explainable AI system for object classification, but as a consequence, suffers no perceptible…

Computer Vision and Pattern Recognition · Computer Science 2020-03-17 Andrea Zunino , Sarah Adel Bargal , Riccardo Volpi , Mehrnoosh Sameki , Jianming Zhang , Stan Sclaroff , Vittorio Murino , Kate Saenko

We study the evolution of networks through `triplets' - three-node graphlets. We develop a method to compute a transition matrix to describe the evolution of triplets in temporal networks. To identify the importance of higher-order…

Physics and Society · Physics 2021-08-02 Qing Yao , Bingsheng Chen , Kim Christensen , Tim S. Evans