English
Related papers

Related papers: Interpreting Neural Ranking Models using Grad-CAM

200 papers

Despite their black-box nature, deep learning models are extensively used in image-based drug discovery to extract feature vectors from single cells in microscopy images. To better understand how these networks perform representation…

Image and Video Processing · Electrical Eng. & Systems 2024-03-27 Vivek Gopalakrishnan , Jingzhe Ma , Zhiyong Xie

Mechanistic interpretation has greatly contributed to a more detailed understanding of generative language models, enabling significant progress in identifying structures that implement key behaviors through interactions between internal…

Information Retrieval · Computer Science 2025-11-25 Meng Lu , Catherine Chen , Carsten Eickhoff

Recently, neural models for information retrieval are becoming increasingly popular. They provide effective approaches for product search due to their competitive advantages in semantic matching. However, it is challenging to use…

Information Retrieval · Computer Science 2019-01-25 Yuan Zhang , Dong Wang , Yan Zhang

We present a new technique that explains the output of a CNN-based model using a combination of GradCAM and LRP methods. Both of these methods produce visual explanations by highlighting input regions that are important for predictions. In…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Vaibhav Dhore , Achintya Bhat , Viraj Nerlekar , Kashyap Chavhan , Aniket Umare

We investigate the problem of explainability for visual object detectors. Specifically, we demonstrate on the example of the YOLO object detector how to integrate Grad-CAM into the model architecture and analyze the results. We show how to…

Computer Vision and Pattern Recognition · Computer Science 2022-11-23 Armin Kirchknopf , Djordje Slijepcevic , Ilkay Wunderlich , Michael Breiter , Johannes Traxler , Matthias Zeppelzauer

We present Gradient Activation Maps (GAM) - a machinery for explaining predictions made by visual similarity and classification models. By gleaning localized gradient and activation information from multiple network layers, GAM offers…

Computer Vision and Pattern Recognition · Computer Science 2021-09-03 Oren Barkan , Omri Armstrong , Amir Hertz , Avi Caciularu , Ori Katz , Itzik Malkiel , Noam Koenigstein

An important goal of medical imaging is to be able to precisely detect patterns of disease specific to individual scans; however, this is challenged in brain imaging by the degree of heterogeneity of shape and appearance. Traditional…

Learning to Rank has traditionally considered settings where given the relevance information of objects, the desired order in which to rank the objects is clear. However, with today's large variety of users and layouts this is not always…

Information Retrieval · Computer Science 2018-08-29 Harrie Oosterhuis , Maarten de Rijke

Recent studies have shown that large language models (LLMs) can assess relevance and support information retrieval (IR) tasks such as document ranking and relevance judgment generation. However, the internal mechanisms by which…

Information Retrieval · Computer Science 2025-04-11 Qi Liu , Jiaxin Mao , Ji-Rong Wen

In this paper, we study the problem of learning probabilistic logical rules for inductive and interpretable link prediction. Despite the importance of inductive link prediction, most previous works focused on transductive link prediction…

Machine Learning · Computer Science 2019-11-04 Ali Sadeghian , Mohammadreza Armandpour , Patrick Ding , Daisy Zhe Wang

Explaining deep learning models in a way that humans can easily understand is essential for responsible artificial intelligence applications. Attribution methods constitute an important area of explainable deep learning. The attribution…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Michal Byra , Henrik Skibbe

Convolutional neural networks (CNNs) achieve prevailing results in segmentation tasks nowadays and represent the state-of-the-art for image-based analysis. However, the understanding of the accurate decision-making process of a CNN is…

Image and Video Processing · Electrical Eng. & Systems 2024-10-01 Tillmann Rheude , Andreas Wirtz , Arjan Kuijper , Stefan Wesarg

The evaluation of explainable artificial intelligence is challenging, because automated and human-centred metrics of explanation quality may diverge. To clarify their relationship, we investigated whether human and artificial image…

Human-Computer Interaction · Computer Science 2024-08-20 Romy Müller , Marius Thoß , Julian Ullrich , Steffen Seitz , Carsten Knoll

Deep neural networks (DNNs) have achieved remarkable success across domains but remain difficult to interpret, limiting their trustworthiness in high-stakes applications. This paper focuses on deep vision models, for which a dominant line…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Qiming Zhao , Xingjian Li , Xiaoyu Cao , Xiaolong Wu , Min Xu

Recently, increasing attention has been drawn to the internal mechanisms of convolutional neural networks, and the reason why the network makes specific decisions. In this paper, we develop a novel post-hoc visual explanation method called…

Computer Vision and Pattern Recognition · Computer Science 2020-04-14 Haofan Wang , Zifan Wang , Mengnan Du , Fan Yang , Zijian Zhang , Sirui Ding , Piotr Mardziel , Xia Hu

Transformer-based language models significantly advanced the state-of-the-art in many linguistic tasks. As this revolution continues, the ability to explain model predictions has become a major area of interest for the NLP community. In…

Machine Learning · Computer Science 2022-04-26 Oren Barkan , Edan Hauon , Avi Caciularu , Ori Katz , Itzik Malkiel , Omri Armstrong , Noam Koenigstein

Grade prediction for future courses not yet taken by students is important as it can help them and their advisers during the process of course selection as well as for designing personalized degree plans and modifying them based on their…

Machine Learning · Computer Science 2020-03-12 Sara Morsy , George Karypis

Extracting valuable facts or informative summaries from multi-dimensional tables, i.e. insight mining, is an important task in data analysis and business intelligence. However, ranking the importance of insights remains a challenging and…

Computation and Language · Computer Science 2018-11-15 Qi Zeng , Liangchen Luo , Wenhao Huang , Yang Tang

Deep learning shows promise for medical image analysis but lacks interpretability, hindering adoption in healthcare. Attribution techniques that explain model reasoning may increase trust in deep learning among clinical stakeholders. This…

Machine Learning · Computer Science 2023-08-08 Yusuf Brima , Marcellin Atemkeng

Existing neural relevance models do not give enough consideration for query and item context information which diversifies the search results to adapt for personal preference. To bridge this gap, this paper presents a neural learning…

Information Retrieval · Computer Science 2023-09-12 Deguang Kong , Daniel Zhou , Zhiheng Huang , Steph Sigalas