English
Related papers

Related papers: Rethinking Saliency Maps: A Cognitive Human Aligne…

200 papers

The performance of convolutional neural networks has continued to improve over the last decade. At the same time, as model complexity grows, it becomes increasingly more difficult to explain model decisions. Such explanations may be of…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Colton Crum , Patrick Tinsley , Aidan Boyd , Jacob Piland , Christopher Sweet , Timothy Kelley , Kevin Bowyer , Adam Czajka

Despite the significant progress in face recognition in the past years, they are often treated as "black boxes" and have been criticized for lacking explainability. It becomes increasingly important to understand the characteristics and…

Computer Vision and Pattern Recognition · Computer Science 2023-04-14 Yuhang Lu , Touradj Ebrahimi

Saliency methods are a popular class of feature attribution explanation methods that aim to capture a model's predictive reasoning by identifying "important" pixels in an input image. However, the development and adoption of these methods…

Machine Learning · Computer Science 2022-06-20 Joon Sik Kim , Gregory Plumb , Ameet Talwalkar

In the past years, deep convolutional neural networks have been pushing the frontier of face recognition (FR) techniques in both verification and identification scenarios. Despite the high accuracy, they are often criticized for lacking…

Computer Vision and Pattern Recognition · Computer Science 2023-10-25 Yuhang Lu , Zewei Xu , Touradj Ebrahimi

With their increase in performance, neural network architectures also become more complex, necessitating explainability. Therefore, many new and improved methods are currently emerging, which often generate so-called saliency maps in order…

Machine Learning · Computer Science 2024-12-24 Leonid Schwenke , Martin Atzmueller

Augmenting pre-trained language models with knowledge graphs (KGs) has achieved success on various commonsense reasoning tasks. However, for a given task instance, the KG, or certain parts of the KG, may not be useful. Although KG-augmented…

Computation and Language · Computer Science 2022-12-20 Aaron Chan , Jiashu Xu , Boyuan Long , Soumya Sanyal , Tanishq Gupta , Xiang Ren

Recent work uncovered potential flaws in \eg attribution or heatmap based saliency methods. A typical flaw is a confirmations bias, where the scores are compared to human expectation. Since measuring the quality of saliency methods is hard…

Machine Learning · Computer Science 2025-01-27 Leonid Schwenke , Martin Atzmueller

Establishing stable mappings between natural language expressions and visual percepts is a foundational problem for both cognitive science and artificial intelligence. Humans routinely ground linguistic reference in noisy, ambiguous…

Artificial Intelligence · Computer Science 2026-02-24 Joseph Bingham

Saliency maps are widely used in the computer vision community for interpreting neural network classifiers. However, due to the randomness of training samples and optimization algorithms, the resulting saliency maps suffer from a…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Shizhan Gong , Jingwei Zhang , Qi Dou , Farzan Farnia

Understanding the reasons behind the predictions made by deep neural networks is critical for gaining human trust in many important applications, which is reflected in the increasing demand for explainability in AI (XAI) in recent years.…

Human-Computer Interaction · Computer Science 2021-08-31 Xiaotian Lu , Arseny Tolmachev , Tatsuya Yamamoto , Koh Takeuchi , Seiji Okajima , Tomoyoshi Takebayashi , Koji Maruhashi , Hisashi Kashima

Recent developments in machine learning have introduced models that approach human performance at the cost of increased architectural complexity. Efforts to make the rationales behind the models' predictions transparent have inspired an…

Computation and Language · Computer Science 2020-09-29 Pepa Atanasova , Jakob Grue Simonsen , Christina Lioma , Isabelle Augenstein

Over recent years, deep convolutional neural networks have significantly advanced the field of face recognition techniques for both verification and identification purposes. Despite the impressive accuracy, these neural networks are often…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Yuhang Lu , Zewei Xu , Touradj Ebrahimi

Deep learning models have performed well on many NLP tasks. However, their internal mechanisms are typically difficult for humans to understand. The development of methods to explain models has become a key issue in the reliability of deep…

Human-Computer Interaction · Computer Science 2024-05-20 Xiaotian Lu , Jiyi Li , Zhen Wan , Xiaofeng Lin , Koh Takeuchi , Hisashi Kashima

Temporal knowledge graphs (TKGs) have shown promise for reasoning tasks by incorporating a temporal dimension to represent how facts evolve over time. However, existing TKG reasoning (TKGR) models lack explainability due to their black-box…

Machine Learning · Computer Science 2023-10-10 Chenhan Yuan , Hoda Eldardiry

Convolutional neural networks (CNNs) offer great machine learning performance over a range of applications, but their operation is hard to interpret, even for experts. Various explanation algorithms have been proposed to address this issue,…

Human-Computer Interaction · Computer Science 2020-02-04 Ahmed Alqaraawi , Martin Schuessler , Philipp Weiß , Enrico Costanza , Nadia Berthouze

Effectiveness and interpretability are two essential properties for trustworthy AI systems. Most recent studies in visual reasoning are dedicated to improving the accuracy of predicted answers, and less attention is paid to explaining the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-14 Shi Chen , Qi Zhao

Visual saliency models have enjoyed a big leap in performance in recent years, thanks to advances in deep learning and large scale annotated data. Despite enormous effort and huge breakthroughs, however, models still fall short in reaching…

Computer Vision and Pattern Recognition · Computer Science 2019-05-28 Ali Borji

Graph Neural Networks (GNNs) have gained prominence for their ability to process graph-structured data across various domains. However, interpreting GNN decisions remains a significant challenge, leading to the adoption of saliency maps for…

Machine Learning · Statistics 2025-09-04 Shuichi Nishino , Tomohiro Shiraishi , Teruyuki Katsuoka , Ichiro Takeuchi

Feature attribution methods highlight the important input tokens as explanations to model predictions, which have been widely applied to deep neural networks towards trustworthy AI. However, recent works show that explanations provided by…

Computation and Language · Computer Science 2024-01-01 Dongfang Li , Baotian Hu , Qingcai Chen , Shan He

Saliency maps are a popular approach to creating post-hoc explanations of image classifier outputs. These methods produce estimates of the relevance of each pixel to the classification output score, which can be displayed as a saliency map…

Machine Learning · Computer Science 2019-12-04 Richard Tomsett , Dan Harborne , Supriyo Chakraborty , Prudhvi Gurram , Alun Preece