English
Related papers

Related papers: Towards A Comprehensive Visual Saliency Explanatio…

200 papers

In this paper we propose a new framework for evaluating the performance of explanation methods on the decisions of a deepfake detector. This framework assesses the ability of an explanation method to spot the regions of a fake image with…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Konstantinos Tsigos , Evlampios Apostolidis , Spyridon Baxevanakis , Symeon Papadopoulos , Vasileios Mezaris

Visual saliency is a fundamental problem in both cognitive and computational sciences, including computer vision. In this paper, we discover that a high-quality visual saliency model can be learned from multiscale features extracted using…

Computer Vision and Pattern Recognition · Computer Science 2016-11-03 Guanbin Li , Yizhou Yu

One of the significant challenges of deep neural networks is that the complex nature of the network prevents human comprehension of the outcome of the network. Consequently, the applicability of complex machine learning models is limited in…

Computer Vision and Pattern Recognition · Computer Science 2020-06-22 Shailja Thakur , Sebastian Fischmeister

The increasing complexity of machine learning models in computer vision, particularly in face verification, requires the development of explainable artificial intelligence (XAI) to enhance interpretability and transparency. This study…

Computer Vision and Pattern Recognition · Computer Science 2025-01-13 Miriam Doh , Caroline Mazini Rodrigues , N. Boutry , L. Najman , Matei Mancas , Bernard Gosselin

Saliency maps are widely used for visual explanations in deep learning, but a fundamental lack of consensus persists regarding their intended purpose and alignment with diverse user queries. This ambiguity hinders the effective evaluation…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Yehonatan Elisha , Seffi Cohen , Oren Barkan , Noam Koenigstein

Deep convolutional neural networks have demonstrated high performances for fixation prediction in recent years. How they achieve this, however, is less explored and they remain to be black box models. Here, we attempt to shed light on the…

Computer Vision and Pattern Recognition · Computer Science 2018-03-23 Sen He , Ali Borji , Yang Mi , Nicolas Pugeault

Scientific fields that are interested in faces have developed their own sets of concepts and procedures for understanding how a target model system (be it a person or algorithm) perceives a face under varying conditions. In computer vision,…

Computer Vision and Pattern Recognition · Computer Science 2018-07-23 Brandon RichardWebster , So Yon Kwon , Christopher Clarizio , Samuel E. Anthony , Walter J. Scheirer

Explaining deep convolutional neural networks has been recently drawing increasing attention since it helps to understand the networks' internal operations and why they make certain decisions. Saliency maps, which emphasize salient regions…

Computer Vision and Pattern Recognition · Computer Science 2022-08-10 Quan Zheng , Ziwei Wang , Jie Zhou , Jiwen Lu

In this paper, we show that existing recognition and localization deep architectures, that have not been exposed to eye tracking data or any saliency datasets, are capable of predicting the human visual saliency. We term this as implicit…

Computer Vision and Pattern Recognition · Computer Science 2020-08-06 Yutong Sun , Mohit Prabhushankar , Ghassan AlRegib

Saliency map generation techniques are at the forefront of explainable AI literature for a broad range of machine learning applications. Our goal is to question the limits of these approaches on more complex tasks. In this paper we apply…

Machine Learning · Computer Science 2019-07-15 David Tuckey , Krysia Broda , Alessandra Russo

Saliency maps are a popular approach for explaining classifications of (convolutional) neural networks. However, it remains an open question as to how best to evaluate salience maps, with three families of evaluation methods commonly being…

Human-Computer Interaction · Computer Science 2025-04-25 Felix Kares , Timo Speith , Hanwei Zhang , Markus Langer

This paper presents an approach for top-down saliency detection guided by visual classification tasks. We first learn how to compute visual saliency when a specific visual task has to be accomplished, as opposed to most state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Francesca Murabito , Concetto Spampinato , Simone Palazzo , Konstantin Pogorelov , Michael Riegler

With Artificial Intelligence (AI) influencing the decision-making process of sensitive applications such as Face Verification, it is fundamental to ensure the transparency, fairness, and accountability of decisions. Although Explainable…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Miriam Doh , Caroline Mazini Rodrigues , Nicolas Boutry , Laurent Najman , Matei Mancas , Hugues Bersini

How can we improve the facial soft-biometric classification with help of the human visual system? This paper explores the use of saliency which is equivalent to the human visual system to classify Age, Gender and Facial Expression…

Computer Vision and Pattern Recognition · Computer Science 2018-11-22 Ayesha Gurnani , Kenil Shah , Vandit Gajjar , Viraj Mavani , Yash Khandhediya

Face recognition is a long standing challenge in the field of Artificial Intelligence (AI). The goal is to create systems that accurately detect, recognize, verify, and understand human faces. There are significant technical hurdles in…

Computer Vision and Pattern Recognition · Computer Science 2019-04-10 Michele Merler , Nalini Ratha , Rogerio S. Feris , John R. Smith

In recent years, considerable work has been devoted to explaining predictive, deep learning-based models, and in turn how to evaluate explanations. An important class of evaluation methods are ones that are human-centered, which typically…

Computer Vision and Pattern Recognition · Computer Science 2024-06-13 Yayan Zhao , Mingwei Li , Matthew Berger

The way to accurately and effectively identify people has always been an interesting topic in research and industry. With the rapid development of artificial intelligence in recent years, facial recognition gains lots of attention due to…

Computer Vision and Pattern Recognition · Computer Science 2018-11-20 Yang Li , Sangwhan Cha

Traditionally, researchers in automatic face recognition and biometric technologies have focused on developing accurate algorithms. With this technology being integrated into operational systems, engineers and scientists are being asked, do…

Computer Vision and Pattern Recognition · Computer Science 2020-02-05 P. Jonathon Phillips , Mark Przybocki

In mission-critical domains such as law enforcement and medical diagnosis, the ability to explain and interpret the outputs of deep learning models is crucial for ensuring user trust and supporting informed decision-making. Despite…

Computer Vision and Pattern Recognition · Computer Science 2024-11-07 Bharat Chandra Yalavarthi , Nalini Ratha

With their increase in performance, neural network architectures also become more complex, necessitating explainability. Therefore, many new and improved methods are currently emerging, which often generate so-called saliency maps in order…

Machine Learning · Computer Science 2024-12-24 Leonid Schwenke , Martin Atzmueller