English
Related papers

Related papers: iGOS++: Integrated Gradient Optimized Saliency by …

200 papers

Scene Graph Generation (SGG) suffers from a long-tailed distribution, where a few predicate classes dominate while many others are underrepresented, leading to biased models that underperform on rare relations. Unbiased-SGG methods address…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Runfeng Qu , Ole Hall , Pia K Bideau , Julie Ouerfelli-Ethier , Martin Rolfs , Klaus Obermayer , Olaf Hellwich

Given a grayscale photograph, the colorization system estimates a visually plausible colorful image. Conventional methods often use semantics to colorize grayscale images. However, in these methods, only classification semantic information…

Computer Vision and Pattern Recognition · Computer Science 2020-11-24 Yuzhi Zhao , Lai-Man Po , Kwok-Wai Cheung , Wing-Yin Yu , Yasar Abbas Ur Rehman

Saliency methods compute heat maps that highlight portions of an input that were most {\em important} for the label assigned to it by a deep net. Evaluations of saliency methods convert this heat map into a new {\em masked input} by…

Machine Learning · Statistics 2022-11-08 Arushi Gupta , Nikunj Saunshi , Dingli Yu , Kaifeng Lyu , Sanjeev Arora

Although deep CNNs have brought significant improvement to image saliency detection, most CNN based models are sensitive to distortion such as compression and noise. In this paper, we propose an end-to-end generic salient object…

Computer Vision and Pattern Recognition · Computer Science 2020-01-23 Delu Zeng , Yixuan He , Li Liu , Zhihong Chen , Jiabin Huang , Jie Chen , John Paisley

Saliency Object Detection (SOD) has several applications in image analysis. The methods have evolved from image-intrinsic to object-inspired (deep-learning-based) models. When a model fail, however, there is no alternative to enhance its…

Computer Vision and Pattern Recognition · Computer Science 2022-03-07 Leonardo de Melo Joao , Alexandre Xavier Falcao

Saliency maps have become one of the most widely used interpretability techniques for convolutional neural networks (CNN) due to their simplicity and the quality of the insights they provide. However, there are still some doubts about…

Artificial Intelligence · Computer Science 2023-09-25 Oscar Llorente , Jaime Boal , Eugenio F. Sánchez-Úbeda

Self-supervised learning holds promise in leveraging large numbers of unlabeled data. However, its success heavily relies on the highly-curated dataset, e.g., ImageNet, which still needs human cleaning. Directly learning representations…

Computer Vision and Pattern Recognition · Computer Science 2023-02-24 Meilin Chen , Yizhou Wang , Shixiang Tang , Feng Zhu , Haiyang Yang , Lei Bai , Rui Zhao , Donglian Qi , Wanli Ouyang

The explanation for deep neural networks has drawn extensive attention in the deep learning community over the past few years. In this work, we study the visual saliency, a.k.a. visual explanation, to interpret convolutional neural…

Computer Vision and Pattern Recognition · Computer Science 2022-04-06 Lin Cheng , Pengfei Fang , Yanjie Liang , Liao Zhang , Chunhua Shen , Hanzi Wang

We introduce SaltiNet, a deep neural network for scanpath prediction trained on 360-degree images. The model is based on a temporal-aware novel representation of saliency information named the saliency volume. The first part of the network…

Computer Vision and Pattern Recognition · Computer Science 2017-08-18 Marc Assens , Kevin McGuinness , Xavier Giro-i-Nieto , Noel E. O'Connor

The need for Explainable AI is increasing with the development of deep learning. The saliency maps derived from convolutional neural networks generally fail in localizing with accuracy the image features justifying the network prediction.…

Computer Vision and Pattern Recognition · Computer Science 2022-05-09 Alexandre Englebert , Olivier Cornu , Christophe De Vleeschouwer

Deep learning models, especially convolutional neural networks, have achieved impressive results in medical image classification. However, these models often produce overconfident predictions, which can undermine their reliability in…

Computer Vision and Pattern Recognition · Computer Science 2025-10-24 Kushan Choudhury , Shubhrodeep Roy , Ankur Chanda , Shubhajit Biswas , Somenath Kuiry

Transparency and explainability in image classification are essential for establishing trust in machine learning models and detecting biases and errors. State-of-the-art explainability methods generate saliency maps to show where a specific…

Machine Learning · Computer Science 2024-07-30 Matteo Bianchi , Antonio De Santis , Andrea Tocchetti , Marco Brambilla

Saliency methods provide post-hoc model interpretation by attributing input features to the model outputs. Current methods mainly achieve this using a single input sample, thereby failing to answer input-independent inquiries about the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-03 Naveed Akhtar , Mohammad A. A. K. Jalwana

Deep neural networks have shown their profound impact on achieving human level performance in visual saliency prediction. However, it is still unclear how they learn the task and what it means in terms of understanding human visual system.…

Computer Vision and Pattern Recognition · Computer Science 2021-09-09 Sai Phani Kumar Malladi , Jayanta Mukhopadhyay , Chaker Larabi , Santanu Chaudhury

Convolutional neural networks (CNNs) offer great machine learning performance over a range of applications, but their operation is hard to interpret, even for experts. Various explanation algorithms have been proposed to address this issue,…

Human-Computer Interaction · Computer Science 2020-02-04 Ahmed Alqaraawi , Martin Schuessler , Philipp Weiß , Enrico Costanza , Nadia Berthouze

As machine learning algorithms are increasingly applied to high impact yet high risk tasks, such as medical diagnosis or autonomous driving, it is critical that researchers can explain how such algorithms arrived at their predictions. In…

Computer Vision and Pattern Recognition · Computer Science 2021-12-06 Ruth Fong , Andrea Vedaldi

Co-saliency detection aims at extracting the common salient regions from an image group containing two or more relevant images. It is a newly emerging topic in computer vision community. Different from the most existing co-saliency methods…

Computer Vision and Pattern Recognition · Computer Science 2017-11-22 Runmin Cong , Jianjun Lei , Huazhu Fu , Qingming Huang , Xiaochun Cao , Chunping Hou

Deep learning dominates image classification tasks, yet understanding how models arrive at predictions remains a challenge. Much research focuses on local explanations of individual predictions, such as saliency maps, which visualise the…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 James Hinns , David Martens

Input gradients have a pivotal role in a variety of applications, including adversarial attack algorithms for evaluating model robustness, explainable AI techniques for generating Saliency Maps, and counterfactual explanations.However,…

Artificial Intelligence · Computer Science 2024-02-05 Mathieu Serrurier , Franck Mamalet , Thomas Fel , Louis Béthune , Thibaut Boissin

Saliency prediction can benefit from training that involves scene understanding that may be tangential to the central task; this may include understanding places, spatial layout, objects or involve different datasets and their bias. One can…

Computer Vision and Pattern Recognition · Computer Science 2019-03-12 Sen Jia , Neil D. B. Bruce