English
Related papers

Related papers: Generating detailed saliency maps using model-agno…

200 papers

Decision processes of computer vision models - especially deep neural networks - are opaque in nature, meaning that these decisions cannot be understood by humans. Thus, over the last years, many methods to provide human-understandable…

Computer Vision and Pattern Recognition · Computer Science 2024-06-10 Benjamin Fresz , Lena Lörcher , Marco Huber

In Autonomous Driving (AD) transparency and safety are paramount, as mistakes are costly. However, neural networks used in AD systems are generally considered black boxes. As a countermeasure, we have methods of explainable AI (XAI), such…

Machine Learning · Computer Science 2024-04-29 Mohamed Roshdi , Julian Petzold , Mostafa Wahby , Hussein Ebrahim , Mladen Berekovic , Heiko Hamann

The field of eXplainable artificial intelligence (XAI) has produced a plethora of methods (e.g., saliency-maps) to gain insight into artificial intelligence (AI) models, and has exploded with the rise of deep learning (DL). However,…

Human-Computer Interaction · Computer Science 2024-04-12 Marvin Pafla , Kate Larson , Mark Hancock

Robustness has become one of the most critical problems in machine learning (ML). The science of interpreting ML models to understand their behavior and improve their robustness is referred to as explainable artificial intelligence (XAI).…

Computer Vision and Pattern Recognition · Computer Science 2026-02-26 Patrick Koller , Amil V. Dravid , Guido M. Schuster , Aggelos K. Katsaggelos

In this work, we propose a novel framework named Region-Aware Network (RANet), which learns the ability of anti-confusing in case of heavy occlusion, nearby person and symmetric appearance, for human pose estimation. Specifically, the…

Computer Vision and Pattern Recognition · Computer Science 2019-05-28 Xuan Cao , Yanhao Ge , Ying Tai , Wei Zhang , Jian Li , Chengjie Wang , Jilin Li , Feiyue Huang

Saliency maps are a popular approach for explaining classifications of (convolutional) neural networks. However, it remains an open question as to how best to evaluate salience maps, with three families of evaluation methods commonly being…

Human-Computer Interaction · Computer Science 2025-04-25 Felix Kares , Timo Speith , Hanwei Zhang , Markus Langer

Machine learning models are known to perpetuate and even amplify the biases present in the data. However, these data biases frequently do not become apparent until after the models are deployed. Our work tackles this issue and enables the…

Computer Vision and Pattern Recognition · Computer Science 2021-07-27 Angelina Wang , Alexander Liu , Ryan Zhang , Anat Kleiman , Leslie Kim , Dora Zhao , Iroha Shirai , Arvind Narayanan , Olga Russakovsky

Driven by recent vision and graphics applications such as image segmentation and object recognition, computing pixel-accurate saliency values to uniformly highlight foreground objects becomes increasingly important. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2017-08-01 Keze Wang , Liang Lin , Jiangbo Lu , Chenglong Li , Keyang Shi

Camera-based 3D Semantic Scene Completion (SSC) is a critical task for autonomous driving and robotic scene understanding. It aims to infer a complete 3D volumetric representation of both semantics and geometry from a single image. Existing…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Zaidao Han , Risa Higashita , Jiang Liu

This paper proposes a new gradient-based XAI method called Guided AbsoluteGrad for saliency map explanations. We utilize both positive and negative gradient magnitudes and employ gradient variance to distinguish the important areas for…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Jun Huang , Yan Liu

The last decade of computer vision has been dominated by Deep Learning architectures, thanks to their unparalleled success. Their performance, however, often comes at the cost of explainability owing to their highly non-linear nature.…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Syed Nouman Hasany , Fabrice Mériaudeau , Caroline Petitjean

Interpretation and improvement of deep neural networks relies on better understanding of their underlying mechanisms. In particular, gradients of classes or concepts with respect to the input features (e.g., pixels in images) are often used…

Computer Vision and Pattern Recognition · Computer Science 2020-12-02 Lennart Brocki , Neo Christopher Chung

In this report, we present our champion solution for the NTIRE 2026 Challenge on Video Saliency Prediction held in conjunction with CVPR 2026. To exploit complementary inductive biases for video saliency, we propose Video Saliency with…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Kun Wang , Yupeng Hu , Zhiran Li , Hao Liu , Qianlong Xiang , Liqiang Nie

This paper proposes a novel saliency detection method by combining region-level saliency estimation and pixel-level saliency prediction with CNNs (denoted as CRPSD). For pixel-level saliency prediction, a fully convolutional neural network…

Computer Vision and Pattern Recognition · Computer Science 2016-08-19 Youbao Tang , Xiangqian Wu

There has been profound progress in visual saliency thanks to the deep learning architectures, however, there still exist three major challenges that hinder the detection performance for scenes with complex compositions, multiple salient…

Computer Vision and Pattern Recognition · Computer Science 2017-08-16 Jing Zhang , Yuchao Dai , Fatih Porikli , Mingyi He

Deep Learning of neural networks has gained prominence in multiple life-critical applications like medical diagnoses and autonomous vehicle accident investigations. However, concerns about model transparency and biases persist. Explainable…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Pedro Valois , Koichiro Niinuma , Kazuhiro Fukui

Augmented reality (AR) overlays digital content onto the reality. In AR system, correct and precise estimations of user's visual fixations and head movements can enhance the quality of experience by allocating more computation resources on…

Image and Video Processing · Electrical Eng. & Systems 2020-07-21 Yucheng Zhu , Xiongkuo Min , DanDan Zhu , Ke Gu , Jiantao Zhou , Guangtao Zhai , Xiaokang Yang , Wenjun Zhang

Saliency methods have been widely used to highlight important input features in model predictions. Most existing methods use backpropagation on a modified gradient function to generate saliency maps. Thus, noisy gradients can result in…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Aya Abdelsalam Ismail , Héctor Corrada Bravo , Soheil Feizi

Despite recent advancements in Instruct-based Image Editing models for generating high-quality images, they are known as black boxes and a significant barrier to transparency and user trust. To solve this issue, we introduce SMILE…

Artificial Intelligence · Computer Science 2024-12-24 Zeinab Dehghani , Koorosh Aslansefat , Adil Khan , Adín Ramírez Rivera , Franky George , Muhammad Khalid

Deep Learning has become overly complicated and has enjoyed stellar success in solving several classical problems like image classification, object detection, etc. Several methods for explaining these decisions have been proposed. Black-box…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Siddhant Agarwal , Owais Iqbal , Sree Aditya Buridi , Madda Manjusha , Abir Das