English
Related papers

Related papers: Saliency Cards: A Framework to Characterize and Co…

200 papers

Saliency prediction models are constrained by the limited diversity and quantity of labeled data. Standard data augmentation techniques such as rotating and cropping alter scene composition, affecting saliency. We propose a novel data…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Bahar Aydemir , Deblina Bhattacharjee , Tong Zhang , Mathieu Salzmann , Sabine Süsstrunk

As the applications of Natural Language Processing (NLP) in sensitive areas like Political Profiling, Review of Essays in Education, etc. proliferate, there is a great need for increasing transparency in NLP models to build trust with…

Computation and Language · Computer Science 2022-11-29 Adel Rahimi , Shaurya Jain

The interpretability of medical image analysis models is considered a key research field. We use a dataset of eye-tracking data from five radiologists to compare the outputs of interpretability methods and the heatmaps representing where…

Computer Vision and Pattern Recognition · Computer Science 2023-04-21 Ricardo Bigolin Lanfredi , Ambuj Arora , Trafton Drew , Joyce D. Schroeder , Tolga Tasdizen

Input perturbation methods occlude parts of an input to a function and measure the change in the function's output. Recently, input perturbation methods have been applied to generate and evaluate saliency maps from convolutional neural…

Machine Learning · Computer Science 2021-01-27 Lukas Brunke , Prateek Agrawal , Nikhil George

The distinctiveness of image regions is widely used as the cue of saliency. Generally, the distinctiveness is computed according to the absolute difference of features. However, according to the image quality assessment (IQA) studies, the…

Computer Vision and Pattern Recognition · Computer Science 2019-05-27 Yang Li , Xuanqin Mou

Interpretability is a critical factor in applying complex deep learning models to advance the understanding of brain disorders in neuroimaging studies. To interpret the decision process of a trained classifier, existing techniques typically…

Image and Video Processing · Electrical Eng. & Systems 2021-06-29 Zixuan Liu , Ehsan Adeli , Kilian M. Pohl , Qingyu Zhao

Visual saliency is a fundamental problem in both cognitive and computational sciences, including computer vision. In this paper, we discover that a high-quality visual saliency model can be learned from multiscale features extracted using…

Computer Vision and Pattern Recognition · Computer Science 2016-11-03 Guanbin Li , Yizhou Yu

Getting pain intensity from face images is an important problem in autonomous nursing systems. However, due to the limitation in data sources and the subjectiveness in pain intensity values, it is hard to adopt modern deep neural networks…

Computer Vision and Pattern Recognition · Computer Science 2018-11-21 Conghui Li , Zhaocheng Zhu , Yuming Zhao

The volume of User Generated Content (UGC) has increased in recent years. The challenge with this type of content is assessing its quality. So far, the state-of-the-art metrics are not exhibiting a very high correlation with perceptual…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Xinyi Wang , Angeliki Katsenou , David Bull

Light field saliency detection -- important due to utility in many vision tasks -- still lacks speed and can improve in accuracy. Due to the formulation of the saliency detection problem in light fields as a segmentation task or a…

Computer Vision and Pattern Recognition · Computer Science 2021-12-14 Sahan Hemachandra , Ranga Rodrigo , Chamira Edussooriya

We address the need to generate faithful explanations of "black box" Deep Learning models. Several tests have been proposed to determine aspects of faithfulness of explanation methods, but they lack cross-domain applicability and a rigorous…

Machine Learning · Computer Science 2023-06-27 Harshinee Sriram , Cristina Conati

Beneficial from Fully Convolutional Neural Networks (FCNs), saliency detection methods have achieved promising results. However, it is still challenging to learn effective features for detecting salient objects in complicated scenarios, in…

Computer Vision and Pattern Recognition · Computer Science 2020-04-07 Sina Mohammadi , Mehrdad Noori , Ali Bahri , Sina Ghofrani Majelan , Mohammad Havaei

Tables provide valuable knowledge that can be used to verify textual statements. While a number of works have considered table-based fact verification, direct alignments of tabular data with tokens in textual statements are rarely…

Computation and Language · Computer Science 2021-09-10 Fei Wang , Kexuan Sun , Jay Pujara , Pedro Szekely , Muhao Chen

This work proposes a saliency-based attribution framework to evaluate and compare 10 state-of-the-art explainability methods for deep learning models in astronomy, focusing on the classification of radio galaxy images. While previous work…

Instrumentation and Methods for Astrophysics · Physics 2025-02-25 M. T. Atemkeng , C. Chuma , S. Zaza , C. D. Nunhokee , O. M. Smirnov

Saliency maps have been widely used to interpret deep learning classifiers for Alzheimer's disease (AD). However, since AD is heterogeneous and has multiple subtypes, the pathological mechanism of AD remains not fully understood and may…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Yihan Zhang , Xuanshuo Zhang , Wei Wu , Haohan Wang

This paper proposes a new end-to-end trainable model for lossy image compression, which includes several novel components. The method incorporates 1) an adequate perceptual similarity metric; 2) saliency in the images; 3) a hierarchical…

Image and Video Processing · Electrical Eng. & Systems 2020-11-10 Yash Patel , Srikar Appalaraju , R. Manmatha

Reading code is an essential activity in software maintenance and evolution. Several studies with human subjects have investigated how different factors, such as the employed programming constructs and naming conventions, can impact code…

Software Engineering · Computer Science 2021-10-05 Delano Oliveira , Reydne Bruno , Fernanda Madeiral , Fernando Castor

Research in interpretable machine learning proposes different computational and human subject approaches to evaluate model saliency explanations. These approaches measure different qualities of explanations to achieve diverse goals in…

Human-Computer Interaction · Computer Science 2020-06-30 Sina Mohseni , Jeremy E. Block , Eric D. Ragan

Explainability features are intended to provide insight into the internal mechanisms of an AI device, but there is a lack of evaluation techniques for assessing the quality of provided explanations. We propose a framework to assess and…

Artificial Intelligence · Computer Science 2025-06-18 Miguel A. Lago , Ghada Zamzmi , Brandon Eich , Jana G. Delfino

We present a novel method for reliably explaining the predictions of neural networks. We consider an explanation reliable if it identifies input features relevant to the model output by considering the input and the neighboring data points.…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Dohun Lim , Hyeonseok Lee , Sungchan Kim