English
Related papers

Related papers: Learning a Saliency Evaluation Metric Using Crowds…

200 papers

We proposed a probabilistic approach to joint modeling of participants' reliability and humans' regularity in crowdsourced affective studies. Reliability measures how likely a subject will respond to a question seriously; and regularity…

Machine Learning · Statistics 2017-01-09 Jianbo Ye , Jia Li , Michelle G. Newman , Reginald B. Adams , James Z. Wang

Saliency prediction refers to the computational task of modeling overt attention. Social cues greatly influence our attention, consequently altering our eye movements and behavior. To emphasize the efficacy of such features, we present a…

Computer Vision and Pattern Recognition · Computer Science 2022-06-10 Fares Abawi , Tom Weber , Stefan Wermter

Conventional saliency maps highlight input features to which neural network predictions are highly sensitive. We take a different approach to saliency, in which we identify and analyze the network parameters, rather than inputs, which are…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Roman Levin , Manli Shu , Eitan Borgnia , Furong Huang , Micah Goldblum , Tom Goldstein

Tables provide valuable knowledge that can be used to verify textual statements. While a number of works have considered table-based fact verification, direct alignments of tabular data with tokens in textual statements are rarely…

Computation and Language · Computer Science 2021-09-10 Fei Wang , Kexuan Sun , Jay Pujara , Pedro Szekely , Muhao Chen

Saliency prediction is a well studied problem in computer vision. Early saliency models were based on low-level hand-crafted feature derived from insights gained in neuroscience and psychophysics. In the wake of deep learning breakthrough,…

Computer Vision and Pattern Recognition · Computer Science 2018-03-16 Sen He , Nicolas Pugeault

Sentiment analysis is crucial for extracting social signals from social media content. Due to the prevalence of images in social media, image sentiment analysis is receiving increasing attention in recent years. However, most existing…

Artificial Intelligence · Computer Science 2016-11-16 Honglin Zheng , Tianlang Chen , Jiebo Luo

Methods based on class activation maps (CAM) provide a simple mechanism to interpret predictions of convolutional neural networks by using linear combinations of feature maps as saliency maps. By contrast, masking-based methods optimize a…

Computer Vision and Pattern Recognition · Computer Science 2024-04-08 Hanwei Zhang , Felipe Torres , Ronan Sicre , Yannis Avrithis , Stephane Ayache

Salient object detection is evaluated using binary ground truth with the labels being salient object class and background. In this paper, we corroborate based on three subjective experiments on a novel image dataset that objects in natural…

Computer Vision and Pattern Recognition · Computer Science 2020-03-20 Gökhan Yildirim , Debashis Sen , Mohan Kankanhalli , Sabine Süsstrunk

Deep convolutional neural networks have achieved impressive performance on a broad range of problems, beating prior art on established benchmarks, but it often remains unclear what are the representations learnt by those systems and how…

Computer Vision and Pattern Recognition · Computer Science 2018-03-23 Sen He , Nicolas Pugeault

Visual saliency detection aims at identifying the most visually distinctive parts in an image, and serves as a pre-processing step for a variety of computer vision and image processing tasks. To this end, the saliency detection procedure…

Computer Vision and Pattern Recognition · Computer Science 2017-02-27 Xuanyang Xi , Yongkang Luo , Fengfu Li , Peng Wang , Hong Qiao

While there is increasing concern about the interpretability of neural models, the evaluation of interpretability remains an open problem, due to the lack of proper evaluation datasets and metrics. In this paper, we present a novel…

Computation and Language · Computer Science 2022-11-16 Lijie Wang , Yaozong Shen , Shuyuan Peng , Shuai Zhang , Xinyan Xiao , Hao Liu , Hongxuan Tang , Ying Chen , Hua Wu , Haifeng Wang

The high cost of pixel-level annotations makes it appealing to train saliency detection models with weak supervision. However, a single weak supervision source usually does not contain enough information to train a well-performing model. To…

Computer Vision and Pattern Recognition · Computer Science 2019-04-02 Yu Zeng , Yunzhi Zhuge , Huchuan Lu , Lihe Zhang , Mingyang Qian , Yizhou Yu

We propose a framework inspired by biological vision systems to produce saliency maps of digital images. Well-known computational models for receptive fields of areas in the visual cortex that are specialized for color and orientation…

Computer Vision and Pattern Recognition · Computer Science 2022-05-04 Reza Hojjaty Saeedy , Richard A. Messner

Existing saliency-guided training approaches improve model generalization by incorporating a loss term that compares the model's class activation map (CAM) for a sample's true-class ({\it i.e.}, correct-label class) against a human…

Computer Vision and Pattern Recognition · Computer Science 2025-07-24 Jacob Piland , Chris Sweet , Adam Czajka

Predicting where people look in natural scenes has attracted a lot of interest in computer vision and computational neuroscience over the past two decades. Two seemingly contrasting categories of cues have been proposed to influence where…

Computer Vision and Pattern Recognition · Computer Science 2015-04-01 Ali Borji , James Tanner

Saliency maps are widely used in the computer vision community for interpreting neural network classifiers. However, due to the randomness of training samples and optimization algorithms, the resulting saliency maps suffer from a…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Shizhan Gong , Jingwei Zhang , Qi Dou , Farzan Farnia

The success of current deep saliency detection methods heavily depends on the availability of large-scale supervision in the form of per-pixel labeling. Such supervision, while labor-intensive and not always possible, tends to hinder the…

Computer Vision and Pattern Recognition · Computer Science 2018-03-30 Jing Zhang , Tong Zhang , Yuchao Dai , Mehrtash Harandi , Richard Hartley

The classification decisions of neural networks can be misled by small imperceptible perturbations. This work aims to explain the misled classifications using saliency methods. The idea behind saliency methods is to explain the…

Computer Vision and Pattern Recognition · Computer Science 2019-10-22 Jindong Gu , Volker Tresp

Benefiting from deep learning research and large-scale datasets, saliency prediction has achieved significant success in the past decade. However, it still remains challenging to predict saliency maps on images in new domains that lack…

Computer Vision and Pattern Recognition · Computer Science 2020-07-13 Yan Luo , Yongkang Wong , Mohan S. Kankanhalli , Qi Zhao

This paper presents a fresh perspective on the role of saliency maps in weakly-supervised semantic segmentation (WSSS) and offers new insights and research directions based on our empirical findings. We conduct comprehensive experiments and…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Beomyoung Kim , Donghyun Kim , Sung Ju Hwang