English
Related papers

Related papers: Visual Saliency Maps Can Apply to Facial Expressio…

200 papers

Saliency prediction refers to the computational task of modeling overt attention. Social cues greatly influence our attention, consequently altering our eye movements and behavior. To emphasize the efficacy of such features, we present a…

Computer Vision and Pattern Recognition · Computer Science 2022-06-10 Fares Abawi , Tom Weber , Stefan Wermter

Automatic facial expression recognition is an important research area in the emotion recognition and computer vision. Applications can be found in several domains such as medical treatment, driver fatigue surveillance, sociable robotics,…

Computer Vision and Pattern Recognition · Computer Science 2020-02-03 Sevegni Odilon Clement Allognon , Alessandro L. Koerich , Alceu de S. Britto

Class activation map (CAM) helps to formulate saliency maps that aid in interpreting the deep neural network's prediction. Gradient-based methods are generally faster than other branches of vision interpretability and independent of human…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 Masud An Nur Islam Fahim , Nazmus Saqib , Shafkat Khan Siam , Ho Yub Jung

In this work, we aim to predict human eye fixation with view-free scenes based on an end-to-end deep learning architecture. Although Convolutional Neural Networks (CNNs) have made substantial improvement on human attention prediction, it is…

Computer Vision and Pattern Recognition · Computer Science 2018-03-26 Wenguan Wang , Jianbing Shen

Of later years, numerous bottom-up attention models have been proposed on different assumptions. However, the produced saliency maps may be different from each other even from the same input image. We also observe that human fixation map…

Computer Vision and Pattern Recognition · Computer Science 2018-11-08 Jian Li

Existing saliency-guided training approaches improve model generalization by incorporating a loss term that compares the model's class activation map (CAM) for a sample's true-class ({\it i.e.}, correct-label class) against a human…

Computer Vision and Pattern Recognition · Computer Science 2025-07-24 Jacob Piland , Chris Sweet , Adam Czajka

In this paper, we address the problem of quantifying reliability of computational saliency for videos, which can be used to improve saliency-based video processing and enable more reliable performance and risk assessment of such processing.…

Computer Vision and Pattern Recognition · Computer Science 2019-01-16 Tariq Alshawi , Zhiling Long , Ghassan AlRegib

Conventional saliency maps highlight input features to which neural network predictions are highly sensitive. We take a different approach to saliency, in which we identify and analyze the network parameters, rather than inputs, which are…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Roman Levin , Manli Shu , Eitan Borgnia , Furong Huang , Micah Goldblum , Tom Goldstein

Feature maps in deep neural network generally contain different semantics. Existing methods often omit their characteristics that may lead to sub-optimal results. In this paper, we propose a novel end-to-end deep saliency network which…

Computer Vision and Pattern Recognition · Computer Science 2018-08-07 Fengdong Sun , Wenhui Li , Yuanyuan Guan

Facial expression is a way of communication that can be used to interact with computers or other electronic devices and the recognition of emotion from faces is an emerging practice with application in many fields. There are many…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Salik Ram Khanal , Prabin Sharma , Hugo Fernandes , João Barroso , Vítor Manuel de Jesus Filipe

Dynamic facial expression recognition has many useful applications in social networks, multimedia content analysis, security systems and others. This challenging process must be done under recurrent problems of image illumination and low…

Computer Vision and Pattern Recognition · Computer Science 2020-12-29 Ali Raza Shahid , Sheheryar Khan , Hong Yan

Understanding the mental state of other people is an important skill for intelligent agents and robots to operate within social environments. However, the mental processes involved in `mind-reading' are complex. One explanation of such…

Computer Vision and Pattern Recognition · Computer Science 2019-11-05 Jonathan Vitale , Mary-Anne Williams , Benjamin Johnston , Giuseppe Boccignone

Deep neural networks, especially convolutional deep neural networks, are state-of-the-art methods to classify, segment or even generate images, movies, or sounds. However, these methods lack of a good semantic understanding of what happens…

Computer Vision and Pattern Recognition · Computer Science 2021-08-27 Jens Bayer , David Münch , Michael Arens

Understanding and predicting the human visual attentional mechanism is an active area of research in the fields of neuroscience and computer vision. In this work, we propose DeepFix, a first-of-its-kind fully convolutional neural network…

Computer Vision and Pattern Recognition · Computer Science 2015-10-13 Srinivas S. S. Kruthiventi , Kumar Ayush , R. Venkatesh Babu

Warmth and competence represent the fundamental traits in social judgment that determine emotional reactions and behavioral intentions towards social targets. This research investigates whether an algorithm can learn visual representations…

Computer Vision and Pattern Recognition · Computer Science 2019-07-02 U. Messer , S. Fausser

This article reports on an investigation of the use of convolutional neural networks to predict the visual attention of chess players. The visual attention model described in this article has been created to generate saliency maps that…

Machine Learning · Statistics 2019-04-21 Justin Le Louedec , Thomas Guntz , James Crowley , Dominique Vaufreydaz

Being able to explain the prediction to clinical end-users is a necessity to leverage the power of AI models for clinical decision support. For medical images, saliency maps are the most common form of explanation. The maps highlight…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Weina Jin , Xiaoxiao Li , Ghassan Hamarneh

State-of-the-art saliency prediction methods develop upon model architectures or loss functions; while training to generate one target saliency map. However, publicly available saliency prediction datasets can be utilized to create more…

Computer Vision and Pattern Recognition · Computer Science 2020-09-01 Sandeep Mishra , Oindrila Saha

Bottom-up saliency, an early human visual processing, behaves like binary classification of interest and null hypothesis. Its discriminant power, mutual information of image features and class distribution, is closely related to saliency…

Computer Vision and Pattern Recognition · Computer Science 2013-02-05 Anh Cat Le Ngo , Li-Minn Ang , Guoping Qiu , Kah-Phooi Seng

Automated facial expression analysis has a variety of applications in human-computer interaction. Traditional methods mainly analyze prototypical facial expressions of no more than eight discrete emotions as a classification task. However,…

Computer Vision and Pattern Recognition · Computer Science 2018-05-04 Feng Zhou , Shu Kong , Charless Fowlkes , Tao Chen , Baiying Lei