English
Related papers

Related papers: Emotion Recognition with Facial Attention and Obje…

200 papers

Facial emotion recognition is a vast and complex problem space within the domain of computer vision and thus requires a universally accepted baseline method with which to evaluate proposed models. While test datasets have served this…

Computer Vision and Pattern Recognition · Computer Science 2022-02-01 Nyle Siddiqui , Rushit Dave , Tyler Bauer , Thomas Reither , Dylan Black , Mitchell Hanson

Emotion being a subjective thing, leveraging knowledge and science behind labeled data and extracting the components that constitute it, has been a challenging problem in the industry for many years. With the evolution of deep learning in…

Computer Vision and Pattern Recognition · Computer Science 2017-06-07 Prudhvi Raj Dachapally

Attention mechanisms have become integral to modern convolutional neural networks (CNNs), delivering notable performance improvements with minimal computational overhead. However, the efficiency accuracy trade off of different channel…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Prem Babu Kanaparthi , Tulasi Venkata Sri Varshini Padamata

This article presents our results for the eighth Affective Behavior Analysis in-the-wild (ABAW) competition.Multimodal emotion recognition (ER) has important applications in affective computing and human-computer interaction. However, in…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Ran Liu , Fengyu Zhang , Cong Yu , Longjiang Yang , Zhuofan Wen , Siyuan Zhang , Hailiang Yao , Shun Chen , Zheng Lian , Bin Liu

Speech emotion recognition is a challenging task for three main reasons: 1) human emotion is abstract, which means it is hard to distinguish; 2) in general, human emotion can only be detected in some specific moments during a long…

Sound · Computer Science 2019-05-03 Yuanyuan Zhang , Jun Du , Zirui Wang , Jianshu Zhang

For many years, the emotion recognition task has remained one of the most interesting and important problems in the field of human-computer interaction. In this study, we consider the emotion recognition task as a classification as well as…

Computer Vision and Pattern Recognition · Computer Science 2020-06-22 Denis Rangulov , Muhammad Fahim

In many domains, including online education, healthcare, security, and human-computer interaction, facial emotion recognition (FER) is essential. Real-world FER is still difficult despite its significance because of some factors such as…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Deeptimaan Banerjee , Prateek Gothwal , Ashis Kumer Biswas

In this paper, we propose a novel approach that learns to sequentially attend to different Convolutional Neural Networks (CNN) layers (i.e., ``what'' feature abstraction to attend to) and different spatial locations of the selected feature…

Computer Vision and Pattern Recognition · Computer Science 2019-06-03 Tony Joseph , Konstantinos G. Derpanis , Faisal Z. Qureshi

Fine-grained visual recognition typically depends on modeling subtle difference from object parts. However, these parts often exhibit dramatic visual variations such as occlusions, viewpoints, and spatial transformations, making it hard to…

Computer Vision and Pattern Recognition · Computer Science 2017-09-19 Lin Wu , Yang Wang

Attention mechanisms, particularly channel attention, have become highly influential in numerous computer vision tasks. Despite their effectiveness, many existing methods primarily focus on optimizing performance through complex attention…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Ronghui Zhang , Runzong Zou , Yue Zhao , Zirui Zhang , Junzhou Chen , Yue Cao , Chuan Hu , Houbing Song

Deep neural networks, including recurrent networks, have been successfully applied to human activity recognition. Unfortunately, the final representation learned by recurrent networks might encode some noise (irrelevant signal components,…

Machine Learning · Computer Science 2018-10-10 Ming Zeng , Haoxiang Gao , Tong Yu , Ole J. Mengshoel , Helge Langseth , Ian Lane , Xiaobing Liu

A novel ``edge attention-based Convolutional Neural Network (CNN)'' is proposed in this research for object classification task. With the advent of advanced computing technology, CNN models have achieved to remarkable success, particularly…

Computer Vision and Pattern Recognition · Computer Science 2025-02-06 Santanu Roy , Ashvath Suresh , Archit Gupta

Attention has long been proposed by psychologists as important for effectively dealing with the enormous sensory stimulus available in the neocortex. Inspired by the visual attention models in computational neuroscience and the need of…

Computer Vision and Pattern Recognition · Computer Science 2015-02-24 Yichuan Tang , Nitish Srivastava , Ruslan Salakhutdinov

Affect (emotion) recognition has gained significant attention from researchers in the past decade. Emotion-aware computer systems and devices have many applications ranging from interactive robots, intelligent online tutor to emotion based…

Human-Computer Interaction · Computer Science 2016-07-12 Amol Patwardhan , Gerald Knapp

Action recognition with 3D skeleton sequences is becoming popular due to its speed and robustness. The recently proposed Convolutional Neural Networks (CNN) based methods have shown good performance in learning spatio-temporal…

Computer Vision and Pattern Recognition · Computer Science 2018-04-12 Zhengyuan Yang , Yuncheng Li , Jianchao Yang , Jiebo Luo

Windowed attention mechanisms were introduced to mitigate the issue of excessive computation inherent in global attention mechanisms. In this paper, we present FwNet-ECA, a novel method that utilizes Fourier transforms paired with learnable…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Shengtian Mian , Ya Wang , Nannan Gu , Yuping Wang , Xiaoqing Li

Automated Facial Expression Recognition (FER) has been a challenging task for decades. Many of the existing works use hand-crafted features such as LBP, HOG, LPQ, and Histogram of Optical Flow (HOF) combined with classifiers such as Support…

Computer Vision and Pattern Recognition · Computer Science 2020-04-17 Behzad Hasani , Mohammad H. Mahoor

This paper proposes a Residual Convolutional Neural Network (ResNet) based on speech features and trained under Focal Loss to recognize emotion in speech. Speech features such as Spectrogram and Mel-frequency Cepstral Coefficients (MFCCs)…

Audio and Speech Processing · Electrical Eng. & Systems 2025-04-16 Suraj Tripathi , Abhay Kumar , Abhiram Ramesh , Chirag Singh , Promod Yenigalla

In this work, we explore the impact of visual modality in addition to speech and text for improving the accuracy of the emotion detection system. The traditional approaches tackle this task by fusing the knowledge from the various…

Machine Learning · Computer Science 2020-04-24 Seunghyun Yoon , Subhadeep Dey , Hwanhee Lee , Kyomin Jung

Automatic affect recognition using visual cues is an important task towards a complete interaction between humans and machines. Applications can be found in tutoring systems and human computer interaction. A critical step towards that…

Computer Vision and Pattern Recognition · Computer Science 2021-11-05 Panagiotis Tzirakis , Dénes Boros , Elnar Hajiyev , Björn W. Schuller