English
Related papers

Related papers: Two in One Go: Single-stage Emotion Recognition wi…

200 papers

We propose a novel one-stage Transformer-based semantic and spatial refined transformer (SSRT) to solve the Human-Object Interaction detection task, which requires to localize humans and objects, and predicts their interactions. Differently…

Computer Vision and Pattern Recognition · Computer Science 2022-05-27 A S M Iftekhar , Hao Chen , Kaustav Kundu , Xinyu Li , Joseph Tighe , Davide Modolo

User independent emotion recognition with large scale physiological signals is a tough problem. There exist many advanced methods but they are conducted under relatively small datasets with dozens of subjects. Here, we propose Res-SIN, a…

Computer Vision and Pattern Recognition · Computer Science 2020-08-04 Guanghao Yin , Shouqian Sun , Hui Zhang , Dian Yu , Chao Li , Kejun Zhang , Ning Zou

Emotion recognition from multi-modal physiological and behavioral signals plays a pivotal role in affective computing, yet most existing models remain constrained to the prediction of singular emotions in controlled laboratory settings.…

Machine Learning · Computer Science 2026-02-25 Ming Li , Yong-Jin Liu , Fang Liu , Huankun Sheng , Yeying Fan , Yixiang Wei , Minnan Luo , Weizhan Zhang , Wenping Wang

Learning disentangled representations in sequential data is a key goal in deep learning, with broad applications in vision, audio, and time series. While real-world data involves multiple interacting semantic factors over time, prior work…

Machine Learning · Computer Science 2025-10-28 Tal Barami , Nimrod Berman , Ilan Naiman , Amos H. Hason , Rotem Ezra , Omri Azencot

Speech emotion recognition (SER) has received a great deal of attention in recent years in the context of spontaneous conversations. While there have been notable results on datasets like the well known corpus of naturalistic dyadic…

Computation and Language · Computer Science 2024-01-02 Alex-Răzvan Ispas , Théo Deschamps-Berger , Laurence Devillers

Emotion detection can provide us with a window into understanding human behavior. Due to the complex dynamics of human emotions, however, constructing annotated datasets to train automated models can be expensive. Thus, we explore the…

Computation and Language · Computer Science 2022-05-06 Sabit Hassan , Shaden Shaar , Kareem Darwish

Research on Speech Emotion Recognition (SER) often faces challenges such as the lack of large-scale public datasets and limited generalization capability when dealing with data from different distributions. To solve this problem, this paper…

Sound · Computer Science 2024-12-02 Xiang minjie

Facial Emotion Recognition is an inherently difficult problem, due to vast differences in facial structures of individuals and ambiguity in the emotion displayed by a person. Recently, a lot of work is being done in the field of Facial…

Computer Vision and Pattern Recognition · Computer Science 2021-10-29 Aakash Saroop , Pathik Ghugare , Sashank Mathamsetty , Vaibhav Vasani

Human emotions are difficult to convey through words and are often abstracted in the process; however, electroencephalogram (EEG) signals can offer a more direct lens into emotional brain activity. Recent studies show that deep learning…

Neurons and Cognition · Quantitative Biology 2025-11-19 Nilay Kumar , Priyansh Bhandari , G. Maragatham

Obtaining the human-like perception ability of abstracting visual concepts from concrete pixels has always been a fundamental and important target in machine learning research fields such as disentangled representation learning and scene…

Computer Vision and Pattern Recognition · Computer Science 2022-10-14 Tao Yang , Yuwang Wang , Yan Lu , Nanning Zheng

In recent years, deep learning has achieved innovative advancements in various fields, including the analysis of human emotions and behaviors. Initiatives such as the Affective Behavior Analysis in-the-wild (ABAW) competition have been…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Seongjae Min , Junseok Yang , Sangjun Lim , Junyong Lee , Sangwon Lee , Sejoon Lim

Speech Emotion Recognition (SER) plays a crucial role in enhancing human-computer interaction. Cross-Linguistic SER (CLSER) has been a challenging research problem due to significant variability in linguistic and acoustic features of…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-22 Ruoyu Zhao , Xiantao Jiang , F. Richard Yu , Victor C. M. Leung , Tao Wang , Shaohu Zhang

In emotion recognition in conversation (ERC), the emotion of the current utterance is predicted by considering the previous context, which can be utilized in many natural language processing tasks. Although multiple emotions can coexist in…

Computation and Language · Computer Science 2022-06-17 Joosung Lee

In this work we tackle the task of video-based visual emotion recognition in the wild. Standard methodologies that rely solely on the extraction of bodily and facial features often fall short of accurate emotion prediction in cases where…

Computer Vision and Pattern Recognition · Computer Science 2022-02-03 Ioannis Pikoulis , Panagiotis P. Filntisis , Petros Maragos

Within the context of creating new Socially Assistive Robots, emotion recognition has become a key development factor, as it allows the robot to adapt to the user's emotional state in the wild. In this work, we focused on the analysis of…

Explainable Multimodal Emotion Recognition (EMER) is an emerging task that aims to achieve reliable and accurate emotion recognition. However, due to the high annotation cost, the existing dataset (denoted as EMER-Fine) is small, making it…

Human-Computer Interaction · Computer Science 2024-07-11 Zheng Lian , Haiyang Sun , Licai Sun , Jiangyan Yi , Bin Liu , Jianhua Tao

Speech emotion recognition is a challenging problem because human convey emotions in subtle and complex ways. For emotion recognition on human speech, one can either extract emotion related features from audio signals or employ speech…

Computation and Language · Computer Science 2020-04-06 Haiyang Xu , Hui Zhang , Kun Han , Yun Wang , Yiping Peng , Xiangang Li

Classification and localization are two main sub-tasks in object detection. Nonetheless, these two tasks have inconsistent preferences for feature context, i.e., localization expects more boundary-aware features to accurately regress the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-03 Jiayuan Zhuang , Zheng Qin , Hao Yu , Xucan Chen

Applications of an efficient emotion recognition system can be found in several domains such as medicine, driver fatigue surveillance, social robotics, and human-computer interaction. Appraising human emotional states, behaviors, and…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Savinay Nagendra , Prapti Panigrahi

This paper focuses on EEG-based visual recognition, aiming to predict the visual object class observed by a subject based on his/her EEG signals. One of the main challenges is the large variation between signals from different subjects. It…

Computer Vision and Pattern Recognition · Computer Science 2021-10-27 Pilhyeon Lee , Sunhee Hwang , Seogkyu Jeon , Hyeran Byun