English
Related papers

Related papers: Two-level Attention with Two-stage Multi-task Lear…

200 papers

Despite the recent progress in speech emotion recognition (SER), state-of-the-art systems are unable to achieve improved performance in cross-language settings. In this paper, we propose a Multimodal Dual Attention Transformer (MDAT) model…

Computation and Language · Computer Science 2023-07-17 Syed Aun Muhammad Zaidi , Siddique Latif , Junaid Qadir

Emotion recognition is a core research area at the intersection of artificial intelligence and human communication analysis. It is a significant technical challenge since humans display their emotions through complex idiosyncratic…

Human-Computer Interaction · Computer Science 2018-09-14 Paul Pu Liang , Amir Zadeh , Louis-Philippe Morency

Over the past few years, deep learning methods have shown remarkable results in many face-related tasks including automatic facial expression recognition (FER) in-the-wild. Meanwhile, numerous models describing the human emotional states…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Panagiotis Antoniadis , Panagiotis P. Filntisis , Petros Maragos

This paper illustrates our submission method to the fourth Affective Behavior Analysis in-the-Wild (ABAW) Competition. The method is used for the Multi-Task Learning Challenge. Instead of using only face information, we employ full…

Computer Vision and Pattern Recognition · Computer Science 2022-07-25 Irfan Haider , Minh-Trieu Tran , Soo-Hyung Kim , Hyung-Jeong Yang , Guee-Sang Lee

Facial expression is related to facial muscle contractions and different muscle movements correspond to different emotional states. For micro-expression recognition, the muscle movements are usually subtle, which has a negative impact on…

Computer Vision and Pattern Recognition · Computer Science 2023-07-28 Zhifeng Wang , Kaihao Zhang , Wenhan Luo , Ramesh Sankaranarayana

We propose a novel two-layered attention network based on Bidirectional Long Short-Term Memory for sentiment analysis. The novel two-layered attention network takes advantage of the external knowledge bases to improve the sentiment…

Computation and Language · Computer Science 2018-06-19 Abhishek Kumar , Daisuke Kawahara , Sadao Kurohashi

In this paper, we propose a new deep network that learns multi-level deep representations for image emotion classification (MldrNet). Image emotion can be recognized through image semantics, image aesthetics and low-level visual features…

Computer Vision and Pattern Recognition · Computer Science 2018-09-26 Tianrong Rao , Min Xu , Dong Xu

Automatic facial expression recognition is an important research area in the emotion recognition and computer vision. Applications can be found in several domains such as medical treatment, driver fatigue surveillance, sociable robotics,…

Computer Vision and Pattern Recognition · Computer Science 2020-02-03 Sevegni Odilon Clement Allognon , Alessandro L. Koerich , Alceu de S. Britto

Applications of an efficient emotion recognition system can be found in several domains such as medicine, driver fatigue surveillance, social robotics, and human-computer interaction. Appraising human emotional states, behaviors, and…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Savinay Nagendra , Prapti Panigrahi

Emotion recognition and sentiment analysis are pivotal tasks in speech and language processing, particularly in real-world scenarios involving multi-party, conversational data. This paper presents a multimodal approach to tackle these…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Aref Farhadipour , Hossein Ranjbar , Masoumeh Chapariniya , Teodora Vukovic , Sarah Ebling , Volker Dellwo

Emotion recognition from speech is a challenging task. Re-cent advances in deep learning have led bi-directional recur-rent neural network (Bi-RNN) and attention mechanism as astandard method for speech emotion recognition, extractingand…

Sound · Computer Science 2021-06-09 Zixuan Peng , Yu Lu , Shengfeng Pan , Yunfeng Liu

Micro-expression, for its high objectivity in emotion detection, has emerged to be a promising modality in affective computing. Recently, deep learning methods have been successfully introduced into the micro-expression recognition area.…

Computer Vision and Pattern Recognition · Computer Science 2019-08-28 Chongyang Wang , Min Peng , Tao Bi , Tong Chen

Emotion being a subjective thing, leveraging knowledge and science behind labeled data and extracting the components that constitute it, has been a challenging problem in the industry for many years. With the evolution of deep learning in…

Computer Vision and Pattern Recognition · Computer Science 2017-06-07 Prudhvi Raj Dachapally

Speech emotion recognition is a challenging task for three main reasons: 1) human emotion is abstract, which means it is hard to distinguish; 2) in general, human emotion can only be detected in some specific moments during a long…

Sound · Computer Science 2019-05-03 Yuanyuan Zhang , Jun Du , Zirui Wang , Jianshu Zhang

Emotion has an important role in daily life, as it helps people better communicate with and understand each other more efficiently. Facial expressions can be classified into 7 categories: angry, disgust, fear, happy, neutral, sad and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-07 Shaoyuan Xu , Yang Cheng , Qian Lin , Jan P. Allebach

The research and applications of multimodal emotion recognition have become increasingly popular recently. However, multimodal emotion recognition faces the challenge of lack of data. To solve this problem, we propose to use transfer…

Computation and Language · Computer Science 2022-07-13 Zihan Zhao , Yanfeng Wang , Yu Wang

Facial expressions play an important role in conveying the emotional states of human beings. Recently, deep learning approaches have been applied to image recognition field due to the discriminative power of Convolutional Neural Network…

Computer Vision and Pattern Recognition · Computer Science 2018-07-30 Yingruo Fan , Jacqueline C. K. Lam , Victor O. K. Li

The project leverages advanced machine and deep learning techniques to address the challenge of emotion recognition by focusing on non-facial cues, specifically hands, body gestures, and gestures. Traditional emotion recognition systems…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Haoyang Liu

In this paper, we study the effect of introducing channel and spatial attention mechanisms, namely SEN-Net, ECA-Net, and CBAM, to existing CNN vision-based models such as VGGNet, ResNet, and ResNetV2 to perform the Facial Emotion…

Computer Vision and Pattern Recognition · Computer Science 2024-10-24 Andrzej Miskow , Abdulrahman Altahhan

Learning to capture long-range relations is fundamental to image/video recognition. Existing CNN models generally rely on increasing depth to model such relations which is highly inefficient. In this work, we propose the "double attention…

Computer Vision and Pattern Recognition · Computer Science 2018-10-30 Yunpeng Chen , Yannis Kalantidis , Jianshu Li , Shuicheng Yan , Jiashi Feng