English
Related papers

Related papers: Real-Time Emotion Recognition via Attention Gated …

200 papers

Human emotion recognition is an active research area in artificial intelligence and has made substantial progress over the past few years. Many recent works mainly focus on facial regions to infer human affection, while the surrounding…

Computer Vision and Pattern Recognition · Computer Science 2021-11-09 Nhat Le , Khanh Nguyen , Anh Nguyen , Bac Le

Emotion recognition plays a crucial role in human-computer interaction, and electroencephalography (EEG) is advantageous for reflecting human emotional states. In this study, we propose MACTN, a hierarchical hybrid model for jointly…

Signal Processing · Electrical Eng. & Systems 2023-05-30 Xiaopeng Si , Dong Huang , Yulin Sun , Dong Ming

Efficiently capturing consistent and complementary semantic features in a multimodal conversation context is crucial for Multimodal Emotion Recognition in Conversation (MERC). Existing methods mainly use graph structures to model dialogue…

Computation and Language · Computer Science 2024-05-06 Tao Meng , Fuchen Zhang , Yuntao Shou , Wei Ai , Nan Yin , Keqin Li

In recent years, numerous neuroscientific studies demonstrate that specific areas of the brain are connected to human emotional responses, with these regions exhibiting variability across individuals and emotional states. To fully leverage…

Signal Processing · Electrical Eng. & Systems 2025-04-30 Tianzhi Feng , Chennan Wu , Yi Niu , Fu Li , Yang Li , Boxun Fu , Zhifu Zhao , Xiaotian Wang

In human-computer interaction, Speech Emotion Recognition (SER) plays an essential role in understanding the user's intent and improving the interactive experience. While similar sentimental speeches own diverse speaker characteristics but…

Sound · Computer Science 2022-11-08 Jia-Xin Ye , Xin-Cheng Wen , Xuan-Ze Wang , Yong Xu , Yan Luo , Chang-Li Wu , Li-Yan Chen , Kun-Hong Liu

Nowadays, neural network models achieve state-of-the-art results in many areas as computer vision or speech processing. For sequential data, especially for Natural Language Processing (NLP) tasks, Recurrent Neural Networks (RNNs) and their…

Computation and Language · Computer Science 2021-02-23 Elie Azeraf , Emmanuel Monfrini , Emmanuel Vignon , Wojciech Pieczynski

Convolutional neural network (CNN) and recurrent neural network (RNN) models have become the mainstream methods for relation classification. We propose a unified architecture, which exploits the advantages of CNN and RNN simultaneously, to…

Computation and Language · Computer Science 2018-07-31 Bin He , Yi Guan , Rui Dai

Empathetic response generation aims to comprehend the cognitive and emotional states in dialogue utterances and generate proper responses. Psychological theories posit that comprehending emotional and cognitive states necessitates…

Computation and Language · Computer Science 2024-06-04 Zhou Yang , Zhaochun Ren , Yufeng Wang , Chao Chen , Haizhou Sun , Xiaofei Zhu , Xiangwen Liao

Since Multimodal Emotion Recognition in Conversation (MERC) can be applied to public opinion monitoring, intelligent dialogue robots, and other fields, it has received extensive research attention in recent years. Unlike traditional…

Machine Learning · Computer Science 2024-07-25 Tao Meng , Fuchen Zhang , Yuntao Shou , Hongen Shao , Wei Ai , Keqin Li

Automatic affect recognition is a challenging task due to the various modalities emotions can be expressed with. Applications can be found in many domains including multimedia retrieval and human computer interaction. In recent years, deep…

Computer Vision and Pattern Recognition · Computer Science 2018-02-14 Panagiotis Tzirakis , George Trigeorgis , Mihalis A. Nicolaou , Björn Schuller , Stefanos Zafeiriou

Emotion recognition in conversations is challenging due to the multi-modal nature of the emotion expression. We propose a hierarchical cross-attention model (HCAM) approach to multi-modal emotion recognition using a combination of recurrent…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-10 Soumya Dutta , Sriram Ganapathy

Emotions are an inherent part of human interactions, and consequently, it is imperative to develop AI systems that understand and recognize human emotions. During a conversation involving various people, a person's emotions are influenced…

Computation and Language · Computer Science 2022-05-06 Abhinav Joshi , Ashwani Bhat , Ayush Jain , Atin Vikram Singh , Ashutosh Modi

Recurrent neural networks with a gating mechanism such as an LSTM or GRU are powerful tools to model sequential data. In the mechanism, a forget gate, which was introduced to control information flow in a hidden state in the RNN, has…

Machine Learning · Statistics 2021-11-08 Kentaro Ohno , Atsutoshi Kumagai

Socially-intelligent agents are of growing interest in artificial intelligence. To this end, we need systems that can understand social relationships in diverse social contexts. Inferring the social context in a given visual scene not only…

Computer Vision and Pattern Recognition · Computer Science 2019-03-26 Arushi Goel , Keng Teck Ma , Cheston Tan

The recent progress in multi-agent deep reinforcement learning(MADRL) makes it more practical in real-world tasks, but its relatively poor scalability and the partially observable constraints raise challenges to its performance and…

Machine Learning · Computer Science 2021-09-07 Zhenhui Ye , Xiaohong Jiang , Guanghua Song , Bowei Yang

This document presents an in-depth examination of stock market sentiment through the integration of Convolutional Neural Networks (CNN) and Gated Recurrent Units (GRU), enabling precise risk alerts. The robust feature extraction capability…

Machine Learning · Computer Science 2024-12-16 You Wu , Mengfang Sun , Hongye Zheng , Jinxin Hu , Yingbin Liang , Zhenghao Lin

Cross-domain sentiment classification (CDSC) is an importance task in domain adaptation and sentiment classification. Due to the domain discrepancy, a sentiment classifier trained on source domain data may not works well on target domain…

Machine Learning · Computer Science 2019-03-28 Yuebing Zhang , Duoqian Miao , Jiaqi Wang

Long text brings a big challenge to semantic matching due to their complicated semantic and syntactic structures. To tackle the challenge, we consider using prior knowledge to help identify useful information and filter out noise to…

Computation and Language · Computer Science 2016-11-16 Yu Wu , Wei Wu , Zhoujun Li , Ming Zhou

Emotion recognition is a critical task in human-computer interaction, enabling more intuitive and responsive systems. This study presents a multimodal emotion recognition system that combines low-level information from audio and text,…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-23 Shamin Bin Habib Avro , Taieba Taher , Nursadul Mamun

While reasoning over long context is crucial for various real-world applications, it remains challenging for large language models (LLMs) as they suffer from performance degradation as the context length grows. Recent work MemAgent has…

Computation and Language · Computer Science 2026-02-12 Leheng Sheng , Yongtao Zhang , Wenchang Ma , Yaorui Shi , Ting Huang , Xiang Wang , An Zhang , Ke Shen , Tat-Seng Chua