English
Related papers

Related papers: Topic-Driven and Knowledge-Aware Transformer for D…

200 papers

Social chatbots have gained immense popularity, and their appeal lies not just in their capacity to respond to the diverse requests from users, but also in the ability to develop an emotional connection with users. To further develop and…

Computation and Language · Computer Science 2022-06-01 Avinash Madasu , Mauajama Firdaus , Asif Eqbal

Real time nature of social networks with bursty short messages and their respective large data scale spread among vast variety of topics are research interest of many researchers. These properties of social networks which are known as 5'Vs…

Computation and Language · Computer Science 2021-08-05 Meysam Asgari-Chenaghlu , Mohammad-Reza Feizi-Derakhshi , Leili farzinvash , Mohammad-Ali Balafar , Cina Motamed

Emotion recognition from speech is one of the key steps towards emotional intelligence in advanced human-machine interaction. Identifying emotions in human speech requires learning features that are robust and discriminative across diverse…

Audio and Speech Processing · Electrical Eng. & Systems 2019-12-30 Alison Marczewski , Adriano Veloso , Nívio Ziviani

In this paper, we propose a novel time-frequency joint learning method for speech emotion recognition, called Time-Frequency Transformer. Its advantage is that the Time-Frequency Transformer can excavate global emotion patterns in the…

Sound · Computer Science 2023-08-29 Yong Wang , Cheng Lu , Yuan Zong , Hailun Lian , Yan Zhao , Sunan Li

This paper presents an efficient Multi-scale Transformer-based approach for the task of Emotion recognition from Physiological data, which has gained widespread attention in the research community due to the vast amount of information that…

Signal Processing · Electrical Eng. & Systems 2024-08-28 Tu Vu , Van Thong Huynh , Soo-Hyung Kim

With the continuous development of deep learning (DL), the task of multimodal dialogue emotion recognition (MDER) has recently received extensive research attention, which is also an essential branch of DL. The MDER aims to identify the…

Computation and Language · Computer Science 2024-09-04 Wei Ai , Yuntao Shou , Tao Meng , Nan Yin , Keqin Li

Understanding and predicting the emotional trajectory in multi-party multi-turn conversations is of great significance. Such information can be used, for example, to generate empathetic response in human-machine interaction or to inform…

Computation and Language · Computer Science 2024-01-02 Enas Altarawneh , Ameeta Agrawal , Michael Jenkin , Manos Papagelis

Deep learning has been applied to achieve significant progress in emotion recognition. Despite such substantial progress, existing approaches are still hindered by insufficient training data, and the resulting models do not generalize well…

Computer Vision and Pattern Recognition · Computer Science 2020-03-26 Dung Nguyen , Sridha Sridharan , Duc Thanh Nguyen , Simon Denman , Son N. Tran , Rui Zeng , Clinton Fookes

Topic drift is a common phenomenon in multi-turn dialogue. Therefore, an ideal dialogue generation models should be able to capture the topic information of each context, detect the relevant context, and produce appropriate responses…

Computation and Language · Computer Science 2020-09-29 Hainan Zhang , Yanyan Lan , Liang Pang , Hongshen Chen , Zhuoye Ding , Dawei Yin

Empathetic conversation is a crucial characteristic in daily conversations between individuals. Nowadays, Large Language models (LLMs) have shown outstanding performance in generating empathetic responses. Knowledge bases like COMET can…

Computation and Language · Computer Science 2024-12-10 Huiying Cao , Yiqun Zhang , Shi Feng , Xiaocui Yang , Daling Wang , Yifei Zhang

Emotion dynamics modeling is a significant task in emotion recognition in conversation. It aims to predict conversational emotions when building empathetic dialogue systems. Existing studies mainly develop models based on Recurrent Neural…

Artificial Intelligence · Computer Science 2021-04-22 Haiqin Yang , Jianping Shen

This research presents a hybrid emotion recognition system integrating advanced Deep Learning, Natural Language Processing (NLP), and Large Language Models (LLMs) to analyze audio and textual data for enhancing customer interactions in…

Computation and Language · Computer Science 2025-03-31 Sahan Hewage Wewelwala , T. G. D. K. Sumanathilaka

Accurately detecting emotions in conversation is a necessary yet challenging task due to the complexity of emotions and dynamics in dialogues. The emotional state of a speaker can be influenced by many different factors, such as…

Computation and Language · Computer Science 2023-02-07 Jiachen Luo , Huy Phan , Joshua Reiss

Multimodal emotion recognition (MER) aims to detect the emotional status of a given expression by combining the speech and text information. Intuitively, label information should be capable of helping the model locate the salient…

Computation and Language · Computer Science 2023-09-06 Peiying Wang , Sunlu Zeng , Junqing Chen , Lu Fan , Meng Chen , Youzheng Wu , Xiaodong He

In this paper, we propose an end-to-end sentiment-aware conversational agent based on two models: a reply sentiment prediction model, which leverages the context of the dialogue to predict an appropriate sentiment for the agent to express…

Computation and Language · Computer Science 2022-07-26 Isabel Dias , Ricardo Rei , Patrícia Pereira , Luisa Coheur

Emotion Recognition in Conversation (ERC) plays a crucial role in enabling dialogue systems to effectively respond to user requests. The emotions in a conversation can be identified by the representations from various modalities, such as…

Computation and Language · Computer Science 2024-04-02 Taeyang Yun , Hyunkuk Lim , Jeonghwan Lee , Min Song

Empathetic speech dialogue requires not only understanding linguistic content but also perceiving rich paralinguistic information such as prosody, tone, and emotional intensity for affective understandings. Existing speech-to-speech large…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-26 Zhuoyue Gao , Xiaohui Wang , Xiaocui Yang , Wen Zhang , Daling Wang , Shi Feng , Yifei Zhang

Emotion recognition in conversation (ERC) has been attracting attention by methods for modeling multi-turn contexts. The multi-turn input to a pretraining model implicitly assumes that the current turn and other turns are distinguished…

Computation and Language · Computer Science 2025-01-03 Junya Ono , Hiromi Wakaki

Emotion Recognition in Conversations (ERC) facilitates a deeper understanding of the emotions conveyed by speakers in each utterance within a conversation. Recently, Graph Neural Networks (GNNs) have demonstrated their strengths in…

Computation and Language · Computer Science 2024-12-24 Cuong Tran Van , Thanh V. T. Tran , Van Nguyen , Truong Son Hy

The rise of emergence of social media platforms has fundamentally altered how people communicate, and among the results of these developments is an increase in online use of abusive content. Therefore, automatically detecting this content…

Computation and Language · Computer Science 2023-02-20 Khouloud Mnassri , Praboda Rajapaksha , Reza Farahbakhsh , Noel Crespi