English
Related papers

Related papers: Exploiting Unsupervised Data for Emotion Recogniti…

200 papers

Multimodal Language Analysis is a demanding area of research, since it is associated with two requirements: combining different modalities and capturing temporal information. During the last years, several works have been proposed in the…

Computation and Language · Computer Science 2022-01-10 Panagiotis Koromilas , Theodoros Giannakopoulos

Speech Emotion Recognition (SER) aims to help the machine to understand human's subjective emotion from only audio information. However, extracting and utilizing comprehensive in-depth audio information is still a challenging task. In this…

Sound · Computer Science 2022-03-30 Heqing Zou , Yuke Si , Chen Chen , Deepu Rajan , Eng Siong Chng

Emotion perception and adaptive expression are fundamental capabilities in human-agent interaction. While recent advances in speech emotion captioning (SEC) have improved fine-grained emotional modeling, existing systems remain limited to…

Computation and Language · Computer Science 2026-04-30 Shuhao Xu , Yifan Hu , Jingjing Wu , Zhihao Du , Zheng Lian , Rui Liu

We propose a novel multi-task pre-training method for Speech Emotion Recognition (SER). We pre-train SER model simultaneously on Automatic Speech Recognition (ASR) and sentiment classification tasks to make the acoustic ASR model more…

Computation and Language · Computer Science 2022-01-31 Ayoub Ghriss , Bo Yang , Viktor Rozgic , Elizabeth Shriberg , Chao Wang

Speech emotion recognition is a challenging task and an important step towards more natural human-machine interaction. We show that pre-trained language models can be fine-tuned for text emotion recognition, achieving an accuracy of 69.5%…

Audio and Speech Processing · Electrical Eng. & Systems 2019-12-06 Verena Heusser , Niklas Freymuth , Stefan Constantin , Alex Waibel

Emotional voice conversion (EVC) traditionally targets the transformation of spoken utterances from one emotional state to another, with previous research mainly focusing on discrete emotion categories. This paper departs from the norm by…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-19 Kun Zhou , Berrak Sisman , Carlos Busso , Bin Ma , Haizhou Li

Speech encodes a wealth of information related to human behavior and has been used in a variety of automated behavior recognition tasks. However, extracting behavioral information from speech remains challenging including due to inadequate…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-09 Haoqi Li , Brian Baucom , Shrikanth Narayanan , Panayiotis Georgiou

Conversational Speech Synthesis (CSS) aims to accurately express an utterance with the appropriate prosody and emotional inflection within a conversational setting. While recognising the significance of CSS task, the prior studies have not…

Computation and Language · Computer Science 2023-12-20 Rui Liu , Yifan Hu , Yi Ren , Xiang Yin , Haizhou Li

E-commerce query understanding is the process of inferring the shopping intent of customers by extracting semantic meaning from their search queries. The recent progress of pre-trained masked language models (MLM) in natural language…

Computation and Language · Computer Science 2022-10-11 Haoming Jiang , Tianyu Cao , Zheng Li , Chen Luo , Xianfeng Tang , Qingyu Yin , Danqing Zhang , Rahul Goutam , Bing Yin

In this paper, we introduce the task of learning unsupervised dialogue embeddings. Trivial approaches such as combining pre-trained word or sentence embeddings and encoding through pre-trained language models (PLMs) have been shown to be…

Computation and Language · Computer Science 2022-10-28 Che Liu , Rui Wang , Junfeng Jiang , Yongbin Li , Fei Huang

Emotion detection in dialogues is challenging as it often requires the identification of thematic topics underlying a conversation, the relevant commonsense knowledge, and the intricate transition patterns between the affective states. In…

Computation and Language · Computer Science 2021-06-03 Lixing Zhu , Gabriele Pergola , Lin Gui , Deyu Zhou , Yulan He

Several recent studies on dyadic human-human interactions have been done on conversations without specific business objectives. However, many companies might benefit from studies dedicated to more precise environments such as after sales…

Computation and Language · Computer Science 2021-09-21 Gaël Guibon , Matthieu Labeau , Hélène Flamein , Luce Lefeuvre , Chloé Clavel

The ability to understand emotions is an essential component of human-like artificial intelligence, as emotions greatly influence human cognition, decision making, and social interactions. In addition to emotion recognition in…

Computation and Language · Computer Science 2024-07-09 Fanfan Wang , Heqing Ma , Jianfei Yu , Rui Xia , Erik Cambria

Current facial emotion recognition systems are predominately trained to predict a fixed set of predefined categories or abstract dimensional values. This constrained form of supervision hinders generalization and applicability, as it…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Licai Sun , Xingxun Jiang , Haoyu Chen , Yante Li , Zheng Lian , Biu Liu , Yuan Zong , Wenming Zheng , Jukka M. Leppänen , Guoying Zhao

Emotion Recognition in Conversation (ERC) has attracted growing attention in recent years as a result of the advancement and implementation of human-computer interface technologies. In this paper, we propose an emotional inertia and…

Computation and Language · Computer Science 2024-03-21 Yingjian Liu , Jiang Li , Xiaoping Wang , Zhigang Zeng

Speech is the most natural way of expressing ourselves as humans. Identifying emotion from speech is a nontrivial task due to the ambiguous definition of emotion itself. Speaker Emotion Recognition (SER) is essential for understanding human…

Sound · Computer Science 2024-11-07 Pourya Jafarzadeh , Amir Mohammad Rostami , Padideh Choobdar

Multi-emotion sentiment classification is a natural language processing (NLP) problem with valuable use cases on real-world data. We demonstrate that large-scale unsupervised language modeling combined with finetuning offers a practical…

Computation and Language · Computer Science 2018-12-05 Neel Kant , Raul Puri , Nikolai Yakovenko , Bryan Catanzaro

Achieving empathy is a crucial step toward humanized dialogue systems. Current approaches for empathetic dialogue generation mainly perceive an emotional label to generate an empathetic response conditioned on it, which simply treat…

Computation and Language · Computer Science 2023-11-28 Fengyi Fu , Lei Zhang , Quan Wang , Zhendong Mao

This paper describes EmoRAG, a system designed to detect perceived emotions in text for SemEval-2025 Task 11, Subtask A: Multi-label Emotion Detection. We focus on predicting the perceived emotions of the speaker from a given text snippet,…

Computation and Language · Computer Science 2025-06-06 Lev Morozov , Aleksandr Mogilevskii , Alexander Shirnin

Despite recent success in machine reading comprehension (MRC), learning high-quality MRC models still requires large-scale labeled training data, even using strong pre-trained language models (PLMs). The pre-training tasks for PLMs are not…

Computation and Language · Computer Science 2021-07-20 Ning Bian , Xianpei Han , Bo Chen , Hongyu Lin , Ben He , Le Sun