English
Related papers

Related papers: Building a Dialogue Corpus Annotated with Expresse…

200 papers

We address the problem of recognizing emotion cause in conversations, define two novel sub-tasks of this problem, and provide a corresponding dialogue-level dataset, along with strong Transformer-based baselines. The dataset is available at…

In emotion recognition in conversation (ERC), the emotion of the current utterance is predicted by considering the previous context, which can be utilized in many natural language processing tasks. Although multiple emotions can coexist in…

Computation and Language · Computer Science 2022-06-17 Joosung Lee

Research in emotion analysis is scattered across different label formats (e.g., polarity types, basic emotion categories, and affective dimensions), linguistic levels (word vs. sentence vs. discourse), and, of course, (few well-resourced…

Computation and Language · Computer Science 2021-11-09 Sven Buechel , Luise Modersohn , Udo Hahn

In this paper, we describe approaches for developing Emily, an emotion-affective open-domain chatbot. Emily can perceive a user's negative emotion state and offer supports by positively converting the user's emotion states. This is done by…

Computation and Language · Computer Science 2021-09-21 Weixuan Wang , Xiaoling Cai , Chong Hsuan Huang , Haoran Wang , Haonan Lu , Ximing Liu , Wei Peng

Data annotation is an important but time-consuming and costly procedure. To sort a text into two classes, the very first thing we need is a good annotation guideline, establishing what is required to qualify for each class. In the…

Computation and Language · Computer Science 2018-08-16 Imane Guellil , Ahsan Adeel , Faical Azouaou , Amir Hussain

Recognizing emotion from speech has become one the active research themes in speech processing and in applications based on human-computer interaction. This paper conducts an experimental study on recognizing emotions from human speech. The…

Sound · Computer Science 2015-06-24 Assel Davletcharova , Sherin Sugathan , Bibia Abraham , Alex Pappachen James

Appraisal theories explain how the cognitive evaluation of an event leads to a particular emotion. In contrast to theories of basic emotions or affect (valence/arousal), this theory has not received a lot of attention in natural language…

Computation and Language · Computer Science 2021-02-26 Jan Hofmann , Enrica Troiano , Roman Klinger

Prior efforts to create an autonomous computer system capable of predicting what a human being is thinking or feeling from facial expression data have been largely based on outdated, inaccurate models of how emotions work that rely on many…

Artificial Intelligence · Computer Science 2018-08-06 Trevor Buteau , Damian Lyons

In this project, we aim to build a Text-to-Speech system able to produce speech with a controllable emotional expressiveness. We propose a methodology for solving this problem in three main steps. The first is the collection of emotional…

Audio and Speech Processing · Electrical Eng. & Systems 2019-07-08 Noé Tits

Many frameworks for emotional text-to-speech (E-TTS) rely on human-annotated emotion labels that are often inaccurate and difficult to obtain. Learning emotional prosody implicitly presents a tough challenge due to the subjective nature of…

Audio and Speech Processing · Electrical Eng. & Systems 2024-05-21 Shreeram Suresh Chandra , Zongyang Du , Berrak Sisman

Modern day conversational agents are trained to emulate the manner in which humans communicate. To emotionally bond with the user, these virtual agents need to be aware of the affective state of the user. Transformers are the recent state…

Sound · Computer Science 2022-04-26 Raman Goel , Seba Susan , Sachin Vashisht , Armaan Dhanda

We present MEDCOD, a Medically-Accurate, Emotive, Diverse, and Controllable Dialog system with a unique approach to the natural language generator module. MEDCOD has been developed and evaluated specifically for the history taking task. It…

Computation and Language · Computer Science 2021-11-19 Rhys Compton , Ilya Valmianski , Li Deng , Costa Huang , Namit Katariya , Xavier Amatriain , Anitha Kannan

Emotion expression and perception are nuanced, complex, and highly subjective processes. When multiple annotators label emotional data, the resulting labels contain high variability. Most speech emotion recognition tasks address this by…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-16 James Tavernor , Yara El-Tawil , Emily Mower Provost

Emotion Cause Extraction in Conversations (ECEC) aims to extract the utterances which contain the emotional cause in conversations. Most prior research focuses on modelling conversational contexts with sequential encoding, ignoring the…

Computation and Language · Computer Science 2022-10-27 Dexin Kong , Nan Yu , Yun Yuan , Guohong Fu , Chen Gong

Open-domain conversational agents or chatbots are becoming increasingly popular in the natural language processing community. One of the challenges is enabling them to converse in an empathetic manner. Current neural response generation…

Computation and Language · Computer Science 2020-12-09 Anuradha Welivita , Pearl Pu

Emotional concepts play a huge role in our daily life since they take part into many cognitive processes: from the perception of the environment around us to different learning processes and natural communication. Social robots need to…

Neural and Evolutionary Computing · Computer Science 2018-08-02 Pablo Barros , Emilia Barakova , Stefan Wermter

In current text-based task-oriented dialogue (TOD) systems, user emotion detection (ED) is often overlooked or is typically treated as a separate and independent task, requiring additional training. In contrast, our work demonstrates that…

Computation and Language · Computer Science 2024-07-01 Armand Stricker , Patrick Paroubek

Emotion perception and adaptive expression are fundamental capabilities in human-agent interaction. While recent advances in speech emotion captioning (SEC) have improved fine-grained emotional modeling, existing systems remain limited to…

Computation and Language · Computer Science 2026-04-30 Shuhao Xu , Yifan Hu , Jingjing Wu , Zhihao Du , Zheng Lian , Rui Liu

Human emotion is expressed in many communication modalities and media formats and so their computational study is equally diversified into natural language processing, audio signal analysis, computer vision, etc. Similarly, the large…

Machine Learning · Computer Science 2023-08-16 Sven Buechel , Udo Hahn

Emotion recognition and sentiment analysis are pivotal tasks in speech and language processing, particularly in real-world scenarios involving multi-party, conversational data. This paper presents a multimodal approach to tackle these…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Aref Farhadipour , Hossein Ranjbar , Masoumeh Chapariniya , Teodora Vukovic , Sarah Ebling , Volker Dellwo