English
Related papers

Related papers: EmotionX-IDEA: Emotion BERT -- an Affectional Mode…

200 papers

In dialogue systems, utterances with similar semantics may have distinctive emotions under different contexts. Therefore, modeling long-range contextual emotional relationships with speaker dependency plays a crucial part in dialogue…

Computation and Language · Computer Science 2022-01-25 Shimin Li , Hang Yan , Xipeng Qiu

Annotated data have traditionally been used to provide the input for training a supervised machine learning (ML) model. However, current pre-trained ML models for natural language processing (NLP) contain embedded linguistic information…

Computation and Language · Computer Science 2022-04-05 Abe Kazemzadeh

We propose a novel transfer learning method for speech emotion recognition allowing us to obtain promising results when only few training data is available. With as low as 125 examples per emotion class, we were able to reach a higher…

Machine Learning · Computer Science 2020-11-12 Jonathan Boigne , Biman Liyanage , Ted Östrem

We introduce a new language representation model called BERT, which stands for Bidirectional Encoder Representations from Transformers. Unlike recent language representation models, BERT is designed to pre-train deep bidirectional…

Computation and Language · Computer Science 2019-05-28 Jacob Devlin , Ming-Wei Chang , Kenton Lee , Kristina Toutanova

Current language models are usually trained using a self-supervised scheme, where the main focus is learning representations at the word or sentence level. However, there has been limited progress in generating useful discourse-level…

Computation and Language · Computer Science 2021-09-13 Vladimir Araujo , Andrés Villa , Marcelo Mendoza , Marie-Francine Moens , Alvaro Soto

How romantic partners interact with each other during a conflict influences how they feel at the end of the interaction and is predictive of whether the partners stay together in the long term. Hence understanding the emotions of each…

Computation and Language · Computer Science 2021-09-21 George Boateng , Peter Hilpert , Guy Bodenmann , Mona Neysari , Tobias Kowatsch

Recently, pre-trained models have been the dominant paradigm in natural language processing. They achieved remarkable state-of-the-art performance across a wide range of related tasks, such as textual entailment, natural language inference,…

Computation and Language · Computer Science 2019-05-21 Dongfang Li , Yifei Yu , Qingcai Chen , Xinyu Li

Affect preferences vary with user demographics, and tapping into demographic information provides important cues about the users' language preferences. In this paper, we utilize the user demographics, and propose EmpathBERT, a…

Machine Learning · Computer Science 2021-02-02 Bhanu Prakash Reddy Guda , Aparna Garimella , Niyati Chhaya

Messages in human conversations inherently convey emotions. The task of detecting emotions in textual conversations leads to a wide range of applications such as opinion mining in social networks. However, enabling machines to analyze…

Computation and Language · Computer Science 2019-10-02 Peixiang Zhong , Di Wang , Chunyan Miao

Recent advances in pre-trained language models have significantly improved neural response generation. However, existing methods usually view the dialogue context as a linear sequence of tokens and learn to generate the next word through…

Computation and Language · Computer Science 2021-12-14 Xiaodong Gu , Kang Min Yoo , Jung-Woo Ha

Pre-trained model representations have demonstrated state-of-the-art performance in speech recognition, natural language processing, and other applications. Speech models, such as Bidirectional Encoder Representations from Transformers…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-07 Vikramjit Mitra , Vasudha Kowtha , Hsiang-Yun Sherry Chien , Erdrin Azemi , Carlos Avendano

Human use language not just to convey information but also to express their inner feelings and mental states. In this work, we adapt the state-of-the-art language generation models to generate affective (emotional) text. We posit a model…

Computation and Language · Computer Science 2020-11-10 Ishika Singh , Ahsan Barkati , Tushar Goswamy , Ashutosh Modi

Emotion recognition in conversation, which aims to predict the emotion for all utterances, has attracted considerable research attention in recent years. It is a challenging task since the recognition of the emotion in one utterance…

Computation and Language · Computer Science 2023-06-13 Ting Zhang , Zhuang Chen , Ming Zhong , Tieyun Qian

Emojis are a succinct form of language which can express concrete meanings, emotions, and intentions. Emojis also carry signals that can be used to better understand communicative intent. They have become a ubiquitous part of our daily…

Computation and Language · Computer Science 2020-07-16 Weicheng Ma , Ruibo Liu , Lili Wang , Soroush Vosoughi

Multimodal emotion recognition study is hindered by the lack of labelled corpora in terms of scale and diversity, due to the high annotation cost and label ambiguity. In this paper, we propose a pre-training model \textbf{MEmoBERT} for…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Jinming Zhao , Ruichen Li , Qin Jin , Xinchao Wang , Haizhou Li

Recognizing emotions in conversations is a challenging task due to the presence of contextual dependencies governed by self- and inter-personal influences. Recent approaches have focused on modeling these dependencies primarily via…

Computation and Language · Computer Science 2020-05-21 Devamanyu Hazarika , Soujanya Poria , Roger Zimmermann , Rada Mihalcea

Representations derived from models such as BERT (Bidirectional Encoder Representations from Transformers) and HuBERT (Hidden units BERT), have helped to achieve state-of-the-art performance in dimensional speech emotion recognition.…

Sound · Computer Science 2023-12-29 Vikramjit Mitra , Jingping Nie , Erdrin Azemi

This paper addresses the problem of modeling textual conversations and detecting emotions. Our proposed model makes use of 1) deep transfer learning rather than the classical shallow methods of word embedding; 2) self-attention mechanisms…

Computation and Language · Computer Science 2019-06-18 Waleed Ragheb , Jérôme Azé , Sandra Bringay , Maximilien Servajean

Pre-training a transformer-based model for the language modeling task in a large dataset and then fine-tuning it for downstream tasks has been found very useful in recent years. One major advantage of such pre-trained language models is…

Computation and Language · Computer Science 2020-11-17 Md Tahmid Rahman Laskar , Enamul Hoque , Jimmy Xiangji Huang

In this paper, we investigate the modeling power of contextualized embeddings from pre-trained language models, e.g. BERT, on the E2E-ABSA task. Specifically, we build a series of simple yet insightful neural baselines to deal with…

Computation and Language · Computer Science 2019-10-07 Xin Li , Lidong Bing , Wenxuan Zhang , Wai Lam