English
Related papers

Related papers: Fine-Grained Emotion Prediction by Modeling Emotio…

200 papers

Modern emotion recognition systems are trained to recognize only a small set of emotions, and hence fail to capture the broad spectrum of emotions people experience and express in daily life. In order to engage in more empathetic…

Computation and Language · Computer Science 2021-08-03 Varsha Suresh , Desmond C. Ong

Emojis are a succinct form of language which can express concrete meanings, emotions, and intentions. Emojis also carry signals that can be used to better understand communicative intent. They have become a ubiquitous part of our daily…

Computation and Language · Computer Science 2020-07-16 Weicheng Ma , Ruibo Liu , Lili Wang , Soroush Vosoughi

This paper explores predicting suitable prosodic features for fine-grained emotion analysis from the discourse-level text. To obtain fine-grained emotional prosodic features as predictive values for our model, we extract a phoneme-level…

Sound · Computer Science 2023-09-22 Xianhao Wei , Jia Jia , Xiang Li , Zhiyong Wu , Ziyi Wang

Understanding emotion expressed in language has a wide range of applications, from building empathetic chatbots to detecting harmful online behavior. Advancement in this area can be improved using large-scale datasets with a fine-grained…

Computation and Language · Computer Science 2020-06-04 Dorottya Demszky , Dana Movshovitz-Attias , Jeongwoo Ko , Alan Cowen , Gaurav Nemade , Sujith Ravi

In this paper, we address the problem of multimodal emotion recognition from multiple physiological signals. We demonstrate that a Transformer-based approach is suitable for this task. In addition, we present how such models may be…

Signal Processing · Electrical Eng. & Systems 2022-12-29 Juan Vazquez-Rodriguez , Grégoire Lefebvre , Julien Cumin , James L Crowley

Decoding emotional states from human brain activity plays an important role in brain-computer interfaces. Existing emotion decoding methods still have two main limitations: one is only decoding a single emotion category from a brain…

Signal Processing · Electrical Eng. & Systems 2022-11-07 Kaicheng Fu , Changde Du , Shengpei Wang , Huiguang He

Understanding emotions is fundamental to human interaction and experience. Humans easily infer emotions from situations or facial expressions, situations from emotions, and do a variety of other affective cognition. How adept is modern AI…

Computation and Language · Computer Science 2026-02-18 Kanishk Gandhi , Zoe Lynch , Jan-Philipp Fränken , Kayla Patterson , Sharon Wambu , Tobias Gerstenberg , Desmond C. Ong , Noah D. Goodman

Emotion Classification based on text is a task with many applications which has received growing interest in recent years. This paper presents a preliminary study with the goal to help researchers and practitioners gain insight into…

Computation and Language · Computer Science 2023-03-01 Anna Koufakou , Jairo Garciga , Adam Paul , Joseph Morelli , Christopher Frank

Automatic emotion recognition is one of the central concerns of the Human-Computer Interaction field as it can bridge the gap between humans and machines. Current works train deep learning models on low-level data representations to solve…

Audio and Speech Processing · Electrical Eng. & Systems 2021-11-22 Mariana Rodrigues Makiuchi , Kuniaki Uto , Koichi Shinoda

It is important for machines to interpret human emotions properly for better human-machine communications, as emotion is an essential part of human-to-human communications. One aspect of emotion is reflected in the language we use. How to…

Computation and Language · Computer Science 2018-08-23 Ji Ho Park

Multimodal emotion understanding requires effective integration of text, audio, and visual modalities for both discrete emotion recognition and continuous sentiment analysis. We present EGMF, a unified framework combining expert-guided…

Computation and Language · Computer Science 2026-01-13 Jiaqi Qiao , Xiujuan Xu , Xinran Li , Yu Liu

In this paper, through multi-task ensemble framework we address three problems of emotion and sentiment analysis i.e. "emotion classification & intensity", "valence, arousal & dominance for emotion" and "valence & arousal} for sentiment".…

Computation and Language · Computer Science 2018-10-16 Md Shad Akhtar , Deepanway Ghosal , Asif Ekbal , Pushpak Bhattacharyya , Sadao Kurohashi

Multimodal sentiment analysis is an important area for understanding the user's internal states. Deep learning methods were effective, but the problem of poor interpretability has gradually gained attention. Previous works have attempted to…

Computation and Language · Computer Science 2023-05-15 Sixia Li , Shogo Okada

We propose emotion2vec, a universal speech emotion representation model. emotion2vec is pre-trained on open-source unlabeled emotion data through self-supervised online distillation, combining utterance-level loss and frame-level loss…

Computation and Language · Computer Science 2023-12-27 Ziyang Ma , Zhisheng Zheng , Jiaxin Ye , Jinchao Li , Zhifu Gao , Shiliang Zhang , Xie Chen

Automatic emotion recognition is an active research topic with wide range of applications. Due to the high manual annotation cost and inevitable label ambiguity, the development of emotion recognition dataset is limited in both scale and…

Audio and Speech Processing · Electrical Eng. & Systems 2020-09-08 Jingjun Liang , Ruichen Li , Qin Jin

We present a model to predict fine-grained emotions along the continuous dimensions of valence, arousal, and dominance (VAD) with a corpus with categorical emotion annotations. Our model is trained by minimizing the EMD (Earth Mover's…

Computation and Language · Computer Science 2021-09-13 Sungjoon Park , Jiseon Kim , Seonghyeon Ye , Jaeyeol Jeon , Hee Young Park , Alice Oh

We proposed the industry level deep learning approach for speech emotion recognition task. In industry, carefully proposed deep transfer learning technology shows real results due to mostly low amount of training data availability, machine…

Sound · Computer Science 2021-09-10 Enkhtogtokh Togootogtokh , Christian Klasen

Emotion recognition is a topic of significant interest in assistive robotics due to the need to equip robots with the ability to comprehend human behavior, facilitating their effective interaction in our society. Consequently, efficient and…

Human-Computer Interaction · Computer Science 2023-12-05 Rutherford Agbeshi Patamia , Paulo E. Santos , Kingsley Nketia Acheampong , Favour Ekong , Kwabena Sarpong , She Kun

This paper proposes an effective emotional text-to-speech (TTS) system with a pre-trained language model (LM)-based emotion prediction method. Unlike conventional systems that require auxiliary inputs such as manually defined emotion…

Emotion recognition is a challenging task due to limited availability of in-the-wild labeled datasets. Self-supervised learning has shown improvements on tasks with limited labeled datasets in domains like speech and natural language.…

Computation and Language · Computer Science 2021-04-08 Aparna Khare , Srinivas Parthasarathy , Shiva Sundaram