English
Related papers

Related papers: MONOVAB : An Annotated Corpus for Bangla Multi-lab…

200 papers

Emotion recognition in conversations (ERC) is vital to the advancements of conversational AI and its applications. Therefore, the development of an automated ERC model using the concepts of machine learning (ML) would be beneficial.…

Computation and Language · Computer Science 2023-06-06 Amitabha Dey , Shan Suthaharan

In this paper, we propose MMER, a novel Multimodal Multi-task learning approach for Speech Emotion Recognition. MMER leverages a novel multimodal network based on early-fusion and cross-modal self-attention between text and acoustic…

Computation and Language · Computer Science 2023-06-06 Sreyan Ghosh , Utkarsh Tyagi , S Ramaneswaran , Harshvardhan Srivastava , Dinesh Manocha

Multimodal emotion recognition in conversations aims to infer utterance-level emotions by jointly modeling textual, acoustic, and visual cues within context. Despite recent progress, key challenges remain, including redundant cross-modal…

Sound · Computer Science 2026-04-17 Chengling Guo , Yuntao Shou , Tao Meng , Wei Ai , Yun Tan , Keqin Li

The rapid advancement of social media enables us to analyze user opinions. In recent times, sentiment analysis has shown a prominent research gap in understanding human sentiment based on the content shared on social media. Although…

Computation and Language · Computer Science 2024-03-12 Md Arid Hasan

In recent years, YouTube has become the leading platform for Bangla movies and dramas, where viewers express their opinions in comments that convey their sentiments about the content. However, not all comments are relevant for sentiment…

Computation and Language · Computer Science 2024-12-03 Usafa Akther Rifa , Pronay Debnath , Busra Kamal Rafa , Shamaun Safa Hridi , Md. Aminur Rahman

This paper investigates the relationship between utterance sentiment and language choice in English-Tamil code-switched text, using methods from machine learning and statistical modelling. We apply a fine-tuned XLM-RoBERTa model for…

Computation and Language · Computer Science 2026-03-30 Paul Bontempo

It is important for machines to interpret human emotions properly for better human-machine communications, as emotion is an essential part of human-to-human communications. One aspect of emotion is reflected in the language we use. How to…

Computation and Language · Computer Science 2018-08-23 Ji Ho Park

In recent years, multimodal natural language processing, aimed at learning from diverse data types, has garnered significant attention. However, there needs to be more clarity when it comes to analysing multimodal tasks in multi-lingual…

Computation and Language · Computer Science 2024-06-13 Gaurish Thakkar , Sherzod Hakimov , Marko Tadić

Emotion Recognition in Conversations (ERC) is a key step towards successful human-machine interaction. While the field has seen tremendous advancement in the last few years, new applications and implementation scenarios present novel…

Computation and Language · Computer Science 2024-10-22 Patrícia Pereira , Helena Moniz , Joao Paulo Carvalho

Emotion recognition is a complex task due to the inherent subjectivity in both the perception and production of emotions. The subjectivity of emotions poses significant challenges in developing accurate and robust computational models. This…

Machine Learning · Computer Science 2023-09-08 Mimansa Jaiswal

Speech Emotion Recognition (SER) systems rely on speech input and emotional labels annotated by humans. However, various emotion databases collect perceptional evaluations in different ways. For instance, the IEMOCAP dataset uses video…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-15 Huang-Cheng Chou , Haibin Wu , Hung-yi Lee , Chi-Chun Lee

Multimodal Emotion Recognition (MER) is a critical research area that seeks to decode human emotions from diverse data modalities. However, existing machine learning methods predominantly rely on predefined emotion taxonomies, which fail to…

Human-Computer Interaction · Computer Science 2025-05-08 Zheng Lian , Haiyang Sun , Licai Sun , Haoyu Chen , Lan Chen , Hao Gu , Zhuofan Wen , Shun Chen , Siyuan Zhang , Hailiang Yao , Bin Liu , Rui Liu , Shan Liang , Ya Li , Jiangyan Yi , Jianhua Tao

Multi-emotion sentiment classification is a natural language processing (NLP) problem with valuable use cases on real-world data. We demonstrate that large-scale unsupervised language modeling combined with finetuning offers a practical…

Computation and Language · Computer Science 2018-12-05 Neel Kant , Raul Puri , Nikolai Yakovenko , Bryan Catanzaro

The portrayal of negative emotions such as anger can vary widely between cultures and contexts, depending on the acceptability of expressing full-blown emotions rather than suppression to maintain harmony. The majority of emotional datasets…

Computer Vision and Pattern Recognition · Computer Science 2021-12-13 Roya Javadi , Angelica Lim

Multimodal emotion recognition (MER), leveraging speech and text, has emerged as a pivotal domain within human-computer interaction, demanding sophisticated methods for effective multimodal integration. The challenge of aligning features…

Audio and Speech Processing · Electrical Eng. & Systems 2024-12-31 Xuechen Wang , Shiwan Zhao , Haoqin Sun , Hui Wang , Jiaming Zhou , Yong Qin

Multilingual speakers often switch between languages to express themselves on social communication platforms. Sometimes, the original script of the language is preserved, while using a common script for all the languages is quite popular as…

Computation and Language · Computer Science 2018-03-19 Soumil Mandal , Dipankar Das

Sentiment analysis is the computational study of opinions and emotions ex-pressed in text. Deep learning is a model that is currently producing state-of-the-art in various application domains, including sentiment analysis. Many researchers…

Computation and Language · Computer Science 2022-11-11 Hendri Murfi , Syamsyuriani , Theresia Gowandi , Gianinna Ardaneswari , Siti Nurrohmah

Emotion recognition is a critical task in human-computer interaction, enabling more intuitive and responsive systems. This study presents a multimodal emotion recognition system that combines low-level information from audio and text,…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-23 Shamin Bin Habib Avro , Taieba Taher , Nursadul Mamun

Text emotion detection constitutes a crucial foundation for advancing artificial intelligence from basic comprehension to the exploration of emotional reasoning. Most existing emotion detection datasets rely on manual annotations, which are…

Computation and Language · Computer Science 2025-11-25 Jingyi Zhou , Senlin Luo , Haofan Chen

Nowadays, the automatic detection of emotions is employed by many applications in different fields like security informatics, e-learning, humor detection, targeted advertising, etc. Many of these applications focus on social media and treat…

Computation and Language · Computer Science 2019-02-27 Wegdan Hussien , Mahmoud Al-Ayyoub , Yahya Tashtoush , Mohammed Al-Kabi