English
Related papers

Related papers: MELT: Towards Automated Multimodal Emotion Data An…

200 papers

Traditional approaches in speech emotion recognition, such as LSTM, CNN, RNN, SVM, and MLP, have limitations such as difficulty capturing long-term dependencies in sequential data, capturing the temporal dynamics, and struggling to capture…

Sound · Computer Science 2023-08-10 Samiul Islam , Md. Maksudul Haque , Abu Jobayer Md. Sadat

After the inception of emotion recognition or affective computing, it has increasingly become an active research topic due to its broad applications. Over the past couple of decades, emotion recognition models have gradually migrated from…

Computation and Language · Computer Science 2023-08-23 Zixing Zhang , Liyizhe Peng , Tao Pang , Jing Han , Huan Zhao , Bjorn W. Schuller

Dog emotion recognition plays a crucial role in enhancing human-animal interactions, veterinary care, and the development of automated systems for monitoring canine well-being. However, accurately interpreting dog emotions is challenging…

Computer Vision and Pattern Recognition · Computer Science 2026-02-18 Jinho Baek , Houwei Cao , Kate Blackwell

Multi-modal large language models have demonstrated impressive performances on most vision-language tasks. However, the model generally lacks the understanding capabilities for specific domain data, particularly when it comes to…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Yucheng Han , Chi Zhang , Xin Chen , Xu Yang , Zhibin Wang , Gang Yu , Bin Fu , Hanwang Zhang

Speech Emotion Recognition (SER) systems rely on speech input and emotional labels annotated by humans. However, various emotion databases collect perceptional evaluations in different ways. For instance, the IEMOCAP dataset uses video…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-15 Huang-Cheng Chou , Haibin Wu , Hung-yi Lee , Chi-Chun Lee

Understanding emotion expressed in language has a wide range of applications, from building empathetic chatbots to detecting harmful online behavior. Advancement in this area can be improved using large-scale datasets with a fine-grained…

Computation and Language · Computer Science 2020-06-04 Dorottya Demszky , Dana Movshovitz-Attias , Jeongwoo Ko , Alan Cowen , Gaurav Nemade , Sujith Ravi

Recently, Multimodal Large Language Models (MLLMs) have achieved exceptional performance across diverse tasks, continually surpassing previous expectations regarding their capabilities. Nevertheless, their proficiency in perceiving emotions…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Daiqing Wu , Dongbao Yang , Sicheng Zhao , Can Ma , Yu Zhou

Most datasets for sentiment analysis lack context in which an opinion was expressed, often crucial for emotion understanding, and are mainly limited by a few emotion categories. Foundation large language models (LLMs) like GPT-4 suffer from…

Computation and Language · Computer Science 2025-04-24 Alexander Shvets

Although Large Audio-Language Models (LALMs) have exhibited outstanding performance in auditory understanding, their performance in affective computing scenarios, particularly in emotion recognition, reasoning, and subtle sentiment…

Sound · Computer Science 2025-09-23 Pengcheng Li , Botao Zhao , Zuheng Kang , Junqing Peng , Xiaoyang Qu , Yayun He , Jianzong Wang

Speech Large Language Models (SLLMs) enable high-level emotion reasoning but often produce ungrounded, text-biased judgments without verifiable acoustic evidence. In contrast, self-supervised speech encoders such as WavLM provide strong…

Machine Learning · Computer Science 2026-02-16 Esther Sun , Bo-Hao Su , Abinay Reddy Naini , Shinji Watanabe , Carlos Busso

Recent research has explored methods for updating and modifying factual knowledge in large language models, often focusing on specific multi-layer perceptron blocks. This study expands on this work by examining the effectiveness of existing…

Computation and Language · Computer Science 2025-02-05 Daniel Tamayo , Aitor Gonzalez-Agirre , Javier Hernando , Marta Villegas

In the era of increasingly sophisticated natural language processing (NLP) systems, large language models (LLMs) have demonstrated remarkable potential for diverse applications, including tasks requiring nuanced textual understanding and…

Computation and Language · Computer Science 2025-05-16 Poli Apollinaire Nemkova , Solomon Ubani , Mark V. Albert

Speech emotion recognition (SER) is crucial for enhancing affective computing and enriching the domain of human-computer interaction. However, the main challenge in SER lies in selecting relevant feature representations from speech signals…

Sound · Computer Science 2024-12-16 Niloy Kumar Kundu , Sarah Kobir , Md. Rayhan Ahmed , Tahmina Aktar , Niloya Roy

Patient experience and care quality are crucial for a hospital's sustainability and reputation. The analysis of patient feedback offers valuable insight into patient satisfaction and outcomes. However, the unstructured nature of these…

Computation and Language · Computer Science 2025-02-21 Hajar Sakai , Sarah S. Lam , Mohammadsadegh Mikaeili , Joshua Bosire , Franziska Jovin

The integration of emotional support into various conversational scenarios presents profound societal benefits, such as social interactions, mental health counseling, and customer service. However, there are unsolved challenges that hinder…

Computation and Language · Computer Science 2023-08-23 Zhonghua Zheng , Lizi Liao , Yang Deng , Liqiang Nie

This paper proposes an effective emotional text-to-speech (TTS) system with a pre-trained language model (LM)-based emotion prediction method. Unlike conventional systems that require auxiliary inputs such as manually defined emotion…

Tracking how data is mentioned and used in research papers provides critical insights for improving data discoverability, quality, and production. However, manually identifying and classifying dataset mentions across vast academic…

Computation and Language · Computer Science 2025-02-17 Aivin V. Solatorio , Rafael Macalaba , James Liounis

Emotion recognition in text, the task of identifying emotions such as joy or anger, is a challenging problem in NLP with many applications. One of the challenges is the shortage of available datasets that have been annotated with emotions.…

Computation and Language · Computer Science 2023-10-31 Anna Koufakou , Diego Grisales , Ragy Costa de jesus , Oscar Fox

Multimodal emotion recognition (MER) seeks to integrate various modalities to predict emotional states accurately. However, most current research focuses solely on the fusion of audio and text features, overlooking the valuable information…

Sound · Computer Science 2025-04-08 Xuechun Shao , Yinfeng Yu , Liejun Wang

Large language models (LLMs) are increasingly positioned as scalable tools for annotating educational data, including classroom discourse, interaction logs, and qualitative learning artifacts. Their ability to rapidly summarize…

Artificial Intelligence · Computer Science 2026-03-17 Bakhtawar Ahtisham , Kirk Vanacore , Rene F. Kizilcec