English
Related papers

Related papers: A Multimodal LSTM for Predicting Listener Empathic…

200 papers

Social interactions promote well-being, yet barriers like geographic distance, time limitations, and mental health conditions can limit face-to-face interactions. Emotionally responsive AI systems, such as chatbots, offer new opportunities…

Human-Computer Interaction · Computer Science 2025-10-28 Mahnaz Roshanaei , Rezvaneh Rezapour , Magy Seif El-Nasr

Emotion recognition from electroencephalogram (EEG) signals is a thriving field, particularly in neuroscience and Human-Computer Interaction (HCI). This study aims to understand and improve the predictive accuracy of emotional state…

Machine Learning · Computer Science 2025-08-13 Shyam K Sateesh , Sparsh BK , Uma D

Human verbal communication includes affective messages which are conveyed through use of emotionally colored words. There has been a lot of research in this direction but the problem of integrating state-of-the-art neural language models…

Computation and Language · Computer Science 2017-04-25 Sayan Ghosh , Mathieu Chollet , Eugene Laksana , Louis-Philippe Morency , Stefan Scherer

Large language models (LLMs) excel at generating empathic responses in text-based conversations. But, how reliably do they judge the nuances of empathic communication? We investigate this question by comparing how experts, crowdworkers, and…

Computation and Language · Computer Science 2025-10-06 Aakriti Kumar , Nalin Poungpeth , Diyi Yang , Erina Farrell , Bruce Lambert , Matthew Groh

Emotion recognition has a pivotal role in affective computing and in human-computer interaction. The current technological developments lead to increased possibilities of collecting data about the emotional state of a person. In general,…

Computer Vision and Pattern Recognition · Computer Science 2020-07-10 Andreea Birhala , Catalin Nicolae Ristea , Anamaria Radoi , Liviu Cristian Dutu

Empathetic dialogue is an indispensable part of building harmonious social relationships and contributes to the development of a helpful AI. Previous approaches are mainly based on fine small-scale language models. With the advent of…

Computation and Language · Computer Science 2024-07-29 Yushan Qian , Wei-Nan Zhang , Ting Liu

Compared to traditional sentiment analysis, which only considers text, multimodal sentiment analysis needs to consider emotional signals from multimodal sources simultaneously and is therefore more consistent with the way how humans process…

Computation and Language · Computer Science 2024-08-19 Hao Yang , Yanyan Zhao , Yang Wu , Shilong Wang , Tian Zheng , Hongbo Zhang , Zongyang Ma , Wanxiang Che , Bing Qin

Emotion Recognition in Conversation~(ERC) across modalities is of vital importance for a variety of applications, including intelligent healthcare, artificial intelligence for conversation, and opinion mining over chat history. The crux of…

Computation and Language · Computer Science 2023-06-07 Xingwei Liang , You Zou , Ruifeng Xu

Emotion detection techniques have been applied to multiple cases mainly from facial image features and vocal audio features, of which the latter aspect is disputed yet not only due to the complexity of speech audio processing but also the…

Sound · Computer Science 2025-01-22 Qianhe Ouyang

A key trait of daily conversations between individuals is the ability to express empathy towards others, and exploring ways to implement empathy is a crucial step towards human-like dialogue systems. Previous approaches on this topic mainly…

Computation and Language · Computer Science 2023-02-02 Sahand Sabour , Chujie Zheng , Minlie Huang

Empathy plays a pivotal role in fostering prosocial behavior, often triggered by the sharing of personal experiences through narratives. However, modeling empathy using NLP approaches remains challenging due to its deep interconnection with…

Computation and Language · Computer Science 2024-11-01 Muhammad Arslan Manzoor , Yuxia Wang , Minghan Wang , Preslav Nakov

Large Language Models (LLMs) have demonstrated remarkable performance across various information-seeking and reasoning tasks. These computational systems drive state-of-the-art dialogue systems, such as ChatGPT and Bard. They also carry…

Computation and Language · Computer Science 2023-10-13 Siyuan Brandon Loh , Aravind Sesagiri Raamkumar

Based on the WASSA 2022 Shared Task on Empathy Detection and Emotion Classification, we predict the level of empathic concern and personal distress displayed in essays. For the first stage of this project we implemented a Feed-Forward…

Computation and Language · Computer Science 2024-07-29 Manisha Singh , Divy Sharma , Alonso Ma , Nora Goldfine

Recent research shows that greater numbers of people are turning to Large Language Models (LLMs) for emotional support, and that people rate LLM responses as more empathic than human-written responses. We suggest a reason for this success:…

Computation and Language · Computer Science 2026-04-10 Emma Gueorguieva , Hongli Zhan , Jina Suh , Javier Hernandez , Tatiana Lau , Junyi Jessy Li , Desmond C. Ong

This paper builds upon an existing speech emotion recognition model by adding an additional LSTM layer to improve the accuracy and processing efficiency of emotion recognition from audio data. By capturing the long-term dependencies within…

Artificial Intelligence · Computer Science 2024-12-02 Xiaoran Yang , Shuhan Yu , Wenxi Xu

Agents represent one of the most emerging applications of Large Language Models (LLMs) and Generative AI, with their effectiveness hinging on multimodal capabilities to navigate complex user environments. Conversational Health Agents…

Computation and Language · Computer Science 2024-05-09 Mahyar Abbasian , Iman Azimi , Mohammad Feli , Amir M. Rahmani , Ramesh Jain

Human conversation involves language, speech, and visual cues, with each medium providing complementary information. For instance, speech conveys a vibe or tone not fully captured by text alone. While multimodal LLMs focus on generating…

Human-Computer Interaction · Computer Science 2025-09-19 Taesoo Kim , Yongsik Jo , Hyunmin Song , Taehwan Kim

Empathy is critical for effective and satisfactory conversational communication. Prior efforts to measure conversational empathy mostly focus on expressed communicative intents -- that is, the way empathy is expressed. Yet, these works…

Computation and Language · Computer Science 2024-10-15 Zhichao Xu , Jiepu Jiang

Differentiating generated and human-written content is increasingly difficult. We examine how an incentive to convey humanness and task characteristics shape this human vs AI race across five studies. In Study 1-2 (n=530 and n=610) humans…

Computation and Language · Computer Science 2026-01-26 Bennett Kleinberg , Jari Zegers , Jonas Festor , Stefana Vida , Julian Präsent , Riccardo Loconte , Sanne Peereboom

Humans constantly interact with digital devices that disregard their feelings. However, the synergy between human and technology can be strengthened if the technology is able to distinguish and react to human emotions. Models that rely on…

Human-Computer Interaction · Computer Science 2020-05-07 Andrea Kuijt , Maryam Alimardani