English
Related papers

Related papers: EmoVerse: Exploring Multimodal Large Language Mode…

200 papers

Emotions are experienced and expressed differently across the world. In order to use Large Language Models (LMs) for multilingual tasks that require emotional sensitivity, LMs must reflect this cultural variation in emotion. In this study,…

Computation and Language · Computer Science 2023-07-11 Shreya Havaldar , Sunny Rai , Bhumika Singhal , Langchen Liu , Sharath Chandra Guntuku , Lyle Ungar

Multimodal sentiment analysis, a pivotal task in affective computing, seeks to understand human emotions by integrating cues from language, audio, and visual signals. While many recent approaches leverage complex attention mechanisms and…

Computation and Language · Computer Science 2025-05-09 Nischal Mandal , Yang Li

Emotion recognition has become an important field of research in Human Computer Interactions as we improve upon the techniques for modelling the various aspects of behaviour. With the advancement of technology our understanding of emotions…

Artificial Intelligence · Computer Science 2019-11-11 Samarth Tripathi , Sarthak Tripathi , Homayoon Beigi

Understanding how visual content conveys sentiment is increasingly important in a digital landscape dominated by imagery. However, sentiment perception depends on complex scene-level semantics, making this a challenging task for…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Neemias B. da Silva , John Harrison , Rodrigo Minetto , Myriam R. Delgado , Bogdan T. Nassu , Thiago H. Silva

LLM-based multimodal emotion recognition relies on static parametric memory and often hallucinates when interpreting nuanced affective states. In this paper, given that single-round retrieval-augmented generation is highly susceptible to…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Zeheng Wang , Zitong Yu , Yijie Zhu , Bo Zhao , Haochen Liang , Taorui Wang , Wei Xia , Jiayu Zhang , Zhishu Liu , Hui Ma , Fei Ma , Qi Tian

The advent of large language models (LLMs) has gained tremendous attention over the past year. Previous studies have shown the astonishing performance of LLMs not only in other tasks but also in emotion recognition in terms of accuracy,…

Computation and Language · Computer Science 2023-10-24 Liyizhe Peng , Zixing Zhang , Tao Pang , Jing Han , Huan Zhao , Hao Chen , Björn W. Schuller

Multimodal Emotion Recognition refers to the classification of input video sequences into emotion labels based on multiple input modalities (usually video, audio and text). In recent years, Deep Neural networks have shown remarkable…

Machine Learning · Computer Science 2024-10-28 Ashish Ramayee Asokan , Nidarshan Kumar , Anirudh Venkata Ragam , Shylaja S Sharath

The advent of large language models (LLMs) such as ChatGPT has attracted considerable attention in various domains due to their remarkable performance and versatility. As the use of these models continues to grow, the importance of…

Neural and Evolutionary Computing · Computer Science 2024-01-19 Jill Baumann , Oliver Kramer

Understanding emotions in natural language is inherently a multi-dimensional reasoning problem, where multiple affective signals interact through context, interpersonal relations, and situational cues. However, most existing emotion…

Computation and Language · Computer Science 2026-04-02 Hemanth Kotaprolu , Kishan Maharaj , Raey Zhao , Abhijit Mishra , Pushpak Bhattacharyya

In the context of today's high-pressure, aging society, the demand for large-scale emotional models capable of providing empathetic support is more critical than ever. However, existing benchmarks fail to simultaneously achieve ecological…

Computation and Language · Computer Science 2026-05-12 Pengze Guo , Jingxi Liang , Zhiwen Xie , Qifeng Wang , Derek F. Wong

Most existing emotion analysis emphasizes which emotion arises (e.g., happy, sad, angry) but neglects the deeper why. We propose Emotion Interpretation (EI), focusing on causal factors-whether explicit (e.g., observable objects,…

Artificial Intelligence · Computer Science 2025-04-18 Yuxiang Lin , Jingdong Sun , Zhi-Qi Cheng , Jue Wang , Haomin Liang , Zebang Cheng , Yifei Dong , Jun-Yan He , Xiaojiang Peng , Xian-Sheng Hua

In recent years, Affective Computing and its applications have become a fast-growing research topic. Furthermore, the rise of Deep Learning has introduced significant improvements in the emotion recognition system compared to classical…

Computer Vision and Pattern Recognition · Computer Science 2020-01-22 Joaquim Comas , Decky Aspandi , Xavier Binefa

Emotion recognition in speech is a challenging multimodal task that requires understanding both verbal content and vocal nuances. This paper introduces a novel approach to emotion detection using Large Language Models (LLMs), which have…

Computation and Language · Computer Science 2024-12-24 Zehui Wu , Ziwei Gong , Lin Ai , Pengyuan Shi , Kaan Donbekci , Julia Hirschberg

Large Language Models primarily operate through text-based inputs and outputs, yet human emotion is communicated through both verbal and non-verbal cues, including facial expressions. While Vision-Language Models analyze facial expressions…

Computer Vision and Pattern Recognition · Computer Science 2025-02-12 Vaibhav Mehra , Guy Laban , Hatice Gunes

MER2025 is the third year of our MER series of challenges, aiming to bring together researchers in the affective computing community to explore emerging trends and future directions in the field. Previously, MER2023 focused on multi-label…

Personality detection from text is commonly performed by analysing users' social media posts. However, existing methods heavily rely on large-scale annotated datasets, making it challenging to obtain high-quality personality labels.…

Computation and Language · Computer Science 2025-09-03 Lingzhi Shen , Xiaohao Cai , Yunfei Long , Imran Razzak , Guanming Chen , Shoaib Jameel

Multimodal Large Language Model (MLLM) relies on the powerful LLM to perform multimodal tasks, showing amazing emergent abilities in recent studies, such as writing poems based on an image. However, it is difficult for these case studies to…

Computer Vision and Pattern Recognition · Computer Science 2025-10-27 Chaoyou Fu , Peixian Chen , Yunhang Shen , Yulei Qin , Mengdan Zhang , Xu Lin , Jinrui Yang , Xiawu Zheng , Ke Li , Xing Sun , Yunsheng Wu , Rongrong Ji , Caifeng Shan , Ran He

Depressive and anxiety disorders are widespread, necessitating timely identification and management. Recent advances in Large Language Models (LLMs) offer potential solutions, yet high costs and ethical concerns about training data remain…

Computation and Language · Computer Science 2025-01-28 June M. Liu , Mengxia Gao , Sahand Sabour , Zhuang Chen , Minlie Huang , Tatia M. C. Lee

Compared with unimodal data, multimodal data can provide more features to help the model analyze the sentiment of data. Previous research works rarely consider token-level feature fusion, and few works explore learning the common features…

Computation and Language · Computer Science 2022-06-15 Zhen Li , Bing Xu , Conghui Zhu , Tiejun Zhao

Multimodal sentiment analysis and depression estimation are two important research topics that aim to predict human mental states using multimodal data. Previous research has focused on developing effective fusion strategies for exchanging…

Multimedia · Computer Science 2022-09-14 Hao Sun , Hongyi Wang , Jiaqing Liu , Yen-Wei Chen , Lanfen Lin
‹ Prev 1 3 4 5 6 7 10 Next ›