English
Related papers

Related papers: MMAFFBen: A Multilingual and Multimodal Affective …

200 papers

Large Language Models (LLMs) have gained widespread global adoption, showcasing advanced linguistic capabilities across multiple of languages. There is a growing interest in academia to use these models to simulate and study human…

Computation and Language · Computer Science 2024-08-06 Shiran Dudy , Ibrahim Said Ahmad , Ryoko Kitajima , Agata Lapedriza

The ability to represent emotion plays a significant role in human cognition and social interaction, yet the high-dimensional geometry of this affective space and its neural underpinnings remain debated. A key challenge, the…

Human-Computer Interaction · Computer Science 2025-09-30 Changde Du , Yizhuo Lu , Zhongyu Huang , Yi Sun , Zisen Zhou , Shaozheng Qin , Huiguang He

The rapid integration of Large Vision-Language Models (LVLMs) into critical domains necessitates comprehensive moral evaluation to ensure their alignment with human values. While extensive research has addressed moral evaluation in LLMs,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Bei Yan , Jie Zhang , Zhiyuan Chen , Shiguang Shan , Xilin Chen

Human verbal communication includes affective messages which are conveyed through use of emotionally colored words. There has been a lot of research in this direction but the problem of integrating state-of-the-art neural language models…

Computation and Language · Computer Science 2017-04-25 Sayan Ghosh , Mathieu Chollet , Eugene Laksana , Louis-Philippe Morency , Stefan Scherer

Large language models have become increasingly common, used by millions of people worldwide in both professional and personal contexts. As these models continue to advance, they are frequently serving as virtual assistants and companions.…

Computation and Language · Computer Science 2025-08-13 Victoria Williams , Benjamin Rosman

Emojis have become ubiquitous in online communication, serving as a universal medium to convey emotions and decorative elements. Their widespread use transcends language and cultural barriers, enhancing understanding and fostering more…

Computation and Language · Computer Science 2024-12-24 Rafid Ishrak Jahan , Heng Fan , Haihua Chen , Yunhe Feng

Emotion is essential in spoken communication, yet most existing frameworks in speech emotion modeling rely on predefined categories or low-dimensional continuous attributes, which offer limited expressive capacity. Recent advances in speech…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-07 Tianhua Qi , Wenming Zheng , Björn W. Schuller , Zhaojie Luo , Haizhou Li

This paper explores the design of an aspect-based sentiment analysis system using large language models (LLMs) for real-world use. We focus on quadruple opinion extraction -- identifying aspect categories, sentiment polarity, targets, and…

Computation and Language · Computer Science 2025-07-17 Benjamin White , Anastasia Shimorina

Large language models (LLMs) have garnered significant attention in recent years due to their impressive performance. While considerable research has evaluated these models from various perspectives, the extent to which LLMs can perform…

Computation and Language · Computer Science 2024-12-03 Guimin Hu , Hasti Seifi

We present LLaVAC, a method for constructing a classifier for multimodal sentiment analysis. This method leverages fine-tuning of the Large Language and Vision Assistant (LLaVA) to predict sentiment labels across both image and text…

Computation and Language · Computer Science 2025-02-06 T. Chay-intr , Y. Chen , K. Viriyayudhakorn , T. Theeramunkong

With strong expressive capabilities in Large Language Models(LLMs), generative models effectively capture sentiment structures and deep semantics, however, challenges remain in fine-grained sentiment classification across multi-lingual and…

Computation and Language · Computer Science 2024-11-28 Jie Wang , Yichen Wang , Zhilin Zhang , Jianhao Zeng , Kaidi Wang , Zhiyang Chen

Emotion recognition from human speech is a critical enabler for socially aware conversational AI. However, while most prior work frames emotion recognition as a categorical classification problem, real-world affective states are often…

Sound · Computer Science 2026-02-05 Hong Jia , Weibin Li , Jingyao Wu , Xiaofeng Yu , Yan Gao , Jintao Cheng , Xiaoyu Tang , Feng Xia , Ting Dang

Emotions are experienced and expressed differently across the world. In order to use Large Language Models (LMs) for multilingual tasks that require emotional sensitivity, LMs must reflect this cultural variation in emotion. In this study,…

Computation and Language · Computer Science 2023-07-11 Shreya Havaldar , Sunny Rai , Bhumika Singhal , Langchen Liu , Sharath Chandra Guntuku , Lyle Ungar

Multimodal Large Language Models (MLLMs) have experienced rapid development in recent years. However, in the financial domain, there is a notable lack of effective and specialized multimodal evaluation datasets. To advance the development…

Computation and Language · Computer Science 2025-06-02 Junyu Luo , Zhizhuo Kou , Liming Yang , Xiao Luo , Jinsheng Huang , Zhiping Xiao , Jingshu Peng , Chengzhong Liu , Jiaming Ji , Xuanzhe Liu , Sirui Han , Ming Zhang , Yike Guo

Multimodal Large Language Models (MLLMs) have revolutionized numerous research fields, including computer vision and affective computing. As a pivotal challenge in this interdisciplinary domain, facial expression recognition (FER) has…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Fan Zhang , Haoxuan Li , Shengju Qian , Xin Wang , Zheng Lian , Hao Wu , Zhihong Zhu , Yuan Gao , Qiankun Li , Yefeng Zheng , Zhouchen Lin , Pheng-Ann Heng

As large language models (LLMs) are increasingly integrated into emotionally sensitive domains, the structural integrity of their emotional intelligence (EI) becomes a critical frontier for safety and alignment. Current benchmarks often…

Artificial Intelligence · Computer Science 2026-05-26 Minghao Lv , Lu Chen , Enchang Zhang , Anji Zhou , Xiaoran Xue , Hanyi Zhang , Fenghua Tang , Zhuo Rachel Han , Mengyue Wu

The recent advancement of Multimodal Large Language Models (MLLMs) is transforming human-computer interaction (HCI) from surface-level exchanges into more nuanced and emotionally intelligent communication. To realize this shift, emotion…

Artificial Intelligence · Computer Science 2026-01-06 Hyeongseop Rha , Jeong Hun Yeo , Yeonju Kim , Yong Man Ro

The field of Multimodal Large Language Models (MLLMs) has made remarkable progress in visual understanding tasks, presenting a vast opportunity to predict the perceptual and emotional impact of charts. However, it also raises concerns, as…

Human-Computer Interaction · Computer Science 2025-05-26 Seon Gyeom Kim , Jae Young Choi , Ryan Rossi , Eunyee Koh , Tak Yeon Lee

Understanding emotions is a fundamental ability for intelligent systems to be able to interact with humans. Vision-language models (VLMs) have made tremendous progress in the last few years for many visual tasks, potentially offering a…

Computer Vision and Pattern Recognition · Computer Science 2026-04-17 Madhav Agarwal , Sotirios A. Tsaftaris , Laura Sevilla-Lara , Steven McDonagh

Financial sentiment analysis is critical for valuation and investment decision-making. Traditional NLP models, however, are limited by their parameter size and the scope of their training datasets, which hampers their generalization…

Computation and Language · Computer Science 2023-11-07 Boyu Zhang , Hongyang Yang , Tianyu Zhou , Ali Babar , Xiao-Yang Liu