English
Related papers

Related papers: Computational emotion analysis with multimodal LLM…

200 papers

Large language models (LLMs) excel at generating empathic responses in text-based conversations. But, how reliably do they judge the nuances of empathic communication? We investigate this question by comparing how experts, crowdworkers, and…

Computation and Language · Computer Science 2025-10-06 Aakriti Kumar , Nalin Poungpeth , Diyi Yang , Erina Farrell , Bruce Lambert , Matthew Groh

Language models (LMs) are known to represent the perspectives of some social groups better than others, which may impact their performance, especially on subjective tasks such as content moderation and hate speech detection. To explore how…

Computation and Language · Computer Science 2024-06-19 Zihao He , Siyi Guo , Ashwin Rao , Kristina Lerman

Large language models (LLMs) show strong potential for simulating human social behaviors and interactions, yet lack large-scale, systematically constructed benchmarks for evaluating their alignment with real-world social attitudes. To…

Social and Information Networks · Computer Science 2025-10-14 Jia Wang , Ziyu Zhao , Tingjuntao Ni , Zhongyu Wei

The rapid integration of Large Vision-Language Models (LVLMs) into critical domains necessitates comprehensive moral evaluation to ensure their alignment with human values. While extensive research has addressed moral evaluation in LLMs,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Bei Yan , Jie Zhang , Zhiyuan Chen , Shiguang Shan , Xilin Chen

Current Large Language Models (LLMs) are unparalleled in their ability to generate grammatically correct, fluent text. LLMs are appearing rapidly, and debates on LLM capacities have taken off, but reflection is lagging behind. Thus, in this…

Computation and Language · Computer Science 2023-11-01 Bram M. A. van Dijk , Tom Kouwenhoven , Marco R. Spruit , Max J. van Duijn

Multimodal large language models (MLLMs) carry the potential to support humans in processing vast amounts of information. While MLLMs are already being used as a fact-checking tool, their abilities and limitations in this regard are…

Computation and Language · Computer Science 2024-04-29 Jiahui Geng , Yova Kementchedjhieva , Preslav Nakov , Iryna Gurevych

Large language models (LLMs) may not equitably represent diverse global perspectives on societal issues. In this paper, we develop a quantitative framework to evaluate whose opinions model-generated responses are more similar to. We first…

Sentiment analysis serves as a pivotal component in Natural Language Processing (NLP). Advancements in multilingual pre-trained models such as XLM-R and mT5 have contributed to the increasing interest in cross-lingual sentiment analysis.…

Computation and Language · Computer Science 2024-06-28 Xiliang Zhu , Shayna Gardiner , Tere Roldán , David Rossouw

This study explores the potential of large language models (LLMs) to conduct market experiments, aiming to understand their capability to comprehend competitive market dynamics. We model the behavior of market agents in a controlled…

Human-Computer Interaction · Computer Science 2024-11-04 Jingru Jia , Zehua Yuan

Gaps arise between a language model's use of concepts and people's expectations. This gap is critical when LLMs generate text to help people communicate via Augmentative and Alternative Communication (AAC) tools. In this work, we introduce…

Computation and Language · Computer Science 2025-11-11 Shadab Choudhury , Asha Kumar , Lara J. Martin

Despite their advanced reasoning capabilities, state-of-the-art Multimodal Large Language Models (MLLMs) demonstrably lack a core component of human intelligence: the ability to `read the room' and assess deception in complex social…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Caixin Kang , Yifei Huang , Liangyang Ouyang , Mingfang Zhang , Ruicong Liu , Yoichi Sato

Large Language Models (LLMs) are increasingly used not only for instrumental tasks, but as always-available and non-judgmental confidants for emotional support. Yet what drives adoption and how users perceive emotional support interactions…

Computation and Language · Computer Science 2026-05-19 Natalia Amat-Lefort , Mert Yazan , Amanda Cercas Curry , Flor Miriam Plaza-del-Arco

We explore Multimodal Large Language Models (MLLMs), which integrate LLMs like GPT-4 to handle multimodal data, including text, images, audio, and more. MLLMs demonstrate capabilities such as generating image captions and answering…

Computation and Language · Computer Science 2025-01-09 Shezheng Song , Xiaopeng Li , Shasha Li , Shan Zhao , Jie Yu , Jun Ma , Xiaoguang Mao , Weimin Zhang

Emotional Support Conversation (ESC) is a typical dialogue that can effectively assist the user in mitigating emotional pressures. However, owing to the inherent subjectivity involved in analyzing emotions, current non-artificial…

Computation and Language · Computer Science 2024-08-05 Huaiwen Zhang , Yu Chen , Ming Wang , Shi Feng

Multimodal Large Language Model (MLLM) relies on the powerful LLM to perform multimodal tasks, showing amazing emergent abilities in recent studies, such as writing poems based on an image. However, it is difficult for these case studies to…

Computer Vision and Pattern Recognition · Computer Science 2025-10-27 Chaoyou Fu , Peixian Chen , Yunhang Shen , Yulei Qin , Mengdan Zhang , Xu Lin , Jinrui Yang , Xiawu Zheng , Ke Li , Xing Sun , Yunsheng Wu , Rongrong Ji , Caifeng Shan , Ran He

The rapid development of large language models (LLMs) has necessitated the creation of benchmarks to evaluate their performance. These benchmarks resemble human tests and surveys, as they consist of sets of questions designed to measure…

Computation and Language · Computer Science 2025-01-30 Denis Federiakin

The increasing sophistication of large language models (LLMs) has sparked growing concerns regarding their potential role in exacerbating ideological polarization through the automated generation of persuasive and biased content. This study…

Computation and Language · Computer Science 2025-06-18 . Pazzaglia , V. Vendetti , L. D. Comencini , F. Deriu , V. Modugno

Multimodal Large Language Models (MLLMs) have recently been proposed as a means to generate natural-language explanations for face recognition decisions. While such explanations facilitate human interpretability, their reliability on…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Redwan Sony , Anil K Jain , Arun Ross

Modern AI technology like Large language models (LLMs) has the potential to pollute the public information sphere with made-up content, which poses a significant threat to the cohesion of societies at large. A wide range of research has…

Computation and Language · Computer Science 2024-07-19 Steffen Herbold , Alexander Trautsch , Zlata Kikteva , Annette Hautli-Janisz

Large language models (LLMs) exhibit expert-level performance in tasks across a wide range of different domains. Ethical issues raised by LLMs and the need to align future versions makes it important to know how state of the art models…

Artificial Intelligence · Computer Science 2024-05-24 Guilherme F. C. F. Almeida , José Luiz Nunes , Neele Engelmann , Alex Wiegmann , Marcelo de Araújo