中文
相关论文

相关论文: Reinforcing Trustworthiness in Multimodal Emotiona…

200 篇论文

The emergence of multimodal LLM-based agents (MLAs) has transformed interaction paradigms by seamlessly integrating vision, language, action and dynamic environments, enabling unprecedented autonomous capabilities across GUI applications…

人工智能 · 计算机科学 2025-06-03 Xiao Yang , Jiawei Chen , Jun Luo , Zhengwei Fang , Yinpeng Dong , Hang Su , Jun Zhu

Multimodal Large Language Models (MLLMs) are gaining increasing popularity in both academia and industry due to their remarkable performance in various applications such as visual question answering, visual perception, understanding, and…

计算与语言 · 计算机科学 2024-09-09 Jian Li , Weiheng Lu , Hao Fei , Meng Luo , Ming Dai , Min Xia , Yizhang Jin , Zhenye Gan , Ding Qi , Chaoyou Fu , Ying Tai , Wankou Yang , Yabiao Wang , Chengjie Wang

Large language models (LLMs) excel at logical and algorithmic reasoning, yet their emotional intelligence (EQ) still lags far behind their cognitive prowess. While reinforcement learning from verifiable rewards (RLVR) has advanced in other…

Large language models (LLMs) have excelled across domains, also delivering notable performance on the medical evaluation benchmarks, such as MedQA. However, there still exists a significant gap between the reported performance and the…

计算与语言 · 计算机科学 2024-06-06 Yuxuan Zhou , Xien Liu , Chen Ning , Ji Wu

Emotional and cognitive factors are essential for understanding mental health disorders. However, existing methods often treat multi-modal data as classification tasks, limiting interpretability especially for emotion and cognition.…

多媒体 · 计算机科学 2026-03-03 Zhiyuan Zhou , Yanrong Guo , Shijie Hao

Recent advances in multimodal large language models (MLLMs) have demonstrated remarkable multi- and cross-modal integration capabilities. However, their potential for fine-grained emotion understanding remains systematically underexplored.…

人机交互 · 计算机科学 2025-12-25 Jing Han , Zhiqiang Gao , Shihao Gao , Jialing Liu , Hongyu Chen , Zixing Zhang , Björn W. Schuller

Automatic detection of multimodal misinformation has gained a widespread attention recently. However, the potential of powerful Large Language Models (LLMs) for multimodal misinformation detection remains underexplored. Besides, how to…

计算与语言 · 计算机科学 2024-04-09 Longzheng Wang , Xiaohan Xu , Lei Zhang , Jiarui Lu , Yongxiu Xu , Hongbo Xu , Minghao Tang , Chuang Zhang

Multimodal large language models (MLLMs) enhance the capabilities of standard large language models by integrating and processing data from multiple modalities, including text, vision, audio, video, and 3D environments. Data plays a pivotal…

Recent advancements in Multimodal Large Language Models (MLLMs) have demonstrated significant potential in recommendation systems. However, the effective application of MLLMs to multimodal sequential recommendation remains unexplored: A)…

信息检索 · 计算机科学 2025-12-25 Haoyu Wang , Yitong Wang , Jining Wang

As a paradigm that delves into the deep seated drivers of user behavior, motivation-based recommendation systems have emerged as a prominent research direction in the field of personalized information retrieval. Unlike traditional…

信息检索 · 计算机科学 2026-03-16 Yicheng Di

Evaluating Large Language Models (LLMs) for mental health support is challenging due to the emotionally and cognitively complex nature of therapeutic dialogue. Existing benchmarks are limited in scale, reliability, often relying on…

Multimodal sentiment analysis is an important area for understanding the user's internal states. Deep learning methods were effective, but the problem of poor interpretability has gradually gained attention. Previous works have attempted to…

计算与语言 · 计算机科学 2023-05-15 Sixia Li , Shogo Okada

Large Language Models (LLMs) demonstrate strong potential across a variety of tasks in communications and networking due to their advanced reasoning capabilities. However, because different LLMs have different model structures and are…

网络与互联网体系结构 · 计算机科学 2025-05-07 Haoxiang Luo , Gang Sun , Yinqiu Liu , Dusit Niyato , Hongfang Yu , Mohammed Atiquzzaman , Schahram Dustdar

The complexity and heterogeneity of data in many real-world applications pose significant challenges for traditional machine learning and signal processing techniques. For instance, in medicine, effective analysis of diverse physiological…

机器学习 · 计算机科学 2024-08-16 Nimeesha Chan , Felix Parker , William Bennett , Tianyi Wu , Mung Yao Jia , James Fackler , Kimia Ghobadi

While Large Language Models (LLMs) demonstrate significant potential in providing accessible mental health support, their practical deployment raises critical trustworthiness concerns due to the domains high-stakes and safety-sensitive…

计算与语言 · 计算机科学 2026-03-04 Zixin Xiong , Ziteng Wang , Haotian Fan , Xinjie Zhang , Wenxuan Wang

With the rapid advancement of mathematical reasoning capabilities in Large Language Models (LLMs), AI systems are increasingly being adopted in educational settings to support students' comprehension of problem-solving processes. However, a…

计算与语言 · 计算机科学 2025-12-18 Jaewoo Park , Jungyang Park , Dongju Jang , Jiwan Chung , Byungwoo Yoo , Jaewoo Shin , Seonjoon Park , Taehyeong Kim , Youngjae Yu

The integration of information across multiple modalities and across time is a promising way to enhance the emotion recognition performance of affective systems. Much previous work has focused on instantaneous emotion recognition. The 2018…

图像与视频处理 · 电气工程与系统科学 2018-05-07 Didan Deng , Yuqian Zhou , Jimin Pi , Bertram E. Shi

Multimodal Entity Linking (MEL) aims to associate textual and visual mentions with entities in a multimodal knowledge graph. Despite its importance, current methods face challenges such as incomplete contextual information, coarse…

计算与语言 · 计算机科学 2025-08-25 Fang Wang , Tianwei Yan , Zonghao Yang , Minghao Hu , Jun Zhang , Zhunchen Luo , Xiaoying Bai

As Large Language Models (LLMs) become popular, there emerged an important trend of using multimodality to augment the LLMs' generation ability, which enables LLMs to better interact with the world. However, there lacks a unified perception…

The rapid progress of Multimodal Large Language Models (MLLMs) marks a significant step toward artificial general intelligence, offering great potential for augmenting human capabilities. However, their ability to provide effective…