English
Related papers

Related papers: MMRole: A Comprehensive Framework for Developing a…

200 papers

The low-intrusion and automated personality assessment is receiving increasing attention in psychology and human-computer interaction fields. This study explores an interactive approach for personality assessment, focusing on the…

Human-Computer Interaction · Computer Science 2026-04-07 Baiqiao Zhang , Xiangxian Li , Chao Zhou , Xinyu Gai , Juan Liu , Xue Yang , Nianlong Li , Shuai Ma , Xiaojuan Ma , Yong-jin Liu , Yulong Bian

In Multi-Agent Systems (MAS), agents are designed with social capabilities, allowing them to understand and reason about social concepts such as norms when interacting with others (e.g., inter-robot interactions). In Normative MAS (NorMAS),…

Multiagent Systems · Computer Science 2026-03-05 Oishik Chowdhury , Anushka Debnath , Bastin Tony Roy Savarimuthu

Leveraging Multi-modal Large Language Models (MLLMs) to create embodied agents offers a promising avenue for tackling real-world tasks. While language-centric embodied agents have garnered substantial attention, MLLM-based embodied agents…

As language model (LM) agents become increasingly capable and adopted in real-world applications, there is a growing need for scalable evaluation frameworks beyond costly, manually designed benchmarks. We propose information-theoretic…

Artificial Intelligence · Computer Science 2026-05-29 Jinyeop Song , Jeff Gore , Max Kleiman-Weiner

Process Reward Models (PRMs) have shown promise in enhancing the mathematical reasoning capabilities of Large Language Models (LLMs) through Test-Time Scaling (TTS). However, their integration into multimodal reasoning remains largely…

Computation and Language · Computer Science 2025-10-07 Ruilin Luo , Zhuofan Zheng , Yifan Wang , Xinzhe Ni , Zicheng Lin , Songtao Jiang , Yiyao Yu , Chufan Shi , Lei Wang , Ruihang Chu , Jin Zeng , Yujiu Yang

Reward modeling has become a cornerstone of aligning large language models (LLMs) with human preferences. Yet, when extended to subjective and open-ended domains such as role play, existing reward models exhibit severe degradation,…

Computation and Language · Computer Science 2025-12-12 Hang Ding , Qiming Feng , Dongqi Liu , Qi Zhao , Tao Yao , Shuo Wang , Dongsheng Chen , Jian Li , Zhenye Gan , Jiangning Zhang , Chengjie Wang , Yabiao Wang

Visual Question Answering (VQA), as the representative multimodal task, serves as a key benchmark for evaluating the reasoning capabilities of Multimodal Large Language Models (MLLMs). However, existing evaluations largely rely on static…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Quanxing Xu , Yuhao Tian , Ling Zhou , Xian Zhong , Xiaohua Huang , Rubing Huang , Chia-Wen Lin

Current Autonomous Scientific Research (ASR) systems, despite leveraging large language models (LLMs) and agentic architectures, remain constrained by fixed workflows and toolsets that prevent adaptation to evolving tasks and environments.…

Artificial Intelligence · Computer Science 2026-04-01 Martin Legrand , Tao Jiang , Matthieu Feraud , Benjamin Navet , Yousouf Taghzouti , Fabien Gandon , Elise Dumont , Louis-Félix Nothias

Multi-agent reinforcement learning is a promising research area that extends established reinforcement learning approaches to problems formulated as multi-agent systems. Recently, a multitude of communication methods have been introduced to…

Multiagent Systems · Computer Science 2026-01-21 Christoph Wittner

Detecting cognitive biases in large language models (LLMs) is a fascinating task that aims to probe the existing cognitive biases within these models. Current methods for detecting cognitive biases in language models generally suffer from…

Computation and Language · Computer Science 2024-10-08 Zhentao Xie , Jiabao Zhao , Yilei Wang , Jinxin Shi , Yanhong Bai , Xingjiao Wu , Liang He

The study of multimodal interaction in therapy can yield a comprehensive understanding of therapist and patient behavior that can be used to develop a multimodal virtual agent supporting therapy. This investigation aims to uncover how…

Computation and Language · Computer Science 2024-06-25 Lucie Galland , Catherine Pelachaud , Florian Pecune

Recent advances in large multimodal models have enabled new opportunities in embodied AI, particularly in robotic manipulation. These models have shown strong potential in generalization and reasoning, but achieving reliable and responsible…

Robotics · Computer Science 2025-12-05 Lei Zhang , Ju Dong , Kaixin Bai , Minheng Ni , Zoltan-Csaba Marton , Zhaopeng Chen , Jianwei Zhang

Recent work has proposed a methodology for the systematic evaluation of "Situated Language Understanding Agents"-agents that operate in rich linguistic and non-linguistic contexts-through testing them in carefully constructed interactive…

Computation and Language · Computer Science 2023-11-27 Kranti Chalamalasetti , Jana Götze , Sherzod Hakimov , Brielen Madureira , Philipp Sadler , David Schlangen

Training multimodal agents via reinforcement learning for knowledge-intensive visual reasoning is fundamentally hindered by the extreme sparsity of outcome-based supervision and the unpredictability of live web environments. To resolve…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Wentao Yan , Shengqin Wang , Huichi Zhou , Yihang Chen , Kun Shao , Yuan Xie , Zhizhong Zhang

We propose a multimodal (vision-and-language) benchmark for cooperative and heterogeneous multi-agent learning. We introduce a benchmark multimodal dataset with tasks involving collaboration between multiple simulated heterogeneous robots…

Artificial Intelligence · Computer Science 2022-08-30 Vasu Sharma , Prasoon Goyal , Kaixiang Lin , Govind Thattai , Qiaozi Gao , Gaurav S. Sukhatme

Despite improvements by length extrapolation, efficient attention and memory modules, handling infinitely long documents with linear complexity without performance degradation during extrapolation remains the ultimate challenge in long-text…

Computation and Language · Computer Science 2025-07-04 Hongli Yu , Tinghong Chen , Jiangtao Feng , Jiangjie Chen , Weinan Dai , Qiying Yu , Ya-Qin Zhang , Wei-Ying Ma , Jingjing Liu , Mingxuan Wang , Hao Zhou

In recent years, multi-agent frameworks powered by large language models (LLMs) have advanced rapidly. Despite this progress, there is still a notable absence of benchmark datasets specifically tailored to evaluate their performance. To…

Computation and Language · Computer Science 2025-04-28 Lei Shen , Xiaoyu Shen

Multimodal Large Language Models (MLLMs) harness comprehensive knowledge spanning text, images, and audio to adeptly tackle complex problems, including zero-shot in-context learning scenarios. This study explores the ability of MLLMs in…

Training large language models (LLMs) as interactive agents presents unique challenges including long-horizon decision making and interacting with stochastic environment feedback. While reinforcement learning (RL) has enabled progress in…