English
Related papers

Related papers: MMRole: A Comprehensive Framework for Developing a…

200 papers

The ability to perform multi-modal multi-hop reasoning by iteratively integrating information across various modalities and external knowledge is critical for addressing complex real-world challenges. However, existing Multi-modal Large…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Tao Zhang , Ziqi Zhang , Zongyang Ma , Yuxin Chen , Bing Li , Chunfeng Yuan , Guangting Wang , Fengyun Rao , Ying Shan , Weiming Hu

Multimodal LLMs are increasingly deployed as perceptual backbones for autonomous agents in 3D environments, from robotics to virtual worlds. These applications require agents to perceive rapid state changes, attribute actions to the correct…

Computation and Language · Computer Science 2026-04-14 Yunzhe Wang , Runhui Xu , Kexin Zheng , Tianyi Zhang , Jayavibhav Niranjan Kogundi , Soham Hans , Volkan Ustun

The current research on Role-Playing Conversational Agents (RPCAs) with Large Language Models (LLMs) primarily focuses on imitating specific speaking styles and utilizing character backgrounds, neglecting the depiction of deeper personality…

Computation and Language · Computer Science 2025-02-07 Tao Yang , Yuhua Zhu , Xiaojun Quan , Cong Liu , Qifan Wang

The advancement of Large Language Models (LLMs) has spurred significant interest in Role-Playing Agents (RPAs) for applications such as emotional companionship and virtual interaction. However, recent RPAs are often built on explicit…

Computation and Language · Computer Science 2025-06-03 Yihong Tang , Kehai Chen , Muyun Yang , Zhengyu Niu , Jing Li , Tiejun Zhao , Min Zhang

Existing evaluations of multimodal large language models (MLLMs) on spatial intelligence are typically fragmented and limited in scope. In this work, we aim to conduct a holistic assessment of the spatial understanding capabilities of…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Haoning Wu , Xiao Huang , Yaohui Chen , Ya Zhang , Yanfeng Wang , Weidi Xie

The rapid rise of Large Language Models (LLMs)-based intelligent agents underscores the need for robust, scalable evaluation frameworks. Existing methods rely on static benchmarks and labor-intensive data collection, limiting practical…

Artificial Intelligence · Computer Science 2025-08-05 Zhiwei Liu , Jielin Qiu , Shiyu Wang , Jianguo Zhang , Zuxin Liu , Roshan Ram , Haolin Chen , Weiran Yao , Shelby Heinecke , Silvio Savarese , Huan Wang , Caiming Xiong

Owing to recent advancements, Large Language Models (LLMs) can now be deployed as agents for increasingly complex decision-making applications in areas including robotics, gaming, and API integration. However, reflecting past experiences in…

Current evaluation frameworks and benchmarks for LLM powered agents focus on text chat driven agents, these frameworks do not expose the persona of user to the agent, thus operating in a user agnostic environment. Importantly, in customer…

Emerging Technologies · Computer Science 2026-04-17 Anupam Purwar , Aditya Choudhary

Building role-playing agents (RPAs) that faithfully emulate specific characters remains challenging because collecting character-specific utterances and continually updating model parameters are resource-intensive, making…

Artificial Intelligence · Computer Science 2026-02-06 Jeiyoon Park , Yongshin Han , Minseop Kim , Kisu Yang

Multimodal large language models are increasingly deployed as long-horizon agents, where memory must do more than recall: it must track an evolving world, revise what has gone stale, and surface the right evidence at decision time. Existing…

Large Language Models (LLMs), enhanced through agent tuning, have demonstrated remarkable capabilities in Chain-of-Thought (CoT) and tool utilization, significantly surpassing the performance of standalone models. However, the multimodal…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Tianhong Gao , Yannian Fu , Weiqun Wu , Haixiao Yue , Shanshan Liu , Gang Zhang

Medical Large Vision-Language Models (Med-LVLMs) have shown strong potential in multimodal diagnostic tasks. However, existing single-agent models struggle to generalize across diverse medical specialties, limiting their performance. Recent…

Machine Learning · Computer Science 2026-01-27 Peng Xia , Jinglu Wang , Yibo Peng , Kaide Zeng , Zihan Dong , Xian Wu , Xiangru Tang , Hongtu Zhu , Yun Li , Linjun Zhang , Shujie Liu , Yan Lu , Huaxiu Yao

Human-robot interaction is increasingly moving toward multi-robot, socially grounded environments. Existing systems struggle to integrate multimodal perception, embodied expression, and coordinated decision-making in a unified framework.…

Robotics · Computer Science 2026-03-25 Shaid Hasan , Breenice Lee , Sujan Sarker , Tariq Iqbal

Role-playing agents (RPAs), powered by large language models, have emerged as a flourishing field of applications. However, a key challenge lies in assessing whether RPAs accurately reproduce the personas of target characters, namely their…

Computation and Language · Computer Science 2024-06-10 Xintao Wang , Yunze Xiao , Jen-tse Huang , Siyu Yuan , Rui Xu , Haoran Guo , Quan Tu , Yaying Fei , Ziang Leng , Wei Wang , Jiangjie Chen , Cheng Li , Yanghua Xiao

The creation of high-quality multimodal datasets remains fundamental for advancing role-playing capabilities in large language models (LLMs). While existing works predominantly focus on text-based persona simulation, Audio Role-Playing…

Sound · Computer Science 2026-04-09 Wenyu Li , Xiaoqi Jiao , Yi Chang , Guangyan Zhang , Yiwen Guo

The emergence of multimodal LLM-based agents (MLAs) has transformed interaction paradigms by seamlessly integrating vision, language, action and dynamic environments, enabling unprecedented autonomous capabilities across GUI applications…

Artificial Intelligence · Computer Science 2025-06-03 Xiao Yang , Jiawei Chen , Jun Luo , Zhengwei Fang , Yinpeng Dong , Hang Su , Jun Zhu

Recent advances in large language models (LLMs) have increased the demand for comprehensive benchmarks to evaluate their capabilities as human-like agents. Existing benchmarks, while useful, often focus on specific application scenarios,…

Augmented Reality (AR) systems are increasingly integrating foundation models, such as Multimodal Large Language Models (MLLMs), to provide more context-aware and adaptive user experiences. This integration has led to the development of AR…

Artificial Intelligence · Computer Science 2025-08-13 Dongwook Choi , Taeyoon Kwon , Dongil Yang , Hyojun Kim , Jinyoung Yeo

Vision-language models (VLMs) have shown impressive capabilities in perceptual tasks, yet they degrade in complex multi-hop reasoning under multiplayer game settings with imperfect and deceptive information. In this paper, we study a…

Artificial Intelligence · Computer Science 2026-04-14 Keyang Zhong , Junlin Xie , Hefeng Wu , Haofeng Li , Guanbin Li

With the rapid growth of academic publications, peer review has become an essential yet time-consuming responsibility within the research community. Large Language Models (LLMs) have increasingly been adopted to assist in the generation of…

Computation and Language · Computer Science 2025-10-09 Xian Gao , Jiacheng Ruan , Zongyun Zhang , Jingsheng Gao , Ting Liu , Yuzhuo Fu