English
Related papers

Related papers: MMRole: A Comprehensive Framework for Developing a…

200 papers

The advent of large language models (LLMs) has significantly propelled the advancement of Role-Playing Agents (RPAs). However, current Role-Playing Agents predominantly focus on mimicking a character's fundamental attributes while…

Computation and Language · Computer Science 2024-11-06 Siyuan Chen , Qingyi Si , Chenxu Yang , Yunzhi Liang , Zheng Lin , Huan Liu , Weiping Wang

Role-playing agents (RPAs) have attracted growing interest for their ability to simulate immersive and interactive characters. However, existing approaches primarily focus on static role profiles, overlooking the dynamic perceptual…

Multimedia · Computer Science 2025-09-22 Xueqiao Zhang , Chao Zhang , Jingtao Xu , Yifan Zhu , Xin Shi , Yi Yang , Yawei Luo

Multimodal Role-Playing Agents (MRPAs) are attracting increasing attention due to their ability to deliver more immersive multimodal emotional interactions. However, existing studies still rely on pure textual benchmarks to evaluate the…

Computation and Language · Computer Science 2026-02-26 Zhenyu Wang , Xiaofen Xing , Yirong Chen , Xiangmin Xu

Speech is essential for realistic role-playing, yet existing work on role-playing agents largely centers on text, leaving Speech Role-Playing Agents (SRPAs) underexplored and without systematic evaluation. We introduce SpeechRole, a unified…

Role-Playing Agent (RPA) is an increasingly popular type of LLM Agent that simulates human-like behaviors in a variety of tasks. However, evaluating RPAs is challenging due to diverse task requirements and agent designs. This paper proposes…

Human-Computer Interaction · Computer Science 2025-03-28 Chaoran Chen , Bingsheng Yao , Ruishi Zou , Wenyue Hua , Weimin Lyu , Yanfang Ye , Toby Jia-Jun Li , Dakuo Wang

The rapid adoption of Large Language Models (LLMs) in interactive systems has enabled the creation of dynamic, open-ended Role-Playing Agents (RPAs). However, evaluating these agents remains a significant challenge, as standard NLP metrics…

Computation and Language · Computer Science 2026-04-14 Riccardo Rosati , Edoardo Colucci , Massimiliano Bolognini , Adriano Mancini , Paolo Sernani

Role-Playing Agents (RPAs), benefiting from large language models, is an emerging interactive AI system that simulates roles or characters with diverse personalities. However, existing methods primarily focus on mimicking dialogues among…

Computation and Language · Computer Science 2025-06-06 Haonan Zhang , Run Luo , Xiong Liu , Yuchuan Wu , Ting-En Lin , Pengpeng Zeng , Qiang Qu , Feiteng Fang , Min Yang , Lianli Gao , Jingkuan Song , Fei Huang , Yongbin Li

Unified multimodal understanding and generation models enable richer human-AI interaction. Yet jointly customizing a character's persona, dialogue style, and visual identity while maintaining output consistency across modalities remains…

Machine Learning · Computer Science 2026-05-12 Chao Tang , Jianzong Wu , Qingyu Shi , Ye Tian , Aixi Zhang , Hao Jiang , Jiangning Zhang , Yunhai Tong

As Multimodal Large Language Models (MLLMs) advance, multimodal agents show promise in real-world tasks like web navigation and embodied intelligence. However, due to limitations in a lack of external feedback, these agents struggle with…

Computation and Language · Computer Science 2025-06-27 Tianyi Men , Zhuoran Jin , Pengfei Cao , Yubo Chen , Kang Liu , Jun Zhao

Deep Research Agents (DRAs) generate citation-rich reports via multi-step search and synthesis, yet existing benchmarks mainly target text-only settings or short-form multimodal QA, missing end-to-end multimodal evidence use. We introduce…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Peizhou Huang , Zixuan Zhong , Zhongwei Wan , Donghao Zhou , Samiul Alam , Xin Wang , Zexin Li , Zhihao Dou , Li Zhu , Jing Xiong , Chaofan Tao , Yan Xu , Dimitrios Dimitriadis , Tuo Zhang , Mi Zhang

Recent significant advancements in Large Language Models (LLMs) have greatly propelled the development of Role-Playing Conversational Agents (RPCAs). These systems aim to create immersive user experiences through consistent persona…

Computation and Language · Computer Science 2025-09-05 Weihao Wu , Liang Cao , Xinyu Wu , Zhiwei Lin , Rui Niu , Jingbei Li , Zhiyong Wu

Role-playing agents (RPAs) require balancing multiple objectives, such as instruction following, persona consistency, and stylistic fidelity, which are not always perfectly aligned across different dimensions. While prior work has primarily…

Computation and Language · Computer Science 2026-04-23 Chonghua Liao , Ke Wang , Yuchuan Wu , Ruoran Li , Fei Huang , Yongbin Li

Role-playing agents (RPA) have been a popular application area for large language models (LLMs), attracting significant interest from both industry and academia.While existing RPAs well portray the characters' knowledge and tones, they face…

Computation and Language · Computer Science 2024-10-16 Yiting Ran , Xintao Wang , Rui Xu , Xinfeng Yuan , Jiaqing Liang , Deqing Yang , Yanghua Xiao

Current role-playing agents (RPAs) are typically constructed by imitating surface-level behaviors, but this approach lacks internal cognitive consistency, often causing out-of-character errors in complex situations. To address this, we…

Computation and Language · Computer Science 2026-01-09 Yihong Tang , Kehai Chen , Xuefeng Bai , Benyou Wang , Zeming Liu , Haifeng Wang , Min Zhang

Large language models (LLMs) have achieved superior performance in powering text-based AI agents, endowing them with decision-making and reasoning abilities akin to humans. Concurrently, there is an emerging research trend focused on…

Computer Vision and Pattern Recognition · Computer Science 2024-02-26 Junlin Xie , Zhihong Chen , Ruifei Zhang , Xiang Wan , Guanbin Li

The rapid evolution of Retrieval-Augmented Generation (RAG) toward multimodal, high-stakes enterprise applications has outpaced the development of domain specific evaluation benchmarks. Existing datasets often rely on general-domain corpora…

Artificial Intelligence · Computer Science 2026-01-23 Chandan Kumar Sahu , Premith Kumar Chilukuri , Matthew Hetrich

Autonomous embodied agents live on an Internet of multimedia websites. Can they hop around multimodal websites to complete complex user tasks? Existing benchmarks fail to assess them in a realistic, evolving environment for their embodiment…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Shulin Tian , Ziniu Zhang , Liangyu Chen , Ziwei Liu

Progress in multiagent intelligence research is fundamentally limited by the number and quality of environments available for study. In recent years, simulated games have become a dominant research platform within reinforcement learning, in…

Machine Learning · Computer Science 2020-04-20 Joseph Suarez , Yilun Du , Igor Mordatch , Phillip Isola

While Multimodal Large Language Models (MLLMs) show immense promise for achieving truly human-like interactions, progress is hindered by the lack of fine-grained evaluation frameworks for human-centered scenarios, encompassing both the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Zheng Qin , Ruobing Zheng , Yabing Wang , Tianqi Li , Yi Yuan , Jingdong Chen , Le Wang

Large Language Models (LLMs) demonstrate a notable capacity for adopting personas and engaging in role-playing. However, evaluating this ability presents significant challenges, as human assessments are resource-intensive and automated…

Computation and Language · Computer Science 2025-05-20 Yassine El Boudouri , Walter Nuninger , Julian Alvarez , Yvan Peter
‹ Prev 1 2 3 10 Next ›