中文
相关论文

相关论文: Personalizing Embodied Multimodal Large Language M…

200 篇论文

As LLM-based agents are increasingly used in long-term interactions, cumulative memory is critical for enabling personalization and maintaining stylistic consistency. However, most existing systems adopt an ``all-or-nothing'' approach to…

Memory is fundamental to large language model (LLM)-based agents, but existing surveys emphasize application-level use (e.g., personalized dialogue), while overlooking the atomic operations governing memory dynamics. This work categorizes…

计算与语言 · 计算机科学 2025-12-25 Yiming Du , Wenyu Huang , Danna Zheng , Zhaowei Wang , Sebastien Montella , Mirella Lapata , Kam-Fai Wong , Jeff Z. Pan

Personalization plays a critical role in numerous language tasks and applications, since users with the same requirements may prefer diverse outputs based on their individual interests. This has led to the development of various…

计算与语言 · 计算机科学 2024-09-19 Jiongnan Liu , Yutao Zhu , Shuting Wang , Xiaochi Wei , Erxue Min , Yu Lu , Shuaiqiang Wang , Dawei Yin , Zhicheng Dou

Large language model (LLM) agents have evolved to intelligently process information, make decisions, and interact with users or tools. A key capability is the integration of long-term memory capabilities, enabling these agents to draw upon…

计算与语言 · 计算机科学 2025-08-04 Rana Salama , Jason Cai , Michelle Yuan , Anna Currey , Monica Sunkara , Yi Zhang , Yassine Benajiba

Memory emerges as the core module in the Large Language Model (LLM)-based agents for long-horizon complex tasks (e.g., multi-turn dialogue, game playing, scientific discovery), where memory can enable knowledge accumulation, iterative…

Existing large language model (LLM) based memory systems apply universal, static policies that overlook a fundamental reality: the contexts that are worth storing in memory are different across users. This misalignment wastes limited memory…

人工智能 · 计算机科学 2026-05-26 Yeonjun In , Wonjoong Kim , Sangwu Park , Kanghoon Yoon , Chanyoung Park

This search introduces the Multimodal Socialized Learning Framework (M-S2L), designed to foster emergent social intelligence in AI agents by integrating Multimodal Large Language Models (M-LLMs) with social learning mechanisms. The…

多智能体系统 · 计算机科学 2025-11-12 Sureyya Akin , Shruti T. Tiwari , Ram Bhattacharya , Sagar A. Raman , Kiran Mohanty , Sita Krishnan

While Large Language Model (LLM) based agents excel at complex tasks, their performance in open-ended scenarios is often constrained by isolated operation and reliance on static databases, missing the dynamic knowledge exchange of human…

计算与语言 · 计算机科学 2026-03-06 Hang Gao , Yongfeng Zhang

Large language models (LLMs) have made significant advances in the field of natural language processing, but they still face challenges such as continuous decision-making, lack of long-term memory, and limited context windows in dynamic…

With the surge in the development of large language models, embodied intelligence has attracted increasing attention. Nevertheless, prior works on embodied intelligence typically encode scene or historical memory in an unimodal manner,…

计算机视觉与模式识别 · 计算机科学 2024-07-30 Yang Liu , Xinshuai Song , Kaixuan Jiang , Weixing Chen , Jingzhou Luo , Guanbin Li , Liang Lin

Embodied intelligence empowers agents with a profound sense of perception, enabling them to respond in a manner closely aligned with real-world situations. Large Language Models (LLMs) delve into language instructions with depth, serving a…

多媒体 · 计算机科学 2024-07-17 Shuyuan Liu , Jiawei Chen , Shouwei Ruan , Hang Su , Zhaoxia Yin

Inspired by the insights in cognitive science with respect to human memory and reasoning mechanism, a novel evolvable LLM-based (Large Language Model) agent framework is proposed as REMEMBERER. By equipping the LLM with a long-term…

计算与语言 · 计算机科学 2023-10-31 Danyang Zhang , Lu Chen , Situo Zhang , Hongshen Xu , Zihan Zhao , Kai Yu

Older adults have increasing difficulty with retrospective memory, hindering their abilities to perform daily activities and posing stress on caregivers to ensure their wellbeing. Recent developments in Artificial Intelligence (AI) and…

人机交互 · 计算机科学 2025-02-05 Natasha Maniar , Samantha W. T. Chan , Wazeer Zulfikar , Scott Ren , Christine Xu , Pattie Maes

Embodied agents designed to assist users with tasks must engage in natural language interactions, interpret instructions, execute actions, and communicate effectively to resolve issues. However, collecting large-scale, diverse datasets of…

计算与语言 · 计算机科学 2024-11-01 Daniel Philipov , Vardhan Dongre , Gokhan Tur , Dilek Hakkani-Tür

This paper presents a novel application of large language models (LLMs) to enhance user comprehension of privacy policies through an interactive dialogue agent. We demonstrate that LLMs significantly outperform traditional models in tasks…

人机交互 · 计算机科学 2024-10-17 Bolun Sun , Yifan Zhou , Haiyun Jiang

Embodied AI agents responsible for executing interconnected, long-sequence household tasks often face difficulties with in-context memory, leading to inefficiencies and errors in task execution. To address this issue, we introduce KARMA, an…

机器人学 · 计算机科学 2025-03-24 Zixuan Wang , Bo Yu , Junzhe Zhao , Wenhao Sun , Sai Hou , Shuai Liang , Xing Hu , Yinhe Han , Yiming Gan

Integrating robotics into everyday scenarios like tutoring or physical training requires robots capable of adaptive, socially engaging, and goal-oriented interactions. While Large Language Models show promise in human-like communication,…

机器人学 · 计算机科学 2025-04-03 Luca Garello , Giulia Belgiovine , Gabriele Russo , Francesco Rea , Alessandra Sciutti

Large language models (LLMs) have grown in popularity due to their natural language interface and pre trained knowledge, leading to rapidly increasing success in question-answering (QA) tasks. More recently, multi-agent systems with…

机器学习 · 计算机科学 2024-10-21 Bhrij Patel , Vishnu Sashank Dorbala , Amrit Singh Bedi , Dinesh Manocha

We introduce Ella, an embodied social agent capable of lifelong learning within a community in a 3D open world, where agents accumulate experiences and acquire knowledge through everyday visual observations and social interactions. At the…

计算机视觉与模式识别 · 计算机科学 2025-07-01 Hongxin Zhang , Zheyuan Zhang , Zeyuan Wang , Zunzhe Zhang , Lixing Fang , Qinhong Zhou , Chuang Gan

Despite advancements in Large Language Models (LLMs) and Large Multimodal Models (LMMs), their integration into language-grounded, human-like embodied agents remains incomplete, hindering complex real-life task performance in physical…

计算与语言 · 计算机科学 2024-08-20 Zhili Cheng , Zhitong Wang , Jinyi Hu , Shengding Hu , An Liu , Yuge Tu , Pengkai Li , Lei Shi , Zhiyuan Liu , Maosong Sun