English
Related papers

Related papers: EMemBench: Interactive Benchmarking of Episodic Me…

200 papers

Effective memory management is essential for large language model (LLM) agents handling long-term interactions. Current memory frameworks typically treat agents as passive "recorders" and retrieve information without understanding its…

Computation and Language · Computer Science 2026-03-03 Xiaohui Zhang , Zequn Sun , Chengyuan Yang , Yaqin Jin , Yazhong Zhang , Wei Hu

Large language models (LLMs) are increasingly deployed as intelligent agents that reason, plan, and interact with their environments. To effectively scale to long-horizon scenarios, a key capability for such agents is a memory mechanism…

Artificial Intelligence · Computer Science 2026-01-09 Yuyang Hu , Jiongnan Liu , Jiejun Tan , Yutao Zhu , Zhicheng Dou

As AI agents increasingly operate in open, real-world environments, they require a deep synergy of multimodal perception, tool invocation with multi-hop reasoning, and dynamic interaction with users. However, existing benchmarks fail to…

Artificial Intelligence · Computer Science 2026-05-28 Yunqi Liu , Tong Niu , Zitong Wang , Zhenlong Dai , Yuqi Qing , Weiqiang Wang , Jian Liu

Large language models (LLMs) increasingly serve as the central control unit of AI agents, yet current approaches remain limited in their ability to deliver personalized interactions. While Retrieval Augmented Generation enhances LLM…

Artificial Intelligence · Computer Science 2025-10-10 Rebecca Westhäußer , Wolfgang Minker , Sebatian Zepf

Multimodal Large Language Models (MLLMs) have shown significant advancements, providing a promising future for embodied agents. Existing benchmarks for evaluating MLLMs primarily utilize static images or videos, limiting assessments to…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Zhili Cheng , Yuge Tu , Ran Li , Shiqi Dai , Jinyi Hu , Shengding Hu , Jiahao Li , Yang Shi , Tianyu Yu , Weize Chen , Lei Shi , Maosong Sun

Turning ideas into full software projects from scratch has become a popular use case for language models. Agents are being deployed to seed, maintain, and grow codebases over extended periods with minimal human oversight. Such settings…

Modern language agents must operate over long-horizon, multi-turn interactions, where they retrieve external information, adapt to observations, and answer interdependent queries. Yet, most LLM systems rely on full-context prompting,…

Computation and Language · Computer Science 2025-07-18 Zijian Zhou , Ao Qu , Zhaoxuan Wu , Sunghwan Kim , Alok Prakash , Daniela Rus , Jinhua Zhao , Bryan Kian Hsiang Low , Paul Pu Liang

MLLMs exhibit strong reasoning on isolated queries, yet they operate de novo -- solving each problem independently and often repeating the same mistakes. Existing memory-augmented agents mainly store past trajectories for reuse. However,…

Artificial Intelligence · Computer Science 2026-05-05 Weihao Bo , Shan Zhang , Yanpeng Sun , Jingjing Wu , Qunyi Xie , Xiao Tan , Kunbin Chen , Wei He , Xiaofan Li , Na Zhao , Jingdong Wang , Zechao Li

The rapid advancement of large language models has accelerated their application in reasoning, with strategic reasoning drawing increasing attention. To evaluate the strategic reasoning capabilities of LLMs, game theory, with its concise…

Artificial Intelligence · Computer Science 2025-05-28 Haochuan Wang , Xiachong Feng , Lei Li , Yu Guo , Zhanyue Qin , Dianbo Sui , Lingpeng Kong

There are currently two main paradigms for evaluating large language models (LLMs), reference-based evaluation and preference-based evaluation. The first, carried over from the evaluation of machine learning models in general, relies on…

Computation and Language · Computer Science 2026-02-27 David Schlangen , Sherzod Hakimov , Chalamalasetti Kranti , Jonathan Jordan , Philipp Sadler

Longitudinal health agents must reason across multi-source trajectories that combine continuous device streams, sparse clinical exams, and episodic life events - yet evaluating them is hard: real-world data cannot be released at scale, and…

Artificial Intelligence · Computer Science 2026-04-06 Chao Li , Cailiang Liu , Ang Gao , Kexin Deng , Shu Zhang , Langping Xu , Xiaotong Shi , Xionghao Ding , Jian Pei , Xun Jiang

As the world of agentic artificial intelligence applied to robotics evolves, the need for agents capable of building and retrieving memories and observations efficiently is increasing. Robots operating in complex environments must build…

Robotics · Computer Science 2026-04-21 Paolo Riva , Leonardo Gargani , Matteo Frosi , Matteo Matteucci

Understanding the physical world is a fundamental challenge in embodied AI, critical for enabling agents to perform complex tasks and operate safely in real-world environments. While Vision-Language Models (VLMs) have shown great promise in…

Computer Vision and Pattern Recognition · Computer Science 2025-01-30 Wei Chow , Jiageng Mao , Boyi Li , Daniel Seita , Vitor Guizilini , Yue Wang

Long-term memory systems enable conversational agents based on large language models (LLMs) to retain, retrieve, and apply user-specific information across multi-session interactions. However, existing evaluations mainly assess…

Information Retrieval · Computer Science 2026-05-21 Zhen Tao , Jinxiang Zhao , Peng Liu , Dinghao Xi , Yanfang Chen , Wei Xu , Zhiyu Li

Personalized agents that interact with users over long periods must maintain persistent memory across sessions and update it as circumstances change. However, existing benchmarks predominantly frame long-term memory evaluation as fact…

Computation and Language · Computer Science 2026-04-23 Md Nayem Uddin , Kumar Shubham , Eduardo Blanco , Chitta Baral , Gengyu Wang

Despite significant advancements in Large Language Models (LLMs) and Large Vision-Language Models (LVLMs), current models still face substantial challenges in handling complex, multi-turn, and visually-grounded tasks that demand deep…

Computation and Language · Computer Science 2025-08-22 Seungmin Han , Haeun Kwon , Ji-jun Park , Taeyang Yoon

Memory embeddings are crucial for memory-augmented systems, such as OpenClaw, but their evaluation is underexplored in current text embedding benchmarks, which narrowly focus on traditional passage retrieval and fail to assess models'…

Computation and Language · Computer Science 2026-05-08 Xinping Zhao , Xinshuo Hu , Jiaxin Xu , Danyu Tang , Xin Zhang , Mengjia Zhou , Yan Zhong , Yao Zhou , Zifei Shan , Meishan Zhang , Baotian Hu , Min Zhang

We investigate how agents built on pretrained large language models (LLMs) can learn target classification functions from labeled examples without parameter updates. While conventional approaches like fine-tuning are often costly,…

Computation and Language · Computer Science 2026-05-06 Jackson Hassell , Dan Zhang , Hannah Kim , Tom Mitchell , Estevam Hruschka

Although LLM agents can leverage tools for complex tasks, they still need memory to maintain cross-turn consistency and accumulate reusable information in long-horizon interactions. However, retrieval-based external memory systems incur low…

Artificial Intelligence · Computer Science 2026-04-23 Jiaquan Zhang , Chaoning Zhang , Shuxu Chen , Zhenzhen Huang , Pengcheng Zheng , Zhicheng Wang , Ping Guo , Fan Mo , Sung-Ho Bae , Jie Zou , Jiwei Wei , Yang Yang

Assessing the capacity of Large Language Models (LLMs) to plan and reason within the constraints of interactive environments is crucial for developing capable AI agents. We introduce $\textbf{LLM-BabyBench}$, a new benchmark suite designed…

Artificial Intelligence · Computer Science 2025-05-20 Omar Choukrani , Idriss Malek , Daniil Orel , Zhuohan Xie , Zangir Iklassov , Martin Takáč , Salem Lahlou