English
Related papers

Related papers: Experience Transfer for Multimodal LLM Agents in M…

200 papers

LLM-based autonomous agents perform well on general reasoning tasks but still struggle to reliably use task structure, key constraints, and prior experience in complex real-world settings. We propose a case-based learning framework that…

Artificial Intelligence · Computer Science 2026-04-15 Zhenyu Ma , Yuyang Song , Chunyi Yang , Jingyi Zhu , Letian Yang , Xukai Jiang

Recent advancements in Large Language Model~(LLM)-based Multi-Agent Systems (MAS) have demonstrated remarkable potential for tackling complex decision-making tasks. However, existing frameworks inevitably rely on serialized execution…

Artificial Intelligence · Computer Science 2026-03-10 Yaoru Li , Shunyu Liu , Tongya Zheng , Li Sun , Mingli Song

The evolution of Large Language Models (LLMs) into autonomous agents necessitates the management of extensive, dynamic contexts. Current benchmarks, however, remain largely static, relying on passive retrieval tasks that fail to simulate…

Computation and Language · Computer Science 2026-02-02 Shicheng Fang , Yuxin Wang , Xiaoran Liu , Jiahao Lu , Chuanyuan Tan , Xinchi Chen , Yining Zheng , Xuanjing Huang , Xipeng Qiu

Memory plays a pivotal role in enabling large language model~(LLM)-based agents to engage in complex and long-term interactions, such as question answering (QA) and dialogue systems. While various memory modules have been proposed for these…

Computation and Language · Computer Science 2024-12-23 Ruihong Zeng , Jinyuan Fang , Siwei Liu , Zaiqiao Meng

With large language models (LLMs) demonstrating remarkable capabilities, there has been a surge in research on leveraging LLMs to build general-purpose multi-modal agents. However, existing approaches either rely on computationally…

Artificial Intelligence · Computer Science 2025-05-29 Changze Qiao , Mingming Lu

Large language model (LLM) based agents have shown great potential in following human instructions and automatically completing various tasks. To complete a task, the agent needs to decompose it into easily executed steps by planning.…

Computation and Language · Computer Science 2025-06-02 Weihong Du , Wenrui Liao , Binyu Yan , Hongru Liang , Anthony G. Cohn , Wenqiang Lei

Multimedia event extraction (M2E2) aims to predict triggers, ground arguments across text and images, and then assemble them into schema-consistent event records. Recent LLM-based approaches have shown strong potential for M2E2, but their…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Hailong Chu , Hongbing Li , Yunlong Chu , Shutai Huang , Xingyue Zhang , Tinghe Yan , Jinsong Zhang , Shuo Zhang , Lei Li

As LLM agents scale to long-horizon, multi-session deployments, efficiently managing accumulated experience becomes a critical bottleneck. Agent memory systems and agent skill discovery both address this challenge -- extracting reusable…

Artificial Intelligence · Computer Science 2026-04-20 Xing Zhang , Guanghui Wang , Yanwei Cui , Wei Qiu , Ziyuan Li , Bing Zhu , Peiyang He

Clinical image interpretation is inherently multi-step and tool-centric: clinicians iteratively combine visual evidence with patient context, quantify findings, and refine their decisions through a sequence of specialized procedures. While…

Artificial Intelligence · Computer Science 2026-03-09 Lin Fan , Pengyu Dai , Zhipeng Deng , Haolin Wang , Xun Gong , Yefeng Zheng , Yafei Ou

As LLM-based agents are increasingly used in long-term interactions, cumulative memory is critical for enabling personalization and maintaining stylistic consistency. However, most existing systems adopt an ``all-or-nothing'' approach to…

Artificial Intelligence · Computer Science 2026-01-09 Muzhao Tian , Zisu Huang , Xiaohua Wang , Jingwen Xu , Zhengkang Guo , Qi Qian , Yuanzhe Shen , Kaitao Song , Jiakang Yuan , Changze Lv , Xiaoqing Zheng

Large Language Models (LLMs) based agents have demonstrated remarkable potential in autonomous task-solving across complex, open-ended environments. A promising approach for improving the reasoning capabilities of LLM agents is to better…

Computation and Language · Computer Science 2025-11-12 Siyu Xia , Zekun Xu , Jiajun Chai , Wentian Fan , Yan Song , Xiaohan Wang , Guojun Yin , Wei Lin , Haifeng Zhang , Jun Wang

Programming robot behavior in a complex world faces challenges on multiple levels, from dextrous low-level skills to high-level planning and reasoning. Recent pre-trained Large Language Models (LLMs) have shown remarkable reasoning ability…

Robotics · Computer Science 2023-10-12 Xufeng Zhao , Mengdi Li , Cornelius Weber , Muhammad Burhan Hafez , Stefan Wermter

Embodied task planning requires agents to execute long-horizon, goal-directed actions in complex 3D environments, where success depends on both immediate perception and accumulated experience across tasks. However, most existing LLM-based…

Robotics · Computer Science 2026-04-21 Xiaoyu Ma , Lianyu Hu , Wenbing Tang , Zixuan Hu , Zeqin Liao , Zhizhen Wu , Yang Liu

Vision-language models (VLMs) have shown remarkable general capabilities, yet embodied agents built on them fail at complex tasks, often skipping critical steps, proposing invalid actions, and repeating mistakes. These failures arise from a…

Artificial Intelligence · Computer Science 2026-03-26 Bingqing Wei , Zhongyu Xia , Dingai Liu , Xiaoyu Zhou , Zhiwei Lin , Yongtao Wang

Agentic frameworks powered by Large Language Models (LLMs) can be useful tools in scientific workflows by enabling human-AI co-creation. A key challenge is recommending the next steps during workflow creation without relying solely on LLMs,…

The captivating realm of Minecraft has attracted substantial research interest in recent years, serving as a rich platform for developing intelligent agents capable of functioning in open-world environments. However, the current research…

Artificial Intelligence · Computer Science 2023-06-02 Xizhou Zhu , Yuntao Chen , Hao Tian , Chenxin Tao , Weijie Su , Chenyu Yang , Gao Huang , Bin Li , Lewei Lu , Xiaogang Wang , Yu Qiao , Zhaoxiang Zhang , Jifeng Dai

Decision Transformer-based decision-making agents have shown the ability to generalize across multiple tasks. However, their performance relies on massive data and computation. We argue that this inefficiency stems from the forgetting…

Machine Learning · Computer Science 2024-05-30 Jikun Kang , Romain Laroche , Xingdi Yuan , Adam Trischler , Xue Liu , Jie Fu

Self-evolving memory systems are unprecedentedly reshaping the evolutionary paradigm of large language model (LLM)-based agents. Prior work has predominantly relied on manually engineered memory architectures to store trajectories, distill…

Computation and Language · Computer Science 2025-12-23 Guibin Zhang , Haotian Ren , Chong Zhan , Zhenhong Zhou , Junhao Wang , He Zhu , Wangchunshu Zhou , Shuicheng Yan

Owing to recent advancements, Large Language Models (LLMs) can now be deployed as agents for increasingly complex decision-making applications in areas including robotics, gaming, and API integration. However, reflecting past experiences in…

We introduce Emergent Trust Learning (ETL), a lightweight, trust-based control algorithm that can be plugged into existing AI agents. It enables these to reach cooperation in competitive game environments under shared resources. Each agent…

Multiagent Systems · Computer Science 2026-03-19 Qianpu Chen , Giulio Barbero , Mike Preuss , Derya Soydaner