English
Related papers

Related papers: Enhancing Web Agents with a Hierarchical Memory Tr…

200 papers

Memory emerges as the core module in the Large Language Model (LLM)-based agents for long-horizon complex tasks (e.g., multi-turn dialogue, game playing, scientific discovery), where memory can enable knowledge accumulation, iterative…

Training LLMs as interactive agents for multi-turn decision-making remains challenging, particularly in long-horizon tasks with sparse and delayed rewards, where agents must execute extended sequences of actions before receiving meaningful…

Machine Learning · Computer Science 2026-05-12 Jiangweizhi Peng , Yuanxin Liu , Ruida Zhou , Charles Fleming , Zhaoran Wang , Alfredo Garcia , Mingyi Hong

Web agents powered by Large Language Models (LLMs) have demonstrated remarkable abilities in planning and executing multi-step interactions within complex web-based environments, fulfilling a wide range of web navigation tasks. Despite…

Computation and Language · Computer Science 2024-02-26 Yang Deng , Xuan Zhang , Wenxuan Zhang , Yifei Yuan , See-Kiong Ng , Tat-Seng Chua

Multimodal Large Language Models (MLLMs) based agents have demonstrated remarkable potential in autonomous web navigation. However, handling long-horizon tasks remains a critical bottleneck. Prevailing strategies often rely heavily on…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Dawei Yan , Haokui Zhang , Guangda Huzhang , Yang Li , Yibo Wang , Qing-Guo Chen , Zhao Xu , Weihua Luo , Ying Li , Wei Dong , Chunhua Shen

Large language models (LLMs) have shown limitations in tasks requiring complex logical reasoning and multi-step problem-solving. To address these challenges, researchers have employed carefully designed prompts and flowcharts, simulating…

Computation and Language · Computer Science 2024-12-06 Changcheng Li , Xiangyu Wang , Qiuju Chen , Xiren Zhou , Huanhuan Chen

Multi-modal multi-agent systems (MM-MAS) have gained increasing attention for their capacity to enable complex reasoning and coordination across diverse modalities. As these systems continue to expand in scale and functionality,…

Artificial Intelligence · Computer Science 2026-05-15 Hao Zhou , Tiru Wu , Yan Jiang , Wanqi Zhou , Junxing Hu , Ai Han

Large Language Models (LLMs) have significantly advanced tool-augmented agents, enabling autonomous reasoning via API interactions. However, executing multi-step tasks within massive tool libraries remains challenging due to two critical…

Artificial Intelligence · Computer Science 2026-04-15 Rongzhe Wei , Ge Shi , Min Cheng , Na Zhang , Pan Li , Sarthak Ghosh , Vaibhav Gorde , Leman Akoglu

In this study, we propose a novel human-like memory architecture designed for enhancing the cognitive abilities of large language model based dialogue agents. Our proposed architecture enables agents to autonomously recall memories…

Human-Computer Interaction · Computer Science 2024-04-02 Yuki Hou , Haruki Tamoto , Homei Miyashita

Large Language Models (LLMs) often produce answers with a single chain-of-thought, which restricts their ability to explore reasoning paths or self-correct flawed outputs in complex tasks. In this paper, we introduce MALT (Multi-Agent LLM…

We introduce a novel large language model (LLM)-driven agent framework, which iteratively refines queries and filters contextual evidence by leveraging dynamically evolving knowledge. A defining feature of the system is its decoupling of…

Artificial Intelligence · Computer Science 2025-04-02 Seyoung Song

Memory networks are neural networks with an explicit memory component that can be both read and written to by the network. The memory is often addressed in a soft way using a softmax function, making end-to-end training with backpropagation…

Machine Learning · Statistics 2016-05-25 Sarath Chandar , Sungjin Ahn , Hugo Larochelle , Pascal Vincent , Gerald Tesauro , Yoshua Bengio

Hierarchical Multiscale LSTM (Chung et al., 2016a) is a state-of-the-art language model that learns interpretable structure from character-level input. Such models can provide fertile ground for (cognitive) computational linguistics…

Computation and Language · Computer Science 2018-07-11 Ákos Kádár , Marc-Alexandre Côté , Grzegorz Chrupała , Afra Alishahi

Multi-agent systems (MAS) built on large language models (LLMs) have shown strong performance across many tasks. Most existing approaches improve only one aspect at a time, such as the communication topology, role assignment, or LLM…

Multiagent Systems · Computer Science 2026-02-25 Tianjun Yao , Zhaoyi Li , Zhiqiang Shen

Continual learning is an essential capability of human cognition, yet it poses significant challenges for current deep learning models. The primary issue is that new knowledge can interfere with previously learned information, causing the…

Machine Learning · Computer Science 2025-09-19 Eric Nuertey Coleman , Luigi Quarantiello , Samrat Mukherjee , Julio Hurtado , Vincenzo Lomonaco

Large language models (LLMs) have shown great progress in responding to user questions, allowing for a multitude of diverse applications. Yet, the quality of LLM outputs heavily depends on the prompt design, where a good prompt might enable…

Computation and Language · Computer Science 2025-04-16 Yuchi Liu , Jaskirat Singh , Gaowen Liu , Ali Payani , Liang Zheng

Long-term conversational large language model (LLM) agents require memory systems that can recover relevant evidence from historical interactions without overwhelming the answer stage with irrelevant context. However, existing memory…

Computation and Language · Computer Science 2026-04-23 Shuqi Cao , Jingyi He , Fei Tan

Large Language Models (LLMs) have demonstrated significant potential as autonomous software engineering (SWE) agents. Recent work has further explored augmenting these agents with memory mechanisms to support long-horizon reasoning.…

Software Engineering · Computer Science 2026-02-26 Kangning Shen , Jingyuan Zhang , Chenxi Sun , Wencong Zeng , Yang Yue

Memory is a fundamental component for enabling long-context LLM agents, supporting persistent state across interactions through a continuous serve-and-update lifecycle. Despite substantial prior work, existing systems suffer from…

Databases · Computer Science 2026-05-26 Han Chen , Zining Zhang , Wenqi Pei , Bingsheng He , Ming Wu , Jason Zeng , Michael Heinrich , Wei Wu , Hongbao Zhang

LLM-based agents have been extensively applied across various domains, where memory stands out as one of their most essential capabilities. Previous memory mechanisms of LLM-based agents are manually predefined by human experts, leading to…

Machine Learning · Computer Science 2025-08-26 Zeyu Zhang , Quanyu Dai , Rui Li , Xiaohe Bo , Xu Chen , Zhenhua Dong

While large language model (LLM) agents can effectively use external tools for complex real-world tasks, they require memory systems to leverage historical experiences. Current memory systems enable basic storage and retrieval but lack…

Computation and Language · Computer Science 2025-10-09 Wujiang Xu , Zujie Liang , Kai Mei , Hang Gao , Juntao Tan , Yongfeng Zhang