English
Related papers

Related papers: Enhancing Web Agents with a Hierarchical Memory Tr…

200 papers

Multi-agent reinforcement learning (MARL) methods struggle with the non-stationarity of multi-agent systems and fail to adaptively learn online when tested with novel agents. Here, we leverage large language models (LLMs) to create an…

Artificial Intelligence · Computer Science 2024-12-13 Logan Cross , Violet Xiang , Agam Bhatia , Daniel LK Yamins , Nick Haber

Contemporary multi-agent systems encounter persistent challenges in cross-platform interoperability, dynamic task scheduling, and efficient resource sharing. Agents with heterogeneous implementations often lack standardized interfaces;…

Artificial Intelligence · Computer Science 2025-07-08 Yuyang Cheng , Yumiao Xu , Chaojia Yu , Yong Zhao

Transformative innovations in model architectures have introduced hierarchical embedding augmentation as a means to redefine the representation of tokens through multi-level semantic structures, offering enhanced adaptability to complex…

Computation and Language · Computer Science 2025-08-11 Derek Yotheringhay , Alistair Kirkland , Humphrey Kirkbride , Josiah Whitesteeple

Providing explanations is considered an imperative ability for an AI agent in a human-robot teaming framework. The right explanation provides the rationale behind an AI agent's decision-making. However, to maintain the human teammate's…

Artificial Intelligence · Computer Science 2021-03-01 Mehrdad Zakershahrak , Samira Ghodratnama

Learning to solve long horizon temporally extended tasks with reinforcement learning has been a challenge for several years now. We believe that it is important to leverage both the hierarchical structure of complex tasks and to use expert…

Machine Learning · Computer Science 2022-10-18 Bharat Prakash , Nicholas Waytowich , Tim Oates , Tinoosh Mohsenin

Recent advancements in large language models (LLMs) have empowered autonomous web agents to execute natural language instructions directly on real-world webpages. However, existing agents often struggle with complex tasks involving dynamic…

Artificial Intelligence · Computer Science 2026-04-22 Lingfeng Zhang , Yongan Sun , Jinpeng Hu , Hui Ma , Yang Ying , Kuien Liu , Zenglin Shi , Meng Wang

Large language model (LLM)-based agents have demonstrated remarkable capabilities in decision-making tasks, but struggle significantly with complex, long-horizon planning scenarios. This arises from their lack of macroscopic guidance,…

Computation and Language · Computer Science 2025-08-27 Ziyue Li , Yuan Chang , Gaihong Yu , Xiaoqiu Le

Online video understanding requires models to perform continuous perception and long-range reasoning within potentially infinite visual streams. Its fundamental challenge lies in the conflict between the unbounded nature of streaming media…

Computer Vision and Pattern Recognition · Computer Science 2026-02-18 Siwei Wen , Zhangcheng Wang , Xingjian Zhang , Lei Huang , Wenjun Wu

Hierarchical Task Network (HTN) planning is a popular approach that cuts down on the classical planning search space by relying on a given hierarchical library of domain control knowledge. This provides an intuitive methodology for…

Robotics · Computer Science 2014-06-13 Raphaël Lallement , Lavindra de Silva , Rachid Alami

Agentic code generation requires large language models (LLMs) capable of complex context management and multi-step reasoning. Prior multi-agent frameworks attempt to address these challenges through collaboration, yet they often suffer from…

Software Engineering · Computer Science 2026-01-13 Ming-Tung Shen , Yuh-Jzer Joung

While large language model-based multi-agent systems have shown strong potential for complex reasoning, how to effectively organize multiple agents remains an open question. In this paper, we introduce OrgAgent, a company-style hierarchical…

Multiagent Systems · Computer Science 2026-04-02 Yiru Wang , Xinyue Shen , Yaohui Han , Michael Backes , Pin-Yu Chen , Tsung-Yi Ho

Hierarchical Reinforcement Learning (HRL) is well-suitedd for solving complex tasks by breaking them down into structured policies. However, HRL agents often struggle with efficient exploration and quick adaptation. To overcome these…

Machine Learning · Computer Science 2025-03-18 Arash Khajooeinejad , Fatemeh Sadat Masoumi , Masoumeh Chapariniya

Large Language Models (LLMs) based agents excel at diverse tasks, yet they suffer from brittle procedural memory that is manually engineered or entangled in static parameters. In this work, we investigate strategies to endow agents with a…

Computation and Language · Computer Science 2026-04-16 Runnan Fang , Yuan Liang , Xiaobin Wang , Jialong Wu , Shuofei Qiao , Pengjun Xie , Fei Huang , Huajun Chen , Ningyu Zhang

While language models (LMs) have shown potential across a range of decision-making tasks, their reliance on simple acting processes limits their broad deployment as autonomous agents. In this paper, we introduce Language Agent Tree Search…

Artificial Intelligence · Computer Science 2024-06-07 Andy Zhou , Kai Yan , Michal Shlapentokh-Rothman , Haohan Wang , Yu-Xiong Wang

Collective learning can be greatly enhanced when agents effectively exchange knowledge with their peers. In particular, recent work studying agents that learn to teach other teammates has demonstrated that action advising accelerates…

Understanding and predicting human actions has been a long-standing challenge and is a crucial measure of perception in robotics AI. While significant progress has been made in anticipating the future actions of individual agents, prior…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Zirui Wang , Xinran Zhao , Simon Stepputtis , Woojun Kim , Tongshuang Wu , Katia Sycara , Yaqi Xie

Many recent long-context and agentic systems address context-length limitations by adding hierarchical memory: they extract atomic units from raw data, build multi-level representatives by grouping and compression, and traverse this…

Information Retrieval · Computer Science 2026-03-24 Yashar Talebirad , Ali Parsaee , Csongor Y. Szepesvari , Amirhossein Nadiri , Osmar Zaiane

Hierarchical multi-agent systems (HMAS) organize collections of agents into layered structures that help manage complexity and scale. These hierarchies can simplify coordination, but they also can introduce trade-offs that are not always…

Multiagent Systems · Computer Science 2025-08-19 David J. Moore

Conventional AI-driven AMS design automation algorithms remain constrained by their reliance on high-quality datasets to capture underlying circuit behavior, coupled with poor transferability across architectures, and a lack of adaptive…

Artificial Intelligence · Computer Science 2026-03-30 Souradip Poddar , Chia-Tung Ho , Ziming Wei , Weidong Cao , Haoxing Ren , David Z. Pan

Reasoning, the process of devising and executing complex goal-oriented action sequences, remains a critical challenge in AI. Current large language models (LLMs) primarily employ Chain-of-Thought (CoT) techniques, which suffer from brittle…

Artificial Intelligence · Computer Science 2025-08-05 Guan Wang , Jin Li , Yuhao Sun , Xing Chen , Changling Liu , Yue Wu , Meng Lu , Sen Song , Yasin Abbasi Yadkori