English
Related papers

Related papers: WebCoach: Self-Evolving Web Agents with Cross-Sess…

200 papers

Long-term memory is crucial for agents in specialized web environments, where success depends on recalling interface affordances, state dynamics, workflows, and recurring failure modes. However, existing memory benchmarks for agents mostly…

Computation and Language · Computer Science 2026-05-13 Di Wu , Zixiang Ji , Asmi Kawatkar , Bryan Kwan , Jia-Chen Gu , Nanyun Peng , Kai-Wei Chang

Building LLM-based agents has become increasingly important. Recent works on LLM-based agent self-evolution primarily record successful experiences as textual prompts or reflections, which cannot reliably guarantee efficient task…

Artificial Intelligence · Computer Science 2026-03-19 Zhang Zhang , Shuqi Lu , Hongjin Qian , Di He , Zheng Liu

AI agents increasingly operate over extended time horizons, yet their ability to retain, organize, and recall multimodal experiences remains a critical bottleneck. Building effective lifelong memory requires navigating a vast design space…

Artificial Intelligence · Computer Science 2026-04-03 Jiaqi Liu , Zipeng Ling , Shi Qiu , Yanqing Liu , Siwei Han , Peng Xia , Haoqin Tu , Zeyu Zheng , Cihang Xie , Charles Fleming , Mingyu Ding , Huaxiu Yao

Experience-driven learning has emerged as a promising paradigm for enabling agents to improve from interaction trajectories by accumulating and reusing past experience. However, existing approaches are predominantly developed in textual…

Artificial Intelligence · Computer Science 2026-05-19 Xingyu Sui , Weixiang Zhao , Yongxin Tang , Yanyan Zhao , Yang Wu , Dandan Tu , Bing Qin

Recent success in large multimodal models (LMMs) has sparked promising applications of agents capable of autonomously completing complex web tasks. While open-source LMM agents have made significant advances in offline evaluation…

Artificial Intelligence · Computer Science 2025-06-02 Vardaan Pahuja , Yadong Lu , Corby Rosset , Boyu Gou , Arindam Mitra , Spencer Whitehead , Yu Su , Ahmed Awadallah

We study how to endow GUI agents with scalable memory that help generalize across unfamiliar interfaces and long-horizon tasks. Prior GUI agents compress past trajectories into text tokens, which balloons context length and misses decisive…

Artificial Intelligence · Computer Science 2025-10-13 Wenyi Wu , Kun Zhou , Ruoxin Yuan , Vivian Yu , Stephen Wang , Zhiting Hu , Biwei Huang

We propose the problem of conversational web navigation, where a digital agent controls a web browser and follows user instructions to solve real-world tasks in a multi-turn dialogue fashion. To support this problem, we introduce WEBLINX -…

Computation and Language · Computer Science 2025-09-24 Xing Han Lù , Zdeněk Kasner , Siva Reddy

As LLM-based agents are increasingly deployed in real-life scenarios, existing benchmarks fail to capture their inherent complexity of handling extensive information, leveraging diverse resources, and managing dynamic user interactions. To…

Computation and Language · Computer Science 2025-10-20 Wei He , Yueqing Sun , Hongyan Hao , Xueyuan Hao , Zhikang Xia , Qi Gu , Chengcheng Han , Dengchang Zhao , Hui Su , Kefeng Zhang , Man Gao , Xi Su , Xiaodong Cai , Xunliang Cai , Yu Yang , Yunke Zhao

Multimodal large language models (MLLMs) are attracting growing attention in the development of Graphical User Interface (GUI) agents. Existing approaches often rely on historical screenshots or actions to implicitly represent the task…

Artificial Intelligence · Computer Science 2025-06-24 Xinzge Gao , Chuanrui Hu , Bin Chen , Teng Li

The popularity of Large Language Models (LLMs) have unleashed a new age ofLanguage Agents for solving a diverse range of tasks. While contemporary frontier LLMs are capable enough to power reasonably good Language agents, the closed-API…

Computation and Language · Computer Science 2024-10-11 Priyanshu Gupta , Shashank Kirtania , Ananya Singha , Sumit Gulwani , Arjun Radhakrishna , Sherry Shi , Gustavo Soares

Web agents enable users to perform tasks on web browsers through natural language interaction. Evaluating web agents trajectories is an important problem, since it helps us determine whether the agent successfully completed the tasks.…

Large Language Model (LLM) agents have shown significant autonomous capabilities in dynamically searching and incorporating relevant tools or Model Context Protocol (MCP) servers for individual queries. However, fixed context windows limit…

Computation and Language · Computer Science 2025-07-30 Elias Lumer , Anmol Gulati , Vamse Kumar Subbiah , Pradeep Honaganahalli Basavaraju , James A. Burke

The current state of modern web interfaces, especially in regards to accessibility focused usage is extremely lacking. Traditional methods for web interaction, such as scripting languages and screen readers, often lack the flexibility to…

Artificial Intelligence · Computer Science 2025-07-08 Trisanth Srinivasan , Santosh Patapati

Multimodal large language models are increasingly deployed as long-horizon agents, where memory must do more than recall: it must track an evolving world, revise what has gone stale, and surface the right evidence at decision time. Existing…

Recent advances in large language models (LLMs) have led to a growing interest in developing LLM-based agents for automating web tasks. However, these agents often struggle with even simple tasks on real-world websites due to their limited…

Computation and Language · Computer Science 2025-12-22 Dongjun Lee , Juyong Lee , Kyuyoung Kim , Jihoon Tack , Jinwoo Shin , Yee Whye Teh , Kimin Lee

LLM-based autonomous agents have demonstrated strong capabilities in reasoning, planning, and tool use, yet remain limited when tasks require sustained coordination across roles, tools, and environments. Multi-agent systems address this…

Existing agent memory systems universally follow what we term a Memory-as-Tool paradigm where a single query triggers one-shot retrieval of flat passage lists, suffering from passive invocation, reasoning-retrieval decoupling, and…

Artificial Intelligence · Computer Science 2026-05-28 Zihan Li , Xingyu Fan , Feifei Li , Wenhui Que

Embodied task planning requires agents to execute long-horizon, goal-directed actions in complex 3D environments, where success depends on both immediate perception and accumulated experience across tasks. However, most existing LLM-based…

Robotics · Computer Science 2026-04-21 Xiaoyu Ma , Lianyu Hu , Wenbing Tang , Zixuan Hu , Zeqin Liao , Zhizhen Wu , Yang Liu

In practical LLM applications, users repeatedly express stable preferences and requirements, such as reducing hallucinations, following institutional writing conventions, or avoiding overly technical wording, yet such interaction experience…

Artificial Intelligence · Computer Science 2026-03-06 Yutao Yang , Junsong Li , Qianjun Pan , Bihao Zhan , Yuxuan Cai , Lin Du , Jie Zhou , Kai Chen , Qin Chen , Xin Li , Bo Zhang , Liang He

Large Language Model (LLM)-based web agents excel at knowledge-intensive tasks but face a fundamental conflict between the need for extensive exploration and the constraints of limited context windows. Current solutions typically rely on…