English
Related papers

Related papers: Structured Distillation of Web Agent Capabilities …

200 papers

System Instructions (SIs), or system prompts, are pivotal for guiding Large Language Models (LLMs) but manual crafting is resource-intensive and often suboptimal. Existing automated methods frequently generate non-human-readable "soft…

Artificial Intelligence · Computer Science 2025-07-08 Jeshwanth Challagundla

Large language models (LLMs) exhibit strong capabilities as decision-making agents by interleaving reasoning and actions, as seen in ReAct-style frameworks. Yet, their practical deployment is constrained by high inference costs and large…

Machine Learning · Computer Science 2026-05-28 Jun Liu , Zhenglun Kong , Peiyan Dong , Changdi Yang , Tianqi Li , Hao Tang , Geng Yuan , Wei Niu , Wenbin Zhang , Pu Zhao , Xue Lin , Dong Huang , Yanzhi Wang

To fulfill user instructions, autonomous web agents must contend with the inherent complexity and volatile nature of real-world websites. Conventional paradigms predominantly rely on Supervised Fine-Tuning (SFT) or Offline Reinforcement…

Artificial Intelligence · Computer Science 2026-05-01 Yuyu Guo , Wenjie Yang , Siyuan Yang , Ziyang Liu , Cheng Chen , Yuan Wei , Yun Hu , Yang Huang , Guoliang Hao , Dongsheng Yuan , Jianming Wang , Xin Chen , Hang Yu , Lei Lei , Peng Di

Training models to act as agents that can effectively navigate and perform actions in a complex environment, such as a web browser, has typically been challenging due to lack of training data. Large language models (LLMs) have recently…

With advances in generative AI, there is now potential for autonomous agents to manage daily tasks via natural language commands. However, current agents are primarily created and tested in simplified synthetic environments, leading to a…

Artificial Intelligence · Computer Science 2024-04-17 Shuyan Zhou , Frank F. Xu , Hao Zhu , Xuhui Zhou , Robert Lo , Abishek Sridhar , Xianyi Cheng , Tianyue Ou , Yonatan Bisk , Daniel Fried , Uri Alon , Graham Neubig

Language agents increasingly act as web-enabled systems that search, browse, and synthesize information from diverse sources. However, these sources can include unreliable or adversarial content, and the robustness of agents to adversarial…

Artificial Intelligence · Computer Science 2026-03-03 Shrey Shah , Levent Ozgur

Fine-tuning on agent-environment interaction trajectory data holds significant promise for surfacing generalized agent capabilities in open-source large language models (LLMs). In this work, we introduce AgentBank, by far the largest…

Computation and Language · Computer Science 2024-10-11 Yifan Song , Weimin Xiong , Xiutian Zhao , Dawei Zhu , Wenhao Wu , Ke Wang , Cheng Li , Wei Peng , Sujian Li

Language agents have demonstrated autonomous decision-making abilities by reasoning with foundation models. Recently, efforts have been made to train language agents for performance improvement, with multi-step reasoning and action…

Artificial Intelligence · Computer Science 2024-04-02 Zonghan Yang , Peng Li , Ming Yan , Ji Zhang , Fei Huang , Yang Liu

Large Language Model agents increasingly operate external systems through programmatic interfaces, yet practitioners lack empirical guidance on how to structure the context these agents consume. Using SQL generation as a proxy for…

Computation and Language · Computer Science 2026-02-13 Damon McMillan

Large language models (LLMs) show remarkable potential to act as computer agents, enhancing human productivity and software accessibility in multi-modal tasks that require planning and reasoning. However, measuring agent performance in…

Large language models (LLMs)-empowered web agents enables automating complex, real-time web navigation tasks in enterprise environments. However, existing web agents relying on supervised fine-tuning (SFT) often struggle with generalization…

Computation and Language · Computer Science 2025-06-10 Yuchen Zhuang , Di Jin , Jiaao Chen , Wenqi Shi , Hanrui Wang , Chao Zhang

Web browsing agents powered by large language models (LLMs) have shown tremendous potential in automating complex web-based tasks. Existing approaches typically rely on large LLMs (e.g., GPT-4o) to explore web environments and generate…

Multiagent Systems · Computer Science 2025-03-10 Ruichen Zhang , Mufan Qiu , Zhen Tan , Mohan Zhang , Vincent Lu , Jie Peng , Kaidi Xu , Leandro Z. Agudelo , Peter Qian , Tianlong Chen

Data annotation remains a significant bottleneck in the Humanities and Social Sciences, particularly for complex semantic tasks such as metaphor identification. While Large Language Models (LLMs) show promise, a significant gap remains…

Computation and Language · Computer Science 2026-02-06 Bingru Li

Advancing complex reasoning in large language models relies on high-quality, verifiable datasets, yet human annotation remains cost-prohibitive and difficult to scale. Current synthesis paradigms often face a recurring trade-off:…

Artificial Intelligence · Computer Science 2026-02-04 Zhengbo Jiao , Shaobo Wang , Zifan Zhang , Xuan Ren , Wei Wang , Bing Zhao , Hu Wei , Linfeng Zhang

For agentic systems to use external tools to solve complex, long-horizon tasks, we need a large set of diverse and controllable tool-use environments. We introduce SynthTools, a fully LLM-based pipeline spanning the entire lifecycle:…

Artificial Intelligence · Computer Science 2026-05-28 Tommaso Castellani , Naimeng Ye , Daksh Mittal , Thomson Yen , Emmanouil Koukoumidis , William Zeng , Hongseok Namkoong

Recent success in large multimodal models (LMMs) has sparked promising applications of agents capable of autonomously completing complex web tasks. While open-source LMM agents have made significant advances in offline evaluation…

Artificial Intelligence · Computer Science 2025-06-02 Vardaan Pahuja , Yadong Lu , Corby Rosset , Boyu Gou , Arindam Mitra , Spencer Whitehead , Yu Su , Ahmed Awadallah

Mastering terminal environments requires language agents capable of multi-step planning, feedback-grounded execution, and dynamic state adaptation. However, training such agents is currently bottlenecked by a reliance on scraped external…

Computation and Language · Computer Science 2026-05-29 Xiaoxuan Peng , Kaiqi Zhang , Xinyu Lu , Boxi Cao , Yaojie Lu , Hongyu Lin , Xianpei Han , Le Sun

Equipping LLMs with tool-use capabilities via Agentic Reinforcement Learning (Agentic RL) is bottlenecked by two challenges: the lack of scalable, robust execution environments and the scarcity of realistic training data that captures…

Recent advances in large language model (LLM) have empowered autonomous agents to perform multi-turn interactions with tools and environments. However, scaling such agent training is limited by the lack of diverse and reliable environments.…

Artificial Intelligence · Computer Science 2026-05-26 Zhaoyang Wang , Canwen Xu , Boyi Liu , Yite Wang , Siwei Han , Zhewei Yao , Huaxiu Yao , Yuxiong He

Structured LLM routing is often treated as a prompt-engineering problem. We argue that it is, more fundamentally, a systems-level burden-allocation problem. As large language models (LLMs) become core control components in agentic AI…

Artificial Intelligence · Computer Science 2026-04-03 Zhou Hanlin , Chan Huah Yong