English
Related papers

Related papers: AgentTrek: Agent Trajectory Synthesis via Guiding …

200 papers

We present WebGym, the largest-to-date open-source environment for training realistic visual web agents. Real websites are non-stationary and diverse, making artificial or small-scale task sets insufficient for robust policy learning.…

Machine Learning · Computer Science 2026-05-05 Hao Bai , Alexey Taymanov , Tong Zhang , Aviral Kumar , Spencer Whitehead

The rise of agentic AI workflows unlocks novel opportunities for computer systems design and optimization. However, for specialized domains such as program synthesis, the relative scarcity of HDL and proprietary EDA resources online…

Hardware Architecture · Computer Science 2025-09-25 Amulya Bhattaram , Janani Ramamoorthy , Ranit Gupta , Diana Marculescu , Dimitrios Stamoulis

Retrieval-augmented generation (RAG) systems have advanced large language models (LLMs) in complex deep search scenarios requiring multi-step reasoning and iterative information retrieval. However, existing approaches face critical…

Computation and Language · Computer Science 2025-10-09 Shuang Sun , Huatong Song , Yuhao Wang , Ruiyang Ren , Jinhao Jiang , Junjie Zhang , Fei Bai , Jia Deng , Wayne Xin Zhao , Zheng Liu , Lei Fang , Zhongyuan Wang , Ji-Rong Wen

As real-world datasets become more complex and heterogeneous, supervised learning is often bottlenecked by input representation design. Modeling multimodal data, such as time-series, free text, and structured records, often requires…

Artificial Intelligence · Computer Science 2026-05-22 Ilker Demirel , Lawrence Shi , Zeshan Hussain , David Sontag

Existing benchmarks for grounding language in interactive environments either lack real-world linguistic elements, or prove difficult to scale up due to substantial human involvement in the collection of data or feedback signals. To bridge…

Computation and Language · Computer Science 2023-02-09 Shunyu Yao , Howard Chen , John Yang , Karthik Narasimhan

While existing text-to-speech (TTS) models exhibit high expressiveness, fine-grained control over composite instructions remains challenging due to the structural mismatch between discrete textual intents and continuous acoustic…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Bin Kang , Shaoguo Wen , Yang Fan , Shunlong Wu , Junjie Wang , Yulin Li , Junzhi Zhao , Junle Wang , Zhuotao Tian

Long-horizon GUI agents are a key step toward real-world deployment, yet effective interaction memory under prevailing paradigms remains under-explored. Replaying full interaction sequences is redundant and amplifies noise, while summaries…

Recent advancements in Graphical User Interface (GUI) agents have predominantly focused on training paradigms like supervised fine-tuning (SFT) and reinforcement learning (RL). However, the challenge of high-dynamic GUI environments remains…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Enqi Liu , Liyuan Pan , Zhi Gao , Yan Yang , Chenrui Shi , Yang Liu , Jingrong Wu , Qing Li

Large language models (LLMs) are increasingly used as tool-augmented agents for multi-step decision making, yet training robust tool-using agents remains challenging. Existing methods still require manual intervention, depend on…

In this work, we present a test-driven, agentic framework for synthesizing a deployable low-level robot controller for navigation tasks. Given a 2D map with an image of an ultrasonic sensor-based robot, or a 3D robotic simulation…

Robotics · Computer Science 2026-03-03 Shivanshu Tripathi , Reza Akbarian Bafghi , Maziar Raissi

Vision-and-Language Navigation (VLN) is an essential skill for embodied agents, allowing them to navigate in 3D environments following natural language instructions. High-performance navigation models require a large amount of training…

Artificial Intelligence · Computer Science 2025-03-10 Zihan Wang , Yaohui Zhu , Gim Hee Lee , Yachun Fan

A key theme in the past decade has been that when large neural networks and large datasets combine they can produce remarkable results. In deep reinforcement learning (RL), this paradigm is commonly made possible through experience replay,…

Machine Learning · Computer Science 2023-10-30 Cong Lu , Philip J. Ball , Yee Whye Teh , Jack Parker-Holder

Recent years, multimodal models have made remarkable strides and pave the way for intelligent browser use agents. However, when solving tasks on real world webpages in multi-turn, long-horizon trajectories, current agents still suffer from…

Artificial Intelligence · Computer Science 2025-09-26 Kaiwen He , Zhiwei Wang , Chenyi Zhuang , Jinjie Gu

Large vision-language models have endowed GUI agents with strong general capabilities for interface understanding and interaction. However, due to insufficient exposure to domain-specific software operation data during training, these…

Artificial Intelligence · Computer Science 2026-04-01 Rui Xie , Zhi Gao , Chenrui Shi , Zirui Shang , Lu Chen , Qing Li

Graphical User Interface (GUI) agents show great potential for enabling foundation models to complete real-world tasks, revolutionizing human-computer interaction and improving human productivity. In this report, we present OmegaUse, a…

The predominant approach for training web navigation agents is to gather human demonstrations for a set of popular websites and hand-written tasks, but it is becoming clear that human data is an inefficient resource. We develop a pipeline…

Machine Learning · Computer Science 2025-05-23 Brandon Trabucco , Gunnar Sigurdsson , Robinson Piramuthu , Ruslan Salakhutdinov

Vision-language model (VLM) based GUI agents show promise for automating complex desktop and mobile tasks, but face significant challenges in applying reinforcement learning (RL): (1) slow multi-turn interactions with GUI environments for…

Visual documentation is an effective tool for reducing the cognitive barrier developers face when understanding unfamiliar code, enabling more intuitive comprehension. Compared to textual documentation, it provides a higher-level…

Software Engineering · Computer Science 2025-09-16 Luís F. Gomes , Xin Zhou , David Lo , Rui Abreu

Graph Retrieval-Augmented Generation (GraphRAG) enhances factual reasoning in LLMs by structurally modeling knowledge through graph-based representations. However, existing GraphRAG approaches face two core limitations: shallow retrieval…

Computation and Language · Computer Science 2025-10-01 Cehao Yang , Xiaojun Wu , Xueyuan Lin , Chengjin Xu , Xuhui Jiang , Yuanliang Sun , Jia Li , Hui Xiong , Jian Guo

In this paper, we propose an AI based approach to Trailer Generation in the form of short videos for online educational courses. Trailers give an overview of the course to the learners and help them make an informed choice about the courses…

Computation and Language · Computer Science 2023-01-11 Prakhar Mishra , Chaitali Diwan , Srinath Srinivasa , G. Srinivasaraghavan