English
Related papers

Related papers: WEBSERV: A Full-Stack and RL-Ready Web Environment…

200 papers

Deep research agents have shown remarkable potential in handling long-horizon tasks. However, state-of-the-art performance typically relies on online reinforcement learning (RL), which is financially expensive due to extensive API calls.…

Artificial Intelligence · Computer Science 2026-02-24 Yuhang Zhou , Kai Zheng , Qiguang Chen , Mengkang Hu , Qingfeng Sun , Can Xu , Jingjing Chen

Computer use agents (CUAs) can operate real-world digital interfaces but remain difficult to train due to the high cost of graphical user interface (GUI) interaction and the scarcity of high-quality trajectory data. Existing datasets rely…

Machine Learning · Computer Science 2026-02-06 Yifei He , Pranit Chawla , Yaser Souri , Subhojit Som , Xia Song

Large language model (LLM) serving demands low latency and high throughput, but high load variability makes it challenging to achieve high GPU utilization. In this paper, we identify a synergetic but overlooked opportunity to co-serve…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-05 Yifan Qiao , Shu Anzai , Shan Yu , Haoran Ma , Shuo Yang , Yang Wang , Miryung Kim , Yongji Wu , Yang Zhou , Jiarong Xing , Joseph E. Gonzalez , Ion Stoica , Harry Xu

Modern software applications demand efficient and reliable testing methodologies to ensure robust user interface functionality. This paper introduces an autonomous reinforcement learning (RL) agent integrated within a Behavior-Driven…

Software Engineering · Computer Science 2026-02-10 Ali Hassaan Mughal

Training capable Large Language Model (LLM) agents is critically bottlenecked by the high cost and static nature of real-world interaction data. We address this by introducing GenEnv, a framework that establishes a difficulty-aligned…

Computation and Language · Computer Science 2025-12-24 Jiacheng Guo , Ling Yang , Peter Chen , Qixin Xiao , Yinjie Wang , Xinzhe Juan , Jiahao Qiu , Ke Shen , Mengdi Wang

For years, we have built LLM serving systems like any other critical infrastructure: a single general-purpose stack, hand-tuned over many engineer-years, meant to support every model and workload. In this paper, we take the opposite bet: a…

Artificial Intelligence · Computer Science 2026-05-08 Keisuke Kamahori , Shihang Li , Simon Peter , Baris Kasikci

Deep Reinforcement Learning (Deep RL) has been in the spotlight for the past few years, due to its remarkable abilities to solve problems which were considered to be practically unsolvable using traditional Machine Learning methods.…

Machine Learning · Computer Science 2022-05-12 Aristotelis Lazaridis , Ioannis Vlahavas

Reasoning over ultra-long documents requires synthesizing sparse evidence scattered across distant segments under strict memory constraints. While streaming agents enable scalable processing, their passive memory update strategy often fails…

Computation and Language · Computer Science 2026-02-04 Xinyu Wang , Mingze Li , Peng Lu , Xiao-Wen Chang , Lifeng Shang , Jinping Li , Fei Mi , Prasanna Parthasarathi , Yufei Cui

AI systems empowered by reinforcement learning (RL) algorithms harbor the immense potential to catalyze societal advancement, yet their deployment is often impeded by significant safety concerns. Particularly in safety-critical…

Machine Learning · Computer Science 2023-05-17 Jiaming Ji , Jiayi Zhou , Borong Zhang , Juntao Dai , Xuehai Pan , Ruiyang Sun , Weidong Huang , Yiran Geng , Mickel Liu , Yaodong Yang

As language models (LMs) are used to build autonomous agents in real environments, ensuring their adversarial robustness becomes a critical challenge. Unlike chatbots, agents are compound systems with multiple components taking actions,…

Machine Learning · Computer Science 2025-02-06 Chen Henry Wu , Rishi Shah , Jing Yu Koh , Ruslan Salakhutdinov , Daniel Fried , Aditi Raghunathan

Recent years have seen significant advancements in designing reinforcement learning (RL)-based agents for building energy management. While individual success is observed in simulated or controlled environments, the scalability of RL…

Machine Learning · Computer Science 2025-07-29 Ruohong Liu , Jack Umenberger , Yize Chen

Environment setup-the process of configuring the system to work with a specific software project-represents a persistent challenge in Software Engineering (SE). Automated environment setup methods could assist developers by providing fully…

Machine Learning · Computer Science 2025-10-16 Alexander Kovrigin , Aleksandra Eliseeva , Konstantin Grotov , Egor Bogomolov , Yaroslav Zharov

In recent years, significant progress has been made in the field of robotic reinforcement learning (RL), enabling methods that handle complex image observations, train in the real world, and incorporate auxiliary data, such as…

Reinforcement learning (RL) algorithms find applications in inventory control, recommender systems, vehicular traffic management, cloud computing and robotics. The real-world complications of many tasks arising in these domains makes them…

Machine Learning · Computer Science 2021-06-03 Sindhu Padakandla

The improvement of web agents on current benchmarks raises the question: Do today's agents perform just as well when the web changes? We introduce TimeWarp, a benchmark that emulates the evolving web using containerized environments that…

Artificial Intelligence · Computer Science 2026-03-06 Md Farhan Ishmam , Kenneth Marino

The rapid development of autonomous web agents powered by Large Language Models (LLMs), while greatly elevating efficiency, exposes the frontier risk of taking unintended or harmful actions. This situation underscores an urgent need for…

Artificial Intelligence · Computer Science 2025-07-22 Boyuan Zheng , Zeyi Liao , Scott Salisbury , Zeyuan Liu , Michael Lin , Qinyuan Zheng , Zifan Wang , Xiang Deng , Dawn Song , Huan Sun , Yu Su

Large language models (LLMs) have enabled web agents that follow natural language goals through multi-step browser interactions. However, agents fine-tuned on specific trajectories and domain often struggle to generalize out of domain, and…

Machine Learning · Computer Science 2026-05-27 Fatemeh Pesaran Zadeh , Seyeon Choi , Xing Han Lù , Siva Reddy , Gunhee Kim

Recent Graphical User Interface (GUI) agents replicate the R1-Zero paradigm, coupling online Reinforcement Learning (RL) with explicit chain-of-thought reasoning prior to object grounding and thereby achieving substantial performance gains.…

Computation and Language · Computer Science 2025-05-23 Yuqi Zhou , Sunhao Dai , Shuai Wang , Kaiwen Zhou , Qinglin Jia , Jun Xu

Recent advances in large language models (LLMs) have sparked growing interest in building generalist agents that can learn through online interactions. However, applying reinforcement learning (RL) to train LLM agents in multi-turn,…

Artificial Intelligence · Computer Science 2025-10-07 Hanchen Zhang , Xiao Liu , Bowen Lv , Xueqiao Sun , Bohao Jing , Iat Long Iong , Zhenyu Hou , Zehan Qi , Hanyu Lai , Yifan Xu , Rui Lu , Hongning Wang , Jie Tang , Yuxiao Dong

Large language models (LLMs) are increasingly deployed as AI agents that operate in short reasoning-action loops, interleaving model computation with external calls. Unlike traditional chat applications, these agentic workloads require…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-03-12 Yuning Zhang , Yan Yan , Nan Yang , Dong Yuan