English

Safe and Scalable Web Agent Learning via Recreated Websites

Computation and Language 2026-03-12 v1

Abstract

Training autonomous web agents is fundamentally limited by the environments they learn from: real-world websites are unsafe to explore, hard to reset, and rarely provide verifiable feedback. We propose VeriEnv, a framework that treats language models as environment creators, automatically cloning real-world websites into fully executable, verifiable synthetic environments. By exposing controlled internal access via a Python SDK, VeriEnv enables agents to self-generate tasks with deterministic, programmatically verifiable rewards, eliminating reliance on heuristic or LLM-based judges. This design decouples agent learning from unsafe real-world interaction while enabling scalable self-evolution through environment expansion. Through experiments on web agent benchmarks, we show that agents trained with VeriEnv generalize to unseen websites, achieve site-specific mastery through self-evolving training, and benefit from scaling the number of training environments. Code and resources will be released at https://github.com/kyle8581/VeriEnv upon acceptance.

Keywords

Cite

@article{arxiv.2603.10505,
  title  = {Safe and Scalable Web Agent Learning via Recreated Websites},
  author = {Hyungjoo Chae and Jungsoo Park and Alan Ritter},
  journal= {arXiv preprint arXiv:2603.10505},
  year   = {2026}
}
R2 v1 2026-07-01T11:14:16.575Z