English

Read More, Think More: Revisiting Observation Reduction for Web Agents

Computation and Language 2026-04-03 v1

Abstract

Web agents based on large language models (LLMs) rely on observations of web pages -- commonly represented as HTML -- as the basis for identifying available actions and planning subsequent steps. Prior work has treated the verbosity of HTML as an obstacle to performance and adopted observation reduction as a standard practice. We revisit this trend and demonstrate that the optimal observation representation depends on model capability and thinking token budget: (1) compact observations (accessibility trees) are preferable for lower-capability models, while detailed observations (HTML) are advantageous for higher-capability models; moreover, increasing thinking tokens further amplifies the benefit of HTML. (2) Our error analysis suggests that higher-capability models exploit layout information in HTML for better action grounding, while lower-capability models suffer from increased hallucination under longer inputs. We also find that incorporating observation history improves performance across most models and settings, and a diff-based representation offers a token-efficient alternative. Based on these findings, we suggest practical guidelines: adaptively select observation representations based on model capability and thinking token budget, and incorporate observation history using diff-based representations.

Keywords

Cite

@article{arxiv.2604.01535,
  title  = {Read More, Think More: Revisiting Observation Reduction for Web Agents},
  author = {Masafumi Enomoto and Ryoma Obara and Haochen Zhang and Masafumi Oyamada},
  journal= {arXiv preprint arXiv:2604.01535},
  year   = {2026}
}
R2 v1 2026-07-01T11:50:09.695Z