English
Related papers

Related papers: EmbeWebAgent: Embedding Web Agents into Any Custom…

200 papers

Recent progress in GUI agents has substantially improved visual grounding, yet robust planning remains challenging, particularly when the environment deviates from a canonical initial state. In real applications, users often invoke…

Artificial Intelligence · Computer Science 2026-05-26 Henry Hengyuan Zhao , Kaiming Yang , Wendi Yu , Difei Gao , Mike Zheng Shou

Large language model-based web agents have demonstrated strong performance on realistic web interaction tasks. However, existing evaluations are predominantly conducted under relatively stable and well-behaved interaction conditions, which…

Software Engineering · Computer Science 2026-04-21 Haoyue Bai , Dong Wang , Long Chen , Bingguang Hao , Pengyang Shao , Yonghui Yang , Yicheng He , Chenyi Zhuang

Assisting non-expert users to develop complex interactive websites has become a popular task for LLM-powered code agents. However, existing code agents tend to only generate frontend web pages, masking the lack of real full-stack data…

Software Engineering · Computer Science 2026-02-04 Zimu Lu , Houxing Ren , Yunqiao Yang , Ke Wang , Zhuofan Zong , Mingjie Zhan , Hongsheng Li

Multimodal large language models are evolving toward multimodal agents capable of proactively executing tasks. Most agent research focuses on GUI or embodied scenarios, which correspond to agents interacting with 2D virtual worlds or 3D…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Longrong Yang , Zhixiong Zeng , Yufeng Zhong , Jing Huang , Liming Zheng , Lei Chen , Haibo Qiu , Zequn Qin , Lin Ma , Xi Li

Information-seeking (IS) agents have achieved strong performance across a range of wide and deep search tasks, yet their tool use remains largely restricted to API-level snippet retrieval and URL-based page fetching, limiting access to the…

Computation and Language · Computer Science 2025-12-30 Baixuan Li , Jialong Wu , Wenbiao Yin , Kuan Li , Zhongwang Zhang , Huifeng Yin , Zhengwei Tao , Liwen Zhang , Pengjun Xie , Jingren Zhou , Yong Jiang

Recent years, multimodal models have made remarkable strides and pave the way for intelligent browser use agents. However, when solving tasks on real world webpages in multi-turn, long-horizon trajectories, current agents still suffer from…

Artificial Intelligence · Computer Science 2025-09-26 Kaiwen He , Zhiwei Wang , Chenyi Zhuang , Jinjie Gu

Multimodal AI agents are increasingly automating complex real-world workflows that involve online web execution. However, current web-agent benchmarks suffer from a critical limitation: they focus entirely on web-based interaction and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Shoubin Yu , Lei Shu , Antoine Yang , Yao Fu , Srinivas Sunkara , Maria Wang , Jindong Chen , Mohit Bansal , Boqing Gong

Agentic Web is an emerging paradigm where autonomous agents help users use online information. As the paradigm develops, content providers are also deploying agents to manage their data and serve it through controlled interfaces. This shift…

Multiagent Systems · Computer Science 2026-04-14 Shanshan Zhong , Kate Shen , Chenyan Xiong

Agents are now used widely in the process of software development, but building production-ready software engineering agents is a complex task. Deploying software agents effectively requires flexibility in implementation and…

The current state of modern web interfaces, especially in regards to accessibility focused usage is extremely lacking. Traditional methods for web interaction, such as scripting languages and screen readers, often lack the flexibility to…

Artificial Intelligence · Computer Science 2025-07-08 Trisanth Srinivasan , Santosh Patapati

GUI agents that interact with graphical interfaces on behalf of users represent a promising direction for practical AI assistants. However, training such agents is hindered by the scarcity of suitable environments. We present InfiniteWeb, a…

Computation and Language · Computer Science 2026-01-09 Ziyun Zhang , Zezhou Wang , Xiaoyi Zhang , Zongyu Guo , Jiahao Li , Bin Li , Yan Lu

Web AI agents such as ChatGPT Agent and GenSpark are increasingly used for routine web-based tasks, yet they still rely on text-based input prompts, lack proactive detection of user intent, and offer no support for interactive data analysis…

Human-Computer Interaction · Computer Science 2026-01-22 Yanwei Huang , Arpit Narechania

Addressing intricate real-world problems necessitates in-depth information seeking and multi-step reasoning. Recent progress in agentic systems, exemplified by Deep Research, underscores the potential for autonomous multi-step research. In…

Computation and Language · Computer Science 2025-08-12 Jialong Wu , Baixuan Li , Runnan Fang , Wenbiao Yin , Liwen Zhang , Zhengwei Tao , Dingchu Zhang , Zekun Xi , Gang Fu , Yong Jiang , Pengjun Xie , Fei Huang , Jingren Zhou

Web browsers are a portal to the internet, where much of human activity is undertaken. Thus, there has been significant research work in AI agents that interact with the internet through web browsing. However, there is also another…

Computation and Language · Computer Science 2025-06-18 Yueqi Song , Frank Xu , Shuyan Zhou , Graham Neubig

As AI technology advances, it is driving innovation across industries, increasing the demand for scalable AI project deployment. However, deployment remains a critical challenge due to complex environment configurations, dependency…

Artificial Intelligence · Computer Science 2025-04-01 Jiaxiang Chen , Jingwei Shi , Lei Gan , Jiale Zhang , Qingyu Zhang , Dongqian Zhang , Xin Pang , Zhucong Li , Yinghui Xu

Reliable evaluation of AI agents operating in complex, real-world environments requires methodologies that are robust, transparent, and contextually aligned with the tasks agents are intended to perform. This study identifies persistent…

Artificial Intelligence · Computer Science 2026-04-01 Deepak Akkil , Mowafak Allaham , Amal Raj , Tamer Abuelsaad , Ravi Kokku

As mobile devices are becoming ubiquitous, regularly interacting with a variety of user interfaces (UIs) is a common aspect of daily life for many people. To improve the accessibility of these devices and to enable their usage in a variety…

Computation and Language · Computer Science 2021-01-27 Zecheng He , Srinivas Sunkara , Xiaoxue Zang , Ying Xu , Lijuan Liu , Nevan Wichers , Gabriel Schubiner , Ruby Lee , Jindong Chen , Blaise Agüera y Arcas

Large language model (LLM)-based agents have demonstrated remarkable capabilities in addressing complex tasks, thereby enabling more advanced information retrieval and supporting deeper, more sophisticated human information-seeking…

Artificial Intelligence · Computer Science 2025-11-11 Yuyang Zhao , Wentao Shi , Fuli Feng , Xiangnan He

Recent advances in large language models (LLMs) and autonomous agents have enabled systems capable of performing complex tasks across domains such as human-computer interaction, planning, and web navigation. However, many existing…

Artificial Intelligence · Computer Science 2025-07-22 Hongyi Yang , Yue Pan , Jiayi Xu , Kelsen Liu

Web agents perceive web pages through an observation space, yet its granularity has remained an underexamined design choice. Existing work treats observation at the same element-level granularity as the action space, leaving the page's…

Computation and Language · Computer Science 2026-05-11 Donguk Kwon , Dongha Lee