中文
相关论文

相关论文: Go-Browse: Training Web Agents with Structured Exp…

200 篇论文

Modern web agents possess computer use abilities that allow them to interact with webpages by sending commands to a virtual keyboard and mouse. While such agents have considerable potential to assist human users with complex tasks,…

人工智能 · 计算机科学 2025-07-25 Yixiao Song , Katherine Thai , Chau Minh Pham , Yapei Chang , Mazin Nadaf , Mohit Iyyer

As language models (LMs) are used to build autonomous agents in real environments, ensuring their adversarial robustness becomes a critical challenge. Unlike chatbots, agents are compound systems with multiple components taking actions,…

机器学习 · 计算机科学 2025-02-06 Chen Henry Wu , Rishi Shah , Jing Yu Koh , Ruslan Salakhutdinov , Daniel Fried , Aditi Raghunathan

We introduce WebSight, a vision-based autonomous web agent, designed to interact with web environments purely through visual perception, eliminating dependence on HTML or DOM-based inputs. Central to our approach we introduce our new model,…

人工智能 · 计算机科学 2025-08-26 Tanvir Bhathal , Asanshay Gupta

Recent advances in multimodal web agents often rely on increased inference-time computation, including rollout search, verifier passes, offline skill discovery, and specialist model stacks. This raises a central question: can a web agent…

人工智能 · 计算机科学 2026-05-27 Yubo Li , Yidi Miao , Yuntian Shen , Yuxin Liu

As large language model-based chat systems become increasingly widely used, generative engine optimization (GEO) has emerged as an important problem for information access and retrieval. In classical search engines, results are…

信息检索 · 计算机科学 2026-04-10 Julius Schulte , Malte Bleeker , Philipp Kaufmann

Agentic web search increasingly faces two distinct demands: deep reasoning over a single target, and structured aggregation across many entities and heterogeneous sources. Current systems struggle on both fronts. Breadth-oriented tasks…

人工智能 · 计算机科学 2026-05-01 Yuxuan Huang , Yihang Chen , Zhiyuan He , Yuxiang Chen , Ka Yiu Lee , Huichi Zhou , Weilin Luo , Meng Fang , Jun Wang

Recently, there has been a surge of vision-based GUI agents designed to automate everyday mobile and web tasks. These agents interpret raw GUI screenshots and autonomously decide where to click, scroll, or type, which bypasses handcrafted…

机器学习 · 计算机科学 2025-07-09 Yucheng Shi , Wenhao Yu , Zaitang Li , Yonglin Wang , Hongming Zhang , Ninghao Liu , Haitao Mi , Dong Yu

Web traffic is a valuable data source, typically used in the marketing space to track brand awareness and advertising effectiveness. However, web traffic is also a rich source of information for cybersecurity monitoring efforts. To better…

信息检索 · 计算机科学 2019-04-04 Han Qin , Kit Riehle , Haozhen Zhao

Large language models (LLMs) have recently achieved remarkable results in complex multi-step tasks, such as mathematical reasoning and agentic software engineering. However, they often struggle to maintain consistent performance across…

To achieve successful assistance with long-horizon web-based tasks, AI agents must be able to sequentially follow real-world user instructions over a long period. Unlike existing web-based agent benchmarks, sequential instruction following…

人工智能 · 计算机科学 2025-12-02 Suyu Ye , Haojun Shi , Darren Shih , Hyokun Yun , Tanya Roosta , Tianmin Shu

Recent advancements in large language models (LLMs) have significantly improved the capabilities of web agents. However, effectively navigating complex and dynamic web environments still requires more advanced trajectory-level planning and…

人工智能 · 计算机科学 2025-07-08 Yifei Gao , Junhong Ye , Jiaqi Wang , Jitao Sang

The evolution of autonomous agents is redefining information seeking, transitioning from passive retrieval to proactive, open-ended web research. However, a significant modality gap remains in processing the web's most dynamic and…

计算机视觉与模式识别 · 计算机科学 2026-01-19 Zhengyang Liang , Yan Shu , Xiangrui Liu , Minghao Qin , Kaixin Liang , Nicu Sebe , Zheng Liu , Lizi Liao

Navigation is a rich and well-grounded problem domain that drives progress in many different areas of research: perception, planning, memory, exploration, and optimisation in particular. Historically these challenges have been separately…

Existing web agent benchmarks have largely converged on short, single-site tasks that frontier models are approaching saturation on. However, real world web use consists of long-horizon, multi-site workflows. Common web navigation tasks,…

机器学习 · 计算机科学 2026-04-29 Lawrence Keunho Jang , Jing Yu Koh , Daniel Fried , Ruslan Salakhutdinov

LLM-based agents often operate in a greedy, step-by-step manner, selecting actions solely based on the current observation without considering long-term consequences or alternative paths. This lack of foresight is particularly problematic…

人工智能 · 计算机科学 2025-12-16 Mahir Labib Dihan , Tanzima Hashem , Mohammed Eunus Ali , Md Rizwan Parvez

Autonomous web navigation requires agents to perceive complex visual environments and maintain long-term context, yet current Large Language Model (LLM) based agents often struggle with spatial disorientation and navigation loops. In this…

人工智能 · 计算机科学 2026-03-04 Xinjun Wang , Shengyao Wang , Aimin Zhou , Hao Hao

Planning has been part of the core pursuit for artificial intelligence since its conception, but earlier AI agents mostly focused on constrained settings because many of the cognitive substrates necessary for human-level planning have been…

计算与语言 · 计算机科学 2024-10-24 Jian Xie , Kai Zhang , Jiangjie Chen , Tinghui Zhu , Renze Lou , Yuandong Tian , Yanghua Xiao , Yu Su

We introduce EconWebArena, a benchmark for evaluating autonomous agents on complex, multimodal economic tasks in realistic web environments. The benchmark comprises 360 curated tasks from 82 authoritative websites spanning domains such as…

计算与语言 · 计算机科学 2026-05-12 Zefang Liu , Yinzhu Quan

Recently, large language model (LLM)-based agents have achieved significant success in interactive environments, attracting significant academic and industrial attention. Despite these advancements, current research predominantly focuses on…

计算与语言 · 计算机科学 2025-05-22 Peng Wang , Ruihan Tao , Qiguang Chen , Mengkang Hu , Libo Qin

This paper considers the problem of efficient exploration of unseen environments, a key challenge in AI. We propose a `learning to explore' framework where we learn a policy from a distribution of environments. At test time, presented with…

机器学习 · 计算机科学 2019-10-30 Hanjun Dai , Yujia Li , Chenglong Wang , Rishabh Singh , Po-Sen Huang , Pushmeet Kohli