English
Related papers

Related papers: Nested Browser-Use Learning for Agentic Informatio…

200 papers

We cast nested named entity recognition (NNER) as a sequence labeling task by leveraging prior work that linearizes constituency structures, effectively reducing the complexity of this structured prediction problem to straightforward token…

Computation and Language · Computer Science 2025-09-30 Alberto Muñoz-Ortiz , David Vilares , Caio Corro , Carlos Gómez-Rodríguez

Automated web testing plays a critical role in ensuring high-quality user experiences and delivering business value. Traditional approaches primarily focus on code coverage and load testing, but often fall short of capturing complex user…

Software Engineering · Computer Science 2025-09-08 Naimeng Ye , Xiao Yu , Ruize Xu , Tianyi Peng , Zhou Yu

Since the 1970s, information retrieval (IR) has long been defined as the process of acquiring relevant information items from a pre-defined corpus to satisfy user information needs. Traditional IR systems, while effective in domains like…

Information Retrieval · Computer Science 2025-02-25 Weinan Zhang , Junwei Liao , Ning Li , Kounianhua Du , Jianghao Lin

A goal shared by artificial intelligence and information retrieval is to create an oracle, that is, a machine that can answer our questions, no matter how difficult they are. A more limited, but still instrumental, version of this oracle is…

Information Retrieval · Computer Science 2019-08-20 Rodrigo Nogueira

Large language models (LLMs) and retrieval-augmented generation (RAG) techniques have revolutionized traditional information access, enabling AI agent to search and summarize information on behalf of users during dynamic dialogues. Despite…

Information Retrieval · Computer Science 2024-09-04 Yunxiao Shi , Min Xu , Haimin Zhang , Xing Zi , Qiang Wu

Building agents to interact with the web would allow for significant improvements in knowledge understanding and representation learning. However, web navigation tasks are difficult for current deep reinforcement learning (RL) models due to…

Machine Learning · Computer Science 2019-02-21 Sheng Jia , Jamie Kiros , Jimmy Ba

Browser-using agents (BUAs) are an emerging class of AI agents that interact with web browsers in human-like ways, including clicking, scrolling, filling forms, and navigating across pages. While these agents help automate repetitive online…

Cryptography and Security · Computer Science 2026-03-05 Luoxi Meng , Henry Feng , Ilia Shumailov , Earlence Fernandes

Despite significant advances in autonomous web navigation, current methods remain far from human-level performance in complex web environments. We argue that this limitation stems from Topological Blindness, where agents are forced to…

Information Retrieval · Computer Science 2026-03-24 Xuanwang Zhang , Yuteng Han , Jinnan Qi , Mulong Xie , Zhen Wu , Xinyu Dai

Search intelligence is evolving from Deep Research to Wide Research, a paradigm essential for retrieving and synthesizing comprehensive information under complex constraints in parallel. However, progress in this field is impeded by the…

Computation and Language · Computer Science 2026-02-04 Ziyang Huang , Haolin Ren , Xiaowei Yuan , Jiawei Wang , Zhongtao Jiang , Kun Xu , Shizhu He , Jun Zhao , Kang Liu

The ability of modeling the other agents, such as understanding their intentions and skills, is essential to an agent's interactions with other agents. Conventional agent modeling relies on passive observation from demonstrations. In this…

Artificial Intelligence · Computer Science 2018-10-02 Tianmin Shu , Caiming Xiong , Ying Nian Wu , Song-Chun Zhu

Research agents have recently achieved significant progress in information seeking and synthesis across heterogeneous textual and visual sources. In this paper, we introduce MuSEAgent, a multimodal reasoning agent that enhances…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Shijian Wang , Jiarui Jin , Runhao Fu , Zexuan Yan , Xingjian Wang , Mengkang Hu , Eric Wang , Xiaoxi Li , Kangning Zhang , Li Yao , Wenxiang Jiao , Xuelian Cheng , Yuan Lu , Zongyuan Ge

We introduce WebGames, a comprehensive benchmark suite designed to evaluate general-purpose web-browsing AI agents through a collection of 50+ interactive challenges. These challenges are specifically crafted to be straightforward for…

Machine Learning · Computer Science 2025-02-26 George Thomas , Alex J. Chan , Jikun Kang , Wenqi Wu , Filippos Christianos , Fraser Greenlee , Andy Toulis , Marvin Purtorab

We present Agent S, an open agentic framework that enables autonomous interaction with computers through a Graphical User Interface (GUI), aimed at transforming human-computer interaction by automating complex, multi-step tasks. Agent S…

Artificial Intelligence · Computer Science 2024-10-11 Saaket Agashe , Jiuzhou Han , Shuyu Gan , Jiachen Yang , Ang Li , Xin Eric Wang

The diversification of information access systems, from RAG to autonomous agents, creates a critical need for comparative user studies. However, the technical overhead to deploy and manage these distinct systems is a major barrier. We…

Human-Computer Interaction · Computer Science 2026-01-16 Saber Zerhoudi , Michael Granitzer

We introduce Reagent, a technology that readily converts ordinary webpages containing structured data into software agents with which one can interact naturally, via a combination of speech and pointing. Previous efforts to make webpage…

Human-Computer Interaction · Computer Science 2018-10-30 Mathew Peveler , Jeffery Kephart , Hui Su

We have observed significant progress in visual navigation for embodied agents. A common assumption in studying visual navigation is that the environments are static; this is a limiting assumption. Intelligent navigation may involve…

Computer Vision and Pattern Recognition · Computer Science 2021-05-04 Kuo-Hao Zeng , Luca Weihs , Ali Farhadi , Roozbeh Mottaghi

The resurgence of autonomous agents built using large language models (LLMs) to solve complex real-world tasks has brought increased focus on LLMs' fundamental ability of tool or function calling. At the core of these agents, an LLM must…

Leveraging multiple Large Language Models(LLMs) has proven effective for addressing complex, high-dimensional tasks, but current approaches often rely on static, manually engineered multi-agent configurations. To overcome these constraints,…

Machine Learning · Computer Science 2025-07-21 Xiaowen Ma , Chenyang Lin , Yao Zhang , Volker Tresp , Yunpu Ma

Generative AI search is reshaping information retrieval by offering end-to-end answers to complex queries, reducing users' reliance on manually browsing and summarizing multiple web pages. However, while this paradigm enhances convenience,…

Information Retrieval · Computer Science 2025-05-21 Sunhao Dai , Wenjie Wang , Liang Pang , Jun Xu , See-Kiong Ng , Ji-Rong Wen , Tat-Seng Chua

Named entity recognition (NER) is a crucial task for online advertisement. State-of-the-art solutions leverage pre-trained language models for this task. However, three major challenges remain unresolved: web queries differ from natural…

Information Retrieval · Computer Science 2023-07-03 Simiao Zuo , Pengfei Tang , Xinyu Hu , Qiang Lou , Jian Jiao , Denis Charles