English
Related papers

Related papers: WebExplorer: Explore and Evolve for Training Long-…

200 papers

While recent advances in reasoning models have demonstrated cognitive behaviors through reinforcement learning, existing approaches struggle to invoke deep reasoning capabilities in multi-turn agents with long-horizon interactions. We…

Computation and Language · Computer Science 2025-10-10 Qiaoyu Tang , Hao Xiang , Le Yu , Bowen Yu , Yaojie Lu , Xianpei Han , Le Sun , WenJuan Zhang , Pengbo Wang , Shixuan Liu , Zhenru Zhang , Jianhong Tu , Hongyu Lin , Junyang Lin

Large language models (LLMs) have demonstrated impressive performance in understanding language and executing complex reasoning tasks. However, LLMs with long context windows have been notorious for their expensive training costs and high…

Computation and Language · Computer Science 2024-03-14 Jun Zhao , Can Zu , Hao Xu , Yi Lu , Wei He , Yiwen Ding , Tao Gui , Qi Zhang , Xuanjing Huang

Reinforcement Learning (RL) is essential for evolving Large Language Models (LLMs) into autonomous agents capable of long-horizon planning, yet a practical recipe for scaling RL in complex, multi-turn environments remains elusive. This…

Machine Learning · Computer Science 2026-03-24 Xixi Wu , Qianguo Sun , Ruiyang Zhang , Chao Song , Junlong Wu , Yiyan Qi , Hong Cheng

Current Large Language Model (LLM) agents show strong performance in tool use, but lack the crucial capability to systematically learn from their own experiences. While existing frameworks mainly focus on mitigating external knowledge gaps,…

Computation and Language · Computer Science 2026-05-19 Rong Wu , Xiaoman Wang , Jianbiao Mei , Pinlong Cai , Daocheng Fu , Cheng Yang , Licheng Wen , Xuemeng Yang , Yufan Shen , Yuxin Wang , Botian Shi

A burgeoning area within reinforcement learning (RL) is the design of sequential decision-making agents centered around large language models (LLMs). While autonomous decision-making agents powered by modern LLMs could facilitate numerous…

Machine Learning · Computer Science 2026-02-10 Dilip Arumugam , Thomas L. Griffiths

Efficiently solving real-world problems with LLMs increasingly hinges on their ability to interact with dynamic web environments and autonomously acquire external information. While recent research like Search-R1 and WebDancer demonstrates…

Computation and Language · Computer Science 2025-10-15 Tao Yu , Zhengbo Zhang , Zhiheng Lyu , Junhao Gong , Hongzhu Yi , Xinming Wang , Yuxuan Zhou , Jiabing Yang , Ping Nie , Yan Huang , Wenhu Chen

Large Language Models (LLMs) equipped with web search capabilities have demonstrated impressive potential for deep research tasks. However, current approaches predominantly rely on either manually engineered prompts (prompt…

Artificial Intelligence · Computer Science 2025-04-18 Yuxiang Zheng , Dayuan Fu , Xiangkun Hu , Xiaojie Cai , Lyumanshan Ye , Pengrui Lu , Pengfei Liu

Large language model (LLM) agents are becoming competent at straightforward web tasks, such as opening an item page or submitting a form, but still struggle with objectives that require long horizon navigation, large scale information…

Artificial Intelligence · Computer Science 2025-10-09 Jingbo Yang , Bairu Hou , Wei Wei , Shiyu Chang , Yujia Bao

Information seeking demands iterative evidence gathering and reflective reasoning, yet large language models (LLMs) still struggle with it in open-web question answering. Existing prompting and supervised fine-tuning (SFT) methods remain…

Computation and Language · Computer Science 2025-11-11 Wenxuan Shi , Haochen Tan , Chuqiao Kuang , Xiaoguang Li , Xiaozhe Ren , Chen Zhang , Hanting Chen , Yasheng Wang , Lu Hou , Lifeng Shang

Large Language Model (LLM)-based search agents have shown remarkable capabilities in solving complex tasks by dynamically decomposing problems and addressing them through interleaved reasoning and retrieval. However, this interleaved…

Artificial Intelligence · Computer Science 2025-05-20 Tiannuo Yang , Zebin Yao , Bowen Jin , Lixiao Cui , Yusen Li , Gang Wang , Xiaoguang Liu

Deep search capabilities have become an indispensable competency for frontier Large Language Model (LLM) agents, yet their development remains dominated by industrial giants. The typical industry recipe involves a highly resource-intensive…

Artificial Intelligence · Computer Science 2026-05-06 Yuwen Du , Rui Ye , Shuo Tang , Keduan Huang , Xinyu Zhu , Yuzhu Cai , Siheng Chen

Large reasoning models (LRMs), such as OpenAI-o1 and DeepSeek-R1, demonstrate impressive long-horizon reasoning capabilities. However, their reliance on static internal knowledge limits their performance on complex, knowledge-intensive…

Computation and Language · Computer Science 2025-10-14 Xiaoxi Li , Jiajie Jin , Guanting Dong , Hongjin Qian , Yongkang Wu , Ji-Rong Wen , Yutao Zhu , Zhicheng Dou

Large language models (LLMs) have rapidly evolved from text generators into powerful problem solvers. Yet, many open tasks demand critical thinking, multi-source, and verifiable outputs, which are beyond single-shot prompting or standard…

Recent advancements in GUI agents have significantly expanded their ability to interpret natural language commands to manage software interfaces. However, acquiring GUI data remains a significant challenge. Existing methods often involve…

Artificial Intelligence · Computer Science 2025-11-11 Xiangwu Guo , Difei Gao , Mike Zheng Shou

The rapid progress of large language models (LLMs) has sparked growing interest in building Artificial General Intelligence (AGI) within Graphical User Interface (GUI) environments. However, existing GUI agents based on LLMs or…

Artificial Intelligence · Computer Science 2025-05-27 Runliang Niu , Jinglong Ji , Yi Chang , Qi Wang

While Large Multimodal Models (LMMs) demonstrate impressive visual perception, they remain epistemically constrained by their static parametric knowledge. To transcend these boundaries, multimodal search models have been adopted to actively…

Computer Vision and Pattern Recognition · Computer Science 2026-04-16 Yikun Liu , Yuan Liu , Le Tian , Xiao Zhou , Jiangchao Yao , Yanfeng Wang , Weidi Xie

Driven by curiosity, humans have continually sought to explore and understand the world around them, leading to the invention of various tools to satiate this inquisitiveness. Despite not having the capacity to process and memorize vast…

Artificial Intelligence · Computer Science 2024-01-11 Haojie Pan , Zepeng Zhai , Hao Yuan , Yaojia Lv , Ruiji Fu , Ming Liu , Zhongyuan Wang , Bing Qin

Large language model (LLM)-based evolution is a promising approach for open-ended discovery, where progress requires sustained search and knowledge accumulation. Existing methods still rely heavily on fixed heuristics and hard-coded…

Web testing has long been recognized as a notoriously difficult task. Even nowadays, web testing still heavily relies on manual efforts while automated web testing is far from achieving human-level performance. Key challenges in web testing…

Software Engineering · Computer Science 2021-03-11 Yan Zheng , Yi Liu , Xiaofei Xie , Yepang Liu , Lei Ma , Jianye Hao , Yang Liu

Agentic web search increasingly faces two distinct demands: deep reasoning over a single target, and structured aggregation across many entities and heterogeneous sources. Current systems struggle on both fronts. Breadth-oriented tasks…

Artificial Intelligence · Computer Science 2026-05-01 Yuxuan Huang , Yihang Chen , Zhiyuan He , Yuxiang Chen , Ka Yiu Lee , Huichi Zhou , Weilin Luo , Meng Fang , Jun Wang