English
Related papers

Related papers: Beyond Ten Turns: Unlocking Long-Horizon Agentic S…

200 papers

Autonomous agents powered by large language models (LLMs) have the potential to significantly enhance human productivity by reasoning, using tools, and executing complex tasks in diverse environments. However, current approaches to…

Advances in large language models (LLMs) are driving a shift toward using reinforcement learning (RL) to train agents from iterative, multi-turn interactions across tasks. However, multi-turn RL remains challenging as rewards are often…

Artificial Intelligence · Computer Science 2026-05-20 Aladin Djuhera , Swanand Ravindra Kadhe , Farhan Ahmed , Syed Zawad , Heiko Ludwig , Holger Boche

With the recent rapid advancement of Agentic Intelligence, agentic tool use in LLMs has become increasingly important. During multi-turn interactions between agents and users, the dynamic, uncertain, and stochastic nature of user demands…

Artificial Intelligence · Computer Science 2025-08-27 Weikang Zhao , Xili Wang , Chengdi Ma , Lingbin Kong , Zhaohua Yang , Mingxiang Tuo , Xiaowei Shi , Yitao Zhai , Xunliang Cai

Large reasoning models (LRMs), such as OpenAI-o1 and DeepSeek-R1, demonstrate impressive long-horizon reasoning capabilities. However, their reliance on static internal knowledge limits their performance on complex, knowledge-intensive…

Computation and Language · Computer Science 2025-10-14 Xiaoxi Li , Jiajie Jin , Guanting Dong , Hongjin Qian , Yongkang Wu , Ji-Rong Wen , Yutao Zhu , Zhicheng Dou

Search-augmented reasoning agents interleave multi-step reasoning with external information retrieval, but uncontrolled retrieval often leads to redundant evidence, context saturation, and unstable learning. Existing approaches rely on…

Computation and Language · Computer Science 2026-02-03 Siheng Xiong , Oguzhan Gungordu , Blair Johnson , James C. Kerce , Faramarz Fekri

Large language models (LLMs), adopted to understand human language, drive the development of artificial intelligence (AI) web search agents. Compared to traditional search engines, LLM-powered AI search agents are capable of understanding…

Information Retrieval · Computer Science 2025-02-25 Chuanrui Hu , Shichong Xie , Baoxin Wang , Bin Chen , Xiaofeng Cong , Jun Zhang

Deep Research Agents are a prominent category of LLM-based agents. By autonomously orchestrating multistep web exploration, targeted retrieval, and higher-order synthesis, they transform vast amounts of online information into…

Computation and Language · Computer Science 2025-06-16 Mingxuan Du , Benfeng Xu , Chiwei Zhu , Xiaorui Wang , Zhendong Mao

As LLMs shift toward autonomous agents, Deep Research has emerged as a pivotal metric. However, existing academic benchmarks like BrowseComp often fail to meet real-world demands for open-ended research, which requires robust skills in…

Deep Research (DR) agents extend Large Language Models (LLMs) beyond parametric knowledge by autonomously retrieving and synthesizing evidence from large web corpora into long-form reports, enabling a long-horizon agentic paradigm. However,…

Artificial Intelligence · Computer Science 2026-02-04 Haohao Luo , Zexi Li , Yuexiang Xie , Wenhao Zhang , Yaliang Li , Ying Shen

Recently, as Large Language Models (LLMs) have shown impressive emerging capabilities and gained widespread popularity, research on LLM-based search agents has proliferated. In real-world situations, users often input contextual and highly…

Artificial Intelligence · Computer Science 2024-11-25 Yaqi Wang , Haipei Xu

Recent deep research agents primarily improve performance by scaling reasoning depth, but this leads to high inference cost and latency in search-intensive scenarios. Moreover, generalization across heterogeneous research settings remains…

Tool-use capability is a fundamental component of LLM agents, enabling them to interact with external systems through structured function calls. However, existing research exhibits inconsistent interaction representations, largely overlooks…

Artificial Intelligence · Computer Science 2026-05-26 Yijuan Liang , Xinghao Chen , Yifan Ge , Ziyi Wu , Hao Wu , Changyu Zeng , Wei Xing , Xiaoyu Shen

Equipping large language models (LLMs) with search engines via reinforcement learning (RL) has emerged as an effective approach for building search agents. However, overreliance on search introduces unnecessary cost and risks exposure to…

Computation and Language · Computer Science 2025-12-19 Tzu-Han Lin , Wei-Lin Chen , Chen-An Li , Hung-yi Lee , Yun-Nung Chen , Yu Meng

While large language models (LLMs) augmented with agentic search capabilities show promise for legal reasoning, they overlook a fundamental constraint that applicable law must match the temporal context of each case, as retroactive…

Computation and Language · Computer Science 2026-05-26 Wei Fan , Yining Zhou , Mufan Zhang , Yanbing Weng , Yiran HU , Tianshi Zheng , Baixuan Xu , Chunyang Li , Jianhui Yang , Haoran Li , Yangqiu Song

Information retrieval is a cornerstone of modern knowledge acquisition, enabling billions of queries each day across diverse domains. However, traditional keyword-based search engines are increasingly inadequate for handling complex,…

Reinforcement learning with verifiable rewards (RLVR) has become the mainstream technique for training LLM agents. However, RLVR highly depends on well-crafted task queries and corresponding ground-truth answers to provide accurate rewards,…

Machine Learning · Computer Science 2026-05-20 Hongliang Lu , Yuhang Wen , Pengyu Cheng , Ruijin Ding , Jiaqi Guo , Haotian Xu , Chutian Wang , Haonan Chen , Xiaoxi Jiang , Guanjun Jiang

Explainable Reinforcement Learning (XRL) has emerged as a promising approach in improving the transparency of Reinforcement Learning (RL) agents. However, there remains a gap between complex RL policies and domain experts, due to the…

Artificial Intelligence · Computer Science 2025-09-09 Haechang Kim , Hao Chen , Can Li , Jong Min Lee

A burgeoning area within reinforcement learning (RL) is the design of sequential decision-making agents centered around large language models (LLMs). While autonomous decision-making agents powered by modern LLMs could facilitate numerous…

Machine Learning · Computer Science 2026-02-10 Dilip Arumugam , Thomas L. Griffiths

Transcending human cognitive limitations represents a critical frontier in LLM training. Proprietary agentic systems like DeepResearch have demonstrated superhuman capabilities on extremely complex information-seeking benchmarks such as…

Talent search is a cornerstone of modern recruitment systems, yet existing approaches often struggle to capture nuanced job-specific preferences, model recruiter behavior at a fine-grained level, and mitigate noise from subjective human…

Information Retrieval · Computer Science 2025-12-02 Jihang Li , Bing Xu , Zulong Chen , Chuanfei Xu , Minping Chen , Suyu Liu , Ying Zhou , Zeyi Wen