English
Related papers

Related papers: Beyond Ten Turns: Unlocking Long-Horizon Agentic S…

200 papers

Large Language Models (LLMs) have shown remarkable capabilities in natural language tasks requiring complex reasoning, yet their application in agentic, multi-step reasoning within interactive environments remains a difficult challenge.…

Artificial Intelligence · Computer Science 2024-08-15 Pranav Putta , Edmund Mills , Naman Garg , Sumeet Motwani , Chelsea Finn , Divyansh Garg , Rafael Rafailov

Existing Large Reasoning Models (LRMs) have shown the potential of reinforcement learning (RL) to enhance the complex reasoning capabilities of Large Language Models~(LLMs). While they achieve remarkable performance on challenging tasks…

Artificial Intelligence · Computer Science 2025-03-19 Huatong Song , Jinhao Jiang , Yingqian Min , Jie Chen , Zhipeng Chen , Wayne Xin Zhao , Lei Fang , Ji-Rong Wen

Large Language Models (LLMs) have shown remarkable capabilities in reasoning, exemplified by the success of OpenAI-o1 and DeepSeek-R1. However, integrating reasoning with external search processes remains challenging, especially for complex…

LLM-based web agents have recently made significant progress, but much of it has occurred in closed-source systems, widening the gap with open-source alternatives. Progress has been held back by two key challenges: first, a narrow focus on…

While Large Language Models (LLMs) have empowered AI research agents to perform isolated scientific tasks, automating complex, real-world workflows, such as LLM training, remains a significant challenge. In this paper, we introduce TREX, a…

Artificial Intelligence · Computer Science 2026-04-23 Zerun Ma , Guoqiang Wang , Xinchen Xie , Yicheng Chen , He Du , Bowen Li , Yanan Sun , Wenran Liu , Kai Chen , Yining Li

Large language models (LLMs) excel at knowledge-intensive question answering and reasoning, yet their real-world deployment remains constrained by knowledge cutoff, hallucination, and limited interaction modalities. Augmenting LLMs with…

Computation and Language · Computer Science 2025-10-13 Daocheng Fu , Jianbiao Mei , Licheng Wen , Xuemeng Yang , Cheng Yang , Rong Wu , Tao Hu , Siqi Li , Yufan Shen , Xinyu Cai , Pinlong Cai , Botian Shi , Yong Liu , Yu Qiao

Large language models (LLMs) have brought autonomous agents closer to artificial general intelligence (AGI) due to their promising generalization and emergent capabilities. There is, however, a lack of studies on how LLM-based agents…

Artificial Intelligence · Computer Science 2024-08-13 Yanan Chen , Ali Pesaranghader , Tanmana Sadhu , Dong Hoon Yi

Long-horizon agentic search requires iteratively exploring the web over long trajectories and synthesizing information across many sources, and is the foundation for enabling powerful applications like deep research systems. In this work,…

Computation and Language · Computer Science 2025-10-23 Howard Yen , Ashwin Paranjape , Mengzhou Xia , Thejas Venkatesh , Jack Hessel , Danqi Chen , Yuhao Zhang

Recent advancements in Large Language Models (LLMs) have largely focused on depth scaling, where a single agent solves long-horizon problems with multi-turn reasoning and tool use. However, as tasks grow broader, the key bottleneck shifts…

Artificial Intelligence · Computer Science 2026-03-13 Zelai Xu , Zhexuan Xu , Ruize Zhang , Chunyang Zhu , Shi Yu , Weilin Liu , Quanlu Zhang , Wenbo Ding , Chao Yu , Yu Wang

The rapid advancement of large language models (LLMs) has driven the development of agentic systems capable of autonomously performing complex tasks. Despite their impressive capabilities, LLMs remain constrained by their internal knowledge…

Information Retrieval · Computer Science 2025-08-19 Wenlin Zhang , Xiaopeng Li , Yingyi Zhang , Pengyue Jia , Yichao Wang , Huifeng Guo , Yong Liu , Xiangyu Zhao

Large Language Models (LLMs) are powerful but prone to hallucinations due to static knowledge. Retrieval-Augmented Generation (RAG) helps by injecting external information, but current methods often are costly, generalize poorly, or ignore…

Computation and Language · Computer Science 2025-05-23 Huatong Song , Jinhao Jiang , Wenqing Tian , Zhipeng Chen , Yuhuan Wu , Jiahao Zhao , Yingqian Min , Wayne Xin Zhao , Lei Fang , Ji-Rong Wen

Large language models (LLMs) have recently achieved remarkable results in complex multi-step tasks, such as mathematical reasoning and agentic software engineering. However, they often struggle to maintain consistent performance across…

Multimodal deep search agents have shown great potential in solving complex tasks by iteratively collecting textual and visual evidence. However, managing the heterogeneous information and high token costs associated with multimodal inputs…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Yifan Du , Zikang Liu , Jinbiao Peng , Jie Wu , Junyi Li , Jinyang Li , Wayne Xin Zhao , Ji-Rong Wen

LLM-powered search agents are increasingly being used for multi-step information seeking tasks, yet the IR community lacks empirical understanding of how agentic search sessions unfold and how retrieved evidence is reflected in later…

Information Retrieval · Computer Science 2026-04-30 Jingjie Ning , João Coelho , Yibo Kong , Yunfan Long , Bruno Martins , João Magalhães , Jamie Callan , Chenyan Xiong

Effective information searching is essential for enhancing the reasoning and generation capabilities of large language models (LLMs). Recent research has explored using reinforcement learning (RL) to improve LLMs' search capabilities by…

Computation and Language · Computer Science 2026-05-20 Hao Sun , Zile Qiao , Jiayan Guo , Xuanbo Fan , Yingyan Hou , Yong Jiang , Pengjun Xie , Yan Zhang , Fei Huang , Jingren Zhou

Autonomous agents have recently achieved remarkable progress across diverse domains, yet most evaluations focus on short-horizon, fully observable tasks. In contrast, many critical real-world tasks, such as large-scale software development,…

Large language models (LLMs) are becoming the foundation for autonomous agents that can use tools to solve complex tasks. Reinforcement learning (RL) has emerged as a common approach for injecting such agentic capabilities, but typically…

Machine Learning · Computer Science 2026-02-26 Emre Can Acikgoz , Cheng Qian , Jonas Hübotter , Heng Ji , Dilek Hakkani-Tür , Gokhan Tur

Tool-integrated reasoning has emerged as a key focus for enabling agentic applications. Among these, DeepResearch Agents have gained significant attention for their strong performance on complex, open-ended information-seeking tasks. We…

Artificial Intelligence · Computer Science 2025-09-30 Shreyas Singh , Kunal Singh , Pradeep Moturi

Deep-research agents are capable of executing multi-step web exploration, targeted retrieval, and sophisticated question answering. Despite their powerful capabilities, deep-research agents face two critical bottlenecks: (1) the lack of…

Artificial Intelligence · Computer Science 2026-03-03 Tongzhou Wu , Yuhao Wang , Xinyu Ma , Xiuqiang He , Shuaiqiang Wang , Dawei Yin , Xiangyu Zhao

Large language models (LLMs) have shown remarkable potential as autonomous agents, particularly in web-based tasks. However, existing LLM web agents heavily rely on expensive proprietary LLM APIs, while open LLMs lack the necessary…

Computation and Language · Computer Science 2025-01-28 Zehan Qi , Xiao Liu , Iat Long Iong , Hanyu Lai , Xueqiao Sun , Wenyi Zhao , Yu Yang , Xinyue Yang , Jiadai Sun , Shuntian Yao , Tianjie Zhang , Wei Xu , Jie Tang , Yuxiao Dong