English
Related papers

Related papers: Beyond Turn Limits: Training Deep Search Agents wi…

200 papers

Large language models are evolving from single-turn responders into tool-using agents capable of sustained reasoning and decision-making for deep research. Prevailing systems adopt a linear pipeline of plan to search to write to a report,…

Computation and Language · Computer Science 2025-11-25 Yu Lei , Shuzheng Si , Wei Wang , Yifei Wu , Gang Chen , Fanchao Qi , Maosong Sun

Building Large Language Model agents that expand their capabilities by interacting with external tools represents a new frontier in AI research and applications. In this paper, we introduce InfoAgent, a deep research agent powered by an…

Deep search agents powered by large language models have demonstrated strong capabilities in multi-step retrieval, reasoning, and long-horizon task execution. However, their practical failures often stem from the lack of mechanisms to…

Computation and Language · Computer Science 2026-02-02 Zhongxiang Sun , Qipeng Wang , Weijie Yu , Jingxuan Yang , Haolang Lu , Jun Xu

Long-document topic segmentation plays an important role in information retrieval and document understanding, yet existing methods still show clear shortcomings in ultra-long text settings. Traditional discriminative models are constrained…

Computation and Language · Computer Science 2026-03-02 Kaifeng Wu , Junyan Wu , Qiang Liu , Jiarui Zhang , Wen Xu

Reinforcement Learning has emerged as a key driver for LLM reasoning. This capability is equally pivotal in long-context scenarios--such as long-dialogue understanding and structured data analysis, where the challenge extends beyond…

Computation and Language · Computer Science 2026-02-06 Bowen Ping , Zijun Chen , Yiyao Yu , Tingfeng Hui , Junchi Yan , Baobao Chang

Large language models (LLMs) augmented with multi-step reasoning and action generation abilities have shown promise in leveraging external tools to tackle complex tasks that require long-horizon planning. However, existing approaches either…

Artificial Intelligence · Computer Science 2025-10-16 Wei Fan , Wenlin Yao , Zheng Li , Feng Yao , Xin Liu , Liang Qiu , Qingyu Yin , Yangqiu Song , Bing Yin

Deep research has emerged as a transformative capability for autonomous agents, empowering Large Language Models to navigate complex, open-ended tasks. However, realizing its full potential is hindered by critical limitations, including…

Computation and Language · Computer Science 2026-01-28 Yuxuan Cai , Xinyi Lai , Peng Yuan , Weiting Liu , Huajian Li , Mingda Li , Xinghua Wang , Shengxie Zheng , Yanchao Hao , Yuyang Yin , Zheng Wei

Large language models (LLMs) have recently shown strong reasoning abilities in domains like mathematics, coding, and scientific problem-solving, yet their potential for ranking tasks, where prime examples include retrieval, recommender…

Information Retrieval · Computer Science 2025-10-17 Tao Feng , Zhigang Hua , Zijie Lei , Yan Xie , Shuang Yang , Bo Long , Jiaxuan You

The integration of extensive, dynamic knowledge into Large Language Models (LLMs) remains a significant challenge due to the inherent entanglement of factual data and reasoning patterns. Existing solutions, ranging from non-parametric…

Computation and Language · Computer Science 2026-02-11 Wenxuan Xie , Yujia Wang , Xin Tan , Chaochao Lu , Xia Hu , Xuhong Wang

Presentation generation requires deep content research, coherent visual design, and iterative refinement based on observation. However, existing presentation agents often rely on predefined workflows and fixed templates. To address this, we…

Artificial Intelligence · Computer Science 2026-04-21 Hao Zheng , Guozhao Mo , Xinru Yan , Qianhao Yuan , Wenkai Zhang , Xuanang Chen , Yaojie Lu , Hongyu Lin , Xianpei Han , Le Sun

Large Reasoning Models (LRMs) have demonstrated impressive capabilities but suffer from cognitive inefficiencies like "overthinking" simple problems and "underthinking" complex ones. While existing methods that use supervised fine-tuning…

Artificial Intelligence · Computer Science 2026-03-24 Tian Liang , Wenxiang Jiao , Zhiwei He , Jiahao Xu , Haitao Mi , Dong Yu

While recent Multimodal Large Language Models (MLLMs) have attained significant strides in multimodal reasoning, their reasoning processes remain predominantly text-centric, leading to suboptimal performance in complex long-horizon,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Zefeng He , Xiaoye Qu , Yafu Li , Tong Zhu , Siyuan Huang , Yu Cheng

This paper introduces a novel Deep Researcher architecture designed to generate detailed research reports on complex PhD level topics by addressing the inherent limitations of the Parallel Scaling paradigm. Our system utilizes two key…

Artificial Intelligence · Computer Science 2026-01-29 Saurav Prateek

Large language models are transitioning from generalpurpose knowledge engines to realworld problem solvers, yet optimizing them for deep search tasks remains challenging. The central bottleneck lies in the extreme sparsity of highquality…

Artificial Intelligence · Computer Science 2026-02-17 Zheng Chu , Xiao Wang , Jack Hong , Huiming Fan , Yuqi Huang , Yue Yang , Guohai Xu , Chenxiao Zhao , Cheng Xiang , Shengchao Hu , Dongdong Kuang , Ming Liu , Bing Qin , Xing Yu

We present the first comprehensive, large-scale study of training long-context vision language models up to 344K context, targeting long-document visual question answering with measured transfer to long-context text. While several such…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Austin Veselka

Recent advances in deep-research agents have shown promise for autonomous knowledge construction through dynamic reasoning over external sources. However, existing approaches rely on a mono-contextual paradigm that accumulates all…

Current critic-free RL methods for large reasoning models suffer from severe inefficiency when training on positive homogeneous prompts (where all rollouts are correct), resulting in waste of rollouts due to zero advantage estimates. We…

Artificial Intelligence · Computer Science 2026-05-11 Shuyang Jiang , Yuhao Wang , Ya Zhang , Yanfeng Wang , Yu Wang

Reasoning-oriented language models typically expose explicit reasoning as a long, front-loaded chain of "thinking" tokens before the main output, either always enabled or externally toggled at inference time. Although this can help on…

Machine Learning · Computer Science 2026-05-05 Susmit Das

Document-level neural machine translation has yielded attractive improvements. However, majority of existing methods roughly use all context sentences in a fixed scope. They neglect the fact that different source sentences need different…

Computation and Language · Computer Science 2020-10-12 Xiaomian Kang , Yang Zhao , Jiajun Zhang , Chengqing Zong

While reasoning models (e.g., DeepSeek R1) trained with reinforcement learning (RL), excel in textual reasoning, they struggle in scenarios requiring structured problem-solving, such as geometric reasoning, concise computation, or complex…

Computation and Language · Computer Science 2025-04-18 Jiazhan Feng , Shijue Huang , Xingwei Qu , Ge Zhang , Yujia Qin , Baoquan Zhong , Chengquan Jiang , Jinxin Chi , Wanjun Zhong