English
Related papers

Related papers: Deep Researcher with Sequential Plan Reflection an…

200 papers

Deep Research (DR) is an emerging agent application that leverages large language models (LLMs) to address open-ended queries. It requires the integration of several capabilities, including multi-step reasoning, cross-document synthesis,…

Frontier deep research agents (DRAs) plan a research task, synthesize across documents, and return a structured deliverable on demand. They are being deployed in enterprise workflows faster than they are being evaluated. Existing benchmarks…

Artificial Intelligence · Computer Science 2026-05-19 Tanmay Asthana , Aman Saksena , Divyansh Sahu

This project reproduces and extends the recently proposed ``Recursive Language Models'' (RLMs) framework by Zhang et al. (2026). This framework enables Large Language Models (LLMs) to process near-infinite contexts by offloading the prompt…

Computation and Language · Computer Science 2026-03-04 Daren Wang

The automation of scientific discovery has been a long-standing goal within the research community, driven by the potential to accelerate knowledge creation. While significant progress has been made using commercial large language models…

Computation and Language · Computer Science 2025-03-11 Yixuan Weng , Minjun Zhu , Guangsheng Bao , Hongbo Zhang , Jindong Wang , Yue Zhang , Linyi Yang

Information seeking demands iterative evidence gathering and reflective reasoning, yet large language models (LLMs) still struggle with it in open-web question answering. Existing prompting and supervised fine-tuning (SFT) methods remain…

Computation and Language · Computer Science 2025-11-11 Wenxuan Shi , Haochen Tan , Chuqiao Kuang , Xiaoguang Li , Xiaozhe Ren , Chen Zhang , Hanting Chen , Yasheng Wang , Lu Hou , Lifeng Shang

The widespread 'deeper is better' philosophy has driven the creation of architectures like ResNet and Transformer, which achieve high performance by stacking numerous layers. However, increasing model depth comes with challenges such as…

Machine Learning · Computer Science 2026-02-25 Wei Wang , Xiao-Yong Wei , Qing Li

While Large Language Models (LLMs) demonstrate remarkable capabilities, they remain susceptible to sophisticated, multi-step jailbreak attacks that circumvent conventional surface-level safety alignment by exploiting the internal generation…

Machine Learning · Computer Science 2026-05-21 Jiachen Ma , Jiawen Zhang , Xiangtian Li , Bo Zou , Chaochao Lu , Chao Yang

Recent studies increasingly explore Large Language Models (LLMs) as a new paradigm for recommendation systems due to their scalability and world knowledge. However, existing work has three key limitations: (1) most efforts focus on…

Recent advances of reasoning models, exemplified by OpenAI's o1 and DeepSeek's R1, highlight the significant potential of Reinforcement Learning (RL) to enhance the reasoning capabilities of Large Language Models (LLMs). However,…

This paper introduces AQA-Bench, a novel benchmark to assess the sequential reasoning capabilities of large language models (LLMs) in algorithmic contexts, such as depth-first search (DFS). The key feature of our evaluation benchmark lies…

Computation and Language · Computer Science 2025-06-23 Siwei Yang , Bingchen Zhao , Cihang Xie

Comparative evaluation of several systems is a recurrent task in researching. It is a key step before deciding which system to use for our work, or, once our research has been conducted, to demonstrate the potential of the resulting model.…

Computation and Language · Computer Science 2026-02-24 Sergio Gómez González , Miguel Domingo , Francisco Casacuberta

Large Reasoning Models (LRMs) have demonstrated impressive capabilities but suffer from cognitive inefficiencies like "overthinking" simple problems and "underthinking" complex ones. While existing methods that use supervised fine-tuning…

Artificial Intelligence · Computer Science 2026-03-24 Tian Liang , Wenxiang Jiao , Zhiwei He , Jiahao Xu , Haitao Mi , Dong Yu

Sequential search models provide a powerful framework for studying consumer search using rich data that records the sequence of consumer actions taken during the search process. In existing empirical applications, their implementation often…

Econometrics · Economics 2026-05-05 Tinghan Zhang

Efficient retrieval of external knowledge bases and web pages is crucial for enhancing the reasoning abilities of LLMs. Previous works on training LLMs to leverage external retrievers for solving complex problems have predominantly employed…

The widely used retrieve-and-rerank pipeline faces two critical limitations: they are constrained by the initial retrieval quality of the top-k documents, and the growing computational demands of LLM-based rerankers restrict the number of…

Information Retrieval · Computer Science 2025-09-10 Haike Xu , Tong Chen

Deep research systems, agentic AI that solve complex, multi-step tasks by coordinating reasoning, search across the open web and user files, and tool use, are moving toward hierarchical deployments with a Planner, Coordinator, and…

Artificial Intelligence · Computer Science 2025-11-06 Wenjun Li , Zhi Chen , Jingru Lin , Hannan Cao , Wei Han , Sheng Liang , Zhi Zhang , Kuicai Dong , Dexun Li , Chen Zhang , Yong Liu

DeepSearch paradigms have become a core enabler for deep reasoning models, allowing them to invoke external search tools to access up-to-date, domain-specific knowledge beyond parametric boundaries, thereby enhancing the depth and factual…

Artificial Intelligence · Computer Science 2025-12-11 Hengzhi Lan , Yue Yu , Li Qian , Li Peng , Jie Wu , Wei Liu , Jian Luan , Ting Bai

The escalating complexity of modern codebases has intensified the need for retrieval systems capable of interpreting cross-component change intents, a capability fundamentally absent in conventional function-level search paradigms. While…

Software Engineering · Computer Science 2025-10-30 Aofan Liu , Shiyuan Song , Haoxuan Li , Cehao Yang , Yiyan Qi

Large Language Models (LLMs) have demonstrated significant potential in medical Question Answering (QA), yet they remain prone to hallucinations and ungrounded reasoning, limiting their reliability in high-stakes clinical scenarios. While…

Information Retrieval · Computer Science 2026-01-09 Jessica Ryan , Alexander I. Gumilang , Robert Wiliam , Derwin Suhartono

Sampling-based search, a simple paradigm for utilizing test-time compute, involves generating multiple candidate responses and selecting the best one -- typically by having models self-verify each response for correctness. In this paper, we…

Machine Learning · Computer Science 2025-02-21 Eric Zhao , Pranjal Awasthi , Sreenivas Gollapudi