English
Related papers

Related papers: DeepResearch-9K: A Challenging Benchmark Dataset o…

200 papers

Deep research -- producing comprehensive, citation-grounded reports by searching and synthesizing information from hundreds of live web sources -- marks an important frontier for agentic systems. To rigorously evaluate this ability, four…

Artificial Intelligence · Computer Science 2026-04-21 Jiayu Wang , Yifei Ming , Riya Dulepet , Qinglin Chen , Austin Xu , Zixuan Ke , Frederic Sala , Aws Albarghouthi , Caiming Xiong , Shafiq Joty

The performance gap between closed-source and open-source large language models (LLMs) is largely attributed to disparities in access to high-quality training data. To bridge this gap, we introduce a novel framework for the automated…

Deep research is an inherently challenging task that demands both breadth and depth of thinking. It involves navigating diverse knowledge spaces and reasoning over complex, multi-step dependencies, which presents substantial challenges for…

Large language models (LLMs) are increasingly expected to go beyond simple factual queries toward Deep Research-tasks that require decomposing questions into sub-problems, coordinating multi-step reasoning, and synthesizing evidence from…

Computation and Language · Computer Science 2025-09-03 Ziyi Xia , Kun Luo , Hongjin Qian , Zheng Liu

The frontier of mathematics is defined by problems whose solutions are not yet known, yet it remains unclear whether language models can meaningfully engage with such problems without human intervention. A major obstacle is the lack of…

Computation and Language · Computer Science 2026-05-28 Guijin Son , Seungyeop Yi , Minju Gwak , Hyunwoo Ko , Wongi Jang , Youngjae Yu

Existing question answering (QA) datasets are no longer challenging to most powerful Large Language Models (LLMs). Traditional QA benchmarks like TriviaQA, NaturalQuestions, ELI5 and HotpotQA mainly study ``known unknowns'' with clear…

Computation and Language · Computer Science 2024-02-29 Corby Rosset , Ho-Lam Chung , Guanghui Qin , Ethan C. Chau , Zhuo Feng , Ahmed Awadallah , Jennifer Neville , Nikhil Rao

Deep Research Agents (DRAs) aim to automatically produce analyst-level reports through iterative information retrieval and synthesis. However, most existing DRAs were validated on question-answering benchmarks, while research on generating…

We introduce MLRC-Bench, a benchmark designed to quantify how effectively language agents can tackle challenging Machine Learning (ML) Research Competitions, with a focus on open research problems that demand novel methodologies. Unlike…

The advent of Large Language Models (LLMs) has significantly revolutionized web search. The emergence of LLM-based Search Agents marks a pivotal shift towards deeper, dynamic, autonomous information seeking. These agents can comprehend user…

Information Retrieval · Computer Science 2025-08-20 Yunjia Xi , Jianghao Lin , Yongzhao Xiao , Zheli Zhou , Rong Shan , Te Gao , Jiachen Zhu , Weiwen Liu , Yong Yu , Weinan Zhang

Deep Research agents are rapidly emerging as primary consumers of modern retrieval systems. Unlike human users who issue and refine queries without documenting their intermediate thought processes, Deep Research agents generate explicit…

Computation and Language · Computer Science 2026-03-10 Zijian Chen , Xueguang Ma , Shengyao Zhuang , Jimmy Lin , Akari Asai , Victor Zhong

As an embodiment of intelligence evolution toward interconnected architectures, Deep Research Agents (DRAs) systematically exhibit the capabilities in task decomposition, cross-source retrieval, multi-stage reasoning, information…

Artificial Intelligence · Computer Science 2026-01-30 Yang Yao , Yixu Wang , Yuxuan Zhang , Yi Lu , Tianle Gu , Lingyu Li , Dingyi Zhao , Keming Wu , Haozhe Wang , Ping Nie , Yan Teng , Yingchun Wang

Recent advancements in LLM-based agents have demonstrated remarkable capabilities in handling complex, knowledge-intensive tasks by integrating external tools. Among diverse choices of tools, search tools play a pivotal role in accessing…

Computation and Language · Computer Science 2025-10-28 Jiaxuan Gao , Wei Fu , Minyang Xie , Shusheng Xu , Chuyi He , Zhiyu Mei , Banghua Zhu , Yi Wu

Large reasoning models (LRMs), such as OpenAI-o1 and DeepSeek-R1, demonstrate impressive long-horizon reasoning capabilities. However, their reliance on static internal knowledge limits their performance on complex, knowledge-intensive…

Computation and Language · Computer Science 2025-10-14 Xiaoxi Li , Jiajie Jin , Guanting Dong , Hongjin Qian , Yongkang Wu , Ji-Rong Wen , Yutao Zhu , Zhicheng Dou

Multi-step agentic retrieval systems based on large language models (LLMs) have demonstrated remarkable performance in complex information search tasks. However, these systems still face significant challenges in practical applications,…

Machine Learning · Computer Science 2025-10-16 Chuzhan Hao , Wenfeng Feng , Yuewei Zhang , Hao Wang

Retrieval-Augmented Generation (RAG) enhances large language models (LLMs) by grounding responses with retrieved information. As an emerging paradigm, Agentic RAG further enhances this process by introducing autonomous LLM agents into the…

Information Retrieval · Computer Science 2025-05-26 Yunjia Xi , Jianghao Lin , Menghui Zhu , Yongzhao Xiao , Zhuoying Ou , Jiaqi Liu , Tong Wan , Bo Chen , Weiwen Liu , Yasheng Wang , Ruiming Tang , Weinan Zhang , Yong Yu

As agentic foundation models continue to evolve, how to further improve their performance in vertical domains has become an important challenge. To this end, building upon Tongyi DeepResearch, a powerful agentic foundation model, we focus…

Artificial Intelligence · Computer Science 2026-04-24 Zhichao Lin , Zhichao Liang , Gaoqiang Liu , Meng Xu , Baoyu Xiang , Shuxin Zhao , Yao Wu , Jian Xu , Guanjun Jiang

We present a new benchmark for evaluating Deep Search--a realistic and complex form of retrieval-augmented generation (RAG) that requires source-aware, multi-hop reasoning over diverse, sparsed, but related sources. These include documents,…

Computation and Language · Computer Science 2025-07-01 Prafulla Kumar Choubey , Xiangyu Peng , Shilpa Bhagavath , Kung-Hsiang Huang , Caiming Xiong , Chien-Sheng Wu

Deep research agents have emerged as LLM-based systems designed to perform multi-step information seeking and reasoning over large, open-domain sources to answer complex questions by synthesizing information from multiple information…

Information Retrieval · Computer Science 2026-03-20 Mahta Rafiee , Heydar Soudani , Zahra Abbasiantaeb , Mohammad Aliannejadi , Faegheh Hasibi , Hamed Zamani

Agentic search such as Deep Research systems-where agents autonomously browse the web, synthesize information, and return comprehensive citation-backed answers-represents a major shift in how users interact with web-scale information. While…

We present an open deep research system for long-form question answering, selected as a winning system in the text-to-text track of the MMU-RAG competition at NeurIPS 2025. The system combines an open-source large language model (LLM) with…

Computation and Language · Computer Science 2025-12-16 Ikuya Yamada , Wataru Ikeda , Ko Yoshida , Mengyu Ye , Hinata Sugimoto , Masatoshi Suzuki , Hisanori Ozaki , Jun Suzuki