中文
相关论文

相关论文: DeepResearch-9K: A Challenging Benchmark Dataset o…

200 篇论文

Deep research -- producing comprehensive, citation-grounded reports by searching and synthesizing information from hundreds of live web sources -- marks an important frontier for agentic systems. To rigorously evaluate this ability, four…

The performance gap between closed-source and open-source large language models (LLMs) is largely attributed to disparities in access to high-quality training data. To bridge this gap, we introduce a novel framework for the automated…

Deep research is an inherently challenging task that demands both breadth and depth of thinking. It involves navigating diverse knowledge spaces and reasoning over complex, multi-step dependencies, which presents substantial challenges for…

Large language models (LLMs) are increasingly expected to go beyond simple factual queries toward Deep Research-tasks that require decomposing questions into sub-problems, coordinating multi-step reasoning, and synthesizing evidence from…

计算与语言 · 计算机科学 2025-09-03 Ziyi Xia , Kun Luo , Hongjin Qian , Zheng Liu

The frontier of mathematics is defined by problems whose solutions are not yet known, yet it remains unclear whether language models can meaningfully engage with such problems without human intervention. A major obstacle is the lack of…

计算与语言 · 计算机科学 2026-05-28 Guijin Son , Seungyeop Yi , Minju Gwak , Hyunwoo Ko , Wongi Jang , Youngjae Yu

Existing question answering (QA) datasets are no longer challenging to most powerful Large Language Models (LLMs). Traditional QA benchmarks like TriviaQA, NaturalQuestions, ELI5 and HotpotQA mainly study ``known unknowns'' with clear…

计算与语言 · 计算机科学 2024-02-29 Corby Rosset , Ho-Lam Chung , Guanghui Qin , Ethan C. Chau , Zhuo Feng , Ahmed Awadallah , Jennifer Neville , Nikhil Rao

Deep Research Agents (DRAs) aim to automatically produce analyst-level reports through iterative information retrieval and synthesis. However, most existing DRAs were validated on question-answering benchmarks, while research on generating…

We introduce MLRC-Bench, a benchmark designed to quantify how effectively language agents can tackle challenging Machine Learning (ML) Research Competitions, with a focus on open research problems that demand novel methodologies. Unlike…

The advent of Large Language Models (LLMs) has significantly revolutionized web search. The emergence of LLM-based Search Agents marks a pivotal shift towards deeper, dynamic, autonomous information seeking. These agents can comprehend user…

信息检索 · 计算机科学 2025-08-20 Yunjia Xi , Jianghao Lin , Yongzhao Xiao , Zheli Zhou , Rong Shan , Te Gao , Jiachen Zhu , Weiwen Liu , Yong Yu , Weinan Zhang

Deep Research agents are rapidly emerging as primary consumers of modern retrieval systems. Unlike human users who issue and refine queries without documenting their intermediate thought processes, Deep Research agents generate explicit…

计算与语言 · 计算机科学 2026-03-10 Zijian Chen , Xueguang Ma , Shengyao Zhuang , Jimmy Lin , Akari Asai , Victor Zhong

As an embodiment of intelligence evolution toward interconnected architectures, Deep Research Agents (DRAs) systematically exhibit the capabilities in task decomposition, cross-source retrieval, multi-stage reasoning, information…

人工智能 · 计算机科学 2026-01-30 Yang Yao , Yixu Wang , Yuxuan Zhang , Yi Lu , Tianle Gu , Lingyu Li , Dingyi Zhao , Keming Wu , Haozhe Wang , Ping Nie , Yan Teng , Yingchun Wang

Recent advancements in LLM-based agents have demonstrated remarkable capabilities in handling complex, knowledge-intensive tasks by integrating external tools. Among diverse choices of tools, search tools play a pivotal role in accessing…

计算与语言 · 计算机科学 2025-10-28 Jiaxuan Gao , Wei Fu , Minyang Xie , Shusheng Xu , Chuyi He , Zhiyu Mei , Banghua Zhu , Yi Wu

Large reasoning models (LRMs), such as OpenAI-o1 and DeepSeek-R1, demonstrate impressive long-horizon reasoning capabilities. However, their reliance on static internal knowledge limits their performance on complex, knowledge-intensive…

计算与语言 · 计算机科学 2025-10-14 Xiaoxi Li , Jiajie Jin , Guanting Dong , Hongjin Qian , Yongkang Wu , Ji-Rong Wen , Yutao Zhu , Zhicheng Dou

Multi-step agentic retrieval systems based on large language models (LLMs) have demonstrated remarkable performance in complex information search tasks. However, these systems still face significant challenges in practical applications,…

机器学习 · 计算机科学 2025-10-16 Chuzhan Hao , Wenfeng Feng , Yuewei Zhang , Hao Wang

Retrieval-Augmented Generation (RAG) enhances large language models (LLMs) by grounding responses with retrieved information. As an emerging paradigm, Agentic RAG further enhances this process by introducing autonomous LLM agents into the…

As agentic foundation models continue to evolve, how to further improve their performance in vertical domains has become an important challenge. To this end, building upon Tongyi DeepResearch, a powerful agentic foundation model, we focus…

人工智能 · 计算机科学 2026-04-24 Zhichao Lin , Zhichao Liang , Gaoqiang Liu , Meng Xu , Baoyu Xiang , Shuxin Zhao , Yao Wu , Jian Xu , Guanjun Jiang

We present a new benchmark for evaluating Deep Search--a realistic and complex form of retrieval-augmented generation (RAG) that requires source-aware, multi-hop reasoning over diverse, sparsed, but related sources. These include documents,…

计算与语言 · 计算机科学 2025-07-01 Prafulla Kumar Choubey , Xiangyu Peng , Shilpa Bhagavath , Kung-Hsiang Huang , Caiming Xiong , Chien-Sheng Wu

Deep research agents have emerged as LLM-based systems designed to perform multi-step information seeking and reasoning over large, open-domain sources to answer complex questions by synthesizing information from multiple information…

信息检索 · 计算机科学 2026-03-20 Mahta Rafiee , Heydar Soudani , Zahra Abbasiantaeb , Mohammad Aliannejadi , Faegheh Hasibi , Hamed Zamani

Agentic search such as Deep Research systems-where agents autonomously browse the web, synthesize information, and return comprehensive citation-backed answers-represents a major shift in how users interact with web-scale information. While…

We present an open deep research system for long-form question answering, selected as a winning system in the text-to-text track of the MMU-RAG competition at NeurIPS 2025. The system combines an open-source large language model (LLM) with…

计算与语言 · 计算机科学 2025-12-16 Ikuya Yamada , Wataru Ikeda , Ko Yoshida , Mengyu Ye , Hinata Sugimoto , Masatoshi Suzuki , Hisanori Ozaki , Jun Suzuki