English
Related papers

Related papers: Characterizing Deep Research: A Benchmark and Form…

200 papers

Deep Research (DR) is an emerging agent application that leverages large language models (LLMs) to address open-ended queries. It requires the integration of several capabilities, including multi-step reasoning, cross-document synthesis,…

Deep Research Agents are a prominent category of LLM-based agents. By autonomously orchestrating multistep web exploration, targeted retrieval, and higher-order synthesis, they transform vast amounts of online information into…

Computation and Language · Computer Science 2025-06-16 Mingxuan Du , Benfeng Xu , Chiwei Zhu , Xiaorui Wang , Zhendong Mao

We introduce DRBench, a benchmark for evaluating AI agents on complex, open-ended deep research tasks in enterprise settings. Unlike prior benchmarks that focus on simple questions or web-only queries, DRBench evaluates agents on multi-step…

Deep Research Agents (DRAs) can autonomously conduct complex investigations and generate comprehensive reports, demonstrating strong real-world potential. However, existing evaluations mostly rely on close-ended benchmarks, while open-ended…

Large language models (LLMs) have rapidly evolved from text generators into powerful problem solvers. Yet, many open tasks demand critical thinking, multi-source, and verifiable outputs, which are beyond single-shot prompting or standard…

Deep Research Systems (DRS) aim to help users search the web, synthesize information, and deliver comprehensive investigative reports. However, how to rigorously evaluate these systems remains under-explored. Existing deep-research…

Computation and Language · Computer Science 2026-02-02 Ruizhe Li , Mingxuan Du , Benfeng Xu , Chiwei Zhu , Xiaorui Wang , Zhendong Mao

DeepResearch agents represent a transformative AI paradigm, conducting expert-level research through sophisticated reasoning and multi-tool integration. However, evaluating these systems remains critically challenging due to open-ended…

Artificial Intelligence · Computer Science 2025-10-10 Tianyu Fan , Xinyao Niu , Yuxiang Zheng , Fengji Zhang , Chengen Huang , Bei Chen , Junyang Lin , Chao Huang

As an embodiment of intelligence evolution toward interconnected architectures, Deep Research Agents (DRAs) systematically exhibit the capabilities in task decomposition, cross-source retrieval, multi-stage reasoning, information…

Artificial Intelligence · Computer Science 2026-01-30 Yang Yao , Yixu Wang , Yuxuan Zhang , Yi Lu , Tianle Gu , Lingyu Li , Dingyi Zhao , Keming Wu , Haozhe Wang , Ping Nie , Yan Teng , Yingchun Wang

Deep research -- producing comprehensive, citation-grounded reports by searching and synthesizing information from hundreds of live web sources -- marks an important frontier for agentic systems. To rigorously evaluate this ability, four…

Artificial Intelligence · Computer Science 2026-04-21 Jiayu Wang , Yifei Ming , Riya Dulepet , Qinglin Chen , Austin Xu , Zixuan Ke , Frederic Sala , Aws Albarghouthi , Caiming Xiong , Shafiq Joty

This survey examines the rapidly evolving field of Deep Research systems -- AI-powered applications that automate complex research workflows through the integration of large language models, advanced information retrieval, and autonomous…

Artificial Intelligence · Computer Science 2025-06-17 Renjun Xu , Jingwen Peng

Deep research, in which an agent searches the open web, collects evidence, and derives an answer through extended reasoning, is a prominent use case for frontier language models. Frontier deep research products score high on existing…

Artificial Intelligence · Computer Science 2026-05-21 Sixiong Xie , Zhuofan Shi , Haiyang Shen , Jiuzheng Wang , Siqi Zhong , Mugeng Liu , Chongyang Pan , Peilun Jia , Baoqing Sun , Xiang Jing , Yun Ma

We introduce Deep FinResearch Bench, a practical and comprehensive evaluation framework for deep research (DR) agents in financial investment research. The benchmark assesses three dimensions of report quality: qualitative rigor,…

Artificial Intelligence · Computer Science 2026-04-24 Mirazul Haque , Antony Papadimitriou , Samuel Mensah , Zhiqiang Ma , Zhijin Guo , Joy Prakash Sain , Simerjot Kaur , Charese Smiley , Xiaomo Liu

Deep Research Agents (DRAs) aim to automatically produce analyst-level reports through iterative information retrieval and synthesis. However, most existing DRAs were validated on question-answering benchmarks, while research on generating…

Deep Research Agents (DRAs) generate citation-rich reports via multi-step search and synthesis, yet existing benchmarks mainly target text-only settings or short-form multimodal QA, missing end-to-end multimodal evidence use. We introduce…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Peizhou Huang , Zixuan Zhong , Zhongwei Wan , Donghao Zhou , Samiul Alam , Xin Wang , Zexin Li , Zhihao Dou , Li Zhu , Jing Xiong , Chaofan Tao , Yan Xu , Dimitrios Dimitriadis , Tuo Zhang , Mi Zhang

The advent of Deep Research agents has substantially reduced the time required for conducting extensive research tasks. However, these tasks inherently demand rigorous standards of factual accuracy and comprehensiveness, necessitating…

Computation and Language · Computer Science 2025-08-25 Minghao Li , Ying Zeng , Zhihao Cheng , Cong Ma , Kai Jia

Recent advances in large language models have enabled deep research systems that generate expert-level reports through multi-step reasoning and evidence-based synthesis. However, evaluating such reports remains challenging: report quality…

Computation and Language · Computer Science 2026-03-11 Janghoon Han , Heegyu Kim , Changho Lee , Dahm Lee , Min Hyung Park , Hosung Song , Stanley Jungkyu Choi , Moontae Lee , Honglak Lee

The emergence of deep research systems presents significant capabilities in problem-solving, extending from basic queries to sophisticated research tasks. However, existing benchmarks primarily evaluate these systems as agents for web…

Artificial Intelligence · Computer Science 2025-07-23 Tianze Xu , Pengrui Lu , Lyumanshan Ye , Xiangkun Hu , Pengfei Liu

The rapid progress of Large Language Models (LLMs) has given rise to a new category of autonomous AI systems, referred to as Deep Research (DR) agents. These agents are designed to tackle complex, multi-turn informational research tasks by…

Artificial Intelligence · Computer Science 2025-09-04 Yuxuan Huang , Yihang Chen , Haozheng Zhang , Kang Li , Huichi Zhou , Meng Fang , Linyi Yang , Xiaoguang Li , Lifeng Shang , Songcen Xu , Jianye Hao , Kun Shao , Jun Wang

We present a new benchmark for evaluating Deep Search--a realistic and complex form of retrieval-augmented generation (RAG) that requires source-aware, multi-hop reasoning over diverse, sparsed, but related sources. These include documents,…

Computation and Language · Computer Science 2025-07-01 Prafulla Kumar Choubey , Xiangyu Peng , Shilpa Bhagavath , Kung-Hsiang Huang , Caiming Xiong , Chien-Sheng Wu

Deep Research Agents (DRAs) aim to solve complex, long-horizon research tasks involving planning, retrieval, multimodal understanding, and report generation, yet their evaluation remains challenging due to dynamic web environments and…

‹ Prev 1 2 3 10 Next ›