English
Related papers

Related papers: Improving and Evaluating Open Deep Research Agents

200 papers

Given a user's complex information need, a multi-agent Deep Research system iteratively plans, retrieves, and synthesizes evidence across hundreds of documents to produce a high-quality answer. In one possible architecture, an orchestrator…

Information Retrieval · Computer Science 2026-04-06 Arthur Câmara , Vincent Slot , Jakub Zavrel

As an embodiment of intelligence evolution toward interconnected architectures, Deep Research Agents (DRAs) systematically exhibit the capabilities in task decomposition, cross-source retrieval, multi-stage reasoning, information…

Artificial Intelligence · Computer Science 2026-01-30 Yang Yao , Yixu Wang , Yuxuan Zhang , Yi Lu , Tianle Gu , Lingyu Li , Dingyi Zhao , Keming Wu , Haozhe Wang , Ping Nie , Yan Teng , Yingchun Wang

We present ORCA (Omni Research on Calculation in AI) Benchmark - a novel benchmark that evaluates large language models (LLMs) on multi-domain, real-life quantitative reasoning using verified outputs from Omni's calculator engine. In 500…

Artificial Intelligence · Computer Science 2025-11-06 Claudia Herambourg , Dawid Siuda , Julia Kopczyńska , Joao R. L. Santos , Wojciech Sas , Joanna Śmietańska-Nowak

This survey examines the rapidly evolving field of Deep Research systems -- AI-powered applications that automate complex research workflows through the integration of large language models, advanced information retrieval, and autonomous…

Artificial Intelligence · Computer Science 2025-06-17 Renjun Xu , Jingwen Peng

This paper presents an analysis of open-source large language models (LLMs) and their application in Retrieval-Augmented Generation (RAG) tasks, specific for enterprise-specific data sets scraped from their websites. With the increasing…

Information Retrieval · Computer Science 2024-06-18 Gautam B , Anupam Purwar

Agentic Retrieval Augmented Generation (RAG) and 'deep research' systems aim to enable autonomous search processes where Large Language Models (LLMs) iteratively refine outputs. However, applying these systems to domain-specific…

Computation and Language · Computer Science 2025-08-08 Samy Ateia , Udo Kruschwitz

Edge-scale deep research agents based on small language models are attractive for real-world deployment due to their advantages in cost, latency, and privacy. In this work, we study how to train a strong small deep research agent under…

In the field of software operations, Large Language Models (LLMs) have attracted increasing attention. However, existing research has not yet achieved efficient and effective end-to-end intelligent operations due to low-quality data,…

Machine Learning · Computer Science 2026-05-13 Jingkai He , Pengfei Chen , Chenghui Wu , Shuang Liang , Ye Li , Gou Tan , Xiadao Wen , Chuanfu Zhang

We present \textbf{Deep Researcher Agent}, an open-source framework that enables large language model (LLM) agents to autonomously conduct deep learning experiments around the clock. Unlike existing AI research assistants that focus on…

Artificial Intelligence · Computer Science 2026-04-08 Xiangyue Zhang

Reading comprehension by machine has been widely studied, but machine comprehension of spoken content is still a less investigated problem. In this paper, we release Open-Domain Spoken Question Answering Dataset (ODSQA) with more than three…

Computation and Language · Computer Science 2018-08-08 Chia-Hsuan Lee , Shang-Ming Wang , Huan-Cheng Chang , Hung-Yi Lee

Large language models (LLMs) have excelled in various natural language processing tasks, but challenges in interpretability and trustworthiness persist, limiting their use in high-stakes fields. Causal discovery offers a promising approach…

Artificial Intelligence · Computer Science 2024-06-10 Wei Zhou , Hong Huang , Guowen Zhang , Ruize Shi , Kehan Yin , Yuanyuan Lin , Bang Liu

Search engines answer users' queries by listing relevant items (e.g. documents, songs, products, web pages, ...). These engines rely on algorithms that learn to rank items so as to present an ordered list maximizing the probability that it…

Machine Learning · Computer Science 2021-09-14 Stefan Magureanu , Alexandre Proutiere , Marcus Isaksson , Boxun Zhang

The paradigm of large language model (LLM) reasoning is shifting from parameter scaling to test-time compute scaling, yet many existing approaches still rely on uniform brute-force sampling (for example, fixed best-of-N or self-consistency)…

Artificial Intelligence · Computer Science 2026-03-02 Siyuan Ma , Bo Gao , Xiaojun Jia , Simeng Qin , Tianlin Li , Ke Ma , Xiaoshuang Jia , Wenqi Ren , Yang Liu

Retrieval augmented generation (RAG) reduces hallucinations and factual errors in large language models (LLMs) by conditioning generation on retrieved external knowledge. Recent search agents further cast RAG as an autonomous, multi-turn…

Computation and Language · Computer Science 2026-03-05 Jian Li , Yizhang Jin , Dongqi Liu , Hang Ding , Jiafu Wu , Dongsheng Chen , Yunhang Shen , Yulei Qin , Ying Tai , Chengjie Wang , Xiaotong Yuan , Yabiao Wang

Large Language Models (LLMs) equipped with web search capabilities have demonstrated impressive potential for deep research tasks. However, current approaches predominantly rely on either manually engineered prompts (prompt…

Artificial Intelligence · Computer Science 2025-04-18 Yuxiang Zheng , Dayuan Fu , Xiangkun Hu , Xiaojie Cai , Lyumanshan Ye , Pengrui Lu , Pengfei Liu

Recent advancements in Large Reasoning Models (LRMs), such as OpenAI's o1/o3 and DeepSeek-R1, have demonstrated remarkable performance in specialized reasoning tasks through human-like deliberative thinking and long chain-of-thought…

Artificial Intelligence · Computer Science 2025-11-20 Weixiang Zhao , Xingyu Sui , Jiahe Guo , Yulin Hu , Yang Deng , Yanyan Zhao , Xuda Zhi , Yongbo Huang , Hao He , Wanxiang Che , Ting Liu , Bing Qin

Large Language Models (LLMs) have recently demonstrated remarkable performance in various Natural Language Processing (NLP) applications, such as sentiment analysis, content generation, and personalized recommendations. Despite their…

Computation and Language · Computer Science 2024-12-10 Mahaman Sanoussi Yahaya Alassan , Jessica López Espejel , Merieme Bouhandi , Walid Dahhane , El Hassane Ettifouri

Long-context multiple-choice question answering tasks require robust reasoning over extensive text sources. Since most of the pre-trained transformer models are restricted to processing only a few hundred words at a time, successful…

Information Retrieval · Computer Science 2025-01-28 Manish Singh , Manish Shrivastava

Dense retrieval (DR) converts queries and documents into dense embeddings and measures the similarity between queries and documents in vector space. One of the challenges in DR is the lack of domain-specific training data. While DR models…

Information Retrieval · Computer Science 2024-06-18 Zhiyuan Peng , Xuyang Wu , Qifan Wang , Yi Fang

Augmenting large language models (LLMs) with browsing tools substantially improves their potential as deep search agents to solve complex, real-world tasks. Yet, open LLMs still perform poorly in such settings due to limited long-horizon…

Computation and Language · Computer Science 2025-10-15 Rui Lu , Zhenyu Hou , Zihan Wang , Hanchen Zhang , Xiao Liu , Yujiang Li , Shi Feng , Jie Tang , Yuxiao Dong