English
Related papers

Related papers: DeepResearch-9K: A Challenging Benchmark Dataset o…

200 papers

AI agents have seen widespread adoption in information retrieval for scientific research, giving rise to tools such as Deep Research. However, existing retrieval agents mainly rely on keyword- or embedding-based methods. While effective at…

Computational Engineering, Finance, and Science · Computer Science 2026-05-25 Chenyang Shao , Fengli Xu , Yong Li

Large language models (LLMs) show promise for healthcare question answering, but clinical use is limited by weak verification, insufficient evidence grounding, and unreliable confidence signalling. We propose a multi-agent medical QA…

Computation and Language · Computer Science 2026-02-17 Naeimeh Nourmohammadi , Md Meem Hossain , The Anh Han , Safina Showkat Ara , Zia Ush Shamszaman

Large Language Model (LLM)-based coding agents have shown promising results on coding benchmarks, but their effectiveness on systems code remains underexplored. Due to the size and complexities of systems code, making changes to a systems…

Software Engineering · Computer Science 2026-05-21 Ramneet Singh , Sathvik Joel , Abhav Mehrotra , Nalin Wadhwa , Ramakrishna B Bairi , Aditya Kanade , Nagarajan Natarajan

Reinforcement learning (RL) algorithms have been around for decades and employed to solve various sequential decision-making problems. These algorithms however have faced great challenges when dealing with high-dimensional environments. The…

Machine Learning · Computer Science 2020-04-01 Thanh Thi Nguyen , Ngoc Duy Nguyen , Saeid Nahavandi

Document Question Answering (DocQA) focuses on answering questions grounded in given documents, yet existing DocQA agents lack effective tool utilization and largely rely on closed-source models. In this work, we introduce DocDancer, an…

Computation and Language · Computer Science 2026-01-09 Qintong Zhang , Xinjie Lv , Jialong Wu , Baixuan Li , Zhengwei Tao , Guochen Yan , Huanyao Zhang , Bin Wang , Jiahao Xu , Haitao Mi , Wentao Zhang

We introduce DeepResearch$^{\text{Eco}}$, a novel agentic LLM-based system for automated scientific synthesis that supports recursive, depth- and breadth-controlled exploration of original research questions -- enhancing search diversity…

Artificial Intelligence · Computer Science 2025-07-15 Jennifer D'Souza , Endres Keno Sander , Andrei Aioanei

Deep learning has enabled traditional reinforcement learning methods to deal with high-dimensional problems. However, one of the disadvantages of deep reinforcement learning methods is the limited exploration capacity of learning agents. In…

Machine Learning · Computer Science 2019-07-30 Thanh Nguyen , Ngoc Duy Nguyen , Saeid Nahavandi

Deep research agents powered by Large Language Models (LLMs) can perform multi-step reasoning, web exploration, and long-form report generation. However, most existing systems operate in an autonomous manner, assuming fully specified user…

Computation and Language · Computer Science 2026-01-13 Yingchaojie Feng , Qiang Huang , Xiaoya Xie , Zhaorui Yang , Jun Yu , Wei Chen , Anthony K. H. Tung

DeepSeek-V3 and DeepSeek-R1 are leading open-source Large Language Models (LLMs) for general-purpose tasks and reasoning, achieving performance comparable to state-of-the-art closed-source models from companies like OpenAI and Anthropic --…

Machine Learning · Computer Science 2025-03-17 Chengen Wang , Murat Kantarcioglu

Effectively evaluating deep research agents that autonomously search the web, analyze information, and generate reports remains a major challenge, particularly when it comes to assessing long reports and giving detailed feedback on their…

Deep reasoning is fundamental for solving complex tasks, especially in vision-centric scenarios that demand sequential, multimodal understanding. However, existing benchmarks typically evaluate agents with fully synthetic, single-turn…

While Large Language Models (LLMs) achieve near-human performance on standard benchmarks, their capabilities often fail to generalize to complex, real-world problems. To bridge this gap, we introduce DeepQuestion, a scalable, automated…

Computation and Language · Computer Science 2026-03-02 Ali Khoramfar , Ali Ramezani , Mohammad Mahdi Mohajeri , Mohammad Javad Dousti , Majid Nili Ahmadabadi , Heshaam Faili

A surge in academic publications calls for automated deep research (DR) systems, but accurately evaluating them is still an open problem. First, existing benchmarks often focus narrowly on retrieval while neglecting high-level planning and…

Computation and Language · Computer Science 2026-02-02 Zhihan Guo , Feiyang Xu , Yifan Li , Muzhi Li , Shuai Zou , Jiele Wu , Han Shi , Haoli Bai , Ho-fung Leung , Irwin King

Effective decision making involves flexibly relating past experiences and relevant contextual information to a novel situation. In deep reinforcement learning (RL), the dominant paradigm is for an agent to amortise information that helps…

Machine Learning · Computer Science 2022-12-20 Peter C. Humphreys , Arthur Guez , Olivier Tieleman , Laurent Sifre , Théophane Weber , Timothy Lillicrap

Information seeking is a fundamental requirement for humans. However, existing LLM agents rely heavily on open-web search, which exposes two fundamental weaknesses: online content is noisy and unreliable, and many real-world tasks require…

Computation and Language · Computer Science 2025-10-07 Yaxin Du , Yuanshuo Zhang , Xiyuan Yang , Yifan Zhou , Cheng Wang , Gongyi Zou , Xianghe Pang , Wenhao Wang , Menglan Chen , Shuo Tang , Zhiyu Li , Feiyu Xiong , Siheng Chen

The advent of Deep Research agents has substantially reduced the time required for conducting extensive research tasks. However, these tasks inherently demand rigorous standards of factual accuracy and comprehensiveness, necessitating…

Computation and Language · Computer Science 2025-08-25 Minghao Li , Ying Zeng , Zhihao Cheng , Cong Ma , Kai Jia

Recent advancements in Large Language Models (LLMs) have largely focused on depth scaling, where a single agent solves long-horizon problems with multi-turn reasoning and tool use. However, as tasks grow broader, the key bottleneck shifts…

Artificial Intelligence · Computer Science 2026-03-13 Zelai Xu , Zhexuan Xu , Ruize Zhang , Chunyang Zhu , Shi Yu , Weilin Liu , Quanlu Zhang , Wenbo Ding , Chao Yu , Yu Wang

AI agents could accelerate scientific discovery by automating hypothesis formation, experiment design, coding, execution, and analysis, yet existing benchmarks probe narrow skills in simplified settings. To address this gap, we introduce…

Deep Research Agents (DRAs) aim to answer complex questions by searching the web, checking evidence, and synthesizing conclusions across heterogeneous sources. We introduce a category-theoretic framework for evaluating and improving such…

Machine Learning · Computer Science 2026-04-30 Shuoling Liu , Zhiquan Tan , Kun Yi , Hui Wu , Yihan Li , Jiangpeng Yan , Liyuan Chen , Kai Chen , Qiang Yang

Education is one of the most promising real-world applications for Large Language Models (LLMs). However, current LLMs rely on static pre-training knowledge and lack adaptation to individual learners, while existing RAG systems fall short…

Computers and Society · Computer Science 2026-05-12 Bingxi Zhao , Jiahao Zhang , Xubin Ren , Zirui Guo , Tianzhe Chu , Yi Ma , Chao Huang