English
Related papers

Related papers: How Far Are We from Genuinely Useful Deep Research…

200 papers

Recent work has explored training Large Language Model (LLM) search agents with reinforcement learning (RL) for open-domain question answering (QA). However, most evaluations focus solely on final answer accuracy, overlooking how these…

Artificial Intelligence · Computer Science 2025-09-29 Jiaqi Shao , Yuxiang Lin , Munish Prasad Lohani , Yufeng Miao , Bing Luo

In recent years, advances in deep learning have resulted in a plethora of successes in the use of reinforcement learning (RL) to solve complex sequential decision tasks with high-dimensional inputs. However, existing systems lack the…

Artificial Intelligence · Computer Science 2023-07-19 Pedro Sequeira , Melinda Gervasio

Given a user's complex information need, a multi-agent Deep Research system iteratively plans, retrieves, and synthesizes evidence across hundreds of documents to produce a high-quality answer. In one possible architecture, an orchestrator…

Information Retrieval · Computer Science 2026-04-06 Arthur Câmara , Vincent Slot , Jakub Zavrel

Deep Neural Networks (DNN) have found numerous applications in various domains, including fraud detection, medical diagnosis, facial recognition, and autonomous driving. However, DNN-based systems often suffer from reliability issues due to…

Software Engineering · Computer Science 2025-01-23 Sigma Jahan , Mehil B Shah , Parvez Mahbub , Mohammad Masudur Rahman

Artificial intelligence systems for scientific discovery have demonstrated remarkable potential, yet existing approaches remain largely proprietary and operate in batch-processing modes requiring hours per research cycle, precluding…

Artificial Intelligence · Computer Science 2026-01-28 Lukas Weidener , Marko Brkić , Mihailo Jovanović , Ritvik Singh , Chiara Baccin , Emre Ulgac , Alex Dobrin , Aakaash Meduri

Deep Research (DR) agents extend Large Language Models (LLMs) beyond parametric knowledge by autonomously retrieving and synthesizing evidence from large web corpora into long-form reports, enabling a long-horizon agentic paradigm. However,…

Artificial Intelligence · Computer Science 2026-02-04 Haohao Luo , Zexi Li , Yuexiang Xie , Wenhao Zhang , Yaliang Li , Ying Shen

Fine-grained visual understanding is shifting from static classification to knowledge-augmented reasoning, where models must justify as well as recognise. Existing approaches remain limited by closed-set taxonomies and single-label…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Junhan Chen , Zilu Zhou , Yujun Tong , Dongliang Chang , Yitao Luo , Zhanyu Ma

Current large language models (LLMs) have proven useful for analyzing financial data, but most existing models, such as BloombergGPT and FinGPT, lack customization for specific user needs. In this paper, we address this gap by developing…

Computational Engineering, Finance, and Science · Computer Science 2024-10-22 Felix Tian , Ajay Byadgi , Daniel Kim , Daochen Zha , Matt White , Kairong Xiao , Xiao-Yang Liu Yanglet

Autonomous agent systems powered by Large Language Models (LLMs) have demonstrated promising capabilities in automating complex tasks. However, current evaluations largely rely on success rates without systematically analyzing the…

Artificial Intelligence · Computer Science 2025-08-19 Ruofan Lu , Yichen Li , Yintong Huo

The rapid development of automated scientific survey generation technology has made it increasingly important to establish a comprehensive benchmark to evaluate the quality of generated surveys.Nearly all existing evaluation benchmarks rely…

Artificial Intelligence · Computer Science 2026-01-23 Guo-Biao Zhang , Ding-Yuan Liu , Da-Yi Wu , Tian Lan , Heyan Huang , Zhijing Wu , Xian-Ling Mao

Deepfake detection automatically recognizes the manipulated medias through the analysis of the difference between manipulated and non-altered videos. It is natural to ask which are the top performers among the existing deepfake detection…

Computer Vision and Pattern Recognition · Computer Science 2024-03-14 Chenhao Lin , Jingyi Deng , Pengbin Hu , Chao Shen , Qian Wang , Qi Li

Rare diseases affect over 300 million individuals worldwide, yet timely and accurate diagnosis remains an urgent challenge. Patients often endure a prolonged diagnostic odyssey exceeding five years, marked by repeated referrals,…

Computation and Language · Computer Science 2026-02-17 Weike Zhao , Chaoyi Wu , Yanjie Fan , Xiaoman Zhang , Pengcheng Qiu , Yuze Sun , Xiao Zhou , Yanfeng Wang , Xin Sun , Ya Zhang , Yongguo Yu , Kun Sun , Weidi Xie

The rapid rise in AI conference submissions has driven increasing exploration of large language models (LLMs) for peer review support. However, LLM-based reviewers often generate superficial, formulaic comments lacking substantive,…

Computation and Language · Computer Science 2026-04-17 Zhuofeng Li , Yi Lu , Dongfu Jiang , Haoxiang Zhang , Yuyang Bai , Chuan Li , Yu Wang , Shuiwang Ji , Jianwen Xie , Yu Zhang

The evaluation of Deep Research Agents is a critical challenge, as conventional outcome-based metrics fail to capture the nuances of their complex reasoning. Current evaluation faces two primary challenges: 1) a reliance on singular metrics…

Computation and Language · Computer Science 2026-02-26 Yanyu Chen , Jiyue Jiang , Jiahong Liu , Yifei Zhang , Xiao Guo , Irwin King

We present \textbf{Deep Researcher Agent}, an open-source framework that enables large language model (LLM) agents to autonomously conduct deep learning experiments around the clock. Unlike existing AI research assistants that focus on…

Artificial Intelligence · Computer Science 2026-04-08 Xiangyue Zhang

Safe deployment of AI models requires proactive detection of failures to prevent costly errors. To this end, we study the important problem of detecting failures in deep regression models. Existing approaches rely on epistemic uncertainty…

Machine Learning · Computer Science 2024-06-04 Jayaraman J. Thiagarajan , Vivek Narayanaswamy , Puja Trivedi , Rushil Anirudh

Deep learning (DL) models have become core modules for many applications. However, deploying these models without careful performance benchmarking that considers both hardware and software's impact often leads to poor service and costly…

Machine Learning · Computer Science 2021-01-06 Huaizheng Zhang , Yizheng Huang , Yonggang Wen , Jianxiong Yin , Kyle Guan

Retrieval-augmented generation (RAG) and its graph-based extensions (GraphRAG) are effective paradigms for improving large language model (LLM) reasoning by grounding generation in external knowledge. However, most existing RAG and GraphRAG…

Information Retrieval · Computer Science 2026-04-14 Dongzhe Fan , Zheyi Xue , Siyuan Liu , Qiaoyu Tan

With the increasing deployment of Large Language Models (LLMs) in the finance domain, LLMs are increasingly expected to parse complex regulatory disclosures. However, existing benchmarks often focus on isolated details, failing to reflect…

Computational Engineering, Finance, and Science · Computer Science 2026-02-17 Yidong Jiang , Junrong Chen , Eftychia Makri , Jialin Chen , Peiwen Li , Ali Maatouk , Leandros Tassiulas , Eliot Brenner , Bing Xiang , Rex Ying

The integration of Large Language Models (LLMs) into the financial domain is driving a paradigm shift from passive information retrieval to dynamic, agentic interaction. While general-purpose tool learning has witnessed a surge in…

Artificial Intelligence · Computer Science 2026-03-10 Jiaxuan Lu , Kong Wang , Yemin Wang , Qingmei Tang , Hongwei Zeng , Xiang Chen , Jiahao Pi , Shujian Deng , Lingzhi Chen , Yi Fu , Kehua Yang , Xiao Sun