English
Related papers

Related papers: FinDeepResearch: Evaluating Deep Research Agents i…

200 papers

Recent advances in large language models have enabled deep research systems that generate expert-level reports through multi-step reasoning and evidence-based synthesis. However, evaluating such reports remains challenging: report quality…

Computation and Language · Computer Science 2026-03-11 Janghoon Han , Heegyu Kim , Changho Lee , Dahm Lee , Min Hyung Park , Hosung Song , Stanley Jungkyu Choi , Moontae Lee , Honglak Lee

Information tasks such as writing surveys or analytical reports require complex search and reasoning, and have recently been grouped under the umbrella of \textit{deep research} -- a term also adopted by recent models targeting these…

While Large Multimodal Models (LMMs) excel in general visual tasks, their deployment in specialized financial contexts remains insufficient. Existing benchmarks prioritize isolated charts, often overlooking the need to integrate data from…

Computational Engineering, Finance, and Science · Computer Science 2026-05-19 Jiayong Zhu , Jiangtong Li , Jinru Ding , Dawei Cheng , Jie Xu , Feng Yu

As LLMs shift toward autonomous agents, Deep Research has emerged as a pivotal metric. However, existing academic benchmarks like BrowseComp often fail to meet real-world demands for open-ended research, which requires robust skills in…

Financial decision-making requires processing vast amounts of real-time information while understanding their complex temporal relationships. While traditional search engines excel at providing real-time information access, they often…

Information Retrieval · Computer Science 2025-02-25 Jinzheng Li , Jingshu Zhang , Hongguang Li , Yiqing Shen

Accurate information retrieval (IR) is critical in the financial domain, where investors must identify relevant information from large collections of documents. Traditional IR methods -- whether sparse or dense -- often fall short in…

Deep Research Agents (DRAs) aim to solve complex, long-horizon research tasks involving planning, retrieval, multimodal understanding, and report generation, yet their evaluation remains challenging due to dynamic web environments and…

We introduce FinMMDocR, a novel bilingual multimodal benchmark for evaluating multimodal large language models (MLLMs) on real-world financial numerical reasoning. Compared to existing benchmarks, our work delivers three major advancements.…

The integration of Large Language Models (LLMs) into the financial domain is driving a paradigm shift from passive information retrieval to dynamic, agentic interaction. While general-purpose tool learning has witnessed a surge in…

Artificial Intelligence · Computer Science 2026-03-10 Jiaxuan Lu , Kong Wang , Yemin Wang , Qingmei Tang , Hongwei Zeng , Xiang Chen , Jiahao Pi , Shujian Deng , Lingzhi Chen , Yi Fu , Kehua Yang , Xiao Sun

Recently, AI agents are rapidly evolving in intelligence and widely used in professional research applications, such as STEM, software development, and finance. Among these AI agents, deep research agent is a key category as it can perform…

Computation and Language · Computer Science 2025-10-21 Rui Sun , Zuo Bai , Wentao Zhang , Yuxiang Zhang , Li Zhao , Shan Sun , Zhengwen Qiu

As financial institutions and professionals increasingly incorporate Large Language Models (LLMs) into their workflows, substantial barriers, including proprietary data and specialized knowledge, persist between the finance sector and the…

Statistical Finance · Quantitative Finance 2024-05-28 Hongyang Yang , Boyu Zhang , Neng Wang , Cheng Guo , Xiaoli Zhang , Likun Lin , Junlin Wang , Tianyu Zhou , Mao Guan , Runjia Zhang , Christina Dan Wang

Artificial Intelligence (AI) technology has emerged as a transformative force in financial analysis and the finance industry, though significant questions remain about the full capabilities of Large Language Model (LLM) agents in this…

Computational Engineering, Finance, and Science · Computer Science 2025-08-05 Antoine Bigeard , Langston Nashold , Rayan Krishnan , Shirley Wu

Deep Research (DR) agents built on Large Language Models (LLMs) can perform complex, multi-step research by decomposing tasks, retrieving online information, and synthesizing detailed reports. However, the misuse of LLMs with such powerful…

Cryptography and Security · Computer Science 2025-10-24 Shuo Chen , Zonggen Li , Zhen Han , Bailan He , Tong Liu , Haokun Chen , Georg Groh , Philip Torr , Volker Tresp , Jindong Gu

Real-world financial decision-making is a challenging problem that requires reasoning over heterogeneous signals, including company fundamentals derived from regulatory filings and trading signals computed from price dynamics. Recently,…

Computational Engineering, Finance, and Science · Computer Science 2026-03-24 Yogesh Agrawal , Aniruddha Dutta , Md Mahadi Hasan , Santu Karmaker , Aritra Dutta

Deep Research (DR) requires LLM agents to autonomously perform multi-step information seeking, processing, and reasoning to generate comprehensive reports. In contrast to existing studies that mainly focus on unstructured web content, a…

Large language models (LLMs) are increasingly applied to financial analysis, yet their ability to audit structured financial statements under explicit accounting principles remains poorly explored. Existing benchmarks primarily evaluate…

Artificial Intelligence · Computer Science 2026-03-13 Arun Vignesh Malarkkan , Manan Roy Choudhury , Guangwei Zhang , Vivek Gupta , Qingyun Wang , Yanjie Fu , Denghui Zhang

Large Language Models (LLMs) have demonstrated impressive capabilities across various domains, but their effectiveness in financial decision-making remains inadequately evaluated. Current benchmarks primarily assess LLMs' understanding on…

Multiagent Systems · Computer Science 2025-06-27 Changlun Li , Yao Shi , Yuyu Luo , Nan Tang

Recent studies demonstrate that tool-calling capability enables large language models (LLMs) to interact with external environments for long-horizon financial tasks. While existing benchmarks have begun evaluating financial tool calling,…

While LLMs have shown great success in financial tasks like stock prediction and question answering, their application in fully automating Equity Research Report generation remains uncharted territory. In this paper, we formulate the Equity…

Computation and Language · Computer Science 2025-11-12 Song Jin , Shuqi Li , Shukun Zhang , Rui Yan

In recent years, Large Language Models (LLMs) have demonstrated remarkable versatility across various applications, including natural language understanding, domain-specific knowledge tasks, etc. However, applying LLMs to complex,…

Computation and Language · Computer Science 2024-11-12 Xinqi Yang , Scott Zang , Yong Ren , Dingjie Peng , Zheng Wen