English
Related papers

Related papers: FinDeepResearch: Evaluating Deep Research Agents i…

200 papers

Large Language Models (LLMs) exhibit considerable promise in financial applications; however, prevailing models frequently demonstrate limitations when confronted with scenarios that necessitate sophisticated reasoning capabilities,…

Computation and Language · Computer Science 2025-07-29 Yanjun Zheng , Xiyang Du , Longfei Liao , Xiaoke Zhao , Zhaowen Zhou , Jingze Song , Bo Zhang , Jiawei Liu , Xiang Qi , Zhe Li , Zhiqiang Zhang , Wei Wang , Peng Zhang

We introduce FinDebate, a multi-agent framework for financial analysis, integrating collaborative debate with domain-specific Retrieval-Augmented Generation (RAG). Five specialized agents, covering earnings, market, sentiment, valuation,…

Computation and Language · Computer Science 2025-09-23 Tianshi Cai , Guanxu Li , Nijia Han , Ce Huang , Zimu Wang , Changyu Zeng , Yuqi Wang , Jingshi Zhou , Haiyang Zhang , Qi Chen , Yushan Pan , Shuihua Wang , Wei Wang

This paper presents a novel hierarchical framework for portfolio optimization, integrating lightweight Large Language Models (LLMs) with Deep Reinforcement Learning (DRL) to combine sentiment signals from financial news with traditional…

Computation and Language · Computer Science 2025-08-01 Baptiste Lefort , Eric Benhamou , Beatrice Guez , Jean-Jacques Ohana , Ethan Setrouk , Alban Etienne

This paper introduces CryptoBench, the first expert-curated, dynamic benchmark designed to rigorously evaluate the real-world capabilities of Large Language Model (LLM) agents in the uniquely demanding and fast-paced cryptocurrency domain.…

The agency expected of Agentic Large Language Models goes beyond answering correctly, requiring autonomy to set goals and decide what to explore. We term this investigatory intelligence, distinguishing it from executional intelligence,…

Artificial Intelligence · Computer Science 2026-05-19 Wei Liu , Peijie Yu , Michele Orini , Yali Du , Yulan He

Multimodal Large Language Models (MLLMs) have experienced rapid development in recent years. However, in the financial domain, there is a notable lack of effective and specialized multimodal evaluation datasets. To advance the development…

Computation and Language · Computer Science 2025-06-02 Junyu Luo , Zhizhuo Kou , Liming Yang , Xiao Luo , Jinsheng Huang , Zhiping Xiao , Jingshu Peng , Chengzhong Liu , Jiaming Ji , Xuanzhe Liu , Sirui Han , Ming Zhang , Yike Guo

Despite the strong language understanding abilities of large language models (LLMs), they still struggle with reliable question answering (QA) over long, structured documents, particularly for numerical reasoning. Financial annual reports…

Computation and Language · Computer Science 2026-04-07 Yi-Cheng Wang , Wei-An Wang , Chu-Song Chen

This paper presents a novel risk-sensitive trading agent combining reinforcement learning and large language models (LLMs). We extend the Conditional Value-at-Risk Proximal Policy Optimization (CPPO) algorithm, by adding risk assessment and…

Trading and Market Microstructure · Quantitative Finance 2025-02-12 Mostapha Benhenda

We present Mind DeepResearch (MindDR), an efficient multi-agent deep research framework that achieves leading performance with only ~30B-parameter models through a meticulously designed data synthesis and multi-stage training pipeline. The…

Artificial Intelligence · Computer Science 2026-04-20 MindDR Team , Li Auto Inc

Financial tasks are pivotal to global economic stability; however, their execution faces challenges including labor intensive processes, low error tolerance, data fragmentation, and tool limitations. Although large language models (LLMs)…

Artificial Intelligence · Computer Science 2025-05-21 Junzhe Jiang , Chang Yang , Aixin Cui , Sihan Jin , Ruiyu Wang , Bo Li , Xiao Huang , Dongning Sun , Xinrun Wang

LLMs have transformed NLP and shown promise in various fields, yet their potential in finance is underexplored due to a lack of comprehensive evaluation benchmarks, the rapid development of LLMs, and the complexity of financial tasks. In…

Effective deep search agents must not only access open-domain and domain-specific knowledge but also apply complex rules-such as legal clauses, medical manuals and tariff rules. These rules often feature vague boundaries and implicit logic…

Artificial Intelligence · Computer Science 2025-10-23 Yiqian Yang , Tian Lan , Qianghuai Jia , Li Zhu , Hui Jiang , Hang Zhu , Longyue Wang , Weihua Luo , Kaifu Zhang

In recent years, the research focus of large language models (LLMs) and agents has shifted increasingly from demonstrating novel capabilities to complex reasoning and tackling challenging tasks. However, existing evaluations focus mainly on…

We introduce FinDVer, a comprehensive benchmark specifically designed to evaluate the explainable claim verification capabilities of LLMs in the context of understanding and analyzing long, hybrid-content financial documents. FinDVer…

Computation and Language · Computer Science 2024-11-11 Yilun Zhao , Yitao Long , Yuru Jiang , Chengye Wang , Weiyuan Chen , Hongjun Liu , Yiming Zhang , Xiangru Tang , Chen Zhao , Arman Cohan

While agent evaluation has shifted toward long-horizon tasks, most benchmarks still emphasize local, step-level reasoning rather than the global constrained optimization (e.g., time and financial budgets) that demands genuine planning…

Artificial Intelligence · Computer Science 2026-01-27 Yinger Zhang , Shutong Jiang , Renhao Li , Jianhong Tu , Yang Su , Lianghao Deng , Xudong Guo , Chenxu Lv , Junyang Lin

Recent advancements have underscored the potential of large language model (LLM)-based agents in financial decision-making. Despite this progress, the field currently encounters two main challenges: (1) the lack of a comprehensive LLM agent…

Large language models (LLMs) excel at generating human-like responses but often struggle with interactive tasks that require access to real-time information. This limitation poses challenges in finance, where models must access up-to-date…

Information Retrieval · Computer Science 2026-03-02 Ankur Sinha , Chaitanya Agarwal , Pekka Malo

Large language models excel in general tasks, yet assessing their reliability in logic-heavy, precision-critical domains like finance, law, and healthcare remains challenging. To address this, we introduce BizFinBench, the first benchmark…

Artificial Intelligence · Computer Science 2025-05-27 Guilong Lu , Xuntao Guo , Rongjunchen Zhang , Wenqiao Zhu , Ji Liu

Large Language Models (LLMs) have shown promise for financial applications, yet their suitability for this high-stakes domain remains largely unproven due to inadequacies in existing benchmarks. Existing benchmarks solely rely on…

Computational Engineering, Finance, and Science · Computer Science 2025-08-26 Ziyan Kuang , Feiyu Zhu , Maowei Jiang , Yanzhao Lai , Zelin Wang , Zhitong Wang , Meikang Qiu , Jiajia Huang , Min Peng , Qianqian Xie , Sophia Ananiadou

Large Language Models (LLMs) are increasingly utilized in scientific research assessment, particularly in automated paper review. However, existing LLM-based review systems face significant challenges, including limited domain expertise,…

Computation and Language · Computer Science 2025-03-12 Minjun Zhu , Yixuan Weng , Linyi Yang , Yue Zhang